Skip to content

vLLM Benchmark

vLLM Benchmark #1611

Manually triggered March 7, 2026 03:56
Status Failure
Total duration 5h 45m 27s
Artifacts 3

vllm-benchmark.yml

on: workflow_dispatch
set-parameters
5s
set-parameters
Matrix: Run vLLM benchmarks
Fit to window
Zoom out
Zoom in

Annotations

23 errors and 6 warnings
Run vLLM benchmarks (linux.dgx.b200, pytorch/gemma-3-27b-it-int4)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200, openai/gpt-oss-20b)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200.8, deepseek-ai/deepseek-r1)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200, pytorch/gemma-3-12b-it-fp8)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200, pytorch/gemma-3-12b-it-int4)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200.8, openai/gpt-oss-120b)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200, pytorch/gemma-3-27b-it-fp8)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100.4, openai/gpt-oss-120b)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100.4, mistralai/mixtral-8x7b-instruct-v0.1)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, qwen/qwen3-8b)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200, facebook/opt-125m)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200.8, qwen/qwen3-30b-a3b)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200.8, deepseek-ai/deepseek-v3.2)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, openai/gpt-oss-20b)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, pytorch/gemma-3-27b-it-int4)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, pytorch/gemma-3-27b-it-fp8)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, google/gemma-3-4b-it)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, pytorch/gemma-3-12b-it-fp8)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, pytorch/gemma-3-12b-it-int4)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200.8, google/gemma-3-27b-it)
Process completed with exit code 1.
Run vLLM benchmarks (linux.aws.h100, facebook/opt-125m)
Process completed with exit code 1.
Run vLLM benchmarks (linux.dgx.b200.8, meta-llama/llama-4-scout-17b-16e-instruct)
Process completed with exit code 1.
Run vLLM benchmarks (linux.rocm.gpu.gfx942.1, qwen/qwen3-8b)
Unexpected input(s) 'aws-region', valid inputs are ['http-proxy', 'mask-password', 'registries', 'registry-type', 'skip-logout']
Run vLLM benchmarks (linux.rocm.gpu.gfx942.1, qwen/qwen3-8b)
Unexpected input(s) 'aws-region', valid inputs are ['http-proxy', 'mask-password', 'registries', 'registry-type', 'skip-logout']
Run vLLM benchmarks (linux.rocm.gpu.gfx942.2, mistralai/mixtral-8x7b-instruct-v0.1)
Unexpected input(s) 'aws-region', valid inputs are ['http-proxy', 'mask-password', 'registries', 'registry-type', 'skip-logout']
Run vLLM benchmarks (linux.rocm.gpu.gfx942.2, mistralai/mixtral-8x7b-instruct-v0.1)
Unexpected input(s) 'aws-region', valid inputs are ['http-proxy', 'mask-password', 'registries', 'registry-type', 'skip-logout']
Run vLLM benchmarks (linux.rocm.gpu.gfx942.1, facebook/opt-125m)
Unexpected input(s) 'aws-region', valid inputs are ['http-proxy', 'mask-password', 'registries', 'registry-type', 'skip-logout']
Run vLLM benchmarks (linux.rocm.gpu.gfx942.1, facebook/opt-125m)
Unexpected input(s) 'aws-region', valid inputs are ['http-proxy', 'mask-password', 'registries', 'registry-type', 'skip-logout']

Artifacts

Produced during runtime
Name Size Digest
benchmark-results--AMD_Instinct_MI325X-facebook_opt-125m
99.7 KB
sha256:dd0613d5443540998fc83c892c5ef7438a19070895de675b4aff953f58c10e55
benchmark-results--AMD_Instinct_MI325X-mistralai_mixtral-8x7b-instruct-v0.1
69.7 KB
sha256:447e4dc05a81dfe61931f1c6998c52992f85aec7c94cc6cde754ce79374cbb8a
benchmark-results--AMD_Instinct_MI325X-qwen_qwen3-8b
12.6 KB
sha256:effe600b1879b924a41fd2507cdde5d4f02dc4698c1876b1575e76f87129aa0b