Skip to content

llama-bench : add test measuring token generation rate at given prompt length#11126

Closed
fairydreaming wants to merge 3 commits intoggml-org:masterfrom
fairydreaming:llama-bench-gp
Closed

llama-bench : add test measuring token generation rate at given prompt length#11126
fairydreaming wants to merge 3 commits intoggml-org:masterfrom
fairydreaming:llama-bench-gp