apr bench

Benchmark throughput (spec H12: >= 10 tok/s)

Category: Quality & Evaluation

Synopsis

apr bench [OPTIONS]

Example

apr bench qwen2.5-coder-1.5b-instruct-q4_k_m.gguf --iterations 10

Full help

Run apr bench --help for the complete option list.

See also