I got 10 tok/s
#1
by ehartford - opened
I got 10 tok/s
I have latest ROCm and drivers
clap clap
you have 8x mi300x ?
Are there any updates on using more recent versions of vLLM? v0.19.2rc1.dev21 is no longer available and is way behind the current version