Spaces:
Running
on
A100
Running
on
A100
Commit History
fix Qwen3ForCausalLM has no attribute
13bcd3e
Gong Junmin
commited on
fix Qwen3ForCausalLM has no attribute
259f26f
Gong Junmin
commited on
max_model_len 8192 -> 4096
12bc51a
feat: change windows dependencies
7534053
fix api server no duration
def62ce
feat: update dependencies
a7270bf
fix bugs and test profile
03f73c6
add inference code and doc
11860f1
feat: update uv dependencies
e161e9a
feat: windows support
26b4474
add MetadataConstrainedLogitsProcessor
59f5a8a
add api
0228d48
refact handler
376c43e
fix vllm
a3b47b7
add 5hz llm
25e1b40
first commit
11a221a
Gong Junmin
commited on