Spaces:
Running
on
A100
Error
"CUDA error: device-side assert triggered" WHEN I TRIED TO GENERATE!
same here. looks like they need to fix the demo app. I was hoping to play with it some while at work
Same here :(
I wanted to check out the possibility of purchasing access, but it turned out it wasn't a working product. I guess I'll have to give it up.
Please fix it so it works!
The current nano-vllm implementation is somewhat unstable, causing crashes for too many requests. In the short term, this problem can only be mitigated through reboots. New vllm-based implementations are in development.
R.I.P. ace step 1.5 hugging face space 2026-2026 (until it's fixed)
same in here
โ LM generation failed: Error in batch codes generation: CUDA error: device-side assert triggered
Search for cudaErrorAssert' in https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__TYPES.html for more information. CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with TORCH_USE_CUDA_DSA` to enable device-side assertions.
please fix it
Thanks a lot!