Unable to run on M3 Ultra 512GB RAM
#1
by
vibhuc
- opened
Running into loading issues with this model on M3 Ultra (Mac Studio). Tried both Inferencer and LM Studio—neither can initialize it. Anyone else seeing this, or is there a specific requirement I'm missing?
Double check to see if you downloaded the full 470GB, it only finished uploading yesterday.
Hi, I do have the same issue with the model. Can anyone run this?
🥲 Failed to load the model
Failed to load model
Error when loading model: AttributeError: 'NoneType' object has no attribute 'from_pretrained'
What are you using to inference the model?
Interesting, in Inferencer it does work. In LMStudio it doesn't. Thanks!
ah I tried downloading it again, and it seems to work now (using Inferencer 1.9.3 though)
Doesn't work on LMStudio:
🥲 Failed to load the model
Failed to load model
Error when loading model: AttributeError: 'NoneType' object has no attribute 'from_pretrained'