Spaces:

adilkh26
/

InternVideo2_5_Chat_8B

Build error

adilkh26 commited on Mar 2

Commit

c54660f

verified ·

1 Parent(s): cde97aa

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -15,6 +15,7 @@ model = AutoModelForCausalLM.from_pretrained(
     trust_remote_code=True,
     torch_dtype=torch.float16,  # Use float16 for lower memory usage
     device_map="auto", # Automatically place model on available GPU
 )

     trust_remote_code=True,
     torch_dtype=torch.float16,  # Use float16 for lower memory usage
     device_map="auto", # Automatically place model on available GPU
+    deepspeed={"stage": 3}      # Enable DeepSpeed ZeRO-3
 )