Image-Text-to-Text
Transformers
English
finance
medical
AD
MLLM-CL
Sci
RS
Math
OCR
Count
GUI-Agent
DCL
ACL
llava
multimodal
image-to-text
text-generation
Instructions to use MLLM-CL/MRLoRA_Experts with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MLLM-CL/MRLoRA_Experts with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="MLLM-CL/MRLoRA_Experts")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("MLLM-CL/MRLoRA_Experts", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use MLLM-CL/MRLoRA_Experts with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "MLLM-CL/MRLoRA_Experts" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "MLLM-CL/MRLoRA_Experts", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/MLLM-CL/MRLoRA_Experts
- SGLang
How to use MLLM-CL/MRLoRA_Experts with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "MLLM-CL/MRLoRA_Experts" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "MLLM-CL/MRLoRA_Experts", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "MLLM-CL/MRLoRA_Experts" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "MLLM-CL/MRLoRA_Experts", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use MLLM-CL/MRLoRA_Experts with Docker Model Runner:
docker model run hf.co/MLLM-CL/MRLoRA_Experts
Commit History
-
Improve model card: Update pipeline tag, add dataset, and HF paper link (#3)
Verified signature- Improve model card: Update pipeline tag, add dataset, and HF paper link (ffb8dcbd44ce70e1773b7ccb95f1000f83346880) Co-authored-by: Niels Rogge <[email protected]>26920cd
-
update metadata (#2)
Verified signature- update metadata (3f1b9a8e0fa885edacb2fac81d2d8944e2f508ac)90b19d0 -
Update README.md
Verified signaturec52f944 -
Delete community.jpeg
Verified signature8eaab90 -
Update README.md
Verified signature897f8a5 -
Update README.md
Verified signature6e97bc7 -
Upload MLLM-CL.png
Verified signature5e3db0e -
Update README.md
Verified signature542e863 -
Update README.md
Verified signature5a95779 -
Update README.md
Verified signatureec53577 -
Update README.md
Verified signature99db085 -
Update README.md
Verified signature0f4f1d0 -
Upload community.jpeg
Verified signaturec1618bb -
Update README.md
Verified signature87cfb6f -
Create README.md (#1)
Verified signature- Create README.md (f90deb0bfd3bd624b15349a0747a26e08acef5b6)e3f3489
-
initial commit
Verified signature9d9fef9