Any-to-Any
Transformers
Safetensors
multilingual
minicpmo
feature-extraction
minicpm-o
omni
vision
ocr
multi-image
video
custom_code
audio
speech
voice cloning
live Streaming
realtime speech conversation
asr
tts
Instructions to use openbmb/MiniCPM-o-2_6 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openbmb/MiniCPM-o-2_6 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("openbmb/MiniCPM-o-2_6", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
`streaming_prefill` can't handle the parameter `omni_input=False`
#31
by yzmyyff - opened
https://huggingface.co/openbmb/MiniCPM-o-2_6/blob/main/modeling_minicpmo.py#L1093
if omni_input=False it should join the cur_msgs too.
cur_contents = "".join(cur_msgs) if omni_input else "\n".join(omni_input)
BTW, I don't fully understand when omni_input should be False. could you provide some more doc?
Only image or audio input, then omni_input=false
Cuiunbo changed discussion status to closed