lightonai
/

LightOnOCR-2-1B

Image-Text-to-Text

text-generation

document-understanding

vision-language

🇪🇺 Region: EU

Model card Files Files and versions

whats the best settings to run using vllm at very high concurrency

#19

by markwitt1 - opened 19 days ago

19 days ago

When running VLLM server, which settings do i need to efficiently process 70 pages at once?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment