Hugging Face's logo
Rapidata's picture

Rapidata

RapidataAI
1 2 58
LinoGiger's profile picture caldarons's profile picture Banaxi-Tech's profile picture
·
https://rapidata.ai

AI & ML interests

Human Data

Recent Activity

liked a model 2 days ago
NucleusAI/Nucleus-Image
repliedto jasoncorkill's post 14 days ago
Most public benchmarks collapse model performance into one broad preference signal. That makes it hard to understand which capabilities differentiate between models. It's also almost impossible to inspect the evidence behind it. So @RapidataAI is releasing Benchmark.AI. We started with an SVG generation benchmark including 42 models, 500 prompts, 1.9M+ human judgements, 300K+ match-ups. We evaluate models separately on Preference, Alignment and Coherence, while making the prompts, outputs, match-ups and methodology public. Full dataset: https://huggingface.co/datasets/Rapidata/svg-benchmark Full benchmark: https://www.benchmark.ai/svg Methodology feedback and benchmark suggestions very welcome!
repliedto jasoncorkill's post 14 days ago
Most public benchmarks collapse model performance into one broad preference signal. That makes it hard to understand which capabilities differentiate between models. It's also almost impossible to inspect the evidence behind it. So @RapidataAI is releasing Benchmark.AI. We started with an SVG generation benchmark including 42 models, 500 prompts, 1.9M+ human judgements, 300K+ match-ups. We evaluate models separately on Preference, Alignment and Coherence, while making the prompts, outputs, match-ups and methodology public. Full dataset: https://huggingface.co/datasets/Rapidata/svg-benchmark Full benchmark: https://www.benchmark.ai/svg Methodology feedback and benchmark suggestions very welcome!
View all activity

Organizations

Rapidata's profile picture