MIEB: Massive Image Embedding Benchmark
Paper
•
2504.10471
•
Published
•
21
MIEB
MIEB(Multilingual) is a comprehensive image embeddings benchmark, spanning 10 task types, covering 130 tasks and a total of 39 languages. In ad...
-
-
mteb/birdsnap
Viewer • Updated • 17.9k • 102 -
mteb/Caltech101
Viewer • Updated • 9.14k • 122 -
mteb/cifar10
Viewer • Updated • 60k • 87 • 2 -
mteb/cifar100
Viewer • Updated • 60k • 23 -
mteb/wds_country211
Preview • Updated • 25 -
mteb/dtd
Viewer • Updated • 5.64k • 20 -
mteb/eurosat-rgb
Viewer • Updated • 27k • 20 -
mteb/wds_fer2013
Preview • Updated • 16 -
mteb/FGVCAircraft
Viewer • Updated • 10k • 927 -
mteb/food101
Viewer • Updated • 101k • 21 -
mteb/wds_gtsrb
Preview • Updated • 18 -
mteb/wds_imagenet1k
Viewer • Updated • 1.38M • 28 -
mteb/mnist
Viewer • Updated • 70k • 21 -
mteb/oxford-flowers
Viewer • Updated • 8.19k • 14 -
mteb/OxfordPets
Viewer • Updated • 7.35k • 57 -
mteb/wds_vtab-pcam
Viewer • Updated • 295k • 21 -
mteb/resisc45
Viewer • Updated • 31.5k • 21 -
mteb/StanfordCars
Viewer • Updated • 16.2k • 142 -
mteb/stl10
Viewer • Updated • 13k • 19 -
mteb/sun397
Viewer • Updated • 109k • 27 -
mteb/ucf101
Viewer • Updated • 2.48M • 28 -
mteb/VOC2007
Viewer • Updated • 9.96k • 128 -
mteb/imagenet-dog-15
Viewer • Updated • 2.58k • 28 -
mteb/imagenet-10
Viewer • Updated • 13k • 26 -
mteb/tiny-imagenet
Viewer • Updated • 110k • 24 -
mteb/wds_vtab-clevr_closest_object_distance
Preview • Updated • 14 -
mteb/wds_vtab-clevr_count_all
Preview • Updated • 13 -
mteb/FGVCAircraftZeroShot
Viewer • Updated • 10.1k • 53 -
mteb/wds_renderedsst2
Viewer • Updated • 8.74k • 14 -
mteb/blink-it2i-multi
Viewer • Updated • 2.01k • 20 -
mteb/blink-it2t-multi
Viewer • Updated • 3.07k • 15 -
mteb/CV-Bench
Viewer • Updated • 5.28k • 28 -
mteb/ARO-COCO-order
Viewer • Updated • 25k • 30 -
mteb/ARO-Flickr-Order
Viewer • Updated • 5k • 25 -
mteb/ARO-Visual-Attribution
Viewer • Updated • 28.7k • 33 -
mteb/ARO-Visual-Relation
Viewer • Updated • 23.9k • 33 -
mteb/SUGARCREPE_fmt
Viewer • Updated • 7.51k • 15 -
facebook/winoground
Viewer • Updated • 400 • 2k • 108 -
mteb/imagecode-multi
Viewer • Updated • 48.3k • 32 -
mteb/rendered-sts12
Viewer • Updated • 5.34k • 16 -
mteb/rendered-sts13
Viewer • Updated • 1.5k • 23 -
mteb/rendered-sts14
Viewer • Updated • 3.75k • 16 -
mteb/rendered-sts15
Viewer • Updated • 3k • 20 -
mteb/rendered-sts16
Viewer • Updated • 1.19k • 18 -
mteb/blink-it2i
Viewer • Updated • 1.61k • 15 -
mteb/blink-it2t
Viewer • Updated • 1.61k • 16 -
mteb/mbeir_cirr_task7
Viewer • Updated • 29.9k • 28 -
mteb/cub200_retrieval
Viewer • Updated • 175k • 135 -
mteb/mbeir_edis_task2
Viewer • Updated • 1.06M • 17 -
mteb/mbeir_fashion200k_task3
Viewer • Updated • 71.5k • 43 -
mteb/mbeir_fashion200k_task0
Viewer • Updated • 208k • 17 -
mteb/mbeir_fashioniq_task7
Viewer • Updated • 86.4k • 15 -
mteb/flickr30ki2t
Viewer • Updated • 11k • 175 -
mteb/flickr30kt2i
Viewer • Updated • 11k • 1.24k -
mteb/forb_retrieval
Viewer • Updated • 80.5k • 109 -
mteb/gld-v2
Viewer • Updated • 778k • 24 -
mteb/gld-v2-i2t
Viewer • Updated • 4.59k • 28 -
mteb/MMSoc_HatefulMemes
Viewer • Updated • 10k • 35 -
mteb/imagecode
Viewer • Updated • 27.6k • 26 -
mteb/InfoSeekIT2ITRetrieval
Viewer • Updated • 631k • 47 -
mteb/mbeir_infoseek_task6
Viewer • Updated • 697k • 31 -
mteb/MMSoc_Memotion
Viewer • Updated • 6.99k • 20 -
mteb/met
Viewer • Updated • 521k • 28 -
mteb/mbeir_mscoco_task3
Viewer • Updated • 54.8k • 17 -
mteb/mbeir_mscoco_task0
Viewer • Updated • 54.8k • 24 -
mteb/mbeir_nights_task4
Viewer • Updated • 44.3k • 23 -
mteb/mbeir_oven_task8
Viewer • Updated • 611k • 15 -
mteb/mbeir_oven_task6
Viewer • Updated • 1.22M • 29 -
mteb/r-oxford-easy-multi
Viewer • Updated • 351k • 37 -
mteb/r-oxford-medium-multi
Viewer • Updated • 353k • 26 -
mteb/r-oxford-hard-multi
Viewer • Updated • 350k • 24 -
mteb/rp2k
Viewer • Updated • 4.49M • 34 -
mteb/r-paris-easy-multi
Viewer • Updated • 431k • 25 -
mteb/r-paris-medium-multi
Viewer • Updated • 442k • 24 -
mteb/r-paris-hard-multi
Viewer • Updated • 435k • 23 -
mteb/SciMMIR
Viewer • Updated • 531k • 38 -
mteb/sketchy
Viewer • Updated • 91.1M • 24 -
mteb/stanford-online-products
Viewer • Updated • 1.08M • 27 -
mteb/stanford_cars_retrieval
Viewer • Updated • 342k • 116 -
mteb/tu-berlin
Viewer • Updated • 40.3k • 18 -
mteb/arxivqa_test_subsampled_beir
Viewer • Updated • 1.5k • 26 -
mteb/docvqa_test_subsampled_beir
Viewer • Updated • 1.45k • 19 -
mteb/infovqa_test_subsampled_beir
Viewer • Updated • 1.49k • 20 -
mteb/tabfquad_test_subsampled_beir
Viewer • Updated • 630 • 30 -
mteb/tatdqa_test_beir
Viewer • Updated • 3.58k • 19 -
mteb/shiftproject_test_beir
Viewer • Updated • 1.2k • 17 -
mteb/syntheticDocQA_artificial_intelligence_test_beir
Viewer • Updated • 1.17k • 19 -
mteb/syntheticDocQA_energy_test_beir
Viewer • Updated • 1.18k • 14 -
mteb/syntheticDocQA_government_reports_test_beir
Viewer • Updated • 1.17k • 15 -
mteb/syntheticDocQA_healthcare_industry_test_beir
Viewer • Updated • 1.16k • 205 -
mteb/mbeir_visualnews_task3
Viewer • Updated • 578k • 27 -
mteb/mbeir_visualnews_task0
Viewer • Updated • 582k • 20 -
mteb/vizwiz
Viewer • Updated • 10.7k • 19 -
mteb/vqa-2
Viewer • Updated • 450k • 26 -
mteb/mbeir_webqa_task2
Viewer • Updated • 409k • 27 -
mteb/mbeir_webqa_task1
Viewer • Updated • 552k • 14 -
mteb/wit
Viewer • Updated • 8.55k • 91 -
mteb/xflickrco
Viewer • Updated • 16k • 23 -
mteb/xm3600
Updated • 30 -
Pixel-Linguist/rendered-sts17
Viewer • Updated • 10.7k • 26 -
Pixel-Linguist/rendered-stsb
Viewer • Updated • 173k • 138 • 3