Simple Self-Distillation
AI & ML interests
None defined yet.
Recent Activity
Papers
TopoPrimer: The Missing Topological Context in Forecasting Models
Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why
Team members 743 private
Efficient Vision Encoding for Vision Language Models
Benchmark for the design of efficient continual learning of image-text models over years.
AIM: Autoregressive Image Models
CLaRa models
MobileCLIP2: Mobile-friendly image-text models with SOTA zero-shot capabilities trained on DFNDR-2B
A collection of AIMv2 vision encoders that supports a number of resolutions, native resolution, and a distilled checkpoint.
-
apple/aimv2-large-patch14-224
Image Feature Extraction • 0.3B • Updated • 1.1k • 62 -
apple/aimv2-huge-patch14-224
Image Feature Extraction • 0.7B • Updated • 216 • 13 -
apple/aimv2-1B-patch14-224
Image Feature Extraction • 1B • Updated • 147 • 8 -
apple/aimv2-3B-patch14-224
Image Feature Extraction • 3B • Updated • 244 • 4
MobileCLIP: Mobile-friendly image-text models with SOTA zero-shot capabilities.
DataCompDR: Improved datasets for training image-text SOTA models.
-
MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training
Paper • 2311.17049 • Published • 8 -
apple/mobileclip_s0_timm
Image Classification • Updated • 269 • 12 -
apple/mobileclip_s1_timm
Image Classification • Updated • 38 • 3 -
apple/mobileclip_s2_timm
Image Classification • Updated • 109 • 6
Depth Pro: Sharp Monocular Metric Depth in Less Than a Second
CLIP Models trained using DFN-2B/DFN-5B datasets
DCLM Models + Datasets
Simple Self-Distillation
CLaRa models
Efficient Vision Encoding for Vision Language Models
MobileCLIP2: Mobile-friendly image-text models with SOTA zero-shot capabilities trained on DFNDR-2B
A collection of AIMv2 vision encoders that supports a number of resolutions, native resolution, and a distilled checkpoint.
-
apple/aimv2-large-patch14-224
Image Feature Extraction • 0.3B • Updated • 1.1k • 62 -
apple/aimv2-huge-patch14-224
Image Feature Extraction • 0.7B • Updated • 216 • 13 -
apple/aimv2-1B-patch14-224
Image Feature Extraction • 1B • Updated • 147 • 8 -
apple/aimv2-3B-patch14-224
Image Feature Extraction • 3B • Updated • 244 • 4
MobileCLIP: Mobile-friendly image-text models with SOTA zero-shot capabilities.
DataCompDR: Improved datasets for training image-text SOTA models.
-
MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training
Paper • 2311.17049 • Published • 8 -
apple/mobileclip_s0_timm
Image Classification • Updated • 269 • 12 -
apple/mobileclip_s1_timm
Image Classification • Updated • 38 • 3 -
apple/mobileclip_s2_timm
Image Classification • Updated • 109 • 6
Benchmark for the design of efficient continual learning of image-text models over years.
Depth Pro: Sharp Monocular Metric Depth in Less Than a Second
CLIP Models trained using DFN-2B/DFN-5B datasets
AIM: Autoregressive Image Models
DCLM Models + Datasets