Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Data Selection

community

https://github.com/microsoft/LMOps/tree/main/data_selection

AI & ML interests

Data Selection for Language Models

Data-Selection 's collections 2

Baseline Models

Models Trained on Redpajama-CC

Data-Selection/BSL-160M

Text Generation • Updated Oct 28, 2024 • 697
Data-Selection/BSL-470M

Text Generation • Updated Oct 28, 2024 • 672
Data-Selection/BSL-1.7B

Text Generation • Updated Mar 25, 2025 • 24
Data-Selection/BSL-1B

Text Generation • Updated Oct 28, 2024 • 28

Models trained on PDS-Selected Data

Data-Selection/PDS-160M

Text Generation • 0.2B • Updated Mar 25, 2025 • 32
Data-Selection/PDS-470M

Text Generation • 0.5B • Updated Mar 25, 2025 • 32
Data-Selection/PDS-1B

Text Generation • Updated Mar 25, 2025 • 282
Data-Selection/PDS-1.7B

Text Generation • Updated Mar 25, 2025 • 695

Baseline Models

Models Trained on Redpajama-CC

Data-Selection/BSL-160M

Text Generation • Updated Oct 28, 2024 • 697
Data-Selection/BSL-470M

Text Generation • Updated Oct 28, 2024 • 672
Data-Selection/BSL-1.7B

Text Generation • Updated Mar 25, 2025 • 24
Data-Selection/BSL-1B

Text Generation • Updated Oct 28, 2024 • 28

Models trained on PDS-Selected Data

Data-Selection/PDS-160M

Text Generation • 0.2B • Updated Mar 25, 2025 • 32
Data-Selection/PDS-470M

Text Generation • 0.5B • Updated Mar 25, 2025 • 32
Data-Selection/PDS-1B

Text Generation • Updated Mar 25, 2025 • 282
Data-Selection/PDS-1.7B

Text Generation • Updated Mar 25, 2025 • 695

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs