Haleshot/Mathmate-7B-DELLA-ORPO
7B • Updated • 2
Edit Models filters
Model Tree
Apps
Inference Providers
Models
179
Active filters: preference-learning
ilgee/Binary-Think-RM-8B
8B • Updated • 1
ilgee/Multiclass-Think-RM-8B
8B • Updated • 3
codelion/gemma-3-1b-it-reasoning-grpo-lora
Text Generation • Updated • 14 • 5
ilgee/Binary-Think-RM-3B
3B • Updated • 2 • 1
codelion/Qwen2.5-Coder-0.5B-Instruct-security-grpo-lora
Text Generation • Updated • 26
pyamy/llama3-dpo-pairrm
Updated
pyamy/llama3-dpo-llm-judge
Updated • 2
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated • 2
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 1
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 1
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated • 2
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 1
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 1
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 1
5456es/implicit_reward_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated • 2
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated • 1
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 1
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.5-sigmoid
2B • Updated
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.5-sigmoid
2B • Updated • 1