Update README.md
Browse files
README.md
CHANGED
|
@@ -21,9 +21,9 @@ axolotl version: `0.5.0`
|
|
| 21 |
|
| 22 |
</details><br>
|
| 23 |
|
| 24 |
-
#
|
| 25 |
|
| 26 |
-
This
|
| 27 |
It achieves the following results on the evaluation set:
|
| 28 |
- Loss: 0.3203
|
| 29 |
|
|
@@ -33,11 +33,13 @@ More information needed
|
|
| 33 |
|
| 34 |
## Intended uses & limitations
|
| 35 |
|
| 36 |
-
|
| 37 |
|
| 38 |
## Training and evaluation data
|
| 39 |
|
| 40 |
-
|
|
|
|
|
|
|
| 41 |
|
| 42 |
## Training procedure
|
| 43 |
|
|
@@ -67,6 +69,9 @@ The following hyperparameters were used during training:
|
|
| 67 |
| 0.3248 | 0.6669 | 2486 | 0.3203 |
|
| 68 |
|
| 69 |
|
|
|
|
|
|
|
|
|
|
| 70 |
### Framework versions
|
| 71 |
|
| 72 |
- PEFT 0.13.2
|
|
|
|
| 21 |
|
| 22 |
</details><br>
|
| 23 |
|
| 24 |
+
# Collinear Curator 1:
|
| 25 |
|
| 26 |
+
This is an open-source fine-tuned reasoning adapter of [microsoft/Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct), transformed into a math reasoning model using data curated from [collinear-ai/R1-Distill-SFT-Curated](https://huggingface.co/datasets/collinear-ai/R1-Distill-SFT-Curated).
|
| 27 |
It achieves the following results on the evaluation set:
|
| 28 |
- Loss: 0.3203
|
| 29 |
|
|
|
|
| 33 |
|
| 34 |
## Intended uses & limitations
|
| 35 |
|
| 36 |
+
Math Reasoning
|
| 37 |
|
| 38 |
## Training and evaluation data
|
| 39 |
|
| 40 |
+
- Training data: [collinear-ai/R1-Distill-SFT-Curated](https://huggingface.co/datasets/collinear-ai/R1-Distill-SFT-Curated)
|
| 41 |
+
- Evaluation data: [HuggingFaceH4/MATH-500](https://huggingface.co/datasets/HuggingFaceH4/MATH-500)
|
| 42 |
+
|
| 43 |
|
| 44 |
## Training procedure
|
| 45 |
|
|
|
|
| 69 |
| 0.3248 | 0.6669 | 2486 | 0.3203 |
|
| 70 |
|
| 71 |
|
| 72 |
+
### Evaluation Results on Math500
|
| 73 |
+
|
| 74 |
+
|
| 75 |
### Framework versions
|
| 76 |
|
| 77 |
- PEFT 0.13.2
|