File size: 597 Bytes
740ad41 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
license: mit
datasets:
- sms1097/self_rag_tokens_train_data
---
# Support Model
This generates the `IsSupported` token as descirbed in Self-RAG.
We are testing to see if a generated LLM answer is supported by the document. This is similar to testing for a hallucination in the model result.
The expected input to the model is shown here:
```
Context: {'doc'}\nAnswer: {answer}"
```
### Training results:
```
{'eval_loss': 0.11030498147010803,
'eval_mse': 0.11030498147010803,
'eval_mae': 0.14249496161937714,
'eval_r2': 0.6906673524053266,
'eval_accuracy': 0.9117161716171617}
``` |