| ================================================================================ | |
| MULTILINGUAL MODEL PERFORMANCE REPORT | |
| ================================================================================ | |
| 🇬🇧 ENGLISH RESULTS: | |
| LOSS: 1.9937 | |
| ROUGE1: 0.6282 | |
| ROUGE2: 0.3710 | |
| ROUGEL: 0.6272 | |
| BLEU: 37.7922 | |
| EXACT_MATCH: 0.4360 | |
| F1: 0.6329 | |
| AVG_EXACT_F1: 0.5344 | |
| 🇩🇪 GERMAN RESULTS: | |
| LOSS: 0.5970 | |
| ROUGE1: 0.6646 | |
| ROUGE2: 0.4064 | |
| ROUGEL: 0.6622 | |
| BLEU: 43.1204 | |
| EXACT_MATCH: 0.4874 | |
| F1: 0.6580 | |
| AVG_EXACT_F1: 0.5727 | |
| ================================================================================ | |
| Model trained on: | |
| - English: SQuAD (20,000 samples) | |
| - German: XQuAD (~1,000 samples) | |
| ================================================================================ | |