legacy-datasets/common_voice
Updated β’ 975 β’ 147
How to use AndrewMcDowell/wav2vec2-xls-r-1b-japanese-hiragana-katakana with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="AndrewMcDowell/wav2vec2-xls-r-1b-japanese-hiragana-katakana") # Load model directly
from transformers import AutoProcessor, AutoModelForCTC
processor = AutoProcessor.from_pretrained("AndrewMcDowell/wav2vec2-xls-r-1b-japanese-hiragana-katakana")
model = AutoModelForCTC.from_pretrained("AndrewMcDowell/wav2vec2-xls-r-1b-japanese-hiragana-katakana", device_map="auto")YAML Metadata Error:"model-index[0].name" is not allowed to be empty
This model is a fine-tuned version of facebook/wav2vec2-xls-r-1b on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - JA dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
|---|---|---|---|---|---|
| 1.7019 | 12.65 | 1000 | 1.0510 | 0.9832 | 0.2589 |
| 1.6385 | 25.31 | 2000 | 0.6670 | 0.9915 | 0.1851 |
| 1.4344 | 37.97 | 3000 | 0.6183 | 1.0213 | 0.1797 |
mozilla-foundation/common_voice_8_0 with split testpython ./eval.py --model_id AndrewMcDowell/wav2vec2-xls-r-1b-japanese-hiragana-katakana --dataset mozilla-foundation/common_voice_8_0 --config ja --split test --log_outputs
mozilla-foundation/common_voice_8_0 with split testpython ./eval.py --model_id AndrewMcDowell/wav2vec2-xls-r-1b-japanese-hiragana-katakana --dataset speech-recognition-community-v2/dev_data --config de --split validation --chunk_length_s 5.0 --stride_length_s 1.0