Automatic Speech Recognition
Transformers
PyTorch
TensorBoard
Italian
whisper
whisper-event
Generated from Trainer
Eval Results (legacy)
Instructions to use mattiasu96/whisper-tiny-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mattiasu96/whisper-tiny-it with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="mattiasu96/whisper-tiny-it")# Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("mattiasu96/whisper-tiny-it") model = AutoModelForSpeechSeq2Seq.from_pretrained("mattiasu96/whisper-tiny-it", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
4e7bf93
1
Parent(s): 7fa131d
Training in progress, step 1000
Browse files- pytorch_model.bin +1 -1
- run.sh +1 -39
- runs/Dec12_17-37-06_whisper/events.out.tfevents.1670912612.whisper +2 -2
- runs/Dec13_08-03-51_whisper/1670918648.8614848/events.out.tfevents.1670918648.whisper +3 -0
- runs/Dec13_08-03-51_whisper/events.out.tfevents.1670918648.whisper +3 -0
- runs/Dec13_08-05-22_whisper/1670918740.477143/events.out.tfevents.1670918740.whisper +3 -0
- runs/Dec13_08-05-22_whisper/events.out.tfevents.1670918740.whisper +3 -0
- runs/Dec13_08-50-07_whisper/1670921425.5471199/events.out.tfevents.1670921425.whisper +3 -0
- runs/Dec13_08-50-07_whisper/events.out.tfevents.1670921425.whisper +3 -0
- training_args.bin +1 -1
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 151097331
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:be6dbe79131537bd3b7b0227d78479416263455eebd5bac865985bfbdc1a806f
|
| 3 |
size 151097331
|
run.sh
CHANGED
|
@@ -6,45 +6,7 @@ python run_speech_recognition_seq2seq_streaming.py \
|
|
| 6 |
--train_split_name="train" \
|
| 7 |
--eval_split_name="test" \
|
| 8 |
--model_index_name="Whisper tiny italian - Mattia Surricchio" \
|
| 9 |
-
--max_steps="
|
| 10 |
-
--output_dir="./" \
|
| 11 |
-
--per_device_train_batch_size="64" \
|
| 12 |
-
--per_device_eval_batch_size="32" \
|
| 13 |
-
--logging_steps="25" \
|
| 14 |
-
--learning_rate="1e-5" \
|
| 15 |
-
--warmup_steps="500" \
|
| 16 |
-
--evaluation_strategy="steps" \
|
| 17 |
-
--eval_steps="1000" \
|
| 18 |
-
--save_strategy="steps" \
|
| 19 |
-
--save_steps="1000" \
|
| 20 |
-
--generation_max_length="225" \
|
| 21 |
-
--length_column_name="input_length" \
|
| 22 |
-
--max_duration_in_seconds="30" \
|
| 23 |
-
--text_column_name="sentence" \
|
| 24 |
-
--freeze_feature_encoder="False" \
|
| 25 |
-
--report_to="tensorboard" \
|
| 26 |
-
--metric_for_best_model="wer" \
|
| 27 |
-
--greater_is_better="False" \
|
| 28 |
-
--load_best_model_at_end \
|
| 29 |
-
--gradient_checkpointing \
|
| 30 |
-
--fp16 \
|
| 31 |
-
--overwrite_output_dir \
|
| 32 |
-
--do_train \
|
| 33 |
-
--do_eval \
|
| 34 |
-
--predict_with_generate \
|
| 35 |
-
--do_normalize_eval \
|
| 36 |
-
--streaming \
|
| 37 |
-
--use_auth_token \
|
| 38 |
-
--push_to_hub
|
| 39 |
-
python run_speech_recognition_seq2seq_streaming.py \
|
| 40 |
-
--model_name_or_path="openai/whisper-tiny" \
|
| 41 |
-
--dataset_name="mozilla-foundation/common_voice_11_0" \
|
| 42 |
-
--dataset_config_name="it" \
|
| 43 |
-
--language="italian" \
|
| 44 |
-
--train_split_name="train" \
|
| 45 |
-
--eval_split_name="test" \
|
| 46 |
-
--model_index_name="Whisper tiny italian - Mattia Surricchio" \
|
| 47 |
-
--max_steps="5000" \
|
| 48 |
--output_dir="./" \
|
| 49 |
--per_device_train_batch_size="32" \
|
| 50 |
--per_device_eval_batch_size="32" \
|
|
|
|
| 6 |
--train_split_name="train" \
|
| 7 |
--eval_split_name="test" \
|
| 8 |
--model_index_name="Whisper tiny italian - Mattia Surricchio" \
|
| 9 |
+
--max_steps="7000" \
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
--output_dir="./" \
|
| 11 |
--per_device_train_batch_size="32" \
|
| 12 |
--per_device_eval_batch_size="32" \
|
runs/Dec12_17-37-06_whisper/events.out.tfevents.1670912612.whisper
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4b0b5b1629944339b18dd3405418dc109113291b805d911278e7c13bf7e976a0
|
| 3 |
+
size 358
|
runs/Dec13_08-03-51_whisper/1670918648.8614848/events.out.tfevents.1670918648.whisper
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8349755527f4ab64a152201ea7d9a9d152f3623b80f1a6f9d4155f0016237453
|
| 3 |
+
size 5597
|
runs/Dec13_08-03-51_whisper/events.out.tfevents.1670918648.whisper
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:380d1b9a52b4a0b6956592cc67967932400127b901422e03392002a807c502cf
|
| 3 |
+
size 4254
|
runs/Dec13_08-05-22_whisper/1670918740.477143/events.out.tfevents.1670918740.whisper
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e593aee2d037dd8e887661ed427bf1ecbcba7f26e91faf2ed806c20c754ea306
|
| 3 |
+
size 5597
|
runs/Dec13_08-05-22_whisper/events.out.tfevents.1670918740.whisper
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3c43ee889c5dd6cafa11486be38ce4b96c16438075756f9f6c93c918b934bd1b
|
| 3 |
+
size 6437
|
runs/Dec13_08-50-07_whisper/1670921425.5471199/events.out.tfevents.1670921425.whisper
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b51d5419a56d12be283746ee7757f1be047e67097bcd95a84508c577b9c20cec
|
| 3 |
+
size 5597
|
runs/Dec13_08-50-07_whisper/events.out.tfevents.1670921425.whisper
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1fc22e581ff81cb7c456831960e07c1dc6f4aced96f0644d8bf299078c436b35
|
| 3 |
+
size 10519
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3567
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f8fa948822adc22616636e17a8d70c1fc17c7ee624ab60f8b2e7da3ddf48a9da
|
| 3 |
size 3567
|