Instructions to use google/switch-base-32 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/switch-base-32 with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("google/switch-base-32") model = AutoModelForSeq2SeqLM.from_pretrained("google/switch-base-32") - Notebooks
- Google Colab
- Kaggle
Convert t5x checkpoint of switch to pytorch
#9
by Siddharth63 - opened
Hi. I have pretrained my own switch transformers model using ul2 training procedure with t5x. I have got t5x checkpoint. which script to use to convert the t5x checkpoint to flax/pytorch model.