How to use trl-internal-testing/tiny-PeftModel with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("trl-internal-testing/tiny-PeftModel", dtype="auto")