Instructions to use mlc-ai/gemma-2b-it-q4f16_1-MLC with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLC-LLM
How to use mlc-ai/gemma-2b-it-q4f16_1-MLC with MLC-LLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Update mlc-chat-config.json
Browse files- mlc-chat-config.json +1 -1
mlc-chat-config.json
CHANGED
|
@@ -34,7 +34,7 @@
|
|
| 34 |
"top_p": 0.95,
|
| 35 |
"conv_template": {
|
| 36 |
"name": "gemma_instruction",
|
| 37 |
-
"system_template": "{system_message}",
|
| 38 |
"system_message": "",
|
| 39 |
"system_prefix_token_ids": [
|
| 40 |
2
|
|
|
|
| 34 |
"top_p": 0.95,
|
| 35 |
"conv_template": {
|
| 36 |
"name": "gemma_instruction",
|
| 37 |
+
"system_template": "<bos>{system_message}",
|
| 38 |
"system_message": "",
|
| 39 |
"system_prefix_token_ids": [
|
| 40 |
2
|