Banaxi Inc. PRO

Banaxi-Tech

Banaxi-Tech

AI & ML interests

SLMs, training from scratch, LoRA, TTS

Recent Activity

new activity about 9 hours ago

BananaMind/BananaMind-Content-Safety-Mini-1.5:Just asking...

new activity about 12 hours ago

AxiomicLabs/Open_SLM_Leaderboard:Which measure?

posted an update about 16 hours ago

Hello AI Community! 👋 We currently have a new AI Model and we are currently training it. We are training it on 27B tokens and are currently 8% done. Follow us to be notified when it releases 🚀 Some Info: Parameters 75M GPU: RTX Pro 6000 We expect to be able to release it in the coming days EDIT: We are now at step 40000/274000 expect a Preview Model coming at about 100K

View all activity

Organizations

Posts 2

Post

Hello AI Community! 👋
We currently have a new AI Model and we are currently training it.
We are training it on 27B tokens and are currently 8% done.
Follow us to be notified when it releases 🚀
Some Info:
Parameters 75M
GPU: RTX Pro 6000
We expect to be able to release it in the coming days

EDIT: We are now at step 40000/274000 expect a Preview Model coming at about 100K

Post

We are excited to release MiniBananaMind-v2-9M

MiniBananaMind-v2-9M is a tiny causal language model trained fully from scratch on FineWeb-Edu.

It has only ~8.9M parameters, but was trained for ~3.54B tokens after retokenization using a custom 8k byte-level BPE tokenizer.
We trained it on a RTX 5070 Ti in just 4h 34m!
Go check it out at BananaMind/MiniBananaMind-v2-9M