🏗️ Building on HF

AxionLab

AxionLab-official

131 52 379

AI & ML interests

Owner of SupraLabs

Recent Activity

liked a Space 1 day ago

AlekseyCalvin/SLM_Bistro

reacted to Banaxi-Tech's post with 😔 3 days ago

BananaMind 3 is going to be an comeback. Sorry for the BGA things ( i genuinely didnt know about nsa existing and yes I used aiiii) Were going to use our BananaMind 2.1 Unified architecture with some changes + NSA and some other stuff.

new activity 3 days ago

SupraLabs/Supra2-100M-Instruct:Supra2-100M-Instruct on black-router

View all activity

Organizations

reacted to Banaxi-Tech's post with 😔 3 days ago

Post

5,552

BananaMind 3 is going to be an comeback. Sorry for the BGA things ( i genuinely didnt know about nsa existing and yes I used aiiii)
Were going to use our BananaMind 2.1 Unified architecture with some changes + NSA and some other stuff.

40 replies

reacted to Banaxi-Tech's post with 😔 4 days ago

Post

4,875

BananaMind is in the google situation before argon right now, right?

29 replies

reacted to appvoid's post with 🔥 4 days ago

Post

3,936

You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded.

7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.

All I can say is that the best is yet to come. And will be agentic.

11 replies

reacted to their post with 🚀 10 days ago

Post

3,765

Tommorow we are releasing Supra2-Pro(100M params), our flagship, get ready!

(follow SupraLabs to get tuned in!)

SupraLabs

9 replies

reacted to DedeProGames's post with 🧠🚀🔥 14 days ago

Post

3,459

Meet Supra2.5-Ultra-Preview-001. 230M parameters, ~40.4B training tokens.

SupraLabs has released the first preview of its Supra2.5-Ultra family: a compact, Llama-style base model for text completion and small-model experimentation.

What's inside?
• 230M parameters
• 32 transformer layers
• 2,048-token context window
• Grouped Query Attention: 12 attention heads, 4 KV heads
• 49,152-token vocabulary
• SwiGLU activation, RoPE and tied embeddings
• BF16 weights and Hugging Face Transformers support
• Apache 2.0 license

Training
The model was trained on approximately 40.4B tokens from FineWeb-Edu, DCLM-Baseline and FineMath using a single A100 SXM.

Reported zero-shot results
• HellaSwag: 37.18% normalized accuracy
• PIQA: 65.78% accuracy
• ARC-Easy: 57.11% accuracy
• ARC-Challenge: 26.28% normalized accuracy

Want to experiment?
Code on REPO.

Model, weights and usage example:
SupraLabs/Supra2.5-Ultra-Preview-001

4 replies

reacted to mithulaartigala's post with 🔥 14 days ago

Post

959

Funny how I have stronger hardware than the CEO of HuggingFace itself, huh?

Its okay @clem you will get there one day 🥹❤️

> Yeah, me and the Hugging Face CEO have the same Mac setup. Anyway, my hardware score is 6.5× his.

3 replies

replied to DedeProGames's post 15 days ago

Wishing you a strong fresh start with SupraLabs. The focused direction sounds promising—looking forward to seeing what you build next.

You are so cool bro ngl

replied to Banaxi-Tech's post 15 days ago

@LH-Tech-AI @AxionLab-official which model are you talking about?

That BGA shitty thing

replied to Banaxi-Tech's post 15 days ago

If you are going to make the same slop shit you already did, you should stop. Please stop using AI to make AI slop.

reacted to Banaxi-Tech's post with 😔 16 days ago

Post

4,532

Hi everyone, we're back!

And we're releasing something major again now, if you have seen Grok Bot, its very powerful, but there isn't really a local alternative yet.

Today we're releasing Minds, they're personal AI bots that live on your computer.
They can run anywhere, on your phone, on your mac, on windows, and even on linux.

They support OpenAI Oauth as the main integration because most people already have a ChatGPT sub.

But locally, It supports ANY openai compatible api which allows you to setup ollama and llama.cpp and everything else.

It uses Jev for command approval on OpenRouter and Muse Spark Transcribe for transcription.

Its fully Open Source!

Check it out: https://github.com/BananaMind/Minds

9 replies

reacted to DedeProGames's post with 🔥🚀🤗❤️ 16 days ago

Post

5,144

I’ve just left

BananaMind to focus my work on

SupraLabs .
Following some internal pressure from SupraLabs and issues @Banaxi-Tech encountered with certain architectures, I decided it was time to change direction.
I want to thank

BananaMind for inviting me to join their organization and for helping shape my knowledge and passion regarding SLMs.
Now, it’s just me and

SupraLabs .

8 replies

replied to Banaxi-Tech's post 18 days ago

Bananamind3 is getting delayed lmao

reacted to Banaxi-Tech's post with 😔 18 days ago

Post

3,230

We have released BGA!
And wow, It provides 256x (and 512x at the end of 1M) yes 256x LESS attention compute at 1M context window.
That means you can train a 1M context window at the compute of a ~4K context window.

Check IT OUT: BananaMind/blog

The Accuracy Should BE WAy better than DSA but untested yet.

And, now some updates on BananaMind 3:

BananaMind 3 Will start training Soon!
Sizes: 10M, 25M, 50M, 100M, 150M

And the context windows ARE INSANE: 10M, 16K context, 25M 16k context, 50M 32K context, 100M and 150M, 64K context!!!!

13 replies

reacted to mithulaartigala's post with 🤗🔥 18 days ago

Post

4,628

I am LOVING HuggingFace Pro <3

7 replies

AxionLab

AI & ML interests

Recent Activity

Organizations

AxionLab-official's activity