Archive - Featherless AI - recursive dev blog

🛣️ Our roadmap to Personalized AI and AGI

We will not train a trillion parameter model: A <100B active parameters is all you need.

Mar 24 •

🪿Qwerky-72B and 32B : Training large attention free models, with only 8 GPU's

‼️ Attention is NOT all you need ‼️

Mar 24 •

Featherless.ai Raises $5M in Seed Funding to Democratize Access to Open Source AI Models

Democratizing AI with instant access to 4,000+ open-source models through our breakthrough serverless platform

Mar 17 •

Darin Verheijke

QwQ-32B Now Available on Featherless.ai

QwQ-32B: A Powerful Lightweight in the Age of Reasoning Models

Mar 7 •

Darin Verheijke

,

Featherless AI - dev blog

, and

Joseph Palmisano

February 2025

January 2025

🐋 How DeepSeek slayed the AI giants

Violating the narrative for all the major players in AI

Published on Tech Talk CTO • Jan 29

December 2024

August 2024

Featherless Feud: a dip into LLM-powered game development

rebuilding a TV classic

Aug 20, 2024 •

and

minmodmon: A quickstart to local RWKV

In April we launched our RWKV-based model, EagleX v2. EagleX goes toe-to-toe with modern transformers on performance, while being much cheaper to run…

Aug 14, 2024 •

Model Support Summary + new this week

Nemo 12B and Qwen2 32B latest additions for a total of 12 model families

Aug 3, 2024 •

June 2024

May 2024

Featherless: an introduction

making every hugging face model available for inference and why it matters

May 31, 2024 •

April 2024

🦅 EagleX v2 : Soaring past LLaMA2 7B in both English and Multi-lang evals (RWKV-v5)

You have seen the teaser with the EagleX 1.7T, now its here - the definitive version of linear transformer trained past, LLaMA 2 7B.

Published on RWKV Open Source Development Blog • Apr 18, 2024

🦅 Eagle & 🐦 Finch - architecture paper is here

Available at your local arxiv

Published on RWKV Open Source Development Blog • Apr 10, 2024

Dear VC’s, please stop throwing money at AI founders with no commercial plan, besides AGI

Execute a commercial plan from day 0, not next year in the future, when the bank is empty

Published on Tech Talk CTO • Apr 8, 2024

March 2024

🦅 EagleX v1 : Soaring past LLaMA 7B 2T in both English and Multi-lang evals (RWKV-v5)

A linear transformer has just cross the gold standard in transformer models, LLaMA 7B, with less tokens trained in both English and multi-lingual evals…

Mar 16, 2024 •

January 2024

Launching Eagle 7B - into our public demo, and open router (till March 2024)

Brining the worlds strongest multi-lingual model to the world

Jan 30, 2024 •

🦅 Eagle 7B : Soaring past Transformers with 1 Trillion Tokens Across 100+ Languages (RWKV-v5)

A brand new era for the RWKV-v5 architecture and linear transformer's has arrived - with the strongest multi-lingual model in open source today

Published on RWKV Open Source Development Blog • Jan 29, 2024

December 2023

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts