🌳 The World's Greenest AI Model: RWKV's Pioneering Sustainability

10-100x lower inference cost = to lower carbon footprint

With the rapidly growing usage of AI models worldwide, and the threat of global warming. The need for a greener AI model to reduce our carbon footprint is more important than ever.

In that regard, we are proud to say that RWKV (the model which our team works on), has been independently benchmarked as the world's greenest and most energy-efficient AI model/architecture, on a per token output basis, for models of the same param sizes (7B params).

Benchmarks was done for 7B weight class at : https://ml.energy/leaderboard/

The energy efficiency of the RWKV architecture is derived from the 10-100 times compute efficiency of our linear transformer architecture vs the quadratic scaling of transformer architectures. A benefit we expect to scale better as our models get larger.

Graph is taken from the EleutherAI RWKV paper: 5 x Cheaper compute at 1k tokens, 10x Cheaper compute at 2k tokens, 100x+ Cheaper beyond 20k tokens

Combined with how RWKV models scales similarly to transformers in evals, against other models with the same dataset.

The industry wide benefits for scaling more energy efficient architecture, like RWKV, will be significant for our industry as a whole.

And we, the team at Recursal AI, are excited to be involved in helping spearhead this charge towards more energy efficient models with RWKV, and potentially other future models/architectures as our industry develops.

Towards a future with more, not less alternatives to AI,
with the various unique benefits each architecture will bring us.