Skip to main content
Back to News
Llion Jones, a co-author of the original Transformer paper and CTO of Sakana AI, is now openly frust...
Technology
1 min read
US

Llion Jones, a co-author of the original Transformer paper and CTO of Sakana AI, is now openly frust...

The AMW Read

The article updates the Sakana AI case study and signals a potential architectural shift that challenges the industry's scaling-only paradigm (cross.§B).
NoveltySignificance
Foundation Models · Player MapScaling Laws
Sakana AI
Sakana AI

Foundation Models / LLMs

View Company Profile

Llion Jones, a co-author of the original Transformer paper and CTO of Sakana AI, is now openly frustrated with the dominant architecture that powers most LLMs. This is the clearest signal that the industry’s scaling-only approach is hitting a foundational wall. Sakana is pioneering next-generation, self-adaptive designs like 'Transformer²' and 'Continuous Thought Machines' (CTMs). The next major AI breakthrough will not come from building bigger models, but from a radical architectural paradigm shift toward efficiency and lifelong learning.

#AIArchitecture #DeepLearning #SakanaAI #LLM #AIBreakthrough

How This Connects

Based on Foundation Models · Player Map

  1. 1d agoAnthropic reportedly plans an October IPO at up to a $2 trillion valuation, even as ARR growth shows signs of deceleration.Anthropic
  2. 1d agoAnthropic hires Google TPU veteran Amir Salek to accelerate in-house AI chip developmentAnthropic
  3. 1w agoAlibaba's Qwen team has open-sourced Qwen3.8-27B, a 27-billion-parameter multimodal model designed f...Qwen
  4. 1w agoAlibaba has released Qwen 3.8 27B, an Apache 2.0-licensed open-weight dense model with 27 billion pa...Alibaba Qwen 3.8 27B launch
  5. 1mo agoMoonshot AI launches Kimi K3, a 2.8 trillion-parameter open-weight model, claiming performance near US frontier labsMoonshot AI
  6. 10mo agoLlion Jones, a co-author of the original Transformer paper and CTO of Sakana AI, is now openly frust... · THIS ARTICLE

Related News

More news from Sakana AI

Stay updated with the latest news and announcements from Sakana AI.

View all Sakana AI news

Discover AI Startups

Explore 5,000+ AI companies with VC-grade analysis, funding data, and investment insights.

Explore Dashboard