
Llion Jones, a co-author of the original Transformer paper and CTO of Sakana AI, is now openly frust...
The AMW Read
The article updates the Sakana AI case study and signals a potential architectural shift that challenges the industry's scaling-only paradigm (cross.§B).
NoveltySignificance
Foundation Models · Player MapScaling Laws
Llion Jones, a co-author of the original Transformer paper and CTO of Sakana AI, is now openly frustrated with the dominant architecture that powers most LLMs. This is the clearest signal that the industry’s scaling-only approach is hitting a foundational wall. Sakana is pioneering next-generation, self-adaptive designs like 'Transformer²' and 'Continuous Thought Machines' (CTMs). The next major AI breakthrough will not come from building bigger models, but from a radical architectural paradigm shift toward efficiency and lifelong learning.



