February 24, 2025
All
Exploring the Functional Roles of Transformer Layers
A new paper, "Transformer Layers as Painters," co-written by Emergence researchers and Sakana AI, investigates the internal workings of transformers, focusing on how the removal or reorganization of information impacts pretrained models.