Language Models Can Rewrite Their Own Weights

Published in arXiv preprint, 2026

Recommended citation: Jiajun Fan, Neil He, Changyi Yang, Andy Mao, Xi Zhu, Chaoran Cheng, Kaiqu Liang, Shuaike Shen, Zetian Li, Ruihan Guo, Ge Liu. "Language Models Can Rewrite Their Own Weights." arXiv preprint arXiv:2611.21885, 2026. https://arxiv.org/abs/2611.21885

Self-rewriting is a third way to make a language model better: the model rewrites its own weights by its own reasoning, with no gradients and no training. To our knowledge, this is the first time a language model has done so. The model is its own optimizer. It takes no frontier model: the model’s own edit makes it 6.6 points more accurate on problems it never saw. Over eight consecutive sessions its accuracy only rises. Like a broken robot that fixes itself without being rebuilt, it repairs a damaged copy of itself without ever seeing its original weights, back to over 80% of the original accuracy on image tasks it never saw. The ability emerges with scale: of four sizes of one model family, only the largest improves and repairs itself. No training pipeline to build, no cluster to rent, no added cost per answer. The wall between training and inference is a limit of our tools, not a property of intelligence.