PinnedPreprint 2026
Language Models Can Rewrite Their Own Weights
J. Fan*, N. He, C. Yang, A. Mao, X. Zhu, C. Cheng, K. Liang, S. Shen, Z. Li, R. Guo, G. Liu
A third way to make a model better
For the first time, to our knowledge, a language model rewrites its own weights by its own reasoning and becomes better, with no gradients and no training: the model is its own optimizer. It surpasses itself on problems it never saw, keeps getting better session after session, and repairs a damaged copy of itself without ever seeing its original weights.














