GPT-6 Astra sees the matrix and reprograms other AI models directly through their weights
OpenAI — mIT researchers show that GPT-6 Astra can directly understand and modify the internal settings of other AI models without traditional training. The approach has limits but could change how AI systems are tuned and controlled.
Hand a person a list of thousands of numbers and ask what game an AI model trained on them plays. You won’t get an answer. GPT-6 Astra from OpenAI will give you one: In a research blog, MIT researchers show that GPT-6 Astra can analyze and deliberately modify the internal settings of other AI models, the so-called weights. These numerical values are organized in massive tables, or matrices in mathematical terms. The usual training process of step-by-step mathematical optimization isn’t needed. Depending on the experiment, Astra worked directly with lists of numbers or used programming tools and feedback from test runs. The researchers call the approach “Weight-Space Programming”: instead of expensively retraining an AI model, a language model acts like a mechanic turning individual knobs. Astra identifies games just by looking at a model’s raw numbers In several experiments, the researchers fed Astra the raw weights of trained networks and asked what those networks had learned. Astra correctly identified which of four computer games a network was supposed to play. It also recognized the basic shapes an image generator produced, though it confused filled shapes with outlines. It correctly matched the training language of small language models too – without access to training data and without the ability to run the models. In another test, Astra had to figure out which of two fine-tuned language models was trained to always agree with users. From the weights alone, it couldn’t tell the difference at first. Only when Astra was also allowed to observe what the models paid attention to during text processing did it correctly identify the sycophantic model across all three model pairs. Models written from scratch beat trained competitors Astra went even further: It generated weights for models meant to play three simple computer games, entirely without training, based only on the game rules and source code.