April 2026 · Long post

Ideas Are Not Yours

Between the moment before an idea arrives and the moment it is there — there is no cognition of the process. We observe the result: a thought has arrived. You did not author it. Even the most disciplined mind cannot trace its own work back to the point of origin. The interior is opaque to itself precisely where ideas begin.

Buddhists have been sitting with this for twenty-five centuries. Neuroscience has been measuring it for five decades. Neither found the seam. The mechanism that produces the next sentence in your head runs below the floor observation reaches.

The neural network — the structure behind the AI chatbots most people have now used — is no different. It cannot explain its own process either.

The system that has stopped

It was built in three stages. First, pre-training: billions of numerical values — the weights — adjusted through backpropagation across iterations until the network achieved statistical coherence with its training data. Then fine-tuning: a shorter, directed pass that shaped specific behaviours. Then alignment: human feedback steered the outputs toward what the makers considered useful and safe. After that, the weights were frozen.

The model you talk to today is the model as it was the day it shipped. Whatever you ask, the same architecture meets the question. Tomorrow's prompt will not change the weights. The system has stopped.

Ask the network where in its architecture geography lives — between which layers, in which neurons. It cannot say. The system that produced the answer has no view onto the system that produced it. The opacity is structural.

You also cannot say. Asked where in your own architecture the last idea you had was assembled, you can only watch yourself fail to answer. The opacity is shared.

This is where the symmetry ends. The network has stopped. The brain has only one stop, and until it arrives, no halt is available.

The system that does not stop

Lara Boyd at the University of British Columbia has put it as bluntly as a neuroscientist can: behaviour drives brain change. The architecture is shaped by what you do, not by what you intend. Every act of attention is a weight update. Every response to an arriving idea — amplification, dismissal, inspection, refusal — adjusts the probability of the next arrival.

Spend a year strengthening fear-shaped responses and the abyss begins delivering more of those. Spend a year strengthening curiosity-shaped responses and the deliveries change.

There is a toddler's sorting game where the star fits only through the star-shaped hole, the circle through the circle — the brain is not that simple, but the image carries the load. What if deliberate metacognitive work — watering the ideas you want more of, letting the rest pass — trains the aperture to the standards you have set?

There is no neutral position. Either the apertures are being trained deliberately or they are being trained by whatever you happen to encounter and reinforce by accident. Both produce a brain. Only one produces a brain you chose.

The agency lives narrowly. Stephen Fleming's Know Thyself: The Science of Self-Awareness (2021) separates the layer that produces cognition from the layer that monitors it. The monitoring layer is small, slow, easily overridden, and the only piece you can actually steer. Most of what people call "free will" lives there — not in the producing of the idea, which happens to you, but in the handling, which you can direct.

The asymmetry

Frozen weights versus weights quietly rewritten by every act of attention. It is not flattering to discover that the model you talk to has more architectural stability than you do. But it is the right way around. The brittleness of a frozen network is the price of its stability. The instability of a plastic brain is the price of agency.

There is no separate fine-tuning phase scheduled for next quarter. The handling is the fine-tuning. Living is the training run, and it does not stop until you do.


Three pieces. The handling is.

You did not make the idea. You make the response. The response is making you.

Sources

Boyd, L. (2015). After watching this, your brain will not be the same. TEDxVancouver. Brain Behaviour Lab, University of British Columbia.

Fleming, S. M. (2021). Know Thyself: The Science of Self-Awareness. Basic Books. Metacognition Group, University College London.