← All writing

Three Sources of Knowledge — and the Two Axes We Aren't Scaling

This is part two. Part one opened on a robot that carried a cutlery basket out of a dishwasher on a single finger, let the forks slide onto the floor halfway across the room, and finished its learned trajectory without registering that anything had happened. By way of Plato’s Meno, it argued that a success rate measures true opinion — correct today, gone the moment anything you didn’t name in the demo changes — rather than knowledge, which stays put because it comes with an account of why it is true. It proposed five tethers — Stability, Transfer, Recovery, Foresight, Humility — for telling the two apart, and answered Meno’s paradox (you cannot search for what you don’t know, because you wouldn’t recognize it if you found it) with calibration: a policy can’t know the right action in a novel state, but it can know that this state is one where its own confidence is low, and ask.

Its model case is Socrates’ untaught slave boy, asked to double the area of a square drawn in the dirt. He answers confidently and wrongly — double the side — sees that the square he drew is four times the original, tries again, fails again, and admits he doesn’t know. Only then is he shown the square built on the diagonal, and he can count for himself that it’s right. Part one closed with three moves on measurement. This post is the other half: what you actually feed a policy so the tethers have something to hold.

Where a policy’s content comes from

Calibration tells a policy where its knowledge stops. It says nothing about how the knowledge got there — and for the slave boy, that is the more interesting question. He had never studied geometry. So where did his answers come from at all, the wrong ones included? Something in him was already equipped to have opinions about area before anybody asked him one.

Plato’s answer is that nothing came from anywhere. The knowledge was always in the boy; Socrates only drew it out. Learning is extraction, not insertion — and it is a beautiful answer that is no use to us whatever, because it helps itself to the soul. Nobody hands us a prior that is already there and merely needs reminding. We have to build the soul first. Which turns the question into an engineering one: what do we build it out of?

The Mohists in China, working the same centuries, asked precisely that — not where knowledge ultimately originates, but by which route a given piece of it arrived, and whether the route decides if it stays put. Two traditions on the same seam, and the Mohist answer maps onto our training stack with a precision I find hard to dismiss as coincidence.

闻 heard, 说 inferred, 亲 lived

The 《墨经》 classifies knowledge by where it came from: 闻 wén, what you were told; 说 shuō, what you worked out by inference — the thinking axis; 亲 qīn, what you came to know by direct personal contact with the thing.

One caveat, because the line looks blurrier than it is. You could fairly argue that a teleop log, or a recording from a UMI-style handheld gripper rig — a robot end-effector on a stick — is experience rather than somebody else’s testimony: the trajectory is in the robot’s own action space, and the forces are the ones its body would have felt. First-person in every sensorimotor sense.

What makes it 闻 anyway is not sensor fidelity. It is that the robot did not choose it, did not act it, and cannot ask it a follow-up. 亲 is defined by agency, not by resolution. And the difference bites: a policy that chooses its own actions finds out where its own errors lie, while a demonstration only ever shows the path an expert already selected. That is why behaviour cloning compounds error, and most of why DAgger — which repeatedly sends the expert back to label the states the policy itself wandered into — exists. In a demonstration the human is doing the exploring on the robot’s behalf — and whether that transfers depends entirely on how well a person can guess what a policy doesn’t know.

wén — testimony shuō — inference qīn — direct experience
What someone else recorded What you derive from what you hold What you learn by touching it yourself
The pretraining corpus. Demos, captions, teleop logs — mostly other people’s hands. Thinking. Search, planning, world-model rollouts. Foresight lives here. Experience. Acting, failing, recovering, in the actual world. Recovery lives here.
The axis we have poured a decade into Barely scaled Barely scaled
wén testimony — pretraining corpus a decade of scaling shuō inference — thinking barely started qīn experience — acting barely started We have been scaling one axis and calling the result general capability. 闻 alone yields excellent — opinions.
Fig 1 · Three sources, one axis scaled. 闻 is not bounded by how much teleop anyone can afford — glasses, gripper rigs and video are 闻 too. 说 and 亲 are bounded by nothing but our willingness to build them.

Read that as a roadmap and the conclusion is uncomfortable. We have spent the decade scaling 闻 — more data, more demos, more logs — and 闻 is precisely the source that produces true opinion. It is testimony: the road to Larissa described accurately by someone who has never walked it. It will get you there, and it will not stay. The other two axes are barely scaled at all, and they are where two of the three tethers that rollout was missing actually live — 说 (thinking) is Foresight, 亲 (experience) is Recovery. The third it lacked, Humility, turns out to decide where you spend the other two; that comes below. Scaling data alone cannot produce epistēmē — knowledge that stays put because it comes with an account of why it is true — because epistēmē is not made of testimony.

Why 说 is barely scaled

It is worth being concrete about how little 说 is really scaled, because the field looks busier on this axis than it is. A vision-language-action model — a VLA, the standard robot policy architecture — maps observation to action. There is no deliberation anywhere in that loop: the model that acts does not reason about what its action is about to do. The standard fix has been to bolt a System 2 on top — a separate reasoning model that plans, hands a subgoal down to a System 1 policy, and then gets out of the way. Two standalone models, with the thinking sitting upstream of the acting rather than inside it. Even world models, which at least carry a predictive component, mostly spend it generating a plan rather than checking one mid-execution.

Which is precisely why nothing caught the basket. Whatever System 2 was involved had finished thinking before the load ever shifted, and System 1 does not think. Nobody is scaling 说 in the loop; we are scaling a preamble.

And the split is not a principled architecture. It is a budget. Robots close their control loop at tens of Hz, and you cannot run a large reasoning model inside that window — so the thinking gets moved somewhere it can take its time, which means off the loop and upstream. The blocker on 说 was never a shortage of ideas about deliberation. It is compute per action.

Nobody has seriously scaled the compute axis in robotics action models.

There are two ways out of that, and the first is oddly under-explored: let the thinking run in parallel with the acting. Not a preamble that finishes before the arm moves, and not a monolith that has to complete inside one control step — a slower deliberative process running concurrently, at its own rate, watching the same stream the controller sees. The policy keeps acting at 50 Hz. The thinking lands when it lands, and when it disagrees, it preempts.

That is roughly what a person does carrying an awkward load: the hands keep going while something slower notices the thing is tipping and takes over. And it quietly changes the requirement. Deliberation no longer has to beat the control period — only the time it takes for a failure to become unrecoverable. For a basket sliding off one finger that is a few hundred milliseconds, which is an enormously easier target than the 20 ms a 50 Hz control step allows.

The second way out is to make the model itself cheaper. Enormous effort goes into scaling parameters and data; almost none goes into the compute efficiency of a robotics foundation model — making it cheap enough per step that deliberation fits inside the control budget. And robotics is where that work would pay off first: a robot carries its compute with it, on a battery, against a hard control deadline. There is no larger cluster to phone. Distillation, sparsity and routing, adaptive depth, caching across timesteps, chunking that amortizes one forward pass over many actions — unglamorous work, and it is most of what stands between us and a single model that thinks and acts at practical latency.

And notice what falls out if you get it. The sane way to spend a variable compute budget is to think longer exactly where you are least sure — which means adaptive compute and the Humility tether are the same signal, read twice. A calibrated policy doesn’t only know when to ask a human. It knows when to think.

Recollection, in three traditions

We set Plato’s answer aside as unbuildable. It’s worth picking back up, because the shape of it is right even where the metaphysics isn’t: if a policy’s content is all testimony, put there by somebody else, where does it actually live — and what does learning mean when nothing new goes in?

Plato’s version is wild. The soul is immortal; it has already learned everything there is; birth makes it forget. Nothing is ever taught — what we call learning is anamnēsis, recollection, and Socrates asks questions rather than lectures because questioning is the technology of reminding.

I don’t believe a word of the metaphysics. But three traditions are now describing the same object from different sides, and the shape they agree on is the point.

PLATO, c. 385 BCE MODERN AI The soul has already learned all things that are The corpus contains roughly everything anyone wrote down At birth it forgets — the content is in there, unindexed Training ends — it is all in the weights, and not addressable Learning = anamnēsis, recollection. You ask; you do not tell. Post-training: elicitation, not instruction. A few shots address what is already there. ⚠ Plato's soul is true by construction. A checkpoint is only as true as what it ate.
Fig 2 · Anamnesis as a pretraining story. Two columns here; the prose supplies the third, 闻 — the same object arrived at from a different direction. The correspondence is uncomfortably good — which is exactly why the disanalogy at the bottom matters.

Anyone who has watched a hundred-shot finetune “teach” a model a skill it visibly already had recognizes this: we are not writing the capability in, we are addressing something already in the weights — the way Socrates addresses geometry already in the boy.

Where the pictures come apart matters more. Plato’s soul is true by construction — it saw the Forms, so whatever you recollect is knowledge. A checkpoint ate the internet and a pile of teleop logs, so recollection returns whatever was statistically dominant, which may be right and may be a fluent, beautifully-formed mistake. And unlike Plato’s helpless newborn, it is already strikingly capable — which is precisely what makes its errors hard to see. A newborn’s ignorance is legible across the room; a checkpoint’s speaks in the same confident voice as its competence.

So the three line up: Plato’s soul, the Mohists’ 闻, and a pretrained checkpoint are the same kind of object — a vast inheritance you did not earn, addressable by good questions, and true only as far as its source was. Which settles what a right answer is worth. Eliciting one is not evidence of knowledge. It is evidence of a true opinion, and we already know what those do.

But how big can 闻 get?

Before pushing on that, be clear about the shape of the problem, because it is the inverse of everyone else’s. Language models were handed an enormous circle: essentially everything people wrote down already exists, so building a corpus is subtractive — filter, dedupe, keep the good part. Robotics was handed a tiny one, and the craft has to be additive.

LANGUAGE MODELS ROBOTS the data already exists the work is filtering down everything it will actually meet what anyone has collected most of the data does not exist yet the work is expanding out
Fig 3 · Two opposite data problems. Filtering is a search over data you already hold. Expanding is a search over data that does not exist yet — and something has to choose where to look next.

You cannot filter your way out of a small circle. You have to grow it — and the first question is what growing it costs.

Teleoperation is not the only way to collect 闻. A human wearing camera glasses while cooking dinner is producing it. So is someone holding one of those gripper rigs while they load a dishwasher, which hands you an end-effector trajectory with no robot in the room. So is every instructional video ever uploaded. There is three or four orders of magnitude more of this than there will ever be teleop, none of it costs robot time, and it scales the way corpora actually scale: by harvesting what already exists instead of manufacturing it.

native no actions at all closeness to the robot’s own action space scarce abundant how much of it already exists teleoperation native actions · vanishingly little of it handheld gripper rigs end-effector paths, no robot in the room egocentric video glasses and head-cams · enormous web / instructional video effectively unlimited · furthest from the body the move worth making keep the volume, close the gap CONTAINS FAILURE AND RECOVERY? no — all of it yes — none of it
Fig 4 · Where 闻 actually comes from. The abundant sources are the ones furthest from the robot’s own actions — and every marker on this chart is hollow, because people do not record themselves failing and recovering.

But the axis does not change character when you make it bigger. Two structural facts hold across all of it.

It is outside the body. Video shows you what happened, not what it felt like or what force was applied — vision underdetermines contact. No quantity of head-cam footage would have told a policy how a basket hooked on one finger loads that finger.

It is a corpus of successes. This is the deeper one. People record themselves doing things that work. When it goes wrong it gets retaken, edited out, or never uploaded — and teleop is filtered the same way, because operators reset on failure and you keep the clean episode. So the naturally-occurring supply of 闻 is systematically missing precisely the material Recovery is made of.

Which gives what should we collect? a non-obvious answer: collect against the grain of what people naturally record. Deliberately capture the fumble and the save, not just the clean run. Keep the near-miss you would normally cut. Instrument for contact and force, not only pixels. Prefer sources where the action already lives in a frame the robot can use — the gripper-on-a-stick beats the head-cam, which beats the tutorial.

And then label it properly, the step that actually gets skipped. Footage of a fumble with no annotation of what went wrong, when, and what fixed it is worth little more than no footage. Recovery cannot be learned from an unlabelled pile of things going sideways; it has to be legible as a fumble followed by a save. A line I have started repeating to myself:

There is no bad data. There is only badly labelled data.

Scale 闻 as hard as you can get away with. Just don’t mistake a bigger circle for a tethered one. A million hours of things going right is a million true opinions.

What the boy has that a policy does not

Ten minutes in the dirt with Socrates takes the boy from a confident wrong answer to something worth calling knowledge — no corpus, no gradient step, nothing added from outside. Two things get him there, and they scale very differently.

The first is latent structure — his lived sense of edges, area and halves, which Socrates addresses rather than installs. That is recollection, and its machine analogue does scale with 闻: a prior over how the world is shaped is precisely what pretraining buys. Pile it on; the boy’s prior is on sale.

The second is a verifier. His decisive move is not recall. Socrates draws the four-by-four square and the boy sees that his own answer failed — he can count it. In his own domain he has a cheap, unambiguous, human-free check.

That half does not scale with 闻 at all. More testimony gives you more recollectable content, not the recognition of error that converts it into knowledge; scale alone buys more confident wrong answers. It is why maths and code ran ahead in language models — not easier domains, just buildable checkers.

So the question was never how much 闻 until the boy appears but: what is the robot’s diagonal in the dirt?

And manipulation is luckier than it looks, because the check already ran. The forks hit the floor. A visible, self-delivering contradiction, free of charge, requiring no judge. The robot had every sensor needed to register it; what it lacked was a prediction for the world to contradict, and anything at all that was looking.

Which is the whole build in one line. 说 (thinking) supplies the prediction; Humility notices the contradiction; 亲 (experience) buys the correction. That is the elenchus — refutation by question, until the claim collapses — and the boy’s state arrives domain by domain, as fast as you can construct the check, not off a scaling curve.

Two more moves, on the training side

Part one’s three moves were all about measurement. These two are about what you feed the policy, and they are the harder pair.

1. Scale 说 alongside the action, not upstream of it. Not a bigger System 2 handing plans down to an unchanged System 1, but deliberation running concurrently with the controller and free to interrupt it: where is this load going — and is it still going there? A world model consulted once at plan time is a research artifact; one that gates the next action is a tether. Adaptive depth is how you afford it.

2. Scale 亲, and let the robot choose it. The move nobody is making. Glasses and gripper sticks grow the circle cheaply, but every hour of that is still 闻. 亲 cannot be harvested; it has to be lived, in this body, including the parts that go wrong. So the question is not how do we get more 亲 but which 亲 is worth buying? A calibrated robot answers that.

calibrated here — keep acting 闻 pretraining the axis we already scale the prior true opinions, so far act 说 predict first “where does the load go?” humility do I know this state? no “I don’t know this state — show me.” 亲 one targeted demonstration bought exactly where it was missing now tethered Humility is the only tether that closes the loop. The other four tell you the policy is sound. This one tells you what to buy next — which is what turns an evaluation framework into a training paradigm.
Fig 5 · The loop. 闻 gets you a prior once. 说 and 亲 are what compound — and the robot’s own calibrated ignorance is what decides where the expensive axis gets spent.

Put a calibrated policy together with a robot that chooses its own 亲, and it starts aiming its own data collection. Its uncertainty is a map of its own boundary, and that map is the shopping list: stop paying for a thousand more demonstrations of the drawer it already opens; buy the one demonstration of the drawer it doesn’t.

The honest counter-argument: while the circle is small, blind collection works fine — nearly any hour lands somewhere useful, and that is how the field got this far. But its yield falls as the circle grows while its cost stays flat; directed collection has the opposite curve. Curiosity is not what makes your first ten thousand hours work; it is what makes the next hundred thousand worth buying.

Which is the oldest claim here, and the one a robot makes literal. Fifteen centuries after the Mohists sorted knowledge by its route, Wang Yangming denied the route mattered at all unless it ended in action:

知行合一
zhī xíng hé yī
Knowledge and action are one. To know and not to act is not yet to know.
Wang Yangming (王阳明), 1472–1529

Wang was arguing with scholars who could recite the classics and could not act on them, and refused to grant they knew anything. Not incomplete knowledge. Not knowledge. The only evidence of knowing is what you do in a situation nobody rehearsed you for — word for word, the specification for a robot in someone’s kitchen. That is 亲 stated as a criterion rather than as a data source.

I went looking for a way to make a robot ask for help and found the problem named, diagnosed and half-solved twenty-four centuries before anyone had a robot to ask it about. Meno’s paradox is real: you cannot search for what you do not know. But the escape is smaller than it sounds — you never needed the answer, only the boundary, and then the 说 to predict past it and the 亲 to buy what lies on the other side.

Physical AGI will not arrive as a checkpoint that finally scores high enough; the number measures the wrong category of thing. It will arrive as a machine that can tell you where its knowledge stops, ask for precisely what it is missing, and act differently tomorrow because of what you showed it today. Build the boundary first; the competence compounds behind it.


Part one is Meno’s Paradox — Your Robot’s Success Rate Is Just a “True” OPINION.

Written by Jinyu Xie and Claude. 闻/说/亲 are from the 《墨经》 (Mohist Canon), Warring States period; 知行合一 is Wang Yangming (王阳明), 1472–1529.