One hierarchical, no-backprop agent whose senses — reading, hearing, seeing —
all land as one clean signal. Its priors are stored only over signals; it is taught the
alphabet in Latin, English & Hindi at once, and it has motors that draw a picture
and speak a sound. Shown a picture it says the sound; given a sound it makes the picture.
Motor · actdraw · speakinverse plants over the same signal
One signal, three senses
the letter “A”, taught trilingually in a single “now”
Why it matters. The three inputs look nothing alike — a Latin shape, a
Devanagari shape, a sound — yet each becomes the same type of 64-channel signal (the heatmaps).
The agent binds them into one latent cause not because they resemble each other, but because they
co-occur. That is cross-modal binding by counting — not understanding.
The lesson
Latin + English + Hindi, taught at the same time · press ▶ to hear what the agent emits
letter
Latin (seen)
Hindi (seen)
sound → signal (heard)
agent MADE
says
Read this honestly. “MADE” is the agent’s own picture, drawn from
hearing the sound alone — a blocky 8×8 read-out of the prototype it bound, not a copy of the input.
Fidelity is bounded by the 8×8 signal, on purpose.
Two capabilities, like a body
a sensor to take the world in, a motor to put it back out
Show a picture → it says the sound
→
vision signal → nearest prototype → latent cause → read out the bound audio prototype (exact) → speak motor.
The speak motor is a fixed lossy plant — the audible tone is a demo; the citable capability is the exact read-out.
Give a sound → it makes the picture
🔊 /a/→
audio signal → nearest prototype → latent cause → read out the bound vision prototype → draw motor.
Nested time, in the yuga ratio
“time” is not one clock — it is four loops at 4 : 3 : 2 : 1
L0 · Kali
×1
signal — plastic, forgets fast
L1 · Dvapara
×2
cross-modal binding
L2 · Treta
×3
sequence / order (next rung)
L3 · Satya
×4
slow self / genre prior — stable
Shallow loops update every tick and forget quickly; deep priors update rarely and
forget slowly. Class-C engineering choice inspired by the yuga proportions — not a cosmological claim.
Evidence
every claim carries a class · re-derive with pytest -q
invariant
class
result
Signal uniformity — every sense → Signal(64), ≥0, Σ=1