|
| 1 | +# Substrate Unification Thesis — the north star, stated falsifiably |
| 2 | + |
| 3 | +> **READ BY:** any session touching the canonical node (`canonical_node.rs`), |
| 4 | +> the cascade key, the place/buffer split, the codecs, or proposing a |
| 5 | +> "substrate" / "AGI-as-SoA" direction. Read this BEFORE proposing a new probe |
| 6 | +> — it says what the probes are *for*. |
| 7 | +> |
| 8 | +> **Status:** THESIS (2026-06-24). The unification CLAIM is `[H]` (hypothesis |
| 9 | +> with named falsifiers below); the per-axis INSTANCES are individually graded. |
| 10 | +> This doc exists so probes are sequenced toward one question instead of |
| 11 | +> scattered. It is the synthesis of two converging arcs: the perturbation-sim |
| 12 | +> cascade-key / place-buffer work (PRs #605, #607) and the 8-lens research |
| 13 | +> frontier map (other session). Grades: `[G]` proven-in-code/measured, `[H]` |
| 14 | +> bounded-but-open, `[S]` analogy-only. |
| 15 | +> |
| 16 | +> **Anti-theater clause (this repo's own rule):** every claim here is anchored |
| 17 | +> to a built artifact, a measured number, or a cited theorem. A claim with none |
| 18 | +> of those is marked `[S]` and is a *bet*, not a result. Do not promote a grade |
| 19 | +> without its evidence. |
| 20 | +
|
| 21 | +--- |
| 22 | + |
| 23 | +## 0. The one sentence |
| 24 | + |
| 25 | +**One 512-byte object, read N ways, IS every classical layer at once** — |
| 26 | +primary key, multidimensional index, retrieval/attention, inference operand, |
| 27 | +and measurement — and the operations on it (route, retrieve, reason, learn, |
| 28 | +measure) are all the *same* branch-free prefix-and-table arithmetic, with zero |
| 29 | +value decode. |
| 30 | + |
| 31 | +If true, this is historic (the four-to-five classical layers collapse into one |
| 32 | +operation). If false, it is still a very good substrate (0 collisions, ~250× |
| 33 | +key-only scan, real NARS chaining) — but "merely fast," not new. **The entire |
| 34 | +research program is the work of deciding which.** |
| 35 | + |
| 36 | +--- |
| 37 | + |
| 38 | +## 1. The reframe the verification mandate forced |
| 39 | + |
| 40 | +The mandate was *verify and improve the substrate.* Followed honestly, both |
| 41 | +words changed meaning: |
| 42 | + |
| 43 | +- **Verification is proof-of-code, not calibration.** A deterministic, bijective |
| 44 | + address is not a measurement instrument you calibrate with ICC / Berry-Esseen |
| 45 | + — it is a **code you prove** (lossless containment, exact prefix ancestry). |
| 46 | + Reaching for a σ noise-floor on a deterministic place is a category error; the |
| 47 | + weak-dependence regime (`I-NOISE-FLOOR-JIRAK`) governs the *continuous |
| 48 | + embedding underneath*, not the *quantized address on top*. The seam between |
| 49 | + the two regimes is literally the centroid boundary (see §4). |
| 50 | +- **Improvement reduces to one move: split a conflated pair of axes.** V3 split |
| 51 | + `part_of` from `is_a` (#605). The ketchup fix split *location* from *impulse |
| 52 | + permeability* (#607). Each "improvement" restored an orthogonality. So the |
| 53 | + mandate became: **discover the substrate's orthogonal basis and prove each |
| 54 | + axis is a faithful code.** |
| 55 | + |
| 56 | +--- |
| 57 | + |
| 58 | +## 2. The emerging orthogonal basis (five readings of one node) |
| 59 | + |
| 60 | +Not five subsystems — five readings of the same `NodeRow` |
| 61 | +(`key(16) | edges(16) | value(480)`): |
| 62 | + |
| 63 | +| axis | reading of the node | built / proven instance | grade | |
| 64 | +|---|---|---|---| |
| 65 | +| **Identity** | the key as a stable, deterministic *location* | `helix_place` — pure geometry, never reads the dynamics (PR #607); ICC 0.14→**1.00** under perturbation | `[G]` | |
| 66 | +| **Structure** | HHTL tiers as two prefix-routable hierarchies | V3 `(part_of:is_a)` 8:8 tile (PR #605); `EdgeBlock` = `connected_to` | `[G]` shipped / `[H]` that prefix = ancestry (F-1) | |
| 67 | +| **Dynamics** | the value buffer as the *responsive* field | BF16 buffer residue / `INERTIA_SLOT` (#513); ICC **0.51**, moves under perturbation; `Spearman(λ₂, inertia)≈0` (#509) | `[G]` | |
| 68 | +| **Truth** | the edge as a belief codec | NARS `(f,c)` ↔ subjective-logic `⟨b,d,u,a⟩` ↔ `Beta(α,β)` — a real bijection | `[G]` math / `[H]` as edge codec | |
| 69 | +| **Composition** | the adjacency under a semiring | retrieval IS inference: swap the semiring → swap the reasoning mode; GNN msg-passing = DP-over-semiring (Dudzik–Veličković [2203.15544]) | `[H]` | |
| 70 | + |
| 71 | +The classical-layer collapse, anchored: **attention IS Sparse Distributed Memory |
| 72 | +read-by-distance** (Bricken & Pehlevan [2111.05498]) — so an *explicit semantic |
| 73 | +address* is a designed instance of a proven primitive; **Lance keeps structural |
| 74 | +metadata resident while values stay compressed** ([2504.15247]) — so the ~250× |
| 75 | +is that principle with the offset table promoted to a self-describing address; |
| 76 | +**HEEL+HIP+TWIG = a CAM-PQ 6×256 code** (Jégou [1102.3828]) — so path-distance = |
| 77 | +3 ADC table lookups. The literature already proved the pieces; the thesis is that |
| 78 | +*one object instantiates all of them at once*. |
| 79 | + |
| 80 | +--- |
| 81 | + |
| 82 | +## 3. The self-reference is the deepest part (the ketchup) |
| 83 | + |
| 84 | +The substrate **became the very effect it measures**: the cascade-key place |
| 85 | +exhibits yield-stress (stable → sudden flip across a boundary) *isomorphic to the |
| 86 | +grid cascade it encodes* — because the place was a quantized Laplacian |
| 87 | +impulse-response, i.e. the dynamics, not a coordinate. That is the signature of |
| 88 | +**observer = observed** — the substrate made of the same stuff as what it reasons |
| 89 | +about. It is simultaneously the AGI threshold (cognition is a system that models |
| 90 | +itself with its own substrate) and the measurement hazard (the ruler bends with |
| 91 | +the load). |
| 92 | + |
| 93 | +The fix generalizes: **split the frozen ruler (identity) from the live rubber |
| 94 | +(dynamics)** — the same move cognition makes (frozen prior vs live free-energy; |
| 95 | +self vs world-model). The location/permeability split (#607) was the first |
| 96 | +instance. **Open `[S]`:** does this split scale to *every* self-referential axis, |
| 97 | +and is the resulting basis complete (§2)? The substrate's real deliverable may be |
| 98 | +that finite orthogonal basis, not any single codec. |
| 99 | + |
| 100 | +--- |
| 101 | + |
| 102 | +## 4. The falsification ladder (run in order; each has a KILL) |
| 103 | + |
| 104 | +The probes are not a menu — they are evidence toward §0, sequenced by |
| 105 | +information-per-cost. Each names what would **kill** it. |
| 106 | + |
| 107 | +1. **F-1 — codebook fidelity** `[H]`, run first, ndarray-side. |
| 108 | + Hierarchical-4⁴ (256 = 4⁴, a byte's nibbles = its centroid's ancestry) vs flat |
| 109 | + k-means-256: does the hierarchy preserve rank-distance within the flat band? |
| 110 | + **KILL:** if it doesn't, the prefix-is-ancestry assumption fails and a large |
| 111 | + fraction of the `[H]`/`[S]` map collapses to "useful router, unfaithful code" |
| 112 | + at once. *Named in the OGAR canon, still un-run.* (perturbation-sim can give a |
| 113 | + cross-domain corroboration on the grid spectrum; ndarray-side is authoritative.) |
| 114 | + |
| 115 | +2. **F-collapse — does the collapse *buy* anything?** `[H]`, the deciding gate. |
| 116 | + One real workload, three implementations: (a) the GUID address, (b) a learned |
| 117 | + index (Flood/Tsunami), (c) a trained attention head. **KILL:** if (b)/(c) match |
| 118 | + or beat (a) at equal cost, the GUID's *marginal* value is ≈0 → "elegant |
| 119 | + packing, not a new primitive." **Honest counterweight already on the table: |
| 120 | + CogNGen matched deep-RL *without* the explicit address ([2204.00619]).** This |
| 121 | + is the question that decides historic-vs-fast; everything else is in service of |
| 122 | + it. |
| 123 | + |
| 124 | +3. **F-update — the RUM Update axis** `[G]` measurement, decides *product class*. |
| 125 | + Re-classification / re-mint cost. Catastrophic → this is the best **immutable |
| 126 | + knowledge fabric** ever built, not a general store (and that's still huge). |
| 127 | + Cheap via ref-indirection → the ambition expands to a mutable substrate. |
| 128 | + |
| 129 | +4. **F-code — verification as proof, not calibration** `[G]` reframe. |
| 130 | + Prove lossless containment + exact prefix ancestry as a *code* (not an ICC). |
| 131 | + **KILL:** if containment isn't lossless, "address" is a lie — it's a lossy hash. |
| 132 | + This subsumes F-1 and is the clean gate the statistical battery was groping at. |
| 133 | + |
| 134 | +5. **F-basis — orthogonality completeness** `[S]`, the long game. |
| 135 | + Does the split-the-conflated-axes program (§1) close on a finite basis (§2) or |
| 136 | + proliferate? **KILL (of the *thesis*, not a probe):** if every workload finds a |
| 137 | + new conflation needing a new axis, there is no "basis," only endless patching — |
| 138 | + and "one object, N readings" is a slogan, not a structure. |
| 139 | + |
| 140 | +--- |
| 141 | + |
| 142 | +## 5. The strongest evidence is not a probe — it is the convergence |
| 143 | + |
| 144 | +Four parallel sessions, independently, landed on the **same two gates**: F-1 |
| 145 | +(codebook fidelity) and "retrieval IS inference." This repo's own rule is that |
| 146 | +**convergence is signal**. That cross-session agreement — not any single |
| 147 | +measurement — is currently the best reason to believe §0 is real rather than |
| 148 | +seductive. It is also the reason to run F-collapse *adversarially* (point a |
| 149 | +learned baseline at it): convergence can be shared blind spots as easily as shared |
| 150 | +truth, and only the falsifier tells them apart. |
| 151 | + |
| 152 | +--- |
| 153 | + |
| 154 | +## 6. What would kill the whole thesis (stated up front) |
| 155 | + |
| 156 | +- **F-collapse negative** — a learned index/head matches the address ⇒ the GUID is |
| 157 | + convenience, not a primitive. (Most likely failure; CogNGen is the warning.) |
| 158 | +- **F-1 negative** — hierarchical-4⁴ unfaithful ⇒ prefix routing is approximate, |
| 159 | + not exact; the "code" claim downgrades to "router." |
| 160 | +- **F-basis non-closure** — conflations proliferate ⇒ no unification, just a |
| 161 | + well-packed record. |
| 162 | + |
| 163 | +None of these kill the *engineering* (0 collisions, 250×, NARS chaining are |
| 164 | +real and shipped). They kill the *historic* claim. Keeping those two ledgers |
| 165 | +separate — "definitively a better substrate" vs "collapses the classical stack" |
| 166 | +— is the honesty the whole program turns on. |
| 167 | + |
| 168 | +--- |
| 169 | + |
| 170 | +## 7. North-star sequencing |
| 171 | + |
| 172 | +`F-code (prove the address is a code)` → `F-1 (centroid fidelity)` → |
| 173 | +`F-collapse (does it beat learning)` → `F-update (product class)` → |
| 174 | +`F-basis (does the basis close)`. |
| 175 | + |
| 176 | +Everything built so far — cascade key, V3, the place/buffer split, the NARS/Beta |
| 177 | +codec, the semiring retrieval — is a *rung*, not a destination. The substrate is |
| 178 | +**verified** when it is proven as a faithful code *and* shown to beat the learned |
| 179 | +baseline — not when an ICC clears 0.75. |
| 180 | + |
| 181 | +--- |
| 182 | + |
| 183 | +## Cross-references |
| 184 | + |
| 185 | +- `canonical_node.rs` — the 512B node (key/edges/value, ValueTenant/ValueSchema). |
| 186 | +- `perturbation-sim/src/cascade_key.rs` (PR #605) — V1/V2 six-lens address + V3 `(part_of:is_a)`. |
| 187 | +- `perturbation-sim/src/place_buffer.rs` (PR #607) — helix Place (identity) ⊥ BF16 buffer (dynamics); the measured split. |
| 188 | +- `OGAR/CLAUDE.md` + `ndarray .../guid-prefix-shape-routing.md` — the GUID canon, the 4⁴ condition, F-1. |
| 189 | +- Iron rules: `I-SUBSTRATE-MARKOV`, `I-NOISE-FLOOR-JIRAK`, `I-VSA-IDENTITIES`, `I-LEGACY-API-FEATURE-GATED`. |
| 190 | +- EPIPHANIES `E-CASCADE-KEY-IS-THE-SPATIAL-ADDRESS`, `E-V3-PART-OF-IS-A-TILE`, `E-LOCATION-PERMEABILITY-CONFLATION`. |
| 191 | +- Literature: SDM=attention [2111.05498] · GNN=semiring-DP [2203.15544] · PQ [1102.3828] · RaBitQ [2405.12497] · CogNGen [2204.00619] (the counterweight) · Lance [2504.15247]. |
0 commit comments