Information-Computational Core: Canonical Domain Analysis (Revised to 7 Primitives)
Status: Canonical reference. Full 12-step analysis of the info-comp core at 7 primitives. Revision history:
- v1: 6 primitives {Σ, P, C, K, μ, Γ} in
v1_full_analysis/information-computational-landscape.md - v2 (this document): 7 primitives {Σ, P, C, Ke, Kd, μ, Γ} — K split into Encoder (Ke) + Decoder (Kd) Revision trigger: Cognitive substrate analysis discovered evaluator determinism as the critical variable separating hard from soft information substrates. The key observation: formal systems can be fully encoded in language, but without deterministic evaluators, encoding alone doesn't produce reliable function. This raised the question: why didn't the info-comp core catch this? Because Shannon's framework assumes decoders are deterministic — Code (K) bundles encoding and decoding, hiding the evaluator as an independent variable. The fix: split K into Ke (encoder) and Kd (decoder), making decoder determinism independently assessable. This finding implies Shannon's framework is incomplete for systems with non-deterministic decoders — potentially publishable as an information theory extension.
Step 1 — Information Gathering
1.1 What we're analyzing
The information-computational core: the abstract structure of information processing. This domain captures what ALL information-processing systems have in common — biological (DNA→protein), computational (data→computation), cognitive (symbol→meaning), and communicative (signal→received message).
1.2 Sources
Primary mathematical foundations:
- Shannon (1948): "A Mathematical Theory of Communication" — source coding, channel coding, entropy, capacity
- Shannon & Weaver (1949): "The Mathematical Theory of Communication" — extended framework
- Kolmogorov (1965): Algorithmic information theory — complexity independent of distribution
- Cover & Thomas (2006): "Elements of Information Theory" — modern treatment
Coding theory:
- Hamming (1950): Error-correcting codes
- Reed & Solomon (1960): Polynomial codes
- Berrou et al. (1993): Turbo codes
- Gallager (1962), Richardson & Urbanke (2008): LDPC codes
- Arikan (2009): Polar codes — capacity-achieving
Rate-distortion and source coding:
- Shannon (1959): Rate-distortion theory
- Ziv & Lempel (1977, 1978): LZ77/LZ78 universal compression
- Huffman (1952): Optimal prefix codes
- Rissanen (1976): Arithmetic coding
Extensions and connections:
- Solomonoff (1964): Algorithmic probability and induction
- Chaitin (1966): Algorithmic randomness
- Jaynes (2003): Maximum entropy methods — information theory ↔ statistical mechanics
- MacKay (2003): "Information Theory, Inference, and Learning Algorithms"
The revision trigger (from biology analysis):
bio_v2/exploration-situated-substrate-architecture.md— evaluator discoveryabstract_conclusions/exploration-abstract-structure-and-info-comp-revision.md— K→Ke+Kd split rationalebio_v2/synthesis-information-substrate-architecture.md§10 — info-comp as validator of situated substrate architecture
1.3 Key observations from literature
Shannon's framework has a specific structural assumption: the encoder f(s)→x and decoder g(y)→ŝ are DETERMINISTIC functions. All noise lives in the channel P(Y|X). Shannon's theorems (source coding, channel coding, rate-distortion) are proven under this assumption.
This assumption is valid for:
- Digital communication (encoders and decoders are algorithms — deterministic by construction)
- DNA replication (ribosome is a molecular machine — deterministic by physical geometry)
- Formal mathematics (proof rules are deterministic — valid or invalid)
This assumption FAILS for:
- Human language comprehension (interpretation varies by person, context, culture)
- AI/LLM output interpretation (statistical generation, semantically variable)
- Cultural transmission (meaning drifts across generations)
The failure isn't a "noisy channel" problem — it's a NOISY DECODER problem. Shannon's framework can't model it because it assumes decoders are noise-free. Adding channel redundancy doesn't help when the decoder is the noise source.
Step 1b — Domain Type Declaration
Type: Substrate
The info-comp core describes the MACHINERY of information processing — how information is structured, transmitted, encoded, decoded, measured, and constrained. It's analogous to biology (machinery of life), entity system (machinery of typed data), and cognitive substrate (machinery of thought).
Predictions from substrate type:
- Filter tightness: ~12-20% (tight — sequential dependencies)
- Core triad function: information flow (how information is structured and transformed)
- Dependency chain depth: moderate to deep (sequential processing stages)
- Heavy pair count: approximately equals primitive count
These predictions will be checked against findings.
Step 2 — Landscape Analysis
2.1 The information theory landscape
Information theory is a mature mathematical field (~75 years). Its core structure has been stable since Shannon, with major extensions in coding theory, network information theory, and connections to other fields.
Key landscape features:
| Area | What it covers | Structural role |
|---|---|---|
| Source coding | Compression — representing sources efficiently | Encoder optimization |
| Channel coding | Error correction — reliable transmission through noise | Encoder-decoder joint optimization |
| Rate-distortion | Lossy compression — trade-off between rate and fidelity | Encoder-measure interaction |
| Network information theory | Multi-user channels, broadcast, relay | Channel topology |
| Algorithmic information theory | Kolmogorov complexity — individual-object information | Distribution-free measure |
| Information geometry | Fisher information, divergences as geometry | Measure as geometric structure |
2.2 What recurs across the landscape
Every area of information theory involves the same structural elements:
- An ALPHABET of symbols
- A STATISTICAL STRUCTURE over those symbols
- A PHYSICAL or LOGICAL MEDIUM for transmission/storage
- An ENCODING PROCESS that maps source to medium
- A DECODING PROCESS that recovers meaning from received signals
- QUANTITATIVE MEASURES of information content
- FUNDAMENTAL BOUNDS on what's achievable
These seven elements recur whether you're studying compression, error correction, cryptography, or machine learning. They're the candidate primitives.
Step 3 — Primitive Extraction
3.1 The original 6-primitive analysis (v1)
The v1 analysis identified 6 primitives:
| # | Primitive | What it is |
|---|---|---|
| 1 | Symbol (Σ) | Atomic unit of information |
| 2 | Distribution (P) | Probability structure over symbols |
| 3 | Channel (C) | Stochastic mapping from input to output |
| 4 | Code (K) | Structured transformation (encoder/decoder pair) |
| 5 | Measure (μ) | Information quantities |
| 6 | Constraint (Γ) | Bounds and rates |
3.2 Why Code (K) must split
The K primitive bundles two structurally independent operations:
Encoding (source → channel-compatible form):
- Maps source symbols to channel inputs
- Can be optimized for source statistics (compression)
- Can be optimized for channel characteristics (error protection)
- Can be deterministic or lossy
- Example: Huffman encoding, LDPC encoding, DNA→mRNA transcription, natural language production
Decoding (received signal → interpreted meaning):
- Maps channel outputs to estimated source symbols
- Can be deterministic (lookup table, ribosome) or stochastic (human interpretation)
- Its reliability determines system reliability
- Example: Viterbi decoding, ribosome translation, human reading comprehension, LLM output parsing
The primitive test — independent existence:
- Can encoding exist without decoding? YES — writing a message that nobody reads, DNA in a test tube, encrypted data with lost key. The encoding exists independently.
- Can decoding exist without encoding? MARGINALLY — a decoder can interpret raw channel output (pattern recognition on noise), but this is degenerate. More precisely: decoding presupposes SOMETHING was encoded, even if the specific encoding scheme is unknown.
The primitive test — independent failure modes:
- Encoder failure: information is mis-encoded. The message doesn't faithfully represent the source. Effect: wrong content. Example: imprecise language, lossy compression artifacts, transcription errors.
- Decoder failure: information is mis-decoded. The received message is misinterpreted. Effect: wrong interpretation. Example: misreading, cultural misunderstanding, hallucination, ribosome misincorporation.
These are INDEPENDENT. Perfect encoding + bad decoding = wrong understanding of correct content. Bad encoding + perfect decoding = correct execution of wrong instructions. The failure modes are structurally different.
The structural argument: The biology analysis revealed that evaluator determinism (Kd level) is the single most important variable separating information substrates. With K bundled, the info-comp core literally cannot express this distinction — all substrates have "Code" at some level. With Ke and Kd separated, the decoder's determinism becomes independently assessable.
3.3 The revised 7-primitive set
| # | Primitive | Definition | Shannon equivalent |
|---|---|---|---|
| 1 | Symbol (Σ) | Atomic information unit — the alphabet from which messages are composed | Source alphabet |
| 2 | Distribution (P) | Probability structure over symbols — frequency, correlation, conditional probability | Source statistics P(X) |
| 3 | Channel (C) | Transmission medium — stochastic mapping from input to output with noise characteristics | Noisy channel P(Y|X) |
| 4 | Encoder (Ke) | Source → channel-compatible mapping — how information is represented for transmission or storage | Encoding function f(s)→x |
| 5 | Decoder (Kd) | Channel output → interpreted meaning — how received signals are translated into meaning or function | Decoding function g(y)→ŝ |
| 6 | Measure (μ) | Information quantities — entropy, mutual information, relative entropy, complexity | H(X), I(X;Y), D(P‖Q) |
| 7 | Constraint (Γ) | Bounds and rates — capacity, rate-distortion, complexity bounds, fundamental limits | C, R(D), bounds |
3.4 What was gained by splitting
With Kd as a separate primitive, the info-comp core can now:
-
Distinguish hard from soft substrates: Kd4 (deterministic decoder) vs Kd1-2 (stochastic decoder). Previously invisible when K bundled encoder and decoder.
-
Model evaluator noise independently of channel noise: Kd-noise is independent of C-noise. Shannon's original framework could only model C-noise. Now BOTH noise sources are expressible: which dominates? (For cognition-linguistic: Kd-noise > C-noise. For biology: C-noise > Kd-noise. For entity system: both ≈ 0.)
-
Predict system reliability: Total system noise ≈ C-noise + Kd-noise. Reliable system requires BOTH clean channel AND deterministic decoder.
-
Explain hallucination: AI has C-noise ≈ 0 (digital) but Kd-noise > 0 (statistical semantics). Failure is AT THE DECODER, not the channel. Shannon's original framework couldn't express this.
-
Map cleanly to the situated substrate architecture: Kd → Vr (evaluator) is now a direct one-to-one mapping, instead of K → {En+Vr} as a split.
Step 3b — Partial Levels
Symbol (Σ)
| Level | Description | Instance |
|---|---|---|
| Σ0 | No symbols | Continuous signal, no discretization |
| Σ1 | Binary alphabet | {0,1} — minimal discrete. Bits. |
| Σ2 | Finite fixed alphabet | ASCII, DNA bases {A,T,G,C}, amino acids (20), musical notes (12) |
| Σ3 | Extensible alphabet | Unicode, entity type system (new types definable), vocabulary (new words) |
| Σ4 | Hierarchical alphabet | Symbols with internal structure — codons (triplets of bases), typed entities (type + data) |
| Full Σ | Self-describing alphabet | Alphabet containing its own description — entity types-as-entities, Gödel numbering |
Phase transition: Σ2→Σ3 (Extensibility). Below: alphabet is fixed — the system works with a closed set of symbols. Above: alphabet can GROW — new symbols are added. The information system becomes open. DNA is Σ2 (fixed 4 bases for ~4 Gy). Entity types are Σ3-4 (extensible + hierarchical). Natural language is Σ3 (vocabulary grows continuously).
Distribution (P)
| Level | Description | Instance |
|---|---|---|
| P0 | No structure | Uniform random — all symbols equally likely. Maximum entropy. |
| P1 | Unigram statistics | Single-symbol frequencies. Zipf's law. Codon usage bias. |
| P2 | Pairwise correlation | Bigram statistics, conditional P(Xn|Xn-1). Markov chains. |
| P3 | Higher-order structure | N-gram models, context-dependent distributions. HMMs. |
| P4 | Structured distribution | Grammar-generated distributions. PCFGs. Protein family profiles. |
| Full P | Self-referential distribution | Distribution including itself as a variable. Bayesian updating of the model. Solomonoff induction. |
Phase transition: P2→P3 (Context dependence). Below: probability depends only on the immediately preceding symbol. Above: probability depends on EXTENDED CONTEXT — the meaning of a word depends on the whole sentence/paragraph. Simple Markov models fail; richer statistical models needed (neural language models, HMMs).
Channel (C)
| Level | Description | Instance |
|---|---|---|
| C0 | No channel | Isolated system. No transmission possible. |
| C1 | Noiseless channel | Perfect transmission — output = input. Digital copy within same machine. |
| C2 | Symmetric noise | Each symbol equally likely to be corrupted. Binary symmetric channel. |
| C3 | Structured noise | Noise depends on input — some symbols more confused than others. Burst errors. Fading. |
| C4 | Adversarial channel | Deliberate corruption, interception, modification. Cryptographic threat model. |
| Full C | Channel with feedback | Receiver communicates back to sender — adaptive encoding, acknowledgment, retransmission. |
Phase transition: C1→C2 (Noise introduction). Below: transmission is perfect — no information lost. Above: some information corrupted. Error correction becomes necessary. Shannon's channel coding theorem applies from C2 upward.
Encoder (Ke)
| Level | Description | Instance |
|---|---|---|
| Ke0 | No encoding | Raw source, no transformation. Direct transmission. |
| Ke1 | Fixed encoding | One-to-one mapping. ASCII. Uncompressed. No optimization. |
| Ke2 | Source-adapted encoding | Optimized for source statistics. Huffman, arithmetic coding. Compression. |
| Ke3 | Channel-adapted encoding | Optimized for channel. Error-correcting codes (Reed-Solomon, turbo, LDPC). |
| Ke4 | Semantic encoding | Preserves MEANING, not just symbols. Typed data. Formal specification. |
| Full Ke | Self-describing encoding | Includes its own decoding instructions. Entity ECF. XML with schema. Executable specs. |
Phase transition: Ke2→Ke3 (Channel adaptation). Below: encoding optimized for SOURCE (compress well) but not CHANNEL (no error protection). Above: optimized for BOTH — compressed AND error-protected. Reliable communication over noisy channels becomes possible.
Second critical transition: Ke3→Ke4 (Semantic encoding). Below: encoding preserves SYMBOLS faithfully but doesn't constrain MEANING. Above: encoding constrains MEANING — type systems tell you what data IS, not just what bytes it contains. Encoding becomes FORMAL rather than merely symbolic.
Decoder (Kd)
| Level | Description | Instance |
|---|---|---|
| Kd0 | No decoder | Received signal not interpreted. Raw bits. |
| Kd1 | Stochastic decoder | Interpretation varies randomly. Guessing. Early language learner hearing unfamiliar language. |
| Kd2 | Biased decoder | Usually correct but systematically wrong for some inputs. Cognitive biases. Cultural misinterpretation. |
| Kd3 | Reliable decoder | Correct for >99% of inputs in trained domains. Skilled human reader. Experienced practitioner. |
| Kd4 | Deterministic decoder | Same input ALWAYS produces same output. Proof checker. Ribosome. Type-checked dispatch. |
| Full Kd | Verified decoder | Determinism is itself verified. Formally verified handler. Proofreading ribosome (exonuclease). |
Phase transition: Kd3→Kd4 (Determinism). THE critical transition for information substrates. Below: decoder is reliable but can still err — different decoder instances may produce slightly different outputs for the same input. Above: decoder is DETERMINISTIC — every instance produces exactly the same output for the same input.
This is the hard-substrate gate. Biology crosses it at the ribosome (molecular geometry enforces deterministic codon→amino acid mapping). The entity system crosses it at handler dispatch (type system enforces deterministic routing). Cognition crosses it only for formal content (proofs, mathematics). Cognition in linguistic mode stays below Kd4 — interpretation is inherently variable.
Measure (μ)
| Level | Description | Instance |
|---|---|---|
| μ0 | No measurement | Information content not quantified. |
| μ1 | Entropy | Shannon entropy H(X) = -Σ p(x) log p(x). Average surprise. |
| μ2 | Mutual information | I(X;Y) = H(X) - H(X|Y). How much Y tells about X. |
| μ3 | Relative entropy | D(P‖Q) = Σ p(x) log(p(x)/q(x)). Divergence between distributions. |
| μ4 | Algorithmic complexity | K(x) = shortest program producing x. Kolmogorov complexity. Distribution-independent. |
| Full μ | Meta-information | Information about information. Solomonoff induction. Complexity of the complexity measure. |
Phase transition: μ1→μ2 (Mutual information). Below: measure how much information a source CONTAINS. Above: measure how much one variable tells about ANOTHER. Information theory becomes a theory of COMMUNICATION, not just sources.
Constraint (Γ)
| Level | Description | Instance |
|---|---|---|
| Γ0 | No known constraints | No bounds on system behavior. Unbounded resources assumed. |
| Γ1 | Resource bounds | Finite memory, time, bandwidth. Basic computability limits. |
| Γ2 | Capacity bounds | Shannon capacity C = max I(X;Y). Fundamental limit on reliable rate. |
| Γ3 | Complexity bounds | P vs NP, PSPACE, decidability. What CAN be computed. |
| Γ4 | Trade-off bounds | Rate-distortion R(D). Multi-user capacity regions. Optimizing one degrades another. |
| Full Γ | Meta-constraints | Gödel incompleteness, halting problem, no-free-lunch. Limits of what CAN be bounded. |
Phase transition: Γ1→Γ2 (Capacity). Below: resources are finite but the FUNDAMENTAL LIMIT is unknown. Above: the theoretical maximum is known — Shannon capacity tells the best possible performance regardless of code cleverness.
Step 3c — Evaluator Identification
The info-comp core IS the abstract domain of information processing. Its "evaluator" — the mechanism that translates encoding into function — is the Decoder (Kd) itself. The decoder IS the evaluator at the information-theoretic level.
This is why the K→Ke+Kd split was necessary: the evaluator was hidden inside the bundled Code primitive. Making Kd explicit makes the evaluator visible at the abstract level.
Evaluator determinism in the info-comp core:
- The decoder (Kd) ranges from Kd0 (no interpretation) to Full Kd (verified deterministic)
- Kd4 is the hard-substrate gate — deterministic decoding
- The info-comp core can now MODEL evaluator determinism as a structural variable, not just assume it
Mapping to the situated substrate architecture:
- Kd (info-comp decoder) → Vr (SSA evaluator) — DIRECT one-to-one mapping
- This is the cleanest mapping in the entire info-comp → SSA correspondence
Step 4 — Dependencies
Σ → (nothing; foundation)
P → Σ (distributions are OVER symbols)
C → Σ (channel transmits symbols)
Ke → Σ, P (encoder maps source distribution to channel-compatible symbols)
Kd → C, Ke (decoder interprets channel output, knowing encoding scheme)
μ → P (entropy computed from distribution)
Γ → μ, C, Ke, Kd (bounds relate all components)
DAG:
Σ (hub — no dependencies)
├── P ──── μ
├── C
└── Ke ─── Kd
│
Γ ← (μ + C + Ke + Kd)
Hub: Σ (Symbol). Everything operates on symbols. The alphabet is the foundation.
Terminal: Γ (Constraint). Depends on everything else. Bounds and rates relate ALL components — you need to know the source (Σ,P), the channel (C), the code (Ke,Kd), and the measure (μ) to state the fundamental limits.
Key dependency: Kd → C + Ke. The decoder needs BOTH the channel characteristics (what noise was introduced) AND the encoding scheme (what was encoded) to decode correctly. This captures a real structural constraint: you can't decode without knowing what was encoded and how the channel might have corrupted it.
Depth: Maximum chain length is 4: Σ → P → Ke → Kd → Γ (through the μ requirement on Γ needing P). This is moderate — comparable to biology's depth.
Step 5 — Pair Enumeration
C(7,2) = 21 pairs.
| # | Pair | Name |
|---|---|---|
| 1 | Σ-P | Source alphabet |
| 2 | Σ-C | Symbol transmission |
| 3 | Σ-Ke | Encoding definition |
| 4 | Σ-Kd | Symbol recovery |
| 5 | Σ-μ | Alphabet entropy |
| 6 | Σ-Γ | Alphabet constraints |
| 7 | P-C | Source-channel interface |
| 8 | P-Ke | Source-adapted encoding |
| 9 | P-Kd | Source-informed decoding |
| 10 | P-μ | Source entropy |
| 11 | P-Γ | Source bounds |
| 12 | C-Ke | Channel coding |
| 13 | C-Kd | Channel decoding |
| 14 | C-Γ | Channel capacity |
| 15 | Ke-Kd | Code pair |
| 16 | Ke-μ | Encoding efficiency |
| 17 | Ke-Γ | Encoding limits |
| 18 | Kd-μ | Decoding quality |
| 19 | Kd-Γ | Decoding reliability bounds |
| 20 | μ-Γ | Information bounds |
| 21 | Ke-Kd | (already listed as #15) |
21 unique pairs (correcting: #21 is duplicate, actual count is 21 from C(7,2)).
Step 6 — Load Classification
Heavy pairs
| # | Pair | Name | Content | Why heavy |
|---|---|---|---|---|
| 1 | Σ-P | Source | Alphabet + distribution = information source | The foundational pair. No information theory without it. |
| 2 | Σ-Ke | Encoding definition | What symbols exist + how they're encoded | Encoding operates ON symbols — the alphabet determines what can be encoded. |
| 3 | P-Ke | Source-adapted encoding | Distribution + encoder = compression | Huffman, arithmetic coding — encoding optimized for source statistics. Core of source coding. |
| 4 | P-μ | Source entropy | Distribution + measure = quantified information content | H(X) = -Σ p(x) log p(x). THE formula of information theory. |
| 5 | C-Ke | Channel coding | Channel + encoder = error-protected transmission | Reed-Solomon, turbo codes, LDPC. Core of channel coding. |
| 6 | C-Kd | Channel decoding | Channel + decoder = received information recovery | Viterbi decoding, belief propagation. The reliability pair. |
| 7 | C-Γ | Channel capacity | Channel + constraint = fundamental transmission limit | C = max I(X;Y). Shannon's channel capacity. |
| 8 | Ke-Kd | Code pair | Encoder + decoder = complete code | The core translation pair. Encoding and decoding must be MATCHED. |
| 9 | Ke-Γ | Encoding limits | Encoder + constraint = source coding theorem | H(X) ≤ R. Entropy bounds compression rate. |
| 10 | Kd-Γ | Decoding reliability | Decoder + constraint = achievable error bounds | Probability of error → 0 iff R < C. |
| 11 | μ-Γ | Information bounds | Measure + constraint = Shannon's theorems | The theorems themselves — entropy bounds rates, capacity bounds reliability. |
11 heavy pairs of 21 (52%). High integration — consistent with the info-comp core being a tightly coupled abstract domain.
Light/moderate pairs
| Pair | Assessment | Reason |
|---|---|---|
| Σ-C | Light | Any alphabet goes through any channel (with appropriate encoding). Loosely coupled. |
| Σ-Kd | Light | Alphabet and decoder weakly coupled — decoder needs Ke knowledge, not just Σ. |
| Σ-μ | Moderate | Alphabet SIZE bounds entropy, but the relationship goes through P. |
| Σ-Γ | Light | Indirect through other primitives. |
| P-C | Light | Source statistics and channel noise are independent. |
| P-Kd | Light | Decoder needs encoding info, not directly source statistics. |
| P-Γ | Light | Indirect through μ. |
| Ke-μ | Moderate | Encoding rate relates to entropy — but primarily through P and Γ. |
| Kd-μ | Moderate | Mutual information measures decoding quality — but this is derivative of C-Kd and P-μ. |
| P-Ke is already heavy | — | — |
Check against substrate-type prediction
Predicted: heavy pair count ≈ primitive count. Actual: 11 heavy of 7 primitives. HIGHER than predicted — more like the entity system (11/15 = 73%) than typical substrates (6/15 = 40%). This reflects the tight integration of information-theoretic concepts — everything relates to everything else through Shannon's unified framework.
Step 7 — Coherent Sub-lattice
Dependency constraints
Σ must be present for anything else. Given Σ:
- P needs Σ only
- C needs Σ only
- Ke needs Σ + P
- Kd needs C + Ke (which needs Σ + P)
- μ needs P (which needs Σ)
- Γ needs μ + C + Ke + Kd (which needs everything)
Enumeration
Valid subsets of {P, C, μ, Ke, Kd, Γ} given Σ always present:
| # | Subset | Dependencies satisfied? |
|---|---|---|
| 1 | {} | ✓ (Σ only) |
| 2 | {P} | ✓ |
| 3 | {C} | ✓ |
| 4 | {P, C} | ✓ |
| 5 | {P, μ} | μ needs P ✓ |
| 6 | {P, C, μ} | ✓ |
| 7 | {P, Ke} | Ke needs Σ+P ✓ |
| 8 | {P, C, Ke} | ✓ |
| 9 | {P, μ, Ke} | ✓ |
| 10 | {P, C, μ, Ke} | ✓ |
| 11 | {P, C, Ke, Kd} | Kd needs C+Ke ✓ |
| 12 | {P, C, μ, Ke, Kd} | ✓ |
| 13 | {P, C, μ, Ke, Kd, Γ} | Γ needs everything ✓ (Full) |
Invalid examples:
- {Kd} alone: needs C + Ke → INVALID
- {C, μ}: μ needs P → INVALID
- {P, Kd}: needs C + Ke → INVALID
- {Γ} alone: needs everything → INVALID
- {C, Ke}: Ke needs P → INVALID
- {P, C, Kd}: Kd needs Ke → INVALID
- {μ}: needs P → INVALID
Total: 13 valid subsets + {}: 13 subsets of the 6 non-Σ primitives, plus {} = already counted. Including {} and {Σ} alone: 15 coherent subsets of 128 (2^7).
Wait — let me recount. The total lattice is 2^7 = 128 (all subsets of 7 primitives). But Σ must be present for anything. So the valid subsets are: {}, {Σ}, and {Σ + valid subset of remaining 6}. The 13 valid subsets above all include Σ.
- {} (empty — no primitives): 1
- {Σ} (just symbols): 1
- {Σ} + 13 valid combinations of {P,C,μ,Ke,Kd,Γ}: 13
Total: 15 coherent subsets of 128.
Filter: 15/128 = 11.7%. TIGHT.
Check against substrate-type prediction
Predicted: ~12-20%. Actual: 11.7%. Confirmed — tight filter consistent with substrate type. The deep dependency chain (Γ requires everything, Kd requires C+Ke) creates strong filtering. Slightly tighter than biology (12.5%), reflecting the info-comp core's strict sequential logic.
Step 8 — Build-up Sequence
Primary path
Step 0: {} → {Σ}
Symbols exist. Information can be represented discretely.
At this level: alphabets, enumeration, basic encoding in the Claude Shannon sense
of "symbols from a finite set."
Step 1: {Σ} → {Σ, P}
Symbols have statistical structure. Not all messages equally likely.
At this level: source models, frequency analysis, language statistics.
Step 2: {Σ, P} → {Σ, P, μ}
Information content can be MEASURED. Entropy quantified.
Source coding theorem: H(X) bounds lossless compression.
At this level: entropy calculations, source characterization, redundancy detection.
Step 3: {Σ, P, μ} → {Σ, P, μ, Ke}
Information can be ENCODED — mapped into efficient representation.
Compression is possible. Huffman, arithmetic coding.
At this level: encoding design, compression algorithms, representation optimization.
Step 4: {Σ, P, μ, Ke} → {Σ, P, μ, Ke, C}
Encoded information can be TRANSMITTED through a (noisy) channel.
Communication becomes possible. Channel models arise.
At this level: transmission systems, noise models, physical channels.
Step 5: {Σ, P, μ, Ke, C} → {Σ, P, μ, Ke, C, Kd}
Transmitted information can be DECODED — interpreted at the receiver.
*** GENESIS TRANSITION ***
Before: information exists, is measured, is encoded, is transmitted — but not INTERPRETED.
After: information is decoded — it produces meaning/function at the receiver.
This is where information becomes FUNCTIONAL, not just structural.
At this level: decoding algorithms, error correction, signal recovery, interpretation.
Step 6: {Σ, P, μ, Ke, C, Kd} → {Σ, P, μ, Ke, C, Kd, Γ}
Fundamental LIMITS are known. Shannon's theorems bound what's achievable.
The system is fully characterized — you know what CAN and CANNOT be done.
At this level: capacity theorems, rate-distortion theory, converse theorems, impossibility results.
The genesis transition: Step 4→5 (Kd appearing)
The decoder's appearance is the genesis transition at the info-comp level. This parallels:
- Biology: ribosome emergence (Vr appearing — encoding becomes functional)
- Entity system: handler dispatch activation (X appearing — data becomes computation)
- Cognition: symbolic language (Sy appearing — representation becomes communicable meaning)
- SSA: Vr appearing (Step 1→2 — encoding translates to function)
In ALL cases, the genesis transition is the EVALUATOR/DECODER emerging — the mechanism that translates encoding into function. The info-comp core confirms this at the most abstract level.
Alternative path
{Σ} → {Σ, C} → {Σ, P, C} → {Σ, P, C, Ke} → {Σ, P, C, Ke, Kd} → add μ → add Γ
This path starts with channel (transmission exists before encoding is optimized). Less common in theory but natural in practice — transmission systems existed before source coding theory. Both paths converge at step 5 (Kd appearing).
Step 9 — Load-bearing Compositions
Core triads
Primary: {Σ, Ke, Kd} — "What is a code?"
Symbol alphabet + encoder + decoder. The complete information code. All three pairs heavy:
- Σ-Ke: symbols define what can be encoded ✓
- Σ-Kd: symbols define what can be decoded ✓ (through Ke — but structurally Σ determines the alphabet of decoded outputs)
- Ke-Kd: encoder and decoder must be MATCHED ✓
This is the CODE triad — the structural unit of information translation.
Secondary: {Σ, P, μ} — "What is a source?"
Alphabet + distribution + entropy measure. All three pairs heavy:
- Σ-P: alphabet with distribution = source ✓
- P-μ: distribution's entropy ✓
- Σ-μ: alphabet size bounds entropy ✓
This is the SOURCE triad — the structural unit of information content.
Two core triads correspond to Shannon's two fundamental theorems:
- Source coding theorem: {Σ, P, μ} + Ke — entropy bounds compression
- Channel coding theorem: {Σ, Ke, Kd} + C + Γ — capacity bounds reliable rate
Multiple heavy triads are common across domains — any domain with sufficient integration will have several all-heavy triangles. Which gets elevated to "core triad" remains partly judgmental. Here the two candidates correspond to the two independently motivated halves of Shannon's framework, which gives structural reason for both.
Named compositions (triangles)
| Triangle | Name | Content |
|---|---|---|
| Σ-P-μ | Source characterization | What IS the information source? Entropy answers. |
| Σ-Ke-Kd | Complete code | How is information encoded AND decoded? The translation unit. |
| C-Ke-Kd | Channel coding system | Encoding adapted to channel, decoded at receiver. The communication unit. |
| Ke-Kd-Γ | Code optimality | Is this code achieving fundamental bounds? |
| P-Ke-μ | Source coding | Compressing source at entropy rate. |
| C-Kd-Γ | Decoding reliability | How reliably can the decoder work given channel noise and bounds? |
| C-Ke-Γ | Channel coding bounds | Error-protected encoding within capacity. |
| P-μ-Γ | Source bounds | Entropy and rate-distortion limits on source representation. |
Quad compositions
{Σ, P, Ke, μ} — Source coding system. The complete source coding setup: alphabet, statistics, encoder, and measure. This is where compression theory lives. Requires Ke adapted to P, measured by μ, operating on Σ.
{C, Ke, Kd, Γ} — Channel coding system. The complete channel coding setup: channel, encoder, decoder, and bounds. This is where reliability theory lives. Requires Ke and Kd jointly optimized for C within Γ.
{Σ, P, Ke, Kd} — End-to-end code. Source to destination: alphabet, statistics, encoding, decoding. No bounds or measures — just the operational code.
Full composition
{Σ, P, C, Ke, Kd, μ, Γ} — Complete information system. Shannon's full framework. All components present, all theorems applicable. The emergent property: FUNDAMENTAL LIMITS ON RELIABLE INFORMATION PROCESSING are known and achievable.
Step 10 — Emergent Properties
| Composition | Regime | Emergent Property | Testable? |
|---|---|---|---|
| {Σ, P, μ} | P at any level, μ ≥ μ1 | Entropy as content measure — information has quantifiable content | YES — computed from distribution |
| {P, Ke, μ} | Ke ≥ Ke2, μ ≥ μ1 | Source coding theorem — H(X) ≤ R for lossless compression | YES — Shannon 1948 |
| {C, Ke, Kd, Γ} | Ke ≥ Ke3, Γ ≥ Γ2 | Channel coding theorem — reliable at R < C | YES — Shannon 1948, capacity-achieving codes exist |
| {Ke, Kd, μ, Γ} | μ ≥ μ2, Γ ≥ Γ4 | Rate-distortion — R(D) trade-off | YES — Shannon 1959 |
| {Σ, Ke, Kd} | Kd ≥ Kd4 | Deterministic translation — encoding reliably maps to function | YES — ribosome, type-checked dispatch |
| {Σ, Ke, Kd} | Kd ≤ Kd2 | Evaluator noise — system unreliable regardless of channel quality | YES — human linguistic interpretation |
| {C, Kd} | C ≥ C1, Kd ≤ Kd2 | Decoder-dominated noise — channel perfect but decoding unreliable | YES — AI hallucination (C≈0, Kd-semantic low) |
| {Ke, Kd} | Ke ≥ Ke4, Kd ≥ Kd4 | Formal information substrate — semantic encoding + deterministic decoding | YES — entity system, biology |
| Full set | All at high levels | Complete characterization — everything about the system is known and bounded | YES — mature info-theoretic analysis |
The evaluator noise prediction
This is the key new emergent property enabled by the Ke/Kd split:
When Kd-noise > C-noise, adding channel redundancy doesn't improve system reliability.
Shannon's framework says: add redundancy to overcome channel noise. But if the DECODER is noisier than the channel, redundancy in the channel doesn't help — the decoder will still misinterpret the redundant message. The solution is different: make the encoding MORE FORMAL (raise Ke to Ke4) so the decoder has less room for interpretation, or replace the decoder with a deterministic one (raise Kd to Kd4).
This predicts:
- Saying the same thing louder or more often doesn't fix misunderstanding (human communication)
- Making AI outputs longer or more detailed doesn't fix hallucination (encoder noise)
- Only FORMAL ENCODING + DETERMINISTIC DECODING produces reliable systems (entity system, biology)
Step 11 — Cross-Domain Structural Patterns
11.1 Comparison to other substrate-type domains
| Property | Info-comp core | Biology | Entity system | Cognitive substrate |
|---|---|---|---|---|
| Primitives | 7 | 6 | 6 | 6 |
| Filter | 11.7% | 12.5% | 14% | 27% |
| Heavy pairs | 11/21 (52%) | 6/15 (40%) | 11/15 (73%) | 4/15 (27%) |
| Core triad | {Σ,Ke,Kd} + {Σ,P,μ} | {G,T,R} | {E,I,T} | {Rp,Ct,Sy} |
| Core triad function | Information flow | Information flow | Information flow | Information flow |
| Dependency depth | 4 | 3-4 | 3 | 3 |
Observations:
- Filter tightness is in the substrate range (11.7% — tightest analyzed). Confirmed substrate type.
- Core triad function is information flow — confirmed substrate type.
- TWO core triads is unusual — only the info-comp core has this. Reflects the domain's dual structure (source theory + channel theory). The UI domain also found two core triads, but for different reasons.
- Heavy pair percentage (52%) is between biology (40%) and entity system (73%). The info-comp core is more tightly integrated than biology but less than the entity system.
11.2 The 6→9 expansion pattern
If the info-comp core is a substrate, it should expand to a ~9-primitive surface through bridge mechanisms. Does it?
The info-comp core's "surface" is the Abstract Surface {St, Or, Rg, Pr, Ac, Pt, Ex, [Rs], [Gn]} — what all functional surfaces have in common. The expansion from info-comp (7) to abstract surface (7+2 = 9) follows the pattern:
- Core triad {Σ, Ke, Kd} becomes AMBIENT at surface: symbols, encoding, and decoding are assumed by every surface function
- Non-core {P, C, μ, Γ} expand into surface roles:
- P (distribution) → patterns underlying Structure (St) and Organization (Or)
- C (channel) → medium for Perception (Pr) and Exchange (Ex)
- μ (measure) → basis for Regulation (Rg) — measure deviations to regulate them
- Γ (constraint) → bounds that Protection (Pt) enforces and Action (Ac) operates within
This maps, though less tightly than the concrete substrate→surface mappings. The abstract level has looser correspondence than the concrete level — expected because abstraction loses domain-specific detail.
11.3 Phase transition alignment
| Transition | Info-comp core | SSA | Biology | Entity system |
|---|---|---|---|---|
| Genesis | Kd appears (Step 4→5) | Vr appears (Step 1→2) | R appears (ribosome) | X activates (dispatch) |
| Formality | Ke3→Ke4 (semantic encoding) | En formal structure | DNA regulatory complexity | Type system depth |
| Determinism | Kd3→Kd4 (hard substrate gate) | Vr3→Vr4 | Ribosome precision | Dispatch determinism |
| Completeness | Γ appearing (all bounds known) | Se appearing (selection) | Natural selection | Market selection |
The genesis transition aligns across all levels: it's always the DECODER/EVALUATOR appearing. The determinism transition also aligns: it's always the decoder/evaluator becoming deterministic. This cross-domain alignment supports the info-comp core as a valid abstraction of substrate structure.
Step 12 — Cross-Domain Mapping
12.1 Mapping to the situated substrate architecture (SSA)
| Info-comp (7) | SSA (7) | Quality | Notes |
|---|---|---|---|
| Σ (Symbol) | En (Encoding) — partially | Partial | Σ is the encoding alphabet. En is the full encoding structure. Σ is PART of En. |
| P (Distribution) | Cm (Community) — at population scale | Conceptual | Distribution over symbols at population scale IS community statistical structure. |
| C (Channel) | Cx (Context) | Good | Channel is the transmission medium. Context is the operating environment. Transmission IS a context property. |
| Ke (Encoder) | En (Encoding) — the scheme | Partial | Ke is how information is encoded. En is the full encoding. Ke is the ACTIVE part of En. |
| Kd (Decoder) | Vr (Evaluator) | Direct | Decoder IS evaluator. Same structural role. Best mapping. |
| μ (Measure) | Se (Selection) — partially | Conceptual | Information measure informs selection criterion. μ INFORMS Se. |
| Γ (Constraint) | Distributed across Vr + Cx | Distributed | Constraints on evaluator fidelity and channel capacity. |
Assessment: The mapping is NOT one-to-one overall. Σ and Ke both map to En. P maps to Cm at population scale. μ informs Se but isn't identical. The two frameworks are COMPLEMENTARY perspectives on the same systems:
- Info-comp core: INTERNAL structure of information processing (what happens inside)
- SSA: EXTERNAL architecture of situated information systems (how they're organized in context)
The Kd→Vr mapping is the cleanest — direct one-to-one. This validates the K→Ke+Kd split: before the split, K→{En+Vr} was a messy split. After, Kd→Vr is direct.
12.2 Mapping to concrete substrates
| Info-comp | Biology | Entity system | Cognition (formal) | Cognition (linguistic) | AI/LLM |
|---|---|---|---|---|---|
| Σ | 4 bases, 20 amino acids (Σ2) | Typed entities (Σ3-4) | Mathematical symbols (Σ3) | Vocabulary (Σ3) | Token vocabulary (Σ3) |
| P | Codon usage bias (P1) | Entity content distribution (P2) | Theorem distribution (P3-4) | Zipfian word frequency (P3-4) | Training data distribution (Full P) |
| C | DNA replication (C4, ~10^-9 error) | Hash-verified sync (Full C) | Digital/print (C4-Full) | Speech/writing (C2-3) | Digital (Full C) |
| Ke | Genetic code (Ke4, fixed) | ECF + types (Full Ke) | Formal notation (Ke4) | Natural language (Ke2) | Token generation (Ke2-3) |
| Kd | Ribosome (Kd4-Full) | Handler dispatch (Kd4-Full) | Proof checker (Kd4) | Interpretation (Kd1-2) | User interpretation (Kd2-3) |
| μ | Genome complexity (μ2) | Entity info content (μ4) | Proof complexity (μ3-4) | Sentence info (μ2-3) | Token entropy (μ3-4) |
| Γ | Mutation rate, metabolic cost (Γ2) | Bandwidth, storage (Γ2-3) | Computational bounds (Γ3) | Cognitive limits (Γ1-2) | Context window (Γ3) |
12.3 What the positioning reveals
The Ke-Kd diagonal is the reliability axis. Systems with both high Ke AND high Kd are reliable. Systems with either low are unreliable:
| System | Ke | Kd | Reliable? | Where noise dominates |
|---|---|---|---|---|
| Biology | 4 (fixed genetic code) | 4-Full (ribosome) | YES | Channel (mutations — very low) |
| Entity system | Full (self-describing) | 4-Full (dispatch) | YES | Neither (all ≈ 0) |
| Formal cognition | 4 (notation) | 4 (proof checker) | YES | Neither |
| Linguistic cognition | 2 (ambiguous) | 1-2 (variable) | NO | Decoder (Kd dominates) |
| AI/LLM | 2-3 (statistical) | 2-3 (variable) | PARTIAL | Encoder (Ke — hallucination) |
| Culture | 2-3 (codified) | 2-3 (conventional) | PARTIAL | Distributed (all components) |
Key insight: Shannon's framework predicts that reliable communication requires the decoder to be MORE deterministic than the channel is noisy. When the DECODER is the main noise source (cognition-linguistic: Kd1-2), you can't code around it the way you can code around channel noise. This is WHY hard evaluators matter: they remove the evaluator as a noise source, leaving only channel noise, which CAN be coded around (error correction, hash verification).
Manifestation Landscape
Positioned systems
| System | Σ | P | C | Ke | Kd | μ | Γ |
|---|---|---|---|---|---|---|---|
| Morse code | 2 | 1 | 2-3 | 2 | 4 | 1 | 1 |
| DNA replication | 2 | 1 | 4 | 4 | 4-Full | 1-2 | 2 |
| Entity sync | 3-4 | 2 | Full | Full | 4-Full | 4 | 2-3 |
| Human conversation | 3 | 3-4 | 2-3 | 2 | 1-2 | 2-3 | 1-2 |
| LLM generation | 3 | Full | Full | 2-3 | 2-3 | 3-4 | 3 |
| Formal proof | 3 | 3-4 | 4-Full | 4 | 4 | 3-4 | 3 |
| TCP/IP | 1 | 0-1 | 3-4 | 3 | 4 | 2 | 2 |
| Shannon ideal | Full | Full | parametric | optimal | optimal | Full | Full |
Attractor positions
| Attractor | Position | What makes it sticky | Systems at this attractor |
|---|---|---|---|
| Digital reliable | (Σ2, P1, C4-Full, Ke3, Kd4, μ2, Γ2) | Error correction + deterministic decoding = reliable | TCP, disk storage, Morse |
| Biological | (Σ2, P1, C4, Ke4, Kd4-Full, μ2, Γ2) | Fixed alphabet + deterministic code | DNA replication |
| Formal | (Σ3, P3-4, C4-Full, Ke4, Kd4, μ3-4, Γ3) | Semantic encoding + proof checking | Mathematics, formal verification |
| Linguistic | (Σ3, P3-4, C2-3, Ke2, Kd1-2, μ2-3, Γ1-2) | Flexible but unreliable | Human conversation, culture |
| Statistical AI | (Σ3, Full P, Full C, Ke2-3, Kd2-3, μ3-4, Γ3) | Rich distribution + perfect channel + imperfect code | LLM generation |
Summary
Domain characterization
| Property | Value |
|---|---|
| Domain name | Information-Computational Core (revised) |
| Domain type | Substrate |
| Primitives | 7: {Σ, P, C, Ke, Kd, μ, Γ} |
| Hub | Σ (Symbol) |
| Core triads | {Σ, Ke, Kd} (code) + {Σ, P, μ} (source) |
| Filter | 15/128 = 11.7% (tight — tightest substrate analyzed) |
| Heavy pairs | 11/21 = 52% |
| Dependency depth | 4 |
| Genesis transition | Step 4→5: Kd appears (decoder/evaluator emerging) |
| Key phase transition | Kd3→Kd4 (determinism — the hard-substrate gate) |
What the revision changes
| Before (v1, 6 primitives) | After (v2, 7 primitives) | What was gained |
|---|---|---|
| Code (K) bundles encoder and decoder | Ke and Kd are separate | Evaluator determinism visible as structural variable |
| Can't distinguish hard/soft substrates | Kd level distinguishes them | Hard-substrate gate at Kd3→Kd4 |
| Can't model decoder noise | Kd-noise independent of C-noise | Explains hallucination, linguistic unreliability |
| K→{En+Vr} is messy split to SSA | Kd→Vr is direct mapping | Cleaner correspondence between frameworks |
| One core triad {Σ,P,μ} | Two core triads | Source theory + channel theory structurally separated |
Validation status
| Check | Result |
|---|---|
| Filter in substrate range (12-20%)? | 11.7% — YES (slightly tighter) |
| Core triad function = information flow? | YES — both triads describe information structure/transformation |
| Genesis transition = evaluator appearing? | YES — Kd appearing at Step 4→5 |
| Maps to SSA? | YES — Kd→Vr is direct; others are complementary |
| Maps to concrete substrates? | YES — biology, entity system, cognition all positioned |
| Cross-domain patterns replicate? | YES — tight filter, info-flow core triad, evaluator transition |