Skip to content

jonland82/continuous-computation

Repository files navigation

When Continuous Physical Processes Can Compute

→ Homepage

This repo is about a simple question: when does a continuous physical process count as a real computation rather than just a changing signal? The answer developed here is that computation appears only when coarse-grained states are readable, stable, and predictive, and those properties are usually thermodynamic achievements rather than free gifts of description. The four HTML pages present that argument as an overview plus three connected papers spanning framework, worked examples, and geometry.

This repository is a small static HTML project, plus an accompanying paper draft, about when a continuous physical process can genuinely support a finite symbolic computation.

The top-level contents are:

There is no build step. Open index.html in a browser to navigate the set.

Separate Draft

The arxiv_paper_draft/ folder contains a separate manuscript, continuous_computation.tex, titled When Do Continuous Dynamics Allow Finite-State Computation? It is part of the same research program as the site, but it is narrower than the full three-paper web version.

The draft focuses on the finite-horizon core of the project: decodability, one-step stability, and approximate lumpability; the Markov approximation theorem; the computation epoch; the worked \sin(t) versus \sin(1/t) comparison; the local dissipation-lumpability inequality and power-duration tradeoff; and the observer-cost lower bound on maintaining a computation over a target epoch.

It is not a literal merger of everything on the site. In particular, the current manuscript does not include the site's separate causal computation gain result, and it does not carry over the full geometry paper's stronger global claims about classifying the amenable set, proving measure-zero under Wiener measure, or giving a spectral-gap characterization of the boundary.

The figure-generation scripts in the same folder are:

  • fig1_script.py generates the two-trajectory comparison used for the paper's dwell-time example, contrasting the amenable \sin(t) case with the non-amenable \sin(1/t) case under the same binary partition.
  • fig2_script.py generates the dissipation-lumpability curve and the power-duration tradeoff plot that support the manuscript's thermodynamic maintenance section.
  • fig3_script.py generates a schematic amenable-versus-non-amenable geometry figure for the broader geometry side of the project; it is a supporting repo figure, not one cited in the current manuscript.
  • fig4_script.py generates a spectral amenability comparison across ideal tone, narrowband, Brownian-like, and white-noise signal classes; like fig3_script.py, it supports the broader project framing rather than the present paper text.

These scripts use Matplotlib and NumPy, with fig4_script.py also using SciPy's error function helper. Generated outputs live in arxiv_paper_draft/figures/; the current manuscript uses the first two of those figure PDFs directly. The scripts currently write via a hard-coded OUTDIR, so rerunning them in a different checkout may require making that path repo-relative first.

For the compiled manuscript, see continuous_computation.pdf.

Supplemental Notes

The supplemental_research_notes/ directory contains short extensions that sit alongside the main papers and the arXiv draft rather than replacing them. Start with supplemental_research_notes/README.md for the local overview.

Current contents:

Supporting assets in the same folder include the figure files used by the finite-horizon geometry note:

Project Intuition

The central claim of the repo is that computation is not fundamental just because a system can be described continuously in time. A continuous process only counts as a usable computation when an observer can extract a stable alphabet from it, and when that alphabet has predictive closure of its own.

In practical terms, a coarse-graining has to do three things:

  1. Make the current symbolic state readable.
  2. Make that state persist long enough to be used.
  3. Make the next symbolic state depend mainly on the current symbol, not on unresolved micro-detail inside the symbol's cell.

The papers then push that idea in three directions:

  • physics: what thermodynamic cost buys those properties,
  • examples: why some trajectories can never be repaired into computations,
  • geometry: what the set of computation-amenable trajectories looks like inside function space.

Files

This is the front page for the project. It gives a high-level overview of the three papers, frames the overall problem, and presents six headline theorems in compact card form.

Use this page when you want the shortest entry point into the repo.

This is the conceptual core of the project. It asks when a continuous physical process supports an emergent finite-state machine, and what energetic cost is required to keep that machine reliable.

Content:

  • defines the three operative conditions: decodability, stability, and approximate lumpability,
  • derives a Markov approximation result for the induced symbolic dynamics,
  • introduces the computation epoch $T_{\mathrm{comp}}$,
  • argues that lumpability is not free structure but a thermodynamic achievement,
  • derives dissipation-based bounds on symbolic reliability,
  • includes observer costs through a co-dissipation bound.

Intuition:

  • A symbolic state is only real if an observer can read it.
  • A readable state is only useful if it persists.
  • A persistent state is only computational if it predicts its own successor at the symbolic level.
  • Dissipation is what suppresses micro-level ambiguity strongly enough for the symbolic description to become causally meaningful.

Some of the mathematics:

  • decodability is expressed schematically as $H(A_n \mid R_n) \le \varepsilon$,
  • stability as $\Pr(A_{n+1} \neq A_n) \le \eta$,
  • lumpability error $\lambda$ measures how much the next-step law changes within a coarse-grained cell,
  • the Markov approximation bound is of the form

$$ |\mathcal{L}(A_0,\ldots,A_N) - \mathcal{L}(M_0,\ldots,M_N)|_{\mathrm{TV}} ;\lesssim; N\bigl(\lambda + p_\varepsilon + \eta\bigr), $$

  • the dissipation-lumpability relation is of the form

$$ \lambda(P,\Pi) \approx \lambda_{\mathrm{eq}}(\Pi) - c(\Pi)\sqrt{\sigma(P)}, $$

  • positive causal computation gain requires nonzero entropy production.

This paper is the shortest and most concrete. It compares two trajectories with the same range and the same binary coarse-graining:

  • $x(t) = \sin(t)$,
  • $x(t) = \sin(1/t)$.

Content:

  • shows how the three conditions behave in a minimal worked example,
  • demonstrates that $\sin(1/t)$ fails because zero crossings accumulate without bound near the origin,
  • shows that $\sin(t)$ satisfies the conditions for suitable sampling scale $\Delta$,
  • uses the contrast to argue that amenability is a dwell-time property, not a smoothness property.

Intuition:

  • $\sin(t)$ has evenly spaced zero crossings, so symbolic labels have time to persist.
  • $\sin(1/t)$ crosses too rapidly near $t = 0$, so no observer can choose a sampling rate that makes the symbolic alphabet simultaneously stable and predictive there.
  • If the trajectory does not provide dwell time, dissipation cannot manufacture it.

Some of the mathematics:

  • the coarse-graining is

$$ \Pi(x) = \begin{cases} R, & x \ge 0, \\ L, & x < 0, \end{cases} $$

  • stability is controlled by the spacing between sign changes,
  • lumpability fails when microstates inside the same symbolic cell have very different next-symbol behavior,
  • the comparison makes the failure mechanism geometric rather than merely analytic.

This paper lifts the previous results to the level of function space. It studies the set $\mathcal{A}$ of trajectories that admit a computation-supporting coarse-graining, and its complement $\mathcal{N}$.

Content:

  • defines the amenable set $\mathcal{A}$ and non-amenable set $\mathcal{N}$,
  • studies structural properties of $\mathcal{A}$ such as non-convexity and lack of closure,
  • interprets minimum dwell time as a geometric depth coordinate,
  • shows that $\mathcal{A}$ has measure zero under Wiener measure,
  • connects amenability to a spectral-gap characterization.

Intuition:

  • Computation-supporting trajectories are not generic; they are special, structured, and thermodynamically maintained.
  • The boundary of computation is the boundary where metastability disappears.
  • Dissipation can be read geometrically as motion from generic noisy trajectories toward the interior of the amenable region.

Some of the mathematics:

  • $\mathcal{A}$ consists of trajectories for which some $(\Pi,\Delta)$ satisfies the three symbolic conditions,
  • the minimum dwell time $\tau_{\min}$ stratifies the interior of $\mathcal{A}$,
  • under Wiener measure,

$$ \mu_W(\mathcal{A}) = 0, $$

  • the boundary of $\mathcal{A}$ is tied to closure of a transfer-operator spectral gap.

Core Mathematical Thread

Across the three papers, the same backbone repeats:

  1. Start with a continuous process and a coarse-graining $\Pi$.
  2. Ask whether the induced symbols are decodable, stable, and lumpable.
  3. If they are, the symbolic dynamics is close to a finite-state Markov process for a finite epoch.
  4. The size of that epoch depends on how much dissipation suppresses micro-level ambiguity.
  5. Computation-amenable trajectories form a thin, non-generic subset of all continuous trajectories.

Selected References

  • Claude E. Shannon (1948), A Mathematical Theory of Communication, Bell System Technical Journal 27(3), 379-423; 27(4), 623-656. Foundational source for entropy, mutual information, and coding.
  • John G. Kemeny and J. Laurie Snell (1960), Finite Markov Chains. Classical reference for aggregation and finite-state reductions.
  • Peter Buchholz (1994), Exact and ordinary lumpability in finite Markov chains, Journal of Applied Probability 31(1), 59-75. Canonical structural reference for lumpability.
  • Rolf Landauer (1961), Irreversibility and Heat Generation in the Computing Process, IBM Journal of Research and Development 5, 183-191. Foundational thermodynamic limit for computation.
  • Charles H. Bennett (1982), The Thermodynamics of Computation: A Review, International Journal of Theoretical Physics 21, 905-940. Classic review of reversible computation and Landauer's principle.
  • Mark I. Freidlin and Alexander D. Wentzell, Random Perturbations of Dynamical Systems. Standard reference on metastability, escape, and dwell-time structure in noisy systems.
  • Erik P. Hoel, Larissa Albantakis, and Giulio Tononi (2013), Quantifying causal emergence shows that macro can beat micro, PNAS 110(49), 19790-19795. Background for causal emergence and effective information.
  • Peter Deuflhard and Marcus Weber (2005), Robust Perron cluster analysis in conformation dynamics, Linear Algebra and its Applications 398, 161-184. Spectral and transfer-operator perspective on metastable coarse-grainings.
  • Christof Schuette and Marco Sarich (2013), Metastability and Markov State Models in Molecular Dynamics. Modern reference on spectral gaps, transfer operators, and metastable decompositions.
  • Peter Morters and Yuval Peres (2010), Brownian Motion. Standard reference for Wiener measure and Brownian path geometry.

Purpose

The repo reframes "physical computation" as a precise question in non-equilibrium statistical mechanics instead of treating computation as automatically present whenever one can impose labels on a system.

That is the unifying idea behind all four HTML files: symbolic computation is an emergent, thermodynamically sustained regime, not a default property of continuous dynamics.

About

A mathematical and thermodynamic framework for understanding when continuous physical processes can support stable, predictive symbolic computation through coarse-graining.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors