Pinned Loading

1. grokking-modular-arithmetic grokking-modular-arithmetic Public

   Reproduction and mechanistic analysis of grokking on modular addition, following Power et al. (2022) and Nanda et al. (2023), with a per-frequency decomposition of the learned Fourier circuit.

   Python

2. ntk-linearization ntk-linearization Public

   Reproduction of the Neural Tangent Kernel phenomenon on a 1D regression task, with an activation-function comparison testing the prediction that smoother activations linearize better at fixed width.

   Python

3. information-bottleneck information-bottleneck Public

   Reproduction of the Information Bottleneck analysis of deep learning (Tishby & Shwartz-Ziv, 2017) and its rebuttal (Saxe et al., 2018), with a mechanistic analysis of tanh⁡\tanh tanh saturation as …

   Python

4. perceptron-capacity perceptron-capacity Public

   Empirical reproduction of Gardner's (1988) perceptron storage capacity result with an analytical overlay from the replica-symmetric calculation and a finite-size scaling analysis.

   Python

5. induction-heads induction-heads Public

   Reproduction of the induction-heads circuit (Olsson et al., 2022) in a 2-layer attention-only transformer trained on synthetic random-boundary repeat sequences, with mechanistic identification by a…

   Python

6. credit-risk-modeling credit-risk-modeling Public

   End-to-end LendingClub default-probability model with calibration, fairness audit, and FastAPI deployment

   Jupyter Notebook