Skip to content
View frecsh's full-sized avatar

Highlights

  • Pro

Block or report frecsh

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
frecsh/README.md

I work on LLM post-training and RL. My working thesis: general-purpose models are commoditizing — the value is in adaptation. Every organization sits on proprietary data, structures, and constraints that off-the-shelf intelligence doesn't understand, and post-training is how you mold a model to fit. The real world's signal is rich and waiting to be captured.

Right now, I'm finishing research applying post-training techniques (reward design, GRPO, distributed training) to open-source models for materials science. The co-first-author paper is being written.

Things I've built here

  • SymbolicGym — symbolic reasoning environments for training RL agents, inspired by Gymnasium and formal methods
  • Neural_Network_Sat_Guided_Design — using SAT solvers to generate neural network initial weights that satisfy constraints like orthogonality

Writing

I keep debugging notes from my training runs at jmadison.me — the weird failures are where the learning is:

Before this

Internships at AWS (Consultant), Cloudflare(Product), Datadog(Product), and Microsoft(Product + SWE), with an academic background in cybersecurity, privacy, and intelligence.

P.S. - Reward Hacking is just adversarial behavior with a KL penalty.

Pinned Loading

  1. SymbolicGym SymbolicGym Public

    Symbolic Reasoning Task environment for training RL agents. Inspired by OpenAI Gymnasium and Formal Methods

    Python 1

  2. Neural_Network_Sat_Guided_Design Neural_Network_Sat_Guided_Design Public

    Inspired by Inception. Experiment in training of neural networks by using Boolean Satisfiability (SAT) solvers to generate initial weights that satisfy certain constraints e.g. Orthogonality, Path …

    Jupyter Notebook