Skip to content

Repository files navigation

⚡ Algorithmic Infrastructure Portfolio

Reference architecture for a large-scale Quantitative ML platform and Multi-Agent LLM ecosystem.


CI CodeQL License: MIT Python PyTorch FastAPI Azure Docker

Production-grade scaffolding • Microservice topology • GPU-aware ML worker • Agentic LLM runtime • Azure-native IaC


🧭 Overview

This repository is the public architectural blueprint for a two-part systems portfolio:

Pillar Purpose
🧠 Quantitative ML Platform Low-latency signal generation, backtesting, and live-trading inference over tick-level market data.
🤖 Multi-Agent LLM Ecosystem Orchestrated agent graphs grounded in a proprietary retrieval stack, backed by Azure OpenAI + Anthropic.

The full systems design — service mesh, data contracts, failure modes, capacity plan — lives in ARCHITECTURE_REPORT.md.

⚠️ Public scaffold only. Proprietary trading logic, model weights, and private agent prompts are intentionally excluded from this repository.


🏛️ Topology

                       ┌─────────────────────────────┐
   clients ───HTTPS──▶ │       fastapi-backend       │  :8000
                       │   (auth, rate-limit, OTEL)  │
                       └──────┬──────────┬───────────┘
                              │          │
                  ┌───────────▼──┐   ┌───▼────────────┐
                  │  redis-cache │   │   ml-worker    │
                  │   (hot TTL)  │   │  (CUDA 12.1)   │
                  └───────┬──────┘   └───┬────────────┘
                          │              │
                  ┌───────▼──────────────▼────────┐
                  │         postgres-db           │
                  │  (orders / positions / meta)  │
                  └───────────────────────────────┘

📂 Repository Layout

.
├── .github/                  # CI, CodeQL, Dependabot, PR & issue templates
│   └── workflows/            # GitHub Actions pipelines
├── infrastructure/
│   └── azure/                # Bicep / Terraform modules (AKS, Key Vault, Front Door)
├── src/
│   ├── api/                  # FastAPI gateway + Dockerfile
│   ├── core_ml/              # Model training, inference, agent graphs
│   └── data_pipelines/       # Ingestion, feature store, stream processing
├── tests/                    # unit / integration / e2e
├── docker-compose.yml        # local microservice stack
├── pyproject.toml            # ruff / black / mypy / coverage
├── pytest.ini                # test harness + markers
├── requirements.txt          # pinned prod dependencies
├── Makefile                  # one-command dev workflow
└── ARCHITECTURE_REPORT.md    # full system design document

🚀 Quick Start

# 1. Clone
git clone https://github.com/vighriday/algorithmic-infrastructure-portfolio.git
cd algorithmic-infrastructure-portfolio

# 2. Bootstrap local Python env
make install

# 3. Spin up the microservice mesh
make up

# 4. Tail logs
make logs

# 5. Run the test suite
make test-fast

The FastAPI gateway will be reachable at http://localhost:8000/docs.


🧰 Tech Stack

🧠 ML / Quant

  • PyTorch 2.3 (CUDA 12.1)
  • LightGBM · XGBoost · CatBoost
  • Polars · PyArrow · NumPy · Numba
  • MLflow · Optuna · Hydra · DVC

🔌 Services

  • FastAPI · Uvicorn · Pydantic v2
  • Postgres 16 · MongoDB · Redis 7
  • Kafka · RabbitMQ · Celery
  • OpenTelemetry · Prometheus · Sentry

☁️ Cloud / LLM

  • Azure AKS · Key Vault · Cosmos · Service Bus
  • Azure OpenAI · Anthropic
  • LangChain · LangGraph
  • Qdrant · FAISS · Chroma

🛡️ Engineering Standards

  • Typed throughoutmypy --strict gate on every PR.
  • Security-first — Trivy, Gitleaks, CodeQL, SBOM on every commit.
  • Reproducible builds — pinned deps, multi-stage Dockerfiles, deterministic hashes.
  • Observability by default — every service emits OTEL traces, Prometheus metrics, and structured JSON logs.
  • ≥ 80% coverage — enforced by pytest --cov-fail-under=80.

📐 Architecture Documents

Document Purpose
ARCHITECTURE_REPORT.md Complete systems design, data flows, capacity plan
infrastructure/azure/ Cloud topology — AKS, networking, identity, IaC
.github/workflows/ CI/CD pipeline definitions

🤝 Contributing

Fork, branch, PR. All PRs go through the template checklist and must clear CI (lint, typecheck, test, security scan, docker build).

make precommit    # format + lint + typecheck locally
make test         # full suite with coverage

📄 License

MIT © 2026 vighriday

About

Public architecture portfolio showcasing production-grade ML infrastructure. Features structural designs for a large-scale quantitative trading platform (dual-H100) and a multi-agent LLM (MCP) ecosystem. Core alpha logic and predictive weights are kept proprietary.

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages