This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference speed.
-
Updated
Apr 24, 2026 - Python
#
aiinfrastructure
Here are 10 public repositories matching this topic...
NPU powered On-device AI Mobile applications using Melange
ai edge-computing npu on-device-ai edgeai ai-infrastructure vibe-coding ai-computing aiinfrastructure
-
Updated
Jul 9, 2026 - Swift
The Buildfunctions SDK for Agents examples: Hardware-isolated CPU and GPU Sandboxes for untrusted AI actions 🪐 Now in beta, with $100 in free credits!
-
Updated
Feb 6, 2026 - Python
The Buildfunctions SDK for interacting with serverless functions, hardware-isolated sandboxes, and runtime controls for AI agents 🪐 Now in beta, with $100 in free credits!
-
Updated
Jul 5, 2026 - TypeScript
The Buildfunctions SDK for interacting with serverless functions, hardware-isolated sandboxes, and runtime controls for AI agents 🪐 Now in beta, with $100 in free credits!
-
Updated
Jul 5, 2026 - Python
A .NET MCP control-gate project that discovers live tools, validates contracts, and blocks risky tool changes before promotion.
csharp dotnet mcp devsecops contracttesting modelcontextprotocol aiinfrastructure agentengineering toolgovernance policyenforcement
-
Updated
May 30, 2026 - C#
This repositry contains the practice files necessary for the MLOps and AI infrastructure project
-
Updated
Jun 12, 2026
Secure Agent Governed Execution OS
security ai sandbox compliance observability governance risk-management policy-engine devsecops ai-agents zero-trust soc2 least-privilege endpoint-security audit-logging enterprise-ai agent-runtime aiinfrastructure ai-infrastructure-development
-
Updated
Jan 31, 2026
160+ pages of handwritten notes from Stanford CS336: Language Modeling from Scratch, covering language modeling, LLM systems, and full-stack AI engineering from data to deployment and evaluation and RL alignment
-
Updated
Jul 6, 2026
UniGPU is a peer-to-peer GPU marketplace that enables students to rent out idle GPUs while allowing clients to execute secure, containerized GPU workloads remotely.
redis distributed-systems ai peer-to-peer websockets celery gpu-computing system-design aiinfrastructure
-
Updated
Jul 8, 2026 - Python
Improve this page
Add a description, image, and links to the aiinfrastructure topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the aiinfrastructure topic, visit your repo's landing page and select "manage topics."