A production-ready Docker setup for ComfyUI that unlocks the full potential of NVIDIA Blackwell GPUs (RTX 50 series) through 4-bit quantization with NVFP4.

RTX 5090 & RTX 5060 Docker container with PyTorch + TensorFlow. First fully-tested Blackwell GPU support for ML/AI. CUDA 12.8, Python 3.11, Ubuntu 24.04. Works with RTX 50-series (5090/5080/5070/5060) and RTX 40-series.

Sample application generated using Opencode and Ollama

LoRA fine-tune and serve NVFP4 models on one DGX Spark (GB10, 128 GB UMA): text backbones via generic-family onboarding, and VLM vision towers (Pixtral end-to-end; Llama-4 training-path validated). Fused Triton dequant; runtime-LoRA and merge serving.

🚀 Accelerate image generation with ComfyUI's Docker for NVIDIA Blackwell GPUs, optimizing speed and memory usage through NVFP4 support.

Empirical characterization of ICICLE NTT on consumer NVIDIA Blackwell (RTX 5070, sm_120), with a prototype for the digit-reversal bottleneck.

High-performance, multi-GPU computer vision pipeline for Genetec streams using NVIDIA DeepStream, Triton, and Numba JIT to track personnel, evaluate weapon threats, and perform in-VRAM OCR analytics.

Sync-free MoE dispatch engine with CUDA-graph-safe routing for Qwen3.5-35B and Gemma4 on RTX Spark and RTX 5090

Native C++/CUDA and CuTe DSL kernel library for edge MoE inference: flash decode, sync-free GroupGEMM+SwiGLU, head_dim=512 attention

Reproducible MoE inference benchmarks for RTX Spark and RTX 5090: flash decode, grouped GEMM, end-to-end generation

Edge AI inference runtime: scheduler, memory manager, CUDA graph engine, KV cache, MoE dispatch

Fork of antirez/ds4 with CUDA decode optimizations for NVIDIA GB10 / DGX Spark. 15.16 tok/s on DS4-Flash at ctx 7047. See GB10.md.