Video-Streaming-Survey

Awesome Next-Gen Video Streaming 🚀

This is a repository for collecting resources about Video Streaming and its next-generation evolution.
Unlike traditional surveys that only focus on codecs, ABR, and QoE, this repo aims to bridge the gap between
classic streaming techniques and modern AI/ML-based methods, especially the integration with
Multimodal Large Models (VLMs/VLAs) and intelligent production devices.

🔥 Table of Contents

• Introduction
• Traditional Methods
• Machine Learning-based Methods
• Multimodal LLMs for Streaming
• Datasets and Benchmarks
• Challenges and Future Directions

📜 Paper List

Survey of Streaming Video

1. ['ACM'24] An End-to-End Pipeline Perspective on Video Streaming in Best-Effort Networks: A Survey and Tutorial [PDF]
2. ['COMSNETS'24] Quality of Experience in Video Streaming: Status Quo, Pitfalls, and Guidelines [PDF]
3. ['arXiv'23] UAV Immersive Video Streaming: A Comprehensive Survey, Benchmarking, and Open Challenges [PDF]
4. '['IEEE Transactions on Circuits and Systems for Video Technology']'Streaming video over the Internet: approaches and directions [PDF]
5. ['CVPR'23] Streaming video model [PDF]

Traditional Methods

1. ['arXiv'13] Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale [PDF]
2. ['ACM'16] ABuffer-Based Approach to Rate Adaptation:Evidence from a Large Video Streaming Service [PDF]

Machine Learning-based Methods

1. ['ACM'23] Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video Streaming Quality [PDF]
2. ['IEEE Trans. Multimedia'23] RAV: Learning-Based Adaptive Streaming to Coordinate the Audio and Video Bitrate Selections [PDF]
3. ['IEEE Trans. Netw. Serv. Manage.'24] MEC-Based Super-Resolution Enhanced Adaptive Video Streaming Optimization for Mobile Networks With Satellite Backhaul [PDF]
4. ['ACM MMSys.'24] OASIS: Collaborative Neural-Enhanced Mobile Video Streaming [PDF]
5. ['IEEE IWCMC.'24] EASR: Enabling Neural-Enhanced Video Streaming on Mobile Devices with Edge Assistance [PDF]
6. ['IEEE Transactions on Mobile Computing.'25] REM: Enabling Real-Time Neural-Enhanced Video Streaming on Mobile Devices Using Macroblock-Aware Lookup Table [PDF]
7. ['IEEE Conference on Computer Communications.'24] Dancing with Shackles, Meet the Challenge of Industrial Adaptive Streaming via Offline Reinforcement Learning [PDF]
8. ['arXiv.'22] ECAS-ML: Edge Computing Assisted Adaptation Scheme with Machine Learning for HTTP Adaptive Streaming [PDF]
9. ['arXiv.'20] Real-world Video Adaptation with Reinforcement Learning [PDF]
10. ['arXiv.'23] Improving ABR Performance for Short Video Streaming Using Multi-Agent Reinforcement Learning with Expert Guidance [PDF]
11. ['ACM Multimedia'22] Real-time Streaming Video Denoising with Bidirectional Buffers [PDF], [Code]
12. ['IEEE Conference on Computer Vision.'22] Label-Efficient Online Continual Object Detection in Streaming Video [PDF], [Code]

Multimodal LLMs for Streaming

1. ['CVPR'24] VideoLLM-online: Online Large Language Model for Streaming Video [PDF], [Code]
2. ['CVPR'25] Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction [PDF], [Code]
3. ['CVPR'25] LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale [PDF], [Code]
4. ['arXiv'25] TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videos [PDF], [Code]
5. ['CVPR'25] OmniMMI:AComprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts [PDF], [Code]
6. ['arXiv'25] VideoLLaMB: Long Streaming Video Understanding with Recurrent Memory Bridges [PDF], [Code]
7. ['EMNLP'24] Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge [PDF], [Code]
8. ['ICLR'25] STREAMING VIDEO QUESTION-ANSWERING WITH IN-CONTEXT VIDEO KV-CACHE RETRIEVAL [PDF]
9. ['CVPR'25] BIMBA:Selective-Scan Compression for Long-Range Video Question Answering [PDF], [Code]
10. ['arXiv.'25] InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions [PDF], [Code]
11. ['arXiv'25] VideoMind: AChain-of-LoRAAgent for Long Video Reasoning [PDF], [Code]
12. ['arXiv'24] Video Token Sparsification for Efficient Multimodal LLMs in Autonomous Driving [PDF]
13. ['arXiv'24] Streaming Long Video Understanding with Large Language Models [PDF]
14. ['arXiv'24] VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computation [PDF]
15. ['NeurIPS'25] StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistant [PDF]
16. ['arXiv'25] Chat with AI: The Surprising Turn of Real-time Video Communication from Human to AI [PDF]
17. ['arXiv'25] Memory Helps, but Confabulation Misleads: Understanding Streaming Events in Videos with MLLMs [PDF]
18. ['arXiv'24] Inf-MLLM: Efficient Streaming Inference of Multimodal Large Language Models on a Single GPU [PDF]
19. ['arXiv'25] StreamForest: Efficient Online Video Understanding with Persistent Event Memory [PDF], [Code]
20. ['CVPR'24] MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding [PDF], [Code]
21. ['ICLR'25] Understanding Long Videos with Multimodal Language Models [PDF], [Code]
22. ['CVPR'25] Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understanding [PDF], [Code]
23. ['ECCV'24] LongVLM: Efficient Long Video Understanding via Large Language Models [PDF], [Code]
24. ['ICLR'25] Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge[PDF], [Code]
25. ['ICLR'25] LongVILA: Scaling Long-Context Visual Language Models for Long Videos[PDF], [Code]
26. ['ICLR'25] TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning[PDF], [Code]
27. ['arXiv'25] LiveVLM: Efficient Online Video Understanding via Streaming-Oriented KV Cache and Retrieval[PDF]
28. ['arXiv'24] Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams[PDF]
29. ['arXiv'23]Audio-Visual LLM for Video Understanding[PDF]
30. ['arXiv'25]Memory Helps, but Confabulation Misleads: Understanding Streaming Events in Videos with MLLMs[PDF]
31. ['arXiv'24]SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models[PDF]
32. ['IEEE Transactions on Pattern Analysis and Machine Intelligence'24]MovieChat+: Question-aware Sparse Memory for Long Video Question Answering[PDF]
33. ['Neural Information Processing Systems'24]E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding[PDF]
34. ['CVPR'23]TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding[PDF]
35. ['CVPR'24]Streaming Dense Video Captioning[PDF]
36. ['IEEE transactions on multimedia'23]Optimal Volumetric Video Streaming With Hybrid Saliency Based Tiling[PDF]
37. ['Symposium on Networked Systems Design and Implementation'22]YuZu: Neural-Enhanced Volumetric Video Streaming[PDF]
38. ['Workshop on Mobile Computing Systems and Applications'21]Efficient Volumetric Video Streaming Through Super Resolution[PDF]
39. ['ACM/IEEE International Conference on Mobile Computing and Networking'20]ViVo: visibility-aware mobile volumetric video streaming[PDF]
40. ['IEEE Open Journal of the Computer Society'20]Fuzzy Logic-Based Adaptive Point Cloud Video Streaming[PDF]

Datasets and Benchmark

1. ['arXiv.'25]LongViTU: Instruction Tuning for Long-Form Video Understanding [PDF], [Code]
2. ['CVPR'25]OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding? [PDF], [Code]
3. ['arXiv'25]StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding [PDF], [Code]
4. ['arXiv'25]Online Video Understanding: A Comprehensive Benchmark and Memory-Augmented Method [PDF], [Code]
5. ['arXiv'24]Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams [PDF], [Code]
6. ['ICLR'25] SVBENCH: A BENCHMARK WITH TEMPORAL MULTI TURN DIALOGUES FOR STREAMING VIDEO UNDER STANDING [PDF], [Code]
7. ['arXiv'23] BVI-Artefact: An Artefact Detection Benchmark Dataset for Streamed Videos [PDF], [Code]
8. ['arXiv'23] Bitstream-corrupted Video Recovery:A Novel Benchmark Dataset and Method [PDF], [Code]
9. ['CVPR'24]Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis[PDF]

Challenges and Future Directions

1. ['IEEE Open Journal of the Communications Society'24] Real-Time Immersive Aerial Video Streaming: A Comprehensive Survey, Benchmarking, and Open Challenges [PDF]
2. ['MDPI'24] A Survey on Video Streaming for Next-Generation Vehicular Networks[PDF]

🧰 Timeline

• 2025-09-01: Repo initialized
• 2025-09-05: First batch of papers added

💡 TODO

• Add 2024�?2025 survey papers
• Build timeline figure
• Add datasets section