Skip to content

pr_test doc #6

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Dzysimon wants to merge 1 commit into
base: main
Choose a base branch
from
Open

pr_test doc #6

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions docs/source/zh_archive/architecture.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# Mooncake Architecture



Mooncake 旨在通过在高速互联的 DRAM/SSD 资源上构建一个多级缓存池，来提升大型语言模型（LLM）等场景下的推理效率，尤其是在慢速对象存储环境中。与传统缓存系统相比，Mooncake 的独特之处在于，它能够利用 (GPUDirect) RDMA 技术，以零拷贝的方式将数据从发起端的 DRAM/VRAM 直接传输到接收端的 DRAM/VRAM，同时最大限度地利用单机多网卡资源。

- 提供对象级别的数据存储服务
Expand Down
Loading