Skip to content

[Feature] Add MESH expert residency with io_uring direct I/O for MoE inference#2003

Open
RaQiu wants to merge 10 commits into
kvcache-ai:mainfrom
RaQiu:main
Open

[Feature] Add MESH expert residency with io_uring direct I/O for MoE inference#2003
RaQiu wants to merge 10 commits into
kvcache-ai:mainfrom
RaQiu:main

feat: 方案 A CPU expert load balancing + 35B/397B BF16 benchmark scripts

8f7e704
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs