Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
343 changes: 191 additions & 152 deletions docs/source/design/conductor/conductor-architecture-design.md

Large diffs are not rendered by default.

41 changes: 41 additions & 0 deletions docs/source/design/conductor/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
# Mooncake Conductor

[中文](../../zh/design/conductor/index.md)

Mooncake Conductor keeps an in-memory view of reusable key-value (KV) cache
blocks reported by inference engines and Mooncake Store. A router can query
that view before choosing an inference engine. Use this page to find the guide
for running Conductor, understanding its results, or integrating a client.

## Choose a task

### Run Conductor

Follow the [usage guide](./usage.md) to build the C++ service, configure event
sources, check registrations, query cache availability, and unregister a
source.

### Understand the result

Read the [architecture guide](./conductor-architecture-design.md) to see how
vLLM GPU events and shared Mooncake CPU or Disk events become per-engine query
results.

### Call the HTTP API

Use the [HTTP API reference](./indexer-api-design.md) for the five implemented
endpoints, their accepted fields, response bodies, and error formats.

### Connect event sources

Start with [KV Events](../kv-event/index.md) to compare the vLLM and Mooncake
message paths. That section also explains what Mooncake publishes and what
Conductor accepts.

```{toctree}
:maxdepth: 1
:hidden:

conductor-architecture-design
usage
```
Comment on lines +39 to +41

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The English toctree list is missing the indexer-api-design reference, which is present in the Chinese version. This causes the HTTP API reference page to be omitted from the Conductor section navigation in English.

Suggested change
conductor-architecture-design
usage
```
conductor-architecture-design
usage
indexer-api-design

Loading
Loading