gahow/agentic-pd-hybrid
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: document sglang maintenance workflow

Browse Source
This commit is contained in:
Gahow Wang
2026-04-24 12:31:32 +00:00
parent b8e6f13c20
commit 5bdc0ed4f0
2 changed files with 30 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
README.md
View File

@@ -35,8 +35,10 @@ Sync the environment:
uv sync
```
Local experiments can use a repo-local `third_party/sglang` checkout of SGLang
`v0.5.10`, but that heavyweight checkout is intentionally not committed here.
`third_party/sglang` vendors a clean SGLang `v0.5.10` snapshot plus our local
PD/session-cache patches in later commits. Keep SGLang changes scoped under that
directory and commit them with `feat(sglang): ...` or `fix(sglang): ...` so they
stay easy to review against the vendor baseline.
## CLI
@@ -126,9 +128,9 @@ Notes:
- Live benchmarking uses the repo-local `agentic_pd_hybrid.pd_router`, which
preserves the real prefill/decode double-request path over loopback without
depending on the upstream Rust router build.
- Managed live benchmarking prefers a local
`third_party/sglang/python/sglang` checkout when it exists, so local SGLang
source changes can apply immediately without packaging a wheel.
- Managed live benchmarking prefers the vendored
`third_party/sglang/python/sglang` source tree, so local SGLang changes apply
immediately without packaging a wheel.
- Live benchmarking currently targets the `mooncake` transfer backend, because
`mooncake-transfer-engine` is installed and usable on this node.
- `benchmark-live` and `replay` support streaming by default for TTFT/TPOT