Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• 1906857ffd chore: update README main Gahow Wang 2026-04-17 19:15:22 +08:00
• cad83cec2f Merge branch 'feature/bucket-aware-routing' Gahow Wang 2026-04-17 18:16:56 +08:00
• 43ada0cfc0 feat: add bucket score global router Gahow Wang 2026-04-17 17:55:54 +08:00
• b5a6fb964c feat: wire bucket identities through driver outputs Gahow Wang 2026-04-17 17:52:49 +08:00
• 3a84c15068 fix: harden bucket routing review follow-up Gahow Wang 2026-04-17 15:15:18 +08:00
• fa381b5db3 feat: add bucketed service and strict global routing Gahow Wang 2026-04-17 15:03:10 +08:00
• 96019082cc fix: complete global router config and recoverable cluster init Gahow Wang 2026-04-17 14:50:47 +08:00
• 008fe2fe5d fix: reject bucketed configs in cluster constructor Gahow Wang 2026-04-17 14:44:21 +08:00
• 7de38fa998 fix: guard legacy runtime paths for bucketed configs Gahow Wang 2026-04-17 14:35:09 +08:00
• d8a0796506 fix: close bucketed cluster config model gaps Gahow Wang 2026-04-17 14:21:34 +08:00
• a723d7a811 feat: model explicit bucketed cluster config Gahow Wang 2026-04-17 14:16:56 +08:00
• bb280c8ba0 chore: ignore local worktrees Gahow Wang 2026-04-17 13:37:25 +08:00
• 92d593d59b docs: add bucket-aware routing design Gahow Wang 2026-04-17 13:26:51 +08:00
• 82b3e2985f chore Gahow Wang 2026-04-17 10:56:30 +08:00
• 67eef78244 chore: git ignore Gahow Wang 2026-04-16 14:30:29 +08:00
• 996511f300 feat: new router and benchmark setup Gahow Wang 2026-04-16 14:23:53 +08:00
• c86d931d8f feat(ablate): input-length bucketing + auto-instance sizing Gahow Wang 2026-04-15 19:42:28 +08:00
• a3f386c858 feat: update ttft modeling and add cache affinity Gahow Wang 2026-04-15 19:08:10 +08:00
• ff316c6873 fix: cache calculation Gahow Wang 2026-04-15 17:31:39 +08:00
• 365ceac3be chore: update ablation and clean configs Gahow Wang 2026-04-15 14:48:59 +08:00
• eaf574cd4e fix: kvcache evict workflow Gahow Wang 2026-04-14 15:46:36 +08:00
• 663ca9c5b9 Support compute_dtype for FP4/FP8 tensor core FLOPS selection Gahow Wang 2026-04-14 11:54:10 +08:00
• 84696604e8 Add B300 GPU preset and GLM-5-NVFP4 on 8xB300 config Gahow Wang 2026-04-14 11:37:20 +08:00
• 8d41123418 Update README with full feature documentation Gahow Wang 2026-04-14 01:21:28 +08:00
• ec73a95e05 KVCache simulator for LLM serving cluster routing research Gahow Wang 2026-04-14 01:16:02 +08:00