Gahow Wang 43ada0cfc0 feat: add bucket score global router

2026-04-17 17:55:54 +08:00

..

cluster

feat: add bucket score global router

2026-04-17 17:55:54 +08:00

instance

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

metrics

feat: wire bucket identities through driver outputs

2026-04-17 17:52:49 +08:00

router

feat: add bucket score global router

2026-04-17 17:55:54 +08:00

sim

feat: wire bucket identities through driver outputs

2026-04-17 17:52:49 +08:00

config.rs

feat: wire bucket identities through driver outputs

2026-04-17 17:52:49 +08:00

driver.rs

feat: wire bucket identities through driver outputs

2026-04-17 17:52:49 +08:00

hardware_presets.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

hf_config.rs

fix: cache calculation

2026-04-15 17:31:39 +08:00

lib.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

main.rs

feat: wire bucket identities through driver outputs

2026-04-17 17:52:49 +08:00

network.rs

feat: update ttft modeling and add cache affinity

2026-04-15 19:08:10 +08:00

oracle.rs

feat: wire bucket identities through driver outputs

2026-04-17 17:52:49 +08:00

replay.rs

fix: guard legacy runtime paths for bucketed configs

2026-04-17 14:35:09 +08:00

trace.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

ttft.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

types.rs

KVCache simulator for LLM serving cluster routing research

2026-04-14 01:16:02 +08:00