Gahow Wang 996511f300 feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

..

cluster

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

instance

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

metrics

fix: cache calculation

2026-04-15 17:31:39 +08:00

router

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

sim

fix: cache calculation

2026-04-15 17:31:39 +08:00

config.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

driver.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

hardware_presets.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

hf_config.rs

fix: cache calculation

2026-04-15 17:31:39 +08:00

lib.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

main.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

network.rs

feat: update ttft modeling and add cache affinity

2026-04-15 19:08:10 +08:00

oracle.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

replay.rs

chore: update ablation and clean configs

2026-04-15 14:48:59 +08:00

trace.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

ttft.rs

feat: new router and benchmark setup

2026-04-16 14:23:53 +08:00

types.rs

KVCache simulator for LLM serving cluster routing research

2026-04-14 01:16:02 +08:00