Prioritize uncovered prefill scheduler candidates
This commit is contained in:
@@ -65,6 +65,9 @@ target_mbt = sqrt(current_mbt * prompt_tokens_p95)
|
||||
- `_prefill_scheduler_candidate_actions`
|
||||
- 输出 `prefill-scheduler-interaction` family。
|
||||
- `score_factors` 显式记录 current/target `prefill_quantum_ratio`,方便后续实验解释。
|
||||
- 当 scheduler dimension 还没有被 materialized config 覆盖时,加入
|
||||
`uncovered_scheduler_dimension_bonus`,让该 family 在 topology settled 后优先于
|
||||
`gpu-memory-utilization` 这类 resource micro-tuning。
|
||||
|
||||
## 为什么不是 rule-based hack
|
||||
|
||||
@@ -101,12 +104,30 @@ target_mbt = sqrt(current_mbt * prompt_tokens_p95)
|
||||
- `adjust_admission_pressure_with_chunked_prefill`
|
||||
3. 测试改为验证 normalized direction 和 scale sensitivity,而不是固定 absolute value。
|
||||
|
||||
### 2026-06-29 远端 review feedback
|
||||
|
||||
在 dash1 用 `36c301c` 启动 case3 bad-runtime 重跑后,trial-0003 的
|
||||
candidate-set 已经出现 `prefill-scheduler-interaction`:
|
||||
|
||||
```text
|
||||
action_id = seed_chunked_prefill_quantum
|
||||
patch = enable-chunked-prefill=true, max-num-batched-tokens=8192
|
||||
ratio = target prefill_quantum_ratio ~= 1.05
|
||||
```
|
||||
|
||||
但初始 scoring 仍让 `raise_gpu_memory_utilization` 排在前面。这说明 family
|
||||
接入是正确的,但排序仍偏向 resource micro-tuning。随后实现加入
|
||||
`uncovered_scheduler_dimension_bonus`:当 topology frontier 已覆盖、prefill scheduler
|
||||
dimension 还没有被 materialized config 测过时,优先测试 scheduler hypothesis,
|
||||
避免重复旧 harness 先爬 GMU 的失败轨迹。
|
||||
|
||||
## 单元验证
|
||||
|
||||
新增/更新的测试覆盖:
|
||||
|
||||
- long-tail TTFT 下,过大的 `prefill_quantum_ratio` 会下降;
|
||||
- prompt length scale 变大时,下一步 MBT target 也变大;
|
||||
- topology frontier 已覆盖后,未覆盖的 scheduler dimension 排在 GMU 微调之前;
|
||||
- short prompt workload 不激活 prefill scheduler family;
|
||||
- 原有 prefill stop guard 仍不允许在有 high-value candidate 时停止;
|
||||
- normalized full-config no-repeat 语义不变。
|
||||
@@ -138,4 +159,3 @@ PYTHONPATH=src python3 -m unittest discover -s tests
|
||||
- candidate family sequence;
|
||||
- `prefill_quantum_ratio_current -> target` 的方向是否与 bottleneck evidence 一致;
|
||||
- 是否出现 repeated normalized full-config signature。
|
||||
|
||||
|
||||
Reference in New Issue
Block a user