gahow/aituner
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Summarize Frontier selection regret

Browse Source
This commit is contained in:
Gahow Wang
2026-07-19 15:31:16 +08:00
parent 4c8d581a5b
commit 3d3878c5aa
6 changed files with 199 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
docs/simulator-tuning/README.md Normal file
View File

@@ -0,0 +1,14 @@
# Simulator tuning evaluation
This directory contains decision-level summaries for experiments that compare
a serving simulator's selected configuration with the best configuration on
real hardware.
Current report:
- [Frontier selection regret on Qwen3-30B and Qwen3-235B](frontier-selection-regret-qwen30-qwen235-20260719.md)
The primary quantity is **real-hardware selection regret**, not simulator
absolute-latency error. Raw commands, profiles, traces, and experiment-specific
audit records remain under `runs/` or in the immutable remote artifact roots
listed by each report.