488 B
488 B
Objective
- Serverless KVCache cache
Key Result
- Preprocess 5 days trace for comparison
- Draw policy results in Trace A under 7B, 13B, 70B models
- Write policy algorithm for paper
- Prepare an version of trace for open source
Last Week
- Get 5 workdays trace and preprocess them for future simulator test.
- Write paper policy design part, finish a pseudocode for our cache policy.
- Process and get an anonymous trace for open source.
Next Week
- Finish final version paper writing