13 lines
505 B
Markdown
13 lines
505 B
Markdown
Objective
|
|
- Serverless KVCache cache
|
|
|
|
Key Result
|
|
- Implement PDF-based workload-aware cache policy in simulator
|
|
- Test the policy with different refine methods
|
|
|
|
Last Week
|
|
- Implement workload-aware cache policy by exponential distribution fitting and get stable hit ratio improvement for the first time.
|
|
- Try to monitor with time sliding window, warm up for fitting coefficients, use oracle fitting coefficients etc. But all of them cannot get a notable improvement.
|
|
|
|
Next Week
|
|
- Refine the cache policy. |