505 B
505 B
Objective
- Serverless KVCache cache
Key Result
- Implement PDF-based workload-aware cache policy in simulator
- Test the policy with different refine methods
Last Week
- Implement workload-aware cache policy by exponential distribution fitting and get stable hit ratio improvement for the first time.
- Try to monitor with time sliding window, warm up for fitting coefficients, use oracle fitting coefficients etc. But all of them cannot get a notable improvement.
Next Week
- Refine the cache policy.