339 B
339 B
Objective
- Serverless KVCache cache
Key Results
- Analysis new trace
Last Week
- Get the qwen-plus trace, analysis its feature. 96% requests come from script. Many long system prompt which will be used many times (greater than 100k in 4h).
- Confirm trace A and trace B for paper. Draw figures for them.
Next Week
- Profile our policy.