obsidian/phd/weekly-report/25/250316.md

Objective

• Serverless KVCache cache
• DeepSeek deployment study

Key Results

• Refine some trace figures in 24h trace
• Give a cache policy evaluation method (w/ Jinbo)
• Survey the hardware for MoE deploying in medium-scale cluster

Last Week

• Finish all the trace clean and preprocess and re-plot some figures for traceA and traceB in new trace.
• Communicate with Jinbo to have a better understand in the gap between vLLM cache management and traditional cache policy. Figure out a evaluation method to judge the cache policy.
• Calculate the FLOPs requirement for DeepSeek.

Next Week

• Test and refine the cache policy.
• Try to summary the challenges for medium-scale deployment.