Initial commit: obsidian to gitea
This commit is contained in:
15
phd/weekly-report/25/250323.md
Normal file
15
phd/weekly-report/25/250323.md
Normal file
@@ -0,0 +1,15 @@
|
||||
Objectives
|
||||
- Serverless KVCache cache
|
||||
- DeepSeek deployment study
|
||||
|
||||
Key Results
|
||||
- Write a KVCache simulator to speed up policy test
|
||||
- Refine S3-FIFO to get some improvement
|
||||
|
||||
Last Week
|
||||
- Write a *naive* KVCache simulator to align with vLLM's KVCache management. And have very small bias comparing to real vLLM.
|
||||
- Refine the S3-FIFO in vLLM and evaluate it. It can have a little improvement in relatively small cache space.
|
||||
- Write the middle-stage report for graduation thesis.
|
||||
|
||||
Next Week
|
||||
- Refine the cache policy.
|
||||
Reference in New Issue
Block a user