gahow/agentic-kvc
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
8a6b22c11cbf6b14324c8425d2e8b9740daaa2f9
agentic-kvc/third_party/vllm/vllm
History
Gahow Wang 657cd36f3d Gate evict_sent_blocks behind VLLM_EVICT_SENT_BLOCKS 
Fork commit e13391e unconditionally evicts sent blocks from the prefix
cache on every KV transfer. That is correct only for session MIGRATION
(source won't see the session again); for plain PD-disagg producer->
consumer transfers it destroys cross-turn producer reuse and contaminates
PD reuse experiments. Default OFF; enable for migration runs via
VLLM_EVICT_SENT_BLOCKS=1.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-05-29 18:18:59 +08:00
..
assets
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
benchmarks
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
compilation
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
config
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
device_allocator
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
distributed
Fix multi-turn replay fidelity: track realized output tokens across all components
2026-05-24 14:47:51 +08:00
engine
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
entrypoints
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
inputs
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
kernels
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
logging_utils
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
lora
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
model_executor
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
multimodal
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
parser
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
platforms
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
plugins
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
profiler
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
ray
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
reasoning
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
renderers
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
third_party
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
tokenizers
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
tool_parsers
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
tracing
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
transformers_utils
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
triton_utils
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
usage
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
utils
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
v1
Gate evict_sent_blocks behind VLLM_EVICT_SENT_BLOCKS
2026-05-29 18:18:59 +08:00
vllm_flash_attn
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
__init__.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
_aiter_ops.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
_custom_ops.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
_oink_ops.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
_xpu_ops.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
beam_search.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
collect_env.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
connections.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
env_override.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
envs.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
exceptions.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
forward_context.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
logger.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
logits_process.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
logprobs.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
model_inspection.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
outputs.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
pooling_params.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
py.typed
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
sampling_params.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
scalar_type.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
scripts.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
sequence.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
tasks.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00
version.py
Add vLLM v0.18.1 source tree with KV transfer abort fix
2026-05-22 00:30:38 +08:00