Add vLLM v0.18.1 source tree with KV transfer abort fix

Browse Source

third_party/vllm/ now tracked in git for direct patch management.
Based on vLLM v0.18.1 release with one patch applied:

  vllm/v1/core/sched/scheduler.py:
    Replace fatal assert with graceful skip when KV transfer callback
    arrives for an already-aborted request during PD disaggregated serving.

Future vLLM modifications should be made directly in third_party/vllm/
and committed normally. The patches/ directory is kept as documentation
of what changed from upstream.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

...

This commit is contained in:

Gahow Wang

2026-05-22 00:30:38 +08:00

parent b6591950bc

commit 445e491123

4285 changed files with 1111303 additions and 1 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

third_party/vllm/docs/assets/design/arch_overview/entrypoints.excalidraw.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 120 KiB

BIN

third_party/vllm/docs/assets/design/arch_overview/llm_engine.excalidraw.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 174 KiB

BIN

third_party/vllm/docs/assets/design/arch_overview/v1_process_architecture_tp2_dp4.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.7 MiB

BIN

third_party/vllm/docs/assets/design/arch_overview/v1_process_architecture_tp4.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 3.8 MiB

BIN

third_party/vllm/docs/assets/design/cuda_graphs/current_design.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 70 KiB

BIN

third_party/vllm/docs/assets/design/cuda_graphs/executor_runtime.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 60 KiB

BIN

third_party/vllm/docs/assets/design/cuda_graphs/previous_design.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 44 KiB

BIN

third_party/vllm/docs/assets/design/cuda_graphs/wrapper_flow.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 87 KiB

BIN

third_party/vllm/docs/assets/design/debug_vllm_compile/design_diagram.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 314 KiB

BIN

third_party/vllm/docs/assets/design/debug_vllm_compile/dynamic_shapes.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 359 KiB

BIN

third_party/vllm/docs/assets/design/debug_vllm_compile/tlparse_inductor.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 257 KiB

BIN

third_party/vllm/docs/assets/design/fused_moe_modular_kernel/fused_experts_blocks.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 187 KiB

BIN

third_party/vllm/docs/assets/design/fused_moe_modular_kernel/fused_moe_batched.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 189 KiB

BIN

third_party/vllm/docs/assets/design/fused_moe_modular_kernel/fused_moe_non_batched.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 227 KiB

BIN

third_party/vllm/docs/assets/design/fused_moe_modular_kernel/prepare_and_finalize_blocks.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 128 KiB

BIN

third_party/vllm/docs/assets/design/hierarchy.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 170 KiB

BIN

third_party/vllm/docs/assets/design/hybrid_kv_cache_manager/basic_grouping_example.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 24 KiB

BIN

third_party/vllm/docs/assets/design/hybrid_kv_cache_manager/full_attn.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.0 KiB

BIN

third_party/vllm/docs/assets/design/hybrid_kv_cache_manager/memory_layout.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 62 KiB

BIN

third_party/vllm/docs/assets/design/hybrid_kv_cache_manager/overview.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 39 KiB

BIN

third_party/vllm/docs/assets/design/hybrid_kv_cache_manager/sw_attn.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.5 KiB

BIN

third_party/vllm/docs/assets/design/metrics/intervals-1.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 185 KiB

BIN

third_party/vllm/docs/assets/design/metrics/intervals-2.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 162 KiB

BIN

third_party/vllm/docs/assets/design/metrics/intervals-3.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 161 KiB

BIN

third_party/vllm/docs/assets/design/model_runner_v2/async_no_race_condition.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 130 KiB

BIN

third_party/vllm/docs/assets/design/model_runner_v2/async_race_condition.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 128 KiB

BIN

third_party/vllm/docs/assets/design/model_runner_v2/async_sched.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 254 KiB

BIN

third_party/vllm/docs/assets/design/model_runner_v2/persistent_batch_mrv2.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 73 KiB

BIN

third_party/vllm/docs/assets/design/model_runner_v2/persistent_batch_v1.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 65 KiB

BIN

third_party/vllm/docs/assets/design/paged_attention/k_vecs.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 27 KiB

BIN

third_party/vllm/docs/assets/design/paged_attention/key.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 109 KiB

BIN

third_party/vllm/docs/assets/design/paged_attention/logits_vec.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 17 KiB

BIN

third_party/vllm/docs/assets/design/paged_attention/q_vecs.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 41 KiB

BIN

third_party/vllm/docs/assets/design/paged_attention/query.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 32 KiB

BIN

third_party/vllm/docs/assets/design/paged_attention/v_vec.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 42 KiB

BIN

third_party/vllm/docs/assets/design/paged_attention/value.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 167 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/example-time-1.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 47 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/example-time-3.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 50 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/example-time-4.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 59 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/example-time-5.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 54 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/example-time-6.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 54 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/example-time-7.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 55 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/free.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 18 KiB

BIN

third_party/vllm/docs/assets/design/prefix_caching/overview.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 32 KiB

BIN

third_party/vllm/docs/assets/design/tpu/most_model_len.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 12 KiB