Files

Gahow Wang 445e491123 Add vLLM v0.18.1 source tree with KV transfer abort fix

third_party/vllm/ now tracked in git for direct patch management.
Based on vLLM v0.18.1 release with one patch applied:

  vllm/v1/core/sched/scheduler.py:
    Replace fatal assert with graceful skip when KV transfer callback
    arrives for an already-aborted request during PD disaggregated serving.

Future vLLM modifications should be made directly in third_party/vllm/
and committed normally. The patches/ directory is kept as documentation
of what changed from upstream.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-22 00:30:38 +08:00

1.8 KiB

Raw Blame History

Dockerfile

We provide a docker/Dockerfile to construct the image for running an OpenAI compatible server with vLLM. More information about deploying with Docker can be found here.

Below is a visual representation of the multi-stage Dockerfile. The build graph contains the following nodes:

All build stages
The default build target (highlighted in grey)
External images (with dashed borders)

The edges of the build graph represent:

FROM ... dependencies (with a solid line and a full arrow head)
COPY --from=... dependencies (with a dashed line and an empty arrow head)
RUN --mount=(.\*)from=... dependencies (with a dotted line and an empty diamond arrow head)
![](../../assets/contributing/dockerfile-stages-dependency.png){ align="center" alt="query" width="100%" }

Made using: https://github.com/patrickhoefler/dockerfilegraph

Commands to regenerate the build graph (make sure to run it from the `root` directory of the vLLM repository where the dockerfile is present):
```
dockerfilegraph \
  -o png \
  --legend \
  --dpi 200 \
  --max-label-length 50 \
  --filename docker/Dockerfile
```
or in case you want to run it directly with the docker image:
```
docker run \
   --rm \
   --user "$(id -u):$(id -g)" \
   --workdir /workspace \
   --volume "$(pwd)":/workspace \
   ghcr.io/patrickhoefler/dockerfilegraph:alpine \
   --output png \
   --dpi 200 \
   --max-label-length 50 \
   --filename docker/Dockerfile \
   --legend
```
(To run it for a different file, you can pass in a different argument to the flag --filename.)

1.8 KiB Raw Blame History

Dockerfile

1.8 KiB

Raw Blame History