(APIServer pid=2634245) INFO 07-12 14:47:36 [api_utils.py:339] 
(APIServer pid=2634245) INFO 07-12 14:47:36 [api_utils.py:339]        █     █     █▄   ▄█
(APIServer pid=2634245) INFO 07-12 14:47:36 [api_utils.py:339]  ▄▄ ▄█ █     █     █ ▀▄▀ █  version 0.24.1.dev3+g668cfb7e2
(APIServer pid=2634245) INFO 07-12 14:47:36 [api_utils.py:339]   █▄█▀ █     █     █     █  model   /home/admin/cpfs/wjh/models/Qwen/Qwen3-30B-A3B
(APIServer pid=2634245) INFO 07-12 14:47:36 [api_utils.py:339]    ▀▀  ▀▀▀▀▀ ▀▀▀▀▀ ▀     ▀
(APIServer pid=2634245) INFO 07-12 14:47:36 [api_utils.py:339] 
(APIServer pid=2634245) INFO 07-12 14:47:36 [api_utils.py:273] non-default args: {'model_tag': '/home/admin/cpfs/wjh/models/Qwen/Qwen3-30B-A3B', 'host': '127.0.0.1', 'port': 8500, 'model': '/home/admin/cpfs/wjh/models/Qwen/Qwen3-30B-A3B', 'served_model_name': ['qwen3-30b-a3b-community'], 'max_num_batched_tokens': 8192, 'max_num_seqs': 8, 'shutdown_timeout': 120}
(APIServer pid=2634245) INFO 07-12 14:47:48 [model.py:598] Resolved architecture: Qwen3MoeForCausalLM
(APIServer pid=2634245) INFO 07-12 14:47:48 [model.py:1725] Using max model len 40960
(APIServer pid=2634245) INFO 07-12 14:47:48 [scheduler.py:252] Chunked prefill is enabled with max_num_batched_tokens=8192.
(APIServer pid=2634245) INFO 07-12 14:47:48 [vllm.py:1006] Asynchronous scheduling is enabled.
(APIServer pid=2634245) INFO 07-12 14:47:48 [kernel.py:276] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
(EngineCore pid=2635013) INFO 07-12 14:47:59 [core.py:114] Initializing a V1 LLM engine (v0.24.1.dev3+g668cfb7e2) with config: model='/home/admin/cpfs/wjh/models/Qwen/Qwen3-30B-A3B', speculative_config=None, tokenizer='/home/admin/cpfs/wjh/models/Qwen/Qwen3-30B-A3B', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.bfloat16, max_seq_len=40960, download_dir=None, load_format=auto, tensor_parallel_size=1, pipeline_parallel_size=1, data_parallel_size=1, decode_context_parallel_size=1, dcp_comm_backend=ag_rs, disable_custom_all_reduce=False, quantization=None, quantization_config=None, enforce_eager=False, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cuda, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=False, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False, jit_monitor_verbose=False), seed=0, served_model_name=qwen3-30b-a3b-community, enable_prefix_caching=True, enable_chunked_prefill=True, pooler_config=None, compilation_config={'mode': <CompilationMode.VLLM_COMPILE: 3>, 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['none'], 'ir_enable_torch_wrap': True, 'splitting_ops': ['vllm::unified_attention_with_output', 'vllm::unified_mla_attention_with_output', 'vllm::mamba_mixer2', 'vllm::mamba_mixer', 'vllm::short_conv', 'vllm::linear_attention', 'vllm::plamo2_mamba_mixer', 'vllm::qwen_gdn_attention_core', 'vllm::gdn_attention_core_xpu', 'vllm::olmo_hybrid_gdn_full_forward', 'vllm::kda_attention', 'vllm::sparse_attn_indexer', 'vllm::rocm_aiter_sparse_attn_indexer', 'vllm::deepseek_v4_attention', 'vllm::unified_kv_cache_update', 'vllm::unified_mla_kv_cache_update'], 'compile_mm_encoder': False, 'cudagraph_mm_encoder': False, 'encoder_cudagraph_token_budgets': [], 'encoder_cudagraph_max_vision_items_per_batch': 0, 'encoder_cudagraph_max_frames_per_batch': None, 'compile_sizes': [], 'compile_ranges_endpoints': [8192], 'inductor_compile_config': {'enable_auto_functionalized_v2': False, 'size_asserts': False, 'alignment_asserts': False, 'scalar_asserts': False, 'combo_kernels': True, 'benchmark_combo_kernel': True}, 'inductor_passes': {}, 'cudagraph_mode': <CUDAGraphMode.FULL_AND_PIECEWISE: (2, 1)>, 'cudagraph_num_of_warmups': 1, 'cudagraph_capture_sizes': [1, 2, 4, 8, 16], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': False, 'fuse_act_quant': False, 'fuse_attn_quant': False, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False, 'fuse_rope_kvcache_cat_mla': False, 'fuse_act_padding': False}, 'max_cudagraph_capture_size': 16, 'dynamic_shapes_config': {'type': <DynamicShapesType.BACKED: 'backed'>, 'evaluate_guards': False, 'assume_32_bit_indexing': False}, 'local_cache_dir': None, 'fast_moe_cold_start': False, 'static_all_moe_layers': []}, kernel_config=KernelConfig(ir_op_priority=IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']), enable_flashinfer_autotune=True, moe_backend='auto', linear_backend='auto')
(EngineCore pid=2635013) INFO 07-12 14:48:02 [parallel_state.py:1588] world_size=1 rank=0 local_rank=0 distributed_init_method=tcp://172.27.132.244:57917 backend=nccl
(EngineCore pid=2635013) INFO 07-12 14:48:02 [parallel_state.py:1923] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, PCP rank 0, TP rank 0, EP rank 0, EPLB rank N/A
(EngineCore pid=2635013) INFO 07-12 14:48:03 [topk_topp_sampler.py:55] Using FlashInfer for top-p & top-k sampling.
(EngineCore pid=2635013) INFO 07-12 14:48:03 [gpu_model_runner.py:5164] Starting to load model /home/admin/cpfs/wjh/models/Qwen/Qwen3-30B-A3B...
(APIServer pid=2634245) Traceback (most recent call last):
(APIServer pid=2634245)   File "/tmp/wjh-opprof-phase2-dash0-20260711/.venv/bin/vllm", line 8, in <module>
(APIServer pid=2634245)     sys.exit(main())
(APIServer pid=2634245)              ^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/entrypoints/cli/main.py", line 95, in main
(APIServer pid=2634245)     args.dispatch_function(args)
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/entrypoints/cli/serve.py", line 148, in cmd
(APIServer pid=2634245)     uvloop.run(run_server(args))
(APIServer pid=2634245)   File "/tmp/wjh-opprof-phase2-dash0-20260711/.venv/lib/python3.12/site-packages/uvloop/__init__.py", line 96, in run
(APIServer pid=2634245)     return __asyncio.run(
(APIServer pid=2634245)            ^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run
(APIServer pid=2634245)     return runner.run(main)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
(APIServer pid=2634245)     return self._loop.run_until_complete(task)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "uvloop/loop.pyx", line 1512, in uvloop.loop.Loop.run_until_complete
(APIServer pid=2634245)   File "uvloop/loop.pyx", line 1505, in uvloop.loop.Loop.run_until_complete
(APIServer pid=2634245)   File "uvloop/loop.pyx", line 1379, in uvloop.loop.Loop.run_forever
(APIServer pid=2634245)   File "uvloop/loop.pyx", line 557, in uvloop.loop.Loop._run
(APIServer pid=2634245)   File "uvloop/loop.pyx", line 476, in uvloop.loop.Loop._on_idle
(APIServer pid=2634245)   File "uvloop/cbhandles.pyx", line 83, in uvloop.loop.Handle._run
(APIServer pid=2634245)   File "uvloop/cbhandles.pyx", line 61, in uvloop.loop.Handle._run
(APIServer pid=2634245)   File "/tmp/wjh-opprof-phase2-dash0-20260711/.venv/lib/python3.12/site-packages/uvloop/__init__.py", line 48, in wrapper
(APIServer pid=2634245)     return await main
(APIServer pid=2634245)            ^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/entrypoints/openai/api_server.py", line 663, in run_server
(APIServer pid=2634245)     await run_server_worker(listen_address, sock, args, **uvicorn_kwargs)
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/entrypoints/openai/api_server.py", line 677, in run_server_worker
(APIServer pid=2634245)     async with build_async_engine_client(
(APIServer pid=2634245)   File "/usr/lib/python3.12/contextlib.py", line 210, in __aenter__
(APIServer pid=2634245)     return await anext(self.gen)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/entrypoints/openai/api_server.py", line 99, in build_async_engine_client
(APIServer pid=2634245)     async with build_async_engine_client_from_engine_args(
(APIServer pid=2634245)   File "/usr/lib/python3.12/contextlib.py", line 210, in __aenter__
(APIServer pid=2634245)     return await anext(self.gen)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/entrypoints/openai/api_server.py", line 135, in build_async_engine_client_from_engine_args
(APIServer pid=2634245)     async_llm = AsyncLLM.from_vllm_config(
(APIServer pid=2634245)                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/v1/engine/async_llm.py", line 217, in from_vllm_config
(APIServer pid=2634245)     return cls(
(APIServer pid=2634245)            ^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/v1/engine/async_llm.py", line 146, in __init__
(APIServer pid=2634245)     self.engine_core = EngineCoreClient.make_async_mp_client(
(APIServer pid=2634245)                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/tracing/otel.py", line 178, in sync_wrapper
(APIServer pid=2634245)     return func(*args, **kwargs)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/v1/engine/core_client.py", line 132, in make_async_mp_client
(APIServer pid=2634245)     return AsyncMPClient(*client_args)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/tracing/otel.py", line 178, in sync_wrapper
(APIServer pid=2634245)     return func(*args, **kwargs)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/v1/engine/core_client.py", line 963, in __init__
(APIServer pid=2634245)     super().__init__(
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/v1/engine/core_client.py", line 619, in __init__
(APIServer pid=2634245)     if not sync_input_socket.poll(
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/tmp/wjh-opprof-phase2-dash0-20260711/.venv/lib/python3.12/site-packages/zmq/sugar/socket.py", line 1062, in poll
(APIServer pid=2634245)     evts = dict(p.poll(timeout))
(APIServer pid=2634245)                 ^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "/tmp/wjh-opprof-phase2-dash0-20260711/.venv/lib/python3.12/site-packages/zmq/sugar/poll.py", line 106, in poll
(APIServer pid=2634245)     return zmq_poll(self.sockets, timeout=timeout)
(APIServer pid=2634245)            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=2634245)   File "zmq/backend/cython/_zmq.py", line 1680, in zmq.backend.cython._zmq.zmq_poll
(APIServer pid=2634245)   File "zmq/backend/cython/_zmq.py", line 179, in zmq.backend.cython._zmq._check_rc
(APIServer pid=2634245)   File "/home/admin/cpfs/wjh/opprof-phase2-dash0-20260711/vllm-v0.24.0/vllm/entrypoints/openai/api_server.py", line 658, in _interrupt_init
(APIServer pid=2634245)     raise KeyboardInterrupt("terminated")
(APIServer pid=2634245) KeyboardInterrupt: terminated
