您好，2卡4090部署报错，请问您这边方便给出vllm部署的版本和指令吗，谢谢
[2025-09-25 20:03:20] [/bin/sh]: Process EngineCore_0:
[2025-09-25 20:03:20] [/bin/sh]: Traceback (most recent call last):
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
[2025-09-25 20:03:20] [/bin/sh]: self.run()
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/multiprocessing/process.py", line 108, in run
[2025-09-25 20:03:20] [/bin/sh]: self._target(*self._args, **self._kwargs)
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 636, in run_engine_core
[2025-09-25 20:03:20] [/bin/sh]: raise e
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 623, in run_engine_core
[2025-09-25 20:03:20] [/bin/sh]: engine_core = EngineCoreProc(*args, **kwargs)
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 441, in init
[2025-09-25 20:03:20] [/bin/sh]: super().init(vllm_config, executor_class, log_stats,
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 86, in init
[2025-09-25 20:03:20] [/bin/sh]: self._initialize_kv_caches(vllm_config)
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 158, in _initialize_kv_caches
[2025-09-25 20:03:20] [/bin/sh]: self.model_executor.determine_available_memory())
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/executor/abstract.py", line 76, in determine_available_memory
[2025-09-25 20:03:20] [/bin/sh]: output = self.collective_rpc("determine_available_memory")
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/executor/multiproc_executor.py", line 237, in collective_rpc
[2025-09-25 20:03:20] [/bin/sh]: result = get_response(w, dequeue_timeout)
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/executor/multiproc_executor.py", line 224, in get_response
[2025-09-25 20:03:20] [/bin/sh]: raise RuntimeError(
[2025-09-25 20:03:20] [/bin/sh]: RuntimeError: Worker failed with error 'FlashAttention only support fp16 and bf16 data type', please check the stack trace above for the root cause
[2025-09-25 20:03:21] [/bin/sh]: Traceback (most recent call last):
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/cli/deploy.py", line 5, in
[2025-09-25 20:03:21] [/bin/sh]: deploy_main()
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/deploy.py", line 215, in deploy_main
[2025-09-25 20:03:21] [/bin/sh]: SwiftDeploy(args).main()
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/deploy.py", line 40, in init
[2025-09-25 20:03:21] [/bin/sh]: super().init(args)
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer.py", line 38, in init
[2025-09-25 20:03:21] [/bin/sh]: self.infer_engine = self.get_infer_engine(args, self.template)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer.py", line 83, in get_infer_engine
[2025-09-25 20:03:21] [/bin/sh]: return infer_engine_cls(**kwargs)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer_engine/vllm_engine.py", line 114, in init
[2025-09-25 20:03:21] [/bin/sh]: self._prepare_engine()
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer_engine/vllm_engine.py", line 123, in _prepare_engine
[2025-09-25 20:03:21] [/bin/sh]: engine = llm_engine_cls.from_engine_args(self.engine_args)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/engine/async_llm_engine.py", line 653, in from_engine_args
[2025-09-25 20:03:21] [/bin/sh]: return async_engine_cls.from_vllm_config(
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/async_llm.py", line 163, in from_vllm_config
[2025-09-25 20:03:21] [/bin/sh]: return cls(
[2025-09-25 20:03:21] [/bin/sh]: ^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/async_llm.py", line 117, in init
[2025-09-25 20:03:21] [/bin/sh]: self.engine_core = EngineCoreClient.make_async_mp_client(
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core_client.py", line 98, in make_async_mp_client
[2025-09-25 20:03:21] [/bin/sh]: return AsyncMPClient(*client_args)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core_client.py", line 677, in init
[2025-09-25 20:03:21] [/bin/sh]: super().init(
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core_client.py", line 408, in init
[2025-09-25 20:03:21] [/bin/sh]: with launch_core_engines(vllm_config, executor_class,
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/contextlib.py", line 144, in exit
[2025-09-25 20:03:21] [/bin/sh]: next(self.gen)
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/utils.py", line 697, in launch_core_engines
[2025-09-25 20:03:21] [/bin/sh]: wait_for_engine_startup(
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/utils.py", line 750, in wait_for_engine_startup
[2025-09-25 20:03:21] [/bin/sh]: raise RuntimeError("Engine core initialization failed. "
[2025-09-25 20:03:21] [/bin/sh]: RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {}
[2025-09-25 20:03:22] [/bin/sh]: /bin/sh: 2: Syntax error: ";" unexpected
您好，2卡4090部署报错，请问您这边方便给出vllm部署的版本和指令吗，谢谢
[2025-09-25 20:03:20] [/bin/sh]: Process EngineCore_0:
[2025-09-25 20:03:20] [/bin/sh]: Traceback (most recent call last):
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
[2025-09-25 20:03:20] [/bin/sh]: self.run()
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/multiprocessing/process.py", line 108, in run
[2025-09-25 20:03:20] [/bin/sh]: self._target(*self._args, **self._kwargs)
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 636, in run_engine_core
[2025-09-25 20:03:20] [/bin/sh]: raise e
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 623, in run_engine_core
[2025-09-25 20:03:20] [/bin/sh]: engine_core = EngineCoreProc(*args, **kwargs)
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 441, in init
[2025-09-25 20:03:20] [/bin/sh]: super().init(vllm_config, executor_class, log_stats,
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 86, in init
[2025-09-25 20:03:20] [/bin/sh]: self._initialize_kv_caches(vllm_config)
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 158, in _initialize_kv_caches
[2025-09-25 20:03:20] [/bin/sh]: self.model_executor.determine_available_memory())
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/executor/abstract.py", line 76, in determine_available_memory
[2025-09-25 20:03:20] [/bin/sh]: output = self.collective_rpc("determine_available_memory")
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/executor/multiproc_executor.py", line 237, in collective_rpc
[2025-09-25 20:03:20] [/bin/sh]: result = get_response(w, dequeue_timeout)
[2025-09-25 20:03:20] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:20] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/executor/multiproc_executor.py", line 224, in get_response
[2025-09-25 20:03:20] [/bin/sh]: raise RuntimeError(
[2025-09-25 20:03:20] [/bin/sh]: RuntimeError: Worker failed with error 'FlashAttention only support fp16 and bf16 data type', please check the stack trace above for the root cause
[2025-09-25 20:03:21] [/bin/sh]: Traceback (most recent call last):
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/cli/deploy.py", line 5, in
[2025-09-25 20:03:21] [/bin/sh]: deploy_main()
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/deploy.py", line 215, in deploy_main
[2025-09-25 20:03:21] [/bin/sh]: SwiftDeploy(args).main()
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/deploy.py", line 40, in init
[2025-09-25 20:03:21] [/bin/sh]: super().init(args)
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer.py", line 38, in init
[2025-09-25 20:03:21] [/bin/sh]: self.infer_engine = self.get_infer_engine(args, self.template)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer.py", line 83, in get_infer_engine
[2025-09-25 20:03:21] [/bin/sh]: return infer_engine_cls(**kwargs)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer_engine/vllm_engine.py", line 114, in init
[2025-09-25 20:03:21] [/bin/sh]: self._prepare_engine()
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/swift/llm/infer/infer_engine/vllm_engine.py", line 123, in _prepare_engine
[2025-09-25 20:03:21] [/bin/sh]: engine = llm_engine_cls.from_engine_args(self.engine_args)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/engine/async_llm_engine.py", line 653, in from_engine_args
[2025-09-25 20:03:21] [/bin/sh]: return async_engine_cls.from_vllm_config(
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/async_llm.py", line 163, in from_vllm_config
[2025-09-25 20:03:21] [/bin/sh]: return cls(
[2025-09-25 20:03:21] [/bin/sh]: ^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/async_llm.py", line 117, in init
[2025-09-25 20:03:21] [/bin/sh]: self.engine_core = EngineCoreClient.make_async_mp_client(
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core_client.py", line 98, in make_async_mp_client
[2025-09-25 20:03:21] [/bin/sh]: return AsyncMPClient(*client_args)
[2025-09-25 20:03:21] [/bin/sh]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core_client.py", line 677, in init
[2025-09-25 20:03:21] [/bin/sh]: super().init(
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/core_client.py", line 408, in init
[2025-09-25 20:03:21] [/bin/sh]: with launch_core_engines(vllm_config, executor_class,
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/contextlib.py", line 144, in exit
[2025-09-25 20:03:21] [/bin/sh]: next(self.gen)
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/utils.py", line 697, in launch_core_engines
[2025-09-25 20:03:21] [/bin/sh]: wait_for_engine_startup(
[2025-09-25 20:03:21] [/bin/sh]: File "/usr/local/lib/python3.11/site-packages/vllm/v1/engine/utils.py", line 750, in wait_for_engine_startup
[2025-09-25 20:03:21] [/bin/sh]: raise RuntimeError("Engine core initialization failed. "
[2025-09-25 20:03:21] [/bin/sh]: RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {}
[2025-09-25 20:03:22] [/bin/sh]: /bin/sh: 2: Syntax error: ";" unexpected