Parallel Inference

[1390806607]

@GACLove Hello, may I ask if using ComfyUI-Lightx2vWrapper on comfyui enables direct multi-card parallel inference? I would like to utilize multiple cards to accelerate the inference speed.

[GACLove]

You can try using https://github.com/ModelTC/LightX2V/blob/main/scripts/server/start_multi_servers.sh to start a parallel inference service. Then call it through API.