Question about tools/parallel_inference/run.sh

[z-jiaming]

Thanks for your great work!

I try the tools/parallel_inference/run.sh but raise an error as:

My python env like (same as install):

Package                   Version
------------------------- ------------
absl-py                   2.1.0
accelerate                1.1.1
aiofiles                  23.2.1
aiosignal                 1.3.2
albucore                  0.0.23
albumentations            2.0.4
annotated-types           0.7.0
antlr4-python3-runtime    4.9.3
anyio                     4.8.0
anykeystore               0.2
asttokens                 3.0.0
attrs                     25.1.0
av                        14.2.0
beautifulsoup4            4.13.3
bitsandbytes              0.45.3
blessed                   1.20.0
blinker                   1.9.0
certifi                   2025.1.31
charset-normalizer        3.4.1
click                     8.1.8
clip                      1.0
coloredlogs               15.0.1
comm                      0.2.2
consisid_eva_clip         1.0.2
contourpy                 1.3.1
cryptacular               1.6.2
cycler                    0.12.1
Cython                    3.0.12
decorator                 5.2.1
decord                    0.6.0
deepspeed                 0.15.2
defusedxml                0.7.1
diffusers                 0.33.0.dev0
DistVAE                   0.0.0b5
docker-pycreds            0.4.0
easydict                  1.13
einops                    0.8.1
executing                 2.2.0
facexlib                  0.3.0
fastapi                   0.115.8
ffmpy                     0.5.0
filelock                  3.17.0
filterpy                  1.4.5
flash_attn                2.7.4.post1
Flask                     3.1.0
flatbuffers               25.2.10
fonttools                 4.56.0
frozenlist                1.5.0
fsspec                    2025.2.0
ftfy                      6.3.1
func_timeout              4.3.5
gitdb                     4.0.12
GitPython                 3.1.44
gpustat                   1.1.1
gradio                    5.6.0
gradio_client             1.4.3
greenlet                  3.1.1
grpcio                    1.70.0
h11                       0.14.0
hjson                     3.1.0
httpcore                  1.0.7
httpx                     0.28.1
huggingface-hub           0.27.1
humanfriendly             10.0
hupper                    1.12.1
hydra-core                1.3.2
idna                      3.10
imageio                   2.37.0
imageio-ffmpeg            0.6.0
importlib_metadata        8.6.1
iniconfig                 2.0.0
insightface               0.7.3
iopath                    0.1.10
ipython                   8.32.0
ipywidgets                8.1.5
itsdangerous              2.2.0
jedi                      0.19.2
Jinja2                    3.1.5
joblib                    1.4.2
jsonschema                4.23.0
jsonschema-specifications 2024.10.1
jupyterlab_widgets        3.0.13
kiwisolver                1.4.8
lap                       0.5.12
lazy_loader               0.4
llvmlite                  0.43.0
loguru                    0.7.3
Markdown                  3.7
markdown-it-py            3.0.0
MarkupSafe                2.1.5
matplotlib                3.10.0
matplotlib-inline         0.1.7
mdurl                     0.1.2
moviepy                   2.1.1
mpmath                    1.3.0
msgpack                   1.1.0
networkx                  3.4.2
ninja                     1.11.1.3
numba                     0.60.0
numpy                     1.26.4
nvidia-cublas-cu12        12.1.3.1
nvidia-cuda-cupti-cu12    12.1.105
nvidia-cuda-nvrtc-cu12    12.1.105
nvidia-cuda-runtime-cu12  12.1.105
nvidia-cudnn-cu12         9.1.0.70
nvidia-cufft-cu12         11.0.2.54
nvidia-curand-cu12        10.3.2.106
nvidia-cusolver-cu12      11.4.5.107
nvidia-cusparse-cu12      12.1.0.106
nvidia-ml-py              12.570.86
nvidia-nccl-cu12          2.21.5
nvidia-nvjitlink-cu12     12.8.61
nvidia-nvtx-cu12          12.1.105
nvitop                    1.4.2
oauthlib                  3.2.2
omegaconf                 2.3.0
onnx                      1.17.0
onnxruntime-gpu           1.19.2
opencv-python             4.10.0.84
opencv-python-headless    4.11.0.86
optimum-quanto            0.2.6
orjson                    3.10.15
packaging                 24.2
pandas                    2.2.3
parso                     0.8.4
PasteDeploy               3.1.0
pbkdf2                    1.3
peft                      0.12.0
pexpect                   4.9.0
pillow                    10.4.0
pip                       25.0
plaster                   1.1.2
plaster-pastedeploy       1.0.1
platformdirs              4.3.6
pluggy                    1.5.0
portalocker               3.1.1
prettytable               3.14.0
prodigyopt                1.1.2
proglog                   0.1.10
prompt_toolkit            3.0.50
protobuf                  5.29.3
psutil                    5.9.8
ptyprocess                0.7.0
pure_eval                 0.2.3
py-cpuinfo                9.0.0
pydantic                  2.10.6
pydantic_core             2.27.2
pydub                     0.25.1
pyfacer                   0.0.4
Pygments                  2.19.1
pyparsing                 3.2.1
pyramid                   2.0.2
pyramid-mailer            0.15.1
pytest                    8.3.4
python-dateutil           2.9.0.post0
python-dotenv             1.0.1
python-multipart          0.0.12
python3-openid            3.2.0
pytz                      2025.1
PyYAML                    6.0.2
qwen-vl-utils             0.0.10
ray                       2.42.1
referencing               0.36.2
regex                     2024.11.6
repoze.sendmail           4.4.1
requests                  2.32.3
requests-oauthlib         2.0.0
rich                      13.9.4
rpds-py                   0.23.1
ruff                      0.9.7
safehttpx                 0.1.6
safetensors               0.5.2
SAM-2                     1.0
scenedetect               0.6.5.2
scikit-image              0.25.2
scikit-learn              1.6.1
scikit-video              1.1.11
scipy                     1.15.2
seaborn                   0.13.2
semantic-version          2.10.0
sentencepiece             0.2.0
sentry-sdk                2.22.0
setproctitle              1.3.5
setuptools                75.8.0
shellingham               1.5.4
simsimd                   6.2.1
six                       1.17.0
smmap                     5.0.2
sniffio                   1.3.1
soupsieve                 2.6
spaces                    0.30.4
spandrel                  0.4.0
SQLAlchemy                2.0.38
stack-data                0.6.3
starlette                 0.45.3
stringzilla               3.12.0
supervision               0.25.1
sympy                     1.13.1
tensorboard               2.17.1
tensorboard-data-server   0.7.2
threadpoolctl             3.5.0
tifffile                  2025.2.18
timm                      1.0.9
tokenizers                0.20.1
tomlkit                   0.12.0
torch                     2.5.1+cu121
torchaudio                2.5.1+cu121
torchvision               0.20.1+cu121
tqdm                      4.67.1
traitlets                 5.14.3
transaction               5.0
transformers              4.46.3
translationstring         1.4
triton                    3.1.0
typer                     0.15.1
typing_extensions         4.12.2
tzdata                    2025.1
ultralytics               8.3.79
ultralytics-thop          2.0.14
urllib3                   2.3.0
uvicorn                   0.34.0
validators                0.34.0
velruse                   1.1.1
venusian                  3.1.1
wandb                     0.19.7
wcwidth                   0.2.13
WebOb                     1.8.9
websockets                12.0
Werkzeug                  3.1.3
wheel                     0.45.1
widgetsnbextension        4.0.13
WTForms                   3.2.1
wtforms-recaptcha         0.3.2
xformers                  0.0.28.post3
xfuser                    0.4.1
yunchang                  0.6.0
zipp                      3.21.0
zope.deprecation          5.1
zope.interface            7.2
zope.sqlalchemy           3.1

I checked diffusers code and found that 'timestep_back' and 'sample' are indeed needed.

https://github.com/huggingface/diffusers/blob/3fab6624fdd2753233a10984b62025076a7e9889/src/diffusers/schedulers/scheduling_dpm_cogvideox.py#L330-L342

So it may be that the code is not compatible with the current version of diffusers or xfuser?

[SHYuanBest]

Thanks for your interest! I will fix it later.

[SHYuanBest]

Did your code the same as https://github.com/PKU-YuanGroup/ConsisID/tree/main/tools/parallel_inference? It seem that your code fail to recognize CogVideoXDPMScheduler, and if not isinstance(self.scheduler, CogVideoXDPMScheduler) should not be True.
https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/consisid/pipeline_consisid.py#L931

[z-jiaming]

I just fix the file path as:

the xfuser has been installed.