Expose the real-time internal state of the batcher through SSE · huggingface/text-generation-inference@8de41f6

Triggered via pull request February 27, 2025 16:01

mfuntowicz

opened #3065

proxy_sse_engine_state

Status Failure

Total duration 1h 49m 44s

Artifacts –

ci_build.yaml

on: pull_request

Matrix: build

Annotations

6 errors and 6 warnings

build (cuda) / build-and-push

buildx failed with: ERROR: failed to solve: process "/bin/sh -c cargo build --profile release-opt --frozen" did not complete successfully: exit code: 101

build (intel-cpu) / build-and-push

buildx failed with: ERROR: failed to solve: process "/bin/sh -c cargo build --profile release-opt --frozen" did not complete successfully: exit code: 101

build (intel-xpu) / build-and-push

buildx failed with: ERROR: failed to solve: process "/bin/sh -c cargo build --profile release-opt --frozen" did not complete successfully: exit code: 101

build (neuron) / build-and-push

buildx failed with: ERROR: failed to solve: process "/bin/sh -c cargo build --release" did not complete successfully: exit code: 101

build (rocm) / build-and-push

buildx failed with: ERROR: failed to solve: process "/bin/sh -c cargo build --profile release-opt --frozen" did not complete successfully: exit code: 101

build (cuda-trtllm) / build-and-push

buildx failed with: ERROR: failed to solve: process "/bin/sh -c export CC=gcc-14 export CXX=g++-14 export CMAKE_C_COMPILER_LAUNCHER=sccache && export CMAKE_CXX_COMPILER_LAUNCHER=sccache && export CMAKE_CUDA_COMPILER_LAUNCHER=sccache && mkdir $TGI_INSTALL_PREFIX && mkdir \"$TGI_INSTALL_PREFIX/include\" && mkdir \"$TGI_INSTALL_PREFIX/lib\" && cargo build --profile ${build_type} --package text-generation-backends-trtllm --bin text-generation-backends-trtllm && sccache --show-stats" did not complete successfully: exit code: 101

build (cuda) / build-and-push