Skip to content

update vLLM CPU to the latest stable version #1546

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Feb 17, 2025

Conversation

xiguiw
Copy link
Collaborator

@xiguiw xiguiw commented Feb 13, 2025

update vLLM CPU to latest stable version

default vllm main branch are in development and changed from time to time. It may be broken sometimes.

Description

The summary of the proposed changes as long as the relevant motivation and context.

Issues

#1532
#1519

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)

Dependencies

Tests

test local, vLLM works as expecte on multiple CPUs.

Copy link

github-actions bot commented Feb 13, 2025

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

@xiguiw
Copy link
Collaborator Author

xiguiw commented Feb 13, 2025

this depends on PR: opea-project/GenAIComps#1285

Merge 1285 first, then this PR.

@yinghu5 yinghu5 changed the title update vLLM CPU to v0.7.2 update vLLM CPU to the latest stable version Feb 14, 2025
default vllm main branch are in development and changed
from time to time. It may be broken sometimes.

Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
@chensuyue
Copy link
Collaborator

chensuyue commented Feb 14, 2025

But [WorkflowExecAgent](https://github.com/opea-project/GenAIExamples/pull/1546/files#diff-f0a3b602b3ccaccbe24d287296e895db76a7ee54d745e2d0a99afa5119e6d65c) test is not triggered. Let's retest after my PR merge, #1554.

@yinghu5 yinghu5 merged commit 0c0edff into opea-project:main Feb 17, 2025
18 checks passed
ezelanza pushed a commit to ezelanza/GenAIExamples that referenced this pull request Feb 28, 2025
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Mar 4, 2025
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Mar 4, 2025
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants