Skip to content

ChatQnA Docker compose file for Milvus as vdb #1548

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 44 commits into from
Feb 28, 2025
Merged

ChatQnA Docker compose file for Milvus as vdb #1548

merged 44 commits into from
Feb 28, 2025

Conversation

ezelanza
Copy link
Contributor

Description

Docker_compose file for Milvus usage as Vector Database on GenAIExamples/ChatQnA

Issues

Retriever PR

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • [ X] New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

n/a

Tests

Locally tested

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 13, 2025 •
edited
Loading

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

@ezelanza
Copy link
Contributor Author

ezelanza commented Feb 13, 2025 •
edited
Loading

The PR replaces the actual retriever error on Milvus comps. Once the new image is created, the functionality will work.

@letonghan
Copy link
Collaborator

Hi @ezelanza ! Please also provide a test script in GenAIExamples/ChatQnA/tests named as test_compose_milvus_on_xeon.sh. You can follow the design of this file, Thanks!

@yinghu5 yinghu5 requested review from ftian1 and chensuyue February 25, 2025 06:39
@xiguiw
Copy link
Collaborator

xiguiw commented Feb 25, 2025

@ezelanza
Please check the CI failed.

@ezelanza ezelanza force-pushed the milvus_compose branch 9 times, most recently from 1c69e98 to 28382b1 Compare February 28, 2025 05:34
Ezequiel Lanza and others added 10 commits February 28, 2025 22:12
@ezelanza
Compose file to use Milvus as vdb
0c2cb4c 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@kendall1997 @ezelanza
Make a fix in the main README.md of the ChatQnA. (opea-project#1551)
1f0a26e 
Signed-off-by: Kendall González León <kendall.gonzalez.leon@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@chensuyue @ezelanza
Expand CI test scope for common test scripts (opea-project#1554)
d3db280 
Expand CI test scope, trigger all hw test when the common test scripts changed.

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@Spycsh @ezelanza
Refactor AudioQnA README (opea-project#1508)
1c6e267 
Signed-off-by: Spycsh <sihan.chen@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@xiguiw @chensuyue @ezelanza
update vLLM CPU to the latest stable version (opea-project#1546)
43b0ad1 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@jotpalch @ezelanza
Fix minor typo in README (opea-project#1559)
fa9f5d9 
Change Docker Compost<br/>Deployment on ROCm to Docker Compose<br/>Deployment on ROCm

Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@ZePan110 @ezelanza
Remove perf test code from test scripts. (opea-project#1510)
79ef340 
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@dependabot @chensuyue @ezelanza
Bump gradio from 5.5.0 to 5.11.0 in /MultimodalQnA/ui/gradio (opea-pr…
6af942b 
…oject#1391)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@xiguiw @ezelanza
Simplify ChatQnA AIPC user setting (opea-project#1573)
18f6342 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@xiguiw @ezelanza
Fix mismatched environment variable (opea-project#1575)
f10e493 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
ezelanza and others added 11 commits February 28, 2025 22:12
@ezelanza
Docker compose updated
bdf8014 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@pre-commit-ci @ezelanza
[pre-commit.ci] auto fixes from pre-commit.com hooks
b7663cd 
for more information, see https://pre-commit.ci

Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@chensuyue @ezelanza
Fix benchmark scripts (opea-project#1517)
b7431f0 
- Align benchmark default config:
1. Update default helm charts version.
2. Add `# mandatory` comment.
3. Update default model ID for LLM.
- Fix deploy issue:
1. Support different `replicaCount` for w/ w/o rerank test.
2. Add `max_num_seqs` for vllm.
3. Add resource setting for tune mode.

- Fix Benchmark issue:
1. Update `user_queries` and `concurrency` setting.
2. Remove invalid parameters.
3. Fix `dataset` and `prompt` setting. And dataset ingest into db.
5. Fix the benchmark hang issue with large user queries. Update `"processes": 16` will fix this issue.
6. Update the eval_path setting logical.
- Optimize benchmark readme.
- Optimize the log path to make the logs more readable.

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@alexsin368 @pre-commit-ci @ezelanza
Top level README: add link to github.io documentation (opea-project#1584
ea0cfcd 
)

Signed-off-by: alexsin368 <alex.sin@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@ezelanza
Update test_compose_milvus_on_xeon.sh
ec679a9 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@WenjiaoYue @ezelanza
fix click example button issue (opea-project#1586)
5755e0c 
Signed-off-by: WenjiaoYue <wenjiao.yue@intel.com>
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@ezelanza
Milvus compose
3d09215 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@ezelanza
Docker compose updated
80d9b32 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@ezelanza
Docker compose updated
6ebe408 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@ezelanza
Docker compose updated
5db12a5 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@pre-commit-ci @ezelanza
[pre-commit.ci] auto fixes from pre-commit.com hooks
ceaa7bc 
for more information, see https://pre-commit.ci

Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
@lvliang-intel lvliang-intel merged commit fba0de4 into opea-project:main Feb 28, 2025
14 checks passed
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Mar 4, 2025
@ezelanza @kendall1997
@chensuyue @Spycsh @xiguiw @jotpalch @ZePan110 @dependabot @minmin-intel @yinghu5 @pre-commit-ci @eero-t @lvliang-intel @artem-astafev @XinyaoWa @alexsin368 @WenjiaoYue
ChatQnA Docker compose file for Milvus as vdb (opea-project#1548)
b486a4e 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
Signed-off-by: Kendall González León <kendall.gonzalez.leon@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Spycsh <sihan.chen@intel.com>
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: minmin-intel <minmin.hou@intel.com>
Signed-off-by: Artem Astafev <a.astafev@datamonsters.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: alexsin368 <alex.sin@intel.com>
Signed-off-by: WenjiaoYue <wenjiao.yue@intel.com>
Co-authored-by: Ezequiel Lanza <emlanza@CDQ242RKJDmac.local>
Co-authored-by: Kendall González León <kendallgonzalez@hotmail.es>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: xiguiw <111278656+xiguiw@users.noreply.github.com>
Co-authored-by: jotpalch <49465120+jotpalch@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: Ying Hu <ying.hu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Eero Tamminen <eero.t.tamminen@intel.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Artem Astafev <a.astafev@datamonsters.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: alexsin368 <109180236+alexsin368@users.noreply.github.com>
Co-authored-by: WenjiaoYue <wenjiao.yue@intel.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
jedwards-habana pushed a commit to jedwards-habana/GenAIExamples that referenced this pull request Mar 11, 2025
@ezelanza @kendall1997
@chensuyue @Spycsh @xiguiw @jotpalch @ZePan110 @dependabot @minmin-intel @yinghu5 @pre-commit-ci @eero-t @lvliang-intel @artem-astafev @XinyaoWa @alexsin368 @WenjiaoYue
ChatQnA Docker compose file for Milvus as vdb (opea-project#1548)
b212844 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
Signed-off-by: Kendall González León <kendall.gonzalez.leon@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Spycsh <sihan.chen@intel.com>
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: minmin-intel <minmin.hou@intel.com>
Signed-off-by: Artem Astafev <a.astafev@datamonsters.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: alexsin368 <alex.sin@intel.com>
Signed-off-by: WenjiaoYue <wenjiao.yue@intel.com>
Co-authored-by: Ezequiel Lanza <emlanza@CDQ242RKJDmac.local>
Co-authored-by: Kendall González León <kendallgonzalez@hotmail.es>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: xiguiw <111278656+xiguiw@users.noreply.github.com>
Co-authored-by: jotpalch <49465120+jotpalch@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: Ying Hu <ying.hu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Eero Tamminen <eero.t.tamminen@intel.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Artem Astafev <a.astafev@datamonsters.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: alexsin368 <109180236+alexsin368@users.noreply.github.com>
Co-authored-by: WenjiaoYue <wenjiao.yue@intel.com>
Signed-off-by: Edwards, James A <jaedwards@habana.ai>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Mar 21, 2025
@ezelanza @kendall1997
@chensuyue @Spycsh @xiguiw @jotpalch @ZePan110 @dependabot @minmin-intel @yinghu5 @pre-commit-ci @eero-t @lvliang-intel @artem-astafev @XinyaoWa @alexsin368 @WenjiaoYue
ChatQnA Docker compose file for Milvus as vdb (opea-project#1548)
136903b 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
Signed-off-by: Kendall González León <kendall.gonzalez.leon@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Spycsh <sihan.chen@intel.com>
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: minmin-intel <minmin.hou@intel.com>
Signed-off-by: Artem Astafev <a.astafev@datamonsters.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: alexsin368 <alex.sin@intel.com>
Signed-off-by: WenjiaoYue <wenjiao.yue@intel.com>
Co-authored-by: Ezequiel Lanza <emlanza@CDQ242RKJDmac.local>
Co-authored-by: Kendall González León <kendallgonzalez@hotmail.es>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: xiguiw <111278656+xiguiw@users.noreply.github.com>
Co-authored-by: jotpalch <49465120+jotpalch@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: Ying Hu <ying.hu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Eero Tamminen <eero.t.tamminen@intel.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Artem Astafev <a.astafev@datamonsters.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: alexsin368 <109180236+alexsin368@users.noreply.github.com>
Co-authored-by: WenjiaoYue <wenjiao.yue@intel.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request May 16, 2025
@ezelanza @kendall1997
@chensuyue @Spycsh @xiguiw @jotpalch @ZePan110 @dependabot @minmin-intel @yinghu5 @pre-commit-ci @eero-t @lvliang-intel @artem-astafev @XinyaoWa @alexsin368 @WenjiaoYue @chyundunovDatamonsters
ChatQnA Docker compose file for Milvus as vdb (opea-project#1548)
859b697 
Signed-off-by: Ezequiel Lanza <ezequiel.lanza@gmail.com>
Signed-off-by: Kendall González León <kendall.gonzalez.leon@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Spycsh <sihan.chen@intel.com>
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: minmin-intel <minmin.hou@intel.com>
Signed-off-by: Artem Astafev <a.astafev@datamonsters.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: alexsin368 <alex.sin@intel.com>
Signed-off-by: WenjiaoYue <wenjiao.yue@intel.com>
Co-authored-by: Ezequiel Lanza <emlanza@CDQ242RKJDmac.local>
Co-authored-by: Kendall González León <kendallgonzalez@hotmail.es>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Spycsh <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: xiguiw <111278656+xiguiw@users.noreply.github.com>
Co-authored-by: jotpalch <49465120+jotpalch@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: Ying Hu <ying.hu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Eero Tamminen <eero.t.tamminen@intel.com>
Co-authored-by: Liang Lv <liang1.lv@intel.com>
Co-authored-by: Artem Astafev <a.astafev@datamonsters.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: alexsin368 <109180236+alexsin368@users.noreply.github.com>
Co-authored-by: WenjiaoYue <wenjiao.yue@intel.com>
Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@letonghan letonghan letonghan left review comments

@Spycsh Spycsh Spycsh approved these changes

@lvliang-intel lvliang-intel lvliang-intel approved these changes

@ftian1 ftian1 Awaiting requested review from ftian1

@chensuyue chensuyue Awaiting requested review from chensuyue

@XinyaoWa XinyaoWa Awaiting requested review from XinyaoWa

@jaswanth8888 jaswanth8888 Awaiting requested review from jaswanth8888

@hteeyeoh hteeyeoh Awaiting requested review from hteeyeoh

@rbrugaro rbrugaro Awaiting requested review from rbrugaro

@ashahba ashahba Awaiting requested review from ashahba

@myqi myqi Awaiting requested review from myqi

@lkk12014402 lkk12014402 Awaiting requested review from lkk12014402

@xuechendi xuechendi Awaiting requested review from xuechendi

@WenjiaoYue WenjiaoYue Awaiting requested review from WenjiaoYue

@minmin-intel minmin-intel Awaiting requested review from minmin-intel

@ZePan110 ZePan110 Awaiting requested review from ZePan110

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.