-
Notifications
You must be signed in to change notification settings - Fork 195
VDMS langchain package update #1317
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
@XinyuYe-Intel could you please review this? |
Hi @cwlacewe , |
Please fix the CI failures. |
7df2811
to
3c1a623
Compare
Hi @chensuyue @yinghu5, |
This fix is needed for opea-project/GenAIExamples#1696 |
|
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
…etriever dockerfiles Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
…et proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
…into update_vdms
|
|
@@ -64,6 +64,10 @@ jobs: | |||
role-to-assume: ${{ secrets.AWS_IAM_ROLE_ARN }} | |||
aws-region: us-east-1 | |||
|
|||
- name: Set Memory Map Limit |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This change will break CI test, the code change in GHA workflow won't work until they merged, because we use "pull_request_target".
commit 9e5e9be Author: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Date: Fri Apr 4 11:19:23 2025 -0700 Update Gaudi Docker to v1.19.0 and PyTorch Installer 2.5.1 (opea-project#1513) Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Co-authored-by: chen, suyue <suyue.chen@intel.com> commit c787ce6 Author: Mustafa <109312699+MSCetin37@users.noreply.github.com> Date: Fri Apr 4 08:54:33 2025 -0700 Data Ingestion and Retrieval with custom index_name (opea-project#1439) * CodeGen initial Signed-off-by: Mustafa <mustafa.cetin@intel.com> * code update Signed-off-by: Mustafa <mustafa.cetin@intel.com> * code update Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * adding index_name variable Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update unit tests Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update the tests Signed-off-by: Mustafa <mustafa.cetin@intel.com> * code update & add ingest_with_index test Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update redis test Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update retrievers Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update redis-delete_files Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Mustafa <mustafa.cetin@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> commit 52b9172 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Thu Apr 3 18:10:40 2025 -0700 Unset TEI_EMBEDDING_ENDPOINT when running multimodal redis retriever tests (opea-project#1515) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 80ef317 Author: jilongW <109333127+jilongW@users.noreply.github.com> Date: Thu Apr 3 20:13:39 2025 +0800 Add xtune to finetuning (opea-project#1432) Signed-off-by: jilongwa <jilong.wang@intel.com> commit a763c35 Author: Chun Tao <chun.tao@intel.com> Date: Thu Apr 3 00:30:35 2025 -0700 Add in entrypoint new download links for wav2lip and wav2lip_gan models, as old links were deprecated. (opea-project#1523) Signed-off-by: Chun Tao <chun.tao@intel.com> commit d133eee Author: chen, suyue <suyue.chen@intel.com> Date: Thu Apr 3 14:16:53 2025 +0800 remove concurrency in image build and push workflow (opea-project#1510) 1. Remove concurrency setting in image build and push workflow, cause the build scope is not the same for each push. 2. Fix a duplicate container name in agent test. Signed-off-by: chensuyue <suyue.chen@intel.com> commit 2a0ce2a Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Thu Apr 3 14:10:27 2025 +0800 minor fix gpt-sovits service names (opea-project#1521) commit cec2e1d Author: chen, suyue <suyue.chen@intel.com> Date: Thu Apr 3 09:41:08 2025 +0800 Fix CI workflow (opea-project#1518) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 11b1969 Author: Louie Tsai <louie.tsai@intel.com> Date: Wed Apr 2 16:28:02 2025 -0700 Enable Telemetry Tracing in Agent Comp and also add class name along with func name as span name for tracing (opea-project#1503) * Trace Agent functions and get class name for opea_telemtry tracing Signed-off-by: Louie, Tsai <louie.tsai@intel.com> Signed-off-by: Tsai, Louie <louie.tsai@intel.com> * seperate llm invoke into a standalone function for tracing Signed-off-by: Tsai, Louie <louie.tsai@intel.com> --------- Signed-off-by: Louie, Tsai <louie.tsai@intel.com> Signed-off-by: Tsai, Louie <louie.tsai@intel.com> commit a8f300f Author: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com> Date: Wed Apr 2 02:45:12 2025 -0700 VDMS langchain package update (opea-project#1317) * Update VDMS related components * Pinned protobuf==4.24.2 for vdms to avoid issues * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count * pin protobuf and downgrade opentelemetry to v1.27.0 in dataprep and retriever dockerfiles * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com> Co-authored-by: chen, suyue <suyue.chen@intel.com> commit 40d431a Author: Shifani Rajabose <shifani.rajabose@intel.com> Date: Wed Apr 2 03:55:22 2025 -0400 [Bug: 1379] Added Multimodal support for Milvus for retriever component (opea-project#1381) Added Multimodal support for Milvus for retriever component Fixes opea-project#1379 Co-authored-by: Jaini, Pallavi <pallavi.jaini@intel.com> Co-authored-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> Signed-off-by: pallavi.jaini <pallavi.jaini@intel.com> commit b2eee3a Author: Melanie Hart Buehler <melanie.h.buehler@intel.com> Date: Wed Apr 2 00:53:49 2025 -0700 MultimodalQnA audio features completion (opea-project#1433) Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com> commit 3c1cb20 Author: dolpher <dolpher.du@intel.com> Date: Wed Apr 2 13:39:44 2025 +0800 Fix model cache path and use Random to avoid ns conflict (opea-project#1500) Signed-off-by: Dolpher Du <dolpher.du@intel.com> commit 4a15795 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Wed Apr 2 13:06:21 2025 +0800 Integrate UI-TARS vLLM in lvm component (opea-project#1458) commit 1dddab0 Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Wed Apr 2 10:59:52 2025 +0800 Fix Dataprep ingest PPT and async issues (opea-project#1504) Signed-off-by: letonghan <letong.han@intel.com> commit 981faf5 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Apr 2 10:53:28 2025 +0800 add model cache for example test (opea-project#1509) Signed-off-by: chensuyue <suyue.chen@intel.com> commit c512141 Author: ZePan110 <ze.pan@intel.com> Date: Wed Apr 2 10:45:48 2025 +0800 Remove langchain-huggingface from requirement. (opea-project#1505) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 2b0cd08 Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Tue Apr 1 23:14:29 2025 +0800 unify service ports in compose and READMEs (opea-project#1506) Signed-off-by: letonghan <letong.han@intel.com> commit de882e5 Author: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Date: Mon Mar 31 22:40:28 2025 -0700 Update nofile's hard limit to 262144 for opensearch (opea-project#1495) Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> commit 380f95c Author: Eero Tamminen <eero.t.tamminen@intel.com> Date: Mon Mar 31 14:40:44 2025 +0300 Fix finetuning python regex syntax error (opea-project#1446) Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com> commit ea3374f Author: Trawinski, Dariusz <dariusz.trawinski@intel.com> Date: Mon Mar 31 13:12:33 2025 +0200 ignore false positive errors in reseting cache permissions (opea-project#1489) Signed-off-by: Dariusz Trawinski <Dariusz.Trawinski@intel.com> commit 411af51 Author: chen, suyue <suyue.chen@intel.com> Date: Mon Mar 31 11:56:46 2025 +0800 CICD update to adapt the new xeon test cluster (opea-project#1475) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 342c1ed Author: Siddhi Velankar <siddhi.velankar@intel.com> Date: Sat Mar 29 09:49:19 2025 -0500 Docker support for nebula (opea-project#1396) Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> commit 7a26282 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Fri Mar 28 18:03:05 2025 +0800 Bump version of web search (opea-project#1451) commit 8533924 Author: chen, suyue <suyue.chen@intel.com> Date: Fri Mar 28 11:10:11 2025 +0800 add nginx src into example test trigger path (opea-project#1474) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 3c606ac Author: ZePan110 <ze.pan@intel.com> Date: Fri Mar 28 10:10:57 2025 +0800 Revert "Support parametrization of nginx port (opea-project#1456)" (opea-project#1473) This reverts commit d58d320. commit 1871dec Author: sri-intel <108247623+srinarayan-srikanthan@users.noreply.github.com> Date: Thu Mar 27 11:01:27 2025 -0400 remote endpoint support (opea-project#1399) Signed-off-by: Srinarayan Srikanthan <srinarayan.srikanthan@intel.com> commit ac38d87 Author: chen, suyue <suyue.chen@intel.com> Date: Thu Mar 27 22:55:07 2025 +0800 Enhance test env clean up (opea-project#1469) * Update test env clean up Signed-off-by: chensuyue <suyue.chen@intel.com> commit 772ef6e Author: XinyaoWa <xinyao.wang@intel.com> Date: Thu Mar 27 21:48:48 2025 +0800 Enlarge DocSum prompt buffer (opea-project#1471) Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> commit 4252121 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 14:06:22 2025 +0800 Use model cache for dataprep docker compose test. (opea-project#1450) Use model cache for dataprep docker compose test. Fix web_retrievers typo Signed-off-by: ZePan110 <ze.pan@intel.com> commit 0672112 Author: xiguiw <111278656+xiguiw@users.noreply.github.com> Date: Thu Mar 27 13:24:56 2025 +0800 Update TEI docker image to 1.6 (opea-project#1453) update TEI docker image to ghcr.io/huggingface/text-embeddings-inference:cpu-1.6 Signed-off-by: Wang, Xigui <xigui.wang@intel.com> commit 8ce0162 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:33:10 2025 +0800 Use model cache for third_parties docker compose test. (opea-project#1464) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 5d6ada9 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:32:46 2025 +0800 Use model cache for agent and guardrails docker compose test. (opea-project#1462) Signed-off-by: ZePan110 <ze.pan@intel.com> commit f34829a Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:32:29 2025 +0800 Use model cache for llms docker compose test. (opea-project#1463) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 8170dfb Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:07:35 2025 +0800 Use model cache for retrievers docker compose tests. (opea-project#1460) Use model cache for retrievers docker compose tests Signed-off-by: ZePan110 <ze.pan@intel.com> commit 3f3b006 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:06:59 2025 +0800 Use model cache for rerankings docker compose tests. (opea-project#1459) Use model cache for rerankings docker compose tests. Signed-off-by: ZePan110 <ze.pan@intel.com> commit 206de27 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:06:41 2025 +0800 Use model cache for web_retriever docker compose tests. (opea-project#1461) Use model cache for web_retriever docker compose tests Signed-off-by: ZePan110 <ze.pan@intel.com> commit d58d320 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 09:40:42 2025 +0800 Support parametrization of nginx port (opea-project#1456) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 78b94fc Author: Trawinski, Dariusz <dariusz.trawinski@intel.com> Date: Wed Mar 26 12:19:46 2025 +0100 text generation, embedding and reranking with ovms (opea-project#1318) Signed-off-by: Dariusz Trawinski <Dariusz.Trawinski@intel.com> commit d5cd3e4 Author: ZePan110 <ze.pan@intel.com> Date: Wed Mar 26 13:38:45 2025 +0800 Fix issue with orphaned containers in the Github runtime program for running tests. (opea-project#1454) Fix issue opea-project#1323 Signed-off-by: ZePan110 <ze.pan@intel.com> commit 11a061a Author: ZePan110 <ze.pan@intel.com> Date: Wed Mar 26 13:37:53 2025 +0800 Use model cache for embeddings docker compose test. (opea-project#1452) Use model cache for embeddings docker compose test. Signed-off-by: ZePan110 <ze.pan@intel.com> commit ed4acef Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Wed Mar 26 09:38:30 2025 +0800 Fix Retriever Async Issue (opea-project#1457) Signed-off-by: letonghan <letong.han@intel.com> commit d8bd6ee Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Wed Mar 26 09:38:12 2025 +0800 fix function name issue (opea-project#1426) Signed-off-by: letonghan <letong.han@intel.com> commit be4c04f Author: Louie Tsai <louie.tsai@intel.com> Date: Tue Mar 25 18:19:57 2025 -0700 Return Mega/Micro Service Version number at runtime (opea-project#912) Signed-off-by: Tsai, Louie <louie.tsai@intel.com> commit 3e559df Author: ZePan110 <ze.pan@intel.com> Date: Tue Mar 25 15:31:17 2025 +0800 Fix Deprecation warnings in logs service logs (opea-project#1444) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix issue Signed-off-by: ZePan110 <ze.pan@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Update requirements Signed-off-by: ZePan110 <ze.pan@intel.com> --------- Signed-off-by: ZePan110 <ze.pan@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit 616c00c Author: chen, suyue <suyue.chen@intel.com> Date: Tue Mar 25 11:52:05 2025 +0800 Update default model cache for new CI cluster (opea-project#1445) Signed-off-by: chensuyue <suyue.chen@intel.com> commit e73c22a Author: ZePan110 <ze.pan@intel.com> Date: Mon Mar 24 23:14:32 2025 +0800 Use model cache for text2sql docker compose test. (opea-project#1436) Signed-off-by: ZePan110 <ze.pan@intel.com> commit d8b491c Author: Eero Tamminen <eero.t.tamminen@intel.com> Date: Mon Mar 24 16:33:05 2025 +0200 Fix: make Orchestrator metrics singleton (opea-project#1301) Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com> commit eadfe2f Author: chen, suyue <suyue.chen@intel.com> Date: Mon Mar 24 15:41:35 2025 +0800 Fix default model cache adapt to the new test cluster (opea-project#1443) 1. Fix default model cache adapt to the new test cluster 2. Skip docker build container clean up for microservice test Signed-off-by: chensuyue <suyue.chen@intel.com> commit 8f9ec23 Author: chen, suyue <suyue.chen@intel.com> Date: Mon Mar 24 13:49:44 2025 +0800 Enhance docker clean up in CI (opea-project#1442) * enhance docker clean up * clean up invalid label Signed-off-by: chensuyue <suyue.chen@intel.com> commit 02a2cdd Author: XinyuYe-Intel <xinyu.ye@intel.com> Date: Mon Mar 24 13:40:58 2025 +0800 Added Mistral-Small-24B-Instruct-2501 and Mistral-Large-Instruct-2411 models support in text-gen (opea-project#1387) * added Mistral-Small-24B-Instruct-2501 and Mistral-Large-Instruct-2411 models in text-gen. Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit 559ebb2 Author: Eknath Baravkar <50608952+baravkareknath@users.noreply.github.com> Date: Sat Mar 22 19:28:03 2025 +0530 Refine the README for llms/doc-summarization (opea-project#1437) Signed-off-by: unknown <baravkareknath@gmail.com> commit c58fd39 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Fri Mar 21 18:51:31 2025 -0700 Fix curl commands in the LLaVA server README (opea-project#1427) Signed-off-by: dmsuehir <dina.s.jones@intel.com> commit 3bb51f7 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Fri Mar 21 18:21:21 2025 -0700 Fix failing data prep milvus multimodal tests that use the LVM (opea-project#1441) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 03ac6ed Author: minmin-intel <minmin.hou@intel.com> Date: Fri Mar 21 11:38:54 2025 -0700 Add redis-finance to dataprep (opea-project#1384) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * redis finance code Signed-off-by: minmin-intel <minmin.hou@intel.com> * add two new packages Signed-off-by: minmin-intel <minmin.hou@intel.com> * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * debug ci error Signed-off-by: minmin-intel <minmin.hou@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix errors Signed-off-by: minmin-intel <minmin.hou@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add readme and rename test script to run ci on gaudi Signed-off-by: minmin-intel <minmin.hou@intel.com> --------- Signed-off-by: minmin-intel <minmin.hou@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit c65ceb2 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Fri Mar 21 16:52:52 2025 +0800 Add LLaMA Vision OH optimization (opea-project#1296) * Add LLaMA Vision OH optimization - Add mllama OH optimization - Fix LVM README and fix steps - add UT - fix 422 request body issue from wrapper to dependency - add LOGFLAG - add healthcheck - Upgrade HPU driver version - Correct compose file mllama names commit 7044590 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Thu Mar 20 18:51:35 2025 -0700 Fix failing data prep redis multimodal tests that use the LVM (opea-project#1440) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 8493659 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 19 15:35:23 2025 +0800 Add third party into test matrix (opea-project#1430) Signed-off-by: chensuyue <suyue.chen@intel.com> commit ccef449 Author: Zhu Yongbo <yongbo.zhu@intel.com> Date: Wed Mar 19 13:52:17 2025 +0800 Fix Dockerfile.intel_gpu build issue (opea-project#1429) Signed-off-by: Zhu, Yongbo <yongbo.zhu@intel.com> commit 006bd91 Author: Shifani Rajabose <shifani.rajabose@intel.com> Date: Tue Mar 18 02:16:40 2025 -0400 [Bug: 1378] Added Multimodal support for Milvus for dataprep component (opea-project#1380) * [Bug: 1378] Added Multimodal support for Milvus for dataprep component Fixes opea-project#1378 Co-authored-by: Jaini, Pallavi <pallavi.jaini@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Rajabose, Shifani <shifani.rajabose@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> --------- Signed-off-by: Shifani Rajabose <srajabose@habana.ai> Signed-off-by: pallavi.jaini <pallavi.jaini@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: pallavi.jaini <pallavi.jaini@intel.com> commit 831c5a3 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Mon Mar 17 13:33:38 2025 +0800 vLLM lvm integration (opea-project#1362) * vLLM lvm integration - integrate vLLM LVMs and set vLLM as default - use OpenAI chat completions and cover single-image/text-only cases commit 558a2f6 Author: minmin-intel <minmin.hou@intel.com> Date: Fri Mar 14 19:25:20 2025 -0700 enable custom prompt for react_llama and react_langgraph (opea-project#1391) Signed-off-by: minmin-intel <minmin.hou@intel.com> commit 3ebab3c Author: Sun, Xuehao <xuehao.sun@intel.com> Date: Fri Mar 14 17:55:56 2025 +0800 Add GitHub Action to check and close stale issues and PRs (opea-project#1394) Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com> commit b2b7908 Author: Louie Tsai <louie.tsai@intel.com> Date: Fri Mar 14 00:26:45 2025 -0700 [Telemetry] use existed env variable instead of introducing new one (opea-project#1251) * try to leverage existed env variable instead of introducing new one Signed-off-by: Tsai, Louie <louie.tsai@intel.com> * remove ENABLE_OPEA_TELEMETRY getenv Signed-off-by: Tsai, Louie <louie.tsai@intel.com> --------- Signed-off-by: Tsai, Louie <louie.tsai@intel.com> commit 986c138 Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Fri Mar 14 10:36:18 2025 +0800 Fix dependency issue in Retriever (opea-project#1393) Add aiofiles in requirements.txt of retriever, which is caused by cross-component function call of retriever neo4j. Signed-off-by: letonghan <letong.han@intel.com> commit e8994da Author: Jonathan Minkin <minkinj@amazon.com> Date: Thu Mar 13 03:35:06 2025 -0700 Fix file list and index drop for opensearch (opea-project#1322) Signed-off-by: Jonathan Minkin <minkinj@amazon.com> commit d47127e Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Thu Mar 13 15:25:07 2025 +0800 Refine Dataprep Redis with Async Issue (opea-project#1390) Signed-off-by: letonghan <letong.han@intel.com> commit b1d01a2 Author: Lianhao Lu <lianhao.lu@intel.com> Date: Wed Mar 12 16:04:02 2025 +0800 bridgetower/clip: add missing dependency for aiohttp (opea-project#1371) Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> commit 492f028 Author: Shifani Rajabose <shifani.rajabose@intel.com> Date: Wed Mar 12 03:04:07 2025 -0400 [Bug: 1375] Fix Readme errors in dataprep component for all VectorDBs (opea-project#1377) * [Bug: 1375] Fix Readme errors in dataprep component for all VectorDBs Fixes opea-project#1375 Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Jaini, Pallavi <pallavi.jaini@intel.com> Signed-off-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * Improve dataprep CI and fix pptx file ingesting bug (opea-project#1334) - Fix permission issue for when ingesting pptx file with embedded image - Add more test coverage to the dataprep CI and unify common dataprep CI test code for DB backends: qdrant, milvus, redis, pgvector Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * Fix docker compose command in embedding BridgeTower readme (opea-project#1374) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * Changes to checkin text2graph microservice (opea-project#1357) Signed-off-by: Raghava, Sharath <sharath.raghava@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * [Bug: 1375] Fix Readme errors in dataprep component for all VectorDBs Fixes opea-project#1375 Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Jaini, Pallavi <pallavi.jaini@intel.com> Signed-off-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> --------- Signed-off-by: Shifani Rajabose <srajabose@habana.ai> Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> Signed-off-by: Raghava, Sharath <sharath.raghava@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Lianhao Lu <lianhao.lu@intel.com> Co-authored-by: Dina Suehiro Jones <dina.s.jones@intel.com> Co-authored-by: intelsharath <116231490+intelsharath@users.noreply.github.com> Co-authored-by: Liang Lv <liang1.lv@intel.com> commit 8c6f2b1 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 12 14:25:30 2025 +0800 Use the latest HabanaAI/vllm-fork release tag to build vllm-gaudi image (opea-project#1376) opea-project/GenAIExamples#1436 --------- Signed-off-by: chensuyue <suyue.chen@intel.com> commit f714d33 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 12 11:09:17 2025 +0800 Filter none test scripts in test matrix (opea-project#1386) * filter none test scripts in test matrix Signed-off-by: chensuyue <suyue.chen@intel.com> commit b93189d Author: chyundunovDatamonsters <c.yundunov@datamonsters.com> Date: Wed Mar 12 09:42:10 2025 +0700 Add Dockerfile for build ROCm vLLM Docker image (opea-project#1372) * Add Dockerfile for build ROCm vLLM Docker image Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com> commit e231574 Author: Jean Yu <jean1.yu@intel.com> Date: Sun Mar 9 22:46:10 2025 -0500 add text2cypher component (opea-project#1319) Signed-off-by: jeanyu-habana <jean1.yu@intel.com> commit 838d16d Author: intelsharath <116231490+intelsharath@users.noreply.github.com> Date: Thu Mar 6 23:29:45 2025 -0800 Changes to checkin text2graph microservice (opea-project#1357) Signed-off-by: Raghava, Sharath <sharath.raghava@intel.com> commit 60c20b5 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Thu Mar 6 19:49:02 2025 -0800 Fix docker compose command in embedding BridgeTower readme (opea-project#1374) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 24f5021 Author: Lianhao Lu <lianhao.lu@intel.com> Date: Fri Mar 7 10:13:21 2025 +0800 Improve dataprep CI and fix pptx file ingesting bug (opea-project#1334) - Fix permission issue for when ingesting pptx file with embedded image - Add more test coverage to the dataprep CI and unify common dataprep CI test code for DB backends: qdrant, milvus, redis, pgvector Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> commit cbb8a82 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 5 11:47:56 2025 +0800 update image push machine (opea-project#1361) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 1064b2b Author: Eero Tamminen <eero.t.tamminen@intel.com> Date: Tue Mar 4 14:15:12 2025 +0200 Megaservice / orchestrator metric testing + fixes (opea-project#1348) Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com> commit 50d2e8c Author: XinyaoWa <xinyao.wang@intel.com> Date: Tue Mar 4 13:44:59 2025 +0800 Add timeout param for DocSum and FaqGen to deal with long context (opea-project#1329) * Add timeout param for DocSum and FaqGen to deal with long context Make timeout param configurable, solve issue opea-project/GenAIExamples#1481 Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Update VDMS related components * Pinned protobuf==4.24.2 for vdms to avoid issues * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count * pin protobuf and downgrade opentelemetry to v1.27.0 in dataprep and retriever dockerfiles * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com> Co-authored-by: chen, suyue <suyue.chen@intel.com> Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com>
commit 0060b04 Author: Yao Qing <Qing.Yao@intel.com> Date: Fri Apr 11 21:43:56 2025 +0800 Unified default port number for the same service in text2graph and text2sql (opea-project#1554) Signed-off-by: Yao, Qing <qing.yao@intel.com> commit 936aaa6 Author: chen, suyue <suyue.chen@intel.com> Date: Fri Apr 11 15:50:58 2025 +0800 Fix image build issue (opea-project#1553) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 7714b05 Author: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Date: Fri Apr 11 00:05:04 2025 -0700 Upgrade Torch and it's dependencies to v2.5.x for video-llama (opea-project#1551) Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> commit 6e30a85 Author: Siddhi Velankar <siddhi.velankar@intel.com> Date: Thu Apr 10 21:00:26 2025 -0500 Text to knowledge graph (text2kg) microservice implementation (opea-project#1472) * add all comps for text2kg Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * add tests Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update README Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * add DATA_PATH variable for tests Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * change port Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * review updates Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update neo4j hyperlink Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * update health check Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit 67933f4 Author: ZePan110 <ze.pan@intel.com> Date: Thu Apr 10 16:32:14 2025 +0800 Enhance CD workfow. (opea-project#1519) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 6acacc8 Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Thu Apr 10 11:46:33 2025 +0800 Support health check in dataprep component (opea-project#1546) * Support health check in dataprep component. Modify all related test scripts. Issue: opea-project/GenAIExamples#1699 Signed-off-by: letonghan <letong.han@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: letonghan <letong.han@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit 62aa2cd Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Thu Apr 10 10:38:46 2025 +0800 align ports host/docker and simply some healthcheck logics (opea-project#1499) * align ports host/docker and simply some healthcheck * fix port * revert commit 022313c Author: ZePan110 <ze.pan@intel.com> Date: Thu Apr 10 09:56:47 2025 +0800 Adaptation to vllm v0.8.3 build paths and limit vllm version (opea-project#1544) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 1e37512 Author: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Date: Wed Apr 9 18:55:06 2025 -0700 Misc apt and pip updates to Dockerfiles (opea-project#1542) * Misc apt and pip updates to Dockerfiles Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> commit a941fc5 Author: chen, suyue <suyue.chen@intel.com> Date: Thu Apr 10 02:24:41 2025 +0800 upgrade setuptools version adapt to the latest wheel version (opea-project#1545) Signed-off-by: chensuyue <suyue.chen@intel.com> Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> commit e0081e8 Author: Eero Tamminen <eero.t.tamminen@intel.com> Date: Wed Apr 9 16:06:33 2025 +0300 Add tests + docs for BaseStatistics and generalize its code (opea-project#1107) Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com> commit 927dc44 Author: Siddhi Velankar <siddhi.velankar@intel.com> Date: Tue Apr 8 21:57:28 2025 -0500 Struct2graph microservice for HybridRAG (opea-project#1502) Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> commit 5bd5309 Author: XinyaoWa <xinyao.wang@intel.com> Date: Wed Apr 9 09:09:22 2025 +0800 Update readme for supporting deepseek and phi4 (opea-project#1522) Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> commit 8002e8b Author: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Date: Wed Apr 9 09:09:03 2025 +0800 [pre-commit.ci] pre-commit autoupdate (opea-project#1531) Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com> commit 0c106d9 Author: jilongW <109333127+jilongW@users.noreply.github.com> Date: Wed Apr 9 09:08:24 2025 +0800 Fix xtune output location is wrong and update doc (opea-project#1533) Signed-off-by: jilongwa <jilong.wang@intel.com> commit 1f5ec91 Author: Chun Tao <chun.tao@intel.com> Date: Tue Apr 8 17:57:46 2025 -0700 Fix GenAIExamples opea-project#1607 by adding timeout to the wav2lip request (opea-project#1540) Signed-off-by: Chun Tao <chun.tao@intel.com> commit 97d0ec5 Author: rbrugaro <rita.brugarolas.brufau@intel.com> Date: Tue Apr 8 14:02:02 2025 -0700 separate test script ports vs. ports in code/readme/compose (opea-project#1478) * separate test script ports vs. ports in code/readme/compose Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * exported DATAPREP_PORT in script to avoid default 5000 port Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> * missing port export in ci test Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> * changed DATAPREP port to 5001 because 5000 is reserved for local registry Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> * pin sentence transformers because latests 4.0.2 breaks Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> * Revert "changed DATAPREP port to 5001 because 5000 is reserved for local registry" This reverts commit 1806e80. Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> * Revert "pin sentence transformers because latests 4.0.2 breaks" This reverts commit df066a7. Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> --------- Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com> commit f692a32 Author: Sharan Shirodkar <91109427+sharanshirodkar7@users.noreply.github.com> Date: Tue Apr 8 10:34:14 2025 -0400 Hermes-2-Pro-Llama-3-8B model to be deprecated from Prediction Guard platform (opea-project#1366) Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com> commit b7a04bf Author: dolpher <dolpher.du@intel.com> Date: Tue Apr 8 22:25:44 2025 +0800 Sync values yaml file for 1.3 release (opea-project#1524) * Sync values yaml file for 1.3 release Signed-off-by: Dolpher Du <dolpher.du@intel.com> commit dc5edc3 Author: XinyaoWa <xinyao.wang@intel.com> Date: Tue Apr 8 21:12:18 2025 +0800 Support Phi-4-mini and Phi-4-multimodal-instruct in LLM text-generation comps on gaudi mode (opea-project#1335) Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> commit d51a136 Author: Liang Lv <liang1.lv@intel.com> Date: Tue Apr 8 20:25:27 2025 +0800 Add native LLM microservice using IPEX (opea-project#1337) Signed-off-by: lvliang-intel <liang1.lv@intel.com> commit c96b124 Author: lkk <33276950+lkk12014402@users.noreply.github.com> Date: Tue Apr 8 15:15:28 2025 +0800 format react agent llama response to openai for openwebui display. (opea-project#1467) Signed-off-by: lkk <33276950+lkk12014402@users.noreply.github.com> commit e9ba084 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Tue Apr 8 13:46:52 2025 +0800 Refactor multimodal dependencies (opea-project#1527) * Refactor multimodal dependencies - move asr/lvm/tts => 3rd parties - unzip video-llama path as default Signed-off-by: Spycsh <sihan.chen@intel.com> commit cfc43ee Author: Anthony Mahanna <43019056+aMahanna@users.noreply.github.com> Date: Tue Apr 8 00:16:53 2025 -0400 feature: OpeaStore Class (opea-project#1493) Signed-off-by: Anthony Mahanna <anthony.mahanna@arangodb.com> commit 13c0e4d Author: ZePan110 <ze.pan@intel.com> Date: Mon Apr 7 23:42:37 2025 +0800 Limit vllm and vllm-fork tags (opea-project#1529) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 9e5e9be Author: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Date: Fri Apr 4 11:19:23 2025 -0700 Update Gaudi Docker to v1.19.0 and PyTorch Installer 2.5.1 (opea-project#1513) Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Co-authored-by: chen, suyue <suyue.chen@intel.com> commit c787ce6 Author: Mustafa <109312699+MSCetin37@users.noreply.github.com> Date: Fri Apr 4 08:54:33 2025 -0700 Data Ingestion and Retrieval with custom index_name (opea-project#1439) * CodeGen initial Signed-off-by: Mustafa <mustafa.cetin@intel.com> * code update Signed-off-by: Mustafa <mustafa.cetin@intel.com> * code update Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * adding index_name variable Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update unit tests Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update the tests Signed-off-by: Mustafa <mustafa.cetin@intel.com> * code update & add ingest_with_index test Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update redis test Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update retrievers Signed-off-by: Mustafa <mustafa.cetin@intel.com> * update redis-delete_files Signed-off-by: Mustafa <mustafa.cetin@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Mustafa <mustafa.cetin@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> commit 52b9172 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Thu Apr 3 18:10:40 2025 -0700 Unset TEI_EMBEDDING_ENDPOINT when running multimodal redis retriever tests (opea-project#1515) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 80ef317 Author: jilongW <109333127+jilongW@users.noreply.github.com> Date: Thu Apr 3 20:13:39 2025 +0800 Add xtune to finetuning (opea-project#1432) Signed-off-by: jilongwa <jilong.wang@intel.com> commit a763c35 Author: Chun Tao <chun.tao@intel.com> Date: Thu Apr 3 00:30:35 2025 -0700 Add in entrypoint new download links for wav2lip and wav2lip_gan models, as old links were deprecated. (opea-project#1523) Signed-off-by: Chun Tao <chun.tao@intel.com> commit d133eee Author: chen, suyue <suyue.chen@intel.com> Date: Thu Apr 3 14:16:53 2025 +0800 remove concurrency in image build and push workflow (opea-project#1510) 1. Remove concurrency setting in image build and push workflow, cause the build scope is not the same for each push. 2. Fix a duplicate container name in agent test. Signed-off-by: chensuyue <suyue.chen@intel.com> commit 2a0ce2a Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Thu Apr 3 14:10:27 2025 +0800 minor fix gpt-sovits service names (opea-project#1521) commit cec2e1d Author: chen, suyue <suyue.chen@intel.com> Date: Thu Apr 3 09:41:08 2025 +0800 Fix CI workflow (opea-project#1518) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 11b1969 Author: Louie Tsai <louie.tsai@intel.com> Date: Wed Apr 2 16:28:02 2025 -0700 Enable Telemetry Tracing in Agent Comp and also add class name along with func name as span name for tracing (opea-project#1503) * Trace Agent functions and get class name for opea_telemtry tracing Signed-off-by: Louie, Tsai <louie.tsai@intel.com> Signed-off-by: Tsai, Louie <louie.tsai@intel.com> * seperate llm invoke into a standalone function for tracing Signed-off-by: Tsai, Louie <louie.tsai@intel.com> --------- Signed-off-by: Louie, Tsai <louie.tsai@intel.com> Signed-off-by: Tsai, Louie <louie.tsai@intel.com> commit a8f300f Author: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com> Date: Wed Apr 2 02:45:12 2025 -0700 VDMS langchain package update (opea-project#1317) * Update VDMS related components * Pinned protobuf==4.24.2 for vdms to avoid issues * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count * pin protobuf and downgrade opentelemetry to v1.27.0 in dataprep and retriever dockerfiles * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com> Co-authored-by: chen, suyue <suyue.chen@intel.com> commit 40d431a Author: Shifani Rajabose <shifani.rajabose@intel.com> Date: Wed Apr 2 03:55:22 2025 -0400 [Bug: 1379] Added Multimodal support for Milvus for retriever component (opea-project#1381) Added Multimodal support for Milvus for retriever component Fixes opea-project#1379 Co-authored-by: Jaini, Pallavi <pallavi.jaini@intel.com> Co-authored-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> Signed-off-by: pallavi.jaini <pallavi.jaini@intel.com> commit b2eee3a Author: Melanie Hart Buehler <melanie.h.buehler@intel.com> Date: Wed Apr 2 00:53:49 2025 -0700 MultimodalQnA audio features completion (opea-project#1433) Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com> commit 3c1cb20 Author: dolpher <dolpher.du@intel.com> Date: Wed Apr 2 13:39:44 2025 +0800 Fix model cache path and use Random to avoid ns conflict (opea-project#1500) Signed-off-by: Dolpher Du <dolpher.du@intel.com> commit 4a15795 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Wed Apr 2 13:06:21 2025 +0800 Integrate UI-TARS vLLM in lvm component (opea-project#1458) commit 1dddab0 Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Wed Apr 2 10:59:52 2025 +0800 Fix Dataprep ingest PPT and async issues (opea-project#1504) Signed-off-by: letonghan <letong.han@intel.com> commit 981faf5 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Apr 2 10:53:28 2025 +0800 add model cache for example test (opea-project#1509) Signed-off-by: chensuyue <suyue.chen@intel.com> commit c512141 Author: ZePan110 <ze.pan@intel.com> Date: Wed Apr 2 10:45:48 2025 +0800 Remove langchain-huggingface from requirement. (opea-project#1505) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 2b0cd08 Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Tue Apr 1 23:14:29 2025 +0800 unify service ports in compose and READMEs (opea-project#1506) Signed-off-by: letonghan <letong.han@intel.com> commit de882e5 Author: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> Date: Mon Mar 31 22:40:28 2025 -0700 Update nofile's hard limit to 262144 for opensearch (opea-project#1495) Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com> commit 380f95c Author: Eero Tamminen <eero.t.tamminen@intel.com> Date: Mon Mar 31 14:40:44 2025 +0300 Fix finetuning python regex syntax error (opea-project#1446) Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com> commit ea3374f Author: Trawinski, Dariusz <dariusz.trawinski@intel.com> Date: Mon Mar 31 13:12:33 2025 +0200 ignore false positive errors in reseting cache permissions (opea-project#1489) Signed-off-by: Dariusz Trawinski <Dariusz.Trawinski@intel.com> commit 411af51 Author: chen, suyue <suyue.chen@intel.com> Date: Mon Mar 31 11:56:46 2025 +0800 CICD update to adapt the new xeon test cluster (opea-project#1475) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 342c1ed Author: Siddhi Velankar <siddhi.velankar@intel.com> Date: Sat Mar 29 09:49:19 2025 -0500 Docker support for nebula (opea-project#1396) Signed-off-by: siddhivelankar23 <siddhi.velankar@intel.com> commit 7a26282 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Fri Mar 28 18:03:05 2025 +0800 Bump version of web search (opea-project#1451) commit 8533924 Author: chen, suyue <suyue.chen@intel.com> Date: Fri Mar 28 11:10:11 2025 +0800 add nginx src into example test trigger path (opea-project#1474) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 3c606ac Author: ZePan110 <ze.pan@intel.com> Date: Fri Mar 28 10:10:57 2025 +0800 Revert "Support parametrization of nginx port (opea-project#1456)" (opea-project#1473) This reverts commit d58d320. commit 1871dec Author: sri-intel <108247623+srinarayan-srikanthan@users.noreply.github.com> Date: Thu Mar 27 11:01:27 2025 -0400 remote endpoint support (opea-project#1399) Signed-off-by: Srinarayan Srikanthan <srinarayan.srikanthan@intel.com> commit ac38d87 Author: chen, suyue <suyue.chen@intel.com> Date: Thu Mar 27 22:55:07 2025 +0800 Enhance test env clean up (opea-project#1469) * Update test env clean up Signed-off-by: chensuyue <suyue.chen@intel.com> commit 772ef6e Author: XinyaoWa <xinyao.wang@intel.com> Date: Thu Mar 27 21:48:48 2025 +0800 Enlarge DocSum prompt buffer (opea-project#1471) Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> commit 4252121 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 14:06:22 2025 +0800 Use model cache for dataprep docker compose test. (opea-project#1450) Use model cache for dataprep docker compose test. Fix web_retrievers typo Signed-off-by: ZePan110 <ze.pan@intel.com> commit 0672112 Author: xiguiw <111278656+xiguiw@users.noreply.github.com> Date: Thu Mar 27 13:24:56 2025 +0800 Update TEI docker image to 1.6 (opea-project#1453) update TEI docker image to ghcr.io/huggingface/text-embeddings-inference:cpu-1.6 Signed-off-by: Wang, Xigui <xigui.wang@intel.com> commit 8ce0162 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:33:10 2025 +0800 Use model cache for third_parties docker compose test. (opea-project#1464) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 5d6ada9 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:32:46 2025 +0800 Use model cache for agent and guardrails docker compose test. (opea-project#1462) Signed-off-by: ZePan110 <ze.pan@intel.com> commit f34829a Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:32:29 2025 +0800 Use model cache for llms docker compose test. (opea-project#1463) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 8170dfb Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:07:35 2025 +0800 Use model cache for retrievers docker compose tests. (opea-project#1460) Use model cache for retrievers docker compose tests Signed-off-by: ZePan110 <ze.pan@intel.com> commit 3f3b006 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:06:59 2025 +0800 Use model cache for rerankings docker compose tests. (opea-project#1459) Use model cache for rerankings docker compose tests. Signed-off-by: ZePan110 <ze.pan@intel.com> commit 206de27 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 10:06:41 2025 +0800 Use model cache for web_retriever docker compose tests. (opea-project#1461) Use model cache for web_retriever docker compose tests Signed-off-by: ZePan110 <ze.pan@intel.com> commit d58d320 Author: ZePan110 <ze.pan@intel.com> Date: Thu Mar 27 09:40:42 2025 +0800 Support parametrization of nginx port (opea-project#1456) Signed-off-by: ZePan110 <ze.pan@intel.com> commit 78b94fc Author: Trawinski, Dariusz <dariusz.trawinski@intel.com> Date: Wed Mar 26 12:19:46 2025 +0100 text generation, embedding and reranking with ovms (opea-project#1318) Signed-off-by: Dariusz Trawinski <Dariusz.Trawinski@intel.com> commit d5cd3e4 Author: ZePan110 <ze.pan@intel.com> Date: Wed Mar 26 13:38:45 2025 +0800 Fix issue with orphaned containers in the Github runtime program for running tests. (opea-project#1454) Fix issue opea-project#1323 Signed-off-by: ZePan110 <ze.pan@intel.com> commit 11a061a Author: ZePan110 <ze.pan@intel.com> Date: Wed Mar 26 13:37:53 2025 +0800 Use model cache for embeddings docker compose test. (opea-project#1452) Use model cache for embeddings docker compose test. Signed-off-by: ZePan110 <ze.pan@intel.com> commit ed4acef Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Wed Mar 26 09:38:30 2025 +0800 Fix Retriever Async Issue (opea-project#1457) Signed-off-by: letonghan <letong.han@intel.com> commit d8bd6ee Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Wed Mar 26 09:38:12 2025 +0800 fix function name issue (opea-project#1426) Signed-off-by: letonghan <letong.han@intel.com> commit be4c04f Author: Louie Tsai <louie.tsai@intel.com> Date: Tue Mar 25 18:19:57 2025 -0700 Return Mega/Micro Service Version number at runtime (opea-project#912) Signed-off-by: Tsai, Louie <louie.tsai@intel.com> commit 3e559df Author: ZePan110 <ze.pan@intel.com> Date: Tue Mar 25 15:31:17 2025 +0800 Fix Deprecation warnings in logs service logs (opea-project#1444) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix issue Signed-off-by: ZePan110 <ze.pan@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Update requirements Signed-off-by: ZePan110 <ze.pan@intel.com> --------- Signed-off-by: ZePan110 <ze.pan@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit 616c00c Author: chen, suyue <suyue.chen@intel.com> Date: Tue Mar 25 11:52:05 2025 +0800 Update default model cache for new CI cluster (opea-project#1445) Signed-off-by: chensuyue <suyue.chen@intel.com> commit e73c22a Author: ZePan110 <ze.pan@intel.com> Date: Mon Mar 24 23:14:32 2025 +0800 Use model cache for text2sql docker compose test. (opea-project#1436) Signed-off-by: ZePan110 <ze.pan@intel.com> commit d8b491c Author: Eero Tamminen <eero.t.tamminen@intel.com> Date: Mon Mar 24 16:33:05 2025 +0200 Fix: make Orchestrator metrics singleton (opea-project#1301) Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com> commit eadfe2f Author: chen, suyue <suyue.chen@intel.com> Date: Mon Mar 24 15:41:35 2025 +0800 Fix default model cache adapt to the new test cluster (opea-project#1443) 1. Fix default model cache adapt to the new test cluster 2. Skip docker build container clean up for microservice test Signed-off-by: chensuyue <suyue.chen@intel.com> commit 8f9ec23 Author: chen, suyue <suyue.chen@intel.com> Date: Mon Mar 24 13:49:44 2025 +0800 Enhance docker clean up in CI (opea-project#1442) * enhance docker clean up * clean up invalid label Signed-off-by: chensuyue <suyue.chen@intel.com> commit 02a2cdd Author: XinyuYe-Intel <xinyu.ye@intel.com> Date: Mon Mar 24 13:40:58 2025 +0800 Added Mistral-Small-24B-Instruct-2501 and Mistral-Large-Instruct-2411 models support in text-gen (opea-project#1387) * added Mistral-Small-24B-Instruct-2501 and Mistral-Large-Instruct-2411 models in text-gen. Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit 559ebb2 Author: Eknath Baravkar <50608952+baravkareknath@users.noreply.github.com> Date: Sat Mar 22 19:28:03 2025 +0530 Refine the README for llms/doc-summarization (opea-project#1437) Signed-off-by: unknown <baravkareknath@gmail.com> commit c58fd39 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Fri Mar 21 18:51:31 2025 -0700 Fix curl commands in the LLaVA server README (opea-project#1427) Signed-off-by: dmsuehir <dina.s.jones@intel.com> commit 3bb51f7 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Fri Mar 21 18:21:21 2025 -0700 Fix failing data prep milvus multimodal tests that use the LVM (opea-project#1441) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 03ac6ed Author: minmin-intel <minmin.hou@intel.com> Date: Fri Mar 21 11:38:54 2025 -0700 Add redis-finance to dataprep (opea-project#1384) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * redis finance code Signed-off-by: minmin-intel <minmin.hou@intel.com> * add two new packages Signed-off-by: minmin-intel <minmin.hou@intel.com> * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * debug ci error Signed-off-by: minmin-intel <minmin.hou@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix errors Signed-off-by: minmin-intel <minmin.hou@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add readme and rename test script to run ci on gaudi Signed-off-by: minmin-intel <minmin.hou@intel.com> --------- Signed-off-by: minmin-intel <minmin.hou@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> commit c65ceb2 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Fri Mar 21 16:52:52 2025 +0800 Add LLaMA Vision OH optimization (opea-project#1296) * Add LLaMA Vision OH optimization - Add mllama OH optimization - Fix LVM README and fix steps - add UT - fix 422 request body issue from wrapper to dependency - add LOGFLAG - add healthcheck - Upgrade HPU driver version - Correct compose file mllama names commit 7044590 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Thu Mar 20 18:51:35 2025 -0700 Fix failing data prep redis multimodal tests that use the LVM (opea-project#1440) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 8493659 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 19 15:35:23 2025 +0800 Add third party into test matrix (opea-project#1430) Signed-off-by: chensuyue <suyue.chen@intel.com> commit ccef449 Author: Zhu Yongbo <yongbo.zhu@intel.com> Date: Wed Mar 19 13:52:17 2025 +0800 Fix Dockerfile.intel_gpu build issue (opea-project#1429) Signed-off-by: Zhu, Yongbo <yongbo.zhu@intel.com> commit 006bd91 Author: Shifani Rajabose <shifani.rajabose@intel.com> Date: Tue Mar 18 02:16:40 2025 -0400 [Bug: 1378] Added Multimodal support for Milvus for dataprep component (opea-project#1380) * [Bug: 1378] Added Multimodal support for Milvus for dataprep component Fixes opea-project#1378 Co-authored-by: Jaini, Pallavi <pallavi.jaini@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Rajabose, Shifani <shifani.rajabose@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> --------- Signed-off-by: Shifani Rajabose <srajabose@habana.ai> Signed-off-by: pallavi.jaini <pallavi.jaini@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: pallavi.jaini <pallavi.jaini@intel.com> commit 831c5a3 Author: Spycsh <39623753+Spycsh@users.noreply.github.com> Date: Mon Mar 17 13:33:38 2025 +0800 vLLM lvm integration (opea-project#1362) * vLLM lvm integration - integrate vLLM LVMs and set vLLM as default - use OpenAI chat completions and cover single-image/text-only cases commit 558a2f6 Author: minmin-intel <minmin.hou@intel.com> Date: Fri Mar 14 19:25:20 2025 -0700 enable custom prompt for react_llama and react_langgraph (opea-project#1391) Signed-off-by: minmin-intel <minmin.hou@intel.com> commit 3ebab3c Author: Sun, Xuehao <xuehao.sun@intel.com> Date: Fri Mar 14 17:55:56 2025 +0800 Add GitHub Action to check and close stale issues and PRs (opea-project#1394) Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com> commit b2b7908 Author: Louie Tsai <louie.tsai@intel.com> Date: Fri Mar 14 00:26:45 2025 -0700 [Telemetry] use existed env variable instead of introducing new one (opea-project#1251) * try to leverage existed env variable instead of introducing new one Signed-off-by: Tsai, Louie <louie.tsai@intel.com> * remove ENABLE_OPEA_TELEMETRY getenv Signed-off-by: Tsai, Louie <louie.tsai@intel.com> --------- Signed-off-by: Tsai, Louie <louie.tsai@intel.com> commit 986c138 Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Fri Mar 14 10:36:18 2025 +0800 Fix dependency issue in Retriever (opea-project#1393) Add aiofiles in requirements.txt of retriever, which is caused by cross-component function call of retriever neo4j. Signed-off-by: letonghan <letong.han@intel.com> commit e8994da Author: Jonathan Minkin <minkinj@amazon.com> Date: Thu Mar 13 03:35:06 2025 -0700 Fix file list and index drop for opensearch (opea-project#1322) Signed-off-by: Jonathan Minkin <minkinj@amazon.com> commit d47127e Author: Letong Han <106566639+letonghan@users.noreply.github.com> Date: Thu Mar 13 15:25:07 2025 +0800 Refine Dataprep Redis with Async Issue (opea-project#1390) Signed-off-by: letonghan <letong.han@intel.com> commit b1d01a2 Author: Lianhao Lu <lianhao.lu@intel.com> Date: Wed Mar 12 16:04:02 2025 +0800 bridgetower/clip: add missing dependency for aiohttp (opea-project#1371) Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> commit 492f028 Author: Shifani Rajabose <shifani.rajabose@intel.com> Date: Wed Mar 12 03:04:07 2025 -0400 [Bug: 1375] Fix Readme errors in dataprep component for all VectorDBs (opea-project#1377) * [Bug: 1375] Fix Readme errors in dataprep component for all VectorDBs Fixes opea-project#1375 Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Jaini, Pallavi <pallavi.jaini@intel.com> Signed-off-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * Improve dataprep CI and fix pptx file ingesting bug (opea-project#1334) - Fix permission issue for when ingesting pptx file with embedded image - Add more test coverage to the dataprep CI and unify common dataprep CI test code for DB backends: qdrant, milvus, redis, pgvector Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * Fix docker compose command in embedding BridgeTower readme (opea-project#1374) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * Changes to checkin text2graph microservice (opea-project#1357) Signed-off-by: Raghava, Sharath <sharath.raghava@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> * [Bug: 1375] Fix Readme errors in dataprep component for all VectorDBs Fixes opea-project#1375 Signed-off-by: Piroozan, Nariman <nariman.piroozan@intel.com> Signed-off-by: Ghosh, Soumyadip <soumyadip.ghosh@intel.com> Signed-off-by: Jaini, Pallavi <pallavi.jaini@intel.com> Signed-off-by: Kavulya, Soila <soila.kavulya@intel.com> Signed-off-by: Shifani Rajabose <srajabose@habana.ai> --------- Signed-off-by: Shifani Rajabose <srajabose@habana.ai> Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> Signed-off-by: Raghava, Sharath <sharath.raghava@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Lianhao Lu <lianhao.lu@intel.com> Co-authored-by: Dina Suehiro Jones <dina.s.jones@intel.com> Co-authored-by: intelsharath <116231490+intelsharath@users.noreply.github.com> Co-authored-by: Liang Lv <liang1.lv@intel.com> commit 8c6f2b1 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 12 14:25:30 2025 +0800 Use the latest HabanaAI/vllm-fork release tag to build vllm-gaudi image (opea-project#1376) opea-project/GenAIExamples#1436 --------- Signed-off-by: chensuyue <suyue.chen@intel.com> commit f714d33 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 12 11:09:17 2025 +0800 Filter none test scripts in test matrix (opea-project#1386) * filter none test scripts in test matrix Signed-off-by: chensuyue <suyue.chen@intel.com> commit b93189d Author: chyundunovDatamonsters <c.yundunov@datamonsters.com> Date: Wed Mar 12 09:42:10 2025 +0700 Add Dockerfile for build ROCm vLLM Docker image (opea-project#1372) * Add Dockerfile for build ROCm vLLM Docker image Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com> commit e231574 Author: Jean Yu <jean1.yu@intel.com> Date: Sun Mar 9 22:46:10 2025 -0500 add text2cypher component (opea-project#1319) Signed-off-by: jeanyu-habana <jean1.yu@intel.com> commit 838d16d Author: intelsharath <116231490+intelsharath@users.noreply.github.com> Date: Thu Mar 6 23:29:45 2025 -0800 Changes to checkin text2graph microservice (opea-project#1357) Signed-off-by: Raghava, Sharath <sharath.raghava@intel.com> commit 60c20b5 Author: Dina Suehiro Jones <dina.s.jones@intel.com> Date: Thu Mar 6 19:49:02 2025 -0800 Fix docker compose command in embedding BridgeTower readme (opea-project#1374) Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com> commit 24f5021 Author: Lianhao Lu <lianhao.lu@intel.com> Date: Fri Mar 7 10:13:21 2025 +0800 Improve dataprep CI and fix pptx file ingesting bug (opea-project#1334) - Fix permission issue for when ingesting pptx file with embedded image - Add more test coverage to the dataprep CI and unify common dataprep CI test code for DB backends: qdrant, milvus, redis, pgvector Signed-off-by: Lianhao Lu <lianhao.lu@intel.com> commit cbb8a82 Author: chen, suyue <suyue.chen@intel.com> Date: Wed Mar 5 11:47:56 2025 +0800 update image push machine (opea-project#1361) Signed-off-by: chensuyue <suyue.chen@intel.com> commit 1064b2b Author: Eero Tamminen <eero.t.tamminen@intel.com> Date: Tue Mar 4 14:15:12 2025 +0200 Megaservice / orchestrator metric testing + fixes (opea-project#1348) Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com> commit 50d2e8c Author: XinyaoWa <xinyao.wang@intel.com> Date: Tue Mar 4 13:44:59 2025 +0800 Add timeout param for DocSum and FaqGen to deal with long context (opea-project#1329) * Add timeout param for DocSum and FaqGen to deal with long context Make timeout param configurable, solve issue opea-project/GenAIExamples#1481 Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Update VDMS related components * Pinned protobuf==4.24.2 for vdms to avoid issues * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count * pin protobuf and downgrade opentelemetry to v1.27.0 in dataprep and retriever dockerfiles * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com> Co-authored-by: chen, suyue <suyue.chen@intel.com> Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
* Update VDMS related components * Pinned protobuf==4.24.2 for vdms to avoid issues * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count * pin protobuf and downgrade opentelemetry to v1.27.0 in dataprep and retriever dockerfiles * Move opentelemetry installation to requirements file like others, unset proxy in opensearch tests. Opensearch tests pass locally with setting vm.max_map_count Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com> Co-authored-by: chen, suyue <suyue.chen@intel.com>
Description
VDMS integration in LangChain recently updated. This PR adds the necessary changes prior to previous version being deprecated. The retriever for vdms multimodal data is already failing due to file removals while generalizing framework and this should fix it.
Issues
n/a
Type of change
Dependencies
langchain-vdms
Tests
Ran provided tests without any errors: