Skip to content

Add new DocIndexRetriever example#405

Merged
kevinintel merged 12 commits intoopea-project:mainfrom
xuechendi:DocIndexRetriever
Aug 21, 2024
Merged

Add new DocIndexRetriever example#405
kevinintel merged 12 commits intoopea-project:mainfrom
xuechendi:DocIndexRetriever

Conversation

@xuechendi
Copy link
Copy Markdown
Collaborator

@xuechendi xuechendi commented Jul 16, 2024

Description

Add a new example for only add data to vector store and retrieve from vector store

related AIComps change:
opea-project/GenAIComps#314

Issues

n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)

Dependencies

No

Tests

No

@xuechendi
Copy link
Copy Markdown
Collaborator Author

@minmin-intel @ftian1 @lvliang-intel , please take a look

@xuechendi xuechendi force-pushed the DocIndexRetriever branch from ee907e6 to efa8275 Compare July 16, 2024 20:02
@xuechendi xuechendi force-pushed the DocIndexRetriever branch 5 times, most recently from eb91097 to 9f73f29 Compare July 16, 2024 21:30
Signed-off-by: Chendi.Xue <[email protected]>
@xuechendi xuechendi force-pushed the DocIndexRetriever branch from 9f73f29 to 484a033 Compare July 16, 2024 21:36
Copy link
Copy Markdown
Collaborator

@minmin-intel minmin-intel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

Copy link
Copy Markdown
Contributor

@hshen14 hshen14 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xuechendi It seems the new GenAI example could be part of ChatQnA (RAG). Does it make sense to improve ChatQnA to add this example?

@xuechendi
Copy link
Copy Markdown
Collaborator Author

@xuechendi It seems the new GenAI example could be part of ChatQnA (RAG). Does it make sense to improve ChatQnA to add this example?

@hshen14 , thanks for the review.
The reason we extract RAG from ChatQnA is that we will not need LLM inference part. And we are planning to call this RAG megaservice by Agent.

If we use ChatQnA directly, we will need to provide different Spec from ChatQnA with different chatQnA megaflow to only enable RAG part.

Either way is working for me, but I felt adding a new example is clearer. Also, we can support more than one optional vectorstore backend in RAG megaservice for different scenarios.

@xuechendi xuechendi mentioned this pull request Jul 17, 2024
3 tasks
@hshen14
Copy link
Copy Markdown
Contributor

hshen14 commented Jul 25, 2024

@xuechendi It seems the new GenAI example could be part of ChatQnA (RAG). Does it make sense to improve ChatQnA to add this example?

@hshen14 , thanks for the review. The reason we extract RAG from ChatQnA is that we will not need LLM inference part. And we are planning to call this RAG megaservice by Agent.

If we use ChatQnA directly, we will need to provide different Spec from ChatQnA with different chatQnA megaflow to only enable RAG part.

Either way is working for me, but I felt adding a new example is clearer. Also, we can support more than one optional vectorstore backend in RAG megaservice for different scenarios.

We are now having Agent example. Since it's designed to be used by Agent, how about moving under Agent?

@chensuyue chensuyue modified the milestones: v0.8, v0.9 Jul 25, 2024
@xuechendi xuechendi linked an issue Aug 15, 2024 that may be closed by this pull request
Signed-off-by: Chendi.Xue <[email protected]>
@xuechendi
Copy link
Copy Markdown
Collaborator Author

@kevinintel , can you help to '@' the right person who should review/approve this PR.
So we can provide it to RagAgent and InsightAgent who will treat DocRetriever as Tool.

@kevinintel kevinintel merged commit 566cf93 into opea-project:main Aug 21, 2024
dmsuehir pushed a commit to dmsuehir/GenAIExamples that referenced this pull request Sep 11, 2024
* Add DocIndexRetriever example

Signed-off-by: Chendi.Xue <[email protected]>


---------

Signed-off-by: Chendi.Xue <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: XuhuiRen <[email protected]>
wangkl2 pushed a commit to wangkl2/GenAIExamples that referenced this pull request Dec 11, 2024
JakubLedworowski pushed a commit to JakubLedworowski/GenAIExamples that referenced this pull request Jan 28, 2025
User can set evenly_distributed true to have the pods distribute evenly.

Signed-off-by: Dolpher Du <[email protected]>
cogniware-devops pushed a commit to Cogniware-Inc/GenAIExamples that referenced this pull request Dec 19, 2025
* Add DocIndexRetriever example

Signed-off-by: Chendi.Xue <[email protected]>

---------

Signed-off-by: Chendi.Xue <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: XuhuiRen <[email protected]>
Signed-off-by: cogniware-devops <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

IndexRetriever Example

6 participants