feat: Qdrant as a supported knowledge base

[Anush008]

Description

This PR adds support for Qdrant to be used as a knowledge base.

Type of Change

• New feature (non-breaking change which adds functionality)
• This change requires a documentation update

Test Plan

Tests have been added to tests/system/qdrant for the sync and async implementations and are configured to run using both, an in-memory Qdrant instance and Qdrant server(if running at port 6333, skipped otherwise).

Note

The qdrant_client dependency can be gated behind an extra if needed and CLI support can be added subsequently.

[igiloh-pinecone]

Thank you @Anush008 for the great contribution!!
We are still in the process of reviewing this PR, will publish the review in the coming days.

[Anush008]

Thanks @igiloh-pinecone.

[ChristopherDosin]

We are still in the process of reviewing this PR, will publish the review in the coming days.

Any news on that a month later? :)

[igiloh-pinecone]

We are still in the process of reviewing this PR, will publish the review in the coming days.

Any news on that a month later? :)

Hi @ChristopherDosin,
As I mentioned before, we are considering an internal refactor of the KnowledgeBase class, that could affect the approach taken in this PR. But since this is still in internal discussions and design process, we shouldn't delay merging this PR any longer.
I'll publish a review of the current standing PR in the coming day or two.
Thank you for you patience! 🙏

[ChristopherDosin]

We are still in the process of reviewing this PR, will publish the review in the coming days.

Any news on that a month later? :)

Hi @ChristopherDosin, As I mentioned before, we are considering an internal refactor of the KnowledgeBase class, that could affect the approach taken in this PR. But since this is still in internal discussions and design process, we shouldn't delay merging this PR any longer. I'll publish a review of the current standing PR in the coming day or two. Thank you for you patience! 🙏

Awesome, thank you my friend - Just wondering which one performs better :)

[igiloh-pinecone]

@Anush008 thank you very much for your contribution!!

Apologies for the delayed review.
Please see a few comments. Namely, please try to re-use as much test_ code as possible instead of duplicating it. This will make future changes to KnowledgeBase much more maintainable.

[igiloh-pinecone]

LGTM!

Thank you @Anush008 for this effort

[brightsparc]

Looking forward to having this land. Anything holding this up?

[igiloh-pinecone]

Looking forward to having this land. Anything holding this up?

As far as I recall some system test failed in the merge queue 🤔 .
Trying to re-merge this now, let's see.

[Anush008]

@igiloh-pinecone, I've updated the branch. Could you try now please?

[Anush008]

The flaky CI failures seem to arise from unrelated files.

UPDATE: This should be resolved with #327.

[brightsparc]

Nice. When is the next release likely to get cut?

[izellevy]

We have a new release: https://github.com/pinecone-io/canopy/releases/tag/v0.9.0