Skip to content

Introduce mode and compression param resolution#2034

Merged
navneet1v merged 2 commits intoopensearch-project:mainfrom
jmazanec15:mode-resolution-v2
Sep 5, 2024
Merged

Introduce mode and compression param resolution#2034
navneet1v merged 2 commits intoopensearch-project:mainfrom
jmazanec15:mode-resolution-v2

Conversation

@jmazanec15
Copy link
Member

@jmazanec15 jmazanec15 commented Sep 4, 2024

Description

Adds mode and compression based parameter resolution. With this, if a user specifies the mode and/or compression params, we will create a default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the parameters. This will be taken in a future commit.

Still working on tests, but figured it would be good to get the PR out. Heres what I still need to do:

  • Resolve test failures
  • Block mode/compression on non-float data types
  • Add test coverage

Related Issues

#1949

Check List

  • Commits are signed per the DCO using --signoff.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@navneet1v
Copy link
Collaborator

Code looks good to me. Waiting for CI to be successful

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>
@jmazanec15 jmazanec15 force-pushed the mode-resolution-v2 branch 7 times, most recently from 6fec016 to 2f9abde Compare September 5, 2024 04:08
Signed-off-by: John Mazanec <jmazane@amazon.com>
super.tearDown();
}

@Ignore
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ignoring - there is some broken functionality around the quantization state that is being fixed.

@navneet1v navneet1v merged commit ef4922a into opensearch-project:main Sep 5, 2024
opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 5, 2024
* Introduce mode and compression param resolution

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>

* Modify reader changes

Signed-off-by: John Mazanec <jmazane@amazon.com>

---------

Signed-off-by: John Mazanec <jmazane@amazon.com>
(cherry picked from commit ef4922a)
opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 5, 2024
* Introduce mode and compression param resolution

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>

* Modify reader changes

Signed-off-by: John Mazanec <jmazane@amazon.com>

---------

Signed-off-by: John Mazanec <jmazane@amazon.com>
(cherry picked from commit ef4922a)
akashsha1 pushed a commit to akashsha1/k-NN that referenced this pull request Sep 16, 2024
)

* Introduce mode and compression param resolution

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>

* Modify reader changes

Signed-off-by: John Mazanec <jmazane@amazon.com>

---------

Signed-off-by: John Mazanec <jmazane@amazon.com>
Signed-off-by: Akash Shankaran <akash.shankaran@intel.com>
jingqimao77-spec pushed a commit to jingqimao77-spec/k-NN that referenced this pull request Mar 15, 2026
)

* Introduce mode and compression param resolution

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>

* Modify reader changes

Signed-off-by: John Mazanec <jmazane@amazon.com>

---------

Signed-off-by: John Mazanec <jmazane@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants