Skip to content

Update command and setting embedding caches to use metis #268074

@mjbvz

Description

@mjbvz

The command and setting embedding indexes currently use text3small. We should be good to switch these over the use metis embeddings, which has better quality and a smaller size

This involves:

  • Update our remote embedding caches for these to also publish metis embeddings
  • Switch our code in copilot chat over to use metis. This should be as simple as replacing EmbeddingType.text3small_512 with EmbeddingType.metis_1024_I16_Binaryonce the ICombinedEmbeddingIndex has been updated to support metis

Metadata

Metadata

Labels

debtCode quality issuesfeature-requestRequest for new features or functionality

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions