[Feature]: support new type, StructArray

[SpadeA-Tang]

Is there an existing issue for this?

• I have searched the existing issues

Is your feature request related to a problem? Please describe.

The StructArray type represents an array of structs. Each struct adheres to a schema that defines its fields, similar to a collection schema. These fields can be of vector or scalar types; however, nested array types within a struct are not supported. Essentially, a StructArray provides a logical grouping of some related data fields.

Therefore, this structure facilitates building indexes on arrays of vectors and subsequently querying them. Furthermore, it enables support for more advanced filter expressions, including nested queries.

Development Tasks

• Struct Schema
  • protobuf change: StructArray: schema support milvus-proto#448
  • protobuf change: StructArray: extend types for embedding list search in placeholder milvus-proto#461
• Implementation
  • feat: sdk for struct pymilvus#2978
  • feat: impl StructArray -- data storage support in segcore #42406
  • feat: impl StructArray -- create schema, insert, and retrieve data #42855
  • feat: impl StructArray -- support create index for vector array (embedding list) and search on it #43726
  • feat: impl StructArray -- miscellaneous staffs for struct array #43960
  • feat: impl StructArray -- optimize vector array serialization #44035
  • feat: impl StructArray -- reject json types for struct #44190
  • feat: impl StructArray -- support import for CSV/JSON/PARQUET/BINLOG #44201
  • feat: impl StructArray -- support same names in different STRUCT #44557
  • feat: impl StructArray -- support more types of vector in STRUCT #44736
  • feat: impl StructArray -- support embedding searches embeddings in embedding list with element level filter expression #45830
  • feat: support match operator family #46518
  • feat: impl StructArray -- support creating index for scalar fields #46599
  • feat: impl StructArray -- support creating index sort stl #47053
  • feat: impl StructArray -- support ARRAY_CONTAINS* #47172
  • feat: impl StructArray -- support group by for element-level search #47252

[SpadeA-Tang]

/unassign xiaofan-luan

[SpadeA-Tang]

/assign SpadeA-Tang