Skip to content

feat(search): support distributed batch vector queries - #5263

Open
ddupg wants to merge 1 commit into
lance-format:mainfrom
ddupg:feat/ddu-324-batch-vector-search
Open

feat(search): support distributed batch vector queries#5263
ddupg wants to merge 1 commit into
lance-format:mainfrom
ddupg:feat/ddu-324-batch-vector-search

Conversation

@ddupg

@ddupg ddupg commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Summary

  • support fixed-size vector query batches with per-query global top-k across indexed and flat-fallback fragments
  • preserve Lance projection and distance semantics across partial index coverage, including index metric inheritance, bit-level Hamming distance, distance ranges, and requested row IDs
  • document the batch result contract and cover IVF_FLAT, IVF_SQ, IVF_PQ, partial-index, flat-fallback, and multivector boundaries

Testing

  • pytest tests/test_distributed_search.py (37 passed)
  • pytest tests/test_distributed_indexing.py::test_build_distributed_vector_index (3 passed)
  • ruff format --check lance_ray/search.py tests/test_distributed_search.py tests/test_distributed_indexing.py
  • ruff check lance_ray/search.py tests/test_distributed_search.py tests/test_distributed_indexing.py
  • git diff --check

@github-actions github-actions Bot added the enhancement New feature or request label Jul 29, 2026
@ddupg
ddupg force-pushed the feat/ddu-324-batch-vector-search branch from a67abfd to d41faa1 Compare July 29, 2026 05:33
@ddupg
ddupg marked this pull request as ready for review July 29, 2026 08:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant