Repository navigation
Python: add Milvus vector store (agent-framework-milvus) - #9346
Open
Nantha kumar (Nanduu24) wants to merge 8 commits into
Open
Nantha kumar (Nanduu24) wants to merge 8 commits into
Nantha kumar (Nanduu24) wants to merge 8 commits into
Conversation
Adds a new agent-framework-milvus package providing MilvusStore, MilvusCollection and MilvusSettings on the BaseVectorStore / BaseVectorCollection interfaces, so Milvus is available as a vector store alongside the Postgres, Qdrant, Redis, MongoDB and other connectors. - The data model definition drives the collection schema: the key field becomes the primary key (INT64/VARCHAR), data fields become typed scalar fields, and vector fields become FLOAT_VECTOR fields, each with an index. - Distance functions map to Milvus metrics (COSINE/IP/L2) and index kinds to Milvus index types (HNSW/FLAT/IVF_FLAT/DISKANN/AUTOINDEX). - Portable filters (eq, ne, gt, gte, lt, lte, between, in, not_in and and/or/not groups) are translated to Milvus boolean expressions; connector-side score thresholds respect each metric's comparison direction. - Upsert, get (by key or filter), delete, vector search and collection lifecycle, with the sync MilvusClient wrapped in asyncio.to_thread. - README, a runnable sample, and unit tests (filters, settings, collection) plus integration tests gated behind MILVUS_TEST_URI. Registered in the workspace.
Nantha kumar (Nanduu24)
requested review from
SergeyMenshykh,
Tao Chen (TaoChenOSU),
Eduard van Valkenburg (eavanvalkenburg),
Giles Odigwe (giles17),
Jose Alvarez (jpalvarezl),
Evan Mattson (moonbox3),
Roger Barreto (rogerbarreto),
sophia-ramsey and
westey (westey-m)
as code owners
October 13, 2026 15:02
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 13, 2026 15:03 — with 
GitHub Actions
Active
GitHub Actions
Active
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 13, 2026 15:03 — with
GitHub Actions
Active
GitHub Actions
Active
4 tasks done
agent-framework-automation
Bot
added
documentation
Contributor
There was a problem hiding this comment.
🟡 Changes recommended
Connector correctness, package registration, CI coverage, integration testing, and documentation issues remain unresolved.
9 open findings
What changed in this PR
Adds a first-party Milvus vector-store connector implementing Agent Framework’s collection, store, filtering, lifecycle, and vector-search abstractions.
Changes:
- Adds Milvus schema, CRUD, filtering, search, settings, and client ownership support.
- Adds package documentation, samples, and unit-test scaffolding.
- Registers and locks the new workspace package and dependencies.
| File | Description |
|---|---|
python/uv.lock |
Locks Milvus and transitive dependencies. |
python/pyproject.toml |
Registers the workspace source. |
python/packages/milvus/tests/milvus/test_settings.py |
Tests settings resolution. |
python/packages/milvus/tests/milvus/test_filters.py |
Tests filter translation. |
python/packages/milvus/tests/milvus/test_collection.py |
Tests collection behavior. |
python/packages/milvus/tests/milvus/conftest.py |
Defines test fixtures. |
python/packages/milvus/samples/README.md |
Documents the sample. |
python/packages/milvus/samples/milvus_vectors.py |
Demonstrates Milvus usage. |
python/packages/milvus/README.md |
Documents installation and APIs. |
python/packages/milvus/pyproject.toml |
Defines package metadata and tasks. |
python/packages/milvus/LICENSE |
Adds the MIT license. |
python/packages/milvus/agent_framework_milvus/py.typed |
Marks typed-package support. |
python/packages/milvus/agent_framework_milvus/_vector_store.py |
Implements the connector. |
python/packages/milvus/agent_framework_milvus/__init__.py |
Exports public APIs. |
🧠 Review effort: Balanced
💡 Add a code-review agent skill for context-aware, tailored reviews. Learn more in the docs.
- ensure_collection_exists: handle concurrent creation (treat an already-created collection as success instead of failing the ensure operation). - Filter string literals are serialized with json.dumps so quotes, backslashes and control characters cannot break out of the Milvus expression. - Reject is_indexed / is_full_text_indexed on data fields until scalar/full-text index creation is implemented, rather than silently ignoring them. - Validate score_threshold as a finite, non-boolean number before searching. - Qualify the Milvus Lite (local .db) docs: it requires the pymilvus[milvus_lite] extra; fix the README usage snippet (sequence upsert, generate_vectors, subscript SearchResponse fields). - Add live integration tests exercising server_collection (CRUD, search, filters), selected by -m integration. - Add a Milvus PR unit-test job and path filter so regressions are caught on PRs. - Register the package in PACKAGE_STATUS.md (alpha / no).
Nantha kumar (Nanduu24)
requested review from
Vincent Biret (baywet) and
Peter Ibekwe (peibekwe)
as code owners
October 13, 2026 17:53
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 13, 2026 17:54 — with
GitHub Actions
Active
GitHub Actions
Active
|
Great! Thx |
Member
|
/review |
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
MAF Automated Review — Iteration 1
Result: Findings reported
Scope: full PR (2 commit(s)): d121cfe0e10a, 73796abec852
Model: gpt-5.6-sol
Overview
The review found 2 verified inline finding(s).
Reviewed the supplied pull-request change set across correctness, security/reliability, architecture, and failure behavior.
2 verified findings remained after source verification (2 medium) across 1 file. Details are attached to the affected lines below.
Affected areas: python/packages/milvus/agent_framework_milvus/_vector_store.py
Addresses review feedback on microsoft#9346: - ensure_collection_exists now validates an existing collection's fields, vector dimensions and metric types against the data model definition (and does the same after an already-exists race) instead of accepting a stale or unrelated schema. - Portable filter operands are validated against the declared field type: a boolean operand on a numeric field (or any type mismatch) is rejected with a clear error rather than emitting an invalid comparison such as 'price == true'; ordered comparisons require a numeric field. - Added unit tests for schema mismatch (dimension, metric) and operand-type rejection.
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 14, 2026 11:20 — with
GitHub Actions
Active
GitHub Actions
Active
…on_exists Per review on microsoft#9346: create_collection builds the collection and then separately creates indexes and loads it. Treating any exception as success when the collection exists afterwards could mask an index or load failure, leaving an unindexed/unloaded collection. Now only a genuine already-exists/concurrent-create MilvusException is swallowed (then the existing collection is validated); all other create/index/load failures are re-raised. Added tests for the index/load-failure and non-Milvus cases.
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 14, 2026 11:26 — with
GitHub Actions
Active
GitHub Actions
Active
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 14, 2026 11:27 — with
GitHub Actions
Active
GitHub Actions
Active
| ) | ||
| resolved_token = settings.get("token") | ||
| resolved_password = settings.get("password") | ||
| client_kwargs: dict[str, Any] = {"uri": settings.get("uri") or DEFAULT_URI} |
There was a problem hiding this comment.
Suggested change
| client_kwargs: dict[str, Any] = {"uri": settings.get("uri") or DEFAULT_URI} | |
| client_kwargs: dict[str, Any] = {"uri": settings.get("uri", DEFAULT_URI)} |
There was a problem hiding this comment.
Kept settings.get("uri") or DEFAULT_URI: load_settings includes optional keys as None when unset, so settings.get("uri", DEFAULT_URI) would return None rather than the default (verified). Happy to change if you'd prefer a different shape.
Comment on lines
+251
to
+254
| if client is not None and any( | ||
| value is not None for value in (uri, token, user, password, db_name, env_file_path, env_file_encoding) | ||
| ): | ||
| raise ValueError("Pass client or connection settings, not both.") |
There was a problem hiding this comment.
this should be handled after parsing the settings, some or all of this might come from the environment
There was a problem hiding this comment.
This mirrors the Qdrant connector's guard and intentionally inspects only the explicit constructor args — env-sourced settings are ambient and aren't treated as 'passed'. Happy to drop the guard (and let an explicit client win) if you'd prefer; let me know.
Addresses review feedback on microsoft#9346: - Switch from the sync MilvusClient wrapped in asyncio.to_thread to the native AsyncMilvusClient, awaiting operations directly. - Let the native Milvus client-creation error propagate instead of wrapping it. - Replace the brittle already-exists message match: on a create failure, validate the existing collection and re-raise the original error if it does not match, so only a genuine concurrent-create with a complete, matching collection is accepted. - Tests use MILVUS_URI (not a separate MILVUS_TEST_URI) to gate integration tests; the env-clearing fixture is skipped for integration tests. - Require pymilvus>=2.5.3 (AsyncMilvusClient).
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 14, 2026 16:08 — with
GitHub Actions
Active
GitHub Actions
Active
Verified pymilvus 2.5.3+ and its dependencies (grpcio, numpy, …) resolve, install and import on Python 3.15, matching the framework's new 3.15 support.
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 14, 2026 17:20 — with
GitHub Actions
Active
GitHub Actions
Active
Nantha kumar (Nanduu24)
deployed
to
github-app-auth
October 15, 2026 16:39 — with
GitHub Actions
Active
GitHub Actions
Active
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a new
agent-framework-milvuspackage providing a Milvus vector store for Agent Framework, implementing theBaseVectorStore/BaseVectorCollection/BaseVectorSearchinterfaces. This makes Milvus — one of the most widely used open-source vector databases — available out of the box alongside the existing Postgres, Qdrant, Redis, MongoDB, SQL Server and other vector-store packages.It follows the structure of the existing
agent-framework-qdrantpackage (settings viaload_settings, a store that mints collection clients, borrowed-vs-managed client ownership,operation_optionsvalidation, native filtering).What's included
MilvusStore/MilvusCollection/MilvusSettings(+py.typed).INT64forintkeys,VARCHARotherwise), data fields become typed scalar fields, and vector fields becomeFLOAT_VECTORfields, each with its own index.DistanceFunction→ Milvus metric types (cosine_similarity/cosine_distance→COSINE,dot_prod→IP,euclidean_distance/euclidean_squared_distance→L2);IndexKind→ Milvus index types (hnsw,flat,ivf_flat,disk_ann,default→AUTOINDEX).ensure_collection_exists/collection_exists/ensure_collection_deleted,upsert,get(by key or portable filter),delete, and vectorsearch.eq,ne,gt,gte,lt,lte,between,in,not_in, andand/or/notgroups. Operators that Milvus can't implement with correct null/collection semantics raiseNotImplementedErrorrather than silently returning wrong results.score_thresholdthat respects each metric's comparison direction (larger-is-closer forCOSINE/IP, smaller-is-closer forL2), since core does not post-filter.MilvusClientis wrapped inasyncio.to_thread, which keeps the connector compatible across the supportedpymilvusrange while presenting the framework's async interface.samples/milvus_vectors.py), and the package registered in the workspace[tool.uv.sources].Testing
tests/milvus/): filter translation, settings resolution/precedence, and collection behavior (upsert/get/delete/search, schema building, serialization, lifecycle, client ownership) — hermetic, no live service.MILVUS_TEST_URIfor a real server.ruff check,ruff format --check, and Pyright (strict) are clean on the package;uv lock --lockedsucceeds.Motivation
Milvus is a top-tier open-source vector database with no first-party Agent Framework integration, and no existing PR or issue was addressing it. This fills that gap with a connector that matches the conventions of the other vector-store packages.