Use Milvus storage

The milvus backend stores knowledge-chunk embeddings in a Milvus collection. It can connect to Milvus or Zilliz Cloud, or use a local Milvus Lite file. This backend is available in VeADK 1.0.3 and later.

Dependencies

pip install "veadk-python[extensions]"

Use Milvus Lite

For local validation, point DATABASE_MILVUS_URI to a Milvus Lite data file and configure an embedding model:

mkdir -p data
export DATABASE_MILVUS_URI="./data/product_docs.db"
export MODEL_EMBEDDING_API_KEY="your-ark-api-key"

The first run creates the data file. Later runs can retrieve existing content by using the same file and collection name.

Example

Before running, configure MODEL_EMBEDDING_NAME, MODEL_EMBEDDING_DIM, MODEL_EMBEDDING_API_BASE, and MODEL_EMBEDDING_API_KEY. The extensions extra includes llama-index, embedding adapters, and vector-store connectors. Text is sent to the configured embedding service. For BytePlus or another provider, explicitly set the matching endpoint, model, and credentials; the default Ark endpoint does not automatically switch For remote use, provide reachable Milvus, an existing database, and credentials. Milvus Lite requires a supported platform and writable directory

import os

from veadk import Agent
from veadk.knowledgebase import KnowledgeBase

kb = KnowledgeBase(
    backend="milvus",
    index="product_docs",
    backend_config={
        "index": "product_docs",
        "milvus_config": {
            "uri": "https://milvus.example.com",
            "token": os.environ["DATABASE_MILVUS_TOKEN"],
            "db_name": "default",
        },
    },
)
assert kb.add_from_text("Annual leave is 15 days per year")
for entry in kb.search("annual leave"):
    print(entry.content)

agent = Agent(knowledgebase=kb)

Parameters

KnowledgeBase parameters

Parameter	Type	Default	Description
`backend`	`str \| BaseKnowledgebaseBackend`	`"local"`	Set to `milvus` or pass a backend instance
`backend_config`	`dict`	`{}`	Must include index when nonempty; does not merge the outer index
`index`	`str`	`""`	Index name; falls back to app_name when no configuration dictionary is supplied
`app_name`	`str`	`""`	Fallback for index; not a user authorization filter
`top_k`	`int`	`10`	Default result count; search(top_k=0) uses this value
`name`	`str`	`"user_knowledgebase"`	Knowledge-base name shown to the agent
`description`	`str`	`"This knowledgebase stores some user-related information."`	Explains the knowledge base to the agent
`enable_profile`	`bool`	`False`	Enables document profiles; generate profile files first, or leave disabled for ordinary retrieval
`query_with_user_profile`	`bool`	`False`	Uses the agent’s Viking long-term memory profile to guide queries; the knowledge backend itself need not be Viking

Backend configuration

Parameter	Type	Default	Description
`index`	`str`	None	Milvus collection name. It must start with a letter or underscore, contain only letters, digits, and underscores, and be at most 255 characters.
`milvus_config`	`MilvusConfig`	Read from `DATABASE_MILVUS_*`	Milvus connection and collection settings.
`embedding_config`	`EmbeddingModelConfig`	Read from `MODEL_EMBEDDING_*`	Embedding model used to vectorize knowledge chunks.

Milvus configuration

Setting	Environment variable	Type	Default	Description
`uri`	`DATABASE_MILVUS_URI`	`str`	`""`	Remote Milvus URI or local Milvus Lite file path. Required.
`token`	`DATABASE_MILVUS_TOKEN`	`str`	`""`	Milvus token; takes precedence over username and password.
`user`	`DATABASE_MILVUS_USER`	`str`	`""`	Username, used with `password`.
`password`	`DATABASE_MILVUS_PASSWORD`	`str`	`""`	Password.
`db_name`	`DATABASE_MILVUS_DB_NAME`	`str`	`default`	Database name.
`overwrite`	`DATABASE_MILVUS_OVERWRITE`	`bool`	`false`	Whether to replace an existing collection during initialization.
`timeout`	`DATABASE_MILVUS_TIMEOUT`	`float \| None`	`None`	Request timeout in seconds.
`output_fields`	`DATABASE_MILVUS_OUTPUT_FIELDS`	`list[str] \| str`	Empty	Fields returned with search results; use a comma-separated value or JSON array in the environment variable.

Enabling overwrite can remove existing data from a collection with the same name. Use it only when the knowledge base can be rebuilt.

Embedding configuration

Parameter	Environment variable	Type	Default	Description
`name`	`MODEL_EMBEDDING_NAME`	`str`	`doubao-embedding-vision-250615`	Model name
`dim`	`MODEL_EMBEDDING_DIM`	`int`	`2048`	Dimension; must match the collection
`api_base`	`MODEL_EMBEDDING_API_BASE`	`str`	`https://ark.cn-beijing.volces.com/api/v3/`	Service endpoint
`api_key`	`MODEL_EMBEDDING_API_KEY`	`str`	`MODEL_AGENT_API_KEY / Ark token`	Reads MODEL_EMBEDDING_API_KEY first, then the agent key or Ark credentials

The example search should return the annual-leave policy. For empty results, check successful ingestion, matching embedding dimensions, completed server processing, network access, and permissions. Managed ingestion may not be immediately searchable. Running the configured Agent also requires model credentials

Overview

Get started

Core components

Observability

Extensions

Frontend

Security

Deployment

Dependencies

Use Milvus Lite

Example

Parameters

KnowledgeBase parameters

Backend configuration

Milvus configuration

Embedding configuration

​Dependencies

​Use Milvus Lite

​Example

​Parameters

​KnowledgeBase parameters

​Backend configuration

​Milvus configuration

​Embedding configuration

Dependencies

Use Milvus Lite

Example

Parameters

KnowledgeBase parameters

Backend configuration

Milvus configuration

Embedding configuration