194
questions
0
votes
1
answer
32
views
ConanException: Can't locate Digest/SHA.pm while building Milvus
I'm trying to build Milvus but encountering a ConanException error related to the missing Digest::SHA module. The error message indicates that it can't locate Digest/SHA.pm in the include paths. Can ...
- 1
-1
votes
0
answers
16
views
What is the correct lifetime for a MilvusEmbeddingStore instance? One per request, or just 1 for life?
What is the correct lifetime for a MilvusEmbeddingStore instance? One per request, or just 1 for the life of the client?
On one hand the call to loadCollectionInMemory seems to indicate that you ...
- 5,488
0
votes
2
answers
22
views
What exactly does Milvus loadCollection() do?
The documentation for the MilvusClient loadCollection() method just say "This method loads the specified collection and all the data within to memory for search or query.". I assume that ...
- 5,488
0
votes
0
answers
9
views
pymilvus import data failed with parquet reader failed
I am following steps to import data to milvus db from Import data.
Below is my script to create schema and prepare data.
milvus_db/import_test.py
import random
import string
from pymilvus import ...
- 21.1k
0
votes
1
answer
22
views
ModuleNotFoundError: No module named 'milvus_lite' on Windows
I encountered a ModuleNotFoundError: No module named 'milvus_lite' while running the following code after following the installation instructions.
I used the command pip install -U pymilvus and then ...
- 21
0
votes
1
answer
16
views
Need for Serializer When Using MilvusClientV2 - java.io.NotSerializableException
I am streaming data from an external source into Milvus using the MilvusClientV2 class. I would like to know if I need to implement any serializer before inserting the streamed data into a Milvus ...
- 1
0
votes
0
answers
15
views
Error Opening RocksDB During Go Unit Test on Milvus - Lock File Issue
I'm encountering an issue while running Go unit tests for Milvus, as described in the documentation [https://github.com/milvus-io/milvus/blob/master/DEVELOPMENT.md].
The error suggests that a test is ...
- 1
0
votes
0
answers
12
views
pymilvus.exception.paramerror: How to handle strings exceeding 64K bytes in Milvus? [closed]
I encountered a limitation in Milvus where string types can only be up to 64K bytes. This restriction is problematic for my use case, which involves storing larger text data. What best practices can I ...
- 61
0
votes
0
answers
23
views
Milvus database is not able to load collection
I am running milvusdb in docker, and it has 18K+ records in that database. VM's storage was full, I stopped docker and did system prune to remove unused resources. I remove temp log files.
Docker ...
- 21.1k
-1
votes
0
answers
17
views
MilvusException: String length exceeds max length despite len(text) being under limit
I am attempting to insert data into a Milvus text field defined as varchar(60000). The text I want to insert has a length of 21033 characters, which I verified using len(text).
However, I receive the ...
- 1
0
votes
1
answer
20
views
How to Use Memory Mapping and Other Techniques to Reduce Memory Usage
I have a sample dataset of 2M vectors with 512 dimensions, each vector being a float32. I have an id field that is int64.
So, the size of raw vectors is 2M * 512 * 4 = 4GB.
The collection is memory-...
1
vote
0
answers
43
views
How do I get an EmbeddingStore with langchain4j using
How do I get an EmbeddingStore instance connecting to milvus using a tls certificate?
Normally I just use
EmbeddingStore<TextSegment> embeddingStore = MilvusEmbeddingStore.builder()
.uri("...
- 5,488
-1
votes
1
answer
14
views
Milvus - Kafka partitioning strategy
We are using kafka as a message stream with Milvus. when we logged into broker and watch the log directory. we always observing that only 1 partition is being used by log files though we have ...
- 69
0
votes
0
answers
12
views
Excessively slow to connect to Milvus server from PyMilvus
It takes about 3-4 minutes to connect to my database via PyMilivus, whereas it is basically instantaneous via Attu and milvus_cli. What could be causing this?
Here's my code:
from pymilvus import ...
1
vote
0
answers
25
views
Connecting to Milvus instance inside an rdd map function fails
So I have a list of tuples, List[Tuple[str,List[float]] , and I am trying to parallelize it and insert into a Milvus instance using just the PyMilvus connector.
rdd.foreachPartition(insert_records)
...
- 351