GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #68
A Generative AI Engineer is loading 150 million embeddings into a vector database that takes a maximum of 100 million. Which TWO actions can they take to reduce the record count?
The correct answer is A. Increase the document chunk size B. Decrease the overlap between chunks. To reduce the total number of embedding records from 150 million to within the 100 million limit, the engineer should increase chunk size (producing fewer chunks) and decrease overlap (eliminating redundant chunks).
Question
A Generative AI Engineer is loading 150 million embeddings into a vector database that takes a maximum of 100 million. Which TWO actions can they take to reduce the record count?
Options
- AIncrease the document chunk size
- BDecrease the overlap between chunks
- CDecrease the document chunk size
- DIncrease the overlap between chunks
- EUse a smaller embedding model
How the community answered
(21 responses)- A81% (17)
- C5% (1)
- D10% (2)
- E5% (1)
Why each option
To reduce the total number of embedding records from 150 million to within the 100 million limit, the engineer should increase chunk size (producing fewer chunks) and decrease overlap (eliminating redundant chunks).
Increasing document chunk size means each chunk covers more text, so fewer total chunks are needed to represent the same corpus, directly reducing the embedding record count.
Decreasing overlap between chunks reduces the number of duplicate or near-duplicate token windows that generate separate embeddings, further lowering the total record count.
Decreasing chunk size produces more, smaller chunks from the same documents, which increases the total number of embeddings beyond 150 million.
Increasing overlap generates more overlapping windows between adjacent chunks, creating additional redundant embeddings and increasing the record count.
Using a smaller embedding model changes the dimensionality of each vector but does not reduce the number of chunks or records being stored.
Concept tested: Controlling embedding record count via chunking strategy
Source: https://docs.databricks.com/en/generative-ai/vector-search.html
Topics
Community Discussion
No community discussion yet for this question.