nerdexam
Databricks

GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #68

A Generative AI Engineer is loading 150 million embeddings into a vector database that takes a maximum of 100 million. Which TWO actions can they take to reduce the record count?

The correct answer is A. Increase the document chunk size B. Decrease the overlap between chunks. To reduce the total number of embedding records from 150 million to within the 100 million limit, the engineer should increase chunk size (producing fewer chunks) and decrease overlap (eliminating redundant chunks).

Vector Database Management

Question

A Generative AI Engineer is loading 150 million embeddings into a vector database that takes a maximum of 100 million. Which TWO actions can they take to reduce the record count?

Options

  • AIncrease the document chunk size
  • BDecrease the overlap between chunks
  • CDecrease the document chunk size
  • DIncrease the overlap between chunks
  • EUse a smaller embedding model

How the community answered

(21 responses)
  • A
    81% (17)
  • C
    5% (1)
  • D
    10% (2)
  • E
    5% (1)

Why each option

To reduce the total number of embedding records from 150 million to within the 100 million limit, the engineer should increase chunk size (producing fewer chunks) and decrease overlap (eliminating redundant chunks).

AIncrease the document chunk sizeCorrect

Increasing document chunk size means each chunk covers more text, so fewer total chunks are needed to represent the same corpus, directly reducing the embedding record count.

BDecrease the overlap between chunksCorrect

Decreasing overlap between chunks reduces the number of duplicate or near-duplicate token windows that generate separate embeddings, further lowering the total record count.

CDecrease the document chunk size

Decreasing chunk size produces more, smaller chunks from the same documents, which increases the total number of embeddings beyond 150 million.

DIncrease the overlap between chunks

Increasing overlap generates more overlapping windows between adjacent chunks, creating additional redundant embeddings and increasing the record count.

EUse a smaller embedding model

Using a smaller embedding model changes the dimensionality of each vector but does not reduce the number of chunks or records being stored.

Concept tested: Controlling embedding record count via chunking strategy

Source: https://docs.databricks.com/en/generative-ai/vector-search.html

Topics

#Vector Databases#Text Chunking#Embeddings#Data Preprocessing

Community Discussion

No community discussion yet for this question.

Full GENERATIVE-AI-ENGINEER-ASSOCIATE Practice