nerdexam
Databricks

GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #7

A Generative AI Engineer is developing a RAG application and would like to experiment with different embedding models to improve the application performance. Which strategy for picking an embedding…

The correct answer is C. Pick an embedding model trained on related domain knowledge. Embedding models encode text into vector representations, and their quality depends heavily on what domain they were trained on. A model pre-trained or fine-tuned on domain-related text (e.g., legal, medical, or technical documents) will produce embeddings that better capture…

Designing and Optimizing RAG Applications

Question

A Generative AI Engineer is developing a RAG application and would like to experiment with different embedding models to improve the application performance. Which strategy for picking an embedding model should they choose?

Options

  • APick an embedding model with multilingual support to support potential multilingual user
  • BPick the most recent and most performant open LLM released at the time
  • CPick an embedding model trained on related domain knowledge
  • DPick the embedding model ranked highest on the Massive Text Embedding Benchmark (MTEB)

How the community answered

(19 responses)
  • A
    5% (1)
  • B
    5% (1)
  • C
    84% (16)
  • D
    5% (1)

Explanation

Embedding models encode text into vector representations, and their quality depends heavily on what domain they were trained on. A model pre-trained or fine-tuned on domain-related text (e.g., legal, medical, or technical documents) will produce embeddings that better capture the semantic nuances of that domain, leading to more accurate retrieval. Option A (multilingual) is a valid consideration only if multilingual support is a confirmed requirement, not a default choice. Option B is wrong because open LLMs (generative models) are not embedding models - they serve different purposes. Option D (top MTEB model) is a reasonable baseline heuristic but ignores domain fit: a top general-purpose embedding model may underperform a domain-specific one on specialized content.

Topics

#RAG#Embedding Models#Model Selection#Domain Specificity

Community Discussion

No community discussion yet for this question.

Full GENERATIVE-AI-ENGINEER-ASSOCIATE Practice