GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #7
A Generative AI Engineer is developing a RAG application and would like to experiment with different embedding models to improve the application performance. Which strategy for picking an embedding…
The correct answer is C. Pick an embedding model trained on related domain knowledge. Embedding models encode text into vector representations, and their quality depends heavily on what domain they were trained on. A model pre-trained or fine-tuned on domain-related text (e.g., legal, medical, or technical documents) will produce embeddings that better capture…
Question
A Generative AI Engineer is developing a RAG application and would like to experiment with different embedding models to improve the application performance. Which strategy for picking an embedding model should they choose?
Options
- APick an embedding model with multilingual support to support potential multilingual user
- BPick the most recent and most performant open LLM released at the time
- CPick an embedding model trained on related domain knowledge
- DPick the embedding model ranked highest on the Massive Text Embedding Benchmark (MTEB)
How the community answered
(19 responses)- A5% (1)
- B5% (1)
- C84% (16)
- D5% (1)
Explanation
Embedding models encode text into vector representations, and their quality depends heavily on what domain they were trained on. A model pre-trained or fine-tuned on domain-related text (e.g., legal, medical, or technical documents) will produce embeddings that better capture the semantic nuances of that domain, leading to more accurate retrieval. Option A (multilingual) is a valid consideration only if multilingual support is a confirmed requirement, not a default choice. Option B is wrong because open LLMs (generative models) are not embedding models - they serve different purposes. Option D (top MTEB model) is a reasonable baseline heuristic but ignores domain fit: a top general-purpose embedding model may underperform a domain-specific one on specialized content.
Topics
Community Discussion
No community discussion yet for this question.