nerdexam
Databricks

GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #21

A Generative AI Engineer has been asked to build an LLM-based question-answering application. The application should take into account new documents that are frequently published. The engineer wants…

The correct answer is A. For the application a prompt, a retriever, and an LLM are required. The retriever output is inserted. Option A describes a standard RAG chain: a prompt template + a retriever (vector store) + an LLM. This is the lowest-cost, lowest-effort architecture for a QA app over frequently updated documents because: (1) new documents are simply indexed into the vector store - no model…

LLM Application Design

Question

A Generative AI Engineer has been asked to build an LLM-based question-answering application. The application should take into account new documents that are frequently published. The engineer wants to build this application with the least cost and least development effort and have it operate at the lowest cost possible. Which combination of chaining components and configuration meets these requirements?

Options

  • AFor the application a prompt, a retriever, and an LLM are required. The retriever output is inserted
  • BThe LLM needs to be frequently with the new documents in order to provide most up-to-date
  • CFor the question-answering application, prompt engineering and an LLM are required to generate
  • DFor the application a prompt, an agent and a fine-tuned LLM are required. The agent is used by

How the community answered

(28 responses)
  • A
    82% (23)
  • B
    7% (2)
  • C
    4% (1)
  • D
    7% (2)

Explanation

Option A describes a standard RAG chain: a prompt template + a retriever (vector store) + an LLM. This is the lowest-cost, lowest-effort architecture for a QA app over frequently updated documents because: (1) new documents are simply indexed into the vector store - no model retraining required, (2) it uses an off-the-shelf retriever rather than a costly agent, (3) it requires minimal custom development. Option B (frequent fine-tuning) is expensive and operationally complex. Option C (prompt engineering alone without retrieval) can't handle new documents reliably. Option D (agent + fine-tuned LLM) is the most expensive and complex option, the opposite of the stated goals.

Topics

#RAG#LLM Architectures#Cost Optimization#Question Answering

Community Discussion

No community discussion yet for this question.

Full GENERATIVE-AI-ENGINEER-ASSOCIATE Practice