AI-102 · Question #329
You build a chatbot that uses the Azure OpenAI GPT 3.5 model. You need to improve the quality of the responses from the chatbot. The solution must minimize development effort. What are two ways to…
The correct answer is B. Provide grounding content. C. Add sample request/response pairs. To enhance a chatbot's GPT 3.5 responses with minimal development effort, you can provide grounding content or use few-shot learning by adding sample request/response pairs.
Question
Options
- AFine-tune the model.
- BProvide grounding content.
- CAdd sample request/response pairs.
- DRetrain the language model by using your own data.
- ETrain a custom large language model (LLM).
How the community answered
(35 responses)- A3% (1)
- B69% (24)
- D11% (4)
- E17% (6)
Why each option
To enhance a chatbot's GPT 3.5 responses with minimal development effort, you can provide grounding content or use few-shot learning by adding sample request/response pairs.
Fine-tuning the model involves significant data preparation and computational resources, which does not minimize development effort.
Providing grounding content, often through Retrieval Augmented Generation (RAG), improves response quality by supplying the model with relevant external information, which helps anchor its answers to specific, accurate data without modifying the model itself.
Adding sample request/response pairs, also known as few-shot learning or in-context learning, guides the model to produce desired outputs by showing it examples within the prompt, which is a low-effort way to steer its behavior without retraining.
Retraining a language model with your own data is an extensive and resource-intensive process, going against the requirement to minimize development effort.
Training a custom large language model (LLM) from scratch is a highly complex, time-consuming, and resource-intensive endeavor, far from minimizing development effort.
Concept tested: Improving LLM response quality with minimal effort
Source: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/advanced-prompt-engineering?tabs=python
Topics
Community Discussion
No community discussion yet for this question.