AI-102 · Question #328
You are building a chatbot for a travel agent. The chatbot will use the Azure OpenAI GPT 3.5 model and will be used to make travel reservations. You need to maximize the accuracy of the responses…
The correct answer is D. Modify the system message used by the model to specify that the answers must be accurate. To maximize the accuracy of responses from an Azure OpenAI GPT 3.5 model for travel reservations, modifying the system message to explicitly instruct the model to provide accurate answers is a key prompt engineering technique.
Question
Options
- AConfigure the model to include data from the travel agent's database.
- BSet the Top P parameter for the model to 0.
- CSet the Temperature parameter for the model to 0.
- DModify the system message used by the model to specify that the answers must be accurate.
How the community answered
(40 responses)- A5% (2)
- B13% (5)
- C25% (10)
- D57% (23)
Why each option
To maximize the accuracy of responses from an Azure OpenAI GPT 3.5 model for travel reservations, modifying the system message to explicitly instruct the model to provide accurate answers is a key prompt engineering technique.
Configuring the model to include external database data typically involves advanced techniques like fine-tuning or retrieval-augmented generation (RAG), which is a complex development effort, not a simple configuration to maximize accuracy of an existing GPT-3.5 model.
Setting the Top P parameter to 0 is not a standard valid configuration for this parameter, which is typically between 0 and 1. While low Top P values increase determinism, setting it to 0 is an invalid or extreme configuration.
Setting the Temperature parameter for the model to 0 makes the output highly deterministic and less creative, which often helps with factual accuracy. However, explicit instruction in the system message (Option D) provides direct guidance to the model's intent, complementing parameter tuning by making accuracy an explicit goal, which can be more impactful in maximizing accuracy than just reducing randomness alone.
Modifying the system message to explicitly instruct the model that answers must be accurate is a direct and effective prompt engineering technique. This guidance helps align the model's response generation towards factual correctness and reliability, which is crucial for sensitive tasks like travel reservations, thereby maximizing accuracy by influencing the model's internal prioritization.
Concept tested: Azure OpenAI prompt engineering for accuracy
Source: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/prompt-engineering
Topics
Community Discussion
No community discussion yet for this question.