AI-102 · Question #234
You train a Conversational Azure AI Language Understanding model to understand the natural language input of users. You need to evaluate the accuracy of the model before deploying it. What are two…
The correct answer is A. From the language authoring REST endpoint, retrieve the model evaluation summary. C. From Language Studio, select Model performance. To evaluate the accuracy of a trained Conversational Language Understanding model before deployment, you can either retrieve the model evaluation summary via the language authoring REST endpoint or directly view model performance metrics in Language Studio.
Question
Options
- AFrom the language authoring REST endpoint, retrieve the model evaluation summary.
- BFrom Language Studio, enable Active Learning, and then validate the utterances logged for
- CFrom Language Studio, select Model performance.
- DFrom the Azure portal, enable log collection in Log Analytics, and then analyze the logs.
How the community answered
(46 responses)- A70% (32)
- B17% (8)
- D13% (6)
Why each option
To evaluate the accuracy of a trained Conversational Language Understanding model before deployment, you can either retrieve the model evaluation summary via the language authoring REST endpoint or directly view model performance metrics in Language Studio.
The Azure AI Language authoring REST API provides endpoints specifically for retrieving model evaluation details, including metrics like precision, recall, and F1-score, which are crucial for assessing model accuracy and can be accessed programmatically.
Active Learning in Language Studio is used for improving model performance over time by suggesting new utterances to label, not for a direct evaluation of the current model's accuracy before initial deployment.
Azure AI Language Studio includes a 'Model performance' section or similar functionality (often under 'Test model' or 'Evaluate') where users can visually inspect the model's accuracy, view detailed evaluation metrics, and identify areas for improvement before deployment.
Enabling log collection in Log Analytics from the Azure portal is for monitoring service usage and operational issues, not for directly evaluating the accuracy of an AI Language Understanding model's training performance.
Concept tested: Evaluating Conversational Language Understanding model accuracy
Source: https://learn.microsoft.com/en-us/azure/ai-services/language-service/conversational-language-understanding/how-to/test-model
Topics
Community Discussion
No community discussion yet for this question.