GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #66
GENERATIVE-AI-ENGINEER-ASSOCIATE Question #66: Real Exam Question with Answer & Explanation
The correct answer is A: Operational metrics like request volume, latency, and errors. The Mosaic AI Agent Framework automatically captures operational metrics such as request volume, latency, and errors by default, enabling real-time monitoring of the agent’s performance and reliability. Quality metrics typically require additional evaluation setups and are not ca
Question
A generative AI engineer is deploying an AI agent authored with MLflow's ChatAgent interface for a retail company's customer support system on Databricks. The agent must handle thousands of inquiries daily, and the engineer needs to track its performance and quality in real-time to ensure it meets service-level agreements. Which metrics are automatically captured by default and made available for monitoring when the agent is deployed using the Mosaic AI Agent Framework?
Options
- AOperational metrics like request volume, latency, and errors
- BQuality metrics like correctness and guideline adherence
- CBoth operational and quality metrics
- DNo metrics are automatically captured
Explanation
The Mosaic AI Agent Framework automatically captures operational metrics such as request volume, latency, and errors by default, enabling real-time monitoring of the agent’s performance and reliability. Quality metrics typically require additional evaluation setups and are not captured
Topics
Community Discussion
No community discussion yet for this question.