nerdexam
Databricks

GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #66

A generative AI engineer is deploying an AI agent authored with MLflow's ChatAgent interface for a retail company's customer support system on Databricks. The agent must handle thousands of inquiries

Sign in or unlock GENERATIVE-AI-ENGINEER-ASSOCIATE to reveal the answer and full explanation for question #66. The question stem and answer options stay visible for context.

AI Agent Deployment and Monitoring

Question

A generative AI engineer is deploying an AI agent authored with MLflow's ChatAgent interface for a retail company's customer support system on Databricks. The agent must handle thousands of inquiries daily, and the engineer needs to track its performance and quality in real-time to ensure it meets service-level agreements. Which metrics are automatically captured by default and made available for monitoring when the agent is deployed using the Mosaic AI Agent Framework?

Options

  • AOperational metrics like request volume, latency, and errors
  • BQuality metrics like correctness and guideline adherence
  • CBoth operational and quality metrics
  • DNo metrics are automatically captured

Unlock GENERATIVE-AI-ENGINEER-ASSOCIATE to see the answer

You've previewed enough free GENERATIVE-AI-ENGINEER-ASSOCIATE questions. Unlock GENERATIVE-AI-ENGINEER-ASSOCIATE for full answers, explanations, the timed quiz mode, progress tracking, and the master PDF. Question stem and options stay visible so you can still see what's on the exam.

Topics

#AI Agent Deployment#MLOps#Monitoring#Operational Metrics
Full GENERATIVE-AI-ENGINEER-ASSOCIATE Practice