nerdexam
Databricks

GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #102

A Generative AI Engineer has just deployed an LLM application at a manufacturing company that assists with answering customer service inquiries. They need to identity the key enterprise metrics to mon

Sign in or unlock GENERATIVE-AI-ENGINEER-ASSOCIATE to reveal the answer and full explanation for question #102. The question stem and answer options stay visible for context.

Operationalizing and Monitoring LLM Applications

Question

A Generative AI Engineer has just deployed an LLM application at a manufacturing company that assists with answering customer service inquiries. They need to identity the key enterprise metrics to monitor the application in production. Which is NOT a metric they will implement for their customer service LLM application in production?

Options

  • AMassive Multi-task Language Understanding (MMLU) score
  • BNumber of customer inquiries processed per unit of time
  • CFactual accuracy of the response
  • DTime taken for LLM to generate a response

Unlock GENERATIVE-AI-ENGINEER-ASSOCIATE to see the answer

You've previewed enough free GENERATIVE-AI-ENGINEER-ASSOCIATE questions. Unlock GENERATIVE-AI-ENGINEER-ASSOCIATE for full answers, explanations, the timed quiz mode, progress tracking, and the master PDF. Question stem and options stay visible so you can still see what's on the exam.

Topics

#LLM Monitoring#Production Metrics#Model Evaluation#Operationalizing LLMs
Full GENERATIVE-AI-ENGINEER-ASSOCIATE Practice