You are reviewing model benchmarks in Azure AI Foundry. You must use a large language model based on the proficiency of the model to generate the most linguistically correct text. You need to select t

The correct answer is C. fluency. Fluency evaluates the language proficiency of a generative AI's predicted answer. It assesses how well the generated text adheres to grammatical rules, syntactic structures, and appropriate usage of vocabulary, resulting in linguistically correct and natural-sounding responses. h

Optimize language models for AI applications

Question

You are reviewing model benchmarks in Azure AI Foundry. You must use a large language model based on the proficiency of the model to generate the most linguistically correct text. You need to select the model benchmark. Which benchmark metric should you focus on?

Options

Aaccuracy
Bcoherence
Cfluency
Dprecision

How the community answered

(34 responses)

B
3% (1)
C
94% (32)
D
3% (1)

Explanation

Fluency evaluates the language proficiency of a generative AI's predicted answer. It assesses how well the generated text adheres to grammatical rules, syntactic structures, and appropriate usage of vocabulary, resulting in linguistically correct and natural-sounding responses. https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/model-benchmarks

Topics

#LLM evaluation metrics#Fluency#Model benchmarking#Natural Language Generation

Community Discussion

No community discussion yet for this question.

Full DP-100 Practice