nerdexam
Databricks

GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #2

An AI developer team wants to fine tune an open-weight model to have exceptional performance on a code generation use case. They are trying to choose the best model to start with. They want to minimiz

Sign in or unlock GENERATIVE-AI-ENGINEER-ASSOCIATE to reveal the answer and full explanation for question #2. The question stem and answer options stay visible for context.

Generative AI Model Selection and Evaluation

Question

An AI developer team wants to fine tune an open-weight model to have exceptional performance on a code generation use case. They are trying to choose the best model to start with. They want to minimize model hosting costs, and are using Huggingface model cards and spaces to explore models. Which TWO model attributes and metrics should the team focus on to make their selection? (Choose two.)

Options

  • ABig Code Models Leaderboard
  • BNumber of model parameters
  • CMTEB Leaderboard
  • DChatbot Arena Leaderboard
  • ENumber of model downloads last month

Unlock GENERATIVE-AI-ENGINEER-ASSOCIATE to see the answer

You've previewed enough free GENERATIVE-AI-ENGINEER-ASSOCIATE questions. Unlock GENERATIVE-AI-ENGINEER-ASSOCIATE for full answers, explanations, the timed quiz mode, progress tracking, and the master PDF. Question stem and options stay visible so you can still see what's on the exam.

Topics

#Model Selection#LLM Evaluation#Code Generation#Cost Optimization
Full GENERATIVE-AI-ENGINEER-ASSOCIATE Practice