GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #2
GENERATIVE-AI-ENGINEER-ASSOCIATE Question #2: Real Exam Question with Answer & Explanation
The correct answer is A: Big Code Models Leaderboard. The Big Code Models Leaderboard provides performance metrics specifically for code generation tasks, making it relevant for selecting a model optimized for this use case. The number of model parameters directly impacts hosting costs and efficiency; smaller models reduce costs whi
Question
An AI developer team wants to fine tune an open-weight model to have exceptional performance on a code generation use case. They are trying to choose the best model to start with. They want to minimize model hosting costs, and are using Huggingface model cards and spaces to explore models. Which TWO model attributes and metrics should the team focus on to make their selection? (Choose two.)
Options
- ABig Code Models Leaderboard
- BNumber of model parameters
- CMTEB Leaderboard
- DChatbot Arena Leaderboard
- ENumber of model downloads last month
Explanation
The Big Code Models Leaderboard provides performance metrics specifically for code generation tasks, making it relevant for selecting a model optimized for this use case. The number of model parameters directly impacts hosting costs and efficiency; smaller models reduce costs while balancing performance.
Topics
Community Discussion
No community discussion yet for this question.