GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #79
A Generative AI Engineer is asked to build an LLM application that would excel at code generation. They need to select a model that has been specifically trained to generate code. Which model would…
The correct answer is A. CodeLlama-34b-Instruct-hf. CodeLlama is Meta's family of models derived from Llama 2 but further pre-trained and fine-tuned on large code corpora covering many programming languages. The 34b-Instruct variant adds instruction-following tuning optimized for code-related tasks. It is purpose-built for code…
Question
A Generative AI Engineer is asked to build an LLM application that would excel at code generation. They need to select a model that has been specifically trained to generate code. Which model would likely produce the best results out of the box?
Options
- ACodeLlama-34b-Instruct-hf
- BMixtral-8x7B-v0.1
- CLlama-2-70b-hf
- Dmpt-7b-8k-instruct
How the community answered
(34 responses)- A91% (31)
- C6% (2)
- D3% (1)
Explanation
CodeLlama is Meta's family of models derived from Llama 2 but further pre-trained and fine-tuned on large code corpora covering many programming languages. The 34b-Instruct variant adds instruction-following tuning optimized for code-related tasks. It is purpose-built for code generation, completion, and explanation. Mixtral-8x7B (B) is a general-purpose mixture-of-experts model with no specific code specialization. Llama-2-70b-hf (C) is a general language model; it can generate code but was not specifically trained for it. mpt-7b-8k-instruct (D) is a small general-purpose model with an extended context window but no code-specific training. For out-of-the-box code generation quality, CodeLlama is the clear choice.
Topics
Community Discussion
No community discussion yet for this question.