nerdexam
Databricks

GENERATIVE-AI-ENGINEER-ASSOCIATE · Question #9

Generative AI Engineer needs to build an LLM application that can understand medical documents, including recently published ones. They want to select an open model available on HuggingFace's model…

The correct answer is D. Check for the model and training data description to identify if the model is trained on any medical. For a specialized domain like medical document understanding, the most critical selection criterion is whether the model's training data includes medical literature. Model cards on HuggingFace describe the training dataset, domain focus, and any domain-specific fine-tuning. A…

LLM Model Selection

Question

Generative AI Engineer needs to build an LLM application that can understand medical documents, including recently published ones. They want to select an open model available on HuggingFace’s model hub. Which step is most appropriate for selecting an LLM?

Options

  • APick any model in the Mistral family, as Mistral models are good with all types of use cases
  • BSelect a model based on the highest number of downloads, as this indicates popularity, reliability,
  • CSelect a model that is most recently uploaded, as this indicates the model is the newest and
  • DCheck for the model and training data description to identify if the model is trained on any medical

How the community answered

(41 responses)
  • A
    15% (6)
  • B
    2% (1)
  • C
    7% (3)
  • D
    76% (31)

Explanation

For a specialized domain like medical document understanding, the most critical selection criterion is whether the model's training data includes medical literature. Model cards on HuggingFace describe the training dataset, domain focus, and any domain-specific fine-tuning. A model trained on medical corpora (e.g., PubMed, clinical notes) will have learned medical terminology, abbreviations, and reasoning patterns, making it far more capable on this task. Option A is incorrect because Mistral models are general-purpose; no model family is universally best for all use cases. Option B (most downloads) measures popularity, not medical capability. Option C (most recently uploaded) conflates novelty with suitability - a newly uploaded model may have no medical training data.

Topics

#LLM Selection#Domain-specific LLMs#HuggingFace Hub#Training Data

Community Discussion

No community discussion yet for this question.

Full GENERATIVE-AI-ENGINEER-ASSOCIATE Practice