nerdexam
Isaca

AAIA · Question #10

When auditing a research agency's use of generative AI models for analyzing scientific data, which of the following is MOST critical to evaluate in order to prevent hallucinatory results and ensure…

The correct answer is D. The measures in place to ensure the appropriateness and relevance of input data for generative AI. AI hallucinations - outputs that are plausible-sounding but factually incorrect - are primarily driven by irrelevant, out-of-domain, or poor-quality input data. Ensuring that inputs are appropriate and relevant to the scientific domain directly reduces the likelihood of…

AI Risk Management and Controls

Question

When auditing a research agency's use of generative AI models for analyzing scientific data, which of the following is MOST critical to evaluate in order to prevent hallucinatory results and ensure the accuracy of outputs?

Options

  • AThe effectiveness of data anonymization processes that help preserve data quality
  • BThe algorithms for generative AI models designed to detect and correct data bias before
  • CThe frequency of data audits verifying the integrity and accuracy of inputs
  • DThe measures in place to ensure the appropriateness and relevance of input data for generative AI

How the community answered

(56 responses)
  • A
    18% (10)
  • B
    27% (15)
  • C
    9% (5)
  • D
    46% (26)

Explanation

AI hallucinations - outputs that are plausible-sounding but factually incorrect - are primarily driven by irrelevant, out-of-domain, or poor-quality input data. Ensuring that inputs are appropriate and relevant to the scientific domain directly reduces the likelihood of hallucinations by keeping the model grounded in valid, pertinent information. Data anonymization (A) preserves privacy but does not prevent hallucinations. Bias detection algorithms (B) address systematic skew in training data, which is a related but distinct problem from hallucination. Audit frequency (C) helps maintain data integrity over time but is less directly targeted at the root cause of hallucinations compared to controlling what data the model receives as input.

Topics

#Generative AI auditing#Data quality#AI hallucinations#Input data validation

Community Discussion

No community discussion yet for this question.

Full AAIA Practice