AAIA · Question #31
An IS auditor is auditing a financial system in which a generative AI tool is used to identify trends in batches of 4,000 rows, while the generative AI tool has a limit of 3,000 tokens. Which of the…
The correct answer is D. The AI output will be biased toward the first 3,000 tokens. When input exceeds the model's context window, the model processes only the data that fits - typically the beginning of the input - and silently truncates the rest. The model will not reject the input or flag the omission; it will generate analysis as if it processed the full…
Question
An IS auditor is auditing a financial system in which a generative AI tool is used to identify trends in batches of 4,000 rows, while the generative AI tool has a limit of 3,000 tokens. Which of the following is the GREATEST concern?
Options
- AThe AI will process only a portion of the data set.
- BThe AI will prioritize high-value entries.
- CThe AI will reject the data set and not analyze the data.
- DThe AI output will be biased toward the first 3,000 tokens.
How the community answered
(38 responses)- A24% (9)
- B5% (2)
- C11% (4)
- D61% (23)
Explanation
When input exceeds the model's context window, the model processes only the data that fits - typically the beginning of the input - and silently truncates the rest. The model will not reject the input or flag the omission; it will generate analysis as if it processed the full dataset. This means any identified trends will be derived only from the first ~3,000 tokens, causing the output to be systematically biased toward whichever data appears first in the batch. Option A is partially true but understates the concern - the real issue is not just incompleteness but the undetected bias it introduces. Option B is incorrect; LLMs do not selectively prioritize high-value entries. Option C is incorrect; truncation, not rejection, is the typical behavior.
Topics
Community Discussion
No community discussion yet for this question.