A company wants to assess the costs that are associated with using a large language model (LLM) to generate inferences. The company wants to use Amazon Bedrock to build generative AI applications…

The correct answer is A. Number of tokens consumed. In generative AI models, such as those built on Amazon Bedrock, inference costs are driven by the number of tokens processed. A token can be as short as one character or as long as one word, and the more tokens consumed during the inference process, the higher the cost.

Submitted by andreas_gr· Mar 30, 2026

Question

A company wants to assess the costs that are associated with using a large language model (LLM) to generate inferences. The company wants to use Amazon Bedrock to build generative AI applications. Which factor will drive the inference costs?

Options

ANumber of tokens consumed
BTemperature value
CAmount of data used to train the LLM
DTotal training time

How the community answered

(36 responses)

A
89% (32)
B
3% (1)
C
3% (1)
D
6% (2)

Explanation

In generative AI models, such as those built on Amazon Bedrock, inference costs are driven by the number of tokens processed. A token can be as short as one character or as long as one word, and the more tokens consumed during the inference process, the higher the cost.

Topics

#Amazon Bedrock#LLM inference costs#Token-based pricing

Community Discussion

No community discussion yet for this question.

Full AIF-C01 Practice