An organization recently created a custom model that integrates with a language model (LLM). The developer notices that the application programming interface (API) costs have increased. Which of the…

The correct answer is D. Adjusting token limits. API costs for large language model integrations are directly tied to token usage (input + output tokens). By adjusting token limits, the organization can reduce unnecessary processing of overly long prompts or responses, thereby lowering overall API costs without changing model…

Security Architecture and Tool Sets

Question

An organization recently created a custom model that integrates with a language model (LLM). The developer notices that the application programming interface (API) costs have increased. Which of the following is the best control to reduce cost?

Options

AImplementing prompt templates
BIncreasing central processing unit (CPU) and memory
CReducing the model size
DAdjusting token limits

How the community answered

(39 responses)

A
3% (1)
B
8% (3)
C
3% (1)
D
87% (34)

Explanation

API costs for large language model integrations are directly tied to token usage (input + output tokens). By adjusting token limits, the organization can reduce unnecessary processing of overly long prompts or responses, thereby lowering overall API costs without changing model size or infrastructure resources.

Topics

#LLM API costs#token limits#AI cost optimization#prompt engineering

Community Discussion

No community discussion yet for this question.

Full CY0-001 Practice