SAA-C03 · Question #800
A company is developing an AI-powered application that uses an Amazon API Gateway REST API and a large language model (LLM). The API uses rate limiting and a custom authorizer. Users report that the a
The correct answer is B. Increase the API Gateway integration timeout quota.. Increasing the API Gateway integration timeout allows long-running LLM processing to complete without timing out, resolving unresponsiveness while requiring minimal changes to the existing
Question
A company is developing an AI-powered application that uses an Amazon API Gateway REST API and a large language model (LLM). The API uses rate limiting and a custom authorizer. Users report that the application is often unresponsive. The company discovered that the LLM processing can take a long time to finish, which causes the API calls to time out and fail. The company wants to resolve the problem with the fewest changes to the existing architecture. Which solution will meet these requirements?
Options
- AReplace the REST API with an Amazon Simple Queue Service (Amazon SQS) queue.
- BIncrease the API Gateway integration timeout quota.
- CReplace the REST API with an Application Load Balancer.
- DSplit the LLM response into smaller chunks that finish sooner.
How the community answered
(38 responses)- A3% (1)
- B92% (35)
- D5% (2)
Explanation
Increasing the API Gateway integration timeout allows long-running LLM processing to complete without timing out, resolving unresponsiveness while requiring minimal changes to the existing
Community Discussion
No community discussion yet for this question.