AIF-C01 · Question #34
A company wants to use language models to create an application for inference on edge devices. The inference must have the lowest latency possible. Which solution will meet these requirements?
The correct answer is A. Deploy optimized small language models (SLMs) on edge devices. To achieve the lowest latency possible for inference on edge devices, deploying optimized small language models (SLMs) is the most effective solution. SLMs require fewer resources and have faster inference times, making them ideal for deployment on edge devices where processing…
Question
A company wants to use language models to create an application for inference on edge devices. The inference must have the lowest latency possible. Which solution will meet these requirements?
Options
- ADeploy optimized small language models (SLMs) on edge devices.
- BDeploy optimized large language models (LLMs) on edge devices.
- CIncorporate a centralized small language model (SLM) API for asynchronous communication with
- DIncorporate a centralized large language model (LLM) API for asynchronous communication with
How the community answered
(49 responses)- A82% (40)
- B10% (5)
- C6% (3)
- D2% (1)
Explanation
To achieve the lowest latency possible for inference on edge devices, deploying optimized small language models (SLMs) is the most effective solution. SLMs require fewer resources and have faster inference times, making them ideal for deployment on edge devices where processing power and memory are limited.
Topics
Community Discussion
No community discussion yet for this question.