PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #149
You work for a company that manages a ticketing platform for a large chain of cinemas. Customers use a mobile app to search for movies they're interested in and purchase tickets in the app. Ticket pur
The correct answer is D. Convert your model with TensorFlow Lite (TFLite), and add it to the mobile app so that the promo. To meet ultra-low latency requirements for real-time promo code predictions within a mobile app context, converting the BigQuery ML model to TensorFlow Lite and integrating it directly into the mobile app for on-device inference is the most suitable solution.
Question
Options
- ARun batch inference with BigQuery ML every five minutes on each new set of tickets issued.
- BExport your model in TensorFlow format, and add a tfx_bsl.public.beam.RunInference step to the
- CExport your model in TensorFlow format, deploy it on Vertex AI, and query the prediction endpoint
- DConvert your model with TensorFlow Lite (TFLite), and add it to the mobile app so that the promo
How the community answered
(45 responses)- A22% (10)
- B7% (3)
- C11% (5)
- D60% (27)
Why each option
To meet ultra-low latency requirements for real-time promo code predictions within a mobile app context, converting the BigQuery ML model to TensorFlow Lite and integrating it directly into the mobile app for on-device inference is the most suitable solution.
Batch inference with BigQuery ML every five minutes is unsuitable for real-time, low-latency predictions during an active ticket purchase flow in a mobile app, as it introduces significant delay.
Adding a `RunInference` step to the Dataflow pipeline would introduce network latency and processing overhead for each event, making it difficult to consistently achieve the strict 50ms requirement for each pipeline step.
Deploying the model on Vertex AI and querying the prediction endpoint introduces network latency for each request from the mobile app, making it difficult to consistently achieve the strict sub-50ms latency requirement.
Converting the model to TensorFlow Lite (TFLite) allows for on-device inference directly within the mobile app. This completely bypasses network latency and server-side processing, ensuring the lowest possible latency (sub-50ms) for predicting promo code effectiveness, which is critical for real-time customer interaction during ticket purchase.
Concept tested: On-device ML inference for low latency
Source: https://www.tensorflow.org/lite/guide
Topics
Community Discussion
No community discussion yet for this question.