AAIA · Question #88
Which use case for an AI model to be used by a food delivery service would pose ethical risk to the organization?
The correct answer is B. Basing driver retention and termination decisions on the number of delivered orders per total hours. Using an AI model to make driver retention and termination decisions based solely on algorithmic output - delivered orders per total hours - poses significant ethical risk. Employment decisions are high-stakes and consequential, and relying on a narrow, algorithmically generated
Question
Which use case for an AI model to be used by a food delivery service would pose ethical risk to the organization?
Options
- ACorrelating time, cost, delivery distance, and customer satisfaction metrics to issue coupons to
- BBasing driver retention and termination decisions on the number of delivered orders per total hours
- CComparing total food preparation and delivery time to an industry benchmark to set key
- DUsing customer service metrics for service speed and food quality to predict customer retention
How the community answered
(43 responses)- A7% (3)
- B81% (35)
- C9% (4)
- D2% (1)
Explanation
Using an AI model to make driver retention and termination decisions based solely on algorithmic output - delivered orders per total hours - poses significant ethical risk. Employment decisions are high-stakes and consequential, and relying on a narrow, algorithmically generated metric without human oversight can embed bias, ignore contextual factors (e.g., traffic, order complexity, illness), and violate fair employment principles. This is a classic example of harmful algorithmic management of workers. Issuing coupons (A), setting benchmarks (C), and predicting customer retention (D) are analytical or marketing applications with lower stakes and no direct adverse impact on individuals' livelihoods or rights.
Topics
Community Discussion
No community discussion yet for this question.