An attacker crafts inputs to a large language model (LLM) to exploit output integrity controls. Which of the following types of attacks is this an example of?

The correct answer is A. Prompt injection. According to the AAISM framework, prompt injection is the act of deliberately crafting malicious or manipulative inputs to override, bypass, or exploit the model's intended controls. In this case, the attacker is targeting the integrity of the model's outputs by exploiting…

AI Security Design and Implementation

Question

Options

APrompt injection
BJailbreaking
CRemote code execution
DEvasion

How the community answered

(39 responses)

A
90% (35)
B
3% (1)
C
3% (1)
D
5% (2)

Explanation

According to the AAISM framework, prompt injection is the act of deliberately crafting malicious or manipulative inputs to override, bypass, or exploit the model's intended controls. In this case, the attacker is targeting the integrity of the model's outputs by exploiting weaknesses in how it interprets and processes prompts. Jailbreaking is a subtype of prompt injection specifically designed to override safety restrictions, while evasion attacks target classification boundaries in other ML contexts, and remote code execution refers to system-level exploitation outside of the AI inference context. The most accurate classification of this attack is prompt injection.

Topics

#LLM security#Prompt injection#Attack types#AI vulnerabilities

Community Discussion

No community discussion yet for this question.

Full AAISM Practice