Chat
Computer Science · MapleScholar Plus

Spiking the Data Well: How a 2012 Paper Showed Hackers Could Poison AI Brains

Computer scientists spent decades defending software from malicious executable code; Battista Biggio proved that artificial intelligence can be corrupted by quietly spiking its training data. Published in 2012 when machine learning was still a niche academic field, this foundational paper founded the modern discipline of AI data security and model supply-chain defense.

Author
Battista Biggio et al.
Published
2012
Journal
arXiv (Cornell University)
Last updated
September 2026
Spiking the Data Well: How a 2012 Paper Showed Hackers Could Poison AI Brains

In cybersecurity, firewalls and antivirus scanners were built to stop hackers from executing unauthorized software code on computer servers. When the world switched to artificial intelligence, developers naively assumed that feeding computers vast amounts of public web data was completely harmless.

Researchers proved that hackers could poison an AI without writing a single line of malicious code. By injecting a tiny handful of carefully crafted fake data points into the training dataset—like dropping an invisible drop of toxin into a municipal reservoir—an attacker can secretly blind the AI to specific threats.

Ignored before the deep learning boom, this paper founded the field of AI supply-chain security. By teaching engineers to sanitize training datasets, by defending autonomous vehicle vision systems from sabotage, and by protecting enterprise AI from backdoors, data poisoning defense safeguards artificial intelligence.

Reference

Biggio, B., Nelson, B., & Laskov, P. (2012). Poisoning Attacks against Support Vector Machines (Version 3). arXiv.

Title

Poisoning Attacks against Support Vector Machines

Abstract

We investigate a family of poisoning attacks against Support Vector Machines (SVM). Such attacks inject specially crafted training data that increases the SVM's test error. Central to the motivation for these attacks is the fact that most learning algorithms assume that their training data comes from a natural or well-behaved distribution. However, this assumption does not generally hold in security-sensitive settings. As we demonstrate, an intelligent adversary can, to some extent, predict the change of the SVM's decision function due to malicious input and use this ability to construct malicious data. The proposed attack uses a gradient ascent strategy in which the gradient is computed based on properties of the SVM's optimal solution. This method can be kernelized and enables the attack to be constructed in the input space even for non-linear kernels. We experimentally demonstrate that our gradient ascent procedure reliably identifies good local maxima of the non-convex validation error surface, which significantly increases the classifier's test error.

Cited 740 times · View on doi.org

Continue

Continue Exploring

Ask this paper your own questions, or keep browsing the verified research catalogue.