Query-Free Adversarial Transfer via Undertrained Surrogates

Adversarial transferability by surrogate and target model training epoch (lower values indicate greater transferability).

Abstract

Deep neural networks are vulnerable to adversarial examples—minor perturbations added to a model’s input which cause the model to output an incorrect prediction. We introduce a new method for improving the efficacy of adversarial attacks in a black-box setting by undertraining the surrogate model which the attacks are generated on. Using two datasets and five model architectures, we show that this method transfers well across architectures and outperforms state-of-the-art methods by a wide margin. We interpret the effectiveness of our approach as a function of reduced surrogate model loss function curvature and increased universal gradient characteristics, and show that our approach reduces the presence of local loss maxima which hinder transferability. Our results suggest that finding strong single surrogate models is a highly effective and simple method for generating transferable adversarial attacks, and that this method represents a valuable route for future study.

Publication
arXiv

Click the Cite button above to demo the feature to enable visitors to import publication metadata into their reference management software.

Supplementary notes can be added here, including code, math, and images.

Chris Miller
Chris Miller
Software Engineer & Incoming PhD Student

I’m a software developer at Microsoft working on Azure services, and an incoming PhD student at USC Viterbi.