EURO 2024 Copenhagen
Abstract Submission

EURO-Online login

3574. Optimization-based algorithm for robustness enhancement of neural networks

Invited abstract in session TA-4: Topics in Mixed Integer Programming and Nonconvex Optimization, stream MINLP.

Tuesday, 8:30-10:00
Room: 1001 (building: 202)

Authors (first author is the speaker)

1. Shudian Zhao
Department of Mathematics, KTH Royal Institute of Technology
2. Jan Kronqvist
Mathematics, KTH Royal Institute of Technology

Abstract

This talks introduce an optimisation-based method for generating robust neural networks against adversarial attacks for image classifications. Instead of using large training data and heaving computing expense in classic training process, the proposed method only requires a small size of adversarial dataset in each outer iteration to improve the robustness a model trained with default settings. This algorithm includes two levels of updating. In the inner iteration, we add cuts to improve the linear approximation for the nonlinear constraints regarding the adversary behaviour and level of loss function. Then, to balance the performance of the model on both clean dataset and the adversarial dataset, we select the Pareto set by line search and update the model with a weighted objective function. In the outer iteration, we generate new adversarial data and repeat the same process until stopping criteria are satisfied. This talk concludes with numerical restyle with CNN and ResNet models.

Keywords

Status: accepted


Back to the list of papers