USURP: Universal Single-Source Adversarial Perturbations on Multimodal Emotion Recognition
- Publisher:
- IEEE
- Publication Type:
- Conference Proceeding
- Citation:
- 2023 IEEE International Conference on Image Processing (ICIP), 2023, 00, pp. 2150-2154
- Issue Date:
- 2023-09-11
Closed Access
| Filename | Description | Size | |||
|---|---|---|---|---|---|
| USURP_ Universal Single-Source Adversarial Perturbations on Multimodal Emotion Recognition_published.pdf | Published version | 1.1 MB |
Copyright Clearance Process
- Recently Added
- In Progress
- Closed Access
This item is closed access and not available.
The field of affective computing has progressed from traditional unimodal analysis to more complex multimodal analysis due to the proliferation of videos posted online Multimodal learning has shown remarkable performance in emotion recognition tasks but its robustness in an adversarial setting remains unknown This paper investigates the robustness of multimodal emotion recognition models against worst case adversarial perturbations on a single modality We found that standard multimodal models are susceptible to single source adversaries and can be easily fooled by perturbations on any single modality We draw some key observations that serve as guidelines for designing universal adversarial attacks on multimodal emotion recognition models Motivated by these findings we propose a novel universal single source adversarial perturbations framework on multimodal emotion recognition models USURP Through our analysis of adversarial robustness we demonstrate the necessity of studying adversarial attacks on multimodal models Our experimental results show that the proposed USURP method achieves high attack success rates and significantly improves adversarial transferability in multimodal settings The observations and novel attack methods presented in this paper provide a new understanding of the adversarial robustness of multimodal models contributing to their safe and reliable deployment in more real world scenarios
Please use this identifier to cite or link to this item: