Perceptual Adversarial Networks for Image-to-Image Transformation
- Publication Type:
- Journal Article
- Citation:
- IEEE Transactions on Image Processing, 2018, 27 (8), pp. 4066 - 4079
- Issue Date:
- 2018-08-01
Closed Access
| Filename | Description | Size | |||
|---|---|---|---|---|---|
| 08358814.pdf | Published Version | 3.85 MB |
Copyright Clearance Process
- Recently Added
- In Progress
- Closed Access
This item is closed access and not available.
© 1992-2012 IEEE. In this paper, we propose perceptual adversarial networks (PANs) for image-to-image transformations. Different from existing application driven algorithms, PAN provides a generic framework of learning to map from input images to desired images (Fig. 1), such as a rainy image to its de-rained counterpart, object edges to photos, and semantic labels to a scenes image. The proposed PAN consists of two feed-forward convolutional neural networks: the image transformation network T and the discriminative network D. Besides the generative adversarial loss widely used in GANs, we propose the perceptual adversarial loss, which undergoes an adversarial training process between the image transformation network T and the hidden layers of the discriminative network D. The hidden layers and the output of the discriminative network D are upgraded to constantly and automatically discover the discrepancy between the transformed image and the corresponding ground truth, while the image transformation network T is trained to minimize the discrepancy explored by the discriminative network D. Through integrating the generative adversarial loss and the perceptual adversarial loss, D and T can be trained alternately to solve image-to-image transformation tasks. Experiments evaluated on several image-to-image transformation tasks (e.g., image de-raining and image inpainting) demonstrate the effectiveness of the proposed PAN and its advantages over many existing works.
Please use this identifier to cite or link to this item: