Evaluation of synthetic aerial imagery using unconditional generative adversarial networks

Yates, Matthew; Hart, Glen; Houghton, Robert; Torres Torres, Mercedes; Pound, Michael

Abstract

Image generation techniques, such as generative adversarial networks (GANs), have become sufficiently sophisticated to cause growing concerns around the authenticity of images in the public domain. Although these generation techniques have been applied to a wide range of images, including images with objects and faces, there are comparatively few studies focused on their application to the generation and subsequent evaluation of Earth Observation (EO) data, such as aerial and satellite imagery. We examine the current state of aerial image generation by training state-of-the-art unconditional GAN models to generate realistic aerial imagery. We train PGGAN, StyleGAN2 and CoCoGAN models using the Inria Aerial Image benchmark dataset, and quantitatively assess the images they produce according to the Fréchet Inception Distance (FID) and the Kernel Inception Distance (KID). In a paired image human detection study we find that current synthesised EO images are capable of fooling humans and current performance metrics are limited in their ability to quantify the perceived visual quality of these images.

Citation

Yates, M., Hart, G., Houghton, R., Torres Torres, M., & Pound, M. (2022). Evaluation of synthetic aerial imagery using unconditional generative adversarial networks. ISPRS Journal of Photogrammetry and Remote Sensing, 190, 231-251. https://doi.org/10.1016/j.isprsjprs.2022.06.010

• Journal Article Type: Article
• Acceptance Date: Jun 16, 2022
• Online Publication Date: Jun 28, 2022
• Publication Date: 2022-08
• Deposit Date: Feb 28, 2025
• Publicly Available Date: Mar 11, 2025
• Journal: ISPRS Journal of Photogrammetry and Remote Sensing
• Print ISSN: 0924-2716
• Electronic ISSN: 0924-2716
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 190
• Pages: 231-251
• DOI: https://doi.org/10.1016/j.isprsjprs.2022.06.010
• Keywords: Machine learning, Deep learning, Generative adversarial networks, Aerial imagery
• Public URL: https://nottingham-repository.worktribe.com/output/45859122
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S0924271622001678?via%3Dihub
• Additional Information: This article is maintained by: Elsevier; Article Title: Evaluation of synthetic aerial imagery using unconditional generative adversarial networks; Journal Title: ISPRS Journal of Photogrammetry and Remote Sensing; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.isprsjprs.2022.06.010; Content Type: article; Copyright: © 2022 The Author(s). Published by Elsevier B.V. on behalf of International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS).