Real-time glare detection and luminance reconstruction

Published research Jan 2024

Overview

Conventional visual-comfort assessment often depends on high-dynamic-range image capture and time-consuming calibration. This project investigated a faster image-based workflow for reconstructing luminance information from a single exposure.

Grid of fisheye scenes comparing the input image, reference luminance map, and reconstructions from several methods in false colour.
Reconstructed luminance maps compared with the reference across a range of indoor daylight scenes.

Method

A two-step network, SingleLM-Net, was developed to transform a low-dynamic-range fisheye image into a luminance map suitable for visual-comfort analysis. The first stage restores information in under- and overexposed regions using a generative adversarial network; the second reconstructs luminance values with a U-Net-based model. Training and evaluation used a dataset of 884 scenes, each assembled from 15 exposure levels.

Diagram showing a low dynamic range fisheye image passing through an LDR-GAN and a reconstruction network to produce a luminance map.
SingleLM-Net: a single low dynamic range fisheye image is restored, then converted to a luminance map.
Architecture of the generative adversarial network with downsampling and upsampling paths and residual blocks.
Architecture of the restoration stage, which recovers detail in under- and overexposed regions.

Key findings

The method achieved a peak signal-to-noise ratio of 59.24 and an R² of 0.9054 for daylight glare probability on the test set. It processed each image in approximately 0.1 seconds on an RTX 2060 GPU and reduced processing time by up to 95 times compared with the conventional HDR workflow.

Scatter plot of vertical illuminance from the reconstructed HDR image against illuminance meter readings, with an R-squared of 0.9411.
Field validation against illuminance-meter readings (R² = 0.9411).

Contribution

Conceptualization, data curation, methodology, software, visualization, and original-draft writing.