Cloud-Stereo: A Dataset and Benchmark for Reconstructing Atmospheric Clouds from Stereo Images


Jacob Lin (University of Oxford), Edward Gryspeerdt (Imperial College London), Ronald Clark (University of Oxford)
The 35th British Machine Vision Conference
PDFPosterVideo (Right click to download)Supplementary

Abstract

Obtaining accurate measurements of clouds is a critical problem in atmospheric physics, as accurate modeling of cloud properties allows us to better understand and predict climate change. Stereo camera networks have shown promise in obtaining such measurements, being able to reconstruct detailed cloud fields over multi-km$^2$ domains. However, previous studies on cloud stereo depth estimation have been limited to using traditional (non-learned) matching techniques, due to the absence of suitable training datasets for this challenging domain. In this work, we present a novel dataset (Cloud-Stereo) specifically tailored for cloud depth estimation. The Cloud-Stereo dataset includes: 1) a synthetic dataset for training, comprising 3000 stereo pairs and simulated dense LiDAR depth data, and 2) a high-accuracy real-world dataset consisting of $\approx 120k$ frames acquired from a stereo camera and Doppler Aerosol LiDAR for testing. Using our dataset we benchmark existing learning and non-learning based stereo depth estimation approaches, and demonstrate that fine-tuning on our dataset can lead to significant accuracy improvement for learned methods. We believe this dataset will enable the training of future, more accurate, methods for cloud field reconstruction, enhancing a unique measurement capability for developing and evaluating atmospheric models. The dataset is available at https://cloud-stereo.jacob-lin.com/.

Citation

@inproceedings{Lin_2025_BMVC,
author    = {Jacob Lin and Edward Gryspeerdt and Ronald Clark},
title     = {Cloud-Stereo: A Dataset and Benchmark for Reconstructing Atmospheric Clouds from Stereo Images},
booktitle = {36th British Machine Vision Conference 2025, {BMVC} 2025, Sheffield, UK, November 24-27, 2025},
publisher = {BMVA},
year      = {2025},
url       = {https://bmva-archive.org.uk/bmvc/2025/assets/papers/Paper_835/paper.pdf}
}


Copyright © 2025 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection