Supporting data for "High-fidelity Wheat Plant Reconstruction using 3D Gaussian Splatting and Neural Radiance Fields"

Abstract

The reconstruction of 3D plant models can offer advantages over traditional 2D approaches by more accurately capturing the complex structure and characteristics of different crops. Conventional 3D reconstruction techniques often produce sparse or noisy representations of plants using software, or are expensive to capture in hardware. Recently, view synthesis models have been developed that can generate detailed 3D scenes, and even 3D models, from only RGB images and camera poses. These models offer unparalleled accuracy, but are currently data hungry, requiring large numbers of views with very accurate camera calibration.
In this study, we present a view synthesis dataset comprising 20 individual wheat plants captured across 6 different time frames over a 15 week growth period. We develop a camera capture system using two robotic arms combined with a turntable, controlled by a re-deployable and flexible image capture framework. We trained each plant instance using two recent view synthesis models: 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF).
Our results show that both 3DGS and NeRF produce high-fidelity reconstructed images of a plant subject from views not captured in the initial training sets. We also show that these approaches can be used to generate accurate 3D representations of these plants as point clouds, with 0.74 mm and 1.43 mm average accuracy compared with a handheld scanner for 3DGS and NeRF respectively.
We believe that these new methods will be transformative in the field of 3D plant phenotyping, plant reconstruction and active vision. To further this cause, we release all robot configuration and control software, alongside our extensive multi-view dataset. We also release all scripts necessary to train both 3DGS and NeRF, all trained models data, and final 3D point cloud representations.

Citation

(2025). Supporting data for "High-fidelity Wheat Plant Reconstruction using 3D Gaussian Splatting and Neural Radiance Fields". [Data]. https://doi.org/10.5524/102661

• Publication Date: Feb 12, 2025
• Deposit Date: Mar 3, 2025
• DOI: https://doi.org/10.5524/102661
• Keywords: 3d gaussian splatting, 3dgs, neural radiance fields, nerf. 3d reconstruction
• Public URL: https://nottingham-repository.worktribe.com/output/45435468
• Publisher URL: https://gigadb.org/dataset/102661
• Type of Data: Phenotyping, Imaging, Software
• Collection Date: Mar 4, 2024