This work explores approaches to the structure-from-motion problem [1] by employing well-established methods to reconstruct 3D objects from various selected yet limited 2D image sets. We utilize synthetically generated views (Fig. 1a) of textured meshes rendered with PyTorch3D [2] with variable image quality, as well as photographs of objects from the natural world (Fig. 1b). Reconstructing 3D meshes from any given image set requires knowledge of the camera positions from which the shots were taken. Neither of the selected approaches to create datasets (synthetic or natural) did not involve a way of logging camera positions. To locate those positions, COLMAP package [3] was used to select intrinsic features of images, mark them as points within the pictures, cross-match them, and find a global solution (Fig. 1c). However, achieving a successful reconstruction of any given scene is not straightforward. Therefore, this work investigates the minimal quantity and quality of images required in various controlled synthetically generated datasets to ensure a robust reconstruction. Using the extracted camera view positions, we employ the Neural Radiance Field method (NeRF) to synthesize novel views and generate a point cloud much more detailed than that obtained by COLMAP. The model used in this study is similar to the one presented in the original paper [4] introducing the concept of NeRFs. Such model utilizes a volumetric method to project rays out of the picture, interacting with pixel data, to reconstruct object
’s density in 3D space. Synthetically generated models with recovered camera positions were employed to recreate 3D meshes (Fig. 1d) and explore the results achievable with limited quality and quantity image sets. Finally, natural world images were used to create acceptable quality meshes and 3D scene reconstructions.
