Advances in artificial intelligence-driven 3D model generation: a review of GAN and VAE methodologies

Abstract

This paper offers a comprehensive review of current developments in artificial intelligence (AI)-based 3D model creation, with an emphasis on techniques utilizing variational autoencoders (VAEs) and generative adversarial networks (GANs). 3DGAN, paired 3D model generation with GAN, conditional GAN, FaceVAE, voxel-based 3D object reconstruction, and 3D-VAE-SDFRaGAN are the six main techniques that are studied in this work. Each method is discussed, highlighting its architectural framework, data representation, and specific approach to generating 3D models. First, the paper introduces basic terms and classical 3D modeling techniques and provides a comparative analysis of them based on their workflow, purpose and field of application. In subsequent chapters, methods for generating 3D models based on the use of GANs and VAEs are reviewed, describing its methodology, experimentation technique, results, and comparison with other methods. The review outlines the strengths and limitations of each approach and their applications in object reconstruction, shape generation, and maintaining model consistency. It concludes by emphasizing how AI-driven methods can advance 3D modeling, underscoring the need for further research to enhance quality, control, and training reliability. The findings show AI’s significant impact on automating complex modeling tasks and enabling new creative opportunities in 3D content development.