Pix2Pix GAN for Realistic Lung CT scans Generation from COVID-19 Lesion Masks

Vikraant Gopal Sharma, Vedant Mehul Oza, Prathamesh Rajesh Panchal * and Meet Ashok Nadoda

Department Electronics and Computer Science Thakur College of Engineering and Technology Mumbai, India.
 
International Journal of Science and Research Archive, 2024, 13(02), 304–309.
Article DOI: 10.30574/ijsra.2024.13.2.2083
Publication history: 
Received 23 September 2024; revised on 31 October 2024; accepted on 02 November 2024
 
Abstract: 
GANs have recently become one of the most promising directions of machine learning for generative tasks in deep learning. By using architectures such as CNN, GANs can learn relationships in input data without any human intervention and generate new examples that are similar to the original data set. This paper aims at understanding what GANs are and how they work, and the different types of GAN models with a special focus on their application in image synthesis,  style transfer, and text-to-image synthesis. The GAN framework consists of two neural networks: The two primary components of the model are the Generator and the Discriminator. The generator’s goal is to generate ‘realistic’ data such that the discriminator cannot differentiate between the two, while the discriminator’s goal is to distinguish between the real and the fake data. Some other GAN variants include Vanilla GAN, conditional GAN (CGAN), Deep Convolutional GAN (DCGAN), Laplacian Pyramid GAN (LAPGAN) and Super Resolution GAN (SRGAN), all of which have made significant improvements in producing convincing images. The structures of the generator model, which produces data from noise, and the discriminator model, which checks the validity of the data produced, are also considered. The study focuses on the concept of loss functions including the generator loss, discriminator loss and minimax loss in the training of GANs. Pre- processing the data for GAN training is a very crucial step that requires careful consideration as well as data cleaning. This is because when using content               and adversarial loss functions simultaneously, it is easier to find the right balance between the photorealism of the images and their structural similarity to the source material. By training carefully and iterating over the process, GANs exhibit high performance in sample generation, thereby leading to the new state of generative modeling. It will be beneficial for any researcher or practitioner by providing an understanding of artificial intelligence and generative modeling
 
Keywords: 
Machine Learning; GANs; CNN; Deep Learning; Mean Absolute Error; Others
 
Full text article in PDF: