0% Complete
فارسی
Home
/
چهاردهمین کنفرانس بین المللی فناوری اطلاعات و دانش
Improving Training Stability in Variational Autoencoders Through the Integration of Score Matching Loss
Authors :
Amirreza Mokhtari Rad
1
Pouya Ardehkhani
2
Hormehr Alborzi
3
1- پردیس فارابی دانشگاه تهران
2- پردیس فارابی دانشگاه تهران
3- پردیس فارابی دانشگاه تهران
Keywords :
Variational Auto Encoder،Training،Stability،Generative Models،Score Matching
Abstract :
In this research, a Variational Autoencoder (VAE) model was developed, and the CIFAR100 dataset was employed as the primary data source. The problem addressed pertained to the instability in the training process of VAE models. To mitigate this issue, various loss expressions were explored, including the use of score matching loss independently, in conjunction with total variation loss, and in combination with reconstruction loss. The innovative approach revealed that when score matching loss was integrated either with total variation loss or when applied as a standalone loss function, the training process exhibited increased stability. This was evident through smoother loss curves and latent space visualizations that displayed characteristics akin to a normal distribution. As a consequence, this novel approach promises the potential for building more stable generative models, which can significantly enhance the overall training process in VAEs. This innovation provides a valuable contribution to the field of generative modeling, with the prospect of addressing the longstanding challenge of training stability in VAEs, thereby opening avenues for more efficient and effective model development and application.
Papers List
List of archived papers
Challenges of Specification Mining-based Test Oracle for Cyber-Physical Systems
Maryam Raiyat Aliabadi - Dr Mojtaba Vahidi - Dr Ramak Ghavamizadeh
Identifying Children's Personality Styles through Drawing Analysis using Machine Learning
Maedeh Mosharraf - Faezeh Banabazi
A Comparison between Slimed Network and Pruned Network for Head Pose Estimation
Amir Salimiparsa - Hadi Veisi - Mohammad-shahram Moin
UltraLearn: Next-Generation CyberSecurity Learning Platform
Saeed Raisi - Saeid Ghasemshirazi - Ghazaleh Shirvani
خوشه بندی مقید داده ها به کمک اتوماتای یادگیر سلولی
شکوفه علی محمدی - احمدعلی آبین
Sigma: A Secure Federated Network Gaming Platform
Keyhan Mohammadi - Reza Ebrahimi Atani
رویکردی در تشخیص خودکار بوهای بد در مدل های معماری سازمانی با استفاده از تحلیل گرافی
زهرا رحیمی تمندگانی - شهره آجودانیان
Sentiment Analysis of the Amazon Customers Using the BiGRU Neural Network Enhanced by Attention Mechanism
Sara Sinan Salman al-Abedi - Keyvan Mohebbi
AI-based Message Spam Classification Framework for Secure Autonomous Vehicles Communication
Riya Upadhyay - Mili Virani - Lakshit Pathak - Rajesh Gupta - Sudeep Tanwar - Hossein Shahinzadeh
A Novel Service Deployment Policy in Fog Computing Considering The Degree of Availability and Fog Landscape Utilization Using Multiobjective Evolutionary Algorithms
Maryam Eslami - Dr Mehdi Sakhaei-nia
more
Samin Hamayesh - Version 42.5.2