The impact of BERT-infused deep learning models on sentiment analysis accuracy in financial news

Abstract

This study delves into the enhancement of sentiment analysis accuracy within the financial news domain through the integration of bidirectional encoder representations from transformers (BERT) with traditional deep learning models, including artificial neural networks (ANN), long short-term memory (LSTM) networks, gated recurrent units (GRU), and convolutional neural networks (CNN). By employing a comprehensive method encompassing data preprocessing, polarity analysis, and the application of advanced neural network architectures, we investigate the impact of incorporating BERT’s contextual embeddings on the models’ sentiment classification performance. The findings reveal significant improvements in model accuracy, precision, recall, and F1 scores when BERT is integrated, surpassing both traditional sentiment analysis models and contemporary natural language processing (NLP) transformers. This research contributes to the body of knowledge in financial sentiment analysis by demonstrating the potential of combining deep learning and NLP technologies to achieve a more nuanced understanding of financial news sentiment. The study’s insights advocate for a shift towards sophisticated, context-aware models, highlighting the pivotal role of transformer-based techniques in advancing the field.