Dual Word Embedding Framework for Gender-Based Writing Style Analysis Using Word2Vec and BERT

Social media has evolved into a vast and multifaceted data repository, presenting valuable opportunities to investigate gender-based variations in writing styles. This study aims to enhance the precision of gender classification on Twitter text by leveraging a combined word embedding approach. The paper proposes a framework that utilizes two distinct word embedding models - a combination of GloVe and BERT, as well as GloVe and Word2Vec - to capture both global and contextual linguistic nuances within the text. The dataset comprises a comprehensive collection of tweets and user profile descriptions harvested from Twitter, which underwent meticulous preprocessing and word representation steps before being further processed using the robust Random Forest algorithm. The experimental findings indicate that the combination of GloVe and BERT outperforms the other combination of GloVe and Word2Vec, and also surpasses the performance of single embedding models, with 62.93% accuracy being the highest achieved result. This study provides valuable insights into the potential of combined word embedding techniques for enhancing the accuracy of gender classification in social media text analysis.