1- ICT Research Institute Tehran, Iran , farhoodi@itrc.ac.ir
2- ICT Research Institute Tehran, Iran
Abstract: (123 Views)
The ParsiAzma challenges in 2023 focused on Improving Persian text analysis in social media. We designed four shared tasks: stance detection, sentiment analysis, emotion detection, and claim detection in social media posts. The goal of these challenges was to bring together various teams to develop the best models for these challenges and to establish a standard test platform for future Persian language research. A total of 28 teams participated, competing to solve the specified tasks. The most effective models in all shared tasks utilized the BERT model. Text embedding was first obtained using a BERT-based model, followed by final predictions with either an MLP or CNN. Additionally, several meta-classifiers were developed as fusion models to leverage the strengths of individual models. The best results based on accuracy criteria for the four challenges—stance detection, sentiment analysis, emotion recognition, and claim detection—were 0.67, 0.67, 0.45, and 0.56, respectively. These results indicate that emotion detection has lower accuracy than the other three tasks, highlighting its complexity.
Bidirectional Encoder Representations from Transformers
Convolutional Neural Network