Multimodal negative sentiment recognition of online public opinion on public health emergencies based on graph convolutional networks and ensemble learning |
| |
| Institution: | 1. School of Information Management, Wuhan University, Wuhan, 430072, China;2. Center for Studies of Information Resources, Wuhan University, Wuhan, 430072, China;1. Department of Computer Science & Automation, Indian Institute of Science, Bengaluru, India;2. Department of Computer Science & Engineering and Information Technology, Jaypee Institute of Information Technology, Noida-62, Uttar Pradesh, India |
| |
| Abstract: | To improve the effect of multimodal negative sentiment recognition of online public opinion on public health emergencies, we constructed a novel multimodal fine-grained negative sentiment recognition model based on graph convolutional networks (GCN) and ensemble learning. This model comprises BERT and ViT-based multimodal feature representation, GCN-based feature fusion, multiple classifiers, and ensemble learning-based decision fusion. Firstly, the image-text data about COVID-19 is collected from Sina Weibo, and the text and image features are extracted through BERT and ViT, respectively. Secondly, the image-text fused features are generated through GCN in the constructed microblog graph. Finally, AdaBoost is trained to decide the final sentiments recognized by the best classifiers in image, text, and image-text fused features. The results show that the F1-score of this model is 84.13% in sentiment polarity recognition and 82.06% in fine-grained negative sentiment recognition, improved by 4.13% and 7.55% compared to the optimal recognition effect of image-text feature fusion, respectively. |
| |
| Keywords: | |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
