Publications
JOURNAL (INTERNATIONAL) Contextual Sentiment Neural Network for Document Sentiment Analysis
Tomoki Ito (The University of Tokyo), Kota Tsubouchi, Hiroki Sakaji (The University of Tokyo), Kiyoshi Izumi (The University of Tokyo), and Tatsuo Yamashita
Data Science and Engineering (DSEJ)
June 12, 2020
Although deep neural networks are excellent for text sentiment analysis, their applications in real-world practice are occasionally limited owing to their black-box property. In this study, we propose a novel neural network model called contextual sentiment neural network (CSNN) model that can explain the process of its sentiment analysis prediction in a way that humans find natural and agreeable and can catch-up the summary of the contents. The CSNN has the following interpretable layers: the word-level original sentiment layer, word-level sentiment shift layer, word-level global importance layer, word-level contextual sentiment layer, and concept-level contextual sentiment layer. Because of these layers, this network can explain the process of its document-level sentiment analysis results in a human-like way using these layers. Realizing the interpretability of each layer in the CSNN is a crucial problem in the development of this CSNN because the general back-propagation method cannot realize such interpretability. To realize this interpretability, we propose a novel learning strategy called initialization propagation (IP) learning. Using real textual datasets, we experimentally demonstrate that the proposed IP learning is effective for improving the interpretability of each layer in CSNN. We then experimentally demonstrate that the CSNN has both the high predictability and high explanation ability.
Paper :
Contextual Sentiment Neural Network for Document Sentiment Analysis
(external link)