logo

SCIENCE CHINA Information Sciences, Volume 60, Issue 11: 110101(2017) https://doi.org/10.1007/s11432-016-9229-y

Encoding syntactic representations with a neural network for sentiment collocation extraction

More info
  • ReceivedJan 24, 2017
  • AcceptedMay 8, 2017
  • PublishedOct 16, 2017

Abstract

Sentiment collocation refers to the collocation of a target word and a polarity word.Sentiment collocation extraction aims to extract the targets and their modifying polarity words by analyzing the relationships between them.This can be regarded as a basic sentiment analysis task and is relevant in many practical applications.Previous studies relied mainly on the syntactic path, which is used to connect the target word and the polarity word.To deeply exploit the semantic information of the syntactic path,we propose two types of syntactic representation, namely, relation embedding and subtree embedding,to capture the latent semantic features.Relation embedding is used to represent the latent semantics between targets and their corresponding polarity words,and subtree embedding is used to explore the rich syntactic information for each word on the path.To combine the two types of syntactic representations,a neural network is constructed.We use a recursive neural network (RNN) to model the subtree embeddings, andcolorblack


References

[1] Pang B, Lee L. Opinion Mining and Sentiment Analysis. FNT Inf Retrieval, 2008, 2: 1-135 CrossRef Google Scholar

[2] Liu B. Sentiment analysis and opinion mining. Synth Lect Human Language Tech, 2012, 5: 1--167. Google Scholar

[3] Abbasi A, Chen H, Salem A. Sentiment analysis in multiple languages: feature selection for opinion classification in web forums. ACM Trans Inf Syst, 2008, 26: 1--34. Google Scholar

[4] Duric A, Song F. Feature selection for sentiment analysis based on content and syntax models. Decision Support Syst, 2012, 53: 704-711 CrossRef Google Scholar

[5] Bloom K, Garg N, Argamon S. Extracting appraisal expressions. In: Proceedings of Human Language Technologies: the Annual Conference of the North American Chapter of the Association for Computational Linguistics, Rochester, 2007. 308--315. Google Scholar

[6] Qiu G, Liu B, Bu J J, et al. Opinion word expansion and target extraction through double propagation. Comput Linguist, 2011, 37: 9--27. Google Scholar

[7] Xu L H, Liu K, Lai S, et al. Mining opinion words and opinion targets in a two-stage framework. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, Sofia, 2013. 1764--1773. Google Scholar

[8] Zhao Y Y, Che W X, Guo H L, et al. Sentence compression for target-polarity word collocation extraction. In: Proceedings of the 25th International Conference on Computational Linguistics: Technical Papers, Dublin, 2014. 1360--1369. Google Scholar

[9] Zhao Y Y, Li S Q, Qin B, et al. Encoding dependency representation with convolutional neural network for target-polarityword collocation extraction. In: Social Meida Processing. Singapore: Springer, 2016. Google Scholar

[10] Chen Y B, Xu L, Liu K, et al. Event extraction via dynamic multi-pooling convolutional neural networks. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, 2015. 167--176. Google Scholar

[11] Liu Y, Wei F R, Li S J, et al. A dependency-based neural network for relation classification. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, 2015. 285--290. Google Scholar

[12] Meng F D, Lu Z D, Wang M X, et al. Encoding source language with convolutional neural network for machine translation. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, 2015. 20--30. Google Scholar

[13] Nguyen T H, Grishman R. Event detection and domain adaptation with convolutional neural networks. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, 2015. 365--371. Google Scholar

[14] Vu N T, Adel H, Gupta P, et al. Combining recurrent and convolutional neural networks for relation classification. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, 2016. 534--539. Google Scholar

[15] Lee J Y, Dernoncourt F. Sequential short-text classification with recurrent and convolutional neural networks. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, 2016. 515--520. Google Scholar

[16] Zhao J, Xu H B, Huang X J, et al. Overview of chinese pinion analysis evaluation 2008. Proceedings of the 1st Chinese Opinion Analysis Evaluation (COAE), 2008. Google Scholar

[17] Che W X, Li Z H, Liu T. LTP: a chinese language technology platform. In: Proceedings of the 23rd International Conference on Computational Linguistics: Demonstrations, Beijing, 2010. 13--16. Google Scholar

[18] Joachims T. Learning to Classify Text Using Support Vector Machines -- Methods, Theory, and Algorithms. Norwell: Kluwer Academic Publishers, 2002. Google Scholar

[19] Gui L, Zhou Y, Xu R F, et al. Learning representations from heterogeneous network for sentiment classification of product reviews. Knowledge-Based Syst, 2017, 124: 34--45. Google Scholar

[20] Chen T, Xu R, He Y. Learning User and Product Distributed Representations Using a Sequence Model for Sentiment Analysis. IEEE Comput Intell Mag, 2016, 11: 34-44 CrossRef Google Scholar

[21] Hu M Q, Liu B. Mining and summarizing customer reviews. In: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, 2004. 168--177. Google Scholar

[22] dos Santos C, Xiang B, Zhou B. Classifying relations by ranking with convolutional neural networks. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, 2015. 626--634. Google Scholar

[23] Kim Y. Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, 2014. 1746--1751. Google Scholar

[24] Ma M B, Huang L, Xiang B, et al. Dependency-based convolutional neural networks for sentence embedding. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, 2015. 174--179. Google Scholar

Copyright 2019 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有

京ICP备18024590号-1