Research on Text Classification based on Deep Learning

Authors

  • Bo He
  • Lili Zhu
  • Xiao Wang
  • Huanli Zhang
  • Jiaoqiu Shi

DOI:

https://doi.org/10.54691/sjt.v4i7.1286

Keywords:

Neural Networks; Text Classification; Deep Learning.

Abstract

Text classification is a fundamental task in natural language processing, and machine learning and deep learning have seen more research and great progress in this task. In this paper, we introduce the current state of research and analyse the application of deep learning networks to text classification, based on the concept of text classification, feature extraction, text representation and other related techniques and text classification methods.

Downloads

Download data is not yet available.

References

Lin Yiyang. The importance of natural language processing technology [J]. Digital Communication World, 2018, 158(02):186-187.

Wang Kui, Liu Bosong. A Review of Text Classification Research [J]. Data Communication, 2019, 11(03): 37-47.

Kim Y. Convolutional neural networks for sentence classification[C]//Proceedings of the 2014 Conference on Empir.

Ding Zeyuan. Chinese Biomedical Text Information Extraction Based on Deep Learning [D]. Dalian: Dalian University of Technology, 2020.

KIM Y. Convolutional neural networks for sentence classification[C]// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014: 1746-1751.

ZHANG X, ZHAO J, LECUN Y. Character-level convolutional networks for text classification[C]// Advances in Neural Information Processing Systems. 2015: 649-657.

LIU P, QIU X, HUANG X. Recurrent Neural Network for Text Classification with Multi-Task Learning[C]// Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016: 2873– 2879.

YANG Z, YANG D, DYER C, et al. Hierarchical Attention Networks for Document Classification[C]// Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2016: 1480–1489.

BRUNA J, ZAREMBA W, SZLAM A, et al. Spectral networks and locally connected networks on graphs [J]. Proceedings of the International Conference on Learning Representations. arXiv: 1312.6203, 2013.

CHUNG FRK. Spectral Graph Theory[EB/OL]. http://www.ams.org/books/cbms/092/.

SANDRYHAILA A, MOURA J.M.F. Discrete Signal Processing on Graphs[J]. IEEE Trans. On Signal Processing, 2014, 62(12): 3042-3054.

SHUMAN D I, NARANG S K, FROSSARD P, et al. The EmergingField of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains[J]. IEEE Signal Processing Magazine, 2013, 30(3):83-98.

DEFFERRARD M, BRESSON X, VANDERGHEYNST P. Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering[C]// Advances in Neural Information Processing Systems. 2016: 3844-3852.

YAO L, MAO C, LUO Y. Graph Convolutional Networks for Text Classification[C]// Proceedings of the 33rd AAAI Conference on Artificial Intelligence. 2019: 7370–7377.

KIPF T N, WELLING M. Semi-Supervised Classification with Graph Convolutional Networks[C]// Proceedings of the 5th International Conference on Learning Representations. 2017: 1-13.

LIU X, YOU X, ZHANG X, et al. Tensor graph convolutional networks for text classification[C]// Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020: 8409-8416. [57]WU F, ZHANG T, SOUZA A, et al. Simplifying graph convolutional networks[C]// Proceedings of 36th International Conference on Machine Learning. 2019: 6861-6871. [58]HUANG L, MA D, LI S, et al. Text Level Graph Neural Network for Text Classification[C]// Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. 2019: 3442-3448.

Pappas N,Popescu-Belis A. Multilingual hierarchical attention networks for document classification [C] // Proceedings of the 8th International Joint Conference on Natural Language Processing. Taipei,Taiwan,China: IJCNLP, 2017: 1015-1025.

Choi K, Fazekas G, Sandler M, et al. Convolutional recurrent neural networks for music classification[C]. 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2017: 2392-2396.

Yang Z,Yang D,Dyer C,et al. Hierarchical attention net-works for document classification [C]// Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies. San Diego,USA: NAACL,2016: 1480-1489

Agnihotri D, Verma K, Tripathi P. An automatic classification of text documents based oncorrelative association of words [J]. Journal of Intelligent Information Systems, 2018, 50(3): 549-572.

Feng G, Li S, Sun T. A probabilistic model derived term weighting scheme for text classification [J]. Pattern Recognition Letters, 2018, 110(15): 23-29.

Mohasseb A, Bader-El-Den M, Cocea M. Question categorization and classification using grammar based approach [J]. Information Processing and Management,2018,54(6):1228-1243.

Yang Z,Yang D,Dyer C,et al. Hierarchical attention networks for document classification [C]// Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies. San Diego,USA: NAACL,2016: 1480-1489.

Xu K, Ba J, Kiros R, et al. Show, attend and tell: Neural image caption generation with visual attention[C]. International conference on machine learning. 2015:2048-2057.

Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[C]. Advances in neural information processing systems. 2017: 5998-6008.

Hou Hanqing, Huang Gang. Computer and Document Classification[J]. Modern Library and Information Technology, 1982,2(1):5-14.

Choi K, Fazekas G, Sandler M, et al. Convolutional recurrent neural networks for music classification[C]. 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2017: 2392-2396.

Mnih V, Heess N, Graves A. Recurrent models of visual attention[C]. Advances in neural information processing systems. 2014: 2204-2212.

Downloads

Published

2022-07-20

Issue

Section

Articles

How to Cite

He, B., Zhu, L. ., Wang, X., Zhang, H., & Shi, J. (2022). Research on Text Classification based on Deep Learning. Scientific Journal of Technology, 4(7), 119-128. https://doi.org/10.54691/sjt.v4i7.1286