Automated Summarization of Text Documents using Deep Belief Networks
DOI:
https://doi.org/10.52783/jns.v14.3005Keywords:
Text summarization, Natural Language Processing, Deep belief networkAbstract
In recent times, text summarization process becomes familiar as it generates a summary comprising a significant sentence from the original document. At the same time, automated extractive text summarization for lecture notes have gained popularity, which commonly collects important key points and sentences. The absence of a text summarization technique for lecture notes in the Tamil language motivated us to perform this study. In this work, a new automated text summarization model for Tamil Lecture Notes using Deep Belief Networks (DBN) has been presented. The proposed DBN model performs several processes namely preprocessing, sentence feature extraction, optimal feature selection, and summarization. The application of NLP for sentence feature extraction and DBN for selecting the optimal feature vector from the feature sentence matrix results in effective lecture note summarization. The performance of the DBN model has been validated using lecture notes of different subjects in Tamil language. The obtained experimental outcome showcased the superior performance of the DBN model over the compared methods.
Downloads
Metrics
References
D. Yadav, R. Katna, A. K. Yadav and J. Morato, "Feature Based Automatic Text Summarization Methods: A Comprehensive State-of-the-Art Survey," in IEEE Access, vol. 10, pp. 133981-134003, 2022.
Sharma, G., Sharma, D. (2022). Improving extractive text summarization performance using enhanced feature based RBM method. Revue d'Intelligence Artificielle, Vol. 36, No. 5, pp. 777-784.
Z. Jalil, J. A. Nasir and M. Nasir, "Extractive Multi-Document Summarization: A Review of Progress in the Last Decade," in IEEE Access, vol. 9, pp. 130928-130946, 2021.
Saravanakumar, S. (2020). Certain analysis of authentic user behavioral and opinion pattern mining using classification techniques. Solid State Technology, 63(6), 9220-9234.
H. Gupta and M. Patel, "Method Of Text Summarization Using LSA and Sentence Based Topic Modelling With Bert," 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), Coimbatore, India, 2021, pp. 511-517, doi: 10.1109/ICAIS50930.2021.9395976.
Aziz Qaroush, Ibrahim Abu Farha, Wasel Ghanem, Mahdi Washaha, Eman Maali, “An efficient single document Arabic text summarization using a combination of statistical and semantic features”, Journal of King Saud University - Computer and Information Sciences, Volume 33, Issue 6, 2021, Pages 677-692, ISSN 1319-1578.
Long-Da Wang, Xing-Cheng Wang, Kai-Wei Liu, “An Improved Multi-objective Shark Smell Optimization Algorithm for Automatic Train Operation Based on Angle Cosine and Fusion Distance”, Journal of Computers Vol. 31 No. 4, 2020, pp. 141-156.
Insiya AbdulSalam, Shirien K A, Surekha Mariam Varghese, “Rule-Based Extractive Summarization and Title Generation”, International Journal of Innovative Technology and Exploring Engineering (IJITEE), ISSN: 2278-3075 (Online), Volume-9 Issue-5, March 2020.
Saravanan, T., Saravanakumar, S., Rathinam, G. O. P. A. L., Narayanan, M., Poongothai, T., Patra, P. S. K., & Sengan, S. U. D. H. A. K. A. R. (2022). Malicious attack alleviation using improved time-based dimensional traffic pattern generation in uwsn. Journal of Theoretical and Applied Information Technology, 100(3), 682-689.
Deepa Anand, Rupali Wagh, “Effective deep learning approaches for summarization of legal texts”, Journal of King Saud University - Computer and Information Sciences, Volume 34, Issue 5, 2022, Pages 2141-2150, ISSN 1319-1578.
Thangavel, S., & Selvaraj, S. (2023). Machine Learning Model and Cuckoo Search in a modular system to identify Alzheimer’s disease from MRI scan images. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 11(5), 1753-1761.
Xu, W., Li, C., Lee, M. et al. Multi-task learning for abstractive text summarization with key information guide network. EURASIP J. Adv. Signal Process. 2020, 16 (2020).
Ghanem, F.A.; Padma, M.C.; Alkhatib, R. Automatic Short Text Summarization Techniques in Social Media Platforms. Future Internet 2023, 15, 311.
Shahariar, G.M., Talukder, T., Sotez, R.A.K., Shawon, M.T.R. (2024). Rank Your Summaries: Enhancing Bengali Text Summarization Via Ranking-Based Approach. In: Arefin, M.S., Kaiser, M.S., Bhuiyan, T., Dey, N., Mahmud, M. (eds) Proceedings of the 2nd International Conference on Big Data, IoT and Machine Learning. BIM 2023. Lecture Notes in Networks and Systems, vol 867. Springer, Singapore.
Saravanakumar, S., & Thangaraj, P. (2019). A computer aided diagnosis system for identifying Alzheimer’s from MRI scan using improved Adaboost. Journal of medical systems, 43(3), 76.
Asif MSH, “A Novel Approach in Automated Bengali Text Summarizing by Statistical and Sentence Similarity Method”, American Journal of Computer Science and Engineering Survey Vol.8 No.1: 03 2020.
Song, Shengli & Huang, Haitao & Ruan, Tongxiao. (2019). Abstractive text summarization using LSTM-CNN based deep learning. Multimedia Tools and Applications. Volume 78. DOI.10.1007/s11042-018-5749-3.
Saravanan, T., & Saravanakumar, S. (2022). Enhancing investigations in data migration and security using sequence cover cat and cover particle swarm optimization in the fog paradigm. International Journal of Intelligent Networks, 3, 204-212.
M. -H. Su, C. -H. Wu and H. -T. Cheng, "A Two-Stage Transformer-Based Approach for Variable-Length Abstractive Summarization," in IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 28, pp. 2061-2072, 2020.
Joshi, A., Fidalgo, E., Alegre, E. and Fernández-Robles, L., 2019. SummCoder: An unsupervised framework for extractive text summarization based on deep auto-encoders. Expert Systems with Applications, 129, pp.200-215.
A. P. Umejiaku, F. Zhou and V. S. Sheng, "Ensemble Summarization Models to Leverage Performance," 2022 5th International Conference on Computing and Big Data (ICCBD), Shanghai, China, 2022, pp. 56-61.
Dima Suleiman and Arafat Awajan, 2020. Deep Learning Based Abstractive Arabic Text Summarization Using Two Layers Encoder And One Layer Decoder. Journal of Theoretical and Applied Information Technology, 98(16).
Saravanakumar, S., & Saravanan, T. (2023). Secure personal authentication in fog devices via multimodal rank‐level fusion. Concurrency and Computation: Practice and Experience, 35(10), e7673
Kotadiya, R., Bhatt, S. and Chauhan, U., 2020. Advancement of Text Summarization Using Machine Learning and Deep Learning: A Review. In Proceedings of First International Conference on Computing, Communications, and Cyber-Security, (pp. 457-469). Springer, Singapore.
Mohd, M., Jan, R. and Shah, M., 2020. Text document summarization using word embedding. Expert Systems with Applications, 143, p.112958.
Yang M, Li C, Shen Y, Wu Q, Zhao Z, Chen X. Hierarchical Human-Like Deep Neural Networks for Abstractive Text Summarization. IEEE Trans Neural Netw Learn Syst. 2021 Jun;32(6):2744-2757. doi: 10.1109/TNNLS.2020.3008037. Epub 2021 Jun 2. PMID: 32701451.
Yadav, A.K., Singh, A., Dhiman, M. et al. Extractive text summarization using deep learning approach. Int. j. inf. tecnol. 14, 2407–2415 (2022). https://doi.org/10.1007/s41870-022-00863-7.
M. Roder, G. H. de Rosa, J. P. Papa and F. A. Breve, "Fine-Tuning Temperatures in Restricted Boltzmann Machines Using Meta-Heuristic Optimization," 2020 IEEE Congress on Evolutionary Computation (CEC), Glasgow, UK, 2020, pp. 1-8, doi: 10.1109/CEC48606.2020.9185505.
Amal Ganesh, A Jaya and C Sunitha,” An Overview of Semantic Based Document Summarization in Different Languages”, ECS Transactions, Volume 107, 6007, Number 1, 2022.
S. S. Mohamed and S. Hariharan, "An investigation on graphical approach for tamil text summary generation," 2017 International Conference on Intelligent Computing and Control (I2C2), Coimbatore, India, 2017.
M. Y. Saeed, M. Awais, R. Talib and M. Younas, "Unstructured Text Documents Summarization With Multi-Stage Clustering," in IEEE Access, vol. 8, pp. 212838-212854, 2020.
M. Jang and P. Kang, "Learning-Free Unsupervised Extractive Summarization Model," in IEEE Access, vol. 9, pp. 14358-14368, 2021.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
Terms:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
