Prediction of On-time Student Graduation with Deep Learning Method
DOI:
https://doi.org/10.5614/itbj.ict.res.appl.2023.18.1.1Keywords:
deep learning, neural network, prediction, student graduation, student performanceAbstract
Universities have an important role in providing quality education to their students so they can build a foundation for their future. However, a problem that often arises is that the process experienced will be different for each individual. Therefore, it is necessary to apply on-time graduation predictions for students with academic attributes in the hope that educational institutions can better understand student conditions and maximize on-time student graduation. In this study, a deep learning method was implemented to help predict on-time graduation for students at the Faculty of Computer Science, University of Brawijaya. Based on the test results and hyperparameter tuning using Optuna, the best hyperparameter configuration for the deep learning method consisted of number of layer combinations = 4; first-layer nodes = 118; first dropout = 0.3393; second-layer nodes = 83; second dropout = 0.0349; third-layer nodes = 88; third dropout = 0.0491; fourth-layer nodes = 65; fourth dropout = 0.4169; number of epochs = 244; learning rate = 0.0710; and optimizer = SGD. Thus, an accuracy rate of 86.61% was achieved for the two classes of the test data set, i.e., on-time graduation and not on-time graduation.
Downloads
References
Co, J. & Francis, C.N., Predicting On-time Graduation based on Student Performance in Core Introductory Computing Courses using Decision Tree Algorithm, Jurnal Pendidikan Progresif, 11, pp. 650-658, 2021.
Hartatik, H., Optimizing the Student Graduation Prediction Model Using the Naive Bayes Algorithm, Indonesian Journal of Applied Informatics, 5(1), pp. 32-38, 2021. (Text in Indonesian)
Rohmawan, E.P., Prediction of Student Graduation on Time Using Decision Tree and Artificial Neural Network Methods, Jurnal Ilmiah MATRIK, 20(1), pp. 21-30, Apr. 2018. (Text in Indonesian)
Pratama, A., Wihandika, R.C. & Ratnawati, D.E., Implementation of the Support Vector Machine (SVM) Algorithm for Predicting Student Graduation Timeliness, Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, 2, pp. 1704-1708, 2018. (Text in Indonesian)
Martanto, M., Ali, I. & Mulyawan, M., Prediction of Student Graduation Rates Using Machine Learning with Deep Learning Techniques, Jurnal Informatika: Jurnal Pengembangan IT, 4, pp. 191-194, 2019. (Text in Indonesian)
Rismayati, R., Ismarmiaty, I. & Hidayat, S., Ensemble Implementation for Predicting Student Graduation with Classification Algorithm, International Journal of Engineering and Computer Science Applications (IJECSA), 1, pp. 35-42, 2022.
Syahputra, I.K., Bachtiar, F.A. & Wicaksono, S.A., Implementation of Data Mining for Predicting Students Taking Courses using the Naive Bayes Algorithm, Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, 2, pp. 5902-5910, 2018. (Text in Indonesian)
Zhang, Z., Cui, P. & Zhu, W., Deep Learning on Graphs: A Survey, IEEE Transactions on Knowledge and Data Engineering, 34, pp. 249-270, 2022.
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X. & Pietiknen, M., Deep Learning for Generic Object Detection: A Survey, International Journal of Computer Vision, 128, pp. 261-318, 2020.
Johnson, J.M. & Khoshgoftaar, T.M., Survey on Deep Learning with Class Imbalance, Journal of Big Data, 6, 27, 2019.
Xing, W. & Du, D., Dropout Prediction in MOOCs: Using Deep Learning for Personalized Intervention, Journal of Educational Computing Research, 57, pp. 547-570, 2019.
Nurhayati, O.D., Bachri, O.S., Supriyanto, A. & Hasbullah, M., Graduation Prediction System Using Artificial Neural Network, International Journal of Mechanical Engineering and Technology, 9, pp. 1051?1057, 2018.
Riyanto, V., Hamid, A. & Ridwansyah, R., Prediction of Student Graduation Time Using the Best Algorithm, Indonesian Journal of Artificial Intelligence and Data Mining, 2(1), pp. 1-9, 2019.
Liu, H., Zhu, Y., Zang, T., Xu, Y., Yu, J. & Tang, F., Jointly Modeling Heterogeneous Student Behaviors and Interactions among Multiple Prediction Tasks, ACM Transactions on Knowledge Discovery from Data, 16(1), pp. 1-24, 2021.
Liu, H., Zhu, Y., & Xu, Y., Learning from Heterogeneous Student Behaviors for Multiple Prediction Tasks, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12113 LNCS, pp. 297-313, 2020.
Liu, H., Zhu, Y., Wang, C., Ding, J., Yu, J.,& Tang, F., Incorporating Heterogeneous User Behaviors and Social Influences for Predictive Analysis, IEEE Transactions on Big Data, 9, pp. 716-732, 2023.
Liu, H., Zhu, Y., Zang, T., Yu, J. & Cai, H., Jointly Modeling Individual Student Behaviors and Social Influence for Prediction Tasks, International Conference on Information and Knowledge Management, pp. 865-874, 2020.
Alasadi, S.A., & Bhaya, W.S., Review of Data Preprocessing Techniques in Data Mining, Journal of Engineering and Applied Sciences, 12, pp. 4102-4107, 2017.
Bach, M., Werner, A. & Palt, M., The Proposal of Undersampling Method for Learning from Imbalanced Datasets, Procedia Computer Science, 159, pp. 125-134, 2019.
Saranya, C. & Manikandan, G., A Study on Normalization Techniques for Privacy Preserving Data Mining, International Journal of Engineering and Technology, 5, pp. 2701-2704, 2013.
Al-Rawahnaa, A.S.M. & Al Hadid, A.Y.B., Data Mining for Education Sector, A Proposed Concept, Journal of Applied Data Sciences, 1(1), pp.1-10, 2020.
Janiesch, C., Zschech, P. & Heinrich, K., Machine learning and deep learning, Electronic Markets, 31, pp. 685-695, 2021.
Moczulski, M., Denil, M., Appleyard, J. & De Freitas, N., ACDC: A Structured Efficient Linear Layer, 4th International Conference on Learning Representations, ICLR, 2016.
Sharma, S., Sharma, S. & Athaiya, A., Activation Functions in Neural Networks, International Journal of Engineering Applied Sciences and Technology, 04, pp. 310?316, 2020.
Agarap, A.F., Deep Learning using Rectified Linear Units (ReLU), arXiv, /abs/1803.08375, 22nd Mar, 2018.
Shatravin, V., Shashev, D. & Shidlovskiy, S., Sigmoid Activation Implementation for Neural Networks Hardware Accelerators Based on Reconfigurable Computing Environments for Low-Power Intelligent Systems, Applied Sciences (Switzerland), 12(10), 5216, 2022.
Garbin, C., Zhu, X. & Marques, O., Dropout vs. Batch Normalization: An Empirical Study of Their Impact To Deep learning, Multimedia Tools and Applications, 79, pp. 12777?12815, 2020.
Akiba, T., Sano, S., Yanase, T., Ohta, T., & Koyama, M., Optuna: A Next-generation Hyperparameter Optimization Framework, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2623-2631, 2019.
