Online music personalized recommendation algorithm based on KKBox large-scale real-world dataset and integrated behavior sequence transformer
DOI:
https://doi.org/10.71451/ISTAER2546Keywords:
Music recommendation system; Behavior Sequence Transformer; Attention Mechanism; LightGBM; KKBox dataset; Deep LearningAbstract
To address the user selection overload and decision making difficulties caused by the explosive growth of online music platforms, this paper proposes and validates a deep learning recommendation model that incorporates the Behavior Sequence Transformer, aiming to significantly improve music recommendation accuracy, diversity, and novelty. We use the BST Behavior Sequence Transformer to perform multi head self attention modeling on user listening sequences and compare it with a LightGBM boosted tree and logistic regression baseline model. Experiments use AUC, accuracy, and RMSE as core metrics, and use an 80/20 train-test split and early stopping to control overfitting. The BST model achieved an AUC of 0.7662 and an accuracy of 0.7551 on the test set, significantly outperforming LightGBM and logistic regression . Feature importance analysis shows that user genre cross features, contextual entry points, and sequence position encoding contribute most to the model. The recommendation algorithm based on the Behavior Sequence Transformer effectively captures the dynamic evolution of user interests, alleviates information silos, and possesses good scalability and engineering potential. Future research into multimodal fusion and reinforcement learning can further enhance diversity and interpretability.
**************** ACKNOWLEDGEMENTS****************
This work was supported by Jiangxi Provincial College Students' Innovation and Entrepreneurship Program (S202510421047).
References
[1] Zhang, Z., Qiu, T., Liao, Z., Liu, H., Wei, C., & Zhao, T. (2025, July). Research on global power equipment trade prediction and logistics optimization based on 5G and edge computing. In International Conference on Optoelectronics and Information Technology (ICOIT 2025) (Vol. 13665, pp. 302-310). SPIE. DOI: https://doi.org/10.1117/12.3071144
[2] Zhao, T., Chen, G., Pang, C., & Busababodhin, P. (2025). Application and Performance Optimization of SLHS-TCN-XGBoost Model in Power Demand Forecasting. CMES-Computer Modeling in Engineering and Sciences, 143(3), 2883-2917. DOI: https://doi.org/10.32604/cmes.2025.066442
[3] Zhao, T., Chen, G., Suraphee, S., Phoophiwfa, T., & Busababodhin, P. (2025). A hybrid TCN-XGBoost model for agricultural product market price forecasting. PLoS One, 20(5), e0322496. DOI: https://doi.org/10.1371/journal.pone.0322496
[4] Wang, Z., Zhang, Z., Su, T., Ding, Z., & Zhao, T. (2024, December). Research on Supply Chain Network Optimisation Based on the CNNs-BiLSTM Model. In 2024 International Conference on Information Technology, Comunication Ecosystem and Management (ITCEM) (pp. 197-202). IEEE. DOI: https://doi.org/10.1109/ITCEM65710.2024.00044
[5] Zhao, T., Chen, G., Gatewongsa, T., & Busababodhin, P. (2025). Forecasting Agricultural Trade Based on TCN-LightGBM Models: A Data-Driven Decision. Research on World Agricultural Economy, 207-221. DOI: https://doi.org/10.36956/rwae.v6i1.1429
[6] Akkaya, B. (2025). Current Trends in Recommender Systems: A Survey of Approaches and Future Directions. Computer Science, 10(1), 53-91.
[7] Yang, B., Zhou, J., Zhang, S., Xing, Y., Jiang, W., & Xu, L. (2024). Lightweight knowledge distillation and feature compression model for user click-through rates prediction in edge computing scenarios. IEEE Internet of Things Journal. DOI: https://doi.org/10.1109/JIOT.2024.3446640
[8] Liang, W., Meo, P. D., Tang, Y., & Zhu, J. (2024). A survey of multi-modal knowledge graphs: Technologies and trends. ACM Computing Surveys, 56(11), 1-41. DOI: https://doi.org/10.1145/3656579
[9] Chang, Y. J., Han, J. Y., Chu, W. C., Li, L. P. H., & Lai, Y. H. (2024). Enhancing music recognition using deep learning-powered source separation technology for cochlear implant users. The Journal of the Acoustical Society of America, 155(3), 1694-1703. DOI: https://doi.org/10.1121/10.0025057
[10] Tao, S., Qiu, R., Cao, Y., Xue, G., & Ping, Y. (2023). Path-guided intelligent switching over knowledge graphs with deep reinforcement learning for recommendation. Complex & Intelligent Systems, 9(6), 7305-7319. DOI: https://doi.org/10.1007/s40747-023-01124-1
[11] Zhang, M., Liu, H., Chen, C., Gao, G., Li, H., & Zhao, J. (2023). AccessFixer: Enhancing GUI accessibility for low vision users with R-GCN model. IEEE transactions on software engineering, 50(2), 173-189. DOI: https://doi.org/10.1109/TSE.2023.3337421
Downloads
Published
Issue
Section
License
Copyright (c) 2025 International Scientific Technical and Economic Research
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This work is licensed under the Creative Commons Attribution International License (CC BY 4.0).
