banner

LCNA-LSTM CNN based attention model for recommendation system to improve marketing strategies on e-commerce

Vikas Sethi, Rajneesh Kumar, Stuti Mehla, Anju Bhandari Gandhi, Shally Nagpal, Sumit Rana

Abstract


E-commerce industries have grown at an unpredicted and unprecedented rate in the 21st century, booming in the midst of the COVID-19 catastrophe and revolutionizing our way of life. The COVID-19 pandemic has demonstrated the widespread strong uptake of e-commerce. In today scenario, success of any business depends upon e-commerce platform. As e-commerce uses Machine learning algorithms for processing but they also encounter serious issues, i.e., cold start, sparsity, scalability and many more. In this research work, researchers address the cold start issue, as efficiency drops due to new users or lower engagement of users. Same is resolved in proposed LSTM CNN Based Attention Model (LCNA), a Longest short-term memory (LSTM) recurring neural networks, Convolution Neural Network (CNN) and deep attention layer based model for collaborative filtering to solve the problem of cold start for a new user. The proposed model in this study uses deep attention layer for semantic ranking with cosine similarity to improve the recommendation. Proposed framework primarily functions in stages, starting with the creation of interactive map matrices, then improving ranking using CNN, LSTM, and deep attention layer, and concluding with the framework’s prediction of three key metrics: mean absolute error (MAE), root MSE (RMSE), and accuracy. The framework is put to the test in several metrices using various recommender metrics on the electronics dataset from the Amazon dataset.


Keywords


recommendation system; machine learning; longest short-term memory; Convolution Neural Network (CNN); deep attention layer

Full Text:

PDF

References


1. Isinkaye FO, Folajimi YO, Ojokoh BA. Recommendation systems: Principles, methods and evaluation. Egyptian Informatics Journal 2015; 16(3): 261–273. doi: 10.1016/j.eij.2015.06.005

2. Sethi V, Gujral RK. Survey of different recommendation systems to improve the marketing strategies on e-commerce. In: Proceedings of the 2022 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON); 26–27 May 2022; Faridabad, India. pp. 119–125.

3. Portugal I, Alencar P, Cowan D. The use of machine learning algorithms in recommender systems: A systematic review. Expert Systems with Applications 2017; 97: 205–227. doi: 10.1016/j.eswa.2017.12.020

4. Mehla S, Rana S. A hybrid approach for opinion mining using twitter data. Computational and Theoretical NanoScience 2019; 16(9): 3817–3823. doi: 10.1166/jctn.2019.8255

5. Guha R. Improving the performance of an artificial intelligence recommendation engine with deep learning neural nets. In: Proceedings of the IEEE 2021 6th International Conference for Convergence in Technology (I2CT); 2–4 April 2021; Maharashtra, India. pp. 1–7.

6. Patro SGK, Mishra BK, Panda SK, et al. Cold start aware hybrid recommender system approach for e-commerce users. Soft Computing 2023; 27: 2071–2091. doi: 10.1007/s00500-022-07378-0

7. Singh PK, Pramanik PKD, Mishra S, et al. Improving recommendation accuracy using cross-domain similarity. In: Proceedings of the 2020 7th NAFOSTED Conference on Information and Computer Science (NICS); 26–27 November 2020; Ho Chi Minh City, Vietnam. pp. 280–285.

8. Osman NA, Noah SAM, Darwich M. Contextual sentiment based recommender system to provide recommendation in the electronic products domain. International Journal of Machine Learning and Computing 2019; 9(4): 425–431. doi: 10.18178/ijmlc.2019.9.4.821

9. Liu W, Lin Z, Zhu H, et al. Attention-based adaptive memory network for recommendation with review and rating. IEEE Access 2020; 8: 113953–113966. doi: 10.1109/ACCESS.2020.2997115

10. Shoja BM, Tabrizi N. Customer reviews analysis with deep neural networks for e-commerce recommender systems. IEEE Access 2019; 7: 119121–119130. doi: 10.1109/ACCESS.2019.2937518

11. Liu N, Zhao J. Recommendation system based on deep sentiment analysis and matrix factorization. IEEE Access 2023; 11: 16994–17001. doi: 10.1109/ACCESS.2023.3246060

12. Lin J, Pu H, Li Y, Lian J. Intelligent recommendation system for course selection in smart education. Procedia Computer Science 2018; 129: 449–453. doi: 10.1016/j.procs.2018.03.023

13. Aguilar J, Valdiviezo-Diaz P, Riofrio G. A general framework for intelligent recommender systems. Applied Computing and Informatics 2017; 13(2): 147–160. doi: 10.1016/j.aci.2016.08.002

14. Yassine A, Mohamed L, Achhab MA. Intelligent recommender system based on unsupervised machine learning and demographic attributes. Simulation Modelling Practice and Theory 2021; 107: 1–16. doi: 10.1016/j.simpat.2020.102198

15. Zhou Y, Tang Z, Qi L, et al. Intelligent service recommendation for cold-start problems in edge computing. IEEE Access 2019; 7: 46637–46645. doi: 10.1109/ACCESS.2019.2909843

16. Sadeghi M, Asghari SA, Pedram MM. An improved method multi-view group recommender system (IMVGRS). In: Proceedings of the 2020 8th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS); 2–4 September 2020; Mashhad, Iran. pp. 127–132.

17. Ghodsad PR, Chatur PN. Handling user cold-start problem for group recommender system using social behaviour wise group detection method. In: Proceedings of the 2018 International Conference on Research in Intelligent and Computing in Engineering (RICE); 22–24 August 2018; San Salvador, El Salvador. pp. 1–5.

18. Iqbal M, Ghazanfar MA, Sattar A, et al. Kernel context recommender system (KCR): A scalable context-aware recommender system algorithm. IEEE Access 2019; 7: 24719–24737. doi: 10.1109/ACCESS.2019.2897003

19. Hasan M, Lubna FA, Chowdhuy S, et al. ACIRS: A comprehensive item based clustering approach to recommend appropriate items in recommender system. In: Proceedings of the 2019 5th International Conference on Computing and Artificial Intelligence; 19–22 April 2019; Bali, Indonesia. pp. 259–263.

20. Wang CD, Deng ZH, Lai JH, Yu PS. Serendipitous recommendation in e-commerce using innovator-based collaborative filtering. IEEE Transactions on Cybernetics 2018; 49(7): 2678–2692. doi: 10.1109/TCYB.2018.2841924

21. Guo Y, Yin C, Li M, et al. Mobile e-commerce recommendation system based on multi-source information fusion for sustainable e-business. Sustainability 2018; 10(1): 147. doi: 10.3390/su10010147

22. Guo J, Deng J, Ran X, et al. An efficient and accurate recommendation strategy using degree classification criteria for item-based collaborative filtering. Expert Systems with Applications 2021; 164: 113756. doi: 10.1016/j.eswa.2020.113756

23. Lee H, Lee J. Scalable deep learning-based recommendation systems. ICT Express 2019; 5(2): 84–88. doi: 10.1016/j.icte.2018.05.003

24. Goel A, Khandelwal D, Mundhra J, Tiwari R. Intelligent and integrated book recommendation and best price identifier system using machine learning. Intelligent Engineering Informatics 2018; 695: 397–412. doi: 10.1007/978-981-10-7566-7_39

25. Wei J, He J, Chen K, et al. Collaborative filtering and deep learning based recommendation system for cold start items. Expert Systems with Applications 2017; 69: 29–39. doi: 10.1016/j.eswa.2016.09.040

26. Zarzour H, Al-Sharif ZA, Jararweh Y. RecDNNing: A recommender system using deep neural network with user and item embeddings. In: Proceedings of the IEEE 2019 10th International Conference on Information and Communication Systems (ICICS); 11–13 June 2019; Irbid, Jordan. pp. 99–103.

27. Liu F, Guo W. Research on recommendation system algorithm based on deep learning mode in grid environment. In: Proceedings of the 2019 International Conference on Robots & Intelligent System (ICRIS); 15–16 June 2019; Haikou, China. pp. 250–253.

28. Zhou Y. A dynamically adding information recommendation system based on deep neural networks. In: Proceedings of 2020 IEEE International Conference on Artificial Intelligence and Information Systems (ICAIIS); 20–22 March 2020; Dalian, China. pp. 1–4.

29. Hawashin B, Alzubi S, Mughaid A, et al. An efficient cold start solution for recommender systems based on machine learning and user interests. In: Proceedings of the IEEE 2020 Seventh International Conference on Software Defined Systems (SDS); 20–23 April 2020; Paris, France. pp. 220–225.

30. Mana SC, Sasipraba T. A machine learning based implementation of product and service recommendation models. In: Proceedings of the IEEE 2021 7th International Conference on Electrical Energy Systems (ICEES); 11–13 February 2021; Chennai, India. pp. 543–547.

31. Oshnoudi A, Neysiani BS, Aminoroaya Z, Nematbakhsh N. Improving recommender systems performances using user dimension expansion by movies’ genres and voting-based ensemble machine learning technique. In: Proceedings of the IEEE 2021 7th International Conference on Web Research (ICWR); 19–20 May 2021; Tehran, Iran. pp. 175–181.

32. Almaghrabi M, Chetty G. A deep learning based collaborative neural network framework for recommender system. In: Proceedings of the IEEE 2018 International Conference on Machine Learning and Data Engineering (iCMLDE); 3–7 December 2018; Sydney, NSW, Australia. pp. 121–127.

33. Wu D, Luo X, Shang M, et al. A deep latent factor model for high-dimensional and sparse matrices in recommender systems. IEEE Transactions on Systems, Man, and Cybernetics: Systems 2021; 51(7): 4285–4296. doi: 10.1109/TSMC.2019.2931393

34. Guo R, Zhang F, Wang L, et al. BaPa: A novel approach of improving load balance in parallel matrix factorization for recommender systems. IEEE Transactions on Computers 2021; 70(5): 789–802. doi: 10.1109/TC.2020.2997051

35. Ahmed A, Saleem K, Khalid O, Rashid U. On deep neural network for trust aware cross domain recommendations in e-commerce. Expert Systems with Applications 2021; 174: 114757. doi: 10.1016/j.eswa.2021.114757

36. Bai B, Fan Y, Tan W, Zhang J. DLTSR: A deep learning framework for recommendations of long-tail web services. IEEE Transactions on Services Computing 2020; 13(1): 73–85. doi: 10.1109/TSC.2017.2681666

37. Fernández-Garcíaa AJ, Iribarne L, Corral A, et al. A recommender system for component-based applications using machine learning techniques. Knowledge-Based Systems 2018; 164: 68–84. doi: 10.1016/j.knosys.2018.10.019.

38. Mehla S, Rana S. An optimized system for sentiment analysis using twitter data. Challenges and Opportunities for Deep Learning Applications in Industry 4.0. Bentham Science; 2022. pp. 159–180.

39. Saluja R, Rai M. Analysis of existing ML techniques for students success prediction. In: Proceedings of the 2022 Seventh International Conference on Parallel, Distributed and Grid Computing (PDGC); 25–27 November 2022; Solan, Himachal Pradesh, India. pp. 507–512.

40. Saluja R, Rai M. Saluja R. Designing new student performance prediction model using ensemble machine learning. Journal of Autonomous Intelligence 2023; 6(1): 583. doi: 10.32629/jai.v6i1.583

41. Julian McAuley. Recommender systems and personalization datasets. Available online: http://jmcauley.ucsd.edu/data/amazon/links.html (accessed on 9 July 2023).

42. Mondal R, Bhowmik B. DeCS: A deep neural network framework for cold start problem in recommender systems. In: Proceedings of the 2022 IEEE Region 10 Symposium (TENSYMP); 1–3 July 2022; Mumbai, India. pp. 1–6.

43. Sun P, Wu L, Zhang K, et al. Dual learning for explainable recommendation: towards unifying user preference prediction and review generation. In: Proceedings of The Web Conference 2020; 20–24 April 2020; Taipei, Taiwan. pp. 837–847.

44. Lin Z, Tang Y, Zhang Y. Joint deep model with multi-level attention and hybrid-prediction for recommendation. Entropy 2019; 21(2): 143. doi: 10.3390/e21020143

45. Han J, Zheng L, Xu Y, et al. Adaptive deep modeling of users and items using side information for recommendation. IEEE Transactions on Neural Networks and Learning Systems 2020; 31(3): 737–748. doi: 10.1109/TNNLS.2019.2909432

46. Lin Z, Yang W, Zhang Y, et al. MulAttenRec: A multi-level attention-based model for recommendation. In: Cheng L, Leung A, Ozawa S (editors). Neural Information Processing, Proceedings of ICONIP; 13–16 December 2018; Siem Reap, Cambodia. Springer; 2018. Volume 11302, pp. 240–252.

47. Chen Z, Wang X, Xie X, et al. Co-attentive multi-task learning for explainable recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence; 10 August 2019; Macau, China. pp. 2137–2143.

48. Chen H, Chen X, Shi S, Zhang Y. Generate natural language explanations for recommendation. arXiv 2019; arXiv:2101.03392. doi: 10.48550/arXiv.2101.03392




DOI: https://doi.org/10.32629/jai.v7i1.972

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Vikas Sethi, Rajneesh Kumar, Stuti Mehla, Anju Bhandari Gandhi, Shally Nagpal, Sumit Rana

License URL: https://creativecommons.org/licenses/by-nc/4.0/