banner

The use of restricted Boltzmann machines for clustering collaborative filtering

Soojung Lee

Abstract


Collaborative filtering-based recommender systems have been successfully serviced through commercial online systems to assist people with searching the information useful to them. However, several problems inherent in such systems still exist, although a lot of research work has been devoted to finding solutions. This work focuses on clustering collaborative filtering to address the scalability problem. It proposes a novel method to determine the clustering criteria for enhancing the prediction and recommendation accuracy of the systems, which is typically degraded when the clustering algorithm is integrated into collaborative filtering. We use a restricted Boltzmann machine to find the genre preference of users, which is then inputted into the clustering algorithm to cluster users. Various experiments are conducted to evaluate the performance of the proposed method. As a result, our method showed superior performance in terms of various performance criteria compared to previous clustering collaborative filtering methods and some of the major traditional systems.


Keywords


collaborative filtering; recommender system; restricted Boltzmann machine; clustering algorithm; K-means clustering

Full Text:

PDF

References


1. Aamir M, Bhusry M. Recommendation system: State of the art approach. International Journal Computer Applications 2015; 120(12): pp. 25–32. doi: 10.5120/21281-4200

2. Chen R, Hua Q, Chang YS, et al. A survey of collaborative filtering-based recommender systems: from traditional methods to hybrid methods based on social networks. IEEE Access 2018; 6: 64301–64320. doi: 10.1109/ACCESS.2018.2877208

3. Jaiswal S, Jaiswal T. Survey on recommender system using deep learning networks. Artificial Intelligence Evolution 2020; 72–89. doi: 10.37256/aie.122020435

4. Jalili M, Ahmadian S, Izadi M, et al. Evaluating collaborative filtering recommender algorithms: A survey. IEEE Access 2018; 6: 74003–74024. doi: 10.1109/ACCESS.2018.2883742

5. Jothilakshmi SL, Bharathi R. Survey on collaborative filtering technique for recommender system using deep learning. In: Kannan RJ, Thampi SM, Wang SH (editors). Computer Vision and Machine Intelligence Paradigms for SDGs. Springer; 2023.

6. Su X, Khoshgoftaar TM. A survey of collaborative filtering techniques. Advances in Artificial Intelligence 2009; 2009: 421425. doi: 10.1155/2009/421425

7. Liao CL, Lee SJ. A clustering based approach to improving the efficiency of collaborative filtering recommendation. Electronic Commerce Research and Applications 2016; 18: 1–9. doi: 10.1016/j.elerap.2016.05.001

8. Batmaz Z, Yurekli A, Bilge A, Kaleli C. A review on deep learning for recommender systems: Challenges and remedies. Artificial Intelligence Review 2019; 52(1): 1–37. doi: 10.1007/s10462-018-9654-y

9. Mu R, Zeng X, Han L. A survey of recommender systems based on deep learning. IEEE Access 2018; 6: 69009–69022. doi: 10.1109/ACCESS.2018.2880197

10. Wang H, Wang N, Yeung DY. Collaborative deep learning for recommender systems. arXiv 2015; arXiv:1409.2944. doi: 10.48550/arXiv.1409.2944

11. Zhang S, Yao L, Sun A, Tay Y. Deep learning based recommender system: a survey and new perspectives. ACM Computing Surveys 2019; 52(1): 1–38. doi: 10.1145/3285029

12. Khojamli H, Razmara J. Survey of similarity functions on neighborhood-based collaborative filtering. Expert Systems with Applications 2021; 185: 115482. doi: 10.1016/j.eswa.2021.115482

13. Xue G, Lin C, Yang Q, et al. Scalable collaborative filtering using cluster-based smoothing. In: Proceedings of the 28th annual international ACM SIGIR conference on Research and Development in Information Retrieval; 15 August 2005; Salvador, Brazil. pp. 114–121.

14. Gong S. A collaborative filtering recommendation algorithm based on user clustering and item clustering. Journal of Software 2010; 5(7): 745–752. doi: 10.4304/jsw.5.7.745-752

15. Kim KJ, Ahn H. A recommender system using GA K-means clustering in an online shopping market. Expert Systems with Applications 2008; 34(2): 1200–1209. doi: 10.1016/j.eswa.2006.12.025

16. Nilashi M, Jannach D, Ibrahim O, Ithnin N. Clustering- and regression-based multi-criteria collaborative filtering with incremental updates. Information Sciences 2015; 293: 235–250. doi: 10.1016/j.ins.2014.09.012

17. Liu J, Song J, Li C, et al. A hybrid news recommendation algorithm based on K-means clustering and collaborative filtering. Journal of Physics: Conference Series 2021; 1881: 032050. doi: 10.1088/1742-6596/1881/3/032050

18. Ye H. A personalized collaborative filtering recommendation using association rules mining and self-organizing map. Journal of Software 2011; 6(4): 732–739. doi: 10.4304/JSW.6.4.732-739

19. Tsai CF, Hung C. Cluster ensembles in collaborative filtering recommendation. Applied Soft Computing 2012; 12(4): 1417–1425. doi: 10.1016/j.asoc.2011.11.016

20. Lee M, Choi P, Woo Y. A hybrid recommender system combining collaborative filtering with neural network. In: De Bra P, Brusilovsky P, Conejo R (editors). Adaptive Hypermedia and Adaptive Web-Based Systems. Springer; 2002. Volume 2347. pp. 531–534.

21. Roh TH, Oh KJ, Han I. The collaborative filtering recommendation based on SOM cluster-indexing CBR. Expert Systems with Applications 2003; 25(3): 413–423. doi: 10.1016/S0957-4174(03)00067-8

22. Purbey N, Pawde K, Gangan S, Karani R. Using self-organizing maps for recommender systems. International Journal of Soft Computing and Engineering 2014; 4(5): 47–50.

23. Fremal S, Lecron F. Weighting strategies for a recommender system using item clustering based on genres. Expert Systems With Applications 2017; 77(1): 105–113. doi: 10.1016/j.eswa.2017.01.031

24. Najafabadi MK, Mahrin MN, Chuprat S, Sarkan HM. Improving the accuracy of collaborative filtering recommendations using clustering and association rules mining on implicit data. Computers in Human Behavior 2017; 67: 113–128. doi: 10.1016/j.chb.2016.11.010

25. Pu X, Zhang B. Clustering collaborative filtering recommendation algorithm of users based on time factor. In: Proceedings of the 2020 Chinese Control And Decision Conference (CCDC); 22–24 August 2020; Hefei, China. pp. 364–368.

26. Zheng Y, Tang B, Ding W, Zhou H. A neural autoregressive approach to collaborative filtering. arXiv 2016; arXiv:1605.09477. doi: 10.48550/arXiv.1605.09477

27. Deng S, Huang L, Xu G, et al. On deep learning for trust-aware recommendations in social networks. IEEE Transactions on Neural Networks and Learning Systems 2017; 28(5): 1164–1177. doi: 10.1109/TNNLS.2016.2514368

28. Salakhutdinov R, Mnih A, Hinton G. Restricted Boltzmann machines for collaborative filtering. In: Proceedings of the 24th International Conference on Machine Learning; 20 June 2007; New York, United States. pp. 791–798.

29. Georgiev K, Nakov P. A non-iid framework for collaborative filtering with restricted Boltzmann machines. The 30th International Conference on Machine Learning 2013; 28(3): 1148–1156. doi: 10.5555/3042817.3043065

30. Hu L, Cao J, Xu G, et al. Deep modeling of group preferences for group-based recommendation. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence; 27 July 2014; Canada. pp. 1861–1867.

31. Sahoo AK, Pradhan C, Barik RK, Dubey H. DeepReco: deep learning based health recommender system using collaborative filtering. Computation 2019; 7(2): 1–25. doi: 10.3390/computation7020025

32. Verma S, Patel P, Majumdar A. Collaborative filtering with label consistent restricted Boltzmann machine. arXiv 2019; arXiv:1910.07724. doi: 10.48550/arXiv.1910.07724

33. Yang F, Lu Y. Restricted Boltzmann machines for recommender systems with implicit feedback. In: Proceedings of the 2018 IEEE International Conference on Big Data (Big Data); 10–13 December 2018; Seattle, WA, USA. pp. 4109–4113.

34. Hinton GE. A practical guide to training restricted Boltzmann machines. In: Montavon G, Orr GB, Müller KR (editors). Neural Networks: Tricks of the Trade. Springer; 2012. pp. 599–619.

35. Sarne GML. A collaborative filtering recommender exploiting a SOM network. In: Bassis S, Esposito A, Morabito FC (editors). Recent Advances of Neural Network Models and Applications. Springer; 2014. pp. 215–222.

36. Koohi H, Kiani K. User based collaborative filtering using fuzzy c-means. Measurement 2016; 91: 134–139. doi: 10.1016/j.measurement.2016.05.058

37. Lee S. Fuzzy clustering with optimization for collaborative filtering-based recommender systems. Journal of Ambient Intelligence and Humanized Computing 2022; 13(9): 4189–4206. doi: 10.1007/s12652-021-03552-8

38. Bobadilla J, Hernando A, Ortega F, Gutierrez G. Collaborative filtering based on significances. Information Sciences 2012; 185(1): 1–17. doi: 10.1016/j.ins.2011.09.014

39. Iftikhar A, Ghazanfar MA, Ayub M, et al. An improved product recommendation method for collaborative filtering. IEEE Access 2020; 8: 123841–123857. doi: 10.1109/ACCESS.2020.3005953




DOI: https://doi.org/10.32629/jai.v6i3.723

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Soojung Lee

License URL: https://creativecommons.org/licenses/by-nc/4.0/