Improvement of e-commerce recommendation systems with deep hybrid collaborative filtering with content: A case study

• Authors: Wójcik Filip , Górnik Michał

Title variants

PL

Wykorzystanie Hybrydowych Głębokich Sieci Neuronowych jako systemów rekomendacyjnych. Studium przypadku

• Languages of publication: EN

Abstracts

EN

This paper presents a proposition to utilize flexible neural network architecture called Deep Hybrid Collaborative Filtering with Content (DHCF) as a product recommendation engine. Its main goal is to provide better shopping suggestions for customers on the e-commerce platform. The system was tested on 2018 Amazon Reviews Dataset, using repeated cross validation and compared with other approaches: collaborative filtering (CF) and deep collaborative filtering (DCF) in terms of mean squared error (MSE), mean absolute error (MAE) and mean absolute percentage error (MAPE). DCF and DHCF were proved to be significantly better than the CF. DHCF proved to be better than DCF in terms of MAE and MAPE, it also scored the best on separate test data. The significance of the differences was checked by means of a Friedman test, followed by post-hoc comparisons to control p-value. The experiment shows that DHCF can outperform other approaches considered in the study, with more robust scores.

PL

W artykule zbadano innowacyjną architekturę sieci neuronowych zwaną Głębokim Hybrydowym Systemem Filtracji Kolaboratywnej (DHCF), mającą posłużyć jako system rekomendacji konsumenckich. Jego zadaniem jest sugerowanie produktów klientom platform e-commerce. System został przetestowany na zbiorze danych 2018 Amazon Reviews, z wykorzystaniem powtórzonej walidacji krzyżowej, i porównany z dwoma innymi podejściami: filtracją kolaboratywną (CF) oraz filtracją kolaboratywną z siecią neuronową (DCF). Do porównania wykorzystano metryki błędu średniokwadratowego (MSE), średniego błędu bezwzględnego (MAE) oraz średniego procentowego błędu bezwzględnego (MAPE). DCF i DHCF uzyskały wyniki istotnie lepsze niż CF, a dodatkowo DHCF uzyskał lepsze wyniki niż DCF pod względem MAE i MAPE. Istotność różnic sprawdzano testem Friedmana z porównaniami wielokrotnymi i kontrolą poziomu istotności. Eksperyment dowodzi, że DHCF uzyskuje lepsze i stabilniejsze wyniki niż pozostałe metody.

Keywords

EN

collaborative filtering; deep learning; content model; product recommendation

PL

filtracja kolaboratywna; głębokie uczenie; model treści; rekomendacja produktów

• Publisher: Wydawnictwo Uniwersytetu Ekonomicznego we Wrocławiu
• Journal: Econometrics. Ekonometria. Advances in Applied Data Analytics
• Year: 2020
• Issue: vol. 24, nr 3
• Pages: 37-50

Contributors

author

Wójcik Filip

author

Górnik Michał

References

• Adomavicius, G., Bockstedt, J., Shawn, C., and Zhang, J. (2014). De-biasing user preference ratings in recommender systems. CEUR Workshop Proceedings.
• Armstrong, R. A. (2014). When to use the Bonferroni correction. Ophthalmic & Physiological Optics: The Journal of the British College of Ophthalmic Opticians (Optometrists), 34(5), 502-508.
• Bouckaert, R. R., and Frank, E. (2004). Evaluating the replicability of significance tests for comparing learning algorithms. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 3056, 3-12.
• Brynjolfsson, E., and McAfee, A. (2014). The second machine age: Work, progress, and prosperity in a time of brilliant technologies. New York, London: WW Norton & Company.
• Conover, W. J., and Iman, R. L. (1979). On multiple-comparisons procedures. Los Alamos Scientific Laboratory Tech. Rep. LA-7677-MS, 1(14).
• De Myttenaere, A., Grand, B. Le, Golden, B., and Rossi, F. (2014). Reducing offline evaluation bias in recommendation systems. ArXiv Preprint ArXiv:1407.0822.
• Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7(Jan), 1-30.
• García, S., Fernández, A., Luengo, J., and Herrera, F. (2009). A study of statistical techniques and performance measures for genetics-based machine learning: Accuracy and interpretability. Soft Computing, 13(10), 959-977.
• Goldberg, D., Nichols, D., Oki, B. M., and Terry, D. (1992). Using collaborative filtering to weave an information tapestry. Communications of the ACM, 35(12), 61-70.
• Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep learning. Cambridge Massachusetts, London: MIT Press.
• He, R., and McAuley, J. (2016). Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In 25th International World Wide Web Conference, WWW 2016.
• He, X., Du, X., Wang, X., Tian, F., Tang, J., and Chua, T.-S. (2018). Outer product-based neural collaborative filtering. ArXiv Preprint ArXiv:1808.03912.
• He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.-S. (2017). Neural collaborative filtering. Proceedings of the 26th International Conference on World Wide Web, 173-182.
• Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 65-70.
• Hornik, K., Stinchcombe, M., White, H., et al. (1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359-366.
• Jones, M. T. (2013). Recommender systems. Part 1: Introduction to approaches and algorithms. IBM DeveloperWorks, 12.
• Khattar, D., Kumar, V., Gupta, M., and Varma, V. (2018). Neural Content-collaborative filtering for news recommendation. NewsIR@ ECIR, 2079, 45-50.
• Krishnan, S., Patel, J., Franklin, M. J., and Goldberg, K. (2014). A methodology for learning, analyzing, and mitigating social influence bias in recommender systems. RecSys 2014 – Proceedings of the 8th ACM Conference on Recommender Systems.
• Lam, X. N., Vu, T., Le, T. D., and Duong, A. D. (2008). Addressing the cold-start problem in recommendation systems. Proceedings of the 2nd international conference on Ubiquitous information management and communication, 208-211.
• Li, X., and She, J. (2017). Collaborative variational autoencoder for recommender systems. Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, 305-314.
• Lundberg, S. M., and Lee, S. I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems.
• McAuley, J., Targett, C., Shi, Q., and Van Den Hengel, A. (2015). Image-based recommendations on styles and substitutes. SIGIR 2015 – Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval.
• Moore, A. W., and Lee, M. S. (1994). Efficient algorithms for minimizing cross validation error. Machine Learning Proceedings 1994, 190-198.
• Ni, J., Li, J., and McAuley, J. (2020). Justifying recommendations using distantly-labeled reviews and fine-grained aspects. EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference.
• Nielsen, M. A. (2015). Neural networks and deep learning (Vol. 25). Determination Press USA.
• Pereira, D. G., Afonso, A., and Medeiros, F. M. (2015). Overview of Friedman’s Test and post-hoc analysis. Communications in Statistics: Simulation and Computation, 44(10), 2636-2653.
• Qi, J., Du, J., Siniscalchi, S. M., Ma, X., and Lee, C.-H. (2020). On mean absolute error for deep neural network based vector-to-vector regression. IEEE Signal Processing Letters.
• Rendle, S., Freudenthaler, C., Gantner, Z., and Schmidt-Thieme, L. (2012). BPR: Bayesian personalized ranking from implicit feedback. ArXiv Preprint ArXiv:1205.2618.
• Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., and Riedl, J. (1994). GroupLens: An open architecture for collaborative filtering of netnews. Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, CSCW 1994.
• Ribeiro, M. T., Singh, S., and Guestrin, C. (2016). Why should I trust you? Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 1135-1144.
• Sarwar, B., Karypis, G., Konstan, J., and Reidl, J. (2001). Item-based collaborative filtering recommendation algorithms. Proceedings of the tenth international conference on World Wide Web – WWW’01, 285-295.
• Schafer, J., Frankowski, D., Herlocker, J., and Sen, S. (2007). Collaborative filtering recommender systems. The Adaptive Web (4321), 91-324.
• Schaffer, C. (1993). Selecting a classification method by cross-validation. Machine Learning, 13(1), 135-143.
• Sedhain, S., Menon, A. K., Sanner, S., and Xie, L. (2015). Autorec: Autoencoders meet collaborative filtering. Proceedings of the 24th international conference on World Wide Web, 111-112.
• Shani, G., and Gunawardana, A. (2011). Evaluating Recommendation Systems. In F. Ricci, L. Rokach, B. Shapira, and P. Kantor (Eds.), Recommender systems handbook. Boston, MA.: Springer. https://doi.org/10.1007/978-0-387-85820-3_8
• Shardanand, U., and Maes, P. (1995). Social information filtering: algorithms for automating “word of mouth.” Proceedings of the SIGCHI conference on Human factors in computing systems, 210-217.
• Strub, F., Gaudel, R., and Mary, J. (2016). Hybrid recommender system based on autoencoders. Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, 11-16.
• Trawinski, B., Smetek, M., Telec, Z., and Lasota, T. (2012). Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms. International Journal of Applied Mathematics and Computer Science, 22(4), 867-881.
• Zhang, H., Shen, F., Liu, W., He, X., Luan, H., and Chua, T.-S. (2016). Discrete collaborative filtering. Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 325-334.