Design of Distributed Recommendation Engine Based on Hadoop and Mahout

Article Preview

Abstract:

The distributed recommendation engine consists of three layers of data storage layer, Produce recommended layer and application layer, the data storage layer is mainly stored user preferences data, these data are recommended on the basis of upper recommendation engines. Produce recommend layer producing part recommend the key lies in the recommendation engine of the algorithm, the algorithm adopts the Mahout as recommendation framework, and implement custom recommendation algorithm, including the recommendation algorithm based on user similarity, based on the recommendations from the project similarity algorithm and based on the recommendations of the Slope One algorithm after receiving recommended the client's request, the Servlet will produce a recommended by pushing engine first get data model, according to the similarity between data model computing project, and generate the recommended ID. The application layer is mainly based on B/S architecture to implement, can be very easily expanded to mobile platforms.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

1284-1286

Citation:

Online since:

September 2014

Authors:

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2014 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

* - Corresponding Author

[1] Hadoop Map/Reduce tutorial. [EB/OL]. http: /hadoop. apache. org/docs/r1. 0. 4/cn/m apred_ tutorial. html, 2013. 02. 13.

Google Scholar

[2] Apache Hadoop Community. Hadoop [EB/OL]. http: /hadoop. apache. org.

DOI: 10.1002/9781119281320.ch7

Google Scholar

[3] Apache Mahout Community. Mahout [EB/OL]. http: /mahout. apache. org.

Google Scholar

[4] Sean Owen, Robin Anil, Ted Dunning, Ellen Friedman. Mahout in Action[M]. New York: Manning Publications Co. 2012: 42-48, 57-58, 92-110.

Google Scholar

[5] Tom White. Hadoop: The Definitive Guide, Third Edition[M]. Sebastopol: O'Reilly Media, Inc. 2012: 143-187.

Google Scholar

[6] Badrul Sarwar, George Karypis, Joseph Konstan, et al. Item-Based Collaborative Filtering Recommendation Algorithms[J]. GroupLens Research Group/Army HPC Research Center, Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN 55455, (2001).

DOI: 10.1145/371920.372071

Google Scholar

[7] Sebastian Schelter, Sean Owen. Collaborative Filtering with Apache Mahout [J]. RecSysChallenge' 12, Dublin, Ireland, (2012).

Google Scholar