A Software Design Model Based on Big Data

Article Preview

Abstract:

Big data is mainly for analytic applications, which puts high requirements on data processing ability instead of computational accuracy. In this environment, software engineering-based methods should be carried out with the goal of data processing and computation. To adapt to the development of various analytic applications in big data era, this paper provides a software design model based on big data, and at the same time, analyzes compiler mechanism of big data programming language.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

2821-2825

Citation:

Online since:

September 2014

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2014 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

* - Corresponding Author

[1] http: /www. internetware. org.

Google Scholar

[2] G. G. Zhang, C. Z. Xu, Phillip C. -Y. Sheu et al. Parallel association rule mining for medical applications. BIBE 2011: 148~154.

Google Scholar

[3] Phillip C. -Y. Sheu, Shu Wang, Qi Wang, et al. Semantic computing, cloud computing, and semantic search engine. ICSC 2009: 654~657.

DOI: 10.1109/icsc.2009.51

Google Scholar

[4] Shu Wang, Phillip C. -Y. Sheu. Applying syntactical information in Web search. Int. J. Semantic Computing. 2010; 4(4): 535~558.

DOI: 10.1142/s1793351x10001127

Google Scholar

[5] Phillip C. -Y. Sheu, Atsushi Kitazawa. From semanticobjects to semantic software engineering. Int. J. Semantic Computing 2007; 1(1): 11~28.

DOI: 10.1142/s1793351x07000020

Google Scholar

[6] Map Dean J, Ghemawat S. MapReduce: simplified data processing on large clusters. In: Brewer E, Chen P, eds. Proc. of the OSDI2004. California: USENIX Association, 2004. 137~150.

Google Scholar

[7] Sanjay Ghemawat, Howard Gobioff, Shun-Tak Leung. The Google file system. SOSP2003.

Google Scholar

[8] D. Borthakur. HDFS Architecture. http: /hadoop. apache. org/common/docs/r0. 20. 0/hdfs\ _design. html, April (2009).

Google Scholar

[9] Fay Chang, Jeffrey Dean, Sanjay Ghemawat, et, al. Bigtable: a distributed storage system for structured data. Proceedings of OSDI'06: Seventh Symposium on Operating System Design and Implementation . 2006: 205~218.

Google Scholar

[10] Jianling Sun; Qiang Jin. Scalable RDF store based on HBase and MapReduce. Advanced Computer Theory and Engineering (ICACTE), 2010: 633~636.

DOI: 10.1109/icacte.2010.5578937

Google Scholar

[11] Avinash Lakshman,Prashant Malik. Cassandra – A decentralized structured storage system. ACM SIGOPS Operating Systems Review archive. 2010; 44(2): 35~40.

DOI: 10.1145/1773912.1773922

Google Scholar