Research on Decision Tree Algorithm Based on Information Entropy


Article Preview

Decision tree is an important learning method in machine learning and data mining ,this paper discusses the method of choosing the best attribute based on information entropy .It analyzes the process and the characters of classification and the discovery knowledge based on decision tree about the application of decision tree on data mining .Through an instance ,the paper shows the procedure of selecting the decision attribute in detail ,finally it pointes out the developing trends of decision tree.



Edited by:

Yanwen Wu




M. Du et al., "Research on Decision Tree Algorithm Based on Information Entropy", Advanced Materials Research, Vol. 267, pp. 732-737, 2011

Online since:

June 2011




[1] Mehmed Kantardzi, thanslated by Shan S Q. Chen Y. Cheng Y. Data Mining-Concept, Model, Method and Algorithm[M]. 2003(8): 120-143.

[2] Li Tianchi Zhang, Dezheng Wang, Zongjie. Based on C4. 5 analysis on measuring error for Digital Gas Field[J]. Control & Automation, 2006, 5-3: 10-12.

[3] Quinlan J R. Induction of Decision Trees[J]. Machine Learning, 1986, 1(1): 81-106.

[4] Quinlan J R. C4. 5: Programs for Machine Learning[M]. San Mateo, California: Morgan Kaufmann, (1993).

[5] Quinlan J R. Simplifying decision trees[J]. Int J of Man-machine Studies, 1987, 27( 3): 221- 234.


[6] Quinlan J R. Bagging, Booting and C4. 5 in proc of 13th National Conference on Artificial Intelligence Portland[J]. Oct 1996, 725-730.

[7] Quinlan J R. Decision tree and decisionmaking [J]. IEEE Transaction on Systems, Man , and Cybemetics, 1990, 20(2): 339-346.

[8] Swere E, Mulvaney D J. Robot navigation using decision trees[R]. Loughborougk, UK: Electronic Systems and Control Division Research, (2003).

[9] Ruggieri S. Efficient C4. 5[J]: IEEE Transactions on Knowledge and Data Engineering, 2002, 14(2) : 438-444.