Markov Decision Process Based Adaptive Web Advertisements Scheduling

Zhi Cong Zhang; Shuai Li; Kai Shun  Hu; Hui Yu  Huang; Shao Yong  Zhao

doi:10.4028/www.scientific.net/AMR.765-767.1436

Paper Titles

Design of the Logistics Management System Based on J2EE and MVC
p.1419

An Adaptive Cooperative Spectrum Sensing Scheme Based on the k-out-of-N Fusion Rule
p.1423

Verification for Proving the Route Choice Dependence of Motorists
p.1427

Evaluation of Near-Duplicate Image Retrieval Algorithms for the Identification of Celebrities in Web Images
p.1431

Markov Decision Process Based Adaptive Web Advertisements Scheduling
p.1436

A Rule-Based Approach to Sentiment Classification of Chinese Microblogging Texts
p.1441

Study and Construction of the Rock Engineering Data Exchange and Sharing Framework
p.1446

An Adaptive Topic Crawler for Electronic Public Opinion
p.1451

Storage Model of Graph Based on Variable Collection
p.1456

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 765-767Markov Decision Process Based Adaptive Web...

Markov Decision Process Based Adaptive Web Advertisements Scheduling

Abstract:

We study web advertisements scheduling problem by fully considering the interaction of web users and web advertisements publishing system. We construct a Markov Decision Process (MDP) based web advertisements scheduling model and schedule advertisements publishing during the whole process of web surfing by the users, thus we make maximal use of personal behavior characteristics of every web user in the scheduling model. We also track the user habit with reinforcement learning, solve the MDP model by TD(λ) algorithm combing the function approximator, and obtain adaptive online scheduling policies for web advertisements publishing.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 765-767)

Pages:

1436-1440

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.765-767.1436

Citation:

Cite this paper

Online since:

September 2013

Authors:

Zhi Cong Zhang, Shuai Li, Kai Shun Hu, Hui Yu Huang, Shao Yong Zhao

Keywords:

Reinforcement Learning, Scheduling, Web Advertisements

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] M. Langheinrich, A. Nakamura, T. K. N. Abe, et al., Unintrusive customization techniques for web advertising, Computer Networks, 1999, 31(11-16): 1259-1272.

DOI: 10.1016/s1389-1286(99)00033-x

Google Scholar

[2] A. Nakamura and N. Abe, Improvements to the Linear Programming Based Scheduling of Web Advertisements, Electronic Commerce Research, 2005, 5(1): 75–98.

DOI: 10.1023/b:elec.0000045974.88926.88

Google Scholar

[3] D. M. Chickering and D. Heckerman, Targeted Advertising on the Web with Inventory Management, Interfaces, 2003, 33(5): 71-77.

DOI: 10.1287/inte.33.5.71.19248

Google Scholar

[4] N. Abe and A. Nakamura, Learning to optimally schedule internet banner advertisements, Computer Networks, 2000, 33(1): 767-774.

Google Scholar

[5] X. Peng, The Effective Genetic Clustering Algorithm and The Optimization of The Web Advertising Investment, Proceedings of the International Conference on Computational Intelligence and Security, Guangzhou, China, 2006, pp.328-332.

DOI: 10.1109/iccias.2006.294149

Google Scholar

[6] A. Nakamura, Improvements to the Linear Programming Based Scheduling of Web Advertisements, Electronic Commerce Research, 2005, 5(1): 75-98.

DOI: 10.1023/b:elec.0000045974.88926.88

Google Scholar

[7] R. S. Sutton and A. G. Barto, Reinforcement Learning: An introduction, Cambridge, Massachusetts: MIT Press, (1998).

Google Scholar

[8] K. Miyashita, Learning scheduling control knowledge through reinforcements, International Transactions in Operational Research, 2000, 7(2): 125-138.

DOI: 10.1111/j.1475-3995.2000.tb00190.x

Google Scholar