Data Driven Multivariate Adaptive Regression Splines Based Simulation Optimization

Abstract:

This paper proposes a data driven based optimization approach which combines augmented Lagrangian method, MARS with effective data processing. In the approach, an expensive simulation run is required if and only if a nearby data point does not exist in the cumulatively growing database. Over time the database matures and is enriched as more and more optimizations have been performed. MARS is a self-adaptive regression process, which fits in with the multidimensional problems, and uses a modified recursive partitioning strategy to simplify high-dimensional problems into smaller yet highly accurate models. Combining the local response surface of MARS and augmented Lagrangian method improve sequential approximation optimization and reduce simulation times by effective data processing, yet maintain a low computational cost. The approach is applied to a six dimensional test function, a ten dimensional engineering problem and a two dimensional global test functions to demonstrate its feasibility and convergence, and yet some limiting properties.

• Periodical: Applied Mechanics and Materials (Volumes 44-47)
• Pages: 3800-3806
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.44-47.3800
• Online since: December 2010
• Authors: Hu Ping Mao, Yi Zhong Wu, Li Ping Chen
• Keywords: Augmented Lagrangian Method, Data Driven, Multivariate Adaptive Regression Spline (MARS), Simulation Optimization, Trust Region

References

[1] L.A. Schmit Jr., B. Farshi, Some approximation concepts for structural synthesis. AIAA J. Vol. 12, No. 5 (1974), pp.692-699.

DOI: 10.2514/3.49321

[2] L. A. Schmit, Jr., H. Miura, Approximation concepts for efficient structural synthesis, Tech. Report CR–2552, NASA, (1976).

[3] Conn, A. R., Gould, N. I. M., and Toint, Ph. L., Global Convergence of a Class of Trust Region Algorithms for Optimization with Simple Bounds, SIAM J. Numer. Ana, Vol. 25, No. 2 (1988), pp.433-464.

DOI: 10.1137/0725029

[4] Conn, A, R., Gould, N. 1. M., and Toint, Ph. L., Testing a Class of Methods for Solving Minimization Problems with Simple Bounds on the Variables, Mathematics of Computation, Vol. 50 , No. 182 (1988b), pp.399-430.

DOI: 10.1090/s0025-5718-1988-0929544-3

[5] Rodriguez J. F., Renaud J. E., Watson L. T. Trust Region Augmented Lagrangian Methods for Sequential Response Surface Approximation and Optimization. Transactions of the ASME. Vol. 120, MARCH (1998), pp.58-66.

DOI: 10.1115/1.2826677

[6] Friedman, J. H., Multivariate Adaptive Regression Splines, The Annals of Statistics, Vol. 19, No. 1 (1991), pp.1-67.

[7] Chen, V. C. P., Ruppert, D., and Shoemaker, C. A., Applying Experimental Design and Regression Splines to High-Dimensional Continuous-State Stochastic Dynamic Programming, Operations Research, Vol. 47, No. 1 (1999), p.38–53.

DOI: 10.1287/opre.47.1.38

[8] Scott Crino, Donald E. Brown Global Optimization with Multivariate Adaptive Regression Splines IEEE transactions on systems, man, and cybernetics—part B: cybernetics, Vol. 37, No. 2 (2007), pp.333-340.

DOI: 10.1109/tsmcb.2006.883430

[9] J.M. Gablonsky, Modifications of the Direct Algorithm. PhD Thesis. North Carolina State University, Raleigh, North Carolina (2001).