Realization of an Execution System of Distributed Performance Testing Based on TTCN-3

Abstract:

An execution system of distributed performance testing is designed in this paper, which provides a mechanism of node communication, test script deployment, test scheduling, execution-driving and test result collection in distributed environment. A workload model is established, by which testers can describe the performance testing requirement. A performance testing framework is given, which simulates user behaviors in real environment based on virtual users so as to generate workload from the system under test (SUT). It can control the execution of virtual users by TTCN-3 standard interface. After executing the performance testing, test report is generated by extracting log. A method of generating performance test-case is studied by reusing functional test scripts. By executing performance testing on an online bookstore, this paper demonstrates the availability of the method of reusing TTCN-3 functional test scripts and the capability of distributed performance testing system established.

• Periodical: Applied Mechanics and Materials (Volumes 713-715)
• Pages: 486-490
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.713-715.486
• Online since: January 2015
• Authors: Shuang Mei Liu*, Xue Mei Liu, Yong Po Liu
• Keywords: Distributed Testing System, Performance Testing, System under Test (SUT), TTCN-3

References

[1] SIEMENS. Synchronized Distributed Testing using TTCN-3, R. TTCN-3 User Conference (2007).

[2] Gábor Ziegler, György Réthy. Performance testing with TTCN-3, J. TTCN-3 User Conference, (2010).

[3] Ina Schieferdecker, Jens Grabowski. Introduction to the special section on advances in test automation: the evolution of TTCN-3, J. International Journal on Software Tools for Technology Transfer, 10(4): 281-283, (2012).

DOI: 10.1007/s10009-008-0071-4

[4] Katerina Goseva-Popstojanova, Fengbin Li, Xuan Wang, and Amit Sangle. A Contribution Towards Solving the Web Workload Puzzle, J. Proceedings of the 2006 International Conference on Dependable Systems and Networks, (2011).

DOI: 10.1109/dsn.2006.2

[5] Robert L. Probert, Bernard Stepien, Pulei Xiong. Formal Testing of Web Content using TTCN-3, R. TTCN-3 User Conference, (2012).

DOI: 10.1109/icit.2012.6210016

[6] Diwakar Krishnamurthy, Jerome A. Rolia, Shikharesh Majumdar. A Synthetic Workload Generation Technique for Stress Testing Session-Based Systems, J. IEEE Transactions on Software Engineering. 32(11): 868-882, (2006).

DOI: 10.1109/tse.2006.106

[7] Matthew J. Rutherford. A Case for Test-Code Generation in Model-Driven Systems, J. Generative Programming And Component Engineering, Vol. 48: 377-396. (2012).

DOI: 10.1007/978-3-540-39815-8_23

[8] Ina Schieferdecker, Bernard Stepien, Axel Rennoch. PerfTTCN, a TTCN language extension for performance testing, J. Testing of Communicating Systems, (2012).

DOI: 10.1007/978-0-387-35198-8_2

[9] Zhen Ru Dai, Jens Grabowski, Helmut Neukirchen. Timed TTCN-3 - a real-time extention for TTCN-3 , J. Proceedings of the IFIP 14th International Conference on Testing Communicating Systems XIV: 407-424. (2012).

DOI: 10.1007/978-0-387-35497-2_28

[10] Giovanni Denaro, Andrea Polini, Wolfgang Emmerich. Early performance testing of distributed software applications, J. ACM SIGSOFT Software Engineering Notes. 29(1): 94-103, (2012).

DOI: 10.1145/974043.974059

[11] Dorina Petriu. Architecture-Based Performance Analysis Applied to a Telecommunication System, J. IEEE Transactions on Software Engineering, 26(11): 1049 - 1065, (2011).

DOI: 10.1109/32.881717