CN107992418A - A kind of method and system for improving software test stability - Google Patents

Abstract

The invention discloses a kind of method and system for improving software test stability, comprise the following steps：First, tested software is loaded；2nd, automatic test chemical industry tool and pressure test instrument, including the frequency of the automatic test chemical industry tool operation of setting and number, the scene of setting pressure test instrument operation are configured on test controller；3rd, software test is started, controller calling function automated test tool, pressure test instrument, are monitored the operational process of tested software；4th, complete after the scene condition and the running frequency of setting of setting, number, terminate software test；5th, by running performance index, the hardware device index of the tested software obtained in monitoring process, the stability assessment of tested software is completed.By controller calling function automated test tool and pressure test instrument, easy to assess the stability of software, the efficiency of software test is improved.

Description

A method and system for improving software testing stability

technical field

The invention relates to the field of software stability testing, in particular to a method and system for improving the stability of software testing.

Background technique

After the software is designed and completed, its performance needs to be tested to ensure that the purpose and functional requirements of the design are met. The software stability test is to detect the long-term stable operation ability that the software must have. During the operation of the test system, by putting pressure on the test system, observe various performance indicators and operating hardware indicators of the test system.

The software stability test is a probabilistic test. Even if the stability test passes, it cannot completely guarantee that the system will not fail when it is actually running. Therefore, it is necessary to improve the test reliability as much as possible to achieve the stability of the software during operation. . By increasing the number of tests, prolonging the test time, increasing the test pressure and other measures, it is possible to further judge whether the response time has increased, whether the available memory has decreased, whether the CPU utilization has increased, and other data to improve the probability of reliable testing.

At present, for software stability testing, the general method is to manually operate the test system repeatedly for a long time, and monitor server indicators in real time: CPU utilization, memory utilization, and record response time. This method requires a lot of manpower and material resources, and seriously affects Test efficiency.

For example, Chinese patent (CN201510583803.9) discloses "a method and device for testing application software performance", the method includes: building a server based on a continuous integration engine platform, connecting multiple test machines to the server; During software testing, send the test environment configuration installation package corresponding to the preset environment deployment strategy to each test machine, so that the test machine performs test environment deployment according to the received test environment configuration installation package; The test tasks of software testing, query the pre-set mapping relationship including test tasks and test task script files and public operation function library files, obtain the test task script files and public operation function library files, and issue them to each test machine to perform The application software is tested. Although this method can improve the efficiency of software testing, it is inconvenient to adjust parameters and items in the testing process, and the testing steps are complicated, which is not conducive to the evaluation of software stability.

Contents of the invention

The invention provides a method and system for improving the stability of software testing, which are used to solve the problems in the prior art.

The present invention is achieved through the following technical solutions:

A method for improving the stability of software testing, comprising the following steps:

1. Load the software under test;

2. Configure automatic testing tools and stress testing tools on the test controller, including setting the frequency and times of running automatic testing tools, and setting scenarios for running stress testing tools;

3. Start the software test, and the controller calls the function automation test tool and stress test tool to monitor the running process of the software under test;

4. After completing the set scene conditions and the set operating frequency and times, end the software test;

5. Complete the stability evaluation of the tested software through the operating performance indicators and hardware equipment indicators of the tested software obtained during the monitoring process.

A method for improving the stability of software testing as described above, the test controller includes basic configuration, operation constraints, and operation monitoring, and the basic configuration includes but is not limited to the setting of the number and frequency of functional automation test scripts, performance automation The setting of script running times and frequency; the running constraints include but not limited to the stability test of the specified module; the running monitoring includes but not limited to real-time monitoring of whether the software environment has errors, and interrupts the test when it occurs.

In the method for improving the stability of software testing as described above, the automated testing tool simulates the daily use of the software under test by executing the functional automated test script, and the execution frequency and times of the performance automated test script are controlled by the test controller.

According to a method for improving the stability of software testing as described above, the automated testing tool performs a stress test on the software according to the set scene by executing the performance automated test script to simulate the daily use of the tested software, and the set scene content Including the number of concurrent users, test scripts, number of iterations, and server monitoring items, the frequency and times of execution of performance automation test scripts are controlled by the test controller.

A method for improving the stability of software testing as described above is characterized in that the running of the software under test is monitored by a performance testing tool, and the performance testing tool records transaction response time, transaction success rate, and server CPU utilization during each performance test. Rate, memory usage, and compare the performance test report output each time, you can get the software stability index.

The present invention also provides a system for improving the stability of software testing, including a testing controller, an automatic testing tool module, and a pressure testing tool module; the testing controller includes a basic configuration module, an operation constraint module, and an operation monitoring module. The basic configuration module includes a control unit for the running times and frequency of the function automation test script, and a control unit for the running times and frequency of the performance automation script; the operation constraint module includes but is not limited to performing a stability test on a specified module; the operation monitoring The modules include but are not limited to real-time monitoring of whether there is an error in the software environment, and interrupt the test when it occurs; the automated test tool module simulates the daily use of the tested software by executing the functional automated test script, and the execution frequency and times of the performance automated test script are subject to Test controller control; the automated test tool module performs a stress test on the software according to the set scene by executing the performance automated test script to simulate the scene in which the software under test is used daily. The set scene includes the number of concurrent users, the test script, The number of iterations, server monitoring items, and the frequency and times of performance automation test script execution are controlled by the test controller.

Compared with prior art, the advantage of the present invention is:

1. The present invention uses the controller to call the function automation test tool and the pressure test tool, sets the frequency and times of the function automation operation, sets the operation scene of the pressure test tool, and monitors the operation of the software to obtain the same operation of the system. The response time and server indicators of the system running at different times and under different pressures are convenient for evaluating the stability of the software and improving the efficiency of software testing.

2. The present invention facilitates the adjustment of set parameters and items during the testing process, and facilitates operation and use, thus better ensuring the stability of the software and the quality of use.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the description of the embodiments or the prior art.

Fig. 1 is a flow chart of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments.

As shown in Figure 1, a method for improving the stability of software testing disclosed in this embodiment comprises the following steps:

1. Load the software under test;

2. Configure automatic testing tools and stress testing tools on the test controller, including setting the frequency and times of running automatic testing tools, and setting scenarios for running stress testing tools;

3. Start the software test, and the controller calls the function automation test tool and stress test tool to monitor the running process of the software under test;

4. After completing the set scene conditions and the set operating frequency and times, end the software test;

5. Complete the stability evaluation of the tested software through the operating performance indicators and hardware equipment indicators of the tested software obtained during the monitoring process.

Specifically, the test controller in this embodiment includes basic configuration, operation constraints, and operation monitoring. The basic configuration includes, but is not limited to, the setting of the running times and frequency of functional automation scripts, and the setting of the running times and frequency of performance automation scripts; running constraints include but not limited to specifying which modules are to be tested for stability; running monitoring includes but not limited to real-time monitoring Whether there is an error in the software environment, and the test is interrupted when it occurs. Functional automated testing uses automated testing tools to automatically execute automated test scripts to simulate the daily use of software. The frequency and times of its execution are controlled by the controller. Automated performance testing means using automated performance testing tools to conduct stress tests on software according to established scenarios. The running scenario conditions include the number of concurrent users, test scripts, iterations, and server monitoring items. The performance test tool records the transaction response time, transaction success rate, server CPU utilization rate, and memory utilization rate during each performance test, and compares the performance test report output each time to obtain software stability indicators.

As shown in FIG. 1 , in this embodiment, Selenium is used as an automatic testing tool, LoadRunner is used as a performance testing tool, and Selenium is a set of web automated testing tools, including IDE, Grid, RC, WebDriver, and the like. LoadRunner is a performance testing software that analyzes possible bottlenecks in the system by simulating real user behavior, real-time monitoring of load, concurrency and performance, and completed test reports. One of the most effective means of LoadRunner should be concurrency control. The setting in the console is to simulate the operation of thousands of users at the same time to achieve the same business.

In the present embodiment, communicate with the controller and the server through the Web, based on the front-end Ui, the operation of the Selenium automated test script can be carried out, based on the underlying server LoadRunner fixed script according to the set running script test, the process can be as follows during software testing:

1. Before testing, write functional automation test scripts;

2. Set the performance test scenario: the number of concurrent users, script execution, server monitoring indicators, number of iterations

3. Set the number and frequency of automatic function running, such as running 200 times, with an interval of 5 minutes; set the number and frequency of automatic performance running, such as running 50 times, with an interval of 30 minutes

4. The stability test starts, and the controller invokes a functional automation test tool, such as selenium, to automatically operate the system and simulate the daily use of the software

5. Invoke performance automation testing tools, such as LoadRunner, perform performance testing on the software according to the set performance testing scenarios, and output test reports

6. During the running process, the controller monitors the tested software in real time, whether there is an error message, whether there is a downtime, etc. If such a situation is found, the test will be interrupted

The stability of the system can be evaluated based on the test reports output by multiple performance tests. For example, when the response time of the same transaction in multiple reports is not much different, and the server indicators are normal, it can be judged that the software has passed the stability test

The present invention also provides a system for improving the stability of software testing, including a test controller, an automatic testing tool module and a pressure testing tool module; the test controller includes a basic configuration module, an operation constraint module, an operation monitoring module, and a basic configuration module Including the control unit for the running times and frequency of functional automation test scripts, and the control unit for the running times and frequency of performance automation scripts; the running constraint module includes but is not limited to performing stability tests on specified modules; the running monitoring module includes but not limited to real-time monitoring software Whether there is an error in the environment, the test is interrupted when it occurs; the automated test tool module simulates the daily use of the software under test by executing the functional automated test script, and the frequency and times of performance automated test script execution are controlled by the test controller; the automated test tool module passes Execute performance automation test scripts to perform stress tests on the software according to the set scenarios to simulate the daily use of the software under test. The set scenarios include the number of concurrent users, test scripts, iterations, server monitoring items, and execution of performance automation test scripts The frequency and times are controlled by the test controller.

Call the function automation test tool module and stress test tool module through the controller, set the frequency and times of function automation operation, set the scene of the pressure test tool, and monitor the operation of the software to obtain the same operation of the system when the system is running Response time and server indicators at different times and under different pressures facilitate the evaluation of software stability and improve the efficiency of software testing.

The technical contents not described in detail in the present invention are all known technologies.

Claims (6)

1. A method for improving the stability of software testing, characterized in that, comprising the following steps: 1. Load the software under test; 2. Configure automatic testing tools and stress testing tools on the test controller, including setting the frequency and times of running automatic testing tools, and setting scenarios for running stress testing tools; 3. Start the software test, and the controller calls the function automation test tool and stress test tool to monitor the running process of the software under test; 4. After completing the set scene conditions and the set operating frequency and times, end the software test; 5. Complete the stability evaluation of the tested software through the operating performance indicators and hardware equipment indicators of the tested software obtained during the monitoring process. 2. A method for improving the stability of software testing according to claim 1, wherein said test controller includes basic configuration, operation constraints, and operation monitoring, and said basic configuration includes but is not limited to functional automation test scripts The setting of running times and frequency, the setting of running times and frequency of performance automation scripts; the running constraints include but are not limited to performing stability tests on specified modules; the running monitoring includes but not limited to real-time monitoring of software environments for errors, Abort the test when it occurs. 3. a kind of method that improves software test stability according to claim 2, it is characterized in that, described automated test tool simulates the situation that software under test is used by daily use by execution function automated test script, performance automated test script executes The frequency and times are controlled by the test controller. 4. A method for improving the stability of software testing according to claim 2, characterized in that, the automated testing tool performs a stress test on the software according to a set scene by executing a performance automated testing script to simulate that the software under test is routinely The scenario used, the content of the set scenario includes the number of concurrent users, test scripts, number of iterations, server monitoring items, and the frequency and times of execution of performance automation test scripts are controlled by the test controller. 5. a kind of method for improving software testing stability according to claim 2 is characterized in that, by performance testing tool, the operation of tested software is monitored, and the performance testing tool records transaction response time, transaction success during each performance test Rate, server CPU utilization rate, memory usage rate, compared with the performance test report output each time, you can know the software stability indicators. 6. A system for improving the stability of software testing, characterized in that it includes a test controller, an automatic testing tool module and a stress testing tool module; the test controller includes a basic configuration module, an operation constraint module, and an operation monitoring module, The basic configuration module includes a control unit for the number of times and frequency of functional automation test script operations, and a control unit for the number of times and frequency of performance automation script operations; the operation constraint module includes but is not limited to performing a stability test on a specified module; the operation The monitoring module includes but is not limited to real-time monitoring of whether there is an error in the software environment, and interrupts the test when it occurs; the automated test tool module simulates the daily use of the software under test by executing the functional automated test script, and the frequency and number of times the performance automated test script is executed Controlled by the test controller; the automated test tool module performs a stress test on the software according to the set scene by executing the performance automated test script to simulate the daily use of the tested software. The set scene includes the number of concurrent users, the test script , number of iterations, server monitoring items, and the frequency and times of performance automation test script execution are controlled by the test controller.