CN107343194B - A method and device for automatic testing of IPTV broadband products - Google Patents

Abstract

An IPTV broadband product automatic test method and device, the test device includes an IPTV comprehensive tester, a test control computer, an infrared controller and an industrial camera, the test method includes the following steps: the test control computer controls the IPTV comprehensive tester to supply power to the device under test /network shutdown; the test control computer outputs control signals to operate the infrared controller to control the device under test; the test control computer controls the industrial camera to take screenshots of the real-time pictures generated by the IPTV signal processed by the device under test and transmit them to the test control computer; IPTV integration The tester obtains video stream signal analysis and outputs network layer signal quality data to the test control computer; the IPTV comprehensive tester takes a screenshot of the real-time picture generated by the current IPTV signal processed by the device under test and transmits it to the test control computer; the above steps Analyze test results and output test reports.

Description

A method and device for automatic testing of IPTV broadband products

technical field

The invention belongs to the field of mobile terminal equipment testing, and in particular relates to an IPTV product automatic testing system method and testing device.

Background technique

At present, the test methods for IPTV products such as home IPTV are mainly manual testing. Manual testing is greatly affected by human subjectivity, making certain test scenarios unstable, inaccurate, not objective, unable to quantify analysis and reproducibility limitations etc. With the wide application of optical fiber-based IPTV products, traditional manual testing methods can no longer meet the needs, so how to design an automated testing solution has become an urgent problem to be solved.

Contents of the invention

The present invention is mainly applied to the automated testing of IPTV products such as smart TVs and smart set-top boxes, and in particular can be applied to testing of testing scenarios including MTBF stability testing, functional testing, and performance testing.

The invention provides a method for automatic testing of IPTV products. The hardware for implementing the method includes a testing device and a device under test. The testing tool includes an IPTV comprehensive tester (hereinafter referred to as an IPTV comprehensive tester), a test control computer, an infrared control device and industrial camera, the input IPTV signal is connected to the IPTV comprehensive tester, industrial camera and test control computer respectively through the switch. Control computer is connected, and described testing method comprises the steps:

(1) The test control computer controls the IPTV comprehensive tester to supply power to the device under test/shut off the network

(2) The test control computer outputs control signals to operate the infrared controller to control the equipment under test;

(3) The test control computer controls the industrial camera to take a screenshot of the real-time picture generated by the IPTV signal processed by the device under test and transmits it to the test control computer;

(4) The IPTV comprehensive tester analyzes and outputs the network layer signal quality data to the test control computer by obtaining the video stream signal;

(5) The IPTV comprehensive tester takes a screenshot of the real-time picture generated by the current IPTV signal processed by the device under test and transmits it to the test control computer

(6) Analyze the test results of the above steps, and output a test report.

The described automatic test method for IPTV products is characterized in that the test scenario for applying the test method is one or more of MTBF stability test, functional test and performance test.

The MTBF stability test is to simulate the typical business scenarios commonly used by users for a long time in an automated manner to verify whether the device under test has stability problems.

The functional test is to check each business scenario of the home broadband product one by one in an automated manner, and verify whether each functional module of the product can provide normal services.

The performance test is to obtain the signal layer video stream by the IPTV comprehensive tester, analyze and judge whether the IP layer has frame skipping, jitter, time delay, out-of-sequence, packet loss, etc. Adaptability and error correction ability; obtain channel switching information at the signal layer through the IPTV comprehensive tester, and obtain the switcher time at the network layer; pass high-speed The camera takes high-speed screenshots and performs image analysis to examine the performance and quality of the device under test at the presentation level

The present invention also provides the test device that carries out described IPTV product automatic test method, described test device comprises IPTV comprehensive tester (hereinafter referred to as IPTV comprehensive tester), test control computer, infrared controller and industrial camera, input The IPTV signal is connected to the IPTV comprehensive tester, industrial camera and test control computer after the switch, the tested equipment is connected to the IPTV comprehensive tester through the network cable and the power line, and the infrared controller is connected to the test control computer.

The test device also includes a display device connected to the video output port of the device under test.

The test control computer is a PC or a notebook computer or a server, and the switch is a gigabit switch.

The device under test is a smart set-top box or a smart TV.

An IPTV product automatic testing method and testing device provided by the present invention are mainly used in testing smart TVs, smart set-top boxes and other products, and can be used in testing scenarios such as MTBF stability testing, functional testing, and performance testing. Execute the control software through the test control computer, operate the infrared controller to control the device under test and obtain the real-time picture generated by the IPTV signal processed by the device under test through the industrial camera, and test the IPTV product in combination with the network layer signal quality data output by the IPTV comprehensive tester Analyze the analysis and output the results. The test method and device provided by the present invention have broken through the previous automated test software that must be connected to the device under test in a coupled manner. There is no data line to connect the device under test, and there is no need to open additional permissions/interfaces for the device under test. The whole process simulates the real user Realistic use and operation, the test results of the tested equipment are more accurate and objective. At the same time, the combination of bottom-level monitoring and upper-level analysis can more objectively reflect the real performance indicators of the tested equipment. Compared with the existing testing methods and equipment, it has the following beneficial effects:

1. No physical connection is required between the test tool and the device under test

It does not have any impact on the device under test, does not destroy the internal/external structure of the device under test, does not require additional permissions/interfaces for the device under test, and does not require the root of the smart device under test. Maintain the independence of the equipment under test and ensure the objectivity of the test results.

2. Can simulate the real operation scene of the user

Use the infrared controller to remotely control, perfectly simulate the real use scene of the user, and conduct functional, performance, and stress tests. The test scene is consistent with the real use scene, ensuring the validity of the test results.

3. IPTV comprehensive tester monitors network signals and analyzes accurately

Using the IPTV comprehensive tester to monitor the audio/video signal at the network layer can accurately analyze audio/video defects; it can obtain performance indicators that are not visible to the naked eye, such as whether the FEC stream is processed normally, etc.; Time indicators such as switcher time can be accurate to milliseconds.

4. The combination of bottom-level monitoring and upper-level analysis makes it more objective

This automated test system combines the bottom layer signal monitoring and application performance layer monitoring, which can more objectively evaluate the quality problems of the tested equipment, effectively eliminate the influence of network signals, etc., and make the evaluation of the tested equipment more accurate.

5. The adaptation workload is small

In the functional test, the real-time picture of the device under test received from the IPTV comprehensive tester is used for functional verification/comparison, which is less affected by the environment, and the workload of adapting terminal devices from different manufacturers is small. It reduces the complexity of the work of the testers and reduces the work intensity of the testers. The testers do not need to manually intervene in the whole process, but only need to configure the test script according to the test case to complete all the tests.

6. Good system compatibility,

It can test the IPTV products of all manufacturers, and the infrared controller can be learned, which is perfectly adapted to the equipment under test of various manufacturers.

Description of drawings

Fig. 1 is the schematic diagram of the structure of the testing device that carries out a kind of IPTV product automatic testing method that the present invention provides;

Detailed ways

The present invention will be further described below in conjunction with specific embodiments.

A kind of IPTV product automation testing method provided by the present invention, the hardware that carries out described method comprises test device and tested equipment 6, and described test device comprises IPTV comprehensive tester 1, test control computer 2, infrared controller 3 and industrial camera 4. Connect the input IPTV signal to the IPTV comprehensive tester, industrial camera and test control computer respectively through the switch 5, the equipment under test is connected to the IPTV comprehensive tester through the network cable and power line respectively, and the infrared controller is connected to the test control computer connected. The system structure of described hardware environment is as shown in Figure 1, and described switch is gigabit switch, and in this specific embodiment, tested device is smart TV, and IPTV comprehensive tester is E9100 type IPTV comprehensive tester.

In the above hardware, the device under test includes a smart TV/set-top box. If the device under test is a smart set-top box, the test requires a TV as a display device; the switch is used to provide a test control computer, industrial camera, IPTV comprehensive tester and other devices The local area network with high-speed communication between them; the infrared controller is controlled by the test control computer to simulate the real operation of the user, and remotely controls the device under test; the industrial camera is used to take high-speed screenshots of the images displayed on the smart TV or display device, and analyze it from the application performance layer performance of the device under test.

Described test method comprises the following steps

(1) The test control computer controls the IPTV comprehensive tester to supply power to the device under test/shut off the network

(2) The test control computer outputs control signals to operate the infrared controller to control the equipment under test;

(3) The test control computer controls the industrial camera to take a screenshot of the real-time picture generated by the IPTV signal processed by the device under test and transmits it to the test control computer;

(4) The IPTV comprehensive tester analyzes and outputs the network layer signal quality data to the test control computer by obtaining the video stream signal;

(5) The IPTV comprehensive tester takes a screenshot of the real-time picture generated by the current IPTV signal processed by the device under test and transmits it to the test control computer

(6) Analyze the test results of the above steps, and output a test report.

The test method specifically includes the following test scenarios

1. MTBF Stability Test

Simulate the common typical business scenarios of users running for a long time in an automated way, including online/local video playback, application installation and uninstallation, application browsing and switching, picture/file/audio browsing and playback, etc., to verify whether the product has a card that seriously affects the user experience Stability issues such as stuttering/distortion, performance degradation, etc.

2. Functional testing

Check each business scenario of home broadband products one by one in an automated way, including live/on-demand video playback, 4K video playback, Migu music playback, game download, Dolby function, collection function, payment function, etc., to verify whether each functional module of the product is consistent Can provide normal service.

Described functional test specifically comprises the following steps

2.1 Write scripts based on test content

2.2 Execute step (2), control the infrared controller to remotely control the device under test according to the script

2.3 Execute step (3) or (5), and execute step (4) at the same time

2.4 Analyze the data obtained by executing step (3) or (5) and step (4) by the test control computer. The analysis method is protocol layer signal analysis and/or comparison with the expected verification point, and the analysis result output as a test result.

3. Performance testing

Obtain the video stream of the signal layer through the IPTV comprehensive tester, analyze and judge whether there are frame skipping, jitter, delay, out-of-sequence, packet loss, etc. Ability; Obtain channel switching information at the signal layer through the IPTV comprehensive tester, and obtain the switcher time at the network layer; take high-speed screenshots through industrial cameras in test cases such as live broadcast, on-demand, playback, local EPG switching, and local video/file browsing. And carry out image analysis, so as to examine the performance quality of the terminal itself under test at the presentation layer.

The specific steps of the performance test include

3.1 Write scripts based on test content

3.2 Execute step (2), control the infrared controller to remotely control the device under test according to the script

3.3 Execute step (3) and execute step (4) at the same time

3.4 Analyze the data obtained by executing step (3) and executing step (4) by the test control computer. The analysis method is screenshot image analysis and/or protocol layer data flow analysis, and the analysis result is output as the test result.

The basic principles and specific implementations of the present invention have been described above, but the present invention is not limited by the above-mentioned implementation process, and the present invention can also have various changes and improvements without departing from the spirit and scope of the invention. Therefore, unless otherwise such changes and improvements depart from the scope of the present invention, they should be construed as being included therein.

Claims (10)

1. a kind of IPTV broadband product automated testing method, it is characterised in that the hardware for executing the method includes test device With equipment under test, the test device includes IPTV comprehensive tester, testing and control computer, infrared controller and industrial phase Machine, by the IPTV signal of input after interchanger respectively with IPTV comprehensive tester, industrial camera and testing and control computer phase Connection, equipment under test pass through cable and power supply line respectively and are connected with IPTV comprehensive tester, infrared controller and testing and control meter Calculation machine is connected, and the test method includes the following steps:

(1) testing and control computer control IPTV comprehensive tester is powered the/shutdown of network to equipment under test；

(2) testing and control computer output control signal operation infrared controller controls equipment under test；

(3) testing and control computer control industrial camera handles the real-time pictures generated through equipment under test to IPTV signal and cuts Scheme and is transmitted to testing and control computer；

(4) IPTV comprehensive tester is analyzed by obtaining video stream signal and exports network layer signal quality data to testing and control Computer；

(5) IPTV comprehensive tester handles the real-time pictures generated progress screenshot through equipment under test to current IPTV signal and transmits To testing and control computer；

(6) test result of above-mentioned steps is analyzed, exports test report.

2. a kind of IPTV broadband product automated testing method as described in claim 1, it is characterised in that apply the test Method testing scene is one or more of MTBF stability test, functional test and performance test.

3. a kind of IPTV broadband product automated testing method as claimed in claim 2, it is characterised in that the MTBF stablizes Property test for by way of automation long-time analog subscriber run common typical services scene, verify whether equipment under test has surely Qualitative question.

4. a kind of IPTV broadband product automated testing method as claimed in claim 2, it is characterised in that the functional survey Examination is each business scenario for checking the wide product of family one by one by automation mode, and whether the verifying each functional module of product can Normal service is provided.

5. a kind of IPTV broadband product automated testing method as claimed in claim 2, it is characterised in that the performance test For by IPTV comprehensive tester obtain signals layer video flowing, analyze and judge IP layers whether have frame-skipping, shake, time delay, random ordering, Situations such as packet loss, occurs, to investigate equipment under test to the adaptability and error correcting capability of different data streams；It is surveyed by the way that IPTV is comprehensive It tries instrument and obtains signals layer channel switching information, obtain the cut bank time in network layer；Live streaming, program request, review, local EPG is cut It changes, high speed screenshot is carried out by high-speed industrial camera in the test case example such as local video/browsing file, and carry out image point Analysis, to investigate the performance quality of equipment under test itself in presentation layer.

6. a kind of test device of IPTV broadband product automated testing method of execution as described in Claims 1 to 5 is any, It is characterized in that the test device includes: IPTV comprehensive tester, testing and control computer, infrared controller and industrial camera, The IPTV signal of input is connected with IPTV comprehensive tester, industrial camera and testing and control computer respectively after interchanger It connects, equipment under test passes through cable and power supply line respectively and is connected with IPTV comprehensive tester, and infrared controller and testing and control calculate Machine is connected.

7. test device as claimed in claim 6, it is characterised in that: the test device further includes display equipment, described aobvious Show that equipment is connected with the video-out port of equipment under test.

8. test device as claimed in claims 6 or 7, it is characterized in that the testing and control computer is PC or server, The interchanger is gigabit switch.

9. test device according to claim 6, it is characterised in that the equipment under test is smart television.

10. test device according to claim 7, it is characterised in that the equipment under test is Intelligent set top box.