CN100337440C - Method and system for testing intercommunity between equipments - Google Patents

Abstract

The invention discloses a method and system for interoperability testing between equipment, which are used in the field of interoperability testing between communication equipment entities. The step of establishing a mapping relationship between the initial configuration parameters and test commands of each test device; when each test case is executed, according to the mapping relationship, the initial configuration parameters and test commands corresponding to the test case are sent to the corresponding test case respectively. In the corresponding test equipment corresponding to the test case, the test equipment executes the corresponding test command to complete the steps of the interoperability test. The test system mainly includes a mapping module and a delivery module. The interoperability test method and system among devices of the present invention can reduce the workload of test engineers, and improve test efficiency and test result accuracy.

Description

Interoperability testing method and system between devices

technical field

The invention relates to the field of testing of communication systems, in particular to an interoperability testing method and system between devices.

Background technique

With the digital subscriber line (DSL, Digital Subscriber Line) technology becoming more and more mature, the test technology has shifted from strict conformance (Conformance) test to interoperability (Interoperability) test. Among them, the TR-048 interoperability test specification of the DSL Forum is a set of general interoperability test standards in the industry, which is used to ensure that devices produced by different manufacturers meet the specified basic data throughput and performance requirements. , to achieve mutual interconnection and intercommunication.

The interoperability in the TR-048 interoperability test specification of the above-mentioned DSL forum refers to: if a modem (MODEM) of a client equipment (CPE, Custom Premises Equipment) and a digital subscriber line access multiplexer (DSLAM, Digital Subscriber Line AccessMultiplexer) under the same or compatible parameters, functions and options, the actual network architecture is used as the performance test environment, and they can show satisfactory communication during the test environment change process, then they are called Dynamic and interoperable.

The TR-048 interoperability test of DSL Forum is to test the communication interoperability between DSLAM and CPE MODEM. TR-048 interoperability test system generally includes circuit emulator and Smartbits tester. Among them, the line emulator is a noise generating device, which is used to set the noise and simulated line length stipulated in TR-048 in the TR-048 interoperability test system; the Smartbits tester is a device that combines data flow generation and analysis , used to test the bit error rate and packet loss rate of data transmission between DSLAM and CPE MODEM.

In the prior art, test engineers are required to manually configure DSLAM parameters, circuit emulator parameters, and Smartbits tester parameters on the operating interface of the test machine, and artificially feed back the DSLAM, line emulator, and Smartbits tester parameters during the test process. The data is compared with the corresponding index parameters in the TR-048 standard and a test report is generated.

Referring to Figure 1, it is a structural block diagram of the TR-048 interoperability testing system. The test engineer opened the DSLAM 2 control interface on the operation interface of the test machine 1, manually input the initial configuration parameters of the DSLAM 2 during the test, and fed back the data from the DSLAM 2 during the test through the DSLAM 2 control interface Compare with the corresponding index parameters in the TR-048 standard, and then write the result data after comparison and analysis into the file system.

Similarly, by opening the control interface of the line emulator 3 on the operation interface of the test machine 1, manually input the initial configuration parameters such as the noise value and the length of the analog line, and on the control interface of the line emulator 3 according to During the test process, the data fed back by the circuit emulator 3 is compared with the corresponding index parameters in the TR-048 standard, and then the result data after comparison and analysis is written into the file system.

Open the control interface of Smartbits tester 4 on the operation interface of test machine 1, manually configure the initial configuration parameters such as test attribute data values, and after the test time stipulated in the TR-048 standard, run Smartbits tester 4 The control interface compares the data fed back by the Smartbits tester 4 during the test with the corresponding index parameters in the TR-048 standard, and then writes the result data after comparison and analysis into the file system.

Among them, the parameters of MODEM 5 can adopt the default settings under normal circumstances, so I will not describe them in detail here.

Since the TR-048 standard involves multiple test cases, when testing each test case, it is necessary to reset the initial configuration parameters of the DSLAM, the initial configuration parameters of the line emulator, and the initial configuration parameters of the Smartbits tester; When counting and analyzing various data fed back by DSLAM, circuit emulator and Smartbits tester on the operation interface of the machine, it may be necessary to take the average value many times, especially for the Smartbits tester, after several hours of data transmission After that, the data value it feeds back can be quite large. Therefore, the above two reasons may lead to a large workload of test engineers and low accuracy of test results during the DSL interoperability test process, which in turn leads to problems of low test efficiency and waste of human resources.

Contents of the invention

The present invention proposes an interoperability testing method and system between devices, in order to solve the problems in the prior art that test engineers have a large workload and low testing efficiency.

The invention provides a method and system for interoperability testing between devices, and also aims to solve the problem of low accuracy of test results in the prior art.

For this reason, the present invention proposes a kind of interoperability testing method between equipment, comprises steps:

(S1) Establishing a mapping relationship between each test case, the test equipment required to execute the test case, the initial configuration parameters and test commands for the test equipment;

(S2) When each test case is executed, according to the mapping relationship, the initial configuration parameters and test commands corresponding to the test case are sent to the test equipment corresponding to the test case, and the test equipment executes the corresponding test command , to complete the interoperability test.

Wherein step (S2) further comprises after:

(S251) Capture the test data fed back by the test equipment in time;

(S252) Comparing, analyzing and processing the test data and corresponding index parameters in the stored interoperability test standards, and then obtaining result data.

Simultaneously, the present invention also proposes a kind of interoperability test system between equipment, and this system comprises:

The mapping module is used to establish a mapping relationship between each test case, the test equipment required to execute the test case, the initial configuration parameters and test commands for the test equipment;

The delivery module is configured to deliver the initial configuration parameters and test commands corresponding to the test case to the test equipment corresponding to the test case according to the mapping relationship when executing each test case.

The interoperability testing system further includes:

A capture module, configured to capture the test data fed back by the test equipment in time;

The comparison and analysis module is connected with the capture module, and is used to compare and analyze the test data and the corresponding index parameters in the stored interoperability test standard, and then obtain the result data.

Beneficial effects of the present invention: due to the interoperability testing method and system among the devices of the present invention, the process of sending initial configuration parameters and test commands to each test device automatically, and comparing and analyzing the test data fed back by each test device It does not require test engineers to manually configure and analyze data, so the workload of test engineers is reduced. At the same time, the process of automatically performing comparison and analysis of data also improves test efficiency and test accuracy.

Description of drawings

Fig. 1 is the structural block diagram of TR-048 interoperability test system in the prior art;

Fig. 2 is a flow chart of sending initial configuration parameters and test commands in the first embodiment of the interoperability testing method between devices and the system of the present invention;

Fig. 3 is a schematic diagram of the mapping relation table in the interoperability testing method and system between the devices of the present invention;

4 is a flow chart of the testing process of the second embodiment of the interoperability testing method between devices of the present invention;

Fig. 5 is the structural block diagram of the first embodiment of the interoperability testing system among the equipments of the present invention;

Fig. 6 is a structural block diagram of the second embodiment of the interoperability testing system between devices of the present invention;

Fig. 7 is a connection diagram between the testing machine and the DSLAM;

Fig. 8 is a connection diagram between the test machine and the test equipment.

Detailed ways

The interoperability test method and system between devices of the present invention are mainly applied to the TR-048 interoperability test of the DSL forum as an example for description below.

First with reference to Fig. 2, it is the flow chart of sending initial configuration parameters and test orders of the first embodiment in the interoperability testing method between the equipment of the present invention and the system; In step 70, according to each test case, formulate the test case Test plan and scheme, that is, according to each test case, combined with the TR-048 standard, designate the test equipment that executes the test case, as well as the initial configuration parameters and test commands that need to be executed for each test equipment, and establish these corresponding entities into a mapping relationship; furthermore, a plurality of such mapping relationships can be composed into a mapping relationship table. Referring to Fig. 3, it is a schematic diagram of a mapping relationship table. Multiple test cases are set in the mapping relationship table, for example, it is composed of test case A1 to test case An; each test case is determined to be executed according to the provisions of the TR-048 standard. The test equipment for each test case, and the initial configuration parameters and test commands required for each test equipment form a mapping relationship table.

In step 80, when a test case is executed, according to the test case, the test equipment corresponding to the test case, as well as the initial configuration parameters and test commands for each test equipment are retrieved from the multiple mapping relationships established in step 70. As shown in Figure 3, when the test case A1 is to be executed, the test equipment 1 to test equipment m corresponding to the test case A1, and the initial configuration parameters and test commands corresponding to the test equipment 1 are retrieved from the mapping relationship table... Initial configuration parameters and test commands corresponding to the test device m;

In step 90, the retrieved initial configuration parameters and test commands are sent to the retrieved corresponding test equipment respectively, as shown in Figure 3, the initial configuration parameters and test commands corresponding to the test equipment 1 are sent to the test equipment 1 Middle... Send the initial configuration parameters and test commands corresponding to the test device m to the test device m.

Furthermore, the mapping relationship table shown in FIG. 3 may also be stored for use in subsequent queries. When a certain test case is executed, the mapping relationship corresponding to the test case is firstly downloaded from the stored mapping relationship table for use.

Referring to FIG. 4 , it is a flow chart of the testing process of the second embodiment of the interoperability testing method between devices of the present invention. The main process of the interoperability testing method is as follows:

In step 100, first download the mapping relationship corresponding to the test case to be executed from the pre-stored mapping relationship table; as shown in the mapping relationship table in Figure 3, when the test case A1 is to be executed, in the mapping relationship table will Download the mapping relationship corresponding to the test case A1 (the mapping relationship includes the test case A1, its corresponding test equipment 1 to test equipment m, and the initial configuration parameters and test commands corresponding to the test equipment 1 ... the corresponding test equipment m initial configuration parameters and test commands).

In step 200, in the information downloaded in step 100, the corresponding test equipment for executing the test case, and the initial configuration parameters and test command information required for each test equipment are retrieved; as shown in the mapping table in Figure 3, to execute When testing case A1, retrieve the test equipment 1 to test equipment m corresponding to the test case A1 from the downloaded information, as well as the initial configuration parameters and test commands corresponding to test equipment 1 ... the initial configuration parameters and test commands corresponding to test equipment m Test command.

In step 300, the initial configuration parameters and test commands required for each test device retrieved in step 200 are sent to the corresponding retrieved test devices respectively; as shown in the mapping relationship table in Figure 3, when the test case A1 is to be executed , send the retrieved initial configuration parameters and test commands corresponding to test device 1 to test device 1 ... send the retrieved initial configuration parameters and test commands corresponding to test device m to test device m.

In step 400, each test device feeds back test data after executing a corresponding test command, and automatically captures the test data fed back by each test device in time;

In step 500, compare and analyze the test data captured in time in step 400 and the corresponding index parameters in TR-048 (the TR-048 standard provides standard index parameters and these standard index parameters have been stored in advance, After comparing and analyzing according to the test data and the corresponding index parameters, the result data of whether the corresponding test index is passed can be obtained. Of course, the present invention is not limited to the test of the TR-048 interoperability standard, and can also be other interoperability tests. Correspondingly store the corresponding standard index parameters in advance), and then obtain the result data, that is, the message whether the test index passes.

In step 600, the result data obtained in step 500 are written into the file system one by one to form a test report for backup and subsequent query.

Assume below that the test equipment required to carry out a certain test case is a line emulator and a Smartbits tester in the TR-048 standard system, and the interoperability between the DSLAM and the MODEM in the DSL system is used as an example to test the interoperability of the present invention The test system is described in detail. Referring to Fig. 5, it is a structural block diagram of the first embodiment of the interoperability test system between devices of the present invention; wherein the interoperability test system proposed in this embodiment includes a mapping module 9, a retrieval module 12, a delivery module 13, a capture module 14, Compare and analyze module 15 and writing module 16; Above-mentioned module is all placed in the testing machine 1, wherein the function and connection relation of each module are as follows:

The mapping module 9 is mainly used to establish a mapping relationship between each test case and the test equipment required to execute the test case, as well as the initial configuration parameters and test commands for each test equipment;

Retrieval module 12, connected with mapping module 9, is mainly used for each test case, among multiple mapping relationships established by mapping module 9, retrieves the test equipment needed to execute the test case, and the Initial configuration parameters and test command information;

The sending module 13 is connected with the retrieval module 12, and is mainly used to send the initial configuration parameters and test commands retrieved by the retrieval module 12 to the corresponding test equipment retrieved respectively; Execute corresponding test commands after initial configuration parameters to test various interoperability test tasks between DSLAM and MODEM in the DSL system;

The capture module 14 is mainly used to automatically and timely capture the test data fed back by each test device, so as to obtain the various test data fed back by each test device in time;

The comparison and analysis module 15 is connected with the capture module 14, and is mainly used for comparing and analyzing the test data captured by the capture module 14 with the corresponding index parameters in TR-048 and processing them, and then obtaining the result data; that is, combining the test data and the TR-048 The corresponding index parameters in -048 are compared one by one to obtain the result data of whether the corresponding interoperability test index passes;

The writing module 16 is connected with the comparison and analysis module 15 and is mainly used to write the result data obtained by the comparison and analysis module 15 into the file system one by one to form a test report for backup and subsequent query.

In order to reuse the established mapping relationship in the future, a mapping relationship table composed of multiple mapping relationships can also be stored, and when a certain mapping relationship is called, the mapping relationship is first downloaded and reused.

Referring to Fig. 6, it is the structural block diagram of the second embodiment of the interoperability testing system between the equipment of the present invention; Wherein the interoperability testing system that this embodiment proposes comprises mapping module 9, memory module 10, download module 11, retrieval module 12, download Sending module 13, capture module 14, comparison analysis module 15 and writing module 16; Above-mentioned module is also all placed in the testing machine 1, wherein the function and connection relation of each module are as follows:

The mapping module 9 is mainly used to establish a mapping relationship between each test case and the test equipment required to execute the test case, as well as the initial configuration parameters and test commands for each test equipment;

The storage module 10 is connected with the mapping module 9 and is mainly used to store each test case and the test equipment required to execute the test case, as well as the mapping relationship established for the initial configuration parameters and test commands of each test equipment. Mapping relationship table; that is, the test case mapping relationship table as shown in Figure 3 is stored in the storage module 10;

The download module 11 is connected with the storage module 10, and is mainly used for downloading the corresponding mapping relationship of each test case from the mapping relationship table stored in the storage module 10, that is, downloading the test case and the required test equipment for executing the test case and initial configuration parameters and test command information for each test device;

Retrieval module 12, connected with download module 11, is mainly used for each test case, among the information downloaded by download module 11, retrieves the test equipment needed to execute the test case, and the initial configuration parameters for each test equipment and test command information;

The sending module 13 is connected with the retrieval module 12, and is mainly used to send the initial configuration parameters and test commands retrieved by the retrieval module 12 to the corresponding test equipment retrieved respectively; Execute corresponding test commands after initial configuration parameters to test various interoperability test tasks between DSLAM and MODEM in the DSL system;

The capture module 14 is mainly used to automatically and timely capture the test data fed back by each test device, so as to obtain the various test data fed back by each test device in time;

The comparison and analysis module 15 is connected with the capture module 14, and is mainly used for comparing and analyzing the test data captured by the capture module 14 with the corresponding index parameters in TR-048 and processing them, and then obtaining the result data; that is, combining the test data and the TR-048 The corresponding index parameters in -048 are compared one by one to obtain the result data of whether the corresponding interoperability test index passes;

The writing module 16 is connected with the comparison and analysis module 15 and is mainly used to write the result data obtained by the comparison and analysis module 15 into the file system one by one to form a test report for backup and subsequent query.

Wherein in the test machine 1, in the process of executing the test process for each of the above-mentioned functional modules, the sending module 13 sends the DSLAM initial configuration parameters and test commands to the DSLAM through the serial port, and simultaneously sends the circuit emulator initial configuration parameters and test commands to the DSLAM. The test command is sent to the line emulator through the serial port, and the initial configuration parameters and test commands of the Smartbits tester are sent to the Smartbits tester through the network port; the DSLAM, the line emulator and the Smartbits tester are performing corresponding interoperability tests. , continuously feed back the test data to the test machine 1 through the corresponding serial ports and network ports, and the capture module 14 in the test machine 1 automatically captures the test data fed back by the three test devices, and then sends them in time for comparison The analysis module 15 is compared with the corresponding index parameters in the TR-048 standard to obtain the result data of whether the corresponding index test is passed; then the obtained result data is sent to the writing module 16 in time, and written into the file system one by one in the form of a test report.

The sending module 13 in the above-mentioned test machine 1 respectively establishes logical channels with the DSLAM, the circuit emulator and the Smartbits tester through the scripting language, and then issues the initial configuration parameters and test commands through the corresponding scripting language logical channels respectively to the corresponding test equipment; then each test equipment feeds back the test data to the test machine 1 through these corresponding script language logic channels for subsequent capture, comparison analysis and writing operations. Its detailed processing is as follows:

With reference to Fig. 5, on test machine 1, utilize certain programming language, as TCL (Tools CommandLanguage), Microsoft Visual C++, write DSLAM control package, dynamic link library (DLL, Dynamic Link Library), to form scripting language logic channel , and then the sending module 13 sends the initial configuration parameters and test commands of the DSLAM to the DSLAM through the logical channel; at the same time, the test machine 1 uses a serial port or a network port to send or receive binary codes or string instructions for controlling the DSLAM for communication ; And the DSLAM returns the test data to the testing machine 1 by the formed logic channel, so as to carry out the next step.

With reference to Fig. 6, on the testing machine 1, utilize certain programming language, as TCL (Tools CommandLanguage), Microsoft Visual C++, utilize the bottom layer of some existing control interfaces and test equipment (comprising circuit emulator and Smartbits tester) Drive command, write the corresponding test equipment control package and dynamic link library DLL to form the corresponding scripting language logic channel. In the sending module 13, the test command is sent to the corresponding test equipment through the serial port, the network port or the general interface bus GPIB card and the GPIB cable. After receiving the test command, the test equipment executes the corresponding test. Then the test equipment takes certain test status values as test data, and feeds back to the test machine 1 through the formed script language logic channel.

The above is only a preferred embodiment of the present invention, it should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, and these improvements and modifications should also be It is regarded as the protection scope of the present invention.

Claims (12)

1, a kind of interoperability testing method of equipment room is characterized in that, this method comprises the steps:

(S1) each test case, carry out the required testing equipment of this test case, be created as mapping relations at the initial configuration parameter and the test command of this testing equipment;

When (S2) carrying out each test case, according to described mapping relations, initial configuration parameter that will be corresponding and test command with this test case be issued to respectively with the corresponding testing equipment of this test case in, testing equipment is carried out corresponding test command, to finish Interoperability Testing.

2, interoperability testing method according to claim 1, it is characterized in that, further be included in the described step (S2) and retrieve the testing equipment corresponding in the described mapping relations, reach initial configuration parameter and test command at each testing equipment with the test case that will carry out.

3, interoperability testing method according to claim 1 is characterized in that, also comprises in the described step (S1) a plurality of described mapping relations are formed mapping relations table and storage; Simultaneously the index parameter in the Interoperability Testing standard is stored.

4, interoperability testing method according to claim 3 is characterized in that, described step (S2) further comprises:

(S241) the pairing mapping relations of the test case that will carry out are downloaded from the mapping relations table of storage;

(S242) in the mapping relations of downloading, retrieve the testing equipment corresponding, reach initial configuration parameter and test command at each testing equipment with the test case that will carry out.

5, interoperability testing method according to claim 3 is characterized in that, described step (S2) further comprises afterwards:

(S251) in time catch the test data that described testing equipment is fed back;

(S252) the corresponding index parameter in the Interoperability Testing standard of described test data and storage is compared processing, and then obtain result data.

6, interoperability testing method according to claim 5 is characterized in that, (S252) also comprises afterwards in described step: described result data is write file system one by one, to form test report.

7, a kind of Interoperability Testing system of equipment room is characterized in that, this system comprises:

Mapping block is used for each test case, carries out the required testing equipment of this test case, is created as mapping relations at the initial configuration parameter and the test command of this testing equipment;

Issue module, be used for when carrying out each test case, according to described mapping relations, initial configuration parameter that will be corresponding and test command with this test case be issued to respectively with the corresponding testing equipment of this test case in.

8, Interoperability Testing according to claim 7 system is characterized in that this system also comprises:

Retrieval module, respectively with described mapping block with issue module and be connected, be used for according to each test case, the required testing equipment of this test case is carried out in retrieval, and at the initial configuration parameter and the test command of each testing equipment.

9, Interoperability Testing according to claim 7 system is characterized in that this system also comprises:

Memory module is connected with described mapping block, is used to store the mapping relations table that each mapping relations are formed;

Download module is connected with described memory module, is used for downloading the mapping relations corresponding with the test case that will carry out from the mapping relations table of storage;

Retrieval module, respectively with described download module with issue module and be connected, be used for retrieving the required testing equipment of implementation of test cases, and at the initial configuration parameter and the test command of each testing equipment from the mapping relations of downloading.

10, Interoperability Testing according to claim 9 system is characterized in that described memory module also stores the index parameter in the Interoperability Testing standard.

11, Interoperability Testing according to claim 10 system is characterized in that this system also comprises:

Trapping module is used in time catching the test data that described testing equipment is fed back;

The compare of analysis module is connected with described trapping module, is used for the processing that compares of corresponding index parameter with the Interoperability Testing standard of test data and storage, and then obtains result data.

12, Interoperability Testing according to claim 11 system is characterized in that this system also comprises:

Writing module is connected with described compare of analysis module, is used for result data is write file system one by one, to form test report.

Images