CN107766219A - Automated testing log collection method, system, equipment and computer memory device - Google Patents

Abstract

The present application discloses a method, system, device, and computer storage medium for collecting automated test logs, wherein the method includes: obtaining instructions for collecting preset log types, and obtaining target log types according to the instructions; type, searching the logs generated by the automated test to obtain the logs corresponding to the target log type, so as to complete the collection of the target logs. The application provides a method for collecting automated test logs, which collects the logs generated by the automated tests by classification, and these logs record the information of the automated tests, and uses the collected logs to implement analysis operations after the automated tests are completed.

Description

Automated test log collection method, system, device and computer storage device

technical field

The invention relates to computer technology, in particular to an automatic test log collection method, system, equipment and computer storage equipment.

Background technique

The automated testing of distributed storage clusters requires the execution of thousands of test scripts. In order to prevent the tests between scripts from interfering with each other, the test environment will be cleaned up before and after the execution of each test script to ensure that the environment returns to its original state. However, once the automated testing system is found to be abnormal in the later stage, when analysis operations such as performance analysis or performance analysis are required, it will not be possible.

Therefore, how to implement the analysis operation after the automated test is completed is an urgent problem to be solved by those skilled in the art.

Contents of the invention

In view of this, the present invention provides an automated test log collection method, system, device and computer storage device, with the purpose of realizing the management operation of the later stage of the automated test. The specific plan is as follows:

A method for collecting automated test logs, comprising:

Obtaining instructions for collecting preset log types, and obtaining target log types according to the instructions;

According to the type of the target log, the logs generated by the automated test are searched to obtain the log corresponding to the type of the target log, so as to complete the collection of the target log.

Optionally, the process of obtaining instructions for collecting preset log types includes:

Obtain an instruction for collecting preset log types triggered by the completion of the automated test.

Optionally, the process of obtaining instructions for collecting preset log types includes:

An instruction for collecting preset log types triggered by the automated test error is acquired.

Optionally, the target log type includes a test task log and/or a test result log generated by the automated test;

Wherein, the test task logs include cluster configuration information logs and/or automated test platform logs and/or cluster node logs; the cluster node logs include operating system logs and/or cluster status logs and/or file system logs.

Optionally, the automated test log collection method also includes:

storing the target log to a preset server.

Optionally, the process of storing the target log to a preset server includes:

The target log is stored to a preset server in the form of a compressed package.

Correspondingly, an automated test log collection system includes:

The log type acquisition module is used to obtain instructions for collecting preset log types, and obtain target log types according to the instructions;

The log collection module is configured to search the logs generated by the automated test according to the type of the target log, and obtain the log corresponding to the type of the target log, so as to complete the collection of the target log.

Optionally, the log type obtaining module is configured to obtain an instruction for collecting preset log types triggered by the completion of the automated test, and obtain a target log type according to the instruction.

Optionally, the log type obtaining module is configured to obtain an instruction for collecting a preset log type triggered by an error in the automated test, and obtain a target log type according to the instruction.

Optionally, the automated test log collection system also includes:

A log storage module, configured to store the target log to a preset server.

The present invention also provides an automated test log collection device, which includes a memory, a processor, and an automated test log collection program stored on the memory and operable on the processor. The automatic test log collection program is configured to realize the steps of the above-mentioned automatic test log collection method.

The present invention also provides a computer-readable storage medium, where a distributed automated test log collection program is stored on the computer-readable storage medium, and when the automated test log collection program is executed by a processor, the above-mentioned automated test log collection is realized method steps.

It can be seen that the automated test log collection method provided by the present invention collects the logs generated by the automated test by classification, and these logs record the information of the automated test, and the analysis operation after the automated test is completed can be realized by using the collected logs.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can also obtain other drawings according to the provided drawings without creative work.

Fig. 1 is a flow chart of a method for collecting automated test logs provided by an embodiment of the present invention;

FIG. 2 is a flow chart of another automated test log collection method provided by an embodiment of the present invention;

Figure 3 is an example of logs classified by role, time, and module for automated test logs;

Fig. 4 is the example of test result log and test task log;

Figure 5 is an example of cluster configuration information, platform operation logs and logs of each node;

Figure 6 is an example of each node system log, cluster status, and file system log;

Fig. 7 is a flow chart of automated testing;

FIG. 8 is a schematic structural diagram of an automated test log collection system provided by an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

The embodiment of the present invention discloses a method for collecting automated test logs, as shown in Figure 1, comprising:

Step S11: Obtain an instruction for collecting preset log types, and obtain a target log type according to the instruction.

Wherein, during the running process of the automated test, a log recording the automated test information will be generated in real time. It should be noted that the types of logs generated by automated testing include but are not limited to test task logs and test result logs generated by automated testing; among them, the test task logs generated by automated testing include but not limited to cluster configuration information logs, automated testing platform Logs and logs of each node in the cluster. It should be further explained that, the logs of each node in the cluster include but are not limited to operating system logs, cluster status logs and/or file system logs.

In the embodiment of the present invention, the instruction for obtaining the collection preset log type may be an instruction for obtaining the collection preset log type triggered by the completion of the automated test, and of course it may also be an instruction for obtaining the collection preset log type triggered by the automation test error, such as an mds file , osd file, mon file.

Step S12: According to the type of the target log, the logs generated by the automated test are searched to obtain the log corresponding to the type of the target log, so as to complete the collection of the target log.

It can be understood that, according to the type of the target log, the search for the log generated by the automated test can be searched in the form of a keyword, and of course can also be searched in other forms.

It should be noted that, in addition to the above method of classifying and collecting automated test logs based on the types of automated test logs, it may also be collected according to the content that the user needs to find.

It can be seen that the automated test log collection method provided by the present invention collects the logs generated by the automated test by classification, and these logs record the information of the automated test, and the analysis operation after the automated test is completed can be realized by using the collected logs.

The embodiment of the present invention also provides another automated test log collection method, as shown in Figure 2, including:

Step S21: Obtain an instruction for collecting preset log types, and obtain a target log type according to the instruction.

Wherein, during the running process of the automated test, a log recording the automated test information will be generated in real time. It should be noted that the types of logs generated by automated testing include but are not limited to test task logs and test result logs generated by automated testing; among them, the test task logs generated by automated testing include but not limited to cluster configuration information logs, automated testing platform Logs and logs of each node in the cluster. It should be further explained that, the logs of each node in the cluster include but are not limited to operating system logs, cluster status logs and/or file system logs.

In the embodiment of the present invention, the instruction for obtaining the collection preset log type may be an instruction for obtaining the collection preset log type triggered by the completion of the automated test, and of course it may also be an instruction for obtaining the collection preset log type triggered by the automation test error, such as an mds file , osd file, mon file.

Step S22: Search the logs generated by the automated test according to the type of the target log, and obtain the log corresponding to the type of the target log, so as to complete the collection of the target log.

It can be understood that, according to the type of the target log, the search for the log generated by the automated test can be searched in the form of a keyword, and of course can also be searched in other forms.

It should be noted that, in addition to the above method of classifying and collecting automated test logs based on the types of automated test logs, it may also be collected according to the content that the user needs to find.

Step S23: storing the target log to a preset server.

Wherein, the process of storing the target log to the preset server may be storing the target log to the preset server in the form of a compressed package. It should be noted that before step S23 deletes the automatically generated logs, the collected automation logs are stored in the preset server, which does not affect the smooth progress of the next automated test, and facilitates the analysis operation after the automated test is completed, such as automated testing If the system is abnormal, it is necessary to analyze the cause of the abnormality or perform analysis operations such as performance analysis.

The embodiment of the present invention also discloses a specific implementation of an automated test log collection method, including:

Step 1: Execute automated tests and trigger log collection.

Step 2: Classify according to the automated test submission role, date, time, test set, and module name, and generate a separate log directory for each test task, as shown in Figure 3.

Step 3: The lower level of the task directory is divided into the test task result log and the task log directory, as shown in Figure 4; the task log directory contains the cluster configuration information log, automation platform log, and cluster node log information for executing this task, as shown in Figure 4. 5; each cluster node has a separate directory to collect system logs, cluster status logs, and file system logs of the node, such as: mds logs, osd logs, mon logs, etc., as shown in Figure 6.

Step 4: Automatically collect various logs of the cluster, classify and collect them according to the above description, and copy them to the http server;

Step 5: Log in to the web server to view logs.

It should be noted that after the automated testing scheme is completed, the required procedure is to clean up the environment and continue with the next testing task, as shown in FIG. 7 .

Correspondingly, the embodiment of the present invention also discloses an automated test log collection system, as shown in Figure 8, including:

The log type acquisition module 11 is used to obtain instructions for collecting preset log types, and obtain target log types according to the instructions;

It should be noted that the log type acquisition module 11 is specifically used to obtain instructions for collecting preset log types triggered by the completion of automated testing, and obtain target log types according to the instructions; it can also be specifically used to obtain collection preset log types triggered by automated testing errors. Set the log type instruction, and get the target log type according to the instruction.

The log collection module 12 is configured to search the logs generated by the automated test according to the type of the target log, and obtain the log corresponding to the type of the target log, so as to complete the collection of the target log.

It can be understood that, according to the type of the target log, the search for the log generated by the automated test can be searched in the form of a keyword, and of course can also be searched in other forms.

It should be noted that, in addition to the above method of classifying and collecting automated test logs based on the types of automated test logs, it may also be collected according to the content that the user needs to find.

In order not to affect the smooth progress of the next automated test, but also to facilitate later management operations, if the automated test system is abnormal, operations such as performance analysis need to occur or need to be performed, the embodiment of the present invention also includes:

The log storage module is used to store the target log to a preset server.

Wherein, the process of storing the target log to the preset server may be storing the target log to the preset server in the form of a compressed package.

It can be seen that a kind of automated test log collection method provided by the present invention collects the logs generated by automated tests by classification, and these logs record the information of automated tests, and the analysis operation after the completion of automated tests can be realized by using the collected logs. .

The embodiment of the present invention also provides an automated test log collection device. The automated test log collection device includes a memory, a processor, and an automated test log collection program stored on the memory and operable on the processor. The automated test log collection program is configured In order to realize the steps of the above-mentioned automatic test log collection method.

The embodiment of the present invention also provides a computer-readable storage medium, where a distributed automated test log collection program is stored on the computer-readable storage medium, and when the automated test log collection program is executed by a processor, the above-mentioned automated test is realized The steps of the log collection method.

Finally, it should also be noted that in this text, relational terms such as first and second etc. are only used to distinguish one entity or operation from another, and do not necessarily require or imply that these entities or operations, any such actual relationship or order exists. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Above, the automatic test log collection method, system, equipment and computer storage device provided by the present invention have been introduced in detail. In this paper, specific examples have been used to illustrate the principle and implementation of the present invention. The description of the above embodiments is only for To help understand the method of the present invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and scope of application. In summary, the content of this specification It should not be construed as a limitation of the invention.

Claims (12)

1. A kind of 1. automated testing log collection method, it is characterised in that including：

   The instruction for collecting default daily record species is obtained, and target journaling species is obtained according to the instruction；

   According to the target journaling species, the daily record to automatic test generation is searched, and obtains the target journaling species Corresponding daily record, to complete the collection to target journaling.
2. 2. automated testing log collection method according to claim 1, it is characterised in that described obtain collects default day The process of the instruction of will species includes：

   Obtain the instruction that the automatic test completes the default daily record species of collection of triggering.
3. 3. automated testing log collection method according to claim 1, it is characterised in that described obtain collects default day The process of the instruction of will species includes：

   Obtain the instruction of the default daily record species of collection of the automatic test erroneous trigger.
4. 4. automated testing log collection method according to claim 1, it is characterised in that the target journaling species bag Include the test assignment daily record and/or test result daily record of the automatic test generation；

   Wherein, the test assignment daily record includes cluster configuration information daily record and/or automatic test platform daily record and/or cluster Each node log；Each node log of cluster includes operating system daily record and/or cluster state daily record and/or file system day Will.
5. 5. the automated testing log collection method according to any one of Claims 1-4, it is characterised in that also include：

   The target journaling is stored to predetermined server.
6. 6. automated testing log collection method according to claim 5, it is characterised in that described by the target journaling Storing to the process of predetermined server includes：

   The target journaling is stored in the form of compressed package to predetermined server.
7. A kind of 7. automated testing log collection system, it is characterised in that including：

   Daily record species acquisition module, the instruction of default daily record species is collected for obtaining, and target day is obtained according to the instruction Will species；

   Log collection module, for according to the target journaling species, the daily record to automatic test generation to be searched, obtained Daily record corresponding to the target journaling species, to complete the collection to target journaling.
8. 8. automated testing log collection system according to claim 7, it is characterised in that

   The daily record species acquisition module, the finger for completing the default daily record species of collection of triggering for obtaining the automatic test Order, and target journaling species is obtained according to the instruction.
9. 9. automated testing log collection system according to claim 7, it is characterised in that

   The daily record species acquisition module, the finger of the default daily record species of collection for obtaining the automatic test erroneous trigger Order, and target journaling species is obtained according to the instruction.
10. 10. the automated testing log collection system according to any one of claim 7 to 9, it is characterised in that also include：

    Daily record memory module, for the target journaling to be stored to predetermined server.
11. 11. a kind of automated testing log collecting device, it is characterised in that the automated testing log collecting device includes depositing The automated testing log that reservoir, processor and being stored in can be run on the memory and on the processor collects journey Sequence, the automated testing log collection procedure are arranged for carrying out the automatic test as any one of claim 1 to 6 The step of log collecting method.
12. 12. a kind of computer-readable recording medium, it is characterised in that be stored with distribution on the computer-readable recording medium Automated testing log collection procedure, such as claim is realized when the automated testing log collection procedure is executed by processor The step of automated testing log collection method any one of 1 to 6.