CN116364090A - Audio data analysis and processing method, server device and system - Google Patents

Abstract

The present application relates to an audio data analysis and processing method, server device, system, equipment and storage medium. The audio data analysis and processing method described in the present application includes: obtaining the audio fragment of the target audio data at the current moment; if there is an incomplete audio frame in the obtained audio fragment, cutting the audio fragment, removing the A complete audio frame; analyzing and processing the clipped audio slices to obtain analysis and processing results of the audio slices; merging the analysis and processing results of continuous audio slices in the audio data. The audio data analysis and processing method described in this application has the advantage of improving the efficiency of audio data analysis and processing.

Description

Audio data analysis and processing method, server device and system

technical field

The present application relates to the technical field of audio data processing, in particular to an audio data analysis and processing method, server device, system, equipment and storage medium.

Background technique

With the popularization of computer technology, more and more users can upload the recording through the application program to obtain the analysis results of this recording. The recording device can upload the work at the same time during the recording process, shortening the upload time.

However, in practice, it is found that in order to ensure that the analysis and processing of the data do not make mistakes, the server needs to perform analysis and processing after receiving the complete recording, which leads to low efficiency of audio data analysis and processing of the recording.

During the research process, the inventor found that how to improve the efficiency of audio data analysis and processing is a technical problem that needs to be solved.

Contents of the invention

Based on this, the purpose of the present application is to provide an audio data analysis and processing method, server device, system, equipment and storage medium, which have the advantage of improving the efficiency of audio data analysis and processing.

According to the first aspect of the embodiments of the present application, an audio data analysis and processing method is provided, the audio data analysis and processing method includes:

Obtain the audio fragment of the target audio data at the current moment;

If there is an incomplete audio frame in the acquired audio fragment, cutting the audio fragment to remove the incomplete audio frame;

Analyzing and processing the clipped audio fragments to obtain analysis and processing results of the audio fragments;

The analysis processing results of consecutive audio slices in the audio data are merged.

According to the second aspect of the embodiments of the present application, there is provided an audio data analysis and processing method, the audio data analysis and processing method comprising:

Collecting target audio data at the client; when detecting that the target audio data currently collected meets preset conditions, cutting the currently collected target audio data into audio fragments, and uploading the audio fragments to the server;

Acquire the audio fragments of the target audio data at the server; if there are incomplete audio frames in the obtained audio fragments, cut the audio fragments to remove the incomplete audio frames; The audio fragments are analyzed and processed to obtain the analysis and processing results of the audio fragments; the analysis and processing results of the continuous audio fragments in the audio data are combined and sent to the client.

According to a third aspect of the embodiment of the present application, an audio data analysis and processing system is provided, including a client and a server, wherein the client is used to collect target audio data; when the currently collected target audio is detected When the data meets the preset conditions, the currently collected target audio data is truncated into audio fragments, and the audio fragments are uploaded to the server;

The server is used to obtain the audio fragments of the target audio data; if there are incomplete audio frames in the obtained audio fragments, the audio fragments are cut to remove the incomplete audio frames; Analyzing and processing the audio fragments to obtain the analysis and processing results of the audio fragments; merging the analysis and processing results of consecutive audio fragments in the audio data, and sending them to the client.

According to a fourth aspect of the embodiments of the present application, there is provided an audio data analysis and processing server device, the device comprising:

The obtaining module is used to obtain the audio fragmentation of the current moment of the target audio data;

A clipping module, configured to clip the audio clips to remove incomplete audio frames if there are incomplete audio frames in the acquired audio clips;

An analysis and processing module, configured to analyze and process the clipped complete audio fragments, and obtain analysis and processing results of the audio fragments;

The result merging module is used for merging the analysis and processing results of continuous audio slices in the audio data.

According to a fifth aspect of the embodiments of the present application, there is provided an electronic device, including: a processor and a memory; wherein, the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing any one The audio data analysis and processing method.

According to the sixth aspect of the embodiments of the present application, there is provided a computer-readable storage medium, on which a computer program is stored, and it is characterized in that, when the computer program is executed by a processor, any one of the audio data analysis and processing methods described above is implemented .

In this application, when a single audio fragment is obtained, if there is an incomplete audio frame in the audio fragment, the audio fragment can be trimmed to remove the incomplete audio frame, which can avoid The problem of parsing failure caused by the complete audio frame, so that individual audio fragments can be analyzed and processed. There is no need to wait for all audio fragments to be uploaded and merged before analysis and processing. Analysis and processing can be performed in advance. Multiple After the audio fragments are analyzed and processed, the analysis results of the audio fragments with continuity in content can be merged. There is no need to wait for all the audio fragments to be analyzed and processed before merging them one by one, which further shortens the audio data analysis. Processing time, thereby improving the efficiency of audio data analysis and processing.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

For better understanding and implementation, the present application will be described in detail below in conjunction with the accompanying drawings.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic block diagram of an application environment of an audio data analysis and processing method provided by an embodiment of the present application;

FIG. 2 is a flowchart of an audio data analysis and processing method provided by an embodiment of the present application;

FIG. 3 is a flow chart of an audio data analysis and processing method provided in another embodiment of the present application;

FIG. 4 is a flow chart of an audio data analysis and processing method provided in another embodiment of the present application;

FIG. 5 is an interactive diagram of an audio data analysis and processing method provided by another embodiment of the present application;

FIG. 6 is a schematic structural diagram of an audio data analysis and processing server device provided by an embodiment of the present application;

Fig. 7 is a schematic structural block diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.

It should be clear that the described embodiments are only some of the embodiments of the present application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be Read as indicating or implying relative importance. Those of ordinary skill in the art can understand the specific meanings of the above terms in this application according to specific situations. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. As used herein, the words "if"/"if" may be construed as "at" or "when" or "in response to a determination". In addition, in the description of the present application, unless otherwise specified, "plurality" means two or more. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship.

Please refer to FIG. 1 , which is a schematic block diagram of an application environment of an audio data analysis and processing method provided by an embodiment of the present application. As shown in FIG. 1 , the application environment of the audio data analysis and processing method of the embodiment of the present application includes a client 1000 and a server 2000 . Wherein, the client 1000 is used to collect target audio data; when it is detected that the currently collected target audio data meets the preset conditions, the currently collected target audio data is truncated into audio fragments, and the audio fragments are uploaded to The server 2000; the server 2000 is used to obtain the audio fragment of the target audio data; if there is an incomplete audio frame in the obtained audio fragment, the audio fragment is cut to remove the incomplete audio frame; Analyzing and processing the clipped audio fragments to obtain the analysis and processing results of the audio fragments; merging the analysis and processing results of the continuous audio fragments in the audio data, and sending them to the client 1000 .

Embodiment one:

The embodiment of the present application discloses a method for analyzing and processing audio data, and the method is applied to a server.

A method for analyzing and processing audio data provided by an embodiment of the present application will be described in detail below with reference to FIG. 2 .

Please refer to Figure 2, a method for analyzing and processing audio data provided in the embodiment of the present application, including the following steps:

Step S101: Obtain the audio segment of the target audio data at the current moment.

Wherein, the target audio data may refer to a piece of complete recording content data recorded by the user on the client device.

Wherein, the audio fragment may refer to a part of the target audio data.

In this embodiment, when it is detected that the recording content satisfies certain conditions, for example, the recording duration reaches the preset time length threshold, the client can first package this part of the recording content into an audio segment and upload it to the server, and the service The terminal can obtain the audio fragment of the target audio data at the current moment. Assuming that the target audio data is X={x ₁ , x ₂ ,..., x _m }, when the recording content satisfies certain conditions, it is cut into a separate audio slice x _n (0<n≤m), The audio fragment x _n is transmitted to the server in advance through the network. During this process, the user simultaneously records the next audio fragment x _n+1 . Optionally, after the audio fragment x _n is obtained, a copy of the audio fragment can be transferred to the shared storage for other operations such as audio merging.

As the client continues to record, cut and package audio fragments to upload, the server can obtain multiple consecutive audio fragments uploaded by the client in turn. Of course, due to network transmission delays and other factors, the server may also obtain Multiple audio fragments are not contiguous, or only some of them are contiguous.

As an optional implementation manner, after the acquisition of the audio slice at the current moment of the target audio data, the audio data analysis and processing method further includes:

obtaining a start audio frame located at a start position of the audio slice, and obtaining an end audio frame located at an end position of the audio slice;

If the start audio frame is an incomplete audio frame and/or the end audio frame is an incomplete audio frame, determine that there is an incomplete audio frame in the audio slice;

or,

If the start audio frame is an incomplete audio frame and/or the end audio frame is an incomplete audio frame, it is determined that there is an incomplete audio frame in the audio slice.

In the embodiment of the present application, the audio fragment is obtained by cutting data, which may result in cutting out a part of the start audio frame located at the start position of the audio fragment, or may result in A portion of the end audio frame is cut off at the end position. The audio frames located in other positions of the audio slice will not be cut, and it can be determined that the audio frames located in other positions of the audio slice are complete audio frames. Therefore, if the start audio frame is an incomplete audio frame and/or the end audio frame is an incomplete audio frame, it may be determined that there is an incomplete audio frame in the audio slice. There is no need to judge each audio frame, which saves system resources and improves the efficiency of system-related operations.

Step S102: If there is an incomplete audio frame in the acquired audio segment, trim the audio segment to remove the incomplete audio frame.

Wherein, the audio frame may refer to audio sample data of one data length unit, and different encoding formats may correspond to different audio frames.

Among them, audio fragments are cut data, and there may be incomplete audio frames. Incomplete audio frames will cause the analysis of audio fragments to fail, that is, audio fragments cannot be analyzed and processed separately. In order to determine that audio fragments can be analyzed separately Fragments are analyzed and processed, and incomplete audio frames in the audio fragments need to be removed.

In the embodiment of the present invention, incomplete audio frames may be determined, and then these incomplete audio frames may be deleted to complete the clipping of the audio slices.

Step S103: Analyzing and processing the clipped audio fragments to obtain an analysis and processing result of the audio fragments.

Wherein, the analysis processing can be to evaluate the recording content of the audio fragment according to preset rules, and the obtained analysis processing result can be a score or a grade, such as scoring a section of English recording, and obtaining a score, such as 80 points , or get a grade, say A.

Step S104: Merge analysis and processing results of consecutive audio slices in the audio data.

Wherein, the continuous audio fragments may refer to received audio fragments with adjacent fragment numbers.

Wherein, each audio fragment can be assigned a sequence number according to the composition position of the audio fragment itself in the target audio data before the network is transmitted, that is, the preset fragment sequence number is assigned, and all audio fragments can be According to the combination of the preset segment numbers into the entire data content of the audio data, audio segments with adjacent preset segment numbers may constitute a piece of continuous data content as a whole.

Optionally, the analysis and processing results of merging the continuous audio slices in the audio data include:

If there are continuous fragments in the historical fragments of the target audio data, the analysis and processing results of the continuous fragments are merged, wherein the continuous fragments are historical fragments with adjacent preset fragment numbers.

Wherein, the historical segment may refer to an audio segment that has been obtained before the current moment and belongs to the target audio data.

Wherein, each audio fragment can be assigned a sequence number according to the composition position of the audio fragment itself in the target audio data before the network transmits, that is, the preset fragment sequence number is assigned, and there are adjacent preset fragments. The audio slices of the slice number can constitute a piece of continuous data content as a whole.

Optionally, if there are no continuous fragments in the acquired historical fragments of the target audio data, the analysis and processing results cannot be merged, and the currently obtained analysis and processing results can be temporarily saved for subsequent audio analysis. Analysis and processing continued after slices arrived.

Wherein, the combined analysis and processing results can be stored in the shared storage, and can be used for merging with subsequent analysis and processing results, and the merging operation can be performed in advance to improve the processing efficiency. Merging the analysis results of the continuous slices can be combined in different ways according to different types of analysis results, for example: if the analysis result is an evaluation score, the combination method can be to find the average value of multiple analysis results; if If the analysis result is a detected statement error, the merge method can combine multiple analysis results into an error set, which can be represented by an array or other data structures.

As an optional implementation manner, after the merging of the analysis and processing results of continuous audio slices in the audio data, the audio data analysis and processing method further includes:

After receiving all the audio fragments of the target audio data, merging the analysis and processing results of all the audio fragments;

Sending the combined analysis and processing results.

In the embodiment of the present application, when all audio fragments of the target audio data are received, it means that the analysis and processing work of all audio fragments has been completed, and the analysis and processing results of all audio fragments can be combined to obtain the final analysis and processing results. The combined analysis and processing results may be sent to the client, and the client will display the combined analysis and processing results to the user.

Optionally, the number of analysis and processing results may be counted to obtain the number of results, and if the number of results is equal to a preset number threshold, it may be determined that all audio fragments receiving the target audio data are received.

Optionally, after receiving the audio fragment carrying the last preset fragment sequence number, it can be determined that all audio fragments of the target audio data have been received, and the merging of all audio fragments can be blocked, waited and returned, Operations such as merging of analysis and processing results.

In the embodiment of the present application, when a single audio fragment is obtained, if there is an incomplete audio frame in the audio fragment, the audio fragment can be trimmed to remove the incomplete audio frame, which can avoid Due to the problem of parsing failure caused by incomplete audio frames, individual audio fragments can be analyzed and processed. There is no need to wait for all audio fragments to be uploaded and merged before analysis and processing. Analysis and processing can be performed in advance. After multiple audio fragments are analyzed and processed, the analysis results of the audio fragments with continuity in content can be merged. There is no need to wait for all the audio fragments to be analyzed and processed before merging them one by one, further shortening the audio frequency. The time for data analysis and processing is reduced, thereby improving the efficiency of audio data analysis and processing.

Embodiment two:

Please refer to Fig. 3, the main difference between this embodiment and Embodiment 1 is that, after obtaining the audio slice of the current moment of the target audio data, the following steps are also included:

Step S201: If there are continuous fragments in the historical fragments of the target audio data, merge the continuous fragments, wherein the continuous fragments are historical fragments with adjacent preset fragment numbers;

Wherein, merging may refer to combining the consecutive segments according to the sequence of their preset segment numbers.

As an optional implementation manner, the audio data analysis and processing method further includes:

If there is no continuous segment in the acquired historical segment of the target audio data, add the audio segment to the historical segment.

Optionally, in the historical shards, the continuous shards may also be replaced with merged continuous shards.

Among them, the audio fragments received by the server will be stored in a cache area as historical fragments. After the server merges the continuous fragments, the continuous fragments used for merging can be deleted in the cache area. , and then store the merged continuous fragments to complete the replacement. The merged continuous fragments have all the preset fragment serial numbers of the merged continuous fragments, and the merged continuous fragments can be used for and received later The audio fragments are merged to avoid resource waste caused by repeated merging.

Step S202: After receiving all the audio fragments of the target audio data, merge all the audio fragments.

In the embodiment of the present application, as shown in Figure 4, after acquiring the audio fragments of the target audio data at the current moment, the audio fragments are stored in the shared storage, and the audio fragments can be merged, which is the corresponding analysis If the processing operation is carried out at the same time, different tasks can be performed at the same time through multiple threads or multiple servers. The merging sequence of the audio fragments is determined by the preset fragment number, which avoids the problem of out-of-order audio fragments. The sequenced audio fragments can also be merged immediately. It is not necessary to wait for all the audio fragments to arrive before starting the merge operation. When the last audio fragment is received, only the last audio fragment needs to be merged. The merging operation of all audio fragments can be completed, and the merging efficiency of the audio fragments is improved.

Step S203: storing the combined audio fragments.

The combined audio fragments can be stored in a permanent storage area and can be accessed by users at any time.

In the embodiment of the present application, the merged audio fragments can be persistently stored for subsequent access by users.

Optionally, if all audio fragments of the target audio data have not been received, reception success information may be generated and sent.

In this optional embodiment, prompt information may be generated to prompt the user that the audio fragment has been successfully received.

Optionally, if all audio fragments of the target audio data have been received, generate and send waiting analysis and processing result information.

In this optional embodiment, if all the audio fragments of the target audio data have been received, prompt information may be generated to prompt the user to wait for the analysis and processing result.

Embodiment three:

Please refer to Fig. 5, a method for analyzing and processing audio data provided by the embodiment of the present application, including the following steps:

Step S301: Collect target audio data on the client side, and when it is detected that the currently collected target audio data meets the preset conditions, cut the currently collected target audio data into audio fragments, and upload the audio fragments to the service end.

Among them, the client can collect the user's audio information, convert the audio information into audio data, and can package the audio data into audio fragments for data upload and other operations. The client can cut the recorded content synchronously during the recording process, and package it into audio fragments for uploading.

Wherein, the preset condition may be a preset recording duration threshold, assuming that the recording duration threshold is 10 seconds, the currently collected audio data is packaged into audio fragments every 10 seconds during the recording process, and an auto-incrementing The segment number of the audio segment is added to the audio segment. For example, if the currently packaged audio segment is the third audio segment, the added segment number is 3 to complete the cutting of the currently obtained audio data.

Step S302: Obtain the audio fragment of the target audio data at the server; if there is an incomplete audio frame in the obtained audio fragment, trim the audio fragment to remove the incomplete audio frame; Analyzing and processing the audio fragments to obtain the analysis and processing results of the audio fragments; merging the analysis and processing results of consecutive audio fragments in the audio data, and sending them to the client.

In the embodiment of the present application, after receiving the analysis and processing result returned by the server, the client can output the analysis and processing result to the display interface. Optionally, it can generate voice according to the analysis and processing result for broadcasting.

The operation of the server in this embodiment is the same as that in Embodiment 1 and Embodiment 2, and will not be repeated here.

Embodiment four:

This embodiment provides an audio data analysis and processing server device, which can be used to execute the audio data analysis and processing methods in Embodiments 1 and 2 of the present application. For details not disclosed in this embodiment, please refer to Embodiments 1 and 2 of this application.

Please refer to FIG. 6 . FIG. 6 is a schematic structural diagram of an audio data analysis and processing server device disclosed in an embodiment of the present application. The audio data analysis and processing server device can run in a server. As shown in Figure 6, the server device includes:

The acquiring module 701 is configured to acquire audio fragments of the target audio data at the current moment.

The cropping module 702 is configured to, if there are incomplete audio frames in the acquired audio fragments, crop the audio fragments to remove the incomplete audio frames.

The analysis and processing module 703 is configured to analyze and process the clipped complete audio fragment, and obtain an analysis and processing result of the audio fragment.

The result combining module 704 is configured to combine the analysis and processing results of continuous audio slices in the audio data.

In an optional embodiment, the acquiring module 701 is further configured to acquire a start audio frame located at the start position of the audio slice, and acquire an end audio frame located at the end position of the audio slice .

As shown in Figure 6, the audio data analysis and processing server device may also include:

A determining module 705, configured to determine that there is an incomplete audio frame in the audio slice if the start audio frame is an incomplete audio frame and/or the end audio frame is an incomplete audio frame.

The determination module 705 is further configured to determine that there is no incomplete audio frame in the audio slice if the start audio frame is a complete audio frame and the end audio frame is a complete audio frame.

In an optional embodiment, the result merging module 704 is further configured to merge the analysis and processing results of the continuous segments if there are continuous segments in the acquired historical segments of the target audio data.

In an optional embodiment, as shown in FIG. 6, the audio data analysis and processing server device further includes:

The audio merging module 706 is configured to merge the continuous segments if there are continuous segments in the acquired historical segments of the target audio data.

The audio merging module 706 is further configured to merge all the audio fragments after receiving all the audio fragments of the target audio data.

The storage module 707 is configured to store the merged audio fragments.

As an optional implementation manner, the audio data analysis and processing server device may also include:

An adding module, configured to add the audio segment to the historical segment if there is no continuous segment in the acquired historical segment of the target audio data.

As an optional implementation manner, the audio data analysis and processing server device may also include:

A replacement module, configured to replace the continuous shards in the historical shards with merged continuous shards.

As an optional implementation manner, as shown in FIG. 6, the audio data analysis and processing server device may also include:

The information transceiving module 708 is configured to generate and send reception success information if all audio fragments of the target audio data have not been received.

As an optional implementation manner, the information transceiving module 708 is further configured to generate and send waiting analysis and processing result information if all audio fragments of the target audio data have been received.

As an optional implementation manner, the result merging module 704 is also used for merging the analysis and processing results of the continuous audio segments in the audio data, when all the audio segments of the target audio data are received After fragmentation, the analysis and processing results of all audio fragments are merged.

The audio data analysis and processing server device may also include:

A sending module, configured to send the combined analysis and processing results.

In the embodiment of the present application, when a single audio fragment is obtained, if there is an incomplete audio frame in the audio fragment, the audio fragment can be trimmed to remove the incomplete audio frame, which can avoid Due to the problem of parsing failure caused by incomplete audio frames, individual audio fragments can be analyzed and processed. There is no need to wait for all audio fragments to be uploaded and merged before analysis and processing. Analysis and processing can be performed in advance. After multiple audio fragments are analyzed and processed, the analysis results of the audio fragments with continuity in content can be merged. There is no need to wait for all the audio fragments to be analyzed and processed before merging them one by one, further shortening the audio frequency. The time for data analysis and processing is reduced, thereby improving the efficiency of audio data analysis and processing.

Embodiment five:

As shown in Figure 1, this embodiment also provides an audio data analysis and processing system, including a client 1000 and a server 2000;

The client 1000 is used to collect target audio data; when it is detected that the currently collected target audio data meets the preset conditions, the currently collected target audio data is truncated into audio fragments, and the audio fragments are uploaded to the server 2000;

Wherein, the client 1000 can collect audio information of the user, convert the audio information into audio data, and package the audio data into audio fragments for data uploading and other operations.

The server 2000 is used to obtain the audio fragments of the target audio data; if there are incomplete audio frames in the obtained audio fragments, the audio fragments are trimmed to remove the incomplete audio frames; The audio fragments are analyzed and processed to obtain the analysis and processing results of the audio fragments; the analysis and processing results of consecutive audio fragments in the audio data are combined and sent to the client 1000 .

Wherein, the client 1000 may output the information received from the server 2000 to a display interface for display to the user.

The server 2000 is the same as the audio data analysis and processing server device described in Embodiment 4 of the present application, and will not be repeated here.

Embodiment six:

This embodiment provides an electronic device that can be used to execute all or part of the steps of the audio data analysis and processing method in Embodiments 1 and 2 of the present application. For details not disclosed in this embodiment, please refer to Embodiments 1 and 2 of this application.

Please refer to FIG. 7 . FIG. 7 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device 900 may be, but not limited to, a combination of one or more of various servers, personal computers, notebook computers, smart phones, tablet computers and other devices.

In a preferred embodiment of the present application, the electronic device 900 includes a memory 901 , at least one processor 902 , at least one communication bus 903 and a transceiver 904 .

Those skilled in the art should understand that the structure of the electronic device shown in Figure 7 does not constitute a limitation of the embodiment of the present application, it can be either a bus structure or a star structure, and the electronic device 900 can also include a ratio diagram more or less other hardware or software, or a different arrangement of components.

In some embodiments, the electronic device 900 is a device capable of automatically performing numerical calculations and/or information processing according to preset or stored instructions, and its hardware includes but not limited to microprocessors, application-specific integrated circuits, Programmable gate arrays, digital processors and embedded devices, etc. The electronic device 900 may also include a client device, which includes but is not limited to any electronic product that can interact with the client through a keyboard, mouse, remote control, touch pad, or voice-activated device, for example, Personal computers, tablets, smartphones, digital cameras, etc.

It should be noted that the electronic device 900 is only an example, and other existing or future electronic products that can be adapted to this application should also be included in the scope of protection of this application, and are included here by reference .

In some embodiments, a computer program is stored in the memory 901, and when the computer program is executed by the at least one processor 902, all or part of the audio data analysis and processing methods in the first and second embodiments are implemented. step. The memory 901 includes a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable Read-Only Memory, PROM), an erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

In some embodiments, the at least one processor 902 is the control core (Control Unit) of the electronic device 900, using various interfaces and lines to connect the various components of the entire electronic device 900, by running or executing the Programs or modules in the memory 901 and call data stored in the memory 901 to execute various functions of the electronic device 900 and process data. For example, when the at least one processor 902 executes the computer program stored in the memory, it realizes all or part of the steps of the audio data analysis and processing method described in the embodiment of the present application; or realizes all the steps of the audio data analysis and processing server device. or partial functions. The at least one processor 902 may be composed of an integrated circuit, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits with the same function or different functions, including one or more central processing units (Central Processing unit, CPU), microprocessor, digital processing chip, graphics processor and a combination of various control chips, etc.

In some embodiments, the at least one communication bus 903 is configured to implement communication between the memory 901 and the at least one processor 902 and so on.

The electronic device 900 may also include various sensors, a Bluetooth module, a Wi-Fi module, etc., which will not be repeated here.

Embodiment seven:

This embodiment provides a computer-readable storage medium, on which a computer program is stored, and the instructions are suitable for being loaded by a processor and executing the audio data analysis and processing methods of Embodiments 1 and 2 of the present application. For the specific execution process, please refer to the implementation The specific descriptions of the embodiments shown in Example 1 and Embodiment 2 will not be repeated here.

As for the device embodiment, since it basically corresponds to the method embodiment, for related parts, please refer to part of the description of the method embodiment. The device embodiments described above are only illustrative, and the components described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this application. It can be understood and implemented by those skilled in the art without creative effort.

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

The above are only examples of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may occur in this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims (13)

1. An audio data analysis processing method, characterized in that the audio data analysis processing method comprises:

acquiring an audio fragment of the current moment of the target audio data;

if the obtained audio fragments have incomplete audio frames, cutting the audio fragments, and removing the incomplete audio frames;

analyzing and processing the cut audio fragments to obtain analysis and processing results of the audio fragments;

and merging analysis processing results of the continuous audio fragments in the audio data.

2. The audio data analysis processing method according to claim 1, wherein after the audio fragment of the current time of the target audio data is acquired, the audio data analysis processing method further comprises:

acquiring a starting audio frame positioned at the starting position of the audio fragment, and acquiring an end audio frame positioned at the end position of the audio fragment;

if the initial audio frame is a complete audio frame and the end audio frame is a complete audio frame, determining that the audio fragment does not have an incomplete audio frame;

or alternatively, the first and second heat exchangers may be,

if the initial audio frame is an incomplete audio frame and/or the end audio frame is an incomplete audio frame, determining that the audio fragment has an incomplete audio frame.

3. The audio data analysis processing method according to claim 1, wherein the merging of analysis processing results of consecutive audio slices in the audio data includes:

if continuous fragments exist in the historical fragments of the target audio data, merging analysis processing results of the continuous fragments, wherein the continuous fragments are the historical fragments with adjacent preset fragment serial numbers.

4. The audio data analysis processing method according to any one of claims 1 to 3, wherein after the acquisition of the audio slice of the current time of the target audio data, the audio data analysis processing method further comprises:

if continuous fragments exist in the historical fragments of the target audio data, merging the continuous fragments, wherein the continuous fragments are the historical fragments with adjacent preset fragment serial numbers;

when all the audio fragments of the target audio data are received, combining all the audio fragments,

and storing the combined audio fragments.

5. The audio data analysis processing method according to claim 4, characterized in that the audio data analysis processing method further comprises:

and if no continuous fragments exist in the obtained historical fragments of the target audio data, adding the audio fragments into the historical fragments.

6. The audio data analysis processing method according to claim 4, wherein after the merging of the continuous slices, the audio data analysis processing method further comprises:

and replacing the continuous fragments in the history fragments with the combined continuous fragments.

7. The audio data analysis processing method according to any one of claims 1 to 3, wherein after the acquisition of the audio slice of the current time of the target audio data, the audio data analysis processing method further comprises:

if all the audio fragments of the target audio data are not received, generating and sending successful receiving information; or alternatively, the first and second heat exchangers may be,

and if all the audio fragments of the target audio data are received, generating and transmitting information of the analysis waiting processing result.

8. The audio data analysis processing method according to any one of claims 1 to 3, characterized in that the audio data analysis processing method further comprises, after the merging of the analysis processing results of the audio fragments that are continuous in the audio data:

after receiving all the audio fragments of the target audio data, merging analysis processing results of all the audio fragments;

and sending the combined analysis and processing result.

9. An audio data analysis processing method, characterized in that the audio data analysis processing method comprises:

collecting target audio data at a client; when the current collected target audio data is detected to meet the preset condition, cutting the current collected target audio data into audio fragments, and uploading the audio fragments to a server;

acquiring an audio fragment of target audio data at a server; if the obtained audio fragments have incomplete audio frames, cutting the audio fragments, and removing the incomplete audio frames; analyzing and processing the cut audio fragments to obtain an analysis and processing result of the audio fragments; and merging analysis processing results of the continuous audio fragments in the audio data, and sending the analysis processing results to the client.

10. An audio data analysis processing server device, comprising:

the acquisition module is used for acquiring the audio fragments of the target audio data at the current moment;

the clipping module is used for clipping the audio fragments and removing the incomplete audio frames if the obtained audio fragments have the incomplete audio frames;

the analysis processing module is used for analyzing and processing the cut complete audio fragments to obtain analysis processing results of the audio fragments;

and the result merging module is used for merging analysis processing results of the continuous audio fragments in the audio data.

11. The audio data analysis processing system comprises a client and a server, and is characterized in that the client is used for collecting target audio data; when the current collected target audio data is detected to meet the preset condition, cutting off the current collected target audio data into audio fragments, and uploading the audio fragments to a server;

the server side is used for acquiring the audio fragments of the target audio data; if the obtained audio fragments have incomplete audio frames, cutting the audio fragments, and removing the incomplete audio frames; analyzing and processing the cut audio fragments to obtain an analysis and processing result of the audio fragments; and merging analysis processing results of the continuous audio fragments in the audio data, and sending the analysis processing results to the client.

12. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the audio data analysis processing method according to any one of claims 1 to 9.

13. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when executed by a processor, implements the audio data analysis processing method according to any one of claims 1 to 9.

Images