CN113990362A - Audio data processing method and system and audio processing equipment - Google Patents
Audio data processing method and system and audio processing equipment Download PDFInfo
- Publication number
- CN113990362A CN113990362A CN202111231348.8A CN202111231348A CN113990362A CN 113990362 A CN113990362 A CN 113990362A CN 202111231348 A CN202111231348 A CN 202111231348A CN 113990362 A CN113990362 A CN 113990362A
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- audio data
- sampling rate
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 33
- 238000005070 sampling Methods 0.000 claims abstract description 101
- 239000000872 buffer Substances 0.000 claims abstract description 78
- 238000000034 method Methods 0.000 claims abstract description 12
- 230000005540 biological transmission Effects 0.000 claims description 34
- 230000003139 buffering effect Effects 0.000 claims description 10
- 230000003247 decreasing effect Effects 0.000 claims description 7
- 230000001360 synchronised effect Effects 0.000 claims description 6
- 230000002596 correlated effect Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 9
- 230000000875 corresponding effect Effects 0.000 description 22
- 230000008569 process Effects 0.000 description 7
- 230000008713 feedback mechanism Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012938 design process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 239000012464 large buffer Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C7/00—Arrangements for writing information into, or reading information out from, a digital store
- G11C7/16—Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters
Landscapes
- Communication Control (AREA)
Abstract
The application discloses an audio data processing method, an audio data processing system and an audio processing device, wherein the audio data processing method comprises the following steps: caching audio data sent by the electronic equipment by adopting a preset buffer area; acquiring the data size of the audio data cached in the buffer area; adjusting the data sampling rate according to the data size; and sending feedback data to the electronic equipment according to the data sampling rate so that the electronic equipment adjusts the rate of sending the audio data according to the feedback data. The method and the device can realize low time delay, do not lose frames, output high sound quality and effectively improve the processing effect of audio data.
Description
Technical Field
The present application relates to the field of signal processing technologies, and in particular, to an audio data processing method, system, and audio processing device.
Background
The audio processing device such as the sound card device is externally connected to the electronic device such as the computer and/or the projector, the processing effect of the audio data generated by the electronic device can be improved, and better hearing experience is provided for a user. The traditional audio processing equipment can further process the audio data output by the electronic equipment, responds to the audio data processing requirement of the electronic equipment to a certain extent, and is easy to have the conditions of time delay, frame loss and the like, thereby influencing the processing effect of the corresponding audio data.
Disclosure of Invention
In view of this, the present application provides an audio data processing method, system and audio processing device, so as to solve the problem that the existing scheme is prone to delay, frame loss and other conditions, which affect the corresponding audio data processing effect.
The application provides an audio data processing method, which comprises the following steps:
caching audio data sent by the electronic equipment by adopting a preset buffer area;
acquiring the data size of the audio data cached in the buffer area;
adjusting the data sampling rate according to the data size;
and sending feedback data to the electronic equipment according to the data sampling rate so that the electronic equipment adjusts the rate of sending the audio data according to the feedback data.
Optionally, the adjusting the data sampling rate according to the data size includes:
if the data size is larger than a first threshold value, the data sampling rate is reduced, and if the data size is smaller than a second threshold value, the data sampling rate is increased; the second threshold is less than or equal to the first threshold.
Optionally, the first threshold is smaller than a buffer capacity of the buffer.
Optionally, the adjusting up the data sampling rate comprises: increasing the data sampling rate by a first adjustment step size; and/or, the reducing the data sampling rate comprises: the data sampling rate is decreased by a second adjustment step size.
Optionally, before the buffering the audio data sent by the electronic device by using the preset buffer, the method further includes:
and receiving the audio data by adopting a transmission protocol matched with the transmission port of the electronic equipment.
Optionally, the transmission protocol includes a UAC2.0 protocol; the audio data comprises audio playing data and audio recording data;
the receiving the audio data by using the transmission protocol matched with the transmission port of the electronic equipment comprises: receiving the audio playing data by adopting a first synchronization breakpoint, and receiving the audio recording data by adopting a second synchronization breakpoint;
the feeding back the data sampling rate to the electronic device comprises: and feeding back the data sampling rate to the electronic equipment by adopting a third synchronous breakpoint.
The application also provides an audio data processing method, which comprises the following steps:
receiving feedback data sent by the audio processing equipment according to the data sampling rate; the data sampling rate is related to the depth of the audio data cached by the audio processing device;
transmitting the audio data at a transmission rate that matches the feedback data such that the transmission rate matches the data sampling rate.
Optionally, the sending rate is positively correlated with the data sampling rate.
Optionally, the audio processing device samples the buffered audio data by using the data sampling rate to adjust the depth of the buffered audio data of the audio processing device.
The present application further provides an audio data processing system, comprising:
the buffer module is used for buffering the audio data sent by the electronic equipment by adopting a preset buffer area;
the obtaining module is used for obtaining the data size of the audio data cached in the buffer area;
the adjusting module is used for adjusting the data sampling rate according to the data size;
and the feedback module is used for sending feedback data to the electronic equipment according to the data sampling rate so that the electronic equipment adjusts the rate of sending the audio data according to the feedback data.
The application also provides audio processing equipment, which comprises a processing chip; the processing chip is used for executing any one of the audio data processing methods.
Optionally, the processing chip includes an embedded single chip microcomputer.
Optionally, the audio processing device further includes a USB interface, where the USB interface is configured to receive audio data and/or send feedback data.
According to the audio data processing method, the system and the audio processing equipment, the audio data sent by the electronic equipment are cached in the preset buffer area, the data size of the audio data cached in the buffer area is obtained, the data sampling rate is adjusted according to the data size, the feedback data is sent to the electronic equipment according to the data sampling rate, so that the electronic equipment adjusts the speed of sending the audio data in real time according to the feedback data, the purpose of synchronizing with the clock of the audio processing equipment is achieved, low delay is achieved, frames are not lost, high sound quality is output, and the processing effect of the audio data is improved; the audio processing equipment is provided with a dynamic buffer feedback mechanism and can form a closed-loop network with the electronic equipment, so that the audio processing equipment can dynamically adjust the data buffer depth of the buffer area, a larger buffer space is not needed to store audio data, meanwhile, the data can be ensured not to overflow, the capacity required by the buffer space and the time for outputting corresponding audio data can be reduced, the corresponding system design is simplified, and the system design difficulty is reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a flow chart of an audio data processing method according to an embodiment of the present application;
FIG. 2 is a schematic diagram illustrating a connection relationship between an electronic device and an audio processing device according to an embodiment of the present application;
FIG. 3 is a flow chart of an audio data processing method according to another embodiment of the present application;
FIG. 4 is a schematic diagram of an audio data processing system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an audio processing device according to an embodiment of the present application.
Detailed Description
The audio data processing scheme of audio processing equipment such as sound card equipment and the like adopts a synchronization scheme in many cases, and because the audio processing equipment and the electronic equipment belong to two independent systems and respectively have independent clocks, the electronic equipment of the sound card equipment cannot achieve absolute synchronization on the clocks easily; if a synchronization scheme is adopted, a larger buffer space is needed to store enough audio data to counteract the synchronization problem caused by clock deviation; if the buffer space is not enough, the problem of audio frame loss is caused, and meanwhile, the larger the buffer space is, the larger the audio delay is caused. It can be seen that the conventional audio processing scheme is prone to delay and/or frame loss, and the like, and affects the processing effect of corresponding audio data.
Aiming at the problem, according to the audio data processing method, the audio data processing system and the audio processing equipment, the preset buffer area is adopted to buffer the audio data sent by the electronic equipment, the data size of the audio data buffered by the buffer area is obtained, the data sampling rate is adjusted according to the data size, and the feedback data is sent to the electronic equipment according to the data sampling rate, so that the electronic equipment adjusts the rate of sending the audio data in real time according to the feedback data, the purpose of clock synchronization with the audio processing equipment is achieved, low delay is realized, no frame loss occurs, high sound quality output is realized, and the processing effect of the audio data is improved; the audio processing equipment is provided with a dynamic buffer feedback mechanism and can form a closed-loop network with the electronic equipment, so that the audio processing equipment can dynamically adjust the data buffer depth of the buffer area, a larger buffer space is not needed to store audio data, meanwhile, the data can be ensured not to overflow, the capacity required by the buffer space and the time for outputting corresponding audio data can be reduced, the corresponding system design is simplified, and the system design difficulty is reduced.
The technical solutions in the embodiments of the present application are clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. The following embodiments and their technical features may be combined with each other without conflict.
A first aspect of the present application provides an audio data processing method, which is applied to an audio processing device such as a sound card device; referring to fig. 1, the audio data processing method includes:
s110, caching audio data sent by the electronic equipment by adopting a preset buffer area;
s120, acquiring the data size of the audio data cached in the buffer area;
s130, adjusting the data sampling rate according to the data size;
and S140, sending feedback data to the electronic equipment according to the data sampling rate, so that the electronic equipment adjusts the rate of sending the audio data according to the feedback data.
The feedback data can represent the characteristics of the data sampling rate and the like; the feedback data may include identification information corresponding to each data sampling rate, for example, if the audio processing device presets a plurality of data sampling rates, the electronic device may prestore sending rates corresponding to each data sampling rate, so that when receiving a certain identification information, the electronic device sends the audio data at the sending rate corresponding to the identification information; for another example, if the audio processing device can also directly send the data sampling rate to the electronic device, when the electronic device receives the data sampling rate, the electronic device may send the audio data at a sending rate corresponding to the data sampling rate.
Optionally, the data sampling rate is related to the depth of the audio data in the buffer; the audio processing equipment samples the audio data cached in the buffer area by adopting the data sampling rate so as to adjust the depth of the audio data in the buffer area, so that the depth of the audio data in the buffer area is not too large, overflow is generated, and the problem that the space of the buffer area is wasted and/or the audio processing equipment is difficult to read effective audio data and the like is caused. Specifically, the audio processing device may determine the data sampling rate according to the data size of the audio data buffered in the buffer, so that the data sampling rate is matched with the data size of the audio data buffered in the buffer, and thus the depth of the audio data in the buffer may be dynamically balanced, and the stability of the audio data processing process may be ensured.
In this embodiment, as shown in fig. 2, the connection relationship between the electronic device and the audio processing device may be that the electronic device sends audio data to be processed to the audio processing device, the audio processing device buffers currently received audio data in a buffer, and obtains the data size of the buffered audio data in real time, and adjusts the data sampling rate of the audio data according to the data size, so that the audio data buffered in the buffer does not overflow the buffer, and the depth of the audio data buffered in the buffer can be kept within a certain range, thereby ensuring the subsequent processing effect on the audio processing. The audio processing equipment sends the feedback data to the electronic equipment according to the data sampling rate, so that the electronic equipment can adjust the sending rate of sending the audio data according to the feedback data to ensure that the data sampling rate is matched with the sending rate, the aim of clock synchronization of the electronic equipment and the audio processing equipment is fulfilled, and low delay, no frame loss and high sound quality output are realized. It can be seen that the present embodiment adopts a dynamic buffer feedback mechanism, which can dynamically adjust the depth of the audio data buffered in the buffer, does not need a large buffer space to store the audio data, and meanwhile, can ensure that the audio data does not overflow, the required buffer has a small capacity, and can effectively reduce the time for outputting the audio data, and avoid the occurrence of situations such as delay and/or frame loss.
In one embodiment, said adjusting the data sampling rate according to said data size comprises: if the data size is larger than a first threshold value, the data sampling rate is reduced, and if the data size is smaller than a second threshold value, the data sampling rate is increased; the second threshold is less than or equal to the first threshold.
In this embodiment, when the size of the data buffered in the buffer is greater than the first threshold, the data sampling rate is decreased, so that the rate at which the electronic device sends the audio data is decreased, and when the size of the data is less than the second threshold, the data sampling rate is increased, so that the rate at which the electronic device sends the audio data is increased, so that the audio data buffered in the buffer can be maintained in the range from the second threshold to the first threshold, thereby implementing dynamic adjustment of the data buffered in the buffer and preventing the audio data from overflowing the buffer.
In particular, the first threshold is smaller than a buffer capacity of the buffer. For example, the first threshold is 5/8 and the second threshold is 3/8, so that the buffered audio data can be maintained within a depth range of 3/8 to 5/8.
Specifically, the increasing the data sampling rate includes: increasing the data sampling rate by a first adjustment step size; and/or, the reducing the data sampling rate comprises: the data sampling rate is decreased by a second adjustment step size. The first adjustment step size and the second adjustment step size can be set according to the configuration characteristics of the audio processing device, and can be set to be the same step size parameter or different step size parameters. The data sampling rate is increased by increasing the first adjustment step length, and the data sampling rate is decreased by decreasing the second adjustment step length, so that the orderliness of the data sampling rate adjustment process can be ensured.
In one embodiment, before the buffering the audio data sent by the electronic device by using the preset buffer, the method further includes: and receiving the audio data by adopting a transmission protocol matched with the transmission port of the electronic equipment. In the embodiment, the audio data is received by adopting the transmission protocol matched with the transmission port of the electronic equipment, and other drivers do not need to be additionally installed, so that a system (such as a Windows10 system) for running the electronic equipment can be effectively supported, and the smoothness of the transmission process of the audio data is ensured. Optionally, the transmission port of the electronic device includes a USB (Universal Serial Bus) port, in which case the transmission protocol may include a protocol based on the UAC standard.
Protocols based on the UAC standard comprise a UAC1.0 protocol and a UAC2.0 protocol, the existing low-cost USB sound card scheme is generally based on a synchronization scheme of the UAC1.0 standard, the design difficulty is low, but the defects of high time delay, frame loss during playing, low sampling rate and the like are generally existed. Some conventional USB sound cards also process audio data using an asynchronous scheme, which requires audio processing equipment to monitor data buffering trend in real time, and feed the data buffering trend back to electronic equipment such as a computer in real time to form a closed-loop network. The electronic equipment dynamically adjusts the data sending frequency according to the feedback data so as to synchronize a clock; the scheme has complex system design and higher difficulty.
In view of the above problem, in one example, the transmission protocol adopted by the audio processing method of the present application includes a UAC2.0 protocol; by adopting an asynchronous feedback mechanism, a high-speed USB scheme is realized, effective data transmission bandwidth is ensured, the characteristics of UAC2.0 high bandwidth and low delay are fully exerted, the related design process is simplified, and the design difficulty is reduced; therefore, even in the high sampling rate mode, the exclusive mode cannot be used for playing and recording due to the limitation of the bandwidth. The asynchronous mechanism of the high-speed USB scheme and the Windows10 and other operating systems have better compatibility, and are favorable for stable operation; in some cases, this example may output up to 384K of sound quality in a 32-bit two-channel full duplex mode.
Specifically, the audio data includes audio playing data and audio recording data; the receiving the audio data by using the transmission protocol matched with the transmission port of the electronic equipment comprises: receiving the audio playing data by adopting a first synchronization breakpoint, and receiving the audio recording data by adopting a second synchronization breakpoint; the feeding back the data sampling rate to the electronic device comprises: and feeding back the data sampling rate to the electronic equipment by adopting a third synchronous breakpoint. Based on the UAC2.0 protocol, two synchronous breakpoints are adopted to respectively transmit audio playing data and audio recording data, and another synchronous breakpoint is adopted to transmit feedback data representing the data sampling rate of the audio processing equipment, so that the audio processing equipment and the electronic equipment form a closed-loop network, and an asynchronous feedback mechanism is realized; when the electronic equipment receives the feedback data of the audio processing equipment, the data sending rate can be adjusted in real time, so that the aim of synchronizing with the clock of the audio processing equipment is fulfilled, low delay is realized, no frame is lost, and high-quality output is realized.
Optionally, the audio data processing method further includes: and decoding the audio data cached in the buffer area, and playing the decoded audio data so as to improve the playing quality of the audio data.
According to the audio data processing method, the audio data sent by the electronic equipment is cached in the preset buffer area, the data size of the audio data cached in the buffer area is obtained, the data sampling rate is adjusted according to the data size, the feedback data is sent to the electronic equipment according to the data sampling rate, so that the electronic equipment adjusts the speed of sending the audio data in real time according to the feedback data, the purpose of clock synchronization with the audio processing equipment is achieved, and low delay, no frame loss and high sound quality output are realized; the audio processing equipment is provided with a dynamic buffer feedback mechanism and can form a closed-loop network with the electronic equipment, so that the audio processing equipment can dynamically adjust the data buffer depth of the buffer area, a larger buffer space is not needed to store audio data, meanwhile, the data can be ensured not to overflow, the capacity required by the buffer space and the time for outputting corresponding audio data can be reduced, the corresponding system design is simplified, and the system design difficulty is reduced.
A second aspect of the present application provides an audio data processing method applied to an electronic device such as a personal computer. Referring to fig. 3, the audio data processing method includes:
s210, receiving feedback data sent by the audio processing equipment according to the data sampling rate; the data sampling rate is related to the depth of the audio data cached by the audio processing device;
s220, the audio data is transmitted at a transmission rate matched with the feedback data, so that the transmission rate is matched with the data sampling rate.
The feedback data can represent the characteristics of the data sampling rate and the like; the feedback data may include identification information corresponding to each data sampling rate, for example, if the audio processing device presets a plurality of data sampling rates, the electronic device may prestore sending rates corresponding to each data sampling rate, so that when receiving a certain identification information, the electronic device sends the audio data at the sending rate corresponding to the identification information; for another example, if the audio processing device can also directly send the data sampling rate to the electronic device, when the electronic device receives the data sampling rate, the electronic device may send the audio data at a sending rate corresponding to the data sampling rate.
Specifically, the transmission rate is positively correlated with the data sampling rate to keep the electronic apparatus synchronized with the clock of the audio processing apparatus. Optionally, the transmission rate is proportional to the data sampling rate to improve the consistency between the transmission rate and the data sampling rate.
In one embodiment, the audio processing device samples the cached audio data by using the data sampling rate to adjust the depth of the audio data cached by the audio processing device, so that the depth of the audio data in a buffer area in the audio processing device is not too large and overflow is not generated, and the depth is not too small and effective audio data is difficult to read by the audio processing device. Specifically, the audio processing device may determine the data sampling rate according to the data size of the audio data buffered in the buffer, so that the data sampling rate is matched with the data size of the audio data buffered in the buffer, and thus the depth of the audio data in the buffer may be dynamically balanced, and the stability of the audio data processing process may be ensured.
According to the audio data processing method, the electronic equipment can adjust the rate of sending the audio data in real time according to the feedback data representing the data sampling rate, the aim of synchronizing with the clock of the audio processing equipment is achieved, and low delay, no frame loss and high sound quality output are achieved.
The present application provides, in a third aspect, an audio data processing system that may be provided in an audio processing device such as a sound card device. Referring to fig. 4, the audio data processing system includes:
the buffer module 110 is configured to buffer audio data sent by the electronic device by using a preset buffer area;
an obtaining module 120, configured to obtain a data size of the audio data cached in the buffer;
an adjusting module 130, configured to adjust a data sampling rate according to the data size;
and the feedback module 140 is configured to send feedback data to the electronic device according to the data sampling rate, so that the electronic device adjusts a rate of sending the audio data according to the feedback data.
For specific limitations of the audio data processing system, reference may be made to the above limitations of the audio data processing method, which are not described herein again. The various modules in the audio data processing system described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent of an operation module in the computer equipment, and can also be stored in a memory in the computer equipment in a software form, so that the operation module of the computer equipment can call and execute the operation corresponding to each module.
The present application provides in a fourth aspect an audio data processing system that can be provided in an electronic device such as a personal computer, comprising:
the receiving module is used for receiving feedback data sent by the audio processing equipment according to the data sampling rate; the data sampling rate is related to the depth of the audio data cached by the audio processing device;
and the sending module is used for sending the audio data by adopting a sending rate matched with the feedback data so as to enable the sending rate to be matched with the data sampling rate.
For the specific definition of the audio data processing system, reference may be made to the above definition of the corresponding audio data processing method, which is not described herein again. The various modules in the audio data processing system described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent of an operation module in the computer equipment, and can also be stored in a memory in the computer equipment in a software form, so that the operation module of the computer equipment can call and execute the operation corresponding to each module.
The present application provides in a fifth aspect an audio processing device comprising a processing chip; the processing chip is used for executing the audio data processing method of any one of the above embodiments.
In one embodiment, the processing chip includes an embedded single chip, such as an STM32 chip, and the embedded single chip has the advantages of high performance, low cost, and low power consumption, and can reduce the cost when the same or higher performance is achieved.
In an example, if the data transmission port of the electronic device is a USB port, the audio processing device further includes a USB interface, and the USB interface is configured to receive audio data and/or send feedback data representing a data sampling rate. According to the example, the USB interface matched with the USB port of the electronic equipment is adopted to transmit data, no additional driver is needed to be installed, operating systems such as a windows10 system in the electronic equipment can be perfectly supported, the transmission process of audio data can be further simplified, and the transmission effect of the audio data is improved.
In one example, the audio processing device is a USB sound card device, and as shown in fig. 5, the audio processing device includes a USB interface 311 and an STM32 chip 312; the STM32+ USB3300 low-cost and mature hardware platform is adopted to realize the purposes of low time delay and high tone quality, and the pain point of high cost of the high-order USB sound card in the market at present is solved. Correspondingly, the audio processing equipment adopts the UAC2.0 protocol to transmit audio data, so that a high-speed USB scheme is realized, and effective data transmission bandwidth is ensured; the UAC2.0 protocol has the characteristics of high bandwidth and low time delay, and can simplify the related design process and reduce the design difficulty; therefore, even in the high sampling rate mode, the exclusive mode cannot be used for playing and recording due to the limitation of the bandwidth.
Further, as shown in fig. 5, the audio processing apparatus further includes a playing component 313 such as a speaker, which is used for playing the audio data processed by the audio processing apparatus such as decoding.
The audio processing device processes the audio data sent by the electronic device by adopting the audio data processing method provided by any embodiment, can dynamically adjust the data buffering depth of the buffer area, does not need a larger buffering space to store the audio data, can ensure that the data does not overflow, and can reduce the capacity required by the buffering space and the output time of the corresponding audio data, thereby simplifying the corresponding system design and reducing the difficulty of the system design; the audio data processing can also send feedback data representing the data sampling rate to the electronic equipment, so that the electronic equipment adjusts the rate of sending the audio data in real time according to the feedback data, the aim of clock synchronization with the audio processing equipment is fulfilled, low delay is realized, no frame loss is caused, high sound quality output is realized, and the processing performance of the audio data can be effectively improved.
Although the application has been shown and described with respect to one or more implementations, equivalent alterations and modifications will occur to others skilled in the art based upon a reading and understanding of this specification and the annexed drawings. This application is intended to embrace all such modifications and variations and is limited only by the scope of the appended claims. In particular regard to the various functions performed by the above described components, the terms used to describe such components are intended to correspond, unless otherwise indicated, to any component which performs the specified function of the described component (e.g., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein illustrated exemplary implementations of the specification.
That is, the above description is only an embodiment of the present application, and not intended to limit the scope of the present application, and all equivalent structures or equivalent flow transformations made by using the contents of the specification and the drawings, such as mutual combination of technical features between various embodiments, or direct or indirect application to other related technical fields, are included in the scope of the present application.
In addition, in the description of the present application, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, should not be considered as limiting the present application. In addition, structural elements having the same or similar characteristics may be identified by the same or different reference numerals. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
In this application, the word "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The previous description is provided to enable any person skilled in the art to make and use the present application. In the foregoing description, various details have been set forth for the purpose of explanation. It will be apparent to one of ordinary skill in the art that the present application may be practiced without these specific details. In other instances, well-known structures and processes are not shown in detail to avoid obscuring the description of the present application with unnecessary detail. Thus, the present application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
Claims (13)
1. A method of audio data processing, comprising:
caching audio data sent by the electronic equipment by adopting a preset buffer area;
acquiring the data size of the audio data cached in the buffer area;
adjusting the data sampling rate according to the data size;
and sending feedback data to the electronic equipment according to the data sampling rate so that the electronic equipment adjusts the rate of sending the audio data according to the feedback data.
2. The audio data processing method of claim 1, wherein the adjusting the data sampling rate according to the data size comprises:
if the data size is larger than a first threshold value, the data sampling rate is reduced, and if the data size is smaller than a second threshold value, the data sampling rate is increased; the second threshold is less than or equal to the first threshold.
3. The audio data processing method of claim 2, wherein the first threshold is less than a buffer capacity of the buffer.
4. The audio data processing method of claim 2, wherein the scaling up the data sample rate comprises: increasing the data sampling rate by a first adjustment step size; and/or, the reducing the data sampling rate comprises: the data sampling rate is decreased by a second adjustment step size.
5. The audio data processing method according to claim 1, further comprising, before buffering the audio data sent by the electronic device using the preset buffer:
and receiving the audio data by adopting a transmission protocol matched with the transmission port of the electronic equipment.
6. The audio data processing method according to claim 5, wherein the transmission protocol comprises a UAC2.0 protocol; the audio data comprises audio playing data and audio recording data;
the receiving the audio data by using the transmission protocol matched with the transmission port of the electronic equipment comprises: receiving the audio playing data by adopting a first synchronization breakpoint, and receiving the audio recording data by adopting a second synchronization breakpoint;
the feeding back the data sampling rate to the electronic device comprises: and feeding back the data sampling rate to the electronic equipment by adopting a third synchronous breakpoint.
7. A method of audio data processing, comprising:
receiving feedback data sent by the audio processing equipment according to the data sampling rate; the data sampling rate is related to the depth of the audio data cached by the audio processing device;
transmitting the audio data at a transmission rate that matches the feedback data such that the transmission rate matches the data sampling rate.
8. The audio data processing method of claim 7, wherein the sending rate is positively correlated to the data sampling rate.
9. The audio data processing method of claim 7, wherein the audio processing device samples the buffered audio data using the data sampling rate to adjust a depth of the buffered audio data of the audio processing device.
10. An audio data processing system, comprising:
the buffer module is used for buffering the audio data sent by the electronic equipment by adopting a preset buffer area;
the obtaining module is used for obtaining the data size of the audio data cached in the buffer area;
the adjusting module is used for adjusting the data sampling rate according to the data size;
and the feedback module is used for sending feedback data to the electronic equipment according to the data sampling rate so that the electronic equipment adjusts the rate of sending the audio data according to the feedback data.
11. An audio processing apparatus, comprising a processing chip; the processing chip is used for executing the audio data processing method according to any one of claims 1 to 6.
12. The audio processing device according to claim 11, wherein the processing chip comprises an embedded single chip microcomputer.
13. The audio processing device according to claim 11, further comprising a USB interface for receiving audio data and/or sending feedback data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111231348.8A CN113990362A (en) | 2021-10-22 | 2021-10-22 | Audio data processing method and system and audio processing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111231348.8A CN113990362A (en) | 2021-10-22 | 2021-10-22 | Audio data processing method and system and audio processing equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113990362A true CN113990362A (en) | 2022-01-28 |
Family
ID=79740230
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111231348.8A Pending CN113990362A (en) | 2021-10-22 | 2021-10-22 | Audio data processing method and system and audio processing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113990362A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060009983A1 (en) * | 2004-06-25 | 2006-01-12 | Numerex Corporation | Method and system for adjusting digital audio playback sampling rate |
| CN201945917U (en) * | 2011-01-13 | 2011-08-24 | 无锡硅动力微电子股份有限公司 | USB (Universal Serial Bus) sound card adopting single 12 MHz crystal oscillator |
| CN108551358A (en) * | 2018-03-16 | 2018-09-18 | 恒玄科技（上海）有限公司 | A kind of method of adjustment of bluetooth headset difference model subaudio frequency data |
| CN112735463A (en) * | 2020-12-16 | 2021-04-30 | 杭州小伴熊科技有限公司 | Audio playing delay AI correction method and device |
-
2021
- 2021-10-22 CN CN202111231348.8A patent/CN113990362A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060009983A1 (en) * | 2004-06-25 | 2006-01-12 | Numerex Corporation | Method and system for adjusting digital audio playback sampling rate |
| CN201945917U (en) * | 2011-01-13 | 2011-08-24 | 无锡硅动力微电子股份有限公司 | USB (Universal Serial Bus) sound card adopting single 12 MHz crystal oscillator |
| CN108551358A (en) * | 2018-03-16 | 2018-09-18 | 恒玄科技（上海）有限公司 | A kind of method of adjustment of bluetooth headset difference model subaudio frequency data |
| CN112735463A (en) * | 2020-12-16 | 2021-04-30 | 杭州小伴熊科技有限公司 | Audio playing delay AI correction method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7447521B2 (en) | Microprocessor and mobile communication terminal | |
| JP4846589B2 (en) | Synchronous transmission of audio and video data from the computer to the client via the interface | |
| JP5753889B2 (en) | Interface for transmitting synchronized audio and video data | |
| CN114974321B (en) | An audio playback method, device and system | |
| CN110888619B (en) | Digital audio power amplifier synchronization circuit and method and electronic equipment | |
| US20120133829A1 (en) | Video display apparatus and video display method, audio reproduction apparatus and audio reproduction method, and video/audio synchronous control system | |
| CN114079824A (en) | Transmitting card, display device, computer device, storage medium, and control method for transmitting card | |
| CN105472404A (en) | Data processing method in video service | |
| EP2568653A1 (en) | Transmitting device, receiving device, communication system, transmission method, reception method, and program | |
| JP4847331B2 (en) | Method for synthesizing vertical blanking signal | |
| CN113990362A (en) | Audio data processing method and system and audio processing equipment | |
| CN118450182A (en) | Method, device, processor and medium for realizing frame synchronization calibration processing for video stream for optimizing vehicle-mounted interconnection screen throwing function | |
| US20230379434A1 (en) | Data transmission method and apparatus | |
| CN107707829A (en) | A kind of method that multiplex roles intelligence SDI video switching boxs are realized based on FPGA | |
| CN115484483B (en) | Streaming media audio and video synchronization method, terminal equipment, control device and medium | |
| CN114339345B (en) | A source end synchronization device and synchronization method applied to audio and video signals | |
| CA2808601C (en) | A packet structure for a mobile display digital interface | |
| US20050282580A1 (en) | Video and audio synchronization | |
| CA2685073C (en) | A packet structure for a mobile display digital interface | |
| CN111104350A (en) | Online low-delay regulation and control method, terminal equipment and storage medium | |
| CN116017012B (en) | Multi-screen synchronization method, device, display equipment and computer readable storage medium | |
| US20240422247A1 (en) | Signal processing method and associated relay device | |
| CN114830678B (en) | Bluetooth earphone of self-adaptation audio playback speed | |
| JP5231533B2 (en) | Packet structure for mobile display digital interface | |
| WO2025001916A1 (en) | Audio and video synchronization method and apparatus, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |