CN113115175B - 3D sound effect processing method and related products - Google Patents

Abstract

The embodiment of the present application discloses a 3D sound effect processing method and related products. The method includes: acquiring mono data of a sound source; determining a target content scene type corresponding to the mono data; according to the target content scene type Determining target reverberation effect parameters; processing the mono data according to the target reverberation effect parameters to obtain target reverberation binaural data. Using the embodiment of the present application, the reverberation effect parameter corresponding to the content scene can be determined, and the reverberation binaural data can be generated according to the reverberation effect parameter, thereby realizing the reverberation effect suitable for the content scene, and the stereoscopic feeling is more realistic.

Description

3D sound effect processing method and related products

technical field

The present application relates to the technical field of virtual/augmented reality, and in particular, to a 3D sound effect processing method and related products.

Background technique

With the widespread application of electronic devices (such as mobile phones, tablet computers, etc.), electronic devices can support more and more applications, and their functions are becoming more and more powerful. Electronic devices are developing in the direction of diversification and personalization. Indispensable electronics.

With the development of technology, virtual reality has also developed rapidly in electronic devices. However, in virtual reality products, the audio data received by earphones in the prior art is often 2D audio data, so it cannot bring the real sense of sound to users. , which degrades the user experience.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a 3D sound effect processing method and related products, which can synthesize 3D sound effects and improve user experience.

In a first aspect, an embodiment of the present application provides a 3D sound effect processing method, including:

Get the mono data of the sound source;

Determine the target content scene type corresponding to the mono data;

Determine target reverberation effect parameters according to the target content scene type;

The monaural data is processed according to the target reverberation effect parameter to obtain target reverberation binaural data.

In a second aspect, an embodiment of the present application provides a 3D sound effect processing apparatus, the 3D sound effect processing apparatus includes: an acquisition unit, a first determination unit, a second determination unit, and a processing unit, wherein,

The acquisition unit is used to acquire mono data of the sound source;

the first determining unit, configured to determine the target content scene type corresponding to the mono data;

the second determining unit, configured to determine a target reverberation effect parameter according to the target content scene type;

The processing unit is configured to process the mono data according to the target reverberation effect parameter to obtain target reverberation binaural data.

In a third aspect, embodiments of the present application provide an electronic device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory, and are configured by the above Executed by the processor, the above program includes instructions for executing the steps in the first aspect of the embodiments of the present application.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program causes a computer to execute the computer program as described in the first embodiment of the present application. Some or all of the steps described in an aspect.

In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute as implemented in the present application. Examples include some or all of the steps described in the first aspect. The computer program product may be a software installation package.

It can be seen that the 3D sound effect processing method and related products described in the embodiments of the present application acquire the mono data of the sound source, determine the target content scene type corresponding to the mono data, and determine the target reverberation according to the target content scene type. Effect parameters: Process the mono data according to the target reverberation effect parameters to obtain the target reverberation binaural data. In this way, the reverberation effect parameters corresponding to the content scene can be determined, and the reverberation can be generated according to the reverberation effect parameters. Two-channel data, thus, the reverberation effect suitable for the content scene is realized, and the stereoscopic effect is more realistic.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1A is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 1B is a schematic flowchart of a 3D sound effect processing method disclosed in an embodiment of the present application;

FIG. 1C is a schematic diagram illustrating a multi-channel binaural data division method disclosed in an embodiment of the present application;

1D is a schematic diagram illustrating a demonstration of a 3D sound effect processing method disclosed in an embodiment of the present application;

FIG. 1E is a schematic diagram illustrating another 3D sound effect processing method disclosed in an embodiment of the present application;

2 is a schematic flowchart of another 3D sound effect processing method disclosed in an embodiment of the present application;

3 is a schematic flowchart of another 3D sound effect processing method disclosed in an embodiment of the present application;

4 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a 3D sound effect processing apparatus disclosed in an embodiment of the present application.

Detailed ways

In order to make those skilled in the art better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The terms "first", "second" and the like in the description and claims of the present application and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally also includes For other steps or units inherent to these processes, methods, products or devices.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

The electronic devices involved in the embodiments of the present application may include various handheld devices (such as smart phones) with wireless communication functions, vehicle-mounted devices, virtual reality (VR)/augmented reality (AR) devices, wearable Equipment, computing equipment or other processing equipment connected to a wireless modem, and various forms of user equipment (UE), mobile station (MS), terminal device (terminal device), R&D/test platforms, servers and many more. For convenience of description, the devices mentioned above are collectively referred to as electronic devices.

In the specific implementation, in the embodiment of the present application, the electronic device may filter the audio data (sound emitted by the sound source) using an HRTF (Head Related Transfer Function) filter to obtain virtual surround sound, which is also referred to as a virtual surround sound. Surround sound, or panoramic sound, achieves a three-dimensional sound effect. The name corresponding to HRTF in the time domain is HRIR (Head Related Impulse Response). Or convolve the audio data with the Binaural Room Impulse Response (BRIR), which consists of three components: direct sound, early reflections, and reverb.

Please refer to FIG. 1A . FIG. 1A is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device includes a control circuit and an input-output circuit, and the input-output circuit is connected to the control circuit.

Among them, the control circuit may include storage and processing circuits. The storage circuits in the storage and processing circuits may be memories, such as hard disk drive memory, non-volatile memory (such as flash memory or other electronically programmable read only memory used to form solid state drives, etc.), volatile memory (such as static or dynamic random access memory, etc.), etc., which are not limited in the embodiments of the present application. The processing circuitry in the storage and processing circuitry may be used to control the operation of the electronic device. The processing circuit may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.

The storage and processing circuits can be used to run software in electronic devices, such as playing a ringing application for incoming calls, a ringing application for playing a short message, a ringing application for playing an alarm clock, a media file application, voice over internet protocol (voice) over internet protocol, VOIP) phone calling applications, operating system functions, etc. These softwares can be used to perform some control operations, such as playing the ringtone for incoming calls, playing the ringtone for short messages, playing the ringtone for alarm clocks, playing media files, making voice phone calls, and other functions in electronic equipment, etc. The embodiment is not limited.

Among them, the input-output circuit can be used to enable the electronic device to input and output data, that is, to allow the electronic device to receive data from an external device and to allow the electronic device to output data from the electronic device to the external device.

The input-output circuit may further include sensors. Sensors may include ambient light sensors, light and capacitive-based infrared proximity sensors, ultrasonic sensors, touch sensors (eg, light-based touch sensors and/or capacitive touch sensors, where the touch sensor may be part of a touch display, or Can be used independently as a touch sensor structure), acceleration sensor, gravity sensor, and other sensors. The input-output circuit may further include audio components, which may be used to provide audio input and output functions for the electronic device. Audio components may also include tone generators and other components for generating and detecting sounds.

The input-output circuit may also include one or more display screens. The display screen may include one or a combination of a liquid crystal display screen, an organic light emitting diode display screen, an electronic ink display screen, a plasma display screen, and a display screen using other display technologies. The display screen may include an array of touch sensors (ie, the display screen may be a touch screen display). The touch sensor can be a capacitive touch sensor formed from an array of transparent touch sensor electrodes, such as indium tin oxide (ITO) electrodes, or can be a touch sensor formed using other touch technologies, such as sonic touch, pressure sensitive touch, resistive touch Touch, optical touch, etc., are not limited in the embodiments of the present application.

The input-output circuitry may further include communication circuitry that may be used to provide the electronic device with the ability to communicate with external devices. Communication circuits may include analog and digital input-output interface circuits, and wireless communication circuits based on radio frequency signals and/or optical signals. The wireless communication circuit among the communication circuits may include radio frequency transceiver circuits, power amplifier circuits, low noise amplifiers, switches, filters, and antennas. For example, wireless communication circuitry in a communication circuit may include circuitry for supporting near field communication (NFC) by transmitting and receiving near field coupled electromagnetic signals. For example, the communication circuitry may include a near field communication antenna and a near field communication transceiver. Communication circuits may also include cellular telephone transceivers and antennas, wireless local area network transceiver circuits and antennas, and the like.

The input-output circuit may further include other input-output units. Input-output units may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.

Wherein, the electronic device may further include a battery (not shown), and the battery is used to provide electrical energy to the electronic device.

The embodiments of the present application will be described in detail below.

Please refer to FIG. 1B . FIG. 1B is a schematic flowchart of a 3D sound effect processing method disclosed in an embodiment of the present application, which is applied to the electronic device described in FIG. 1A . The 3D sound effect processing method includes the following steps 101 - 103 .

101. Acquire mono data of a sound source.

The embodiments of the present application may be applied to virtual reality/augmented reality scenarios, or 3D recording scenarios. In this embodiment of the present application, the sound source may be a sound generator in a virtual scene, for example, an airplane in a game scene, the sound source may be a fixed sound source, or a moving sound source, or the sound source may also be a physical environment 's sound generator.

102. Determine a target content scene type corresponding to the mono data.

Wherein, in the embodiment of the present application, the content scene type may be at least one of the following: movie, life, entertainment, military, life, astronomy, geography, etc., which are not limited herein. For example, each mono data may correspond to a frequency band, and different frequency bands may correspond to different content scene types. Specifically, the electronic device pre-stores the mapping relationship between the frequency band and the content scene type, and then determines according to the mapping relationship. The target content scene type corresponding to the frequency band of the mono data.

Optionally, in the above step 102, determining the target content scene type corresponding to the mono data may include the following steps:

21. Perform semantic analysis on the mono data to obtain multiple keywords;

22. According to the preset mapping relationship between keywords and content scene types, determine the content scene type corresponding to each keyword in the plurality of keywords, and obtain a plurality of content scene types;

23. Use the content scene type with the largest number of occurrences among the multiple content scene types as the target content scene type.

The monaural data is audio data, so the electronic device can perform semantic analysis on the monaural data to obtain multiple keywords, and the electronic device can also pre-store the mapping between preset keywords and content scene types Then, according to the determined content scene type corresponding to each keyword in the plurality of keywords, multiple content scene types are obtained, and the content scene type with the most occurrences among the multiple content scene types is used as the target content scene type.

103. Determine a target reverberation effect parameter according to the target content scene type.

Wherein, the above reverberation effect parameters may include at least one of the following: input level, low frequency cut point, high frequency cut point, early reflection time, diffusion degree, low mixing ratio, reverberation time, high frequency decay point, crossover point , original dry sound volume, early reflection sound volume, reverberation volume, sound field width, output sound field, tail sound, etc., which are not limited here. In the specific implementation, different content scenes can correspond to different reverberation effect parameters. In this way, in different scenes, the reverberation effect is different, and the reverberation effect suitable for the scene can be achieved, and the 3D sense is more realistic.

Optionally, in the above step 103, the target reverberation effect parameter is determined according to the target content scene type, which may be implemented as follows:

The target reverberation effect parameter corresponding to the target content scene type is determined according to the preset mapping relationship between the content scene type and the reverberation effect parameter.

The electronic device may pre-store a preset mapping relationship between content scene types and reverberation effect parameters, and then determine target reverberation effect parameters corresponding to the target content scene type according to the mapping relationship.

104. Process the monaural data according to the target reverberation effect parameter to obtain target reverberation binaural data.

The electronic device can process the mono data based on the HRTF algorithm to obtain the binaural data, and can also process the binaural data through the target reverberation effect parameters to obtain the reverberated binaural data.

Optionally, in the above step 104, processing the mono data according to the target reverberation effect parameters to obtain target reverberation binaural data, which may include the following steps:

41. Obtain the first three-dimensional coordinates of the sound source;

42. Obtain the second three-dimensional coordinates of the target object, where the first three-dimensional coordinates and the second three-dimensional coordinates are based on the same coordinate origin;

43. Generate target reverberation binaural data according to the first three-dimensional coordinates, the second three-dimensional coordinates, the mono data, and the target reverberation effect parameter.

Among them, taking the virtual scene as an example, since each object in the virtual scene can correspond to a three-dimensional coordinate, the first three-dimensional coordinate of the sound source can be obtained, and when the sound source emits sound, the monophonic sound generated by the sound source can be obtained. data. The target object may also correspond to a three-dimensional coordinate, that is, a second three-dimensional coordinate. Of course, the first three-dimensional coordinate and the second three-dimensional coordinate are different positions, and the first three-dimensional coordinate and the second three-dimensional coordinate are based on the same coordinate origin. Furthermore, the target reverberation binaural data is generated according to the first three-dimensional coordinates, the second three-dimensional coordinates, the monophonic data, and the target reverberation effect parameters, and specifically, the HRTF algorithm can be used.

Optionally, when the target object is in a game scene, in the above step 42, acquiring the second three-dimensional coordinates of the target object may include the following steps:

421. Obtain a map corresponding to the game scene;

422. Determine the coordinate position corresponding to the target object in the map, and obtain the second three-dimensional coordinate.

Among them, when the target object is in the game scene, the target object can be regarded as a character in the game. Of course, in the specific implementation, the game scene can correspond to a three-dimensional map. Therefore, the electronic device can obtain the map corresponding to the game scene and display the map in the map. Determine the coordinate position corresponding to the target object, and obtain the second three-dimensional coordinate. In this way, for different games, the position of the character can be known in real time. Being able to immerse yourself in the scene makes the game world feel more realistic.

Optionally, in the above step 43, generating target reverberation binaural data according to the first three-dimensional coordinates, the second three-dimensional coordinates, the monophonic data, and the target reverberation effect parameters may include the following steps: :

431. Generate the multi-channel binaural data between the first three-dimensional coordinates and the second three-dimensional coordinates from the mono data, and each channel of binaural data corresponds to a unique propagation direction;

432. Combine the multi-channel binaural data into the target reverberation binaural data according to the target reverberation effect parameter.

Among them, the original sound data of the sound source is monophonic data, and through algorithm processing (for example, HRTF algorithm), binaural data can be obtained, because in the real environment, the sound propagates in all directions, of course, in the In the propagation process, phenomena such as reflection, refraction, interference, diffraction, etc. will also occur. Therefore, in this embodiment of the present application, the only thing that is used to finally synthesize the target binaural data is to pass between the first three-dimensional coordinate and the second three-dimensional coordinate. Multi-channel binaural data, the multi-channel binaural data is synthesized into target reverberation binaural data according to the target reverberation effect parameter.

Optionally, the above step 432, synthesizing the multi-channel binaural data into the target reverberation binaural data according to the target reverberation effect parameter, may include the following steps:

A11. Use the first three-dimensional coordinate and the second three-dimensional coordinate as axes to make a cross-section, and divide the multi-channel binaural data to obtain a first binaural data set and a second binaural data set , the first binaural data set and the second binaural data set both include at least one channel of binaural data;

A12. Synthesize the first binaural data set to obtain first monaural data;

A13, synthesizing the second binaural data set to obtain second monaural data;

A14. Synthesize the first monaural data and the second monaural data according to the target reverberation effect parameter to obtain the reverberated binaural data.

Among them, after knowing the first three-dimensional coordinates and the second three-dimensional coordinates, the first three-dimensional coordinates and the second three-dimensional coordinates can be used as the axes to make a cross-section. Since the sound propagation direction is certain, the propagation trajectory will also have a certain degree of symmetry along a certain axis of symmetry. Symmetry, as shown in Figure 1C, the first three-dimensional coordinate and the second three-dimensional coordinate form an axis, and the axis is used as a cross-section to divide the multi-channel binaural data to obtain the first binaural data set and the second binaural data set. The binaural data set, regardless of external factors, such as refraction, reflection, diffraction, etc., the first binaural data set and the second binaural data set may also be binaural data containing the same number of channels , and the binaural data of different sets are also in a symmetrical relationship. The first binaural data set and the second binaural data set both include at least one channel of binaural data. In specific implementation, the electronic device can convert the first binaural data The set is synthesized to obtain the first mono data, the electronic device may include left and right earphones, the first mono data may be played mainly by the left earphone, and correspondingly, the electronic device may synthesize the second dual channel data to obtain The second monaural data, the second monaural data can be played mainly by the right earphone, and finally, the first monaural data and the second monaural data are synthesized according to the target reverberation effect parameters to obtain the target reverberation channel Data, specifically, as shown in FIG. 1D, the electronic device may perform channel processing on mono data (for example, first mono data, second mono data) (channel processing mainly refers to channel data into two-channel data), obtain two two-channel data, and process each channel of mono data according to the target reverberation effect parameters to obtain reverberation audio data, convert the two two-channel data and the mixed channel The sound audio data is synthesized to obtain the target reverberation channel data.

Optionally, in the above step 4322, the first binaural data set is synthesized to obtain the first monaural data, which may include the following steps:

B1, obtain a plurality of energy values from the energy value of each channel of binaural data in the first binaural data set;

B2. Select an energy value greater than the first energy threshold from the plurality of energy values to obtain a plurality of first target energy values;

B3. Determine the first binaural data corresponding to the plurality of first target energy values, and synthesize the first binaural data to obtain the first monaural data.

The above-mentioned first energy threshold may be set by the user or the system defaults. In a specific implementation, the electronic device may obtain a plurality of energy values from the energy value of each channel of binaural data in the first binaural data set, and then select an energy value greater than the first energy threshold from the plurality of energy values, A plurality of first target energy values are obtained, first binaural data corresponding to the plurality of first target energy values is determined, and the first binaural data is synthesized to obtain first monaural data.

Optionally, based on the above-mentioned steps A1-A3, the above-mentioned step 4323 may also be implemented, which will not be repeated here.

Optionally, between the above steps 41 to 43, the following steps may also be included:

obtaining the face orientation of the target object;

Then, in the above step 43, the target reverberation binaural data is generated according to the first three-dimensional coordinates, the second three-dimensional coordinates, the mono data, and the target reverberation effect parameters, which can be implemented as follows:

The target reverberation binaural data is generated according to the face orientation, the first three-dimensional coordinate, the second three-dimensional coordinate, the mono data, and the target reverberation effect parameter.

Among them, in the specific implementation, the 3D sound effects heard by the user with different facial orientations are also different. In view of this, in the embodiment of the present application, the facial orientation of the target object is considered, and the electronic device can detect the facial orientation of the target object. Specifically, On the other hand, if it is a game scene, the orientation of the target object relative to the sound source can be detected as the face orientation of the target object. Realistic headband display devices, etc. A variety of sensors can be used to detect the direction of the human head, including but not limited to resistive sensors, mechanical sensors, photosensitive sensors, ultrasonic sensors, muscle sensors, etc., which are not limited herein. It can be one of the sensors, or a combination of several sensors, or a single sensor or a combination of several sensors. The detection of the head direction may be performed at preset time intervals, and the preset time intervals may be set by the user or the system defaults.

Optionally, the above step 432, synthesizing the multi-channel binaural data into the target reverberation binaural data according to the target reverberation effect parameter, may include the following steps:

A21. Determine the energy value of each channel of dual-channel data in the multi-channel dual-channel data, and obtain multiple energy values;

A22. According to the mapping relationship between the preset energy value and the reverberation effect parameter adjustment coefficient, determine the reverberation effect parameter adjustment coefficient corresponding to each energy value in the plurality of energy values, and obtain a plurality of reverberation effect parameter adjustment coefficient;

A23. Determine the reverberation effect parameter corresponding to each channel of binaural data according to the plurality of reverberation effect parameter adjustment coefficients and the target reverberation effect parameter, and obtain a plurality of first reverberation effect parameters;

A24. Process the multi-channel binaural data according to the plurality of first reverberation effect parameters to obtain multi-channel reverberation binaural data, and each first reverberation effect parameter corresponds to a unique channel of binaural data ;

A25. Synthesize the multi-channel binaural data to obtain the target reverberation binaural data.

The electronic device may pre-store the mapping relationship between the preset energy value and the reverberation effect parameter adjustment coefficient, the reverberation effect parameter adjustment coefficient is used for the reverberation effect parameter, and the value range of the reverberation effect parameter adjustment coefficient Between 0 and 1, specifically, reverberation effect parameter * reverberation effect parameter adjustment coefficient = actual reverberation effect parameter, and the corresponding binaural data is processed by the actual reverberation effect parameter to obtain reverberation binaural data. In a specific implementation, the electronic device can determine the energy value of each channel of binaural data in the multi-channel binaural data, obtain multiple energy values, and determine the mixed energy value corresponding to each energy value in the multiple energy values according to the above mapping relationship The reverberation effect parameter adjustment coefficient is obtained to obtain a plurality of reverberation effect parameter adjustment coefficients, and the reverberation effect parameters corresponding to each channel of binaural data are determined according to the multiple reverberation effect parameter adjustment coefficients and the target reverberation effect parameters, and a plurality of first reverberation effect parameters are obtained. The reverberation effect parameter, that is, the first reverberation effect parameter=target reverberation effect parameter*reverberation effect parameter adjustment coefficient, and further, the multi-channel binaural data is processed according to the plurality of first reverberation effect parameters to obtain a multi-channel reverberation effect parameter. Reverberation binaural data, each first reverberation effect parameter corresponds to a unique channel of binaural data, and multiple channels of binaural data are synthesized to obtain the target reverberation binaural data. In this way, according to the energy value of each channel, the realization of Different reverberation effects in different directions, and the final synthesized reverberation binaural data has a more realistic three-dimensional sense. Specifically, as shown in FIG. 1E , the electronic device may perform channel processing on monaural data (eg, first monaural data, second monaural data) (channel processing mainly refers to processing monaural data Convert into binaural data), obtain multiple binaural data, and process each channel data according to the reverberation effect parameters to obtain multiple reverberation audio data, combine multiple binaural data and multiple The sound audio data is synthesized to obtain the target reverberation channel data.

It can be seen that the 3D sound effect processing method described in the embodiments of the present application acquires the mono data of the sound source, determines the target content scene type corresponding to the mono data, and determines the target reverberation effect parameter according to the target content scene type, The mono data is processed according to the target reverberation effect parameters to obtain the target reverberation binaural data. In this way, the reverberation effect parameters corresponding to the content scene can be determined, and the reverberation binaural can be generated according to the reverberation effect parameters. Therefore, the reverberation effect suitable for the content scene is realized, and the stereoscopic effect is more realistic.

Consistent with the above, FIG. 2 is a schematic flowchart of a 3D sound effect processing method disclosed in an embodiment of the present application. Applied to the electronic device shown in FIG. 1A , the 3D sound effect processing method includes the following steps 201 - 206 .

201. Acquire mono data of a sound source.

202. Determine a target content scene type corresponding to the mono data.

203. Determine a target reverberation effect parameter according to the target content scene type.

204. Acquire first three-dimensional coordinates of the sound source.

205. Acquire second three-dimensional coordinates of the target object, where the first three-dimensional coordinates and the second three-dimensional coordinates are based on the same coordinate origin.

206. Generate target reverberation binaural data according to the first three-dimensional coordinates, the second three-dimensional coordinates, the mono data, and the target reverberation effect parameter.

The specific description of the above steps 201 to 206 may refer to the corresponding description of the 3D sound effect processing method described in FIG. 1B , which will not be repeated here.

It can be seen that the 3D sound effect processing method described in the embodiments of the present application acquires the mono data of the sound source, determines the target content scene type corresponding to the mono data, and determines the target reverberation effect parameter according to the target content scene type, Obtain the first three-dimensional coordinates of the sound source, and obtain the second three-dimensional coordinates of the target object. The first three-dimensional coordinates and the second three-dimensional coordinates are based on the same coordinate origin, according to the first three-dimensional coordinates, the second three-dimensional coordinates The reverberation effect parameters generate the target reverberation binaural data. In this way, the reverberation effect parameters corresponding to the content scene can be determined, and the reverberation binaural data can be generated according to the reverberation effect parameters, thereby realizing the suitability for the content scene. The reverberation effect is more realistic.

Consistent with the above, FIG. 3 is a schematic flowchart of a 3D sound effect processing method disclosed in an embodiment of the present application. Applied to the electronic device shown in FIG. 1A , the 3D sound effect processing method includes the following steps 301 - 306 .

301. Acquire mono data of a sound source.

302. Perform semantic analysis on the mono data to obtain multiple keywords.

303. According to a preset mapping relationship between keywords and content scene types, determine a content scene type corresponding to each keyword in the plurality of keywords, and obtain a plurality of content scene types.

304. Use the content scene type with the most occurrences among the multiple content scene types as the target content scene type.

305. Determine a target reverberation effect parameter corresponding to the target content scene type according to the preset mapping relationship between the content scene type and the reverberation effect parameter.

306. Process the monaural data according to the target reverberation effect parameter to obtain target reverberation binaural data.

The specific description of the above steps 301 to 306 may refer to the corresponding description of the 3D sound effect processing method described in FIG. 1B , which will not be repeated here.

It can be seen that the 3D sound effect processing method described in the embodiments of the present application obtains mono data of the sound source, performs semantic analysis on the mono data, and obtains a plurality of keywords, according to the preset keywords and content scenarios. The mapping relationship between the types, determine the content scene type corresponding to each keyword in the multiple keywords, obtain multiple content scene types, and use the content scene type with the most occurrences among the multiple content scene types as the target content scene type, According to the mapping relationship between the preset content scene type and the reverberation effect parameter, determine the target reverberation effect parameter corresponding to the target content scene type, process the mono data according to the target reverberation effect parameter, and obtain the target reverberation dual In this way, the reverberation effect parameters corresponding to the content scene can be determined, and the reverberation binaural data can be generated according to the reverberation effect parameters, thereby realizing the reverberation effect suitable for the content scene, and the stereoscopic effect is more realistic. .

Please refer to FIG. 4. FIG. 4 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present application. As shown in the figure, the electronic device includes a processor, a memory, a communication interface, and one or more programs, wherein the above-mentioned One or more programs are stored in the aforementioned memory and configured to be executed by the aforementioned processor, the aforementioned programs including instructions for performing the following steps:

Get the mono data of the sound source;

Determine the target content scene type corresponding to the mono data;

Determine target reverberation effect parameters according to the target content scene type;

The monaural data is processed according to the target reverberation effect parameter to obtain target reverberation binaural data.

It can be seen that the electronic device described in the embodiment of the present application acquires the mono data of the sound source, determines the target content scene type corresponding to the mono data, determines the target reverberation effect parameter according to the target content scene type, and determines the target reverberation effect parameter according to the target content scene type. The reverberation effect parameters process the mono data to obtain the target reverberation binaural data. In this way, the reverberation effect parameters corresponding to the content scene can be determined, and the reverberation binaural data can be generated according to the reverberation effect parameters. Therefore, a reverberation effect suitable for the content scene is realized, and the stereoscopic effect is more realistic.

In a possible example, in the aspect of determining the target content scene type corresponding to the mono data, the above program includes instructions for executing the following steps:

Semantic parsing is performed on the mono data to obtain a plurality of keywords;

According to the preset mapping relationship between keywords and content scene types, determine the content scene type corresponding to each keyword in the plurality of keywords, and obtain a plurality of content scene types;

The content scene type with the largest number of occurrences among the plurality of content scene types is used as the target content scene type.

In a possible example, in the aspect of determining the target reverberation effect parameter according to the target content scene type, the above program includes instructions for performing the following steps:

The target reverberation effect parameter corresponding to the target content scene type is determined according to the preset mapping relationship between the content scene type and the reverberation effect parameter.

In a possible example, in the aspect of processing the mono data according to the target reverberation effect parameters to obtain target binaural data, the above program includes instructions for executing the following steps:

obtaining the first three-dimensional coordinates of the sound source;

acquiring the second three-dimensional coordinates of the target object, the first three-dimensional coordinates and the second three-dimensional coordinates are based on the same coordinate origin;

The target reverberation binaural data is generated according to the first three-dimensional coordinates, the second three-dimensional coordinates, the monaural data, and the target reverberation effect parameter.

In a possible example, in the aspect of generating the target reverberation binaural data according to the first three-dimensional coordinates, the second three-dimensional coordinates, the mono data, and the target reverberation effect parameters, the above The program includes instructions for performing the following steps:

generating multi-channel binaural data between the first three-dimensional coordinates and the second three-dimensional coordinates from the monophonic data, and each channel of binaural data corresponds to a unique propagation direction;

The target reverberation binaural data is synthesized from the multi-channel binaural data according to the target reverberation effect parameter.

In a possible example, in the aspect of synthesizing the multi-channel binaural data according to the target reverberation effect parameter to the target reverberation binaural data, the above program includes instructions for performing the following steps:

Taking the first three-dimensional coordinates and the second three-dimensional coordinates as axes to make a cross-section, the multi-channel binaural data is divided to obtain a first binaural data set and a second binaural data set, so The first binaural data set and the second binaural data set both include at least one channel of binaural data;

synthesizing the first binaural data set to obtain first monaural data;

synthesizing the second binaural data set to obtain second monaural data;

The first monaural data and the second monaural data are synthesized according to the target reverberation effect parameter to obtain the reverberated binaural data.

In a possible example, in the aspect of synthesizing the multi-channel binaural data according to the target reverberation effect parameter to the target reverberation binaural data, the above program includes instructions for performing the following steps:

Determine the energy value of each channel of dual-channel data in the multi-channel dual-channel data, and obtain multiple energy values;

According to the mapping relationship between the preset energy value and the reverberation effect parameter adjustment coefficient, determine the reverberation effect parameter adjustment coefficient corresponding to each energy value in the plurality of energy values, and obtain a plurality of reverberation effect parameter adjustment coefficients;

determining a reverberation effect parameter corresponding to each channel of binaural data according to the plurality of reverberation effect parameter adjustment coefficients and the target reverberation effect parameter, to obtain a plurality of first reverberation effect parameters;

processing the multi-channel binaural data according to the plurality of first reverberation effect parameters to obtain multi-channel reverberation binaural data, and each first reverberation effect parameter corresponds to a unique channel of binaural data;

The multi-channel binaural data is synthesized to obtain the target reverberation binaural data.

The foregoing mainly introduces the solutions of the embodiments of the present application from the perspective of the method-side execution process. It can be understood that, in order to realize the above-mentioned functions, the electronic device includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that the present application can be implemented in hardware or in the form of a combination of hardware and computer software, in combination with the units and algorithm steps of each example described in the embodiments provided herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In this embodiment of the present application, the electronic device may be divided into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and other division methods may be used in actual implementation.

Please refer to FIG. 5 . FIG. 5 is a schematic structural diagram of a 3D sound effect processing apparatus disclosed in an embodiment of the present application, which is applied to the electronic device shown in FIG. 1A . The 3D sound effect processing apparatus 500 includes: an obtaining unit 501 , a first determining unit 502, second determining unit 503 and processing unit 504, wherein,

The obtaining unit 501 is used to obtain monophonic data of the sound source;

The first determining unit 502 is configured to determine the target content scene type corresponding to the mono data;

The second determining unit 503 is configured to determine target reverberation effect parameters according to the target content scene type;

The processing unit 504 is configured to process the mono data according to the target reverberation effect parameter to obtain target reverberation binaural data.

In a possible example, in the aspect of determining the target content scene type corresponding to the mono data, the first determining unit 502 is specifically configured to:

Semantic parsing is performed on the mono data to obtain a plurality of keywords;

According to the preset mapping relationship between keywords and content scene types, determine the content scene type corresponding to each keyword in the plurality of keywords, and obtain a plurality of content scene types;

The content scene type with the largest number of occurrences among the plurality of content scene types is used as the target content scene type.

In a possible example, in the aspect of determining the target reverberation effect parameter according to the target content scene type, the second determining unit 503 is specifically configured to:

The target reverberation effect parameter corresponding to the target content scene type is determined according to the preset mapping relationship between the content scene type and the reverberation effect parameter.

In a possible example, in the aspect of processing the mono data according to the target reverberation effect parameter to obtain target binaural data, the processing unit 504 is specifically configured to:

obtaining the first three-dimensional coordinates of the sound source;

acquiring the second three-dimensional coordinates of the target object, the first three-dimensional coordinates and the second three-dimensional coordinates are based on the same coordinate origin;

The target reverberation binaural data is generated according to the first three-dimensional coordinates, the second three-dimensional coordinates, the monaural data, and the target reverberation effect parameter.

In a possible example, in the aspect of generating the target reverberation binaural data according to the first three-dimensional coordinates, the second three-dimensional coordinates, the monophonic data, and the target reverberation effect parameter, the The processing unit 504 is specifically used for:

generating multi-channel binaural data between the first three-dimensional coordinates and the second three-dimensional coordinates from the monophonic data, and each channel of binaural data corresponds to a unique propagation direction;

The target reverberation binaural data is synthesized from the multi-channel binaural data according to the target reverberation effect parameter.

In a possible example, in the aspect of synthesizing the multi-channel binaural data according to the target reverberation effect parameter to the target reverberation binaural data, the processing unit 504 is specifically configured to:

Taking the first three-dimensional coordinates and the second three-dimensional coordinates as axes to make a cross-section, the multi-channel binaural data is divided to obtain a first binaural data set and a second binaural data set, so The first binaural data set and the second binaural data set both include at least one channel of binaural data;

synthesizing the first binaural data set to obtain first monaural data;

synthesizing the second binaural data set to obtain second monaural data;

The first monaural data and the second monaural data are synthesized according to the target reverberation effect parameter to obtain the reverberated binaural data.

In a possible example, in the aspect of synthesizing the multi-channel binaural data according to the target reverberation effect parameter to the target reverberation binaural data, the processing unit 504 is specifically configured to:

Determine the energy value of each channel of dual-channel data in the multi-channel dual-channel data, and obtain multiple energy values;

According to the mapping relationship between the preset energy value and the reverberation effect parameter adjustment coefficient, determine the reverberation effect parameter adjustment coefficient corresponding to each energy value in the plurality of energy values, and obtain a plurality of reverberation effect parameter adjustment coefficients;

determining a reverberation effect parameter corresponding to each channel of binaural data according to the plurality of reverberation effect parameter adjustment coefficients and the target reverberation effect parameter, to obtain a plurality of first reverberation effect parameters;

processing the multi-channel binaural data according to the plurality of first reverberation effect parameters to obtain multi-channel reverberation binaural data, and each first reverberation effect parameter corresponds to a unique channel of binaural data;

The multi-channel binaural data is synthesized to obtain the target reverberation binaural data.

It can be seen that the 3D sound effect processing device described in the embodiments of the present application is applied to electronic equipment, obtains mono data of a sound source, determines the target content scene type corresponding to the mono data, and determines the target content scene type according to the target content scene type. Reverberation effect parameters: Process the monaural data according to the target reverberation effect parameters to obtain the target reverberation binaural data. In this way, the reverberation effect parameters corresponding to the content scene can be determined and generated according to the reverberation effect parameters The two-channel data of reverberation is reverberated, so that the reverberation effect suitable for the content scene is realized, and the three-dimensional sense is more realistic.

It should be noted that the electronic devices described in the embodiments of the present application are presented in the form of functional units. The term "unit" as used herein should be understood in the broadest possible sense, and the object used to implement the functions described by each "unit" may be, for example, an integrated circuit ASIC, a single circuit for executing one or more software or firmware Program processors (shared, dedicated, or chipset) and memory, combinational logic circuits, and/or other suitable components that provide the functions described above.

The obtaining unit 501 , the first determining unit 502 , the second determining unit 503 and the processing unit 504 may be a control circuit or a processor.

Embodiments of the present application further provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables the computer to execute any 3D sound effect processing method described in the above method embodiments. some or all of the steps.

The embodiments of the present application further provide a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the methods described in the foregoing method embodiments. Some or all of the steps of any 3D sound processing method.

It should be noted that, for the sake of simple description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with the present application, certain steps may be performed in other orders or concurrently. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, and can also be implemented in the form of software program modules.

The integrated unit, if implemented in the form of a software program module and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art, or all or part of the technical solution, and the computer software product is stored in a memory, Several instructions are included to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , ROM, RAM, disk or CD, etc.

The embodiments of the present application have been introduced in detail above, and the principles and implementations of the present application are described in this paper by using specific examples. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application; at the same time, for Persons of ordinary skill in the art, based on the idea of the present application, will have changes in the specific implementation manner and application scope. In summary, the contents of this specification should not be construed as limitations on the present application.

Claims (13)

1. A3D sound effect processing method is characterized by comprising the following steps:

acquiring single track data of a sound source;

processing the mono channel data according to a target reverberation effect parameter to obtain target reverberation binaural data, wherein the target reverberation effect parameter depends on a target content scene type, and the target content scene type corresponds to the mono channel data;

wherein,

the target reverberation effect parameter comprises at least one of: the method comprises the steps of inputting level, low-frequency cut points, high-frequency cut points, early reflection time, diffusion degree, low mixing ratio, reverberation time, original dry sound volume, early reflection sound volume, high-frequency attenuation points, frequency dividing points, reverberation volume, sound field width, output sound field and tail sound;

determining a target content scene type corresponding to the mono data includes:

performing semantic analysis on the single sound channel data to obtain a plurality of keywords;

determining a content scene type corresponding to each keyword in the plurality of keywords according to a mapping relation between preset keywords and the content scene type to obtain a plurality of content scene types;

wherein the target content scene type is a content scene type that occurs the most frequently among the plurality of content scene types.

2. The method of claim 1, wherein the target reverberation effect parameter depends on the target content scene type and comprises:

and determining the target reverberation effect parameter corresponding to the target content scene type according to a mapping relation between a preset content scene type and the reverberation effect parameter.

3. The method of any of claims 1-2, wherein the processing the mono data to obtain the target binaural data according to the target reverberation effect parameter comprises:

acquiring a first three-dimensional coordinate of the sound source;

acquiring a second three-dimensional coordinate of the target object, wherein the first three-dimensional coordinate and the second three-dimensional coordinate are based on the same coordinate origin;

and generating target reverberation binaural data according to the first three-dimensional coordinate, the second three-dimensional coordinate, the single sound channel data and the target reverberation effect parameter.

4. The method of claim 3,

generating target reverberation binaural data according to the first three-dimensional coordinate, the second three-dimensional coordinate, the mono data, and the target reverberation effect parameter, including:

generating multi-channel two-channel data between the first three-dimensional coordinate and the second three-dimensional coordinate by using the single-channel data, wherein each channel of two-channel data corresponds to a unique propagation direction;

and synthesizing the multi-channel two-channel data into the target reverberation two-channel data according to the target reverberation effect parameter.

5. The method of claim 4, wherein said synthesizing the multi-channel binaural data into the target reverberant binaural data according to the target reverberation effect parameter comprises:

taking the first three-dimensional coordinate and the second three-dimensional coordinate as axes to be taken as cross sections, dividing the multichannel two-channel data to obtain a first two-channel data set and a second two-channel data set, wherein the first two-channel data set and the second two-channel data set both comprise at least one channel of two-channel data;

synthesizing the first double-channel data set to obtain first single-channel data;

synthesizing the second double-channel data set to obtain second single-channel data;

and synthesizing the first single-channel data and the second single-channel data according to the target reverberation effect parameter to obtain the reverberation double-channel data.

6. The method of claim 4, wherein said synthesizing the multi-channel binaural data into the target reverberant binaural data according to the target reverberation effect parameter comprises:

determining the energy value of each path of double-channel data in the multi-path double-channel data to obtain a plurality of energy values;

determining a reverberation effect parameter adjusting coefficient corresponding to each energy value in the plurality of energy values according to a mapping relation between preset energy values and reverberation effect parameter adjusting coefficients to obtain a plurality of reverberation effect parameter adjusting coefficients;

determining a reverberation effect parameter corresponding to each path of binaural data according to the reverberation effect parameter adjusting coefficients and the target reverberation effect parameter to obtain a plurality of first reverberation effect parameters;

processing the multichannel two-channel data according to the plurality of first reverberation effect parameters to obtain multichannel reverberation two-channel data, wherein each first reverberation effect parameter corresponds to a unique channel of two-channel data;

and synthesizing the multi-channel binaural data to obtain the target reverberation binaural data.

7. A3D sound effect processing method is characterized by comprising the following steps:

acquiring single track data of a sound source;

processing the single-channel data according to a target reverberation effect parameter to obtain target reverberation binaural data, wherein the target reverberation effect parameter depends on a target content scene type, and the target content scene type corresponds to the single-channel data;

wherein,

the target reverberation effect parameter comprises at least one of: the method comprises the steps of inputting level, low-frequency cut points, high-frequency cut points, early reflection time, diffusion degree, low mixing ratio, reverberation time, original dry sound volume, early reflection sound volume, high-frequency attenuation points, frequency dividing points, reverberation volume, sound field width, output sound field and tail sound;

wherein the target reverberation effect parameter depends on a target content scene type, including: and determining the target reverberation effect parameter corresponding to the target content scene type according to a preset mapping relation between the content scene type and the reverberation effect parameter.

8. A3D sound effect processing method is characterized by comprising the following steps:

acquiring single track data of a sound source;

processing the mono channel data according to a target reverberation effect parameter to obtain target reverberation binaural data, wherein the target reverberation effect parameter depends on a target content scene type, and the target content scene type corresponds to the mono channel data;

wherein,

the target reverberation effect parameter comprises at least one of: the method comprises the steps of inputting level, low-frequency cut points, high-frequency cut points, early reflection time, diffusion degree, low mixing ratio, reverberation time, original dry sound volume, early reflection sound volume, high-frequency attenuation points, frequency dividing points, reverberation volume, sound field width, output sound field and tail sound;

wherein the processing the mono channel data according to the target reverberation effect parameter to obtain the target binaural data includes:

acquiring a first three-dimensional coordinate of the sound source;

acquiring a second three-dimensional coordinate of the target object, wherein the first three-dimensional coordinate and the second three-dimensional coordinate are based on the same coordinate origin;

and generating target reverberation binaural data according to the first three-dimensional coordinate, the second three-dimensional coordinate, the single sound channel data and the target reverberation effect parameter.

9. A3D sound effect processing device, wherein the 3D sound effect processing device comprises: an acquisition unit, a first determination unit, a second determination unit and a processing unit, wherein,

the acquisition unit is used for acquiring single sound channel data of a sound source;

the processing unit is configured to process the mono channel data according to a target reverberation effect parameter to obtain target reverberation binaural data, where the target reverberation effect parameter depends on a target content scene type, and the target content scene type corresponds to the mono channel data;

wherein,

the target reverberation effect parameter comprises at least one of: the method comprises the steps of inputting level, low-frequency cut points, high-frequency cut points, early reflection time, diffusion degree, low mixing ratio, reverberation time, original dry sound volume, early reflection sound volume, high-frequency attenuation points, frequency dividing points, reverberation volume, sound field width, output sound field and tail sound;

determining a target content scene type corresponding to the mono data includes:

performing semantic analysis on the single sound channel data to obtain a plurality of keywords;

determining a content scene type corresponding to each keyword in the plurality of keywords according to a mapping relation between preset keywords and the content scene type to obtain a plurality of content scene types;

wherein the target content scene type is a content scene type that occurs the most frequently among the plurality of content scene types.

10. A3D sound effect processing device, wherein the 3D sound effect processing device comprises: an acquisition unit, a first determination unit, a second determination unit and a processing unit, wherein,

the acquisition unit is used for acquiring single sound channel data of a sound source;

the processing unit is configured to process the mono channel data according to a target reverberation effect parameter to obtain target reverberation binaural data, where the target reverberation effect parameter depends on a target content scene type, and the target content scene type corresponds to the mono channel data;

wherein,

the target reverberation effect parameter comprises at least one of: the method comprises the steps of inputting level, low-frequency cut points, high-frequency cut points, early reflection time, diffusion degree, low mixing ratio, reverberation time, original dry sound volume, early reflection sound volume, high-frequency attenuation points, frequency dividing points, reverberation volume, sound field width, output sound field and tail sound;

wherein the target reverberation effect parameter depends on a target content scene type, including: and determining the target reverberation effect parameter corresponding to the target content scene type according to a preset mapping relation between the content scene type and the reverberation effect parameter.

11. A3D sound effect processing device, wherein the 3D sound effect processing device comprises: an acquisition unit, a first determination unit, a second determination unit and a processing unit, wherein,

the acquisition unit is used for acquiring single sound channel data of a sound source;

the processing unit is configured to process the mono channel data according to a target reverberation effect parameter to obtain target reverberation binaural data, where the target reverberation effect parameter depends on a target content scene type, and the target content scene type corresponds to the mono channel data;

wherein,

the target reverberation effect parameter comprises at least one of: the method comprises the steps of inputting level, low-frequency cut points, high-frequency cut points, early reflection time, diffusion degree, low mixing ratio, reverberation time, original dry sound volume, early reflection sound volume, high-frequency attenuation points, frequency dividing points, reverberation volume, sound field width, output sound field and tail sound;

wherein the processing the mono channel data according to the target reverberation effect parameter to obtain the target binaural data includes:

acquiring a first three-dimensional coordinate of the sound source;

acquiring a second three-dimensional coordinate of the target object, wherein the first three-dimensional coordinate and the second three-dimensional coordinate are based on the same coordinate origin;

and generating target reverberation binaural data according to the first three-dimensional coordinate, the second three-dimensional coordinate, the single sound channel data and the target reverberation effect parameter.

12. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-8.

13. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-8.

Images