[go: up one dir, main page]

CN117789750A - Audio signal processing method, device, vehicle and storage medium - Google Patents

Audio signal processing method, device, vehicle and storage medium Download PDF

Info

Publication number
CN117789750A
CN117789750A CN202311835622.1A CN202311835622A CN117789750A CN 117789750 A CN117789750 A CN 117789750A CN 202311835622 A CN202311835622 A CN 202311835622A CN 117789750 A CN117789750 A CN 117789750A
Authority
CN
China
Prior art keywords
audio signal
target
frequency response
response relationship
sound wave
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311835622.1A
Other languages
Chinese (zh)
Inventor
周岭松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Beijing Xiaomi Pinecone Electronic Co Ltd
Xiaomi Technology Wuhan Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Beijing Xiaomi Pinecone Electronic Co Ltd
Xiaomi Technology Wuhan Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd, Beijing Xiaomi Pinecone Electronic Co Ltd, Xiaomi Technology Wuhan Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202311835622.1A priority Critical patent/CN117789750A/en
Publication of CN117789750A publication Critical patent/CN117789750A/en
Pending legal-status Critical Current

Links

Landscapes

  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The disclosure relates to an audio signal processing method, an audio signal processing device, a vehicle and a storage medium, and relates to the technical field of vehicles, wherein the method comprises the following steps: and acquiring a sound wave audio signal corresponding to the simulated sound wave in the vehicle, wherein the simulated sound wave is generated by playing the target audio signal by the vehicle. And determining a correction frequency response relation according to the sound wave audio signal and the target audio signal. And adjusting the target audio signal according to the corrected frequency response relation. According to the method and the device, the target audio signal played by the vehicle is corrected according to the sound wave audio signal corresponding to the simulated sound wave obtained from the environment, so that the target audio signal can be flexibly adapted to various different environments, the vehicle can be ensured to stably output ideal simulated sound waves in different environments, and the flexibility and stability of generating the simulated sound waves are improved.

Description

音频信号处理方法、装置、车辆及存储介质Audio signal processing method, device, vehicle and storage medium

技术领域Technical field

本公开涉及车辆技术领域,尤其涉及一种音频信号处理方法、装置、车辆及存储介质。The present disclosure relates to the field of vehicle technology, and in particular to an audio signal processing method, device, vehicle and storage medium.

背景技术Background technique

随着社会的快速发展,电动汽车正在快速普及。与传统燃油车不同,电动车没有发动机,在行驶过程中会过于安静,缺少驾驶感,因而产生了电子声浪的需求。电子声浪技术根据车辆行驶过程中的状态,发出相匹配的声音,让驾驶者有驾驶感。例如模拟发动机的声音,让电动车与燃油车有同样的驾驶感。现有的声浪合成算法是在汽车驾驶过程中,获取汽车的工况信息,然后根据工况信息,使用声浪合成算法产生音频信号,并通过喇叭进行播放。With the rapid development of society, electric vehicles are rapidly becoming popular. Unlike traditional fuel vehicles, electric vehicles do not have an engine and are too quiet during driving, lacking a driving feel, thus creating a need for electronic sound. Electronic sound wave technology emits matching sounds according to the vehicle's driving status, giving the driver a sense of driving. For example, it simulates the sound of the engine to give electric vehicles and fuel vehicles the same driving feeling. The existing sound wave synthesis algorithm obtains the working condition information of the car during the driving process, and then uses the sound wave synthesis algorithm to generate an audio signal based on the working condition information, and plays it through the speaker.

发明内容Contents of the invention

为克服相关技术中存在的问题,本公开提供一种音频信号处理方法、装置、车辆及存储介质。In order to overcome problems existing in related technologies, the present disclosure provides an audio signal processing method, device, vehicle and storage medium.

根据本公开实施例的第一方面,提供一种音频信号处理方法,所述方法包括:According to a first aspect of an embodiment of the present disclosure, an audio signal processing method is provided, the method including:

获取车辆内的模拟声浪对应的声浪音频信号,所述模拟声浪是所述车辆播放目标音频信号产生的声浪;Obtain the sound wave audio signal corresponding to the simulated sound wave in the vehicle, where the simulated sound wave is the sound wave generated by the vehicle playing the target audio signal;

根据所述声浪音频信号和所述目标音频信号,确定修正频响关系;Determining a modified frequency response relationship according to the sound wave audio signal and the target audio signal;

根据所述修正频响关系调整所述目标音频信号。The target audio signal is adjusted according to the modified frequency response relationship.

可选地,所述根据所述声浪音频信号和所述目标音频信号,确定修正频响关系包括:Optionally, determining the modified frequency response relationship based on the sound wave audio signal and the target audio signal includes:

根据所述声浪音频信号和所述目标音频信号,确定目标频响关系;Determining a target frequency response relationship according to the sound audio signal and the target audio signal;

根据所述目标频响关系和预设频响关系,确定所述修正频响关系。The modified frequency response relationship is determined based on the target frequency response relationship and the preset frequency response relationship.

可选地,所述根据所述声浪音频信号和所述目标音频信号,确定目标频响关系包括:Optionally, determining a target frequency response relationship according to the sound audio signal and the target audio signal includes:

根据所述声浪音频信号和所述目标音频信号确定第一功率谱;所述第一功率谱包括所述声浪音频信号和所述目标音频信号的交叉功率谱;Determine a first power spectrum according to the sound wave audio signal and the target audio signal; the first power spectrum includes the cross power spectrum of the sound wave audio signal and the target audio signal;

根据所述目标音频信号确定第二功率谱,所述第二功率谱包括所述目标音频信号的自功率谱;Determine a second power spectrum based on the target audio signal, the second power spectrum including an autopower spectrum of the target audio signal;

根据所述第一功率谱和所述第二功率谱确定所述目标频响关系。The target frequency response relationship is determined based on the first power spectrum and the second power spectrum.

可选地,所述目标频响关系包括目标频响函数,所述预设频响关系包括预设频响函数,所述修正频响关系包括修正频响函数;所述根据所述目标频响关系和预设频响关系,确定所述修正频响关系包括:Optionally, the target frequency response relationship includes a target frequency response function, the preset frequency response relationship includes a preset frequency response function, and the modified frequency response relationship includes a modified frequency response function; relationship and the preset frequency response relationship. Determining the modified frequency response relationship includes:

将所述目标频响函数和预设频响函数之差作为所述修正频响函数。The difference between the target frequency response function and the preset frequency response function is used as the modified frequency response function.

可选地,所述方法还包括:Optionally, the method also includes:

获取所述车辆的工况信息;Acquiring operating condition information of the vehicle;

根据所述工况信息确定目标相位信息;Determine target phase information according to the working condition information;

所述根据所述修正频响关系调整所述目标音频信号包括:The adjusting the target audio signal according to the modified frequency response relationship includes:

根据所述目标相位信息和所述修正频响关系调整所述目标音频信号。The target audio signal is adjusted according to the target phase information and the modified frequency response relationship.

可选地,所述根据所述目标相位信息和所述修正频响关系调整所述目标音频信号包括:Optionally, the adjusting the target audio signal according to the target phase information and the modified frequency response relationship includes:

根据所述修正频响关系确定目标幅度信息;Determine target amplitude information according to the modified frequency response relationship;

根据所述目标相位信息和所述目标幅度信息调整所述目标音频信号。The target audio signal is adjusted based on the target phase information and the target amplitude information.

可选地,所述根据所述修正频响关系确定目标幅度信息包括:Optionally, determining target amplitude information according to the modified frequency response relationship includes:

将所述修正频响关系与原始幅度信息的乘积,作为所述目标幅度信息,所述原始幅度信息为所述工况信息的幅度信息。The product of the modified frequency response relationship and the original amplitude information is used as the target amplitude information, and the original amplitude information is the amplitude information of the working condition information.

可选地,所述根据所述目标相位信息和所述目标幅度信息调整所述目标音频信号包括:Optionally, adjusting the target audio signal according to the target phase information and the target amplitude information includes:

根据所述目标相位信息和所述目标幅度信息进行反傅里叶变换,以得到调整后的所述目标音频信号。An inverse Fourier transform is performed according to the target phase information and the target amplitude information to obtain the adjusted target audio signal.

根据本公开实施例的第二方面,提供一种音频信息处理装置,所述装置包括:According to a second aspect of an embodiment of the present disclosure, an audio information processing device is provided, and the device includes:

第一获取模块,被配置为获取车辆内的模拟声浪对应的声浪音频信号,所述模拟声浪是所述车辆播放目标音频信号产生的声浪;The first acquisition module is configured to acquire the sound wave audio signal corresponding to the simulated sound wave in the vehicle, where the simulated sound wave is the sound wave generated by the vehicle playing the target audio signal;

第一确定模块,被配置为根据所述声浪音频信号和所述目标音频信号,确定修正频响关系;A first determination module configured to determine a modified frequency response relationship based on the sound wave audio signal and the target audio signal;

调整模块,被配置为根据所述修正频响关系调整所述目标音频信号。An adjustment module configured to adjust the target audio signal according to the modified frequency response relationship.

可选地,所述第一确定模块包括:Optionally, the first determining module includes:

第一确定子模块,被配置为根据所述声浪音频信号和所述目标音频信号,确定目标频响关系;The first determination sub-module is configured to determine the target frequency response relationship according to the sound wave audio signal and the target audio signal;

第二确定子模块,被配置为根据所述目标频响关系和预设频响关系,确定所述修正频响关系。The second determination sub-module is configured to determine the modified frequency response relationship according to the target frequency response relationship and the preset frequency response relationship.

可选地,所述第一确定子模块被配置为:Optionally, the first determination sub-module is configured as:

根据所述声浪音频信号和所述目标音频信号确定第一功率谱;所述第一功率谱包括所述声浪音频信号和所述目标音频信号的交叉功率谱;Determine a first power spectrum according to the sound wave audio signal and the target audio signal; the first power spectrum includes the cross power spectrum of the sound wave audio signal and the target audio signal;

根据所述目标音频信号确定第二功率谱,所述第二功率谱包括所述目标音频信号的自功率谱;determining a second power spectrum according to the target audio signal, wherein the second power spectrum includes an autopower spectrum of the target audio signal;

根据所述第一功率谱和所述第二功率谱确定所述目标频响关系。The target frequency response relationship is determined based on the first power spectrum and the second power spectrum.

可选地,所述目标频响关系包括目标频响函数,所述预设频响关系包括预设频响函数,所述修正频响关系包括修正频响函数;所述第二确定子模块被配置为:Optionally, the target frequency response relationship includes a target frequency response function, the preset frequency response relationship includes a preset frequency response function, and the modified frequency response relationship includes a modified frequency response function; the second determination sub-module is Configured as:

将所述目标频响函数和预设频响函数之差作为所述修正频响函数。The difference between the target frequency response function and the preset frequency response function is used as the modified frequency response function.

可选地,所述装置还包括:Optionally, the device further comprises:

第二获取模块,被配置为获取所述车辆的工况信息;a second acquisition module configured to acquire working condition information of the vehicle;

第二确定模块,被配置为根据所述工况信息确定目标相位信息;A second determination module is configured to determine target phase information according to the operating condition information;

所述调整模块被配置为:The adjustment module is configured as:

根据所述目标相位信息和所述修正频响关系调整所述目标音频信号。The target audio signal is adjusted according to the target phase information and the modified frequency response relationship.

可选地,所述调整模块包括:Optionally, the adjustment module includes:

第三确定子模块,被配置为根据所述修正频响关系确定目标幅度信息;A third determination submodule is configured to determine target amplitude information according to the modified frequency response relationship;

调整子模块,被配置为根据所述目标相位信息和所述目标幅度信息调整所述目标音频信号。The adjustment sub-module is configured to adjust the target audio signal according to the target phase information and the target amplitude information.

可选地,所述第三确定子模块被配置为:Optionally, the third determination sub-module is configured as:

将所述修正频响关系与原始幅度信息的乘积,作为所述目标幅度信息,所述原始幅度信息为所述工况信息对应的幅度信息。The product of the modified frequency response relationship and the original amplitude information is used as the target amplitude information, and the original amplitude information is the amplitude information corresponding to the working condition information.

可选地,所述调整子模块被配置为:Optionally, the adjustment submodule is configured as follows:

根据所述目标相位信息和所述目标幅度信息进行反傅里叶变换,以得到调整后的所述目标音频信号。An inverse Fourier transform is performed according to the target phase information and the target amplitude information to obtain the adjusted target audio signal.

根据本公开实施例的第三方面,提供一种车辆,包括:According to a third aspect of an embodiment of the present disclosure, a vehicle is provided, comprising:

存储器,其上存储有计算机程序;A memory on which a computer program is stored;

处理器,用于执行所述存储器中的所述计算机程序,以实现本公开实施例的第一方面所述方法的步骤。A processor, configured to execute the computer program in the memory to implement the steps of the method described in the first aspect of the embodiment of the present disclosure.

根据本公开实施例的第四方面,提供一种计算机可读存储介质,其上存储有计算机程序指令,该程序指令被处理器执行时实现本公开实施例的第一方面所述方法的步骤。According to a fourth aspect of an embodiment of the present disclosure, there is provided a computer-readable storage medium on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the method described in the first aspect of the embodiment of the present disclosure are implemented.

本公开的实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

本公开首先获取车辆播放目标音频信号产生的模拟声浪对应的声浪音频信号,然后根据声浪音频信号和目标音频信号,确定修正频响关系,并根据修正频响关系调整目标音频信号。本公开根据从环境中获取的模拟声浪对应的声浪音频信号,对车辆播放目标音频信号进行修正,使得目标音频信号能够灵活地适应于各种不同的环境,能够保证车辆在不同的环境中都能稳定输出较为理想的模拟声浪,提高了生成模拟声浪的灵活性和稳定性。This disclosure first obtains the sound wave audio signal corresponding to the simulated sound wave generated by the vehicle playing the target audio signal, then determines the corrected frequency response relationship based on the sound wave audio signal and the target audio signal, and adjusts the target audio signal according to the corrected frequency response relationship. This disclosure corrects the target audio signal played by the vehicle based on the sound wave audio signal corresponding to the simulated sound wave obtained from the environment, so that the target audio signal can be flexibly adapted to various different environments, and can ensure that the vehicle can play in different environments. Stable output of ideal simulated sound waves improves the flexibility and stability of generating simulated sound waves.

应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

附图说明Description of drawings

此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

图1是根据一示例性实施例示出的一种音频信号处理方法的流程图。FIG. 1 is a flow chart of an audio signal processing method according to an exemplary embodiment.

图2是根据一示例性实施例示出的另一种音频信号处理方法的流程图。FIG. 2 is a flowchart of another audio signal processing method according to an exemplary embodiment.

图3是根据图2实施例示出的一种频响曲线的示意图。FIG. 3 is a schematic diagram of a frequency response curve according to the embodiment of FIG. 2 .

图4是根据一示例性实施例示出的另一种音频信号处理方法的流程图。Fig. 4 is a flow chart showing another audio signal processing method according to an exemplary embodiment.

图5是根据一示例性实施例示出的一种音频信号处理装置的框图。FIG. 5 is a block diagram of an audio signal processing device according to an exemplary embodiment.

图6是根据一示例性实施例示出的另一种音频信号处理装置的框图。FIG. 6 is a block diagram of another audio signal processing device according to an exemplary embodiment.

图7是根据一示例性实施例示出的另一种音频信号处理装置的框图。FIG. 7 is a block diagram of another audio signal processing device according to an exemplary embodiment.

图8是根据一示例性实施例示出的另一种音频信号处理装置的框图。FIG. 8 is a block diagram of another audio signal processing device according to an exemplary embodiment.

图9是根据一示例性实施例示出的一种车辆的功能框图示意图。Figure 9 is a schematic functional block diagram of a vehicle according to an exemplary embodiment.

具体实施方式Detailed ways

这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with aspects of the disclosure as detailed in the appended claims.

需要说明的是,本申请中所有获取信号、信息或数据的动作都是在遵照所在地国家相应的数据保护法规政策的前提下,并获得由相应装置所有者给予授权的情况下进行的。It should be noted that all actions to obtain signals, information or data in this application are performed under the premise of complying with the corresponding data protection regulations and policies of the country where the location is located, and with authorization from the owner of the corresponding device.

在介绍本公开实施例示出的一种音频信号处理方法、装置、车辆及存储介质之前,首先对本公开实施例涉及的应用场景进行介绍。Before introducing an audio signal processing method, device, vehicle and storage medium according to the embodiments of the present disclosure, the application scenarios involved in the embodiments of the present disclosure are first introduced.

通常情况下,车辆在出厂时,都适配好了一套声浪合成算法。但是用户实际使用车辆的过程中,乘坐的人数不同,车辆内放置的物品占用空间,以及衣服等物品的吸声材料不同,都会造成座舱声学环境发生变化。声浪合成算法通过喇叭播放同样的声音,在不同的座舱声学环境下,会产生较大的差异,特别是当座舱声学环境不理想时,则可能达不到预期的模拟声浪效果,影响用户的驾驶体验。Normally, vehicles are equipped with a sound synthesis algorithm when they leave the factory. However, when users actually use the vehicle, the number of passengers, the space occupied by items placed in the vehicle, and the sound-absorbing materials of items such as clothes will all cause changes in the cabin acoustic environment. The sound synthesis algorithm plays the same sound through the speaker, and there will be large differences in different cabin acoustic environments. Especially when the cabin acoustic environment is not ideal, the expected simulated sound effect may not be achieved, affecting the user's driving experience.

图1是根据一示例性实施例示出的一种音频信号处理方法的流程图,如图1所示,该方法可以包括:Figure 1 is a flow chart of an audio signal processing method according to an exemplary embodiment. As shown in Figure 1, the method may include:

在步骤S101中,获取车辆内的模拟声浪对应的声浪音频信号,模拟声浪是车辆播放目标音频信号产生的声浪。In step S101, the sound wave audio signal corresponding to the simulated sound wave in the vehicle is obtained. The simulated sound wave is the sound wave generated by the vehicle playing the target audio signal.

示例的,在车辆播放目标音频信号的同时,可以通过设置在车辆内的声音采集装置,实时采集模拟声浪对应的声浪音频信号。其中,模拟声浪是车辆播放目标音频信号产生的,也就是说,声浪音频信号是目标音频信号在当前的座舱声学环境下播放时,在环境中传播的实际音频信号。For example, while the vehicle is playing the target audio signal, a sound wave audio signal corresponding to the simulated sound wave can be collected in real time through a sound collection device arranged in the vehicle. The simulated sound wave is generated by the vehicle playing the target audio signal, that is, the sound wave audio signal is the actual audio signal propagated in the environment when the target audio signal is played in the current cabin acoustic environment.

在步骤S102中,根据声浪音频信号和目标音频信号,确定修正频响关系。In step S102, a modified frequency response relationship is determined based on the sound wave audio signal and the target audio signal.

示例的,在车辆当前的座舱声学环境下,声浪音频信号和目标音频信号对应的目标频响曲线可能并不是理想的频响曲线,导致对应的模拟声浪达不到预期的最佳效果,因此可以先根据声浪音频信号和目标音频信号,得到修正频响关系,并通过修正频响关系对目标音频信号进行调整,以使播放目标音频信号得到的模拟声浪可以达到预期的最佳效果。For example, in the current cockpit acoustic environment of the vehicle, the target frequency response curve corresponding to the sound audio signal and the target audio signal may not be an ideal frequency response curve, resulting in the corresponding simulated sound failing to achieve the expected optimal effect. Therefore, a corrected frequency response relationship can be obtained based on the sound audio signal and the target audio signal, and the target audio signal can be adjusted by correcting the frequency response relationship so that the simulated sound obtained by playing the target audio signal can achieve the expected optimal effect.

在一些实施例中,可以预先设置一个理想的频响关系作为预设频响关系,根据声浪音频信号和目标音频信号可以得到实际的目标频响关系,根据预设频响关系和目标频响关系之间的差异可以得到修正频响关系。在一种可能的实现方式中,可以将声浪音频信号和目标音频信号之间的交叉功率谱,与声浪音频信号的自功率谱之比作为目标频响关系。其中,预设频响关系可以表示为预设频响曲线,目标频响关系可以表示为目标频响曲线,修正频响关系可以表示为修正频响曲线。In some embodiments, an ideal frequency response relationship can be set in advance as the preset frequency response relationship. The actual target frequency response relationship can be obtained according to the sound wave audio signal and the target audio signal. According to the preset frequency response relationship and the target frequency response relationship The difference between them can be obtained by correcting the frequency response relationship. In a possible implementation, the ratio of the cross power spectrum between the sound wave audio signal and the target audio signal to the autopower spectrum of the sound wave audio signal can be used as the target frequency response relationship. Among them, the preset frequency response relationship can be expressed as a preset frequency response curve, the target frequency response relationship can be expressed as a target frequency response curve, and the modified frequency response relationship can be expressed as a modified frequency response curve.

在另一些实施例中,可以预先训练得到频响关系修正模型,将获取到的声浪音频信号和目标音频信号输入频响关系修正模型,可以得到频响关系修正模型输出的修正频响关系。In other embodiments, a frequency response relationship correction model can be pre-trained, and the acquired sound wave audio signal and the target audio signal are input into the frequency response relationship correction model to obtain a corrected frequency response relationship output by the frequency response relationship correction model.

在步骤S103中,根据修正频响关系调整目标音频信号。In step S103, the target audio signal is adjusted according to the modified frequency response relationship.

示例的,可以根据修正频响关系对原始幅度信息进行修正,得到目标幅度信息,然后根据目标幅度信息对目标音频信号进行调整,其中,原始幅度信息可以理解为当前的工况信息对应的幅度信息。在一种可能的实现方式中,可以从多个预设音频信息中确定当前的工况信息对应的指定音频信息,并将指定音频信息的幅度信息作为原始幅度信息,并且可以将原始幅度信息与修正频响曲线的乘积,作为目标幅度信息。For example, the original amplitude information can be corrected according to the modified frequency response relationship to obtain the target amplitude information, and then the target audio signal can be adjusted according to the target amplitude information. The original amplitude information can be understood as the amplitude information corresponding to the current working condition information. . In a possible implementation, the specified audio information corresponding to the current working condition information can be determined from multiple preset audio information, and the amplitude information of the specified audio information can be used as the original amplitude information, and the original amplitude information can be combined with The product of the corrected frequency response curves is used as the target amplitude information.

在一些实施例中,可以根据目标幅度信息对目标音频信号对应的频域信号进行反傅里叶变换,得到调整后的目标音频信号。In some embodiments, an inverse Fourier transform can be performed on the frequency domain signal corresponding to the target audio signal according to the target amplitude information to obtain the adjusted target audio signal.

在另一些实施例中,可以获取车辆的工况信息,并确定工况信息对应的目标相位信息,根据目标幅度信息和目标相位信息对目标音频信号对应的频域信号进行反傅里叶变换,可以得到调整后的目标音频信号。In other embodiments, the vehicle's working condition information can be obtained, the target phase information corresponding to the working condition information can be determined, and the frequency domain signal corresponding to the target audio signal can be inversely Fourier transformed according to the target amplitude information and the target phase information. The adjusted target audio signal can be obtained.

综上所述,本公开首先获取车辆播放目标音频信号产生的模拟声浪对应的声浪音频信号,然后根据声浪音频信号和目标音频信号,确定修正频响关系,并根据修正频响关系调整目标音频信号。本公开根据从环境中获取的模拟声浪对应的声浪音频信号,对车辆播放目标音频信号进行修正,使得目标音频信号能够灵活地适应于各种不同的环境,能够保证车辆在不同的环境中都能稳定输出较为理想的模拟声浪,提高了生成模拟声浪的灵活性和稳定性。To sum up, the present disclosure first obtains the sound wave audio signal corresponding to the simulated sound wave generated by the vehicle playing the target audio signal, then determines the corrected frequency response relationship based on the sound wave audio signal and the target audio signal, and adjusts the target audio signal according to the corrected frequency response relationship. . This disclosure corrects the target audio signal played by the vehicle based on the sound wave audio signal corresponding to the simulated sound wave obtained from the environment, so that the target audio signal can be flexibly adapted to various different environments, and can ensure that the vehicle can play in different environments. Stable output of ideal simulated sound waves improves the flexibility and stability of generating simulated sound waves.

图2是根据一示例性实施例示出的另一种音频信号处理方法的流程图,如图2所示,步骤S102可以通过以下步骤来实现:Figure 2 is a flow chart of another audio signal processing method according to an exemplary embodiment. As shown in Figure 2, step S102 can be implemented through the following steps:

在步骤S1021中,根据声浪音频信号和目标音频信号确定目标频响关系。In step S1021, the target frequency response relationship is determined based on the sound wave audio signal and the target audio signal.

示例的,可以根据声浪音频信号和目标音频信号确定第一功率谱,并根据目标音频信号确定第二功率谱。其中,第一功率谱可以包括声浪音频信号和目标音频信号的交叉功率谱,第二功率谱包括目标音频信号的自功率谱。然后可以根据第一功率谱和第二功率谱确定目标频响关系。For example, the first power spectrum may be determined based on the sound wave audio signal and the target audio signal, and the second power spectrum may be determined based on the target audio signal. The first power spectrum may include a cross power spectrum of the sound wave audio signal and the target audio signal, and the second power spectrum may include an autopower spectrum of the target audio signal. The target frequency response relationship can then be determined based on the first power spectrum and the second power spectrum.

在一些实施例中,目标频响关系可以为目标频响函数,目标频响函数可以通过公式1计算得到:In some embodiments, the target frequency response relationship can be a target frequency response function, and the target frequency response function can be calculated by Formula 1:

其中,HAB(k)为目标频响函数,A为目标音频信号,B为声浪音频信号,GAB为A和B的交叉功率谱,即第一功率谱,GAA为A的自功率谱,即第二功率谱,k表示频点,N为FFT(英文:Fast Fourier Transform,中文:快速傅里叶变换)的点数。Among them, H AB (k) is the target frequency response function, A is the target audio signal, B is the sound wave audio signal, G AB is the cross power spectrum of A and B, that is, the first power spectrum, G AA is the autopower spectrum of A , that is, the second power spectrum, k represents the frequency point, and N is the number of points of FFT (English: Fast Fourier Transform, Chinese: Fast Fourier Transform).

在步骤S1022中,根据目标频响关系和预设频响关系,确定修正频响关系。In step S1022, a modified frequency response relationship is determined based on the target frequency response relationship and the preset frequency response relationship.

其中,预设频响关系可以理解为预先存储的理想频响关系,在频响关系为理想频响关系的情况下,模拟声浪的声音效果最佳。Among them, the preset frequency response relationship can be understood as a pre-stored ideal frequency response relationship. When the frequency response relationship is an ideal frequency response relationship, the sound effect of simulated sound waves is the best.

示例的,目标频响关系可以包括目标频响函数,预设频响关系包括预设频响函数,修正频响关系包括修正频响函数。如公式2所示,可以将目标频响函数和预设频响函数之差作为修正频响函数。For example, the target frequency response relationship may include a target frequency response function, the preset frequency response relationship may include a preset frequency response function, and the modified frequency response relationship may include a modified frequency response function. As shown in Equation 2, the difference between the target frequency response function and the preset frequency response function can be used as the modified frequency response function.

w(k)=T(k)-HAB(k),k=0,1,2,3,…,N-1(公式2)w(k)=T(k)-H AB (k),k=0,1,2,3,…,N-1(Formula 2)

其中,w(k)为修正频响函数,T(k)为预设频响函数。Among them, w(k) is the modified frequency response function, and T(k) is the preset frequency response function.

参照图3,曲线X为预设频响函数对应的预设频响曲线,曲线Y为目标频响函数对应的目标频响曲线,可以得到修正频响函数对应的修正频响曲线为曲线Z。3 , curve X is a preset frequency response curve corresponding to the preset frequency response function, curve Y is a target frequency response curve corresponding to the target frequency response function, and the modified frequency response curve corresponding to the modified frequency response function is curve Z.

图4是根据一示例性实施例示出的另一种音频信号处理方法的流程图,如图4所示,该方法还包括:Figure 4 is a flow chart of another audio signal processing method according to an exemplary embodiment. As shown in Figure 4, the method further includes:

在步骤S104中,获取车辆的工况信息。In step S104, the vehicle's operating condition information is obtained.

在步骤S105中,根据工况信息确定目标相位信息。In step S105, target phase information is determined according to the operating condition information.

示例的,在车辆运行过程中,车辆可以通过CAN(英文:Controller Area Network,中文:控制器局域网)总线获取汽车的工况信息,然后根据工况信息,使用声浪合成算法生成目标音频信号,并通过喇叭将目标音频信息播放出去。其中,工况信息可以包含电机转速、车速、车辆加速度、踏板开合度中的一种或多种信息。For example, during the operation of the vehicle, the vehicle can obtain the working condition information of the car through the CAN (English: Controller Area Network, Chinese: Controller Area Network) bus, and then use the sound wave synthesis algorithm to generate the target audio signal based on the working condition information, and Play the target audio information through the speaker. The working condition information may include one or more types of information including motor speed, vehicle speed, vehicle acceleration, and pedal opening and closing.

以工况信息为电机转速为例,对于不同的电机转速,对应不同的音频信号。比如转速为4000时对应的音频信号是音频A,转速为5000时对应的音频信号是音频B。因为实际车辆芯片空间有限,无法把转速4000、4100、4200、4300等所有工况下的音频信号都预先存储下来再播放,而是存储一部分转速的音频信号,然后根据存储的音频信号来进行扩展出其他转速下的音频信号。例如可以存储转速为2000、4000、6000、8000、10000、12000等对应的音频信号,转速在1000-3000之间的转速对应的音频信号可以通过2000转速对应的音频信号来扩展,转速在3000-5000之间的转速对应音频信号可以通过4000转速对应的音频信号来扩展,以此类推。Taking the working condition information as motor speed as an example, different motor speeds correspond to different audio signals. For example, when the rotation speed is 4000, the corresponding audio signal is audio A, and when the rotation speed is 5000, the corresponding audio signal is audio B. Because the actual vehicle chip space is limited, it is impossible to pre-store the audio signals under all working conditions such as 4000, 4100, 4200, 4300, etc. before playing them. Instead, it stores a part of the audio signals at the rotation speed and then expands them according to the stored audio signals. output audio signals at other rotational speeds. For example, audio signals corresponding to rotational speeds of 2000, 4000, 6000, 8000, 10000, 12000, etc. can be stored. The audio signals corresponding to rotational speeds between 1000-3000 can be expanded by the audio signals corresponding to 2000 rotational speeds. The audio signals corresponding to rotational speeds between 3000-3000 can be stored. The audio signal corresponding to the rotation speed between 5000 and 5000 can be expanded by the audio signal corresponding to the rotation speed 4000, and so on.

在一种可能的实现方式中,可以采用相位声码器算法对转速对应的音频信号进行扩展。示例的,对于选定的一段指定音频信号进行分帧处理,指定音频信号的帧移hopin可以根据经验设定,例如可以为25%~50%的帧长。对分帧后的指定音频信号进行FFT变换,可以得到各个频点上的幅度信息和相位信息。In a possible implementation, a phase vocoder algorithm can be used to expand the audio signal corresponding to the rotation speed. For example, frame processing is performed on a selected specified audio signal, and the frame shift hop in of the specified audio signal can be set based on experience, for example, it can be 25% to 50% of the frame length. Perform FFT transformation on the specified audio signal after framing to obtain the amplitude information and phase information at each frequency point.

在获取到工况信息之后,可以根据当前的工况信息确定对应的指定音频信号,然后根据当前的工况信息和指定音频信号对应的工况信息之间的差异,确定搬移倍率。比如当前转速为3000,选取的指定音频信号是转速2000对应的音频信号,那么搬移倍率ratio可以为1.5,参照公式3,根据搬移倍率ratio可以计算出转速3000对应的帧移hopoutAfter obtaining the working condition information, the corresponding specified audio signal can be determined based on the current working condition information, and then the moving magnification can be determined based on the difference between the current working condition information and the working condition information corresponding to the specified audio signal. For example, the current rotation speed is 3000, and the selected designated audio signal is the audio signal corresponding to the rotation speed 2000, then the movement magnification ratio can be 1.5. Refer to Formula 3. According to the movement magnification ratio, the frame shift hop out corresponding to the rotation speed 3000 can be calculated:

hopout=ratio*hopin (公式3)hop out =ratio*hop in (Formula 3)

参照公式4,根据相位声码器算法,可以得到当前的工况信息对应的目标相位信息:Referring to Formula 4, according to the phase vocoder algorithm, the target phase information corresponding to the current working condition information can be obtained:

其中,k表示频点,i表示当前帧,i-1表示上一帧,表示当前帧第k个频点对应的相位信息,/>表示上一帧第k个频点对应的相位信息,Δt=hopout÷Fs,Fs为采样率,ω(k)i表示当前帧的第k个频点对应的频率值。Among them, k represents the frequency point, i represents the current frame, and i-1 represents the previous frame. Indicates the phase information corresponding to the kth frequency point of the current frame,/> Represents the phase information corresponding to the k-th frequency point of the previous frame, Δt =hop out ÷Fs, Fs is the sampling rate, ω(k) i represents the frequency value corresponding to the k-th frequency point of the current frame.

相应的,步骤S103的一种实现方式可以为:Correspondingly, an implementation manner of step S103 may be:

根据目标相位信息和修正频响关系调整目标音频信号。Adjust the target audio signal based on the target phase information and modified frequency response relationship.

示例的,如果车辆内环境发生变化,目标频响关系也可能会随之发生变化,从而会影响模拟声浪的效果,因此可以根据修正频响关系对目标音频信号的幅度进行调整,使得目标音频信号能够灵活地适应于各种不同的环境,保证车辆在不同的环境中都能稳定输出较为理想的模拟声浪。For example, if the environment inside the vehicle changes, the target frequency response relationship may also change accordingly, which will affect the effect of simulated sound waves. Therefore, the amplitude of the target audio signal can be adjusted according to the modified frequency response relationship, so that the target audio signal It can flexibly adapt to various environments, ensuring that vehicles can stably output ideal simulated sound waves in different environments.

在一些实施例中,可以根据修正频响关系确定指定音频信号的目标幅度信息,然后根据目标相位信息和目标幅度信息调整目标音频信号。In some embodiments, the target amplitude information of the specified audio signal may be determined according to the modified frequency response relationship, and then the target audio signal may be adjusted according to the target phase information and the target amplitude information.

在一种可能的实现方式中,可以将修正频响函数与指定音频信号的原始幅度信息的乘积,作为目标幅度信息,目标幅度信息例如可以通过公式5计算得到。In a possible implementation, the product of the modified frequency response function and the original amplitude information of the specified audio signal can be used as the target amplitude information. The target amplitude information can be calculated, for example, through Formula 5.

AMP(k)=|w(k)·X(k)|,i=0,1,…,N-1 (公式5)AMP(k)=|w(k)·X(k)|,i=0,1,…,N-1 (Formula 5)

其中,AMP(k)为目标幅度信息,X(k)为原始幅度信息。Among them, AMP(k) is the target amplitude information, and X(k) is the original amplitude information.

在另一些实施例中,可以根据目标相位信息和目标幅度信息进行反傅里叶变换,以得到调整后的目标音频信号。In other embodiments, an inverse Fourier transform may be performed according to the target phase information and the target amplitude information to obtain an adjusted target audio signal.

在一种可能的实现方式中,如公式6所示,可以根据目标相位信息和目标幅度信息对指定音频信号对应的频域信号进行反傅里叶变换,得到修正音频信号,然后根据公式7所示的移频算法对修正音频信号进行处理,得到调整后的目标音频信号。In a possible implementation, as shown in Equation 6, the frequency domain signal corresponding to the specified audio signal can be inverse Fourier transformed according to the target phase information and target amplitude information to obtain the modified audio signal, and then the modified audio signal can be obtained according to Equation 7. The frequency shift algorithm shown in the figure is used to process the modified audio signal to obtain the adjusted target audio signal.

其中,xi为修正音频信号,y(n)为调整后的目标音频信号,L为帧长,u(n)为单位阶跃信号。Among them, xi is the modified audio signal, y(n) is the adjusted target audio signal, L is the frame length, and u(n) is the unit step signal.

综上所述,本公开首先获取车辆播放目标音频信号产生的模拟声浪对应的声浪音频信号,然后根据声浪音频信号和目标音频信号,确定修正频响关系,并根据修正频响关系调整目标音频信号。本公开根据从环境中获取的模拟声浪对应的声浪音频信号,对车辆播放目标音频信号进行修正,使得目标音频信号能够灵活地适应于各种不同的环境,能够保证车辆在不同的环境中都能稳定输出较为理想的模拟声浪,提高了生成模拟声浪的灵活性和稳定性。To sum up, the present disclosure first obtains the sound wave audio signal corresponding to the simulated sound wave generated by the vehicle playing the target audio signal, then determines the corrected frequency response relationship based on the sound wave audio signal and the target audio signal, and adjusts the target audio signal according to the corrected frequency response relationship. . This disclosure corrects the target audio signal played by the vehicle based on the sound wave audio signal corresponding to the simulated sound wave obtained from the environment, so that the target audio signal can be flexibly adapted to various different environments, and can ensure that the vehicle can play in different environments. Stable output of ideal simulated sound waves improves the flexibility and stability of generating simulated sound waves.

图5是根据一示例性实施例示出的一种音频信号处理装置的框图,如图5所示,该装置200包括:Figure 5 is a block diagram of an audio signal processing device according to an exemplary embodiment. As shown in Figure 5, the device 200 includes:

第一获取模块201,被配置为获取车辆内的模拟声浪对应的声浪音频信号,模拟声浪是车辆播放目标音频信号产生的声浪。The first acquisition module 201 is configured to acquire the sound wave audio signal corresponding to the simulated sound wave in the vehicle. The simulated sound wave is the sound wave generated by the vehicle playing the target audio signal.

第一确定模块202,被配置为根据声浪音频信号和目标音频信号,确定修正频响关系。The first determination module 202 is configured to determine the modified frequency response relationship according to the sound wave audio signal and the target audio signal.

调整模块203,被配置为根据修正频响关系调整目标音频信号。The adjustment module 203 is configured to adjust the target audio signal according to the modified frequency response relationship.

图6是根据一示例性实施例示出的另一种音频信号处理装置的框图,如图6所示,第一确定模块202包括:Figure 6 is a block diagram of another audio signal processing device according to an exemplary embodiment. As shown in Figure 6, the first determination module 202 includes:

第一确定子模块2021,被配置为根据声浪音频信号和目标音频信号,确定目标频响关系。The first determination sub-module 2021 is configured to determine the target frequency response relationship based on the sound wave audio signal and the target audio signal.

第二确定子模块2022,被配置为根据目标频响关系和预设频响关系,确定修正频响关系。The second determination sub-module 2022 is configured to determine the modified frequency response relationship according to the target frequency response relationship and the preset frequency response relationship.

在一些实施例中,第一确定子模块2021被配置为:In some embodiments, the first determination sub-module 2021 is configured as:

根据声浪音频信号和目标音频信号确定第一功率谱。第一功率谱包括声浪音频信号和目标音频信号的交叉功率谱。A first power spectrum is determined according to the sound wave audio signal and the target audio signal. The first power spectrum includes a cross power spectrum of the sound wave audio signal and the target audio signal.

根据目标音频信号确定第二功率谱,第二功率谱包括目标音频信号的自功率谱。A second power spectrum is determined based on the target audio signal, and the second power spectrum includes an autopower spectrum of the target audio signal.

根据第一功率谱和第二功率谱确定目标频响关系。The target frequency response relationship is determined based on the first power spectrum and the second power spectrum.

在另一些实施例中,目标频响关系包括目标频响函数,预设频响关系包括预设频响函数,修正频响关系包括修正频响函数。第二确定子模块2022被配置为:In other embodiments, the target frequency response relationship includes a target frequency response function, the preset frequency response relationship includes a preset frequency response function, and the modified frequency response relationship includes a modified frequency response function. The second determination sub-module 2022 is configured as:

将目标频响函数和预设频响函数之差作为修正频响函数。The difference between the target frequency response function and the preset frequency response function is used as the modified frequency response function.

图7是根据一示例性实施例示出的另一种音频信号处理装置的框图,如图7所示,该装置200还包括:Figure 7 is a block diagram of another audio signal processing device according to an exemplary embodiment. As shown in Figure 7, the device 200 further includes:

第二获取模块204,被配置为获取车辆的工况信息。The second acquisition module 204 is configured to acquire the operating condition information of the vehicle.

第二确定模块205,被配置为根据工况信息确定目标相位信息。The second determination module 205 is configured to determine the target phase information according to the operating condition information.

调整模块203被配置为:The adjustment module 203 is configured as:

根据目标相位信息和修正频响关系调整目标音频信号。Adjust the target audio signal based on the target phase information and modified frequency response relationship.

图8是根据一示例性实施例示出的另一种音频信号处理装置的框图,如图8所示,调整模块203包括:Figure 8 is a block diagram of another audio signal processing device according to an exemplary embodiment. As shown in Figure 8, the adjustment module 203 includes:

第三确定子模块2031,被配置为根据修正频响关系确定目标幅度信息。The third determination sub-module 2031 is configured to determine the target amplitude information according to the modified frequency response relationship.

调整子模块2032,被配置为根据目标相位信息和目标幅度信息调整目标音频信号。The adjustment sub-module 2032 is configured to adjust the target audio signal according to the target phase information and the target amplitude information.

在另一些实施例中,第三确定子模块2031被配置为:In other embodiments, the third determination sub-module 2031 is configured as:

将修正频响关系与原始幅度信息的乘积,作为目标幅度信息,原始幅度信息为调整前的目标音频信息对应的幅度信息。The product of the corrected frequency response relationship and the original amplitude information is used as the target amplitude information, and the original amplitude information is the amplitude information corresponding to the target audio information before adjustment.

在另一些实施例中,调整子模块2032被配置为:In other embodiments, the adjustment sub-module 2032 is configured to:

根据目标相位信息和目标幅度信息进行反傅里叶变换,以得到调整后的目标音频信号。The inverse Fourier transform is performed based on the target phase information and target amplitude information to obtain the adjusted target audio signal.

关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

综上所述,本公开首先获取车辆播放目标音频信号产生的模拟声浪对应的声浪音频信号,然后根据声浪音频信号和目标音频信号,确定修正频响关系,并根据修正频响关系调整目标音频信号。本公开根据从环境中获取的模拟声浪对应的声浪音频信号,对车辆播放目标音频信号进行修正,使得目标音频信号能够灵活地适应于各种不同的环境,能够保证车辆在不同的环境中都能稳定输出较为理想的模拟声浪,提高了生成模拟声浪的灵活性和稳定性。In summary, the present disclosure first obtains a sound wave audio signal corresponding to the simulated sound wave generated by the vehicle playing the target audio signal, and then determines the corrected frequency response relationship based on the sound wave audio signal and the target audio signal, and adjusts the target audio signal based on the corrected frequency response relationship. The present disclosure corrects the target audio signal played by the vehicle according to the sound wave audio signal corresponding to the simulated sound wave obtained from the environment, so that the target audio signal can flexibly adapt to various different environments, and can ensure that the vehicle can stably output relatively ideal simulated sound waves in different environments, thereby improving the flexibility and stability of generating simulated sound waves.

本公开还提供一种计算机可读存储介质,其上存储有计算机程序指令,该程序指令被处理器执行时实现本公开提供的音频信号处理方法的步骤。The present disclosure also provides a computer-readable storage medium on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the audio signal processing method provided by the present disclosure are implemented.

图9是根据一示例性实施例示出的一种车辆的框图。例如,车辆300可以是混合动力车辆,也可以是非混合动力车辆、电动车辆、燃料电池车辆或者其他类型的车辆。车辆300可以是自动驾驶车辆、半自动驾驶车辆或者非自动驾驶车辆。Figure 9 is a block diagram of a vehicle according to an exemplary embodiment. For example, the vehicle 300 may be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. Vehicle 300 may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

参照图9,车辆300可包括各种子系统,例如,信息娱乐系统310、感知系统320、决策控制系统330、驱动系统340以及计算平台350。其中,车辆300还可以包括更多或更少的子系统,并且每个子系统都可包括多个部件。另外,车辆300的每个子系统之间和每个部件之间可以通过有线或者无线的方式实现互连。Referring to FIG. 9 , vehicle 300 may include various subsystems, such as infotainment system 310 , perception system 320 , decision control system 330 , drive system 340 , and computing platform 350 . The vehicle 300 may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and each component of the vehicle 300 can be interconnected in a wired or wireless manner.

在一些实施例中,信息娱乐系统310可以包括通信系统,娱乐系统以及导航系统等。In some embodiments, the infotainment system 310 may include a communication system, an entertainment system, a navigation system, etc.

感知系统320可以包括若干种传感器,用于感测车辆300周边的环境的信息。例如,感知系统320可包括全球定位系统(全球定位系统可以是GPS系统,也可以是北斗系统或者其他定位系统)、惯性测量单元(inertial measurement unit,IMU)、激光雷达、毫米波雷达、超声雷达以及摄像装置。The sensing system 320 may include several types of sensors for sensing information about the environment around the vehicle 300 . For example, the sensing system 320 may include a global positioning system (the global positioning system may be a GPS system, a Beidou system or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter wave radar, ultrasonic radar and camera equipment.

决策控制系统330可以包括计算系统、整车控制器、转向系统、油门以及制动系统。The decision control system 330 may include a computing system, a vehicle controller, a steering system, a throttle and a braking system.

驱动系统340可以包括为车辆300提供动力运动的组件。在一个实施例中,驱动系统340可以包括引擎、能量源、传动系统和车轮。引擎可以是内燃机、电动机、空气压缩引擎中的一种或者多种的组合。引擎能够将能量源提供的能量转换成机械能量。The drive system 340 may include components that provide power movement for the vehicle 300. In one embodiment, the drive system 340 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, and an air compression engine. The engine can convert energy provided by the energy source into mechanical energy.

车辆300的部分或所有功能受计算平台350控制。计算平台350可包括至少一个处理器351和存储器352,处理器351可以执行存储在存储器352中的指令353。Some or all functions of the vehicle 300 are controlled by a computing platform 350. The computing platform 350 may include at least one processor 351 and a memory 352, and the processor 351 may execute instructions 353 stored in the memory 352.

处理器351可以是任何常规的处理器,诸如商业可获得的CPU。处理器还可以包括诸如图像处理器(Graphic Process Unit,GPU),现场可编程门阵列(Field ProgrammableGate Array,FPGA)、片上系统(System on Chip,SOC)、专用集成芯片(ApplicationSpecific Integrated Circuit,ASIC)或它们的组合。Processor 351 may be any conventional processor, such as a commercially available CPU. The processor may also include graphics processors (Graphic Process Unit, GPU), Field Programmable Gate Array (FPGA), System on Chip (SOC), Application Specific Integrated Circuit (ASIC). or a combination of them.

存储器352可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。Memory 352 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

除了指令353以外,存储器352还可存储数据,例如道路地图,路线信息,车辆的位置、方向、速度等数据。存储器352存储的数据可以被计算平台350使用。In addition to instructions 353 , memory 352 may also store data, such as road maps, route information, vehicle location, direction, speed, etc. The data stored in memory 352 may be used by computing platform 350 .

在本公开实施例中,处理器351可以执行指令353,以完成上述的音频信号处理方法的全部或部分步骤。In this embodiment of the present disclosure, the processor 351 can execute instructions 353 to complete all or part of the steps of the audio signal processing method described above.

在另一示例性实施例中,还提供一种计算机程序产品,该计算机程序产品包含能够由可编程的装置执行的计算机程序,该计算机程序具有当由该可编程的装置执行时用于执行上述的音频信号处理方法的代码部分。In another exemplary embodiment, a computer program product is further provided. The computer program product includes a computer program executable by a programmable device, and the computer program has a code portion for executing the above audio signal processing method when executed by the programmable device.

本领域技术人员在考虑说明书及实践本公开后,将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common common sense or customary technical means in the technical field that are not disclosed in the disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (11)

1.一种音频信号处理方法,其特征在于,所述方法包括:1. A method for processing an audio signal, characterized in that the method comprises: 获取车辆内的模拟声浪对应的声浪音频信号,所述模拟声浪是所述车辆播放目标音频信号产生的声浪;Obtain the sound wave audio signal corresponding to the simulated sound wave in the vehicle, where the simulated sound wave is the sound wave generated by the vehicle playing the target audio signal; 根据所述声浪音频信号和所述目标音频信号,确定修正频响关系;Determine a modified frequency response relationship based on the sound wave audio signal and the target audio signal; 根据所述修正频响关系调整所述目标音频信号。The target audio signal is adjusted according to the modified frequency response relationship. 2.根据权利要求1所述的方法,其特征在于,所述根据所述声浪音频信号和所述目标音频信号,确定修正频响关系包括:2. The method according to claim 1, wherein determining the modified frequency response relationship according to the sound wave audio signal and the target audio signal includes: 根据所述声浪音频信号和所述目标音频信号,确定目标频响关系;Determine the target frequency response relationship according to the sound wave audio signal and the target audio signal; 根据所述目标频响关系和预设频响关系,确定所述修正频响关系。The modified frequency response relationship is determined based on the target frequency response relationship and the preset frequency response relationship. 3.根据权利要求2所述的方法,其特征在于,所述根据所述声浪音频信号和所述目标音频信号,确定目标频响关系包括:3. The method according to claim 2, wherein determining the target frequency response relationship according to the sound wave audio signal and the target audio signal includes: 根据所述声浪音频信号和所述目标音频信号确定第一功率谱;所述第一功率谱包括所述声浪音频信号和所述目标音频信号的交叉功率谱;Determine a first power spectrum according to the sound wave audio signal and the target audio signal; the first power spectrum includes the cross power spectrum of the sound wave audio signal and the target audio signal; 根据所述目标音频信号确定第二功率谱,所述第二功率谱包括所述目标音频信号的自功率谱;Determine a second power spectrum based on the target audio signal, the second power spectrum including an autopower spectrum of the target audio signal; 根据所述第一功率谱和所述第二功率谱确定所述目标频响关系。The target frequency response relationship is determined based on the first power spectrum and the second power spectrum. 4.根据权利要求2所述的方法,其特征在于,所述目标频响关系包括目标频响函数,所述预设频响关系包括预设频响函数,所述修正频响关系包括修正频响函数;所述根据所述目标频响关系和预设频响关系,确定所述修正频响关系包括:4. The method of claim 2, wherein the target frequency response relationship includes a target frequency response function, the preset frequency response relationship includes a preset frequency response function, and the modified frequency response relationship includes a modified frequency response relationship. response function; determining the modified frequency response relationship based on the target frequency response relationship and the preset frequency response relationship includes: 将所述目标频响函数和预设频响函数之差作为所述修正频响函数。The difference between the target frequency response function and the preset frequency response function is used as the modified frequency response function. 5.根据权利要求1-4中任一项所述的方法,其特征在于,所述方法还包括:5. The method according to any one of claims 1-4, characterized in that the method further includes: 获取所述车辆的工况信息;Obtain the operating condition information of the vehicle; 根据所述工况信息确定目标相位信息;Determine target phase information according to the working condition information; 所述根据所述修正频响关系调整所述目标音频信号包括:The adjusting the target audio signal according to the modified frequency response relationship includes: 根据所述目标相位信息和所述修正频响关系调整所述目标音频信号。The target audio signal is adjusted according to the target phase information and the modified frequency response relationship. 6.根据权利要求5所述的方法,其特征在于,所述根据所述目标相位信息和所述修正频响关系调整所述目标音频信号包括:6. The method of claim 5, wherein adjusting the target audio signal according to the target phase information and the modified frequency response relationship includes: 根据所述修正频响关系确定目标幅度信息;Determine target amplitude information according to the modified frequency response relationship; 根据所述目标相位信息和所述目标幅度信息调整所述目标音频信号。The target audio signal is adjusted based on the target phase information and the target amplitude information. 7.根据权利要求6所述的方法,其特征在于,所述修正频响关系包括修正频响函数;所述根据所述修正频响关系确定目标幅度信息包括:7. The method according to claim 6, wherein the modified frequency response relationship includes modifying a frequency response function; and the determining the target amplitude information according to the modified frequency response relationship includes: 将所述修正频响函数与原始幅度信息的乘积,作为所述目标幅度信息,所述原始幅度信息为所述工况信息对应的幅度信息。The product of the modified frequency response function and the original amplitude information is used as the target amplitude information, and the original amplitude information is the amplitude information corresponding to the working condition information. 8.根据权利要求6所述的方法,其特征在于,所述根据所述目标相位信息和所述目标幅度信息调整所述目标音频信号包括:8. The method of claim 6, wherein adjusting the target audio signal according to the target phase information and the target amplitude information includes: 根据所述目标相位信息和所述目标幅度信息进行反傅里叶变换,以得到调整后的所述目标音频信号。An inverse Fourier transform is performed according to the target phase information and the target amplitude information to obtain the adjusted target audio signal. 9.一种音频信息处理装置,其特征在于,所述装置包括:9. An audio information processing device, characterized in that the device includes: 第一获取模块,被配置为获取车辆内的模拟声浪对应的声浪音频信号,所述模拟声浪是所述车辆播放目标音频信号产生的声浪;The first acquisition module is configured to acquire the sound wave audio signal corresponding to the simulated sound wave in the vehicle, where the simulated sound wave is the sound wave generated by the vehicle playing the target audio signal; 第一确定模块,被配置为根据所述声浪音频信号和所述目标音频信号,确定修正频响关系;A first determination module configured to determine a modified frequency response relationship based on the sound wave audio signal and the target audio signal; 调整模块,被配置为根据所述修正频响关系调整所述目标音频信号。An adjustment module configured to adjust the target audio signal according to the modified frequency response relationship. 10.一种车辆,其特征在于,包括:10. A vehicle, characterized in that it includes: 存储器,其上存储有计算机程序;A memory on which a computer program is stored; 处理器,用于执行所述存储器中的所述计算机程序,以实现权利要求1-8中任一项所述方法的步骤。A processor, configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 1 to 8. 11.一种计算机可读存储介质,其上存储有计算机程序指令,其特征在于,该程序指令被处理器执行时实现权利要求1-8中任一项所述方法的步骤。11. A computer-readable storage medium having computer program instructions stored thereon, characterized in that when the program instructions are executed by a processor, the steps of the method according to any one of claims 1-8 are implemented.
CN202311835622.1A 2023-12-27 2023-12-27 Audio signal processing method, device, vehicle and storage medium Pending CN117789750A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311835622.1A CN117789750A (en) 2023-12-27 2023-12-27 Audio signal processing method, device, vehicle and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311835622.1A CN117789750A (en) 2023-12-27 2023-12-27 Audio signal processing method, device, vehicle and storage medium

Publications (1)

Publication Number Publication Date
CN117789750A true CN117789750A (en) 2024-03-29

Family

ID=90396092

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311835622.1A Pending CN117789750A (en) 2023-12-27 2023-12-27 Audio signal processing method, device, vehicle and storage medium

Country Status (1)

Country Link
CN (1) CN117789750A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119649789A (en) * 2024-10-23 2025-03-18 中国第一汽车股份有限公司 Engine simulated sound adjustment method and device, vehicle and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119649789A (en) * 2024-10-23 2025-03-18 中国第一汽车股份有限公司 Engine simulated sound adjustment method and device, vehicle and storage medium

Similar Documents

Publication Publication Date Title
JP2014202856A (en) Engine sound output device and engine sound output method
JP2021113941A (en) Vehicle sound generation device
CN117789750A (en) Audio signal processing method, device, vehicle and storage medium
JP7421725B2 (en) Vehicle sound generator
US11537358B1 (en) Sound experience generator
CN116353482A (en) Method, device, vehicle and storage medium for generating vehicle sound waves
CN120279877A (en) Noise control method, device and readable storage medium
CN120279878A (en) Noise control method, device and readable storage medium
US12175962B2 (en) Apparatus and method for controlling vehicle sound
JP2002351488A (en) Noise cancellation device and in-vehicle system
CN109121041A (en) Audio control system and method based on road characteristics and vehicle operation
US20230294662A1 (en) Apparatus and method for generating virtual sound
CN116935876A (en) Audio synthesis method and device and vehicle
CN116262470A (en) Vehicle, and apparatus and method for generating sound of vehicle
CN118609578A (en) Sound wave synthesis method, device and vehicle
CN118571256A (en) Acoustic wave synthesizing method and device, storage medium, vehicle and electronic equipment
US20250058629A1 (en) System and method for controlling sound output in vehicle
US20240343261A1 (en) Applications of shepard tone in vehicle sound design
CN118629385A (en) Sound synthesis method, device, vehicle and storage medium for vehicle
CN118692489A (en) Sound wave synthesis method, device and vehicle
CN115794024B (en) Volume adjusting method, device, medium, chip and vehicle
US20250174219A1 (en) Method of controlling traveling sound of electric vehicle using motor vibration and virtual transmission signal
US20240190443A1 (en) Apparatus and method for providing vehicle sound
US20250157454A1 (en) Sound control method, sound control device, and battery electric vehicle
CN118486321B (en) Voice processing method, device, electronic device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination