CN106162447A - The method of a kind of audio frequency broadcasting and terminal - Google Patents
The method of a kind of audio frequency broadcasting and terminal Download PDFInfo
- Publication number
- CN106162447A CN106162447A CN201610485673.XA CN201610485673A CN106162447A CN 106162447 A CN106162447 A CN 106162447A CN 201610485673 A CN201610485673 A CN 201610485673A CN 106162447 A CN106162447 A CN 106162447A
- Authority
- CN
- China
- Prior art keywords
- area
- speaker
- terminal
- playing
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000000694 effects Effects 0.000 abstract description 27
- 230000015654 memory Effects 0.000 description 24
- 230000006870 function Effects 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000001360 synchronised effect Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 1
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 1
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/02—Spatial or constructional arrangements of loudspeakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2205/00—Details of stereophonic arrangements covered by H04R5/00 but not provided for in any of its subgroups
- H04R2205/024—Positioning of loudspeaker enclosures for spatial sound reproduction
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
本发明提供一种音频播放的方法和终端,该方法包括:识别与正在播放音频关联的目标对象;获取所述目标对象在终端屏幕中的坐标;根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器;通过所述目标区域对应设置的扬声器播放所述正在播放音频,通过不同的扬声器播放,从而可以提高立体声效果。
The present invention provides an audio playing method and a terminal, the method comprising: identifying a target object associated with the audio being played; acquiring the coordinates of the target object on the terminal screen; judging the location of the target object in the A target area in at least two pre-divided areas of the terminal screen, wherein each area in the at least two areas is correspondingly provided with a speaker; the audio being played is played through the speaker correspondingly provided in the target area, and the audio is played by Different speakers play, which can improve the stereo effect.
Description
技术领域technical field
本发明涉及通信领域,尤其涉及一种音频播放的方法和终端。The present invention relates to the communication field, in particular to an audio playing method and terminal.
背景技术Background technique
随着技术的发展与进步,用户对终端的要求越来越高,用户对终端的多媒体效果也在不断的追求极致,现有终端一般是根据现有信号的左右声道信号来执行播放任务,这与用户在实际使用时的习惯可能不符,会使用户的体验差,特别在片源本身录制过程中使用单声道处理的时候尤为明显。可见,目前的播放技术存在立体声效果较差的问题。With the development and progress of technology, users have higher and higher requirements for terminals, and users are constantly pursuing the ultimate multimedia effect of terminals. Existing terminals generally perform playback tasks based on the left and right channel signals of existing signals. This may not match the user's habit in actual use, which will make the user's experience poor, especially when the monophonic processing is used in the recording process of the film source itself. It can be seen that the current playback technology has the problem of poor stereo effect.
发明内容Contents of the invention
本发明实施例提供一种音频播放的方法及终端,以解决目前的播放技术存在立体声效果较差的问题。Embodiments of the present invention provide an audio playing method and terminal to solve the problem of poor stereo effect in the current playing technology.
第一方面,本发明实施例提供了一种音频播放的方法,包括:In the first aspect, the embodiment of the present invention provides a method for audio playback, including:
识别与正在播放音频关联的目标对象;Identify the target object associated with the audio being played;
获取所述目标对象在终端屏幕中的坐标;Obtain the coordinates of the target object on the terminal screen;
根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器;Judging the target area of the target object in at least two pre-divided areas of the terminal screen according to the coordinates, wherein each area of the at least two areas is correspondingly provided with a speaker;
通过所述目标区域对应设置的扬声器播放所述正在播放音频。The audio being played is played through a speaker corresponding to the target area.
第二方面,本发明实施例还提供一种终端,包括:In a second aspect, an embodiment of the present invention further provides a terminal, including:
识别模块,用于识别与正在播放音频关联的目标对象;An identification module, configured to identify a target object associated with the audio being played;
获取模块,用于获取所述目标对象在终端屏幕中的坐标;An acquisition module, configured to acquire the coordinates of the target object on the terminal screen;
判断模块,用于根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器;A judging module, configured to judge the target area of the target object in the at least two pre-divided areas of the terminal screen according to the coordinates, wherein each of the at least two areas is correspondingly provided with a speaker;
播放模块,用于通过所述目标区域对应的扬声器播放所述正在播放音频。A playing module, configured to play the audio being played through a speaker corresponding to the target area.
这样,本发明实施例中,识别与正在播放音频关联的目标对象;获取所述目标对象在终端屏幕中的坐标;根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器;通过所述目标区域对应设置的扬声器播放所述正在播放音频。这样可以实现将不同区域的目标对象关联的正在播放音频,通过不同的扬声器播放,从而可以提高立体声效果。In this way, in the embodiment of the present invention, the target object associated with the audio being played is identified; the coordinates of the target object on the terminal screen are obtained; and at least two pre-divided parts of the target object on the terminal screen are judged according to the coordinates. A target area in the area, wherein each area in the at least two areas is correspondingly provided with a speaker; the audio being played is played through the speaker correspondingly provided in the target area. In this way, the playing audio associated with the target objects in different areas can be played through different speakers, thereby improving the stereo effect.
附图说明Description of drawings
为了更清楚地说明本发明实施例的技术方案,下面将对本发明实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments of the present invention. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.
图1是本发明第一实施例提供的一种音频播放方法的流程图;Fig. 1 is a flow chart of an audio playback method provided by the first embodiment of the present invention;
图2是本发明第二实施例提供的另一种音频播放方法的流程图;Fig. 2 is a flowchart of another audio playback method provided by the second embodiment of the present invention;
图3是本发明第三实施例提供的另一种音频播放方法的流程图;Fig. 3 is a flowchart of another audio playback method provided by the third embodiment of the present invention;
图4是本发明第四实施例提供的一种终端的结构图;FIG. 4 is a structural diagram of a terminal provided by a fourth embodiment of the present invention;
图5是本发明第五实施例提供的另一种终端的结构图。Fig. 5 is a structural diagram of another terminal provided by the fifth embodiment of the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
第一实施例first embodiment
参见图1,图1是本发明实施例提供的一种音频播放方法的流程图,如图1所示,包括以下步骤:Referring to Fig. 1, Fig. 1 is a flow chart of an audio playback method provided by an embodiment of the present invention, as shown in Fig. 1, comprising the following steps:
步骤101、识别与正在播放音频关联的目标对象。Step 101, identifying a target object associated with the audio being played.
上述识别与正在播放音频关联的目标对象,可以是识别与正在播放音频关联的人物图像或正在分屏使用的软件,即上述目标对象可以是人物图像或者正在分屏使用的软件。例如:在步骤101中,终端可以检测用户是否在播放视频,若检测出用户正在播放视频,则可以识别出正在播放的视频中的人物图像。或者,终端可以检测用户是否正在分屏使用多个软件。The identification of the target object associated with the audio being played may be identifying a character image associated with the audio being played or software being used in split screen, that is, the target object may be a character image or software being used in split screen. For example: in step 101, the terminal can detect whether the user is playing a video, and if it detects that the user is playing a video, it can recognize the image of a person in the video being played. Alternatively, the terminal can detect whether the user is using multiple software on a split screen.
步骤102、获取所述目标对象在终端屏幕中的坐标。Step 102, acquiring the coordinates of the target object on the terminal screen.
在该步骤中,上述获取所述目标对象在终端屏幕中的坐标,可以是获取人物图像或正在分屏使用的软件的软件窗口在终端屏幕中的坐标。例如:在上述步骤中,可以使用头像识别技术对视频中的人物图像在终端屏幕中所处的位置进行定位,获取所述视频中的人物图像的坐标。除此之外,也可以使用其他技术获取视频中的人物图像的坐标,只要能达到对视频中的人物图像进行定位的目的具体方式不限。或者,对正在分屏使用的软件的软件窗口在终端屏幕中所处的位置进行定位,获取正在分屏使用的软件的软件窗口在终端屏幕中的坐标。In this step, the acquisition of the coordinates of the target object on the terminal screen may be acquisition of the coordinates of a character image or a software window of a software being used in split screens on the terminal screen. For example: in the above steps, the avatar recognition technology may be used to locate the position of the character image in the video on the terminal screen, and obtain the coordinates of the character image in the video. In addition, other techniques may also be used to obtain the coordinates of the person images in the video, as long as the purpose of locating the person images in the video can be achieved, the specific method is not limited. Or, locate the position of the software window of the software being used in split screen on the terminal screen, and acquire the coordinates of the software window of the software being used in split screen on the terminal screen.
步骤103、根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器。Step 103 , judging target areas of the target object in at least two pre-divided areas of the terminal screen according to the coordinates, wherein each area of the at least two areas is correspondingly provided with a speaker.
在步骤103中,通过判断所述坐标所属的目标区域,可以为每一个人物图像或正在分屏使用的软件中的任一个选择对应的扬声器。In step 103, by judging the target area to which the coordinates belong, a corresponding speaker can be selected for each character image or any one of the software being used in split screen.
其中,上述预先划分的区域可以是将终端屏幕预先划分为第一区域和第二区域两个区域,此时可以根据获取的视频中的人物图像的坐标确定人物图像处于终端屏幕的第一区域还是第二区域,或者可以根据获取的正在分屏使用的多个软件的软件窗口的坐标确定每个软件窗口处于终端屏幕的第一区域还是第二区域。另外,第一区域可以对应终端的第一扬声器,第二区域可以对应所述终端的第二扬声器。则第一区域中的人物图像发出的声音可以由第一扬声器播放,第二区域中的人物图像发出的声音可以由第二扬声器播放。或者第一区域中的分屏使用的软件发出的声音可以由第一扬声器播放,第二区域中的分屏使用的软件发出的声音可以由第二扬声器播放,这样可以提升立体声效果。Wherein, the above-mentioned pre-divided area may be the terminal screen is pre-divided into two areas, the first area and the second area. At this time, it can be determined according to the coordinates of the character image in the acquired video whether the character image is in the first area of the terminal screen or not. The second area, or it may be determined whether each software window is in the first area or the second area of the terminal screen according to the acquired coordinates of the software windows of the multiple software being used in split screen. In addition, the first area may correspond to the first speaker of the terminal, and the second area may correspond to the second speaker of the terminal. Then the sound from the image of the person in the first area can be played by the first speaker, and the sound from the image of the person in the second area can be played by the second speaker. Or the sound from the software used by the split-screen in the first area can be played by the first speaker, and the sound from the software used by the split-screen in the second area can be played by the second speaker, which can improve the stereo effect.
或者,第一区域可以对应终端连接的音频播放装置的第一扬声器,其中所述音频播放装置的第一扬声器可以是音频播放装置的左声道扬声器。第二区域可以对应终端连接的音频播放装置的第二扬声器,其中所述音频播放装置的第二扬声器可以是音频播放装置的右声道扬声器。则第一区域中的人物图像发出的声音可以由终端连接的音频播放装置的第一扬声器播放,第二区域中的人物图像发出的声音可以由终端连接的音频播放装置的第二扬声器播放。或者第一区域中的分屏使用的软件发出的声音可以由终端连接的音频播放装置的第一扬声器播放,第二区域中的分屏使用的软件发出的声音可以由终端连接的音频播放装置的第二扬声器播放,这样可以提升立体声效果。Alternatively, the first area may correspond to a first speaker of an audio playback device connected to the terminal, where the first speaker of the audio playback device may be a left channel speaker of the audio playback device. The second area may correspond to the second speaker of the audio playback device connected to the terminal, where the second speaker of the audio playback device may be a right channel speaker of the audio playback device. Then the sound from the character image in the first area can be played by the first speaker of the audio playback device connected to the terminal, and the sound from the character image in the second area can be played by the second speaker of the audio playback device connected to the terminal. Or the sound from the software used by the split screen in the first area can be played by the first speaker of the audio playback device connected to the terminal, and the sound from the software used by the split screen in the second area can be played by the audio playback device connected to the terminal. The second speaker plays, which enhances the stereo effect.
或者,上述预先划分的区域也可以是将终端屏幕预先划分为三个区域,包括第一区域、第二区域和第三区域。此时可以根据获取的视频中的人物图像的坐标确定人物图像处于终端屏幕的第一区域、第二区域还是第三区域。或者可以根据获取的正在分屏使用的多个软件的软件窗口的坐标确定每个软件窗口处于终端屏幕的第一区域、第二区域还是第三区域。另外,第一区域可以对应终端的第一扬声器,第二区域可以对应所述终端的第一扬声器和第二扬声器,第三区域可以对应所述终端的第二扬声器。则第一区域中的人物图像发出的声音可以由第一扬声器播放,第二区域中的人物图像发出的声音可以由第一扬声器和第二扬声器同时播放,第三区域中的人物图像发出的声音可以由第二扬声器播放。或者第一区域中的分屏使用的软件发出的声音可以由第一扬声器播放,第二区域中的分屏使用的软件发出的声音可以由第一扬声器和第二扬声器同时播放,第三区域中的分屏使用的软件发出的声音可以由第二扬声器播放,这样可以提升立体声效果。Alternatively, the aforementioned pre-divided areas may also be pre-divided into three areas on the terminal screen, including a first area, a second area, and a third area. At this time, it may be determined according to the acquired coordinates of the character image in the video whether the character image is in the first area, the second area or the third area of the terminal screen. Or it may be determined whether each software window is located in the first area, the second area or the third area of the terminal screen according to the acquired coordinates of the software windows of the multiple software being used in split screen. In addition, the first area may correspond to the first speaker of the terminal, the second area may correspond to the first speaker and the second speaker of the terminal, and the third area may correspond to the second speaker of the terminal. Then the sound that the character image in the first area sends can be played by the first speaker, the sound that the character image in the second area sends can be played by the first speaker and the second speaker simultaneously, the sound that the character image in the third area sends Can be played from a second speaker. Or the sound from the software used by the split screen in the first area can be played by the first speaker, the sound from the software used by the split screen in the second area can be played by the first speaker and the second speaker simultaneously, and in the third area The sound from the software used by the split screen can be played by the second speaker, which can improve the stereo effect.
或者,第一区域可以对应终端连接的音频播放装置的第一扬声器,第二区域可以对应所述终端连接的音频播放装置的第一扬声器和第二扬声器,第三区域可以对应所述终端连接的音频播放装置的第二扬声器。则第一区域中的人物图像发出的声音可以由终端连接的音频播放装置的第一扬声器播放,第二区域中的人物图像发出的声音可以由终端连接的音频播放装置的第一扬声器和第二扬声器同时播放,第三区域中的人物图像发出的声音可以由终端连接的音频播放装置的第二扬声器播放。或者,第一区域中的分屏使用的软件发出的声音可以由终端连接的音频播放装置的第一扬声器播放,第二区域中的分屏使用的软件发出的声音可以由终端连接的音频播放装置的第一扬声器和第二扬声器同时播放,第三区域中的分屏使用的软件发出的声音可以由终端连接的音频播放装置的第二扬声器播放,这样可以提升立体声效果。Alternatively, the first area may correspond to the first speaker of the audio playback device connected to the terminal, the second area may correspond to the first speaker and the second speaker of the audio playback device connected to the terminal, and the third area may correspond to the audio playback device connected to the terminal. The second speaker of the audio playback device. Then the sound from the character image in the first area can be played by the first speaker of the audio playback device connected to the terminal, and the sound from the character image in the second area can be played by the first speaker and the second speaker of the audio playback device connected to the terminal. The speakers play at the same time, and the sound from the image of the person in the third area can be played by the second speaker of the audio playback device connected to the terminal. Alternatively, the sound from the software used by the split screen in the first area can be played by the first speaker of the audio playback device connected to the terminal, and the sound from the software used by the split screen in the second area can be played by the audio playback device connected to the terminal The first speaker and the second speaker of the terminal are played simultaneously, and the sound from the software used in the split screen in the third area can be played by the second speaker of the audio playback device connected to the terminal, which can improve the stereo effect.
步骤104、通过所述目标区域对应设置的扬声器播放所述正在播放音频。Step 104: Play the audio being played through a speaker corresponding to the target area.
在步骤104中,通过所述目标区域绑定的扬声器播放所述正在播放音频,可以提高立体声效果。其中,上述通过所述目标区域对应的扬声器播放所述正在播放音频,可以是确定了视频中的人物图像在终端屏幕上所处的区域后,利用与人物图像所处的区域对应的扬声器播放与人物图像关联的音频。或者,也可以是确定了正在分屏使用的多个软件的软件窗口各自在终端屏幕上所处的区域后,利用正在分屏使用的多个软件的软件窗口所处的区域对应的扬声器播放与分屏使用的软件关联的音频。In step 104, the audio being played is played through the speaker bound to the target area, which can improve the stereo effect. Wherein, the above-mentioned playing the audio being played through the speaker corresponding to the target area may be to determine the area where the character image in the video is located on the terminal screen, and then use the speaker corresponding to the area where the character image is located to play the audio that corresponds to the area where the character image is located. Audio associated with the person image. Or, after determining the respective areas of the software windows of the multiple software being used in split-screen on the terminal screen, the speakers corresponding to the areas where the software windows of the multiple software being used in split-screen are located are played. Software-associated audio for split-screen use.
本发明实施例中,上述终端可以是如下几种:手机、平板电脑(Tablet PersonalComputer)、膝上型电脑(Laptop Computer)、个人数字助理(personal digitalassistant,简称PDA)、移动上网装置(Mobile Internet Device,MID)或可穿戴式设备(Wearable Device)等。In the embodiment of the present invention, the above-mentioned terminal can be the following types: mobile phone, tablet computer (Tablet PersonalComputer), laptop computer (Laptop Computer), personal digital assistant (personal digital assistant, PDA for short), mobile Internet device (Mobile Internet Device) , MID) or wearable devices (Wearable Device), etc.
本发明实施例的音频播放方法,识别与正在播放音频关联的目标对象;获取所述目标对象在终端屏幕中的坐标;根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器;通过所述目标区域对应设置的扬声器播放所述正在播放音频。这样可以实现将不同区域的目标对象关联的正在播放音频,通过不同的扬声器播放,从而可以提高立体声效果。In the audio playing method of the embodiment of the present invention, the target object associated with the audio being played is identified; the coordinates of the target object on the terminal screen are obtained; and at least two pre-divided areas of the target object on the terminal screen are judged according to the coordinates. A target area in one area, wherein, each area in the at least two areas is correspondingly provided with a speaker; the audio being played is played through the speaker correspondingly provided in the target area. In this way, the playing audio associated with the target objects in different areas can be played through different speakers, thereby improving the stereo effect.
第二实施例second embodiment
参见图2,图2是本发明实施例提供的另一种音频播放方法的流程图,如图2所示,包括以下步骤:Referring to FIG. 2, FIG. 2 is a flowchart of another audio playback method provided by an embodiment of the present invention. As shown in FIG. 2, it includes the following steps:
步骤201、识别视频中与所述正在播放音频关联的人物图像,其中,所述正在播放音频为所述视频中的音频。Step 201. Identify a character image in the video that is associated with the audio being played, wherein the audio being played is the audio in the video.
在步骤201中,通过识别视频中与所述正在播放音频关联的人物图像,可以确定哪个人物图像在发出声音。在上述步骤中,可以是识别所述图像帧包括嘴巴有张合的动作的人物图像,并将所述人物图像作为与所述正在播放音频关联的人物图像。例如:在视频中有两个人物图像,分别为人物图像A和人物图像B。假如人物图像A在发出声音,人物图像B没有发出声音。此时利用头像识别技术可以识别出人物图像A的嘴巴有张合的动作,进而确定人物图像A在发出声音,而人物图像B的嘴巴没有张合的动作,可以确定人物图像B没有发出声音。然后可以播放与人物图像A关联的音频。In step 201, by identifying the character image associated with the playing audio in the video, it can be determined which character image is making the sound. In the above steps, it may be to identify that the image frame includes a character image with a mouth opening and closing movement, and use the character image as the character image associated with the audio being played. For example: there are two character images in the video, namely character image A and character image B. If the character image A is making a sound, the character image B is not making a sound. At this time, the avatar recognition technology can be used to identify the opening and closing of the mouth of the character image A, and then determine that the character image A is making a sound, but the mouth of the character image B does not open and close, and it can be determined that the character image B is not making a sound. The audio associated with person image A can then be played.
步骤202、获取所述人物图像在所述终端屏幕中的坐标。Step 202. Obtain the coordinates of the person image on the terminal screen.
在步骤202中,通过获取所述人物图像在所述终端屏幕中的坐标,可以确定所述人物图像在终端屏幕上的具体位置。例如:可以使用头像识别技术对视频中的人物图像在终端屏幕中所处的位置进行定位,获取所述视频中的人物图像的坐标。除此之外,也可以使用其他技术获取视频中的人物图像的坐标,只要能达到对视频中的人物图像进行定位的目的具体方式不限。In step 202, by acquiring the coordinates of the character image on the terminal screen, the specific position of the character image on the terminal screen can be determined. For example, the avatar recognition technology can be used to locate the position of the character image in the video on the terminal screen, and obtain the coordinates of the character image in the video. In addition, other techniques may also be used to obtain the coordinates of the person images in the video, as long as the purpose of locating the person images in the video can be achieved, the specific method is not limited.
步骤203、根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器。Step 203 , judging target areas of the target object in at least two pre-divided areas of the terminal screen according to the coordinates, wherein each area of the at least two areas is correspondingly provided with a speaker.
在步骤203中,通过根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,可以为每一个人物图像或正在分屏使用的软件中的任一个选择对应的扬声器。In step 203, by judging the target area of the target object in the at least two pre-divided areas of the terminal screen according to the coordinates, it can be selected for each character image or any one of the software being used in split screen corresponding speakers.
其中,上述预先划分的区域可以是将终端屏幕预先划分为第一区域和第二区域,此时可以根据获取的视频中的人物图像的坐标确定人物图像处于终端屏幕的第一区域还是第二区域。另外,第一区域可以对应终端的第一扬声器,第二区域可以对应所述终端的第二扬声器,这样可以提升立体声效果。Wherein, the above-mentioned pre-divided area may be to pre-divide the terminal screen into a first area and a second area. At this time, it may be determined according to the coordinates of the character image in the acquired video whether the character image is in the first area or the second area of the terminal screen. . In addition, the first area may correspond to the first speaker of the terminal, and the second area may correspond to the second speaker of the terminal, which can improve the stereo effect.
或者第一区域可以对应终端连接的音频播放装置的第一扬声器,第二区域可以对应终端连接的音频播放装置的第二扬声器,这样可以提升立体声效果。Or the first area may correspond to the first speaker of the audio playback device connected to the terminal, and the second area may correspond to the second speaker of the audio playback device connected to the terminal, which can improve the stereo effect.
或者,上述预先划分的区域也可以是将终端屏幕预先划分为第一区域、第二区域和第三区域。此时可以根据获取的视频中的人物图像的坐标确定人物图像处于终端屏幕的第一区域,第二区域还是第三区域。另外,第一区域可以对应终端的第一扬声器,第二区域可以对应所述终端的第一扬声器和第二扬声器,第三区域可以对应所述终端的第二扬声器。这样可以提升立体声效果。Alternatively, the aforementioned pre-divided areas may also be pre-divided terminal screens into a first area, a second area, and a third area. At this time, it may be determined according to the acquired coordinates of the person image in the video whether the person image is in the first area, the second area or the third area of the terminal screen. In addition, the first area may correspond to the first speaker of the terminal, the second area may correspond to the first speaker and the second speaker of the terminal, and the third area may correspond to the second speaker of the terminal. This improves the stereo effect.
或者第一区域可以对应终端连接的音频播放装置的第一扬声器,第二区域可以对应所述终端连接的音频播放装置的第一扬声器和第二扬声器,第三区域可以对应所述终端连接的音频播放装置的第二扬声器。这样可以提升立体声效果。Or the first area may correspond to the first speaker of the audio playback device connected to the terminal, the second area may correspond to the first speaker and the second speaker of the audio playback device connected to the terminal, and the third area may correspond to the audio playback device connected to the terminal. The second speaker of the playback device. This improves the stereo effect.
步骤204、通过所述目标区域对应设置的扬声器播放所述正在播放音频。Step 204: Play the audio being played through a speaker corresponding to the target area.
在步骤204中,通过所述目标区域对应的扬声器播放所述正在播放音频,可以提高立体声效果。其中,上述通过所述目标区域对应的扬声器播放所述正在播放音频,可以是确定了视频中的人物图像在终端屏幕上所处的区域后,利用与人物图像所处的区域对应的扬声器播放与人物图像关联的音频。In step 204, the audio being played is played through the speaker corresponding to the target area, which can improve the stereo effect. Wherein, the above-mentioned playing the audio being played through the speaker corresponding to the target area may be to determine the area where the character image in the video is located on the terminal screen, and then use the speaker corresponding to the area where the character image is located to play the audio that corresponds to the area where the character image is located. Audio associated with the person image.
另外,对于将终端屏幕等分为三个区域的情况,当视频中的人物图像处于第二区域时,用户可以对处于第二区域中的人物图像的声音进行适当的调整,以使整体听感更加均衡。例如:与处于第二区域的人物图像关联的音频是由两个扬声器同时播放的,可以对两个扬声器的声音大小进行调整。例如可以使其中一个扬声器的声音小一点,使另一个扬声器的声音大一点,直到调整到用户满意为止。In addition, for the case where the terminal screen is divided into three equal areas, when the character image in the video is in the second area, the user can properly adjust the sound of the character image in the second area so that the overall listening experience more balanced. For example: the audio associated with the image of the person in the second area is played by two speakers at the same time, and the volume of the sound of the two speakers can be adjusted. For example, the sound of one of the speakers can be made smaller, and the sound of the other speaker can be made louder, until the user is satisfied with the adjustment.
通过上述步骤201至步骤204,可以提高立体声效果。Through the above steps 201 to 204, the stereo effect can be improved.
第三实施例third embodiment
参见图3,图3是本发明实施例提供的另一种音频播放方法的流程图,如图3所示,包括以下步骤:Referring to FIG. 3, FIG. 3 is a flowchart of another audio playback method provided by an embodiment of the present invention. As shown in FIG. 3, it includes the following steps:
步骤301、识别输出所述正在播放音频的软件,所述软件是所述终端屏幕分屏使用的软件。Step 301. Identify the software that outputs the audio being played, and the software is the software used by the terminal screen split screen.
在该步骤中,通过识别输出所述正在播放音频的软件,可以确定正在分屏使用软件,则可以开启声音分配功能,即执行下面的步骤。其中,上述分屏使用的软件可以是任意可以发出声音的软件,例如:视频播放软件、游戏软件等等。另外本步骤中,不仅可以识别输出所述正在播放音频的软件的类型,还可以识别正在分屏使用的软件的个数。In this step, by identifying and outputting the software that is playing audio, it can be determined that the software is being used in split screens, and then the sound distribution function can be enabled, that is, the following steps are performed. Wherein, the above-mentioned software used in the split screen can be any software that can emit sound, for example: video playback software, game software and so on. In addition, in this step, not only the type of software outputting the audio being played can be identified, but also the number of software being used in split screen can be identified.
步骤302、获取所述软件的软件窗口在所述终端屏幕中的坐标。Step 302, acquiring the coordinates of the software window of the software on the terminal screen.
在步骤302中,通过获取所述软件的软件窗口在所述终端屏幕中的坐标,可以确定所述软件的软件窗口在终端屏幕中的相对位置。在本步骤中,可以对正在分屏使用的软件的软件窗口在终端屏幕中所处的位置进行定位。例如,软件窗口的轮廓为矩形,可以根据矩形的四个顶点确定所述软件窗口在终端屏幕中的坐标。In step 302, by acquiring the coordinates of the software window of the software on the terminal screen, the relative position of the software window of the software on the terminal screen can be determined. In this step, the position of the software window of the software being used in split screen on the terminal screen can be located. For example, the outline of the software window is a rectangle, and the coordinates of the software window on the terminal screen can be determined according to the four vertices of the rectangle.
步骤303、根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器。Step 303 , judging the target area of the target object in at least two pre-divided areas of the terminal screen according to the coordinates, wherein each area of the at least two areas is correspondingly provided with a speaker.
在步骤303中,通过根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,可以为正在分屏使用的软件中的任一个选择对应的扬声器。In step 303, by judging the target area of the target object in at least two pre-divided areas of the terminal screen according to the coordinates, a corresponding speaker can be selected for any of the software being used in split screen.
其中,上述预先划分的区域可以是将终端屏幕预先划分为第一区域和第二区域,此时可以根据获取的正在分屏使用的多个软件的软件窗口的坐标确定每个软件窗口处于终端屏幕的第一区域还是第二区域。另外,第一区域可以对应终端的第一扬声器,第二区域可以对应所述终端的第二扬声器,这样可以提升立体声效果。Wherein, the above-mentioned pre-divided area may be the terminal screen is pre-divided into a first area and a second area. At this time, it can be determined according to the obtained coordinates of the software windows of multiple softwares being used in split screens that each software window is located on the terminal screen. The first zone or the second zone. In addition, the first area may correspond to the first speaker of the terminal, and the second area may correspond to the second speaker of the terminal, which can improve the stereo effect.
或者第一区域可以对应终端连接的音频播放装置的第一扬声器,第二区域可以对应终端连接的音频播放装置的第二扬声器,这样可以提升立体声效果。Or the first area may correspond to the first speaker of the audio playback device connected to the terminal, and the second area may correspond to the second speaker of the audio playback device connected to the terminal, which can improve the stereo effect.
或者,上述预先划分的区域也可以是将终端屏幕预先划分为第一区域、第二区域和第三区域。此时可以根据获取的正在分屏使用的多个软件的软件窗口的坐标确定每个软件窗口处于终端屏幕的第一区域,第二区域还是第三区域。另外,第一区域可以对应终端的第一扬声器,第二区域可以对应所述终端的第一扬声器和第二扬声器,第三区域可以对应所述终端的第二扬声器。这样可以提升立体声效果。Alternatively, the aforementioned pre-divided areas may also be pre-divided terminal screens into a first area, a second area, and a third area. At this time, it can be determined whether each software window is located in the first area, the second area or the third area of the terminal screen according to the acquired coordinates of the software windows of the multiple software being used in split screen. In addition, the first area may correspond to the first speaker of the terminal, the second area may correspond to the first speaker and the second speaker of the terminal, and the third area may correspond to the second speaker of the terminal. This improves the stereo effect.
或者第一区域可以对应终端连接的音频播放装置的第一扬声器,第二区域可以对应所述终端连接的音频播放装置的第一扬声器和第二扬声器,第三区域可以对应所述终端连接的音频播放装置的第二扬声器。这样可以提升立体声效果。Or the first area may correspond to the first speaker of the audio playback device connected to the terminal, the second area may correspond to the first speaker and the second speaker of the audio playback device connected to the terminal, and the third area may correspond to the audio playback device connected to the terminal. The second speaker of the playback device. This improves the stereo effect.
步骤304、通过所述目标区域对应设置的扬声器播放所述正在播放音频。Step 304: Play the audio being played through a speaker corresponding to the target area.
在步骤304中,通过所述目标区域绑定的扬声器播放所述正在播放音频,可以提高立体声效果。其中,上述通过所述目标区域绑定的扬声器播放所述正在播放音频,可以是确定了正在分屏使用的多个软件的软件窗口各自在终端屏幕上所处的区域后,利用正在分屏使用的多个软件的软件窗口所处的区域对应的扬声器播放与分屏使用的软件关联的音频。In step 304, the audio being played is played through the speaker bound to the target area, which can improve the stereo effect. Wherein, the speaker bound to the target area above plays the playing audio, it may be after determining the respective areas of the software windows of the multiple software that are being used in split screen on the terminal screen, and using the software that is being used in split screen The speakers corresponding to the areas where the software windows of the multiple software are located play the audio associated with the software used in split-screen.
本实施例中,通过上述步骤301至步骤304,可以提高立体声效果。In this embodiment, through the above steps 301 to 304, the stereo effect can be improved.
第四实施例Fourth embodiment
参见图4,图4是本发明实施提供的一种终端的结构图,如图4所示,终端400包括识别模块401、获取模块402、判断模块403和播放模块404,其中:Referring to FIG. 4, FIG. 4 is a structural diagram of a terminal provided by the implementation of the present invention. As shown in FIG. 4, the terminal 400 includes an identification module 401, an acquisition module 402, a judgment module 403, and a playback module 404, wherein:
识别模块401,用于识别与正在播放音频关联的目标对象;An identification module 401, configured to identify a target object associated with the audio being played;
获取模块402,用于获取所述目标对象在终端屏幕中的坐标;An acquisition module 402, configured to acquire the coordinates of the target object on the terminal screen;
判断模块403,用于根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器;A judging module 403, configured to judge target areas of the target object in at least two pre-divided areas of the terminal screen according to the coordinates, wherein each of the at least two areas is correspondingly provided with a speaker ;
播放模块404,用于通过所述目标区域对应的扬声器播放所述正在播放音频。The playing module 404 is configured to play the audio being played through a speaker corresponding to the target area.
可选的,识别模块401用于识别视频中与所述正在播放音频关联的人物图像,其中,所述正在播放音频为所述视频中的音频;Optionally, the identification module 401 is configured to identify a character image associated with the audio being played in the video, wherein the audio being played is the audio in the video;
获取模块402用于获取所述人物图像在所述终端屏幕中的坐标。The acquiring module 402 is configured to acquire the coordinates of the character image on the terminal screen.
可选的,识别模块401用于识别输出所述正在播放音频的软件,所述软件是所述终端屏幕分屏使用的软件;Optionally, the identification module 401 is used to identify the software that outputs the audio being played, and the software is the software used by the terminal screen split screen;
获取模块402用于获取所述软件的软件窗口在所述终端屏幕中的坐标。The acquiring module 402 is configured to acquire the coordinates of the software window of the software on the terminal screen.
可选的,所述至少两个区域包括:Optionally, the at least two areas include:
所述终端屏幕被划分为第一区域和第二区域,且第一区域对应终端的第一扬声器,第二区域对应所述终端的第二扬声器;The terminal screen is divided into a first area and a second area, and the first area corresponds to a first speaker of the terminal, and the second area corresponds to a second speaker of the terminal;
或者所述终端屏幕被划分为第一区域和第二区域,且第一区域对应终端连接的音频播放装置的第一扬声器,第二区域对应终端连接的音频播放装置的第二扬声器。Or the terminal screen is divided into a first area and a second area, and the first area corresponds to the first speaker of the audio playback device connected to the terminal, and the second area corresponds to the second speaker of the audio playback device connected to the terminal.
可选的,所述至少两个区域包括:Optionally, the at least two areas include:
所述终端屏幕被划分为第一区域、第二区域和第三区域,且第一区域对应终端的第一扬声器,第二区域对应所述终端的第一扬声器和第二扬声器,第三区域对应所述终端的第二扬声器;The terminal screen is divided into a first area, a second area, and a third area, and the first area corresponds to the first speaker of the terminal, the second area corresponds to the first speaker and the second speaker of the terminal, and the third area corresponds to a second speaker of the terminal;
或者所述终端屏幕被划分为第一区域、第二区域和第三区域,且第一区域对应终端连接的音频播放装置的第一扬声器,第二区域对应所述终端连接的音频播放装置的第一扬声器和第二扬声器,第三区域对应所述终端连接的音频播放装置的第二扬声器。Or the terminal screen is divided into a first area, a second area and a third area, and the first area corresponds to the first speaker of the audio playback device connected to the terminal, and the second area corresponds to the first speaker of the audio playback device connected to the terminal. A speaker and a second speaker, the third area corresponds to the second speaker of the audio playback device connected to the terminal.
可选的,所述识别模块401用于识别视频中与所述正在播放音频关联的图像帧,识别所述图像帧包括嘴巴有张合的动作的人物图像,并将所述人物图像作为与所述正在播放音频关联的人物图像。Optionally, the identification module 401 is configured to identify the image frame associated with the audio being played in the video, identify that the image frame includes a character image with a mouth opening and closing, and use the character image as the Describes the image of the person associated with the audio being played.
或者,在所述视频中的当前播放图像帧只有一个人物图像时,所述识别模块401用于将所述人物图像作为与所述正在播放音频关联的人物图像。Alternatively, when the currently playing image frame in the video has only one character image, the identification module 401 is configured to use the character image as the character image associated with the audio being played.
终端400能够实现图1至图3的方法实施例中终端实现的各个过程,为避免重复,这里不再赘述。且终端400可以达到提高立体声效果的技术效果。The terminal 400 can implement various processes implemented by the terminal in the method embodiments shown in FIG. 1 to FIG. 3 , and details are not repeated here to avoid repetition. And the terminal 400 can achieve the technical effect of improving the stereo effect.
第五实施例fifth embodiment
参见图5,图5是本发明实施提供的另一种终端的结构图,如图5所示,终端500包括:至少一个处理器501、存储器502、至少一个网络接口504和用户接口503。终端500中的各个组件通过总线系统505耦合在一起。可理解,总线系统505用于实现这些组件之间的连接通信。总线系统505除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图5中将各种总线都标为总线系统505。Referring to FIG. 5, FIG. 5 is a structural diagram of another terminal provided by the present invention. As shown in FIG. Various components in the terminal 500 are coupled together through a bus system 505 . It can be understood that the bus system 505 is used to realize connection and communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as bus system 505 in FIG. 5 .
其中,用户接口503可以包括显示器、键盘或者点击设备(例如,鼠标,轨迹球(trackball)、触感板或者触摸屏等。Wherein, the user interface 503 may include a display, a keyboard, or a pointing device (for example, a mouse, a trackball (trackball), a touch panel, or a touch screen, and the like.
可以理解,本发明实施例中的存储器502可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read-OnlyMemory,ROM)、可编程只读存储器(ProgrammableROM,PROM)、可擦除可编程只读存储器(ErasablePROM,EPROM)、电可擦除可编程只读存储器(ElectricallyEPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(RandomAccessMemory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(StaticRAM,SRAM)、动态随机存取存储器(DynamicRAM,DRAM)、同步动态随机存取存储器(SynchronousDRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(DoubleDataRateSDRAM,DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(SynchlinkDRAM,SLDRAM)和直接内存总线随机存取存储器(DirectRambusRAM,DRRAM)。本文描述的系统和方法的存储器502旨在包括但不限于这些和任意其它适合类型的存储器。It can be understood that the memory 502 in the embodiment of the present invention may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Among them, the non-volatile memory can be read-only memory (Read-OnlyMemory, ROM), programmable read-only memory (ProgrammableROM, PROM), erasable programmable read-only memory (ErasablePROM, EPROM), electrically erasable Programming read-only memory (Electrically EPROM, EEPROM) or flash memory. The volatile memory may be random access memory (Random Access Memory, RAM), which acts as an external cache. By way of illustration and not limitation, many forms of RAM are available such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (Synchronous DRAM, SDRAM), Double data rate synchronous dynamic random access memory (DoubleDataRateSDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct memory bus random access Memory (Direct Rambus RAM, DRRAM). Memory 502 of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
在一些实施方式中,存储器502存储了如下的元素,可执行模块或者数据结构,或者他们的子集,或者他们的扩展集:操作系统5021和应用程序5022。In some implementations, the memory 502 stores the following elements, executable modules or data structures, or their subsets, or their extended sets: an operating system 5021 and an application program 5022 .
其中,操作系统5021,包含各种系统程序,例如框架层、核心库层、驱动层等,用于实现各种基础业务以及处理基于硬件的任务。应用程序5022,包含各种应用程序,例如媒体播放器(MediaPlayer)、浏览器(Browser)等,用于实现各种应用业务。实现本发明实施例方法的程序可以包含在应用程序5022中。Among them, the operating system 5021 includes various system programs, such as framework layer, core library layer, driver layer, etc., for realizing various basic services and processing tasks based on hardware. The application program 5022 includes various application programs, such as a media player (MediaPlayer), a browser (Browser), etc., and is used to implement various application services. The program for realizing the method of the embodiment of the present invention may be included in the application program 5022 .
在本发明实施例中,通过调用存储器502存储的程序或指令,具体的,可以是应用程序5022中存储的程序或指令,处理器501用于:In the embodiment of the present invention, by calling the program or instruction stored in the memory 502, specifically, the program or instruction stored in the application program 5022, the processor 501 is used to:
识别与正在播放音频关联的目标对象;Identify the target object associated with the audio being played;
获取所述目标对象在终端屏幕中的坐标;Obtain the coordinates of the target object on the terminal screen;
根据所述坐标判断所述目标对象在所述终端屏幕预先划分的至少两个区域中的目标区域,其中,所述至少两个区域中的每个区域均对应设置有扬声器;Judging the target area of the target object in at least two pre-divided areas of the terminal screen according to the coordinates, wherein each area of the at least two areas is correspondingly provided with a speaker;
通过所述目标区域对应设置的扬声器播放所述正在播放音频。The audio being played is played through a speaker corresponding to the target area.
上述本发明实施例揭示的方法可以应用于处理器501中,或者由处理器501实现。处理器501可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器501中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器501可以是通用处理器、数字信号处理器(DigitalSignalProcessor,DSP)、专用集成电路(ApplicationSpecific IntegratedCircuit,ASIC)、现成可编程门阵列(FieldProgrammableGateArray,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本发明实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器502,处理器501读取存储器502中的信息,结合其硬件完成上述方法的步骤。The methods disclosed in the foregoing embodiments of the present invention may be applied to the processor 501 or implemented by the processor 501 . The processor 501 may be an integrated circuit chip and has signal processing capability. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 501 or instructions in the form of software. The above-mentioned processor 501 may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates Or transistor logic devices, discrete hardware components. Various methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like. The steps of the methods disclosed in the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502, and completes the steps of the above method in combination with its hardware.
可以理解的是,本文描述的这些实施例可以用硬件、软件、固件、中间件、微码或其组合来实现。对于硬件实现,处理单元可以实现在一个或多个专用集成电路(ApplicationSpecificIntegratedCircuits,ASIC)、数字信号处理器(DigitalSignalProcessing,DSP)、数字信号处理设备(DSPDevice,DSPD)、可编程逻辑设备(ProgrammableLogicDevice,PLD)、现场可编程门阵列(Field-ProgrammableGateArray,FPGA)、通用处理器、控制器、微控制器、微处理器、用于执行本申请所述功能的其它电子单元或其组合中。It should be understood that the embodiments described herein may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application-specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing device (DSPDevice, DSPD), programmable logic device (ProgrammableLogicDevice, PLD ), Field-Programmable Gate Array (Field-Programmable GateArray, FPGA), general-purpose processor, controller, microcontroller, microprocessor, other electronic units for performing the functions described in this application, or a combination thereof.
对于软件实现,可通过执行本文所述功能的模块(例如过程、函数等)来实现本文所述的技术。软件代码可存储在存储器中并通过处理器执行。存储器可以在处理器中或在处理器外部实现。For a software implementation, the techniques described herein can be implemented through modules (eg, procedures, functions, and so on) that perform the functions described herein. Software codes can be stored in memory and executed by a processor. Memory can be implemented within the processor or external to the processor.
可选的,上述识别与正在播放音频关联的目标对象,包括:Optionally, the identification of the target object associated with the audio being played includes:
识别视频中与所述正在播放音频关联的人物图像,其中,所述正在播放音频为所述视频中的音频;identifying images of people in the video associated with the audio being played, wherein the audio being played is the audio in the video;
上述获取所述目标对象在终端屏幕中的坐标,包括:The above acquisition of the coordinates of the target object on the terminal screen includes:
获取所述人物图像在所述终端屏幕中的坐标。The coordinates of the character image on the terminal screen are acquired.
可选的,上述识别与正在播放音频关联的目标对象,包括:Optionally, the identification of the target object associated with the audio being played includes:
识别输出所述正在播放音频的软件,所述软件是所述终端屏幕分屏使用的软件;Identify and output the software that is playing the audio, and the software is the software used by the terminal screen split screen;
上述获取所述目标对象在终端屏幕中的坐标,包括:The above acquisition of the coordinates of the target object on the terminal screen includes:
获取所述软件的软件窗口在所述终端屏幕中的坐标。The coordinates of the software window of the software on the terminal screen are acquired.
可选的,上述至少两个区域,包括:Optionally, at least two of the above areas, including:
所述终端屏幕被划分为第一区域和第二区域,且第一区域对应终端的第一扬声器,第二区域对应所述终端的第二扬声器;The terminal screen is divided into a first area and a second area, and the first area corresponds to a first speaker of the terminal, and the second area corresponds to a second speaker of the terminal;
或者所述终端屏幕被划分为第一区域和第二区域,且第一区域对应终端连接的音频播放装置的第一扬声器,第二区域对应终端连接的音频播放装置的第二扬声器。Or the terminal screen is divided into a first area and a second area, and the first area corresponds to the first speaker of the audio playback device connected to the terminal, and the second area corresponds to the second speaker of the audio playback device connected to the terminal.
可选的,上述至少两个区域,包括:Optionally, at least two of the above areas, including:
所述终端屏幕被划分为第一区域、第二区域和第三区域,且第一区域对应终端的第一扬声器,第二区域对应所述终端的第一扬声器和第二扬声器,第三区域对应所述终端的第二扬声器;The terminal screen is divided into a first area, a second area, and a third area, and the first area corresponds to the first speaker of the terminal, the second area corresponds to the first speaker and the second speaker of the terminal, and the third area corresponds to a second speaker of the terminal;
或者所述终端屏幕被划分为第一区域、第二区域和第三区域,且第一区域对应终端连接的音频播放装置的第一扬声器,第二区域对应所述终端连接的音频播放装置的第一扬声器和第二扬声器,第三区域对应所述终端连接的音频播放装置的第二扬声器。Or the terminal screen is divided into a first area, a second area and a third area, and the first area corresponds to the first speaker of the audio playback device connected to the terminal, and the second area corresponds to the first speaker of the audio playback device connected to the terminal. A speaker and a second speaker, the third area corresponds to the second speaker of the audio playback device connected to the terminal.
可选的,上述识别视频中与所述正在播放音频关联的人物图像,包括:Optionally, the above identification of the character image associated with the playing audio in the video includes:
识别视频中与所述正在播放音频关联的图像帧,识别所述图像帧包括嘴巴有张合的动作的人物图像,并将所述人物图像作为与所述正在播放音频关联的人物图像;Recognizing the image frame associated with the audio being played in the video, identifying that the image frame includes a character image with a mouth opening and closing, and using the character image as the character image associated with the audio being played;
或者在所述视频中的当前播放图像帧只有一个人物图像时,将所述人物图像作为与所述正在播放音频关联的人物图像。Or when there is only one character image in the currently playing image frame of the video, the character image is used as the character image associated with the playing audio.
终端500能够实现前述实施例中终端实现的各个过程,为避免重复,这里不再赘述。且终端500可以达到提高立体声效果的技术效果。The terminal 500 can implement various processes implemented by the terminal in the foregoing embodiments, and details are not described here to avoid repetition. And the terminal 500 can achieve the technical effect of improving the stereo effect.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
在本申请所提供的实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本发明实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。If the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media capable of storing program codes such as U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk.
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以权利要求的保护范围为准。The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.
Claims (12)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610485673.XA CN106162447A (en) | 2016-06-24 | 2016-06-24 | The method of a kind of audio frequency broadcasting and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610485673.XA CN106162447A (en) | 2016-06-24 | 2016-06-24 | The method of a kind of audio frequency broadcasting and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106162447A true CN106162447A (en) | 2016-11-23 |
Family
ID=57350118
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610485673.XA Pending CN106162447A (en) | 2016-06-24 | 2016-06-24 | The method of a kind of audio frequency broadcasting and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106162447A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106598457A (en) * | 2016-11-30 | 2017-04-26 | 努比亚技术有限公司 | Sound playing control method and device and terminal |
| CN106686211A (en) * | 2016-11-30 | 2017-05-17 | 努比亚技术有限公司 | Processing method and terminal for sound playing in split screen mode |
| CN107885430A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | A kind of audio frequency playing method, device, storage medium and electronic equipment |
| CN108551636A (en) * | 2018-05-29 | 2018-09-18 | 维沃移动通信有限公司 | A speaker control method and mobile terminal |
| CN109246545A (en) * | 2018-09-04 | 2019-01-18 | 福建星网智慧科技股份有限公司 | A kind of double screen audio-frequency inputting method |
| CN109413563A (en) * | 2018-10-25 | 2019-03-01 | Oppo广东移动通信有限公司 | Video sound effect processing method and related products |
| CN112911354A (en) * | 2019-12-03 | 2021-06-04 | 海信视像科技股份有限公司 | Display apparatus and sound control method |
| CN113724628A (en) * | 2020-05-25 | 2021-11-30 | 苏州佳世达电通有限公司 | Audio-visual system |
| WO2022001204A1 (en) * | 2020-06-29 | 2022-01-06 | 海信视像科技股份有限公司 | Display device and screen sound production method |
| CN114793315A (en) * | 2022-04-11 | 2022-07-26 | 浙江极氪智能科技有限公司 | Speaker partition control method, audio partition playback method and vehicle |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1984310A (en) * | 2005-11-08 | 2007-06-20 | Tcl通讯科技控股有限公司 | Method and communication device for reproducing moving images and use in video conferencing system |
| CN101009792A (en) * | 2005-10-17 | 2007-08-01 | 索尼株式会社 | Image display device, method and program |
| CN101978689A (en) * | 2008-03-20 | 2011-02-16 | 朴胜敏 | Display device with object-oriented stereo sound coordinate display |
| CN103858447A (en) * | 2011-07-29 | 2014-06-11 | 三星电子株式会社 | Method and apparatus for processing audio signal |
| CN104995681A (en) * | 2013-02-15 | 2015-10-21 | 高通股份有限公司 | Video analysis assisted generation of multi-channel audio data |
| US20160165337A1 (en) * | 2014-12-08 | 2016-06-09 | Harman International Industries, Inc. | Adjusting speakers using facial recognition |
-
2016
- 2016-06-24 CN CN201610485673.XA patent/CN106162447A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009792A (en) * | 2005-10-17 | 2007-08-01 | 索尼株式会社 | Image display device, method and program |
| CN1984310A (en) * | 2005-11-08 | 2007-06-20 | Tcl通讯科技控股有限公司 | Method and communication device for reproducing moving images and use in video conferencing system |
| CN101978689A (en) * | 2008-03-20 | 2011-02-16 | 朴胜敏 | Display device with object-oriented stereo sound coordinate display |
| CN103858447A (en) * | 2011-07-29 | 2014-06-11 | 三星电子株式会社 | Method and apparatus for processing audio signal |
| CN104995681A (en) * | 2013-02-15 | 2015-10-21 | 高通股份有限公司 | Video analysis assisted generation of multi-channel audio data |
| US20160165337A1 (en) * | 2014-12-08 | 2016-06-09 | Harman International Industries, Inc. | Adjusting speakers using facial recognition |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106686211A (en) * | 2016-11-30 | 2017-05-17 | 努比亚技术有限公司 | Processing method and terminal for sound playing in split screen mode |
| CN106598457B (en) * | 2016-11-30 | 2019-10-25 | 努比亚技术有限公司 | A kind of sound control method for playing back, device and terminal |
| CN106598457A (en) * | 2016-11-30 | 2017-04-26 | 努比亚技术有限公司 | Sound playing control method and device and terminal |
| CN107885430B (en) * | 2017-11-07 | 2020-07-24 | Oppo广东移动通信有限公司 | Audio playing method and device, storage medium and electronic equipment |
| CN107885430A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | A kind of audio frequency playing method, device, storage medium and electronic equipment |
| CN108551636A (en) * | 2018-05-29 | 2018-09-18 | 维沃移动通信有限公司 | A speaker control method and mobile terminal |
| US11496835B2 (en) | 2018-05-29 | 2022-11-08 | Vivo Mobile Communication Co., Ltd. | Speaker control method and mobile terminal |
| WO2019228163A1 (en) * | 2018-05-29 | 2019-12-05 | 维沃移动通信有限公司 | Speaker control method and mobile terminal |
| CN109246545A (en) * | 2018-09-04 | 2019-01-18 | 福建星网智慧科技股份有限公司 | A kind of double screen audio-frequency inputting method |
| WO2020082902A1 (en) * | 2018-10-25 | 2020-04-30 | Oppo广东移动通信有限公司 | Sound effect processing method for video, and related products |
| CN109413563A (en) * | 2018-10-25 | 2019-03-01 | Oppo广东移动通信有限公司 | Video sound effect processing method and related products |
| CN112911354A (en) * | 2019-12-03 | 2021-06-04 | 海信视像科技股份有限公司 | Display apparatus and sound control method |
| CN113724628A (en) * | 2020-05-25 | 2021-11-30 | 苏州佳世达电通有限公司 | Audio-visual system |
| WO2022001204A1 (en) * | 2020-06-29 | 2022-01-06 | 海信视像科技股份有限公司 | Display device and screen sound production method |
| CN114793315A (en) * | 2022-04-11 | 2022-07-26 | 浙江极氪智能科技有限公司 | Speaker partition control method, audio partition playback method and vehicle |
| CN114793315B (en) * | 2022-04-11 | 2025-08-05 | 浙江极氪智能科技有限公司 | Speaker partition control method, audio partition playback method and vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106162447A (en) | The method of a kind of audio frequency broadcasting and terminal | |
| JP6039111B2 (en) | Video analysis support generation of multi-channel audio data | |
| CN106201430A (en) | Method and electronic device for adjusting volume | |
| CN113014983B (en) | Video playing method and device, storage medium and electronic equipment | |
| US20220248083A1 (en) | Method and apparatus for video playing | |
| US10834503B2 (en) | Recording method, recording play method, apparatuses, and terminals | |
| CN105228050B (en) | The method of adjustment and device of earphone sound quality in terminal | |
| US20160065791A1 (en) | Sound image play method and apparatus | |
| CN106651955A (en) | Method and device for positioning object in picture | |
| CN107087072A (en) | A kind of audio playing method and mobile terminal | |
| CN107682622A (en) | A kind of image pickup method and mobile terminal | |
| US9558761B2 (en) | Causation of rendering of song audio information based upon distance from a sound source | |
| CN107623776A (en) | A volume control method, system and mobile terminal | |
| CN106412282B (en) | A real-time message voice prompt method and mobile terminal | |
| US9986362B2 (en) | Information processing method and electronic device | |
| CN107483735A (en) | Volume control method, device and storage medium of mobile terminal and mobile terminal | |
| CN106027933A (en) | Video recording method, video playing method and mobile terminal | |
| CN105824557A (en) | Method for playing voice information and mobile terminal | |
| CN117037835A (en) | Audio data processing method, electronic device and medium | |
| CN113853529A (en) | Apparatus, and associated method, for spatial audio capture | |
| CN106357509B (en) | The method and mobile terminal that a kind of pair of message received is checked | |
| CN106648496A (en) | Electronic device and method for controlling display thereof | |
| WO2022017006A1 (en) | Video processing method and apparatus, and terminal device and computer-readable storage medium | |
| CN106131472A (en) | A kind of kinescope method and mobile terminal | |
| US11600300B2 (en) | Method and device for generating dynamic image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161123 |
|
| RJ01 | Rejection of invention patent application after publication |