CN111654622B - Shooting focusing method and device, electronic equipment and storage medium - Google Patents

Abstract

The application discloses a shooting focusing method and device, electronic equipment and a storage medium, and belongs to the field of electronic equipment. The method comprises the following steps: under the condition that a shooting preview interface is displayed, acquiring a first video including a target shooting object, wherein the first video is formed by a plurality of frames of historical preview pictures displayed on the shooting preview interface within a first preset time period; amplifying expression actions of a target shooting object in the first video to obtain a second video; identifying an expression area of a target shooting object in a second video; focusing the expression area on the shooting preview interface. By utilizing the embodiment of the application, the accuracy of the focusing area can be ensured, and the user does not need to manually operate the focusing, so that the user can conveniently shoot.

Description

Shooting focusing method, device, electronic device and storage medium

technical field

The present application belongs to the field of electronic equipment, and in particular relates to a shooting and focusing method, device, electronic equipment and storage medium.

Background technique

With the development of shooting technology, there are many ways to achieve shooting focus. One way is that the user's finger touches a certain area of the shooting preview interface to focus on the area. Another way is to use artificial intelligence technology to identify the target shooting subject on the shooting preview interface, and focus on the target shooting subject.

However, for the method of focusing by touching a finger, accurate focusing can be achieved, but manual operation by the user is required, which is very inconvenient for the user. As for the way of focusing on the recognized target subject, although the user does not need manual operation, in some cases, the focusing area is not very accurate. For example, focus on people who have randomly entered the shooting preview interface.

SUMMARY OF THE INVENTION

The purpose of the embodiments of the present application is to provide a photographing focusing method, device, electronic device and storage medium, which can solve the problems that the user needs to manually operate the focusing and the accuracy of the focusing area is not high.

In order to solve the above technical problems, this application is implemented as follows:

In a first aspect, an embodiment of the present application provides a method for shooting and focusing, including:

In the case of displaying the shooting preview interface, acquiring a first video including the target shooting object, where the first video is formed by multiple frames of historical preview images displayed on the shooting preview interface within a first predetermined period of time;

Enlarging the facial expressions of the target shooting object in the first video to obtain a second video;

Identifying the facial expression area of the target shooting object in the second video;

Focusing on the expression area on the shooting preview interface.

In a second aspect, an embodiment of the present application provides a photographing focusing device, including:

A video acquisition module, configured to acquire a first video including a target shooting object when the shooting preview interface is displayed, and the first video is composed of multiple frames of historical preview images displayed on the shooting preview interface within a first predetermined period of time form;

an amplification processing module, configured to perform amplification processing on the facial expressions of the target shooting object in the first video to obtain a second video;

an expression area identification module for identifying the expression area of the target shooting object in the second video;

An area focusing module, configured to focus on the expression area on the shooting preview interface.

In a third aspect, embodiments of the present application provide an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction being The processor implements the steps of the method according to the first aspect when executed.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the method according to the first aspect are implemented .

In a fifth aspect, an embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction, and implement the first aspect the method described.

In the embodiment of the present application, in the case where the shooting preview interface is displayed, a first video formed by multiple frames of historical preview images is acquired. Then, the facial expressions of the target shooting object in the first video are enlarged to obtain a second video. Then, the facial expression area of the target shooting object in the second video is identified, and the facial expression area on the photographing preview interface is focused. Since the facial expressions in the first video are enlarged, the inconspicuous facial expressions in the first video become more obvious, so that the facial expression area of the target object can be more accurately identified. Then, focusing based on the expression area can ensure the accuracy of the focusing area. In addition, the embodiment of the present application can automatically focus, and does not require the user to manually operate the focus, thereby facilitating the user to shoot.

Description of drawings

1 is a schematic flowchart of a method for shooting and focusing according to an embodiment of the present application;

FIG. 2 is a schematic flowchart of a photographing and focusing method according to another embodiment of the present application;

3 is a schematic diagram of a shooting preview interface including multiple facial expressions according to an embodiment provided by the present application;

4 is a schematic diagram of a shooting preview interface including a sensitivity adjustment control according to an embodiment provided by the present application;

5 is a schematic structural diagram of a photographing focusing device according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The terms "first", "second" and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that embodiments of the application can be practiced in sequences other than those illustrated or described herein. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the associated objects are in an "or" relationship.

The following describes the shooting focusing method provided by the embodiments of the present application in detail through specific embodiments and application scenarios with reference to the accompanying drawings.

FIG. 1 is a schematic flowchart of a photographing focusing method according to an embodiment of the present application. The shooting focusing method can be applied to a shooting focusing device. As shown in FIG. 1 , the shooting focusing method includes:

Step 102 , when the shooting preview interface is displayed, acquire a first video including the target shooting object, and the first video is formed by multiple frames of historical preview images displayed on the shooting preview interface within a first predetermined period of time.

It should be noted that, during the period when the shooting preview interface is displayed, the preview image displayed on the shooting preview interface is cached. Thereby, multiple frames of historical preview images displayed on the shooting preview interface within the first predetermined period of time can be acquired from the cached preview images, and then the first video is formed.

For example, when the shooting preview interface is displayed, the multi-frame historical preview images displayed on the shooting preview interface in the last 5 seconds are obtained from the cached preview image.

Step 104: Enlarging the facial expressions of the target shooting object in the first video to obtain a second video.

Step 106: Identify the facial expression area of the target shooting object in the second video.

Optionally, identifying the facial expression area of the target shooting object in the second video may include: extracting multiple areas in the second video, and inputting each extracted area into a pre-trained deep learning model to obtain extraction. Whether each area of is an expression area.

Optionally, identifying the facial expression area of the target shooting object in the second video may include: extracting multiple areas in the second video; performing similarity matching between each extracted area and a pre-stored facial expression image to Get whether each extracted area is an expression area.

Step 108, focus on the expression area on the shooting preview interface.

For example, the expression area in the second video is a screenshot of a smile expression action on a certain frame of the second video. Identify the facial expression area on the shooting preview interface that matches the screenshot, and then focus on the facial expression area that matches the screenshot on the photographing preview interface.

In the embodiment of the present application, in the case where the shooting preview interface is displayed, a first video formed by multiple frames of historical preview images is acquired. Then, the facial expressions of the target shooting object in the first video are enlarged to obtain a second video. Then, the facial expression area of the target shooting object in the second video is identified, and the facial expression area on the photographing preview interface is focused. Since the facial expressions in the first video are enlarged, the inconspicuous facial expressions in the first video become more obvious, so that the facial expression area of the target object can be more accurately identified. Then, focusing based on the expression area can ensure the accuracy of the focusing area. In addition, through the embodiments of the present application, the user can focus on the user by making an expression action, and the user does not need to manually operate the focus, thereby facilitating the user to shoot.

In one or more embodiments of the present application, step 104 may include:

Using the target filter, the signal of the first video is filtered to obtain the first signal related to the facial expression of the first video;

According to the target amplification factor, amplify the first signal to obtain the target signal;

Based on the target signal, a second video is generated.

Optionally, before using the target filter to filter the signal of the first video to obtain the first signal related to the facial expression of the first video, use the sample data including the facial expression to first use the sample data of the European-style video enlargement. The filter is trained to obtain the target filter for amplifying the facial expression. The target filter can be used directly after starting the camera. Optionally, the target filter can be trained once, and after the training is completed, the target filter can be directly used for filtering, and then there is no need to retrain.

Optionally, the target magnification may be a preset magnification or a magnification set by the user.

In this embodiment of the present application, the European-style video magnification technology may be used to perform magnification processing on facial expressions. Specifically, by first filtering the signal of the first video by using the target filter, the first signal related to the facial expression can be obtained, and the second signal not related to the facial expression can be filtered out. Then, amplify the first signal related to the facial expression according to the target magnification, so as to obtain an amplified target signal of the facial expression. Then, a second video is generated according to the amplified target signal of the facial expression. Compared with the first video, the facial expressions of the target photographing subject in the second video are more obvious, and thus, the facial expression area of the target photographing subject can be more accurately identified by using the second video.

In one or more embodiments of the present application, before using the target filter to filter the signal of the first video to obtain the first signal related to the facial expression of the first video, the method for shooting and focusing further includes:

converting the time domain signal of the first video into frequency domain signals of multiple frequency bands;

Wherein, using the target filter, the signal of the first video is filtered to obtain the first signal related to the facial expression of the first video, including:

Using the target filter, the frequency domain signal is filtered to obtain the first signal related to the facial expression in the frequency domain signal;

According to the target signal, a second video is generated, including:

The target signal and the second signal are converted from frequency domain to time domain to obtain a second video.

Optionally, generating the second video according to the target signal may include: generating the second video according to the target signal and a second signal unrelated to expressions and actions.

Generating the second video according to the target signal and the second signal irrelevant to the expression action may specifically include: converting the target signal and the second signal irrelevant to the expression action filtered out during the filtering from frequency domain to time domain, to obtain Second video.

The following describes the shooting focusing method of the embodiment of the present application by using a specific example. The photographing focusing method is applied to a photographing focusing device. As shown in Figure 2, the shooting focusing method includes:

Step 202 , when the shooting preview interface is displayed, acquire a first video including the target shooting object, and the first video is formed by multiple frames of historical preview images displayed on the shooting preview interface within a first predetermined period of time.

Step 204: Convert the time domain signal of the first video into frequency domain signals of multiple frequency bands.

Step 206 , using the target filter to filter the frequency domain signal to obtain a first signal related to the facial expression and a second signal irrelevant to the facial expression in the frequency domain signal.

Step 208: Amplify the first signal according to the target amplification factor to obtain the target signal.

Step 210: Convert the target signal from the frequency domain to the time domain to obtain a second video.

Step 212, identifying the facial expression area of the target shooting object in the second video.

Step 214, focus on the expression area on the shooting preview interface.

It should be noted that step 202 in the embodiment of the present application is similar to step 102 in the embodiment of FIG. 1 , step 212 in the embodiment of the present application is similar to step 106 in the embodiment of FIG. 1 , and the steps in the embodiment of the present application Step 214 is similar to step 108 in the embodiment of FIG. 1 , and details are not repeated here. The following mainly describes steps 204 to 210 in the embodiments of the present application.

In step 204 in this embodiment of the present application, a fast Fourier transform may be used to convert the time domain signal of the first video into frequency domain signals of multiple frequency bands.

It should be noted that the time domain describes the relationship of mathematical functions or physical signals to time. For example, the time domain waveform of a signal can express the change of the signal over time. If discrete time is considered, a function or signal in the time domain has known values at each discrete time point. If continuous time is considered, the value of a function or signal at any time is known. When studying time-domain signals, an oscilloscope is often used to convert the signal to its time-domain waveform. The time domain signal is the waveform data of a certain frequency wave with the time axis as the x-axis and the amplitude as the y-axis.

The time domain signal of the video is a digital signal obtained by encoding the analog signal of the video, and the digital signal is waveform data in the direction of the time axis. Among them, the analog signal of the video is the real image signal obtained for each frame of image.

The frequency domain is a coordinate system used to describe the characteristics of a signal in terms of frequency. The independent variable in the frequency domain is the frequency, that is, the horizontal axis is the frequency, and the vertical axis is the amplitude of the frequency signal, which is commonly referred to as a spectrogram. A spectrogram describes the frequency structure of a signal and the relationship between frequency and signal amplitude at that frequency. That is, the frequency signal is spectral data at a certain time with the frequency on the x-axis and the amplitude on the y-axis.

In step 206 of the embodiment of the present application, the target filter is used to filter the frequency domain signal to obtain a first signal related to the facial expression in the frequency domain signal. The first signal may include signals of some small facial expressions. For example, the first signal includes at least one of a signal that the corner of the user's mouth rises slightly, a signal that the user's eyebrows are raised, and a signal that the user blinks.

In addition, by filtering the frequency-domain signal, a second signal in the frequency-domain signal unrelated to the expression action is also obtained, and the second signal is a signal in the frequency-domain signal except the signal related to the expression action.

In step 208 of the embodiment of the present application, the amplification processing of the first signal is implemented by amplifying the amplitude of the first signal.

In step 210 of the embodiment of the present application, since the target signal after signal amplification is a frequency domain signal, in order to perform video restoration, the target signal is converted from frequency domain to time domain by using inverse Fourier transform to obtain the first Second video, so as to achieve video restoration.

In this embodiment of the present application, the first video is first converted from a time domain signal to a frequency domain signal, and then a first signal related to an expression in the frequency domain signal is obtained by filtering, and the first signal is amplified. After amplifying the first signal, video restoration is performed based on the amplified target signal. In this way, the enlargement processing of the facial expression in the first video is realized, so that the facial expression of the user can be more accurately recognized, and the facial expression of the user can be more accurately focused.

In one or more embodiments of the present application, before using the target filter to filter the signal of the first video to obtain the first signal related to the facial expression of the first video, the method for shooting and focusing further includes:

At least one piece of identification information is displayed on the shooting preview interface, and each identification information is used to indicate a corresponding facial expression, and the facial expression is obtained by enlarging the multi-frame historical preview images displayed on the shooting preview interface within a predetermined period of time, wherein the predetermined The time period is the time period before the time period of the first video;

receiving a first input from a user to target identification information in at least one identification information, wherein the target identification information is used to indicate a target facial expression;

Wherein, using the target filter, the signal of the first video is filtered to obtain the first signal related to the facial expression of the first video, including:

In response to the first input, a target filter corresponding to the target facial expression is used to filter the signal of the first video to obtain a first signal of the first video related to the target facial expression.

The embodiment of the present application will be described below with reference to FIG. 3 .

As shown in FIG. 3 , a plurality of facial expressions are displayed on the shooting preview interface, and in the case of receiving the first input that the user selects the middle blinking action, the signal of the first video is filtered by using the target filter corresponding to the blinking action , get the first signal related to the blinking action. Then, the first signal is amplified, and the video is restored to obtain the second video. Then, the blinking action in the second video is more obvious than that in the first video. In this way, according to the second video, it can be more accurately recognized that the user has made a blinking action.

In this embodiment of the present application, the user can select the facial expression action that needs to be focused according to his own needs. In this way, the photographing focusing device can focus on the facial expression action selected by the user on the photographing preview interface, so that the focused area meets the user's photographing needs.

The embodiments of the present application are described below by using a specific example.

After the camera is turned on, the preview image displayed on the shooting preview interface is cached. In the case where a preview image of 5 seconds has been cached, a video is generated according to the preview image of 5 seconds. The facial expressions of the target shooting subject of the video are enlarged. The enlargement processing method here is similar to the above-mentioned enlargement processing method for the first video, and details are not repeated here. It should be noted that the filter used for the enlargement process of the video generated from the 5-second preview screen may be a preset filter.

Then, the facial expressions of the target shooting object in the enlarged video are recognized, and three facial expressions are identified. The three facial expressions are displayed on the shooting preview interface, so that the user can select a target facial expression among the three facial expressions.

After the user selects the target facial expression, the preview image displayed on the shooting preview interface in the last 5 seconds is re-acquired from the cached historical preview image, and the first video is formed from the preview image. Then, the signal of the first video is filtered by using the target filter corresponding to the target facial expression. Then, perform signal amplification, video restoration, recognition of expression areas, and focusing. Since these steps have been described above, they will not be repeated here.

In the embodiment of the present application, a series of facial expressions recognized after the video magnification process is displayed on the shooting preview interface, so that the user can select different facial expressions as the focus object, so that the focused area can meet the user's shooting needs .

In one or more embodiments of the present application, acquiring multiple facial expressions of the target photographing subject includes: using face recognition to identify the multiple facial expressions of the target photographing subject on the photographing preview interface.

In one or more embodiments of the present application, the first signal is amplified according to a predetermined magnification, and before the target signal is obtained, the photographing and focusing method further includes:

Under the condition that the sensitivity adjustment control is displayed on the shooting preview interface, receive a second input from the user to the sensitivity adjustment control;

in response to the second input, obtaining a target sensitivity value associated with the second input;

According to the relationship between the preset sensitivity value and the magnification, the target magnification associated with the target sensitivity value is determined.

For example, referring to FIG. 4 , a sensitivity adjustment control 302 is displayed on the shooting preview interface, and the user can slide on the sensitivity adjustment control 302 to adjust the target sensitivity value.

Wherein, the higher the target sensitivity value is, the larger the target magnification is, so that the facial expressions in the second video are more obvious. Thus, even if the user makes a slight facial movement, the facial expression area with the facial expression can be identified, and the facial expression area on the shooting preview interface can be focused. Conversely, the lower the target sensitivity value is, the smaller the target magnification is, and the user needs to make a larger expressive action in order to identify the expressive region with the expressive action.

In the embodiment of the present application, the user can adjust the target sensitivity value according to his own needs, thereby adjusting the target magnification, which can meet the user's own needs for shooting and focusing. Among them, the user can adjust the sensitivity to an appropriate value, which can prevent misfocus.

In one or more embodiments of the present application, after recognizing the facial expression area of the target shooting object in the second video and before focusing the facial expression area on the photographing preview interface, the photographing focusing method further includes:

In the case that the expression area includes at least one expression area, displaying the at least one expression area on the shooting preview interface;

receiving a third input from the user to the target expression area in the at least one expression area;

Focus on the expression area on the shot preview interface, including:

In response to the third input, the target expression area on the shooting preview interface is focused.

For example, in the case of taking a picture of person A, nearby person B randomly enters the shooting preview interface. In this case, the smiling expression area of the person A and the winking expression area of the person B in the second video are recognized. Then, the smiling expression area and the winking expression area are displayed on the shooting preview interface. When the user selects the smile expression area, focus on the smile expression area on the shooting preview interface. Thereby, focusing on the expression of the person A is achieved.

In the embodiment of the present application, at least one recognized expression area is displayed on the shooting preview interface, and the user selects to focus on the target expression area, so that the focusing result meets the user's requirement.

In one or more embodiments of the present application, after focusing the expression area on the shooting preview interface, the shooting focusing method further includes:

When the facial expression in the facial expression area is a predetermined facial expression, photographing is performed to obtain a target photographed image.

Optionally, after identifying the facial expression area of the target shooting object in the second video, the facial expressions in the above facial expression area in the second video are acquired. Then, if the facial expression in the facial expression area is a predetermined facial expression, take a photo or a video to obtain the target photographed image. The target captured image may be a frame image in a photo or a video.

In the following, the predetermined facial expression is taken as an example of the smiling action for description.

For example, the facial expression area of user A in the second video is identified, and the facial expression in the facial expression area is identified as a smiling action. Based on this, focus on the area where user A's smiling action is captured on the preview interface, and automatically shoot after focusing to obtain a photo or video of user A.

In the embodiment of the present application, when the facial expression in the facial expression area is a predetermined facial expression, the photographing is performed automatically, and the user does not need to manually click the photographing button, thereby avoiding the user's manual triggering of photographing instructions during photographing. The user clicks the capture button. Thereby, it is convenient for the user to photograph.

It should be noted that, in the above-mentioned embodiments, the executing subject is the photographing focusing device as an example to describe the executing photographing focusing method. However, the executing subject of the photographing focusing method provided by the embodiments of the present application is not limited to the photographing focusing device, and may also be a control module in the photographing focusing device for executing the loading photographing focusing method.

Corresponding to the photographing and focusing method provided by the embodiment of the present application, the embodiment of the present application provides a photographing and focusing device. FIG. 5 is a schematic structural diagram of a photographing and focusing device according to an embodiment of the present application. As shown in Figure 5, the photographing focusing device includes:

The video acquisition module 402 is configured to acquire a first video including the target shooting object when the shooting preview interface is displayed, where the first video is formed by multiple frames of historical preview images displayed on the shooting preview interface within a first predetermined period of time;

an amplification processing module 404, configured to perform amplification processing on the facial expressions of the target shooting object in the first video to obtain a second video;

Expression area identification module 406, used to identify the expression area of the target shooting object in the second video;

The area focusing module 408 is configured to focus on the expression area on the shooting preview interface.

In the embodiment of the present application, in the case where the shooting preview interface is displayed, a first video formed by multiple frames of historical preview images is acquired. Then, the facial expressions of the target shooting object in the first video are enlarged to obtain a second video. Then, the facial expression area of the target shooting object in the second video is identified, and the facial expression area on the photographing preview interface is focused. Since the facial expressions in the first video are enlarged, the inconspicuous facial expressions in the first video become more obvious, so that the facial expression area of the target object can be more accurately identified. Then, focusing based on the expression area can ensure the accuracy of the focusing area. In addition, the embodiment of the present application can automatically focus, and does not require the user to manually operate the focus, thereby facilitating the user to shoot.

In one or more embodiments of the present application, the amplification processing module 404 includes:

a signal filtering module, used for using the target filter to filter the signal of the first video to obtain the first signal related to the facial expression of the first video;

The signal amplification module is used for amplifying the first signal according to the target amplification factor to obtain the target signal;

The video restoration module is used for generating the second video according to the target signal.

In the embodiment of the present application, the target filter is used to filter the signal of the first video first, so as to obtain the first signal related to the facial expression, and filter out the second signal not related to the facial expression. Then, amplify the first signal related to the facial expression according to the target magnification, so as to obtain an amplified target signal of the facial expression. Then, the video is restored according to the amplified target signal of the facial expression and the second signal unrelated to the facial expression that is filtered out during filtering to obtain a second video. Compared with the first video, the facial expressions of the target photographing subject in the second video are more obvious, and thus, the facial expression area of the target photographing subject can be more accurately identified by using the second video.

In one or more embodiments of the present application, the photographing and focusing device further includes:

a signal conversion module for converting the time domain signal of the first video into frequency domain signals of multiple frequency bands;

Wherein, the signal filtering module is specifically configured to use the target filter to filter the frequency domain signal to obtain the first signal related to the facial expression in the frequency domain signal;

The video restoration module is specifically used for converting the target signal from the frequency domain to the time domain to obtain the second video.

In this embodiment of the present application, the first video is first converted from a time domain signal to a frequency domain signal, and then a first signal related to an expression in the frequency domain signal is obtained by filtering, and the first signal is amplified. After amplifying the first signal, video restoration is performed based on the amplified target signal. In this way, the enlargement processing of the facial expression in the first video is realized, so that the facial expression of the user can be more accurately recognized, and the facial expression of the user can be more accurately focused.

In one or more embodiments of the present application, the photographing and focusing device further includes:

The expression action display module is used to display at least one identification information on the shooting preview interface, and each identification information is used to indicate the corresponding expression action, and the expression action is to perform multi-frame historical preview pictures displayed on the shooting preview interface within a predetermined period of time. Enlarged to obtain, wherein, the predetermined time period is a time period before the time period of the first video;

a first input receiving module, configured to receive a first input from a user to target identification information in at least one identification information, wherein the target identification information is used to indicate a target facial expression;

The signal filtering module is specifically configured to, in response to the first input, use a target filter corresponding to the target expression to filter the signal of the first video to obtain a first signal of the first video related to the target expression.

In this embodiment of the present application, the user can select the facial expression action that needs to be focused according to his own needs. In this way, the photographing focusing device can focus on the facial expression action selected by the user on the photographing preview interface, so that the focused area meets the user's photographing needs.

In one or more embodiments of the present application, the photographing and focusing device further includes:

a second input receiving module, configured to receive a second input from the user on the sensitivity adjustment control when the sensitivity adjustment control is displayed on the shooting preview interface;

a second input response module, configured to acquire a target sensitivity value related to the second input in response to the second input;

The magnification determination module is configured to determine the target magnification associated with the target sensitivity value according to the relationship between the preset sensitivity value and the magnification.

In the embodiment of the present application, the user can adjust the target sensitivity value according to his own needs, thereby adjusting the target magnification, which can meet the user's own needs for shooting and focusing. Among them, the user can adjust the sensitivity to an appropriate value, which can prevent misfocus.

In one or more embodiments of the present application, the photographing and focusing device further includes:

an expression area display module, configured to display at least one expression area on the shooting preview interface when the expression area includes at least one expression area;

a second input receiving module, configured to receive a second input from the user to the target expression area in the at least one expression area;

The area focusing module 408 is specifically configured to focus on the target expression area on the shooting preview interface in response to the second input.

In the embodiment of the present application, at least one recognized expression area is displayed on the shooting preview interface, and the user selects to focus on the target expression area, so that the focusing result meets the user's requirement.

In one or more embodiments of the present application, the photographing and focusing device further includes:

The photographing module is used for photographing to obtain a target photographed image when the facial expression in the facial expression area is a predetermined facial expression.

In the embodiment of the present application, when the facial expression in the facial expression area is a predetermined facial expression, the photographing is performed automatically, and the user does not need to manually click the photographing button, thereby avoiding the user's manual triggering of photographing instructions during photographing. The user clicks the capture button. Thereby, it is convenient for the user to photograph.

The photographing and focusing device in the embodiments of the present application may be a device, or may be a component, an integrated circuit, or a chip in the device. The apparatus may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). , PDA), etc., the non-mobile electronic device may be a server, a network attached storage (NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc. The embodiments of the present application There is no specific limitation.

The photographing and focusing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The photographing and focusing device provided by the embodiment of the present application can implement each process implemented by the photographing and focusing device in the method embodiment of FIG. 1 or FIG. 2 , and to avoid repetition, details are not repeated here.

Optionally, an embodiment of the present application further provides an electronic device, including a processor, a memory, a program or instruction stored in the memory and executable on the processor, the program or instruction being executed by the processor to realize the above-mentioned shooting focus. Each process of the method embodiment can achieve the same technical effect, and in order to avoid repetition, it will not be repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the aforementioned mobile electronic devices and non-mobile electronic devices.

FIG. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, and a processor 510, etc. part.

The input unit 504 may include a graphics processor 5041 and a microphone 5042 . The display unit 506 includes a display panel 5061 . The user input unit 507 may include a touch panel 5071 and other input devices 5072 . Memory 509 may include application programs and an operating system.

Those skilled in the art can understand that the electronic device 500 may also include a power supply (such as a battery) for supplying power to various components, and the power supply may be logically connected to the processor 510 through a power management system, so as to manage charging, discharging, and power management through the power management system. consumption management and other functions. The structure of the electronic device shown in FIG. 5 does not constitute a limitation on the electronic device. The electronic device may include more or less components than the one shown, or combine some components, or arrange different components, which will not be repeated here. .

The processor 510 is configured to acquire a first video including the target shooting object when the display unit 506 displays the shooting preview interface, and the first video is previewed from the history of multiple frames displayed on the shooting preview interface within the first predetermined period of time. screen formation;

The processor 510 is further configured to amplify the facial expressions of the target shooting object in the first video to obtain a second video;

The processor 510 is further configured to identify the facial expression area of the target shooting object in the second video;

The processor 510 is further configured to focus on the expression area on the shooting preview interface.

In the embodiment of the present application, in the case where the shooting preview interface is displayed, a first video formed by multiple frames of historical preview images is acquired. Then, the facial expressions of the target shooting object in the first video are enlarged to obtain a second video. Then, the facial expression area of the target shooting object in the second video is identified, and the facial expression area on the photographing preview interface is focused. Since the facial expressions in the first video are enlarged, the inconspicuous facial expressions in the first video become more obvious, so that the facial expression area of the target object can be more accurately identified. Then, focusing based on the expression area can ensure the accuracy of the focusing area. In addition, the embodiment of the present application can automatically focus, and does not require the user to manually operate the focus, thereby facilitating the user to shoot.

In one or more embodiments of the present application, the processor 510 is specifically configured to use the target filter to filter the signal of the first video to obtain the first signal related to the facial expression of the first video; zoom in according to the target multiple, the first signal is amplified to obtain the target signal; according to the target signal, the second video is generated.

In the embodiment of the present application, the target filter is used to filter the signal of the first video first, so as to obtain the first signal related to the facial expression, and filter out the second signal not related to the facial expression. Then, amplify the first signal related to the facial expression according to the target magnification, so as to obtain an amplified target signal of the facial expression. Then, the video is restored according to the amplified target signal of the facial expression and the second signal unrelated to the facial expression that is filtered out during filtering to obtain a second video. Compared with the first video, the facial expressions of the target photographing subject in the second video are more obvious, and thus, the facial expression area of the target photographing subject can be more accurately identified by using the second video.

In one or more embodiments of the present application, the processor 510 is further configured to convert the time domain signal of the first video into frequency domain signals of multiple frequency bands;

The processor 510 is specifically configured to use the target filter to filter the frequency domain signal to obtain the first signal related to the facial expression in the frequency domain signal;

The processor 510 is specifically configured to convert the target signal from the frequency domain to the time domain to obtain the second video.

In this embodiment of the present application, the first video is first converted from a time domain signal to a frequency domain signal, and then a first signal related to an expression in the frequency domain signal is obtained by filtering, and the first signal is amplified. After amplifying the first signal, video restoration is performed based on the amplified target signal. In this way, the enlargement processing of the facial expression in the first video is realized, so that the facial expression of the user can be more accurately recognized, and the facial expression of the user can be more accurately focused.

In one or more embodiments of the present application, the processor 510 is further configured to acquire multiple facial expressions of the target shooting object;

The display unit 506 is used to display at least one identification information on the shooting preview interface, and each identification information is used to indicate a corresponding facial expression, and the facial expression is to enlarge the multi-frame historical preview pictures displayed on the shooting preview interface within a predetermined period of time. Obtained by processing, wherein, the predetermined time period is a time period before the time period of the first video;

a user input unit 507, configured to receive a first input from a user to target identification information in at least one identification information, wherein the target identification information is used to indicate a target facial expression;

The processor 510 is specifically configured to, in response to the first input, use a target filter corresponding to the target expression to filter the signal of the first video to obtain a first signal of the first video related to the target expression.

In this embodiment of the present application, the user can select target identification information for indicating the target facial expression according to his own needs. In this way, the photographing focusing device can focus on the target facial expression on the photographing preview interface, so that the focused area satisfies the user's needs. shooting needs.

In one or more embodiments of the present application, the user input unit 507 is further configured to receive a second input from the user on the sensitivity adjustment control when the sensitivity adjustment control is displayed on the shooting preview interface;

The processor 510 is further configured to, in response to the second input, obtain a target sensitivity value related to the second input; and determine a target magnification associated with the target sensitivity value according to a preset association relationship between the sensitivity value and the magnification.

In the embodiment of the present application, the user can adjust the target sensitivity value according to his own needs, thereby adjusting the target magnification, which can meet the user's own needs for shooting and focusing. Among them, the user can adjust the sensitivity to an appropriate value, which can prevent misfocus.

In one or more embodiments of the present application, the display unit 506 is configured to display at least one expression area on the shooting preview interface when the expression area includes at least one expression area;

a user input unit 507, configured to receive a third input from a user to a target expression area in the at least one expression area;

The processor 510 is specifically configured to focus on the target expression area on the shooting preview interface in response to the third input.

In the embodiment of the present application, at least one recognized expression area is displayed on the shooting preview interface, and the user selects to focus on the target expression area, so that the focusing result meets the user's requirement.

In one or more embodiments of the present application, the processor 510 is further configured to perform photography to obtain a target photographed image when the facial expression in the facial expression area is a predetermined facial expression.

In the embodiment of the present application, when the facial expression in the facial expression area is a predetermined facial expression, the photographing is performed automatically, and the user does not need to manually click the photographing button, thereby avoiding the user's manual triggering of photographing instructions during photographing. The user clicks the capture button. Thereby, it is convenient for the user to photograph.

Embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium. When the program or instruction is executed by a processor, each process of the above-mentioned embodiments of the shooting and focusing method can be realized, and the same technology can be achieved. The effect, in order to avoid repetition, is not repeated here.

The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

An embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or an instruction to implement each process of the above-mentioned embodiments of the shooting and focusing method, and can achieve the same The technical effect, in order to avoid repetition, will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element. In addition, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in the reverse order depending on the functions involved. To perform functions, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of this application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of this application, without departing from the scope of protection of the purpose of this application and the claims, many forms can be made, which all fall within the protection of this application.

Claims (9)

1. A shooting focusing method is characterized by comprising the following steps:

under the condition that a shooting preview interface is displayed, acquiring a first video including a target shooting object, wherein the first video is formed by a plurality of frames of historical preview pictures displayed on the shooting preview interface within a first preset time period;

amplifying the expression action of the target shooting object in the first video to obtain a second video;

identifying an expression area of the target photographic object in the second video;

focusing the expression area on the shooting preview interface;

the method for amplifying the expression action of the target shooting object in the first video to obtain a second video comprises the following steps:

filtering the signal of the first video by using a target filter to obtain a first signal of the first video, wherein the first signal is related to expression actions, and the target filter is used for amplifying the expression actions;

amplifying the first signal according to a target amplification factor to obtain a target signal;

and generating the second video according to the target signal.

2. The method of claim 1, wherein before the filtering the signal of the first video with the target filter to obtain the first signal of the first video related to the expressive action, the method further comprises:

converting a time domain signal of the first video into a plurality of frequency domain signals of a plurality of frequency bands;

wherein the filtering, by using a target filter, the signal of the first video to obtain a first signal of the first video related to the expression action includes:

filtering the frequency domain signal by using the target filter to obtain the first signal related to the expression action in the frequency domain signal;

the generating the second video according to the target signal includes:

and converting the target signal from a frequency domain to a time domain to obtain the second video.

3. The method of claim 1, wherein before filtering the signal of the first video with the target filter to obtain the first signal of the first video related to the expressive motion, the method further comprises:

displaying at least one piece of identification information on the shooting preview interface, wherein each piece of identification information is used for indicating a corresponding expression action, and the expression action is obtained by amplifying a multi-frame history preview picture displayed on the shooting preview interface within a preset time period, wherein the preset time period is a time period before the time period of the first video;

receiving a first input of a user to target identification information in the at least one piece of identification information, wherein the target identification information is used for indicating a target expression action;

wherein the filtering, by using a target filter, the signal of the first video to obtain a first signal of the first video related to an expression action includes:

and responding to the first input, and filtering the signal of the first video by using the target filter corresponding to the target expression action to obtain a first signal of the first video, wherein the first signal is related to the target expression action.

4. The method of claim 1, wherein before the amplifying the first signal according to the predetermined amplification factor to obtain the target signal, the method further comprises:

receiving a second input of a user to the sensitivity adjusting control under the condition that the sensitivity adjusting control is displayed on the shooting preview interface;

in response to the second input, obtaining a target sensitivity value associated with the second input;

and determining the target magnification factor related to the target sensitivity value according to the correlation between the preset sensitivity value and the magnification factor.

5. The method of claim 1, wherein after identifying an expressive region of the target photographic subject in the second video and before focusing on the expressive region on the photographic preview interface, the method further comprises:

displaying at least one expression area on the shooting preview interface under the condition that the expression area comprises the at least one expression area;

receiving a third input of a user to a target expression area in the at least one expression area;

focusing the expression area on the shooting preview interface comprises the following steps:

responding to the third input, and focusing the target expression area on the shooting preview interface.

6. The method according to any one of claims 1 to 5, wherein after focusing the expressive area on the shooting preview interface, the method further comprises:

and shooting to obtain a target shooting image under the condition that the expression action in the expression area is a preset expression action.

7. A photographing focusing device, comprising:

the video acquisition module is used for acquiring a first video comprising a target shooting object under the condition of displaying a shooting preview interface, wherein the first video is formed by a plurality of frames of historical preview pictures displayed on the shooting preview interface within a first preset time period;

the amplification processing module is used for amplifying the expression action of the target shooting object in the first video to obtain a second video;

the expression area identification module is used for identifying the expression area of the target shooting object in the second video;

the area focusing module is used for focusing the expression area on the shooting preview interface;

wherein, enlarge the processing module and include:

the signal filtering module is used for filtering the signal of the first video by using a target filter to obtain a first signal of the first video related to the expression action, and the target filter is used for amplifying the expression action;

the signal amplification module is used for amplifying the first signal according to a target amplification factor to obtain a target signal;

and the video restoration module is used for generating the second video according to the target signal.

8. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the shooting focusing method of any one of claims 1 to 6.

9. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the shooting focusing method according to any one of claims 1 to 6.

Images