CN113905182B - A shooting method and device - Google Patents

Abstract

The embodiment of the present application provides a shooting method and equipment, which relate to the field of electronic technology, and can set appropriate exposure parameters for the subject of interest to the user according to the user's wishes or needs during the framing stage of the shooting, so that the image shot according to the exposure parameters The exposure of the synthesized target image can better meet the wishes or expectations of the user, and meet the personalized shooting needs of the user. The solution includes: the electronic device enters the target shooting mode of the camera application; after detecting the user's operations on the first target object and the second target object on the preview image, respectively determining the first target exposure parameter and the second target exposure parameter; After the user's shooting operation is detected, the target image is displayed; the target image is generated according to the first image to be synthesized and the second image to be synthesized; the first image to be synthesized is obtained by shooting according to the first target exposure parameter, and the second image to be synthesized is obtained according to the second image to be synthesized Two target exposure parameters are obtained by shooting. The embodiment of this application is used in the shooting process.

Description

A shooting method and device

technical field

The embodiments of the present application relate to the field of electronic technology, and in particular, to a photographing method and device.

Background technique

In a scene with a large light ratio (that is, a strong contrast between light and dark), since the camera sensor is not as forgiving as the human eye, if an electronic device such as a mobile phone or a tablet is correctly exposed according to the bright subject, the dark subject will be exposed. Severely underexposed. Similarly, electronics that correctly expose for dark subjects will overexpose bright ones. Both underexposed and overexposed images will seriously lose the details of the object.

In the prior art, in a scene with a large light ratio, a high-dynamic range (high-dynamic range, HDR) mode is used for exposure adjustment and image synthesis. However, this method easily leads to distortion of the synthesized image, and it is not easy to adjust in the later stage. In addition, this method is also difficult to meet the increasingly diverse and personalized shooting needs of users, resulting in poor user experience.

Contents of the invention

The embodiment of the present application provides a shooting method and equipment, which can set appropriate exposure parameters for the subject of interest to the user according to the user's wishes or needs during the framing stage of shooting, so that the target image synthesized from the images shot according to the exposure parameters The exposure situation can better meet the user's wishes or expectations, meet the user's diverse and personalized shooting needs, and can also improve the quality of the composite image, making the image obtained by shooting more natural and improving the user experience.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

On the one hand, the embodiment of the present application provides a shooting method, the method includes: the electronic device enters the target shooting mode of the camera application, and displays a preview interface; after the electronic device detects the user's operation on the first target object on the preview image, Determine the first target exposure parameter according to the first target object; after the electronic device detects the user's operation on the second target object on the preview image, determine the second target exposure parameter according to the second target object; after the electronic device detects the user's shooting operation , displaying the target image, wherein the target image is generated according to the first image to be combined and the second image to be combined; the first image to be combined is obtained according to the first target exposure parameter, and the second image to be combined is obtained according to the second target exposure parameter Captured.

In this solution, the electronic device can set appropriate exposure parameters for the target object that the user is interested in according to the user's wishes or needs under the preview interface of the target shooting mode, so that the target image synthesized from the images captured according to the exposure parameters The exposure can better meet the wishes or expectations of the user, meet the diverse and personalized shooting needs of the user, and can also improve the quality of the composite image, making the image obtained by shooting more natural and improving the user experience.

In a possible design, after the electronic device enters the target shooting mode of the camera application, the method further includes: the electronic device prompts the user to select multiple target objects.

In this way, the user can select the target object whose exposure needs to be adjusted according to the prompt of the electronic device.

On the other hand, an embodiment of the present application provides a shooting method, the method includes: the electronic device opens the camera application, and displays a preview interface for taking pictures; after the electronic device detects the user's operation on the first target object on the preview image, according to The first target object determines the first target exposure parameter; after the electronic device detects the user's operation on the second target object on the preview image, it determines the second target exposure parameter according to the second target object; the electronic device enters the target shooting mode; the electronic device detects After the user's shooting operation, the target image is displayed. The target image is generated according to the first image to be combined and the second image to be combined; The exposure parameters were obtained by shooting.

In this solution, the electronic device can automatically enter the target shooting mode after detecting the user's operation on multiple target objects, and set appropriate exposure parameters for the target objects that the user is interested in according to the user's wishes or needs, so that according to the exposure The exposure of the target image synthesized by the image captured by the parameters can better meet the user's wishes or expectations, meet the user's diverse and personalized shooting needs, and can also improve the quality of the synthesized image, making the image obtained by shooting more natural. Improve user experience.

In a possible design, the electronic device entering the target shooting mode includes: the electronic device prompting the user whether to enter the target shooting mode; and the electronic device entering the target shooting mode in response to the user's instruction operation.

In this way, the electronic device can determine whether to enter the target shooting mode according to the user's instruction, and directly and automatically enter the target shooting mode in case of an accidental touch.

In a possible design, the method further includes: before the electronic device displays the target image, respectively displaying the first image to be combined and the second image to be combined.

In this way, by displaying the first image to be combined and the second image to be combined, the user can intuitively compare the difference between the target image and the image to be combined, thereby obtaining a better user experience.

In a possible design, the method further includes: after the electronic device determines the first target exposure parameters according to the first target object, obtain one or more frames of first preview images according to the first target exposure parameters, and display the Displaying the first preview image; after the electronic device determines the second target exposure parameters according to the second target object, obtains one or more frames of second preview images according to the second target exposure parameters, and displays the second preview images on the preview interface.

In this solution, by displaying the first preview image or the second preview image on the preview interface, the user can intuitively determine whether the current first exposure parameter and the second exposure parameter meet their wishes or expectations, thereby facilitating the user to Adjust the exposure parameters.

In a possible design, the electronic device determines the first target exposure parameter according to the first target object, including: the electronic device performs automatic photometry according to the reflected light of the object to be photographed corresponding to the first target object; The results of the first target exposure parameters are determined.

In a possible design, the method further includes: after the electronic device detects the user's operation on the first target object on the preview image, displaying the exposure adjustment control on the preview interface; the electronic device responds to the user's operation on the exposure adjustment control to adjust the first target exposure parameter.

In a possible design, after the electronic device detects the user's operation on the first target object on the preview image, determining the first target exposure parameter according to the first target object includes: the electronic device detects that the user's operation on the first target object on the preview image After the target object is operated, the exposure setting control corresponding to the first target object is displayed on the preview interface; the electronic device determines the first target exposure parameter in response to the user's operation on the exposure setting control. By displaying the exposure setting controls, the user can conveniently adjust the exposure parameters.

In a possible design, the pixel value of the first subject on the target image is the same as the pixel value of the first subject on the first image to be synthesized, and the first subject is the subject corresponding to the first target object; the second subject on the target image The pixel value of is the same as the pixel value of the second subject on the second image to be synthesized, and the second subject is the subject corresponding to the second target object; the pixel values of other pixel points on the target image except the first subject and the second subject, is the weighted average of pixel values of corresponding pixel points on the first image to be synthesized and the second image to be synthesized after registration.

In this solution, the pixel values of the first subject and the second subject are set according to the user's wishes or needs, so that the exposure of the synthesized target image can better meet the user's wishes or expectations, and meet the user's diverse and personalized needs. Shooting needs.

In a possible design, the method further includes: the electronic device obtains a third target exposure parameter according to the first target exposure parameter and the second target exposure parameter; The third image to be synthesized is generated, and the third image to be synthesized is obtained by shooting according to the third target exposure parameter.

In this solution, the electronic device may synthesize a final target image by combining other images to be synthesized than the first image to be synthesized and the second image to be synthesized.

In a possible design, the method further includes: after the electronic device detects the user's shooting operation, displaying the third image to be synthesized.

In this way, it is convenient for the user to intuitively compare the differences between the third image to be combined and other images to be combined and the target image.

In a possible design, the pixel value of the first subject on the target image is the same as the pixel value of the first subject on the first image to be synthesized, and the first subject is the subject corresponding to the first target object; The pixel value of the second subject is the same as the pixel value of the second subject on the second image to be synthesized, and the second subject is the subject corresponding to the second target object; the pixels of other pixel points on the target image except the first subject and the second subject The value is the same as the pixel value of the corresponding pixel on the third image to be combined.

In this scheme, the third target exposure parameter is obtained according to the first target exposure parameter and the second target exposure parameter, and the third image to be synthesized is obtained according to the third target exposure parameter. The pixel values of other pixel points are the same as the pixel values of corresponding pixel points on the third image to be synthesized, so that more details in the image can be preserved and the image quality of the target image is better. The pixel values of the first subject and the second subject are set according to the user's will or demand, so that the exposure of the synthesized target image can better meet the user's wish or expectation, and meet the user's diverse and personalized shooting needs.

In a possible design, the first target object is the first target subject, and the first subject is the first target subject; or, the first target object is the first target area, and the first subject is the location where the first target area is located. The subject, or the first subject is the subject with the largest area ratio among the plurality of subjects included in the first target area.

That is to say, the first target object may be a subject or an area; the first subject is a subject corresponding to the first target object.

In a possible design, the operation on the first target object includes a single-click operation, a double-click operation, a pressure-press operation, a long-press operation, or an operation to circle the first target object.

That is to say, the embodiment of the present application may select the first target object in various ways.

In a possible design, the operation on the first target object includes a double-click operation, a pressure-press operation, a long-press operation, or an operation to circle the first target object.

That is to say, the embodiment of the present application may select the first target object in various ways.

In a possible design, the first target exposure parameter includes one or more of sensitivity ISO, aperture, shutter time or exposure value EV.

That is to say, the first target exposure parameter can be characterized by parameters of multiple dimensions.

In yet another aspect, an embodiment of the present application provides an electronic device, the electronic device includes: a screen for displaying an interface; one or more processors; a memory; and one or more computer programs, wherein one or more computers The program is stored in the memory, and one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device executes the photographing method provided by the embodiment of the present application.

In yet another aspect, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium includes computer instructions, and when the computer instructions are run on a computer, the computer executes the photographing method provided in the embodiment of the present application.

In yet another aspect, an embodiment of the present application provides a computer program product, which, when the computer program product is run on a computer, causes the computer to execute the photographing method provided in the embodiment of the present application.

Description of drawings

FIG. 1 is a schematic diagram of a hardware structure of an electronic device provided in an embodiment of the present application;

FIG. 2 is a flow chart of a shooting method provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a group of display interfaces provided by the embodiment of the present application;

FIG. 4 is a schematic diagram of another display interface provided by the embodiment of the present application;

FIG. 5 is a schematic diagram of another display interface provided by the embodiment of the present application;

FIG. 6 is a schematic diagram of another group of display interfaces provided by the embodiment of the present application;

FIG. 7 is a schematic diagram of another group of display interfaces provided by the embodiment of the present application;

FIG. 8 is a schematic diagram of another display interface provided by the embodiment of the present application;

FIG. 9 is a schematic diagram of another group of display interfaces provided by the embodiment of the present application;

Fig. 10 is a schematic diagram of a group of images provided by the embodiment of the present application;

Fig. 11 is a schematic diagram of another image provided by the embodiment of the present application;

FIG. 12 is a schematic diagram of another set of images provided by the embodiment of the present application;

FIG. 13 is a schematic diagram of another set of images provided by the embodiment of the present application;

FIG. 14 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. Among them, in the description of the embodiments of this application, unless otherwise specified, "/" means or means, for example, A/B can mean A or B; "and/or" in this article is only a description of associated objects The association relationship of indicates that there may be three kinds of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. In addition, in the description of the embodiments of the present application, "plurality" refers to two or more than two.

Hereinafter, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

The embodiment of the present application provides a shooting method, which can be applied to electronic devices, and can set appropriate exposure parameters for the subject of interest to the user according to the user's wishes or needs in the preview state of shooting, so that the photos taken according to the exposure parameters The exposure of the target image synthesized by the image can better meet the wishes or expectations of the user, meet the diverse and personalized shooting needs of the user, and can also improve the quality of the synthesized image, making the image obtained by shooting more natural and improving the user experience .

However, in the prior art, the HDR mode is usually used for exposure adjustment and image synthesis. In the HDR mode, multiple images are automatically taken according to different exposure parameters and the images are automatically synthesized. The exposure parameters cannot be artificially selected, which may cause serious distortion of the synthesized image, and the post-production adjustment is complicated, and it is difficult to meet the diverse and personalized shooting of users. need.

For example, the electronic device in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a notebook computer, a super mobile personal computer (ultra-mobile personal computer, UMPC), netbook, personal digital assistant (personal digital assistant, PDA) and other mobile terminals may also be equipment such as professional cameras, and the embodiments of the present application do not impose any restrictions on the specific types of electronic equipment.

Exemplarily, FIG. 1 shows a schematic structural diagram of an electronic device 100 . The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor ( image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. . Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

Wherein, the controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

The electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light emitting diode). AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1. For example, the display screen 194 may be used to display a preview interface and a shooting interface in a professional HDR mode.

The electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.

Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide-semiconductor (complementary metal-oxide-semiconductor, CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.

Wherein, the camera 193 may also include multiple types. For example, the camera 193 may include a telephoto camera, a wide-angle camera or an ultra-wide-angle camera with different focal lengths. Among them, the field of view of the telephoto camera is small, which is suitable for shooting distant scenes in a small range; the field of view of the wide-angle camera is relatively large; screen. In some embodiments, the telephoto camera with a smaller field of view can be rotated so as to capture scenes in different ranges.

The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, and the optical signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .

In the embodiment of the present application, the photosensitive element can detect the amount of incoming light, and the ISP can measure light according to the amount of incoming light, so as to determine the target exposure parameter. The camera 193 can collect images according to the target exposure parameters, so as to generate a preview image or an image to be synthesized.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The internal memory 121 may be used to store computer-executable program codes including instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 . The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.

In the embodiment of the present application, the processor 110 may execute instructions stored in the internal memory 121 to synthesize the images to be synthesized into a final target image in a professional HDR mode.

Touch sensor 180K, also known as "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the position of the display screen 194 .

It can be understood that, the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

In the embodiment of the present application, in the preview state, detection components such as the touch sensor 180K may be used to detect the user's operation of selecting multiple target objects. The photosensitive element can detect the amount of incoming light, and the ISP can be used to perform automatic light metering according to the amount of incoming light corresponding to the target object, so as to determine the target exposure parameters. The camera 193 may be used to collect images according to target exposure parameters to generate images to be synthesized. The processor 110 may execute instructions stored in the internal memory 121 to synthesize the images to be synthesized into a final target image. The display screen 194 can be used to display interfaces, such as a preview interface and a shooting interface.

The photographing method provided by the embodiment of the present application will be described below by taking the electronic device as a mobile phone and the screen of the mobile phone as the above-mentioned touch screen as an example.

Referring to Figure 2, an embodiment of the present application provides a shooting method, including:

200. The mobile phone enters the professional HDR mode of the camera application.

In some embodiments, the mobile phone can preset a professional HDR mode in the camera application, and enter this mode to take pictures in response to the user's operation to enter the professional HDR mode.

For example, after detecting that the user clicks the camera icon 301 shown in (a) in FIG. 3 , the mobile phone starts the camera application and enters the camera mode as shown in (b) in FIG. 3 . Exemplarily, after the mobile phone detects that the user clicks the professional HDR control 302 shown in (b) in FIG. 3 , it enters the professional HDR mode and displays a preview interface as shown in (c) in FIG. 3 . The phone displays the preview image on the preview interface. Exemplarily again, after the mobile phone detects that the user clicks the operation of the control 303 shown in (b) in Figure 3, it displays an interface as shown in (d) in Figure 3; after the mobile phone detects the operation of the user clicking the control 304 , enter the professional HDR mode, and display the preview interface of the professional HDR mode as shown in (c) in FIG. 3 .

For another example, the mobile phone displays the desktop or non-camera application interface, and after detecting the user's voice command to enter the professional HDR mode, enters the professional HDR mode, and displays the preview interface of the professional HDR mode as shown in (c) in Figure 3 .

It should be noted that the mobile phone can also enter the professional HDR mode in response to other user touch operations, voice commands, or shortcut gestures. The embodiment of the present application does not limit the operation of triggering the mobile phone to enter the professional HDR mode.

It should also be noted that the professional HDR mode may also have other names, for example, manual HDR mode or enhanced HDR mode, etc., which are not limited in this embodiment of the present application.

In some embodiments, after the mobile phone enters the professional HDR mode, the function of the professional HDR mode may be prompted to the user, so that the user can better use this mode to take photos. For example, the mobile phone can prompt the user: in the professional HDR mode, you can select multiple objects of interest, and the mobile phone will determine the appropriate exposure parameters according to each object you selected, and take a picture according to each exposure parameter The images to be synthesized, and then synthesized according to the exposure of the images to be synthesized to meet your desired target image.

201. The mobile phone generates a target exposure parameter according to a target object, where the target object includes a target subject or a target area.

After the mobile phone enters the professional HDR mode, the preview interface of the professional HDR mode is displayed in the preview state, and the preview image is presented in the preview interface. Among them, the mobile phone can use the default light metering method to measure light according to the amount of light reflected by objects within the field of view of the camera in the current shooting scene to the photosensitive sensor of the camera, so as to calculate the exposure parameters, and collect data based on the exposure parameters Image, generate a preview image based on the collected image and display it on the preview interface.

For example, the default photometry method may be global photometry, central partial photometry, or spot photometry, and the default photometry method is not limited in this embodiment of the present application. Wherein, the default light metering mode may be set by the user, and if the user does not set it, the global light metering mode is adopted by default.

The amount of incoming light here refers to the total amount of light reflected by the object to be photographed (or called the object to be photographed) entering the photosensitive sensor through the lens. Exemplarily, when the default light metering mode is the global light metering mode, the mobile phone can automatically calculate the global exposure parameters according to the overall light input of all objects within the field of view in the current shooting scene, so as to collect images based on the global exposure parameters, according to The captured image generates a preview image and displays it on the preview interface; for another example, when the default metering method is the central partial metering method, the mobile phone can use the object to be photographed in the shooting scene corresponding to the preset middle area on the preview image The exposure parameters are automatically calculated based on the amount of incoming light, and images are collected based on the exposure parameters, and a preview image is generated based on the collected images and displayed on the preview interface. In the following embodiments of the present application, the default light metering mode is global light metering as an example for illustration.

After the mobile phone enters the professional HDR mode, the user can also select the target object on the preview interface. In some embodiments, the mobile phone may prompt the user to select multiple target objects by means of displaying information or voice broadcast. After the mobile phone detects the user's operation of selecting the target object, it determines and saves the target exposure parameters according to the target object. The target exposure parameter is a parameter capable of correctly exposing the target object on the image. Wherein, the exposure parameters may include parameters that can reflect the degree of image exposure, for example, the exposure parameters include target exposure parameters, which may include aperture, sensitivity ISO, and shutter time. The embodiment of the present application does not limit the specific parameters of the target exposure parameters. After entering the professional HDR mode, the user can select the target object multiple times on the preview interface, and each target object can correspond to a set of target exposure parameters.

It should be noted that the user can select any number of target objects greater than 1 according to requirements, and this embodiment of the present application does not limit the number of target objects selected by the user. The following will be described by taking the user selecting two target objects in the preview state as an example.

For example, after entering the professional HDR mode, the user selects the first target object in the preview image, and the mobile phone performs automatic light metering according to the first target object selected by the user. That is, the mobile phone performs automatic light metering according to the amount of light reflected to the photosensitive sensor by the object within the field angle range corresponding to the first target object in the shooting scene on the preview image. The mobile phone generates and saves the first target exposure parameter according to the automatic light metering result. Afterwards, the user selects the second target object on the image displayed on the preview interface, the mobile phone performs automatic light metering according to the second target object, and generates and saves the second target exposure parameter according to the automatic light metering result.

In the embodiment of the present application, if the target object is relatively bright (for example, the sky, white wrapping paper, etc.), it means that the amount of light reflected by the target object into the camera is relatively large, and in order to prevent the target object from being overexposed, the amount of light input needs to be reduced. Therefore, when the mobile phone determines that the amount of incoming light corresponding to the target object is relatively large through automatic metering, it can indicate that the target object is brighter, and the exposure value corresponding to the target exposure parameter corresponding to the target object set by the mobile phone can be smaller, such as the corresponding aperture F value Larger, shorter shutter times, or lower ISO values. In this way, the image captured by the mobile phone according to the target exposure parameters is less prone to overexposure of the target object. Conversely, if the target object is relatively dark (for example, a face under backlight, a gray baffle, etc.), it means that the amount of light reflected by the target object into the camera is small, and in order to prevent the target object from being underexposed, it is necessary to increase the amount of light entering. Therefore, when the mobile phone determines that the amount of incoming light corresponding to the target object is small through automatic light metering, it can indicate that the target object is dark, and the mobile phone can set the exposure value corresponding to the target exposure parameter corresponding to the target object to be relatively large, for example, the corresponding aperture F value is small , the shutter time is longer, or the ISO value is higher. In this way, the image captured by the mobile phone according to the target exposure parameters is unlikely to be underexposed to the target object.

Exemplarily, in the backlit portrait shooting scene as shown in FIG. 4 , if the first target object selected by the user is the sky 401 in FIG. 4 , since the sky 401 contains white clouds and the sun is relatively bright, the mobile phone will The exposure value corresponding to the generated first target exposure parameter is relatively small, for example, the aperture F value is 1.8, the ISO is 200, and the shutter time is 1/50 second. If the second target object selected by the user is the person 402 in FIG. 4 , since there is the sun in the current field of view, the person 402 is relatively dark in a backlit scene, so the exposure value corresponding to the second target exposure parameter generated by the mobile phone for the target object is relatively low. Large, for example, the aperture F value is 1.4, the ISO is 300, and the shutter time is 1/30 second.

In the embodiment of the present application, the target object may be a target body or a target area. For example, when the user wants to adjust or control the exposure level, exposure condition or exposure parameters of a certain subject, the subject may be selected as the target object, or an area on the image of the subject may be selected as the target object. For another example, when the user wants to adjust the exposure degree, exposure condition or exposure parameter of a certain area, the user may select this area as the target object. The mobile phone automatically measures light according to the target object to obtain matching target exposure parameters. Therefore, the target exposure parameter matches the target object selected by the user, and is an exposure parameter that conforms to the exposure intention of the user.

For example, the target object may be a target subject, such as the character 402 in FIG. 4 . When the target object is the target subject, in the preview state, the mobile phone performs panoramic segmentation on the preview image, and the mobile phone determines the target subject whose exposure parameters need to be adjusted according to the user's selection operation on the preview image and the panoramic segmentation result. In this case, the mobile phone performs automatic light metering according to the area where the target subject is located, so as to obtain corresponding target exposure parameters according to the automatic light metering result.

For another example, the target object may be a target area. For example, the target area may only include a part of a certain object. At this time, the mobile phone performs automatic light metering according to the whole object, so as to obtain the corresponding target exposure parameters according to the automatic light metering result; Part of the object is automatically metered, so that the corresponding target exposure parameters are obtained according to the automatic metering result. For another example, the target area may include multiple objects. At this time, the mobile phone automatically measures light according to the main object among the multiple objects in the target area, so as to obtain corresponding target exposure parameters according to the automatic light measurement result. Specifically, the mobile phone performs active photometry according to the part of the main object within the target area. For example, the main object may be the object with the largest area in the target area, or the centermost object in the target area, or a completely displayed object in the target area.

After the mobile phone generates target exposure parameters according to the target object, it can collect images according to the target exposure parameters, and generate and display a preview image according to the collected images.

For example, after the user selects the first target object, the mobile phone generates the first target exposure parameters according to the first target object, and collects images according to the first target exposure parameters to generate and display the first preview image. In the case that the shooting scene does not switch, the mobile phone can continuously collect images according to the first target exposure parameters to generate and display the first preview image. After the user selects the second target image, the mobile phone can generate a second target exposure parameter according to the second target object, and collect images according to the second target exposure parameter to generate and display a second preview image.

In some embodiments, the selection mode of the target object is different, and the display mode of the preview image obtained by the mobile phone according to the target exposure parameters is also different. For example, after the user selects the first target object through the first preset method (for example, clicking the first target object), the mobile phone generates the first target exposure parameter according to the first target object, and collects a frame of image according to the first target exposure parameter to thereby Generate and display a frame of the first preview image. Then, the mobile phone captures images according to the global exposure parameters, thereby generating and displaying preview images. After the user selects the second target image through the first preset method (for example, clicking the second target object), the mobile phone generates the second target exposure parameter according to the second target object, and collects a frame of image according to the second target exposure parameter to generate and Display a frame of the second preview image. Then, the mobile phone captures images according to the global exposure parameters, thereby generating and displaying preview images.

For another example, after the user selects the first target object, the mobile phone generates the first target exposure parameter according to the first target object. The mobile phone continues to collect images according to the first target exposure parameters within a preset time (for example, 1 second) after the user selects the first target object, thereby generating and displaying the first preview image. If the operation of selecting the second target object by the user is not detected within the preset time, after the preset time, the mobile phone collects an image according to the global exposure parameters to generate a preview image and display it; until the user selects the second target object is detected Afterwards, a second preview image is generated and displayed according to the second target exposure parameter. If the mobile phone detects that the user selects the second target object within a preset time after the user selects the first target object, the mobile phone generates a second target exposure parameter according to the second target object, and generates and displays the second target exposure parameter according to the second target object. Second preview image.

For another example, after the user selects the first target object through the second preset method (for example, press and hold the first target object), the mobile phone enters the lock mode. In this way, after the user selects the first target object, the corresponding first preview image is presented on the preview interface; the corresponding second preview image is not presented on the preview interface until the user selects the second target object.

In addition, the user can also delineate the target object by double-clicking, pressing, drawing a circle or drawing a box, etc., and the user can also select by voice instructions (such as voice instructions to select the most middle person as the target object) or other methods. For the target object in the preview image, the embodiment of the present application does not limit the manner in which the user selects the target object in the preview image.

As shown in Figure 5, in some embodiments, when the user selects a certain position of the preview image by clicking or double-clicking, the mobile phone expands a preset number of pixels from the center of the clicked position, and the formed area is for the target area. For example, with the clicked point as the center, an area extending outward by 5 pixels is determined as the target area 502 selected by the user. In some other embodiments, when the user selects a target area in the preview image by drawing a circle or a box to enclose an area, the selected target area is the area enclosed in the circle or box drawn by the user. For example, when the user draws a box, the box is the target area 501 selected by the user. In some other embodiments, when the user clicks on a certain location, the subject to which the location belongs is the target object. For example, when the user clicks on the location where the deer is located, the deer is the target object 503 .

In some other embodiments, the mobile phone can also prompt the user with the first target exposure parameter and the second target exposure parameter by displaying prompt information, voice broadcast or other methods, so that the user can more intuitively compare each target exposure parameter with the preview image. Correspondingly, it is convenient for the user to know the value of the target exposure parameter generated after selecting the target object. Exemplarily, as shown in (a) of FIG. 6 , after the user selects the target area 501 , the mobile phone displays the first target exposure parameter 601 on the first preview image. As shown in (b) of FIG. 6 , after the user selects the target area 502 , the mobile phone displays a second target exposure parameter 602 on the second preview image. The embodiment of the present application does not limit the manner of prompting the user of the target exposure parameter.

In some other embodiments, the user can also manually adjust the target exposure parameters according to personal needs, wishes, experience or preferences, so as to generate target exposure parameters that are more in line with the user's wishes and improve user experience.

For example, in the preview interface, when the user selects the first target object in the preview image, the mobile phone can automatically calculate the first target exposure parameter according to the amount of incoming light of the first target object in the above manner. The mobile phone collects a first preview image according to the first target exposure parameter, and presents the first preview image on a preview interface. In addition, exposure adjustment controls are displayed on the preview interface, and users can adjust the first target exposure parameters automatically calculated by the current mobile phone according to their own needs, wishes, experience or preferences, so as to obtain an adjusted new first target exposure parameter. Wherein, the first target exposure parameter includes aperture, ISO and shutter time.

For example, as shown in (a) in FIG. 7 , the exposure adjustment controls include adjustment controls corresponding to parameters such as aperture, ISO and shutter time. The user can directly input a parameter value in the adjustment control corresponding to each parameter to adjust the first target exposure parameter, or select a parameter value in the drop-down menu of the adjustment control corresponding to each parameter to adjust the first target exposure parameter. In addition, the user can also adjust the value of each parameter by sliding the scroll bars corresponding to the parameters of aperture, ISO and shutter time, thereby adjusting the first target exposure parameter. For another example, the first target exposure parameter may also include an exposure value EV. As shown in (b) in FIG. , the mobile phone determines the size of a corresponding set of exposure parameters according to the gear of the adjusted exposure value. The embodiment of the present application does not limit the manner of adjusting the first target exposure parameter.

In some other embodiments, after the user selects the target object in the preview image, the user can directly set the target exposure parameters according to personal needs, wishes, experience or preferences, without the need for the mobile phone to automatically measure light according to the target object to calculate the target exposure parameter.

For example, in the preview interface, after the user selects the first target object in the preview image, the mobile phone can display an exposure setting control on the preview interface, and the user can set the exposure parameter of the first target through the exposure setting control. Exemplarily, as shown in FIG. 8 , the exposure setting control includes sliding scroll bars respectively corresponding to parameters such as aperture, ISO and shutter time. The user can set the value of each parameter by sliding the sliding scroll bar corresponding to each parameter, thereby setting the first target exposure parameter. In addition, the user can directly input the parameter value in the setting control corresponding to each parameter to set the first target exposure parameter, or select a parameter value in the drop-down menu of the setting control corresponding to each parameter to set the first target exposure parameter. The embodiment of the present application does not limit the manner of setting the first target exposure parameter.

When the user selects the second target object in the preview image, the user can adjust or set the second target exposure parameter for the second target area according to his own needs, experiences, wishes or preferences. The process for the user to adjust or set the second target exposure parameter is similar to the process for adjusting or setting the first target exposure parameter, and will not be repeated here.

In this embodiment of the application, in response to the user's selection operation on different target objects, the mobile phone can automatically generate the target exposure parameters corresponding to each target object for each target object, or the user can manually set the corresponding target exposure parameters for each target object. target exposure parameters. The mobile phone can display the preview image generated according to each target exposure parameter in the preview interface, so that the user can intuitively see the effect of each preview image, and it is convenient for the user to compare the exposure effect of the preview image before and after adjusting the exposure parameter according to the target object.

In some other embodiments, the first preview image is not a preview image directly generated from an image collected according to the first target exposure parameter, but an image synthesized from images respectively obtained according to the global exposure parameter and the first target exposure parameter. For example, the mobile phone uses the first target exposure parameters to capture image 1, uses the global exposure parameters to capture image 2, replaces the pixels of the first target object in image 2 with the pixels of the first target object in image 1, thereby generating the first preview image . That is to say, the image of the first target object on the first preview image is obtained according to the first target exposure parameter, and the images other than the first target object are obtained according to the global exposure parameter. The first preview image generated and displayed in this way allows the user to intuitively compare the changes in the exposure level of the first target object before and after the user selects the first target object to set the target exposure parameters, which is convenient for the user It is determined whether the first target object photographed by using the first target exposure parameter meets the expectations and wishes of the user. Similar to the first preview image, the second preview image may also be an image obtained according to the second target exposure parameter and the global exposure parameter.

In other embodiments of the present application, after the mobile phone enters the camera mode, the professional HDR mode may be automatically activated according to the user's operation of selecting multiple target objects on the preview image of the camera mode. For example, in the photographing mode shown in (a) in Figure 9, the mobile phone displays a preview image of the subject on the preview interface; the mobile phone detects that the user has selected the first target object 901 in the preview image; as shown in Figure 9 As shown in (b), when the mobile phone detects that the user has selected the second target object 902 in the preview image within the preset time, the mobile phone automatically enters the professional HDR mode and displays the image shown in (d) in Figure 9 The preview interface of professional HDR mode.

It should be noted that, in this case, after detecting the user's operation of selecting multiple target objects, the mobile phone generates and saves corresponding target exposure parameters according to the multiple selected target objects. After detecting the user's shooting operation, the mobile phone uses the above target exposure parameters to capture an image, and synthesizes a target image that meets the user's expectations and wishes.

In the embodiment of the present application, the mobile phone can automatically recognize that the user wants to take pictures in the professional HDR mode by detecting that the user selects the target object multiple times in succession. Therefore, the mobile phone generates corresponding target exposure parameters according to multiple target objects selected by the user, so as to capture and synthesize target images that meet the expectations and wishes of the user.

In some embodiments, before automatically starting the professional HDR mode, the mobile phone may prompt the user on the preview interface of the camera mode whether to start the professional HDR mode. Exemplarily, the mobile phone may display a prompt box as shown in (c) in FIG. 9 to prompt the user whether to enter the professional HDR mode. After the user selects "Yes", the mobile phone automatically starts the professional HDR mode, and displays the preview interface of the professional HDR mode as shown in (d) in FIG. 9 .

It should be noted that, in the embodiment of the present application, the user can select any number of target objects greater than 1 according to requirements, and the embodiment of the present application does not limit the number of target objects selected by the user. The user can select the area in the preview image by double-clicking, pressing, long-pressing, drawing a circle or drawing a box, or other methods to delineate the target object. Not limited.

202. After detecting the user's shooting operation, the mobile phone shoots the image to be combined according to the target exposure parameters.

Exemplarily, after the mobile phone detects that the user clicks on the shooting control 1001 shown in (a) in FIG. Two images are stored. That is, the image to be synthesized includes the first image and the second image. It can be understood that the mobile phone can also perform shooting in response to other touch operations, voice commands, or shortcut gestures of the user, and the embodiment of the present application does not limit the specific form of the shooting operation.

For example, when the first target object is the target area 501, the first target object is a part of the sky. In order to prevent the first target object from being overexposed, it is necessary to reduce the amount of incoming light. Therefore, the first target exposure parameter determined by the mobile phone through automatic light metering corresponds to The exposure value is lower. Therefore, as shown in (b) of FIG. 10 , the first image shot with the first target exposure parameter 601 is relatively dark. When the second target object is the target area 502, since the second target object is a part of the person, in order to prevent the second target object from underexposure, it is necessary to increase the amount of incoming light, so the second target exposure parameter determined by the mobile phone through automatic light metering corresponds to The exposure value is high. Therefore, as shown in (c) of FIG. 10 , the first image shot with the second target exposure parameter 602 is brighter. Subsequently, the mobile phone can synthesize the final target image according to the first image and the second image.

In the embodiment of the present application, the number of images taken after the mobile phone detects the user's shooting operation is consistent with the number of target objects selected in the previous step, that is, the number of target exposure parameters generated in the previous step. The embodiment of the present application does not limit the number of captured images.

During the shooting process, the mobile phone continuously captures multiple images. It should be noted that the continuous shooting here refers to the continuous shooting of the mobile phone at the fastest continuous shooting speed. This continuous shooting speed is determined by the hardware, for example, it can shoot dozens of pictures per second. For example, still taking two target objects as an example, the mobile phone continuously captures the first image and the second image during the shooting process, and the shooting interval between the first image and the second image is relatively short and can be ignored. Therefore, it can be considered that the objects in the first image and the second image are basically the same. Wherein, the object is basically consistent can be understood as that the number of objects, object content and object position contained in the first image and the second image are basically the same, so that it can be avoided as far as possible when the image synthesis is performed based on the first image and the second image. Ghosting, ghosting, or blurring occurs when the position of an object is shifted.

In some embodiments, the mobile phone may also obtain the third target exposure parameter by calculating a weighted average of the first target exposure parameter and the second target exposure parameter. The mobile phone captures and stores a third image according to the third target exposure parameter. That is to say, the images to be synthesized include the first image, the second image and the third image. Subsequently, the mobile phone can synthesize the final target image according to the first image, the second image and the third image. It should be noted that the mobile phone may generate the third target exposure parameter before detecting the user's shooting operation, or may generate the third exposure parameter after detecting the user's shooting operation. In the embodiment of the present application, the mobile phone generates the third target exposure parameter The timing of exposure parameters is not limited.

For example, the first target exposure parameter is: the aperture F value is 1.8, the ISO is 200, and the shutter time is 1/50 second, and the second target exposure parameter is: the aperture F value is 1.4, the ISO is 300, and the shutter time is 1/30 Second. The weights corresponding to the first target exposure parameter and the second target exposure parameter are equal, and the mobile phone can calculate the third target exposure parameter by calculating the weighted average value of the first target exposure parameter and the second target exposure parameter. The third target exposure parameters are: the aperture F value is 1.6, the ISO is 250, and the shutter time is 1/40 second. The mobile phone captures and stores a third image according to the third target exposure parameter. The weight in calculating the weighted average value in the embodiment of the present application is determined by the user according to actual needs. The embodiment of the present application does not limit the weights. For example, the weights corresponding to the first target exposure parameter and the second target exposure parameter may be 0.5 and 0.5, or 0.2 and 0.8, or 0.4 and 0.6 respectively.

Exemplarily, when the mobile phone acquires the third target exposure parameter and captures the third image, the mobile phone continuously captures the first image, the second image and the third image during the shooting process. The shooting intervals when the mobile phone shoots the first image, the second image and the third image can be ignored. Therefore, it can be considered that the objects in the first image, the second image, and the third image are basically the same, and the objects are basically the same, which means that the number of objects, object content, and object positions contained in the first image, the second image, and the third image In this way, it is possible to avoid ghosting, ghosting or blurring caused by the positional deviation of the object when compositing images based on the first image, the second image and the third image later.

203. The mobile phone synthesizes the target image according to the image to be synthesized.

After capturing the images to be combined according to the target exposure parameters, the mobile phone can combine the captured images to be combined to generate a final target image.

In the process of image synthesis, the mobile phone performs panorama segmentation on the image to be synthesized first, and obtains a segmentation map of the image to be synthesized. Among them, panorama segmentation is to segment all objects including the background in the image, so as to distinguish different objects on different images. Exemplarily, as shown in FIG. 11 , a segmentation map of an image to be synthesized includes segmented object 1 (sky), object 2 (mountain), object 3 (tree), object 4 (person) and object 5 (animal). Wait. For example, the segmentation map may be a mask (mask) map, and regions where different objects are located may be distinguished by different colors.

There are many schemes for the mobile phone to obtain the target image according to the stored images to be synthesized, which will be described below.

Option One:

The image to be synthesized includes a first image, a second image and a third image, and the mobile phone synthesizes a target image according to the stored first image, second image and third image. After the mobile phone performs panorama segmentation on the first image, the second image and the third image respectively, the corresponding first segmented image, the second segmented image and the third segmented image are obtained. The mobile phone determines the first subject according to the first target object, and determines the second subject according to the second target object.

The description is made by taking the determination of the first subject according to the first target object as an example. If the first target object is the target subject, then the first subject is the first target object; if the first target object is the target area, then the first subject is the subject corresponding to the target area. In some embodiments, the mobile phone may determine the subject corresponding to the target area after determining the first target area in the preview state, and the subject is the first subject. Wherein, the subject corresponding to the target area is the subject where the target area is located or the subject with the largest proportion in the target area.

In other embodiments, in the preview state, the mobile phone can save the coordinates of the target area; after obtaining the image to be synthesized, the mobile phone can determine the subject corresponding to the target area according to the coordinates of the target area, and the subject is the first subject. Wherein, the subject corresponding to the target area is the subject where the target area is located or the subject with the largest proportion in the target area.

The target image may be synthesized by the pixels of the first subject on the first image, the pixels of the second subject on the second image, and other pixels on the third image except for the first subject and the second subject. Exemplarily, (a) in FIG. 12 is the first image taken by the above-mentioned first target exposure parameter 601, (b) in FIG. 12 is the second image taken by the above-mentioned second target exposure parameter 602, and FIG. 12 (c) in (c) is the third image taken with the above-mentioned third target exposure parameters. According to the position of the first subject in the first segmented image, the mobile phone extracts the pixel points of the first subject 1201 at the position on the first image as shown in (a) of FIG. 12 . According to the position of the second subject in the second segmented image, the mobile phone extracts the pixel points of the second subject 1202 at the position on the second image as shown in (b) of FIG. 12 . According to the position of the first subject on the third segmentation map, the mobile phone replaces the pixels of the first subject at this position on the third image as shown in (c) in Figure 12 with the pixels of the first subject 1201 on the first image point. According to the position of the second subject on the third segmentation map, the mobile phone replaces the pixel of the second subject at this position on the third image as shown in (c) in FIG. 12 with the pixel of the second subject 1202 on the second image point. The mobile phone retains the pixels on the third image except for the first subject and the second subject as shown in (c) of FIG. 12 , so as to synthesize the target image. That is to say, in the target image, in the third image, the pixels of the first subject and the pixels of the second subject are respectively divided by the pixels of the first subject of the first image and the pixels of the second subject of the second image The image formed by the replacement.

It should be noted that if the target object selected by the user before is the target area, and the target area is a part of a certain subject, the pixels of the entire subject are replaced instead of only the pixels in the target area. In this way, the problem of image tearing or image blur caused by severe differences in exposure of different areas in the same subject can be avoided, making the final composite target image more natural. Moreover, in general, the reflection and exposure conditions in different areas of the same subject are similar, so the target exposure parameters in the previously selected target area can be applied to the entire subject, and the entire subject can be replaced when compositing images.

That is to say, the pixel value of the first subject corresponding to the first target object on the target image is the same as the pixel value of the first subject on the first image. The pixel value of the second subject corresponding to the second target object on the target image is the same as the pixel value of the second subject on the second image. Pixel values of other pixel points on the target image except the first subject and the second subject are the same as pixel values of corresponding pixel points on the third image.

Wherein, in order to ensure that the synthesized image effect is more natural, during the image synthesis process, the mobile phone performs smooth transition processing on the edges of the replaced first subject and the replaced second subject. Exemplarily, in a smooth transition process, when the mobile phone replaces the pixels of the first subject on the third image with the pixels of the first subject on the first image, the replaced first The edge position of the subject is smoothed outward by 9 pixels, and the pixel values of the 9 pixel points can be sequentially based on the pixel value of the first subject on the replaced first image of the edge position and the original pixel value of the edge position on the third image Adjustment. For example, for a certain edge position A of the first subject on the target image, the pixel values of the adjacent 9 pixel points of the position A that radiate away from the first subject along a certain direction on the first image are a1, a2, a3 in sequence , a4, a5, a6, a7, a8, and a9; the pixel values of the 9 adjacent pixel points of position A radiating toward the outside of the first subject along the same direction on the third image are b1, b2, b3, b4 in sequence, b5, b6, b7, b8 and b9. In this way, the fused pixel values of the 9 adjacent pixels of position A radiating toward the outside of the first subject in the same direction on the target image are: 0.9*a1+0.1*b1, 0.8*a2+0.2*b2, 0.7 *a3+0.3*b3, 0.6*a4+0.4*b4, 0.5*a5+0.5*b5, 0.4*a6+0.6*b6, 0.3*a7+0.7*b7, 0.2*a8+0.8*b8, and 0.1* a9+0.9*b9. In this way, the brightness of the position close to the first subject on the target image tends to the brightness of the first subject on the first image, and the brightness of the position far away from the first subject on the target image approaches the brightness of the third image, so that after replacement The influence of the part of the first image on the brightness of the non-replaced part of the third image is naturally faded from the inside to the outside.

It should be noted that, in the smooth transition process, the number of pixels for which the edge of the replaced subject is smoothed outward is not limited. Generally, the larger the area of the subject to be replaced, the larger the number of outward smoothing pixels, so as to make the smooth transition more natural. In addition, in the smooth transition process, it is enough that the pixel values of the outwardly smoothed pixel points gradually change gradually, and the manner of the pixel values of the outwardly smoothed pixel points is not limited.

Option II:

The image to be synthesized includes a first image and a second image, and the mobile phone synthesizes the stored first image and the second image to obtain a target image. After the mobile phone performs panorama segmentation on the first image and the second image respectively, a corresponding first segmented image and a second segmented image are obtained. The mobile phone determines the first subject according to the first target object, and determines the second subject according to the second target object.

Exemplarily, (a) in FIG. 13 is a first image captured by the first target exposure parameter 601 , and (b) in FIG. 13 is a second image captured by the second target exposure parameter 602 . In some embodiments, the mobile phone extracts the pixel points of the first subject 1301 on the first image as shown in (a) in FIG. 13 according to the position of the first subject in the first segmented image. According to the position of the first subject on the second segmentation map, the mobile phone replaces the pixels of the first subject on the second image shown in (b) in FIG. 13 with the first subject shown in (a) in FIG. 13 Pixels of the first subject 1301 on the image. The mobile phone reserves the pixel points at the position of the second subject 1302 on the second image. The mobile phone registers parts of the first image and the second image except the first subject and the second subject. Afterwards, the mobile phone sets the pixel values of the pixel points on the second image except the first subject and the second subject as the pixel values of the registered first image and the second image except the first subject and the second subject. The weighted average of the pixel values of the pixels, so that the obtained second image is the target image. Exemplarily, the target image may refer to the schematic diagram shown in (c) in FIG. 13 . It should be noted that here, the weighting coefficient may be arbitrarily defined according to requirements, which is not limited in this embodiment of the present application.

That is, the pixel value of the first subject on the target image is the same as the pixel value of the first subject on the first image, the pixel value of the second subject on the target image is the same as the pixel value of the second subject on the second image, and the target image The pixel values of other pixel points except the first subject and the second subject are the weighted average of the pixel values of the corresponding pixel points on the registered first image and the second image.

It can be understood that the mobile phone may also extract pixels of the second subject on the second image according to the position of the second subject in the second segmented image. The mobile phone replaces the pixels of the second subject on the first image with the pixels of the second subject on the second image according to the position of the second subject on the first segmented image. The mobile phone reserves the pixels at the position of the first subject on the first image. The mobile phone registers parts of the first image and the second image except the first subject and the second subject. After that, the mobile phone sets the pixel values of the pixel points on the first image except the first subject and the second subject as the pixel values of the registered first image and the second image except the first subject and the second subject. The weighted average of the pixel values corresponding to the pixel points, so that the first image obtained is the target image. It should be noted that here, the weighting coefficient may be arbitrarily defined according to requirements, which is not limited in this embodiment of the present application. That is to say, the pixels of the first subject on the target image come from the first subject on the first image, the pixels of the second subject on the target image come from the second subject on the second image, and the pixels of other pixels on the target image The value is the weighted average of the pixel values of the corresponding pixel points on the registered first image and the second image.

Similarly, in order to ensure that the synthesized image effect is more natural, during the image synthesis process, the mobile phone may perform smooth transition processing on the edge of the replaced first subject. The specific manner of the smooth transition processing is similar to that in the first solution, and will not be repeated here.

Comparing Scheme 1 and Scheme 2, it can be seen that the advantage of Scheme 1 over Scheme 2 is: for the parts other than the first subject and the second subject, the target image retains the original pixels in the third image, that is, the first subject and the second subject The part other than the second subject is a pixel in the third image captured by the third target exposure parameter obtained according to the weighted average value of the first target exposure parameter and the second target exposure parameter. Since the target object that the user wants to adjust the exposure parameters is usually the part of the image that is too bright or too dark, the entire image to be synthesized obtained according to the target exposure parameters corresponding to the target object may also be overexposed or underexposed, resulting in the Some image details are lost in the image. In this way, in the subsequent process of image synthesis, more image details may be lost in the target image obtained by calculating the weighted average of the pixel values in the image to be synthesized that have lost some image details. Therefore, for parts other than the first subject and the second subject, compared with using the weighted average of the pixel values in the first image and the pixel values in the second image, directly retaining the original pixels on the third image can make The target image can reflect more details of the object to be photographed in the current shooting scene, so that the dynamic range of the target image is larger.

The advantage of Scheme 2 over Scheme 1 is that in Scheme 2, only two images to be synthesized need to be captured, and the time required for shooting is relatively short, while in Scheme 1, three images need to be captured, and the time required for shooting is relatively long. The shorter the shooting time, the less likely the subject to be photographed will move. Therefore, the second solution can better avoid problems such as image ghosting or image blur caused by the mismatch of the subject caused by the movement of the subject to be photographed.

In some embodiments of the present application, after the mobile phone detects the user's shooting operation, it may sequentially display the images to be synthesized and the final target image obtained by shooting according to each target exposure parameter. By displaying the first image taken according to the first target exposure parameter, the second image taken according to the second target exposure parameter, and the final composite target image, the mobile phone can facilitate the user to intuitively see the first image and the second image through comparison. There is overexposure or underexposure, and the effect is poor; while the effect of the final composite target image is better. The shooting method provided by the embodiments of the present application can allow the user to set appropriate target exposure parameters for the subject of interest in the image according to the user's personal needs or wishes during the framing stage of shooting, so as to shoot the image to be synthesized according to the target exposure parameters , so that the target image synthesized according to the image to be synthesized can better meet the user's wishes or expectations, meet the user's personalized shooting needs, and can also improve the quality of the synthesized image, making the image obtained by shooting more natural, and improving user experience.

In other embodiments of the present application, after the mobile phone detects the user's shooting operation, it may not display the images to be synthesized and obtained according to the target exposure parameters, but directly display the final target image.

In some embodiments, since the mobile phone needs a certain synthesis processing time to generate the target image based on the images to be synthesized, the user may be prompted to "processing" or "compositing" or display a rotating circle during the synthesis process of the target image. and other information, so that the user can know that the mobile phone is not stuck or malfunctioning.

In summary, compared with the prior art, the shooting method in the embodiment of the present application has the following beneficial effects:

First, in the embodiment of the present application, the pixel values of the part other than the first subject and the second subject in the final composite target image are the pixel values of the corresponding part in the image captured according to the third target exposure parameter. The three target exposure parameters are calculated according to the weighted average of the first target exposure parameter and the second target exposure parameter, instead of only calculating the weighted average of the pixel values. Therefore, the target image obtained through the shooting method of the embodiment of the present application can retain more details in the shooting object.

In an existing HDR shooting technology, the mobile phone performs global photometry first when shooting. Assuming that the exposure value obtained by photometry is EV, the first image is shot according to +1EV, the second image is shot according to -1EV, and the second image is shot according to EV. Three images. Composite the final image from these three images. Because the second image taken according to -1EV may be partially underexposed, thus missing many details in the image; the first image taken according to +1EV may be partially overexposed, and also may lose many details in the image. The target image is obtained by weighting the pixels of the two images with missing details, which may lack more details and even cause the image to be blurred. However, in the embodiment of the present application, on a certain image to be synthesized, the pixels of one or more subjects that the user is interested in are directly replaced with pixels on another image to be synthesized, so that more details can be preserved, making the image clearer and improving Dynamic Range.

Moreover, in the existing HDR shooting technology, pixel value weighting is used to obtain the pixel value of the final image. Pixels in different regions of the same subject in the target image may come from different images, and pixels in adjacent regions in the same subject may come from different images, which may result in the segmentation of pixels in different regions in the same subject. Different areas (such as adjacent areas) in the same subject have large brightness differences, resulting in unnatural synthetic target images and poor image effects.

In another prior art, the mobile phone obtains a preview image through global metering, and divides the pixels of the image into a first set of pixels with higher brightness and a second set of pixels with lower brightness according to the magnitude of the pixel value. The user can respectively adjust the first target exposure parameter and the second target exposure parameter respectively corresponding to the first pixel set and the second pixel set. In the final image, the first set of pixels is obtained by using the first target exposure parameter, and the second set of pixels is obtained by using the second target exposure parameter. Wherein, the pixel values in each pixel set may be scattered rather than completely concentrated. In this way, on the final image, different pixel values in the same subject or in adjacent regions may belong to different pixel sets, and thus obtained by using different target exposure parameters, and the pixel values in different regions of the same subject may be quite different, so that the same The pixels in different regions of the subject are fragmented, and the brightness of different regions (such as adjacent regions) in the same subject has a large difference in brightness, resulting in an unnatural and poor image effect in the synthesized target image. However, in the embodiment of the present application, pixel replacement is performed for the target subject, which avoids the problem of image segmentation that may exist in the prior art.

Second, in the embodiment of the present application, the target exposure parameter is determined according to the target object selected by the user, which is in line with the user's wish or expectation. In this way, the final synthesized target image of the images to be synthesized obtained according to the target exposure parameters can be more in line with the wishes or expectations of the user and meet the user's personalized shooting needs, thereby improving the user's shooting experience.

The exposure of each part of the image in the existing HDR shooting technology is completely automatically generated by the mobile phone and cannot be selected manually, so it may not meet the user's expectations, and serious distortion may occur. For example, under normal visual effects, it may indeed be a relatively dark part, but the mobile phone automatically adjusts it to be brighter, which does not meet the visual effects, resulting in image distortion. However, in the embodiment of the present application, the exposure parameters can be manually adjusted or set by the user, so that the final target image conforms to the user's expectations or wishes, improves the image quality, and makes the image more natural.

Third, in the embodiment of the present application, after the mobile phone detects the user's shooting operation, it automatically shoots and synthesizes the target image, and forms a piece at one time without post-adjustment. It simplifies the difficulty of post-processing images for users.

In some existing technologies, the user often needs to perform post-processing on the image in order to obtain a target image that meets the user's expectations or wishes. Image post-processing is cumbersome and difficult. However, in the embodiment of the present application, after the mobile phone detects the user's shooting operation, it automatically shoots and synthesizes the target image, and forms a piece at one time without post-adjustment. It simplifies the difficulty of post-processing images for users.

The above is described by taking the user selecting two target objects as an example, and the user may also select more than two N areas. In this case, the mobile phone generates N target exposure parameters corresponding to the N target objects selected by the user, and uses the N target exposure parameters to obtain N images to be synthesized, so as to generate a final target image based on the N images to be synthesized. Alternatively, the mobile phone may determine the N+1th exposure parameter according to the N target exposure parameters, thereby obtaining N+1 images to be synthesized according to the N+1 exposure parameters, thereby generating the final target image based on the N+1 images to be synthesized .

In the shooting method provided in the embodiment of the present application, the mobile phone may determine target exposure parameters corresponding to different target subjects according to the user's wishes, and obtain an image to be synthesized according to the target exposure parameters. During image synthesis, the pixels in the image to be synthesized are replaced in units of subject, so that the exposure of different subjects on the target image can be flexibly adjusted.

The image synthesis process described in the above embodiments is based on pixel replacement in units of subjects. In some other embodiments, pixel replacement may also be performed in units of regions. For example, when the user wants to adjust the exposure of a certain target area, the target area can be selected, and the mobile phone generates exposure parameters corresponding to the target area through automatic light metering. Afterwards, the mobile phone shoots the image to be synthesized according to the generated exposure parameters, and when synthesizing the target image, only the pixel values in the target area on the image to be synthesized are replaced, and the pixel values of the subject corresponding to the target area are not replaced. In this way, the mobile phone can flexibly adjust the exposure of different areas on the target image according to the user's wishes. When there is a difference between light and shade in the same subject, the user can select an area to replace only a part of the pixel values in the subject, so as to meet the user's finer-grained exposure adjustment needs and higher shooting needs.

In some other embodiments, the photographed object on the image may include multiple parts, for example, a person may include parts such as head, body, arms, hands, legs, and feet. The mobile phone can also perform component segmentation on the collected images, thereby demarcating the areas where different components are located. The mobile phone can also perform pixel replacement in units of components. For example, a target object may be a target component. When the user wants to adjust the exposure of a certain component, he can select the target component or the target area where the component is located, and the mobile phone can automatically measure light to generate the exposure parameters corresponding to the target component. Afterwards, the mobile phone shoots the image to be synthesized according to the generated exposure parameters, and only replaces the pixel values in the target part on the image to be synthesized when synthesizing the target image. In this way, the mobile phone can flexibly adjust the exposure of different components on the target image according to the user's wishes.

In some other embodiments, the mobile phone may also save the image to be synthesized while saving the final synthesized target image. For example, the mobile phone can save an image sequence, including the image to be synthesized and the target image sequentially obtained during the shooting process of the professional HRR mode. The mobile phone can play the images in the image sequence sequentially in response to the user's operation.

It should also be noted that the above is an example of an electronic device as a mobile phone. When the electronic device is another device with a shooting function (such as a tablet computer, a wearable device, an AR/VR device, or a camera device), the same The shooting method provided in the embodiment of the present application may be used to perform image synthesis to generate a target image, which will not be repeated here.

It can be understood that, in order to realize the above functions, the electronic device includes hardware and/or software modules corresponding to each function. Combining the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions in combination with the embodiments for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

In this embodiment, the functional modules of the electronic device may be divided according to the above method example. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above integrated modules may be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic, and is only a logical function division, and there may be other division methods in actual implementation.

For example, in one division mode, referring to FIG. 14 , the electronic device 1400 includes a mode determination module 1401 , a parameter acquisition module 1402 , an image acquisition module 1403 , an image segmentation module 1404 and an image synthesis module 1405 . Wherein, the mode determination module is configured to determine to enter the professional HDR mode according to the user's instruction to enter the professional HDR mode, or to determine to enter the professional HDR mode according to the user's operation of selecting a target object. The parameter obtaining module is used to obtain various target exposure parameters according to the target object indicated by the user in the professional HDR mode. The image acquisition module is used to shoot the image to be synthesized according to the target exposure parameters acquired by the parameter acquisition module in the professional HDR mode. The image segmentation module is used for panoramic segmentation of the image to be synthesized or the preview image, so as to distinguish the image areas where different objects are located, for example, determine the image area where the subject corresponding to the target object is located. The image synthesis module is used to synthesize the image to be synthesized into a final target image by performing pixel replacement on the image area where the subject corresponding to the target object is located.

The embodiment of the present application also provides an electronic device, including one or more processors and one or more memories. The one or more memories are coupled with one or more processors, the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device performs The above related method steps implement the photographing method in the above embodiment.

Embodiments of the present application also provide a computer-readable storage medium, where computer instructions are stored in the computer-readable storage medium, and when the computer instructions are run on the electronic device, the electronic device executes the above-mentioned related method steps to realize the above-mentioned embodiment shooting method in .

Embodiments of the present application also provide a computer program product, which, when running on a computer, causes the computer to execute the above-mentioned related steps, so as to implement the photographing method performed by the electronic device in the above-mentioned embodiments.

In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, The processor can execute the computer-executable instructions stored in the memory, so that the chip executes the photographing method performed by the electronic device in the above method embodiments.

Wherein, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment is all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the above-mentioned The beneficial effects of the corresponding method will not be repeated here.

Through the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be assigned by different Completion of functional modules means that the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be Incorporation or may be integrated into another device, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or may be distributed to multiple different places . Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium Among them, several instructions are included to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods described in the various embodiments of the present application. The above-mentioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk, and other various media that can store program codes.

The above content is only the specific implementation of the application, but the scope of protection of the application is not limited thereto. Anyone familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the application, and should covered within the scope of protection of this application. Therefore, the protection scope of the present application should be determined by the protection scope of the claims.

Claims (18)

1. A shooting method, characterized in that, comprising: The electronic device enters the target shooting mode of the camera application and displays a preview interface; After the electronic device detects the user's operation on the first target object on the preview image, determine the first target exposure parameter according to the first target object; After the electronic device detects the user's operation on the second target object on the preview image, determine a second target exposure parameter according to the second target object; After the electronic device detects the user's shooting operation, it displays a target image, the target image is generated according to the first image to be combined and the second image to be combined; the first image to be combined is taken according to the first target exposure parameter Obtaining, the second image to be synthesized is obtained by shooting according to the second target exposure parameter; After the electronic device determines a first target exposure parameter according to the first target object, obtains one or more frames of first preview images according to the first target exposure parameters, and displays the first preview images on a preview interface , the first preview image is an image synthesized from an image taken according to global exposure parameters and an image taken by the first target exposure parameters; After the electronic device determines a second target exposure parameter according to the second target object, obtains one or more frames of second preview images according to the second target exposure parameters, and displays the second preview images on a preview interface , the second preview image is an image synthesized according to the image captured by the global exposure parameters and the image captured by the second target exposure parameters. 2. The method according to claim 1, wherein after the electronic device enters the target shooting mode of the camera application, the method further comprises: The electronic device prompts the user to select a plurality of target objects. 3. The method according to claim 1, wherein the operation on the first target object comprises a single-click operation, a double-click operation, a pressure press operation, a long press operation or Circle the operation of the first target object. 4. A shooting method, characterized in that, comprising: The electronic device opens the camera application and displays a preview interface for taking pictures; After the electronic device detects the user's operation on the first target object on the preview image, determine the first target exposure parameter according to the first target object; After the electronic device detects the user's operation on the second target object on the preview image, determine a second target exposure parameter according to the second target object; The electronic device enters a target shooting mode; After the electronic device detects the user's shooting operation, it displays a target image, the target image is generated according to the first image to be combined and the second image to be combined; the first image to be combined is taken according to the first target exposure parameter Obtaining, the second image to be synthesized is obtained by shooting according to the second target exposure parameter; After the electronic device determines a first target exposure parameter according to the first target object, obtains one or more frames of first preview images according to the first target exposure parameters, and displays the first preview images on a preview interface , the first preview image is an image synthesized from an image taken according to global exposure parameters and an image taken by the first target exposure parameters; After the electronic device determines a second target exposure parameter according to the second target object, obtains one or more frames of second preview images according to the second target exposure parameters, and displays the second preview images on a preview interface , the second preview image is an image synthesized according to the image captured by the global exposure parameters and the image captured by the second target exposure parameters. 5. The method according to claim 4, wherein the electronic device enters the target shooting mode, comprising: The electronic device prompts the user whether to enter the target shooting mode; The electronic device enters the target shooting mode in response to a user's instruction operation. 6. The method according to claim 4, wherein the operation on the first target object comprises a double-click operation, a pressure press operation, a long press operation or a circle around the first target object An operation on a target object. 7. The method according to any one of claims 1-6, wherein the method further comprises: Before the electronic device displays the target image, display the first image to be combined and the second image to be combined respectively. 8. The method according to any one of claims 1-6, wherein the electronic device determines a first target exposure parameter according to the first target object, comprising: The electronic device performs automatic photometry according to the reflected light of the object to be photographed corresponding to the first target object; The electronic device determines the first target exposure parameter according to the result of automatic photometry. 9. The method of claim 8, further comprising: After the electronic device detects the user's operation on the first target object on the preview image, it displays an exposure adjustment control on the preview interface; The electronic device adjusts the first target exposure parameter in response to a user's operation on the exposure adjustment control. 10. The method according to any one of claims 1-6, wherein the electronic device determines the first target according to the first target object after detecting the user's operation on the first target object on the preview image Exposure parameters, including: After the electronic device detects the user's operation on the first target object on the preview image, it displays the exposure setting control corresponding to the first target object on the preview interface; The electronic device determines the first target exposure parameter in response to the user's operation on the exposure setting control. 11. The method according to any one of claims 1-6, wherein the pixel value of the first subject on the target image is the same as the pixel value of the first subject on the first image to be synthesized, The first subject is a subject corresponding to the first target object; The pixel value of the second subject on the target image is the same as the pixel value of the second subject on the second image to be synthesized, and the second subject is the subject corresponding to the second target object; The pixel values of other pixel points on the target image except for the first subject and the second subject are corresponding pixel points on the first image to be synthesized and the second image to be synthesized after registration The weighted average of the pixel values of . 12. The method according to any one of claims 1-6, wherein the method further comprises: The electronic device obtains a third target exposure parameter according to the first target exposure parameter and the second target exposure parameter; The target image is generated according to the first image to be synthesized, the second image to be synthesized, and the third image to be synthesized, and the third image to be synthesized is obtained according to the third target exposure parameter. 13. The method of claim 12, further comprising: After the electronic device detects the user's shooting operation, it displays the third image to be synthesized. 14. The method according to claim 12, wherein the pixel value of the first subject on the target image is the same as the pixel value of the first subject on the first image to be synthesized, and the first subject is the subject corresponding to the first target object; The pixel value of the second subject on the target image is the same as the pixel value of the second subject on the second image to be synthesized, and the second subject is the subject corresponding to the second target object; Pixel values of other pixel points on the target image except for the first subject and the second subject are the same as pixel values of corresponding pixel points on the third image to be synthesized. 15. The method according to claim 11, wherein the first target object is a first target subject, and the first subject is the first target subject; Alternatively, the first target object is a first target area, and the first subject is a subject where the first target area is located, or the first subject is an area among multiple subjects included in the first target area. largest subject. 16. The method according to any one of claims 1-6, wherein the first target exposure parameter includes one or more of sensitivity ISO, aperture, shutter time or exposure value EV. 17. An electronic device, characterized in that it comprises: a screen for displaying an interface; one or more processors; memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the electronic device, cause the The electronic device executes the shooting method according to any one of claims 1-16. 18. A computer-readable storage medium, characterized by comprising computer instructions, and when the computer instructions are run on a computer, the computer is made to execute the photographing method according to any one of claims 1-16.

Images