CN107800962B - Image processing method, device and electronic device - Google Patents

Abstract

the invention provides an image processing method, an image processing device and an electronic device, wherein the method is used for the electronic device, the electronic device comprises a structural light emitter and an image collector, and the method comprises the following steps: continuously selecting a set of light source points from the array of light sources in the structured light emitter in a direction extending from the first area to around the first area; wherein the first region is located at a central position of the light source array; turning on the set of light source points; projecting structured light to a current user through the light source point set and closing the light source point set after the structured light is projected; and controlling an image collector to shoot the structured light image modulated by the current user every time and performing image superposition to obtain a target image. By the method, the instantaneous power consumption of the mobile terminal during shooting can be reduced, and the technical problem of high instantaneous power consumption in the prior art is solved.

Description

Image processing method, device and electronic device

technical field

The present invention relates to the technical field of mobile terminals, and in particular, to an image processing method, device and electronic device.

Background technique

With the development of mobile terminal technology, structured light technology is gradually applied to mobile terminals. However, in the existing mobile terminals that use structured light technology to take pictures, when taking pictures, all light sources of the structured light are projected onto the photographed object at the same time, resulting in high instantaneous power consumption of the mobile terminal and obvious heat generation.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide an image processing method, device, and electronic device, so as to reduce the instantaneous power consumption of a mobile terminal when shooting, and solve the technical problem of large instantaneous power consumption in the prior art.

The image processing method of the embodiment of the present invention is applied to an electronic device, and the electronic device includes a structured light emitter and an image collector, and the image processing method includes:

According to the direction extending from the first area to the periphery of the first area, a light source point set is continuously selected from the light source array in the structured light emitter; wherein, the first area is located at the center of the light source array ;

turn on the light source point set;

Projecting structured light to the current user through the light source point set and turning off the light source point set after projecting the structured light;

The image collector is controlled to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image.

An image processing apparatus according to an embodiment of the present invention is used in an electronic apparatus, and the image processing apparatus includes:

Structured light transmitter, used to transmit structured light to the current user;

an image collector for capturing the structured light image modulated by the current user;

a processor for:

According to the direction extending from the first area to the periphery of the first area, a light source point set is continuously selected from the light source array in the structured light emitter; wherein, the first area is located at the center of the light source array ;

turn on the light source point set;

Projecting structured light to the current user through the light source point set and turning off the light source point set after projecting the structured light;

The image collector is controlled to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image.

An electronic device of an embodiment of the present invention includes: one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more programs Executed by each processor, the program includes instructions for executing the image processing method described in the above embodiments.

The computer-readable storage medium of the embodiments of the present invention includes a computer program used in conjunction with an electronic device capable of imaging, and the computer program can be executed by a processor to complete the image processing method described in the above-mentioned embodiments.

The image processing method, device and electronic device according to the embodiments of the present invention continuously select a light source point set from the light source array in the structured light emitter according to the direction extending from the first area to the periphery of the first area, and turn on the light source point set , project structured light to the current user through the light source point set and turn off the light source point set after projecting the structured light, control the image collector to capture the structured light image modulated by the current user each time and superimpose the image to obtain the target image. Since the light source point set is selected in the way of extending from the middle to the surrounding directions during the shooting process and the light source points are turned on for shooting, the structured light emitter can be controlled to project only a small amount of structured light each time during shooting, and can be divided into multiple light sources. to cast. Because only a small amount of structured light is projected each time, the instantaneous power consumption during shooting can be effectively reduced, which is conducive to heat dissipation, avoids obvious heating of the mobile terminal, and solves the problem of the mobile terminal in the prior art when all light sources are turned on to project structured light. The technical problem of large instantaneous power consumption. Further, since all light source points can be covered by means of multiple projections, the imaging of the photographed object can be completed and the imaging quality can be ensured.

Additional aspects and advantages of the present invention will be set forth, in part, from the following description, and in part will be apparent from the following description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic flowchart of an image processing method proposed by an embodiment of the present invention;

FIG. 2 is a schematic diagram of a light source array composed of uniformly arranged light source lattices;

3 is a schematic flowchart of an image processing method proposed by another embodiment of the present invention;

FIG. 4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention; and

FIG. 6 is a schematic structural diagram of an image processing circuit in a terminal according to an embodiment of the present invention.

Detailed ways

The following describes in detail the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

The image processing method, device, and electronic device according to the embodiments of the present invention are described below with reference to the accompanying drawings.

FIG. 1 is a schematic flowchart of an image processing method proposed by an embodiment of the present invention. The method can be used in an electronic device, and the electronic device can be a mobile terminal such as a mobile phone and a tablet computer. The electronic device includes a structured light emitter and an image collector, wherein the structured light emitter is used for projecting structured light to a shooting object, and the image collector is used for shooting a structured light image modulated by the shooting object.

As shown in Figure 1, the image processing method includes the following steps:

Step 101, continuously select a light source point set from the light source array in the structured light emitter according to the direction extending from the first area to the periphery of the first area.

Wherein, the first area is located at the center of the light source array.

At present, with the development of mobile terminal technology, the functions of the mobile terminal are becoming more and more abundant, and the face recognition function has gradually become a standard configuration of the mobile terminal. For example, more and more mobile terminals support face unlocking, face payment, etc. When a user uses a related function that needs to perform face recognition, after the related function is enabled, the mobile terminal calls the built-in camera to perform image acquisition, so as to obtain an image containing a human face.

When actually taking pictures, the user usually likes to display the most critical part of the object to be photographed in the middle position of the image, that is, when taking pictures, the middle position of the camera is generally aimed at the key part of the object to be photographed. For example, when the user takes a selfie, the user's face image is usually displayed in the middle of the screen of the mobile terminal. Therefore, when taking a photo, especially when using functions such as face unlocking and face payment to collect the face image of the current user, the camera can be controlled to preferentially collect images of the most critical parts of the subject.

Therefore, in this embodiment, the area where the light source points included in the center position of the light source array in the structured light emitter are located can be set as the first area, and then starting from the first area, according to the order from the first area to the surrounding area of the first area In the direction of extension, a set of light source points is continuously selected from the light source array in the structured light emitter.

FIG. 2 is a schematic diagram of a light source array composed of uniformly arranged light source lattices. For ease of understanding, the light source array shown in FIG. 2 is used as an example for explanation below. The light source array shown in Figure 2 is composed of 8*8 light source points. It is assumed that each column in the light source array is numbered in the order from left to right, which is the first column, the second column, ..., the eighth column. ; Each row in the light source array is numbered in order from top to bottom, followed by row 1, row 2, ..., row 8, as shown in Figure 2, and assuming the area 21 shown in Figure 2 is the first area, that is, the first area contains 4 light source points, which are the two light source points in the 4th column and the 5th column in the 4th row, and the two light sources in the 4th column and the 5th column in the 5th row. point.

It should be understood that, in practical applications, the light source array can be composed of light source points of circular pattern, cross pattern, etc., and the size of the light source array is much larger than that of the light source array shown in Fig. 2. The light source array shown is only an example, not a limitation of the present invention.

As an example, when a light source point set is selected, the light source point set selected each time may include the first region. Taking the light source array shown in FIG. 2 as an example, the light source point set selected for the first time may be the light source points included in the first area, that is, the light source points in the area 21 in FIG. 2 ; the light source point set selected for the second time includes The light source point set selected for the first time is included. For example, the light source point set selected for the second time may be the set composed of the light source points contained in the area 22 in FIG. 2; the light source point set selected for the third time includes the light source point set selected for the second time. Including the light source point set, for example, the light source point set selected for the third time may be the set composed of the light source points included in the area 23 in FIG. 2 ; and so on.

As another example, when the light source point set is selected, except that the light source point set selected for the first time includes the first region, the light source point set selected each time thereafter does not include the light source points in the first region. Still taking the light source array shown in FIG. 2 as an example, the light source point set selected for the first time may be the light source points contained in the first area, that is, the light source points in the area 21 in FIG. 2; the light source point set selected for the second time does not include the light source points in the light source point set selected for the first time, for example, the light source point set selected for the second time can be the set composed of the light source points in the annular area between area 21 and area 22; The light source point set of 1 does not include the light source points in the first two selected light source point sets, for example, the third selected light source point set may be the set of light source points in the annular area between the area 22 and the area 23; And so on.

It should be noted here that the set of light source points selected for the first time may not only include the light source points in the first area, but also include the light source points around the first area. For example, the light source points included in the area 22 in FIG. The light source points form the set of light source points selected for the first time. The above examples are only used as examples and cannot be used to limit the present invention.

Step 102: Turn on the light source point set.

In this embodiment, after the light source point set is selected from the light source array of the structured light transmitter, the structured light transmitter can be controlled to turn on all light source points in the selected light source point set.

Step 103 , project the structured light to the current user through the light source point set, and turn off the light source point set after the structured light is projected.

For the light source point set that is turned on each time, the electronic device can control the structured light emitter to project structured light to the current user through the currently turned on light source point set, and close the currently turned on light source point set after the structured light emitter finishes projecting the structured light. light source inside.

Step 104 , controlling the image collector to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image.

In this embodiment, after all the light source points in the currently turned on light source point set project the structured light to the current user, the structured light reaches the current user and changes due to the modulation of the current user after reaching the current user. The device controls the image collector to capture the structured light image modulated by the current user. After the structured light emitter projects the structured light through the set of light source points turned on each time, the image collector captures the corresponding structured light image, and superimposes the obtained structured light image to obtain the target image.

In the image processing method of this embodiment, a light source point set is continuously selected from the light source array in the structured light emitter according to the direction extending from the first area to the periphery of the first area, the light source point set is turned on, and the light source point set is sent to the light source point set. The current user projects the structured light and turns off the light source point set after projecting the structured light, and controls the image collector to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image. Since the light source point set is selected in the way of extending from the middle to the surrounding directions during the shooting process and the light source points are turned on for shooting, the structured light emitter can be controlled to project only a small amount of structured light each time during shooting, and can be divided into multiple light sources. to cast. Because only a small amount of structured light is projected each time, the instantaneous power consumption during shooting can be effectively reduced, which is conducive to heat dissipation, avoids obvious heating of the mobile terminal, and solves the problem of the mobile terminal in the prior art when all light sources are turned on to project structured light. The technical problem of large instantaneous power consumption. Further, since all light source points can be covered by means of multiple projections, the imaging of the photographed object can be completed and the imaging quality can be ensured.

In order to explain the previous embodiment more clearly, the embodiment of the present invention proposes another image processing method, and FIG. 3 is a schematic flowchart of the image processing method proposed by another embodiment of the present invention.

As shown in Figure 3, the image processing method may include the following steps:

Step 201: Select the light source points in the first area as the light source point set.

Since the middle area of the camera is generally aimed at the key part of the object when shooting, the image collector can be controlled to first collect the image of the key part when shooting. Therefore, in this embodiment, when capturing a structured light image, the light source point at the center of the light source array in the structured light emitter can be controlled to project structured light to the current user, so as to preferentially acquire the structured light image of key parts.

In this embodiment, the area where the light source point at the center of the light source array is located may be preset as the first area, and when shooting, the light source points in the first area may be selected as the light source point set. The present invention does not limit the size of the first area. For example, the area 21 in the light source array shown in FIG. 2 can be used as the first area, and the area 22 can also be used as the first area.

Step 202: Turn on the light source point set.

Step 203, project the structured light to the current user through the light source point set, and turn off the light source point set after the structured light is projected.

In this embodiment, after each light source point set is selected, the electronic device can control to turn on the light source points in the selected light source point set, and project structured light to the current user through the turned on light source point set. After all the light source points in the turned on light source point set have finished projecting the structured light, the electronic device controls the light source points in the light source point set to turn off.

Step 204, after the structured light is projected from the light source point set corresponding to the first area, according to the direction extending from the first area to the periphery of the first area, starting from the boundary of the first area, and determining the next area according to the preset distance interval border.

For the light source point set selected for the first time, after the light source point set corresponding to the first area has projected the structured light, when controlling the image collector to capture the structured light image modulated by the current user, you can also follow the steps from the first area to the first area. The direction extending around an area starts from the boundary of the first area, and determines the boundary of the next area according to a preset distance.

The preset distance may be an interval of a predetermined number of light source points, for example, the distance between two light source points is used as the preset distance, and the distance between the two light source points is used as the preset distance.

Taking the light source array shown in FIG. 2 as an example, the set of light source points selected for the first time is the first area, and after the light source points in the first area (area 21 in FIG. The interval between two adjacent light source points is used as a preset distance to determine the boundary of the next area. At this time, the boundary of the next area after the first area can be determined as the boundary of the area 22, and then the boundary of the next area can be determined. is the boundary of area 23. Alternatively, the interval between the three adjacent light source points in the same row can also be used as a preset distance to determine the boundary of the next area. In this case, the boundary of the next area after the first area can be determined as the boundary of the area 23 .

Step 205 , starting from the structured light image captured for the first time, image superimposition of the currently captured structured light image and the last obtained structured light image to obtain a first image.

When the light source point set is selected and turned on for the first time, after all the light source points in the light source point set have projected the structured light, the electronic device controls the image collector to shoot to obtain the first structured light image. For the first shooting, there is no structured light image that can be superimposed with the first structured light image before, so the first structured light image can be used as the first image obtained after the first shooting.

When the light source point set is selected for the second time and all the light source points in the light source point set are turned on, after all the light source points in the light source point set have finished projecting the structured light, the electronic device controls the image collector to perform a second shooting, and obtains A second structured light image is obtained, and the second structured light image is superimposed with the first structured light image to obtain a superimposed structured light image, and the superimposed structured light image is used as the first image.

When the light source point set is selected for the third time and all the light source points in the light source point set are turned on, after all the light source points in the light source point set project the structured light, the electronic device controls the image collector to shoot for the third time, and obtains The third structured light image, and superimpose the currently captured third structured light image with the superimposed structured light image obtained after the second shooting, to obtain the superimposed structured light image and use it as the first image . That is to say, the first image obtained after the third shooting includes the first structured light image, the second structured light image and the third structured light image.

And so on until the shooting ends.

Generally speaking, in this embodiment, in addition to the structured light image obtained by the first shooting, the first image obtained in the subsequent shooting process includes the structured light image obtained this time and the structure obtained by each previous shooting. light image.

Step 206, judging whether a complete face image can be extracted from the first image.

In this embodiment, every time the light source point set is turned on, and the structured light is projected to the current user through all the light source points in the currently turned on light source point set, after the current shooting is completed and the first image is obtained, it can be further judged whether it can be obtained from the A complete face image is extracted from the obtained first image.

Specifically, when judging, a second image including facial features may be first extracted from the first image, where the facial features may include eyebrows, eyes, nose, mouth, ears, and the like. For example, a related face recognition technology can be used to extract the second image from the first image. Matching the extracted second image with the authorized face image stored on the electronic device, wherein the authorized face image may be one or more images, may be multiple different images of an authorized user, or may be Multiple images of multiple different authorized users, and authorized face images may be pre-stored in the memory of the electronic device.

When matching the extracted second image with the authorized face image, the features of the current user's facial organs can be extracted from the second image first, and then the extracted features of the facial organs can be compared with those in the authorized face image. The features of facial organs are compared, and when the extracted features of each facial organ are consistent with the features of the corresponding facial organs in at least one of the authorized face images, then at least one of the authorized face images is used as the target authorized face. image.

When the target authorized face image is matched from the authorized face image stored in the electronic device, it is determined that a complete face image is extracted from the first image, and then step 208 is executed; When the target authorized face image is not matched in the face image, it is determined that a complete face image cannot be extracted from the first image, and step 207 is executed to continue to select the light source point set and shoot a new structured light image.

Further, in a possible implementation manner of the embodiment of the present invention, when the electronic device is currently in a locked state, after matching the target authorized face image, the electronic device can also be unlocked.

Because when the second image matches and recognizes the authorized face image, there are two situations: the second image is incomplete, and the second image is complete but not the authorized user's face image. Therefore, in the embodiment of the present invention, a possible implementation manner , after extracting the features of the facial organs from the second image, you can first determine whether the features of the extracted facial organs are complete, that is, whether the features of the facial organs extracted from the second image can completely represent the face of the current user Organs, if the features of the extracted facial organs are incomplete, then perform step 207; if the features of the extracted facial organs are complete, then further compare the features of the extracted facial organs with the faces in the authorized face image stored on the electronic device The features of the organs are matched, and after the matching is passed, step 208 is performed; if the matching fails, step 209 is performed and the shooting is ended. At this time, if the electronic device is in a locked state, the locked state is maintained. The payment function is enabled, the payment is refused.

Step 207, gradually selecting the light source points between the boundaries of two adjacent regions as the light source point set.

For example, taking FIG. 2 as an example, when the interval between two adjacent light source points in the same row is used as the preset distance to determine the boundary of the next area, the boundary between the boundary of the area 21 and the boundary of the area 22 can be selected. The light source point of , as the light source point set, at this time, the light source point set contains 12 light source points; when the interval between the three adjacent light source points in the same row is used as the preset distance to determine the boundary of the next area , the light source points between the boundary of the area 21 and the boundary of the area 23 may be selected as the light source point set, and at this time, the light source point set includes 32 light source points.

After selecting the next light source point set, you can return to step 202 to start the light source point set, and project structured light to the current user through the light source points in the light source point set, so that the image collector can obtain a new first light source point set. an image.

It should be noted here that, after steps 202 and 203 are performed for the second and subsequent selected light source point sets, only step 205 and its subsequent steps are performed, and step 204 is not performed.

Step 208, using the first image as the target image.

In this embodiment, when a target authorized face image is matched, it is determined that a complete face image is extracted from the first image, and at this time, the first image is used as the target image.

Step 209, controlling the structured light emitter to stop the emission of structured light.

In order to further reduce the power consumption of the electronic device, in this embodiment, after determining that a complete face image is extracted from the first image, the electronic device can control the structured light emitter to stop emitting structured light.

In the image processing method of this embodiment, the boundary of the next area is determined according to the preset distance interval, starting from the boundary of the first area, and the boundary of the two adjacent areas is gradually selected by extending from the middle to the surrounding direction. The light source points in between are used as the light source point set. During the shooting process, the light source point set is continuously selected and the light source point is turned on for shooting. During shooting, the structured light emitter can be controlled to project only a small amount of structured light each time, and can be divided into Performing multiple projections can effectively reduce the instantaneous power consumption during shooting, which is conducive to heat dissipation and avoids obvious heating of the mobile terminal. The first image is obtained by superimposing the images taken each time, and it is judged whether a complete face image can be extracted from the first image, and when the complete face image is extracted, the first image is used as the target image, and The structured light emitter is controlled to stop the emission of the structured light, so that the projected quantity of the structured light can be reduced and the power consumption of the electronic device can be reduced.

In order to realize the above embodiments, the present invention also provides an image processing apparatus.

4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention. The image processing apparatus is used in an electronic apparatus, and the electronic apparatus may be a mobile terminal such as a mobile phone and a tablet computer.

As shown in FIG. 4 , the image processing apparatus 40 includes: a structured light emitter 410 , an image collector 420 , and a processor 430 . in,

The structured light transmitter 410 is used for transmitting structured light to the current user.

The image collector 420 is used for capturing the structured light image modulated by the current user.

A processor 430, the processor 430 is used to:

According to the direction extending from the first area to the periphery of the first area, a light source point set is continuously selected from the light source array in the structured light emitter 410; wherein, the first area is located at the center of the light source array;

Open the light source point collection;

Project structured light to the current user through the light source point set and turn off the light source point set after projecting the structured light;

The image collector 420 is controlled to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image.

Specifically, the process of selecting the light source point set by the processor 430 may include: selecting the light source points in the first area as the light source point set; The direction extending around the first area starts from the boundary of the first area, and determines the boundary of the next area according to a preset distance interval; and gradually selects the light source points between the boundaries of two adjacent areas as the light source point set.

The processor 430 controls the image collector 420 to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image, starting from the structured light image captured for the first time, and combining the currently captured structured light image with the image. The structured light image obtained last time is superimposed to obtain a first image, and then it is judged whether a complete face image can be extracted from the first image, and when a complete face image can be extracted, the first image is used as target image. Further, after the target image is obtained, the structured light emitter 410 can be controlled to stop the emission of structured light.

Specifically, the process of determining whether a complete face image can be extracted from the first image by the processor 430 may include: extracting a second image including facial features from the first image, and storing the second image with the electronic device on the electronic device The authorized face image is matched, and if the target authorized face image is matched, it is determined that a complete face image is extracted from the first image.

Further, the processor 430 can extract the features of the facial parts from the second image; compare the extracted features of the facial parts with the features of the facial parts in the authorized face image; when the extracted features of each facial part are When the features of the corresponding facial organs in one of the authorized face images are consistent, one of the authorized face images is used as the target authorized face image.

When the electronic device is currently in a locked state, after matching the target authorized face image, the electronic device is unlocked.

It should be noted that, the foregoing explanations of the image processing method embodiments are also applicable to the image processing apparatus of this embodiment, and the implementation principles thereof are similar, which will not be repeated here.

The image processing apparatus of this embodiment selects a light source point set from the light source array in the structured light emitter continuously according to the direction extending from the first area to the periphery of the first area, starts the light source point set, and sends the light source point set to the light source point set. The current user projects the structured light and turns off the light source point set after projecting the structured light, and controls the image collector to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image. Since the light source point set is selected in the way of extending from the middle to the surrounding directions during the shooting process and the light source points are turned on for shooting, the structured light emitter can be controlled to project only a small amount of structured light each time during shooting, and can be divided into multiple light sources. to cast. Because only a small amount of structured light is projected each time, the instantaneous power consumption during shooting can be effectively reduced, which is conducive to heat dissipation, avoids obvious heating of the mobile terminal, and solves the problem of the mobile terminal in the prior art when all light sources are turned on to project structured light. The technical problem of large instantaneous power consumption. Further, since all light source points can be covered by means of multiple projections, the imaging of the photographed object can be completed and the imaging quality can be ensured.

In order to realize the above embodiments, the present invention also provides an electronic device.

FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. As shown in FIG. 5 , the electronic device 50 includes: one or more processors 501 , a memory 502 and one or more programs 503 . Wherein, one or more programs 503 are stored in the memory 502 and configured to be executed by one or more processors 501 , and the programs 503 include instructions for executing the image processing method described in any of the foregoing embodiments.

An embodiment of the present invention further provides a terminal, including an image processing circuit, which may be implemented by hardware and/or software components, and may include various processing units that define an ISP (Image Signal Processing, image signal processing) pipeline. FIG. 6 is a schematic structural diagram of an image processing circuit in a terminal according to an embodiment of the present invention. For convenience of description, as shown in FIG. 6 , only various aspects of the image processing technology related to the embodiments of the present invention are shown.

As shown in FIG. 6 , the image processing circuit 110 includes an imaging device 1110 , an ISP processor 1130 and a control logic 1140 . Imaging device 1110 may include a camera with one or more lenses 1112, image sensor 1114, and structured light emitter 1116. The structured light emitter 1116 projects the structured light to the measured object. Wherein, the structured light pattern may be a laser stripe, a Gray code, a sinusoidal stripe, or a randomly arranged speckle pattern, or the like. The image sensor 1114 captures the structured light image projected onto the object to be measured, and sends the structured light image to the ISP processor 1130, and the ISP processor 1130 superimposes the structured light image to obtain the target image. At the same time, the image sensor 1114 can also capture the color information of the measured object. Of course, the structured light image and color information of the object to be measured can also be captured by the two image sensors 1114 respectively.

After the ISP processor 1130 receives the color information of the measured object captured by the image sensor 1114, the image data corresponding to the color information of the measured object can be processed. The ISP processor 1130 analyzes the image data to obtain image statistics that can be used to determine one or more control parameters of the imaging device 1110 . Image sensor 1114 may include an array of color filters (eg, Bayer filters), image sensor 1114 may obtain light intensity and wavelength information captured with each imaging pixel of image sensor 1114 and provide a set of raw materials that may be processed by ISP processor 1130. image data.

The ISP processor 1130 processes raw image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 1130 may perform one or more image processing operations on the raw image data, collect image statistics about the image data. Among them, the image processing operations can be performed with the same or different bit depth precision.

ISP processor 1130 may also receive pixel data from image memory 1120 . The image memory 1120 may be a part of a memory device, a storage device, or an independent dedicated memory within an electronic device, and may include a DMA (Direct Memory Access, direct memory access) feature.

When raw image data is received, the ISP processor 1130 may perform one or more image processing operations.

The image data for the target image may be sent to image memory 1120 for additional processing before being displayed. The ISP processor 1130 receives processed data from the image memory 1120 and performs image data processing in the original domain and in the RGB and YCbCr color spaces on the processed data. The image data of the three-dimensional image may be output to the display 1160 for viewing by the user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit, graphics processor). In addition, the output of the ISP processor 1130 may also be sent to the image memory 1120 , and the display 1160 may read image data from the image memory 1120 . In one embodiment, image memory 1120 may be configured to implement one or more frame buffers. Also, the output of the ISP processor 1130 may be sent to the encoder/decoder 1150 for encoding/decoding the image data. The encoded image data can be saved and decompressed prior to display on the display 1160 device. The encoder/decoder 1150 may be implemented by a CPU or GPU or a coprocessor.

The image statistics determined by the ISP processor 1130 may be sent to the control logic 1140 unit. Control logic 1140 may include a processor and/or microcontroller executing one or more routines (eg, firmware) that may determine control parameters of imaging device 1110 based on received image statistics.

Using the image processing technology in FIG. 6 , the above-mentioned image processing method can be realized.

In order to realize the above-mentioned embodiments, the present invention also provides a computer-readable storage medium, including a computer program used in conjunction with the electronic device 50 capable of taking a picture, and the computer program can be executed by the processor 501 to complete any of the above-mentioned embodiments. The described image processing method.

In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise expressly and specifically defined.

Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing custom logical functions or steps of the process , and the scope of the preferred embodiments of the invention includes alternative implementations in which the functions may be performed out of the order shown or discussed, including performing the functions substantially concurrently or in the reverse order depending upon the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present invention belong.

The logic and/or steps represented in flowcharts or otherwise described herein, for example, may be considered an ordered listing of executable instructions for implementing the logical functions, may be embodied in any computer-readable medium, For use with, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from and execute instructions from an instruction execution system, apparatus, or apparatus) or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or apparatus. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections with one or more wiring (electronic devices), portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.

It should be understood that various parts of the present invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following techniques known in the art, or a combination thereof: discrete with logic gates for implementing logic functions on data signals Logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

Those skilled in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. When executed, one or a combination of the steps of the method embodiment is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present invention have been shown and described above, it should be understood that the above-mentioned embodiments are exemplary and should not be construed as limiting the present invention. Embodiments are subject to variations, modifications, substitutions and variations.

Claims (9)

1. An image processing method for an electronic device, wherein the electronic device comprises a structured light emitter and an image collector, the method comprising: S1, selecting the light source points in the first area as the light source point set, wherein the first area is located at the center of the light source array; S2, turn on the light source point set; S3, projecting structured light to the current user through the light source point set and turning off the light source point set after projecting the structured light; S4, according to the direction extending from the first area to the periphery of the first area, starting from the boundary of the first area, and determining the boundary of the next area according to a preset distance interval; S5, gradually select the light source points between the boundaries of two adjacent regions as the light source point set, and repeat steps S2, S3 and S5 in sequence; S6 , controlling the image collector to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image. 2. The image processing method according to claim 1, wherein the controlling the image collector to shoot the structured light image modulated by the current user every time and superimpose the images to obtain the target image, comprising: From the first time the structured light image is captured, the currently captured structured light image is superimposed on the structured light image obtained last time to obtain a first image; judging whether a complete face image can be extracted from the first image; If the complete face image is extracted, the first image is used as the target image. 3. The image processing method according to claim 2, wherein the judging whether a complete face image can be extracted from the first image comprises: extracting a second image including facial features from the first image; matching the second image with an authorized face image stored on the electronic device; If the target authorized face image is matched, it is determined that the complete face image is extracted from the first image. 4. The image processing method according to claim 3, wherein the matching the second image with the authorized face image stored on the electronic device comprises: extracting features of facial organs from the second image; comparing the features of the extracted facial organs with the features of the facial organs in the authorized face image; When the features of each of the extracted facial parts are consistent with the features of the corresponding facial parts in one of the authorized face images, then the one of the authorized face images is used as the target authorizer face image. 5. The image processing method according to claim 3 or 4, characterized in that, further comprising: When the electronic device is currently in a locked state, after matching the target authorized face image, the electronic device is unlocked. 6. The image processing method according to claim 3 or 4, characterized in that, after taking the first image as the target image if the complete face image is extracted, the method further comprises: The structured light emitter is controlled to stop the emission of the structured light. 7. An image processing device for use in an electronic device, characterized in that it comprises: Structured light transmitter, used to transmit structured light to the current user; an image collector for capturing the structured light image modulated by the current user; a processor for: S1, selecting the light source points in the first area as a light source point set, wherein the first area is located at the center of the light source array; S2, turn on the light source point set; S3, projecting structured light to the current user through the light source point set and turning off the light source point set after projecting the structured light; S4, according to the direction extending from the first area to the periphery of the first area, starting from the boundary of the first area, and determining the boundary of the next area according to a preset distance interval; S5, gradually select the light source points between the boundaries of two adjacent regions as the light source point set, and repeat steps S2, S3 and S5 in sequence; S6, controlling the image collector to capture the structured light image modulated by the current user each time and superimpose the images to obtain the target image. 8. An electronic device, characterized in that the electronic device comprises: one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, the programs comprising means for performing any of claims 1 to 6 An instruction for the described image processing method. 9. A computer-readable storage medium, characterized by comprising a computer program used in conjunction with an electronic device capable of taking a picture, the computer program being executable by a processor to complete the image according to any one of claims 1 to 6 Approach.