CN105430363A - Imaging method, imaging device and electronic device - Google Patents

Abstract

The invention discloses an imaging method, which comprises the steps of firstly, providing an image sensor, wherein the image sensor comprises a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array, the optical filter comprises an optical filter unit array, and each optical filter unit comprises a color filter area and an infrared filter area. The color filter area and the infrared filter area respectively cover at least one photosensitive pixel. And then, reading the output of the photosensitive pixel array, and calculating the pixel value of a synthesized image according to the photosensitive pixels covered by the color filter area and the output of the photosensitive pixels corresponding to the infrared filter area to generate the synthesized image. The resulting composite image contains complete color information and has a high signal-to-noise ratio. The invention also discloses an imaging device for realizing the imaging method and an electronic device applying the imaging device.

Description

Imaging method, imaging device and electronic device

technical field

The invention relates to imaging technology, in particular to an imaging method, an imaging device and an electronic device.

Background technique

Existing RGB image sensors have poor photo effects, blurry, or even blurry pictures under low illumination. Some image sensors are embedded with infrared filter pixels to provide imaging effects, but when the light is sufficient, infrared rays entering the image sensor will affect the imaging effect, causing color casts in the image, etc.

Contents of the invention

The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, the present invention needs to provide an imaging method, an imaging device and an electronic device.

The imaging method of the embodiment of the present invention comprises the following steps:

An image sensor is provided, the image sensor includes an array of photosensitive pixels and a filter disposed on the array of photosensitive pixels, the filter includes an array of filter units, and the filter unit includes a color filter area and an infrared filter In the light area, the color filter area and the infrared filter area respectively cover at least one of the photosensitive pixels; and

Reading the output of the photosensitive pixel array, and calculating the pixel value of the composite image according to the output of the photosensitive pixels covered by the color filter area and the photosensitive pixels covered by the infrared filter area to generate the composite image image.

In the imaging method of the embodiment of the present invention, the color filter area of the filter unit on the filter is used to obtain the color information of the pixels of the composite image, and the infrared filter area is used to obtain the brightness of the pixels of the composite image under low illumination information and this luminance information has less noise. The pixels of the composite image refer to the pixels of the image generated from the output of the photosensitive pixels. In this way, the pixel values of the synthesized image include both color information and low-noise brightness information, and the synthesized image has complete and lifelike colors, better brightness and definition, and less noise. Some problems in existing imaging methods are solved.

The present invention also provides an imaging device for implementing the imaging method of the above embodiment, which includes: an image sensor, the image sensor includes a photosensitive pixel array and a filter arranged on the photosensitive pixel array; the filter The light sheet includes an array of filter units, and each filter unit includes a color filter area and an infrared filter area; the color filter area and the infrared filter area respectively cover at least one of the photosensitive pixels;

The imaging device also includes an image processing module connected to the image sensor;

The image processing module is used to read the output of the photosensitive pixel array, and is used to calculate and synthesize according to the output of the photosensitive pixels covered by the color filter area and the photosensitive pixels corresponding to the infrared filter area The pixel values of the image to generate the composite image.

The present invention also provides an electronic device using the imaging device of the above embodiment. Additional aspects and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and comprehensible from the description of the embodiments in conjunction with the following drawings, wherein:

FIG. 1 is a schematic flowchart of an imaging method according to an embodiment of the present invention.

FIG. 2 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 3 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 4 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 5 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 6 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 7 is a schematic flowchart of steps of an imaging method according to an embodiment of the present invention.

FIG. 8 is a schematic flowchart of the reading steps of the imaging method according to the embodiment of the present invention.

FIG. 9 is a schematic side view of an imaging device according to an embodiment of the present invention.

FIG. 10 is a schematic diagram of a filter unit of an imaging device according to an embodiment of the present invention.

FIG. 11 is a schematic diagram of an array of filter units in a Bayer structure.

FIG. 12 is a schematic diagram of an array of filter units of an imaging device according to an embodiment of the present invention.

FIG. 13 is a schematic perspective view of the three-dimensional structure of an image sensor according to an embodiment of the present invention.

FIG. 14 is a schematic diagram of the corresponding relationship between the filter unit array and the synthesized image according to the embodiment of the present invention.

FIG. 15 is a schematic diagram of functional modules of an imaging device according to an embodiment of the present invention.

FIG. 16 is a schematic structural diagram of a photosensitive pixel circuit of an imaging device according to an embodiment of the present invention.

FIG. 17 is a schematic perspective view of the three-dimensional structure of an image sensor according to an embodiment of the present invention.

FIG. 18 is a schematic diagram of another corresponding relationship between the filter unit array and the synthesized image according to the embodiment of the present invention.

FIG. 19 is a schematic diagram of functional modules of an electronic device according to an embodiment of the present invention.

FIG. 20 is a schematic diagram of functional modules of an electronic device according to an embodiment of the present invention.

detailed description

Embodiments of embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary, are only for explaining the embodiments of the present invention, and should not be construed as limiting the embodiments of the present invention.

The imaging method, imaging device and electronic device according to the embodiments of the present invention will be further described below with reference to the accompanying drawings.

Please refer to Fig. 1, the imaging method of the embodiment of the present invention comprises the following steps:

S1, providing an image sensor, the image sensor includes a photosensitive pixel array and a filter arranged on the photosensitive pixel array, the filter includes an array of filter units, the filter unit includes a color filter area and an infrared filter area, and the color filter The region and the infrared filter region respectively cover at least one photosensitive pixel.

S2. Read the output of the photosensitive pixel array, and calculate the pixel value of the composite image according to the outputs of the photosensitive pixels covered by the color filter area and the photosensitive pixels covered by the infrared filter area to generate a composite image.

In the imaging method of the embodiment of the present invention, the color filter area of the filter unit on the filter is used to obtain the color information of the pixels of the composite image, and the infrared filter area is used to obtain the brightness of the pixels of the composite image under low illumination information and this luminance information has less noise. The pixels of the composite image refer to the pixels of the image generated from the output of the photosensitive pixels. In this way, the pixel values of the synthesized image include both color information and low-noise brightness information, and the synthesized image has complete and lifelike colors, better brightness and definition, and less noise.

Please refer to FIG. 13 , in this embodiment, each filter unit covers 2*2 photosensitive pixels. The color filter area covers three photosensitive pixels, and the infrared filter area covers one photosensitive pixel.

In this way, the color information of the generated synthetic image is relatively complete and the definition is high.

Please refer to FIG. 14 , in this embodiment, each photosensitive pixel 111 corresponds to a pixel 301 of a synthetic image 300 .

For example, a photosensitive pixel array with a resolution of 16M corresponds to an image with a resolution of 16M. In this way, the embedding of infrared pixels did not affect the resolution of the composite image.

Please refer to FIG. 2, in the imaging method of this embodiment, step S2 further includes:

S21. Obtain the color pixel value corresponding to the photosensitive pixel covered by the infrared filter area according to the output of the photosensitive pixel covered by the color filter area in the same filter unit.

Wherein, the color pixel value and the infrared pixel value corresponding to the photosensitive pixel covered by the infrared filter area can be used to calculate the pixel value of the corresponding composite image.

Please refer to FIG. 3, preferably, in the imaging method of this embodiment, step S21 further includes:

S211. Calculate the average value of outputs of the photosensitive pixels covered by the color filter area in the same filter unit as the color pixel value corresponding to the photosensitive pixels covered by the infrared filter area.

In this embodiment, the output of the photosensitive pixels covered by the color filter area includes color pixel values, and the output of the photosensitive pixels covered by the infrared filter area includes infrared pixel values. Referring to Fig. 4, step S2 further includes:

S22. Sensing and judging ambient brightness.

S23. When the ambient brightness is greater than the first predetermined threshold, subtract the corresponding infrared pixel value from the color pixel value to obtain the corresponding pixel value of the synthesized image.

Please refer to Fig. 5, in some embodiments, step S2 further includes:

S25, sensing and judging ambient brightness.

S27. When the ambient brightness is less than the second predetermined threshold, add the color pixel value to the corresponding infrared pixel value to obtain the corresponding pixel value of the synthesized image.

Please refer to FIG. 6, in some embodiments, step S2 further includes:

S29, sensing and judging ambient brightness.

S31. When the ambient brightness is greater than the first threshold and less than the second predetermined threshold, use the color pixel value as the pixel value of the corresponding synthesized image.

The pixel value of the photosensitive pixel can be used as the basis for judging the ambient brightness, for example, the average value of all color pixel values can be used as the ambient brightness value.

By sensing and judging the ambient brightness, the color pixel values are processed appropriately. For example, the infrared rays radiated by the external scene during the day will affect the image quality, and the color pixel value can be subtracted from its infrared brightness component. When the brightness value is low at night, the infrared pixel value can be used to compensate to improve the imaging brightness and signal-to-noise ratio. When the brightness value is moderate in the evening, the color pixel value is used as the pixel value of the composite image.

Please refer to Fig. 7, in some embodiments, step S2 further includes:

S33. Add the outputs of the photosensitive pixels covered by the color filter area to obtain the merged pixel value.

S35. Calculate the pixel value of the synthesized image according to the combined pixel value and the output of the photosensitive pixel covered by the infrared filter area.

In this way, the photosensitive pixels covered by the color filter area are combined, and then the pixel value of the composite image of the composite image is calculated according to the combined pixel value and the output of the photosensitive pixels covered by the infrared filter area.

In some embodiments, each photosensitive pixel is connected to an analog-to-digital converter;

Referring to Figure 8, step S2 further includes:

S37, converting the analog signal output generated by the photosensitive pixel into a digital signal output and storing it in a register.

S39, extract digital signal output from the register to calculate the pixel value of the synthesized image.

In this way, on the one hand, the image processing module that is generally a digital signal processor (DSP, digital signal processor) can directly process the output of the image sensor; As far as the scheme is concerned, the information of the image is better preserved.

The imaging method of the embodiment of the present invention can be realized by the imaging device of the embodiment of the present invention.

Referring to FIG. 9 and FIG. 10 , an imaging device 100 according to an embodiment of the present invention includes an image sensor 10 and an image processing module 50 . The image sensor 10 includes a photosensitive pixel array 11 and a filter 13 disposed on the photosensitive pixel array 11 . The filter 13 includes a filter unit array 131 , and each filter unit 1311 includes a color filter area 1315 and an infrared filter area 1313 . The color filter area 1315 covers at least one photosensitive pixel 111 , and the infrared filter area 1313 is used to only allow infrared light with a predetermined wavelength to pass through. The preset wavelength can be 750-850nm. The external light irradiates the photosensitive part 1111 of the photosensitive pixel 111 through the filter 13 to generate an electrical signal, that is, the output of the photosensitive pixel 111 .

The image processing module 50 is used to read the output of the photosensitive pixel array 11, and calculate the pixels of the composite image according to the output of the photosensitive pixels 111 covered by the color filter area 1315 and the photosensitive pixels 111 corresponding to the infrared filter area 1313 to generate a composite image .

The color filter area 1315 of the filter unit 1311 on the filter 13 is used to obtain the color information of the pixels of the composite image, and the infrared filter area 1313 is used to obtain the brightness information of the pixels of the composite image under low illumination and the brightness information is noisy. less. The pixels of the synthesized image refer to the pixels of the synthesized image output from the photosensitive pixels 111 . In this way, the pixel values of the synthesized image include both color information and low-noise brightness information, and the synthesized image has complete and lifelike colors, better brightness and definition, and less noise.

Please refer to FIG. 11 , in this embodiment, the color filter area 1315 forms a Bayer pattern.

The Bayer array includes filter structures 1317, and each filter structure 1317 includes 2*2 filter units 1311, which are green, red, blue, and green filter units 1311, respectively.

By adopting the Bayer structure, the traditional algorithm for the Bayer structure can be used to process the image signal, so there is no need for major adjustments in the hardware structure.

In a traditional filter unit array structure, each filter unit corresponds to a plurality of photosensitive pixels and image pixels.

Please refer to FIG. 12 , in this embodiment, the filter element array 131 adopts a Bayer structure, including filter structures 1317, each filter structure 1317 includes green, red, blue, green filter units 1311, each filter The unit 1311 corresponds to a plurality of photosensitive pixels 111 . Each filter unit 1311 includes a color filter area 1315 and an infrared filter area 1313 .

Please refer to FIG. 13 and FIG. 12 , in this embodiment, each filter unit 1311 covers 2*2 photosensitive pixels 111 , and the color filter area 1315 and the infrared filter area 1313 cover three photosensitive pixels 111 and one photosensitive pixel 111 respectively.

In this way, the color information of the generated synthetic image is more complete. In other implementations other than this embodiment, the number of photosensitive pixels covered by the color filter area may be two or one, and the number of photosensitive pixels covered by the corresponding infrared filter area may be two or three. However, when the color filter area When fewer photosensitive pixels are covered, more pixels of the composite image will be calculated from the pixel values of other composite images instead of the output of the corresponding photosensitive pixels, which will affect the color integrity and clarity of the composite image .

Please refer to FIG. 14 , in this embodiment, each photosensitive pixel 111 corresponds to a pixel 301 of a synthetic image 300 .

The image processing module is used to obtain the color pixel value corresponding to the photosensitive pixel 111 covered by the infrared filter region 1313 according to the output of the photosensitive pixel 111 corresponding to the color filter region 1315 in the same filter unit 1311 . In addition, the output of the photosensitive pixel 111 corresponding to the infrared filter area 1313 can generate corresponding infrared pixel value. The color pixel values and infrared pixel values are used to calculate the pixel values forming the composite image to generate composite image 300 .

Specifically, the image processing module can calculate the average value of the output of the photosensitive pixels 111 corresponding to the color filter area 1315 in the same filter unit 1311 as the color pixel value corresponding to the photosensitive pixels 111 covered by the infrared filter area 1313 .

For example, the photosensitive outputs of the photosensitive pixels 111 covered by the color filter area 1315 are G1, G2, and G3 respectively, and the color pixel values corresponding to the photosensitive pixels 111 covered by the infrared filter area 1313 are (G1+G2+G3)/3. It is not difficult to understand that in this way, the original missing color information of the pixels 301 of the composite image 300 corresponding to the infrared filter area 1313 can be better simulated or restored.

Please refer to FIG. 15 , in some embodiments, the image sensor 10 may include an array of analog-to-digital converters 21, each of which is connected to a photosensitive pixel, and the analog-to-digital converter is used to convert the analog signal output generated by the photosensitive pixel to for digital signals.

In this way, on the one hand, the image processing module that is generally a digital signal processor (DSP, digital signal processor) can directly process the output of the image sensor; In terms of solutions, image information is better preserved. For example, the imaging method in the embodiment of the present invention can generate a composite image from color pixel values and infrared pixel values, and can also retain color pixel value information and infrared pixel value information.

Further, in this embodiment, the imaging device 100 includes a register connected to the analog-to-digital converter array, and the register stores the digital signal output generated by the analog-to-digital converter.

Referring to FIG. 15, in some implementations, the image sensor 10 includes a control module 17, and the control module 17 controls the row selection logic unit 171 and the column selection logic unit 173 connected to it to collect the output of the photosensitive pixels row by row and store them in Register 19. The image processing module 50 extracts the output of the photosensitive pixels from the register 19 for processing.

Specifically, referring to FIG. 15 and FIG. 16 , the image sensor 10 includes a control module 17 connected to a row selection logic unit 171 and a column selection logic unit 173 . The row selection logic unit 171 and the column selection logic unit 173 are connected to the switch transistors 1115 corresponding to the photosensitive pixels 111, and the control module 17 is used to control the row selection logic unit 171 and the column selection logic unit 173 to gate the photosensitive pixels 111 at specific positions The switching tube 1115.

The photosensitive pixel 111 in this embodiment includes a photodiode 1113 . The photodiode 1113 is used to convert light into electric charges, and the electric charges generated are proportional to the light intensity. The switch tube 1115 is used to control the on and off of the circuit according to the control signals of the row selection logic unit 171 and the column selection logic unit 173. When the circuit is turned on, the source follower 1117 (source follower) is used to connect the photodiode 1113 The charge signal generated by light is converted into a voltage signal. The analog-to-digital converter 211 (Analog-to-digital converter) is used to convert the voltage signal into a digital signal for transmission to subsequent circuits for processing.

This output processing method converts the output of the photosensitive pixel into a digital signal, which is processed by software in the subsequent digital circuit or in the chip. Therefore, the output information of each photosensitive pixel, including color pixel values and infrared pixel values, can be preserved.

Please refer to FIG. 17 , in some embodiments, the image sensor 10 includes a micromirror array 23 disposed on the filter 13 , and each micromirror 231 corresponds to one photosensitive pixel 111 .

Specifically, each micromirror 231 corresponds to one photosensitive pixel 111 , including size and position correspondence. In some embodiments, each filter unit 1311 corresponds to 2*2 photosensitive pixels 111 and 2*2 micromirrors 191 . With the development of technology, in order to obtain images with higher resolution, there are more and more photosensitive pixels 111 on the photosensitive sheet, and the arrangement becomes denser, and the single photosensitive pixel 111 is also smaller and smaller, which is affected by light, and the photosensitive pixels 111 The area of the photosensitive part 1111 is limited, and the micromirror 191 can gather light to the photosensitive part 1111, thereby increasing the intensity of light received by the photosensitive pixel 111 to improve image quality.

Please refer to FIG. 14 , in some embodiments, the output of the photosensitive pixels covered by the color filter area 1315 corresponds to the color pixel value, and the output of the photosensitive pixels covered by the infrared filter area 1313 corresponds to the infrared pixel value.

The image processing module is used to judge the ambient brightness according to the pixel value of the photosensitive pixel, and perform corresponding processing on the color pixel value and the infrared pixel value according to the ambient brightness. For example, when the ambient brightness is greater than the first predetermined threshold, the color pixel value is subtracted from the corresponding infrared pixel value to obtain the pixel value of the synthesized image.

Further, in some embodiments, the image processing module is configured to add the color pixel value to the corresponding infrared pixel value to obtain the pixel value of the synthesized image when the ambient brightness is less than the second predetermined threshold.

Or, in some implementations, the image processing module uses the color pixel value as the pixel value of the corresponding composite image when the ambient brightness is greater than the first threshold but less than the second predetermined threshold.

Wherein, the pixel value of the photosensitive pixel can be used as the basis for judging the ambient brightness, for example, the average value of all the color pixel values can be used as the ambient brightness value.

In the above embodiments, the imaging device 100 performs appropriate processing on the color pixel values by sensing and judging the ambient brightness. For example, the infrared rays radiated by the external scene during the day will affect the image quality, and the color pixel value can be subtracted from its infrared brightness component. When the brightness value is low at night, the infrared pixel value can be used to compensate to improve the imaging brightness and signal-to-noise ratio. When the brightness value is moderate in the evening, the color pixel value is used as the pixel value of the composite image.

In addition to the above three processing methods, in some embodiments, under different ambient brightness, the infrared pixel value is multiplied by a proportional coefficient related to the ambient brightness, and the obtained value is added to the color pixel value to obtain the composite The pixel values of the image to generate the composite image. In this way, the imaging device 100 is more adaptable to ambient brightness.

In some embodiments, the photosensitive pixels corresponding to the color pixel value and the infrared pixel value correspond to the same filter unit.

Combining with the above-mentioned implementation of processing the color pixel value and the infrared pixel value according to the ambient brightness, it is not difficult to understand that the color pixel value and the infrared pixel value to be added or subtracted correspond to the same filter unit. For example, please refer to FIG. 12 , the color pixel values of the photosensitive pixels 111 corresponding to the color filter area 1315 are G1, G2, and G3 respectively. Assuming that in a low-light environment, the corresponding pixel values of the composite image are G1+IR, G2 respectively. +IR, G3+IR. Wherein IR is the infrared pixel value of the photosensitive pixel 111 corresponding to the infrared filter area 1313 .

The pixel value of the synthetic image corresponding to the photosensitive pixel 111 covered by the infrared filter area 1313 can be averaged by G1, G2, and G3 as its color value part, and then IR is added, that is, the final result is:

(G1+G2+G3)/3+IR

The advantage of such nearby processing is that it can minimize the color distortion or the loss of definition produced in the process of image synthesis.

Please refer to FIG. 18 , in some implementations, the image processing module is used to add the outputs of the photosensitive pixels 111 covered by the color filter area 1315 to obtain a combined pixel value, and to obtain a combined pixel value according to the combined pixel value and the infrared filter area 1313 The output of the corresponding photosensitive pixel 111 calculates the pixel value of the composite image.

In this way, the outputs of multiple light-sensitive pixels are added to form a composite image with a higher pixel signal-to-noise ratio. For example, assuming that the original output of each photosensitive pixel 111 is S and the noise is N, the pixel 401 of the synthesized image 400 includes m photosensitive pixels The sound is smaller than the sum of the noise output by each photosensitive pixel before combining. The output of the pixel 401 of the synthesized image 400 is the sum of the output of each photosensitive pixel before the combination, so the color synthesized image 400 generated after the merger, compared with the color image generated by a single pixel in the traditional method, has reduced noise, improved signal-to-noise ratio, and clear degree of improvement.

To sum up, each filter unit of the imaging device in the embodiment of the present invention includes a color filter area and an infrared filter area. The brightness information of the pixels of the image and this brightness information is less noisy. Therefore, the pixel values of the obtained synthetic image contain both color information and low-noise luminance information, so as to generate a synthetic image with complete and realistic colors and a high signal-to-noise ratio.

In addition, the imaging device according to the embodiment of the present invention can also properly adjust the color pixel values corresponding to the color filter area and the infrared pixel values corresponding to the infrared filter area under different ambient brightness by sensing and judging the ambient brightness. Computing and processing to obtain images with high definition and vivid colors.

The present invention also provides an electronic device using the imaging device 100 . In some embodiments, the electronic device includes the imaging device 100 . Therefore, the electronic device has the function of taking pictures and can generate synthetic images with complete and vivid colors, high signal-to-noise ratio, and high definition under low illumination.

The electronic device may be a mobile phone.

In this embodiment, the imaging device 100 may be a front camera of a mobile phone. Since the front camera is mostly used for self-portraits, and self-portraits generally require image clarity but not high image resolution, the electronic device adopting this embodiment can meet this requirement.

Please refer to FIG. 19 , in some embodiments, the electronic device 200 includes a central processing unit 81 connected to the imaging device 100 and an external memory 83 , and the central processing unit 81 is used to control the external memory 83 to store composite images.

In this way, the resulting composite images can be stored for later viewing, use or transfer. The external memory 83 includes an SM (SmartMedia) card, a CF (CompactFlash) card, and the like.

Please refer to FIG. 20 , in some embodiments, the electronic device 200 further includes a central processing unit 81 connected to the imaging device 100 and a display device 85 , and the central processing unit 81 is used to control the display device 85 to display a composite image. In this way, the image captured by the electronic device 200 can be displayed on the display device for the user to view. The display device includes an LED display and the like.

To sum up, the electronic device adopting the embodiment of the present invention has a camera function and can generate a synthetic image with complete and vivid colors, high signal-to-noise ratio, and high definition under low illumination. In particular, when the electronic device is a front camera of a mobile phone, it can improve the brightness and definition of the selfie image under low illumination and reduce the noise.

For the unexpanded parts of the imaging method and the electronic device in the embodiment of the present invention, reference may be made to the corresponding part of the imaging device 100 in the above embodiment, and will not be expanded in detail here.

In the description of this specification, reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific examples" or "some examples" etc. Specific features, structures, materials, or features described in an embodiment or example are included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment for use. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. processing to obtain the program electronically and store it in computer memory.

It should be understood that various parts of the present invention can be realized by hardware, software, firmware or their combination. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like.

Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (29)

1. a formation method, is characterized in that, comprises the following steps:

Imageing sensor is provided, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, described filter comprises filter unit array, described filter unit comprises colorized optical filtering district and infrared filtering district, and described colorized optical filtering district and described infrared filtering district cover photosensitive pixel described at least one respectively; And

Read the output of described photosensitive pixel array, and calculate the pixel value of composograph to generate described composograph according to the output of the described photosensitive pixel of described colorized optical filtering district covering and the described photosensitive pixel of described infrared filtering district covering.

2. formation method as claimed in claim 1, is characterized in that, each described filter unit covers 2*2 described photosensitive pixel; Described colorized optical filtering district covers three described photosensitive pixels; Described infrared filtering district covers a described photosensitive pixel.

3. formation method as claimed in claim 1, it is characterized in that, each described photosensitive pixel is corresponding with the pixel of a described composograph.

4. formation method as claimed in claim 3, it is characterized in that, described read step comprises further:

The color pixel values of the described photosensitive pixel that described infrared filtering district covers is obtained according to the output of the described photosensitive pixel of the described colorized optical filtering district covering in same described filter unit.

5. formation method as claimed in claim 4, it is characterized in that, described color pixel values calculation procedure comprises further:

Calculate the mean value of the output of described photosensitive pixel corresponding to described colorized optical filtering district in same described filter unit and the color pixel values of the described photosensitive pixel covered as described infrared filtering district.

6. formation method as claimed in claim 1, is characterized in that, the output of the described photosensitive pixel that described colorized optical filtering district covers comprises color pixel values; The output of the described photosensitive pixel that described infrared filtering district covers comprises infrared image element value;

Described read step comprises further:

Sense and judge ambient brightness; And

When described ambient brightness is greater than the first predetermined threshold, described color pixel values is deducted corresponding described infrared image element value to obtain the pixel value of corresponding described composograph.

7. formation method as claimed in claim 1, is characterized in that, the output of the described photosensitive pixel that described colorized optical filtering district covers comprises color pixel values; The output of the described photosensitive pixel that described infrared filtering district covers comprises infrared image element value;

Described read step comprises further:

Sense and judge ambient brightness; And

When described ambient brightness is less than the second predetermined threshold, described color pixel values is added corresponding described infrared image element value is to obtain the pixel value of corresponding described composograph.

8. formation method as claimed in claim 1, is characterized in that, the output of the described photosensitive pixel that described colorized optical filtering district covers comprises color pixel values; The output of the described photosensitive pixel that described infrared filtering district covers comprises infrared image element value;

Described read step comprises further:

Sense and judge ambient brightness; And

When described ambient brightness is greater than first threshold and is less than the second predetermined threshold, using the pixel value of described color pixel values as the described composograph of correspondence.

9. formation method as claimed in claim 1, it is characterized in that, described read step comprises further:

The output of the described photosensitive pixel covered in described colorized optical filtering district is added to obtain merging pixel value; And

The pixel value of described composograph is calculated according to the output of described photosensitive pixel corresponding to described merging pixel value and described infrared filtering district.

10. the formation method as described in claim 1-9 any one, is characterized in that, each described photosensitive pixel is connected with an analog to digital converter respectively;

Described read step comprises further:

The analog signal output that described photosensitive pixel produces is converted to digital signal export and stored in register; And

Extract described digital signal from described register to export with the pixel value calculating described composograph.

11. 1 kinds of imaging devices, is characterized in that, comprising:

Imageing sensor, described imageing sensor comprises:

Photosensitive pixel array; And

Be arranged at the filter on described photosensitive pixel array;

Described filter comprises filter unit array, and each described filter unit comprises colorized optical filtering district and infrared filtering district; Described colorized optical filtering district and described infrared filtering district cover photosensitive pixel described at least one respectively;

Described imaging device also comprises the image processing module be connected with described imageing sensor;

Described image processing module for reading the output of described photosensitive pixel array, and calculates the pixel value of composograph to generate described composograph for the output of described photosensitive pixel corresponding to the described photosensitive pixel that covers according to described colorized optical filtering district and described infrared filtering district.

12. imaging devices as claimed in claim 11, is characterized in that, described colorized optical filtering district forms Bayer array.

13. imaging devices as claimed in claim 11, is characterized in that, each described filter unit comprises 2*2 described photosensitive pixel; Described colorized optical filtering district and described infrared filtering district cover three and a described photosensitive pixel respectively.

14. imaging devices as claimed in claim 11, it is characterized in that, each described photosensitive pixel is corresponding with the pixel of a described composograph.

15. imaging devices as claimed in claim 14, it is characterized in that, described image processing module is used for obtaining color pixel values corresponding to described photosensitive pixel that described infrared filtering district covers according to the output of described photosensitive pixel corresponding to the described colorized optical filtering district in same described filter unit.

16. imaging devices as claimed in claim 15, it is characterized in that, described image processing module is for calculating the mean value of the output of described photosensitive pixel corresponding to described colorized optical filtering district in same described filter unit and color pixel values corresponding to the photosensitive pixel covered as described infrared filtering district.

17. imaging devices as claimed in claim 11, it is characterized in that, described imageing sensor comprises analog to digital converter array, each described analog to digital converter is connected with a described photosensitive pixel, and described analog to digital converter is used for the analog signal output that described photosensitive pixel produces to be converted to digital signal.

18. imaging devices as claimed in claim 17, is characterized in that, described imaging device comprises the register be connected with described analog to digital converter array, the described digital signal output that described register produces for storing described analog to digital converter.

19. imaging devices as claimed in claim 11, it is characterized in that, described imageing sensor comprises micro mirror array, and each described micro mirror is corresponding with a described photosensitive pixel.

20. imaging devices as claimed in claim 11, is characterized in that, the corresponding color pixel values of output of the described photosensitive pixel that described colorized optical filtering district covers; The corresponding infrared image element value of output of the described photosensitive pixel that described infrared filtering district covers;

Described image processing module is used for judging ambient brightness according to the pixel value of described photosensitive pixel, and for when described ambient brightness is greater than the first predetermined threshold, described color pixel values is deducted corresponding described infrared image element value to obtain the pixel value of described composograph.

21. imaging devices as claimed in claim 11, is characterized in that, the corresponding color pixel values of output of the described photosensitive pixel that described colorized optical filtering district covers; The corresponding infrared image element value of output of the described photosensitive pixel that described infrared filtering district covers;

Described image processing module is used for judging ambient brightness according to the pixel value of described photosensitive pixel, and when being less than the second predetermined threshold for described ambient brightness, described color pixel values is added corresponding described infrared image element value is to obtain the pixel value of described composograph.

22. imaging devices as claimed in claim 11, is characterized in that, the corresponding color pixel values of output of the described photosensitive pixel that described colorized optical filtering district covers; The corresponding infrared image element value of output of the described photosensitive pixel that described infrared filtering district covers;

Described image processing module is used for judging ambient brightness according to the pixel value of described photosensitive pixel, and using the pixel value of described color pixel values as the described composograph of correspondence when being less than the second predetermined threshold for being greater than first threshold at described ambient brightness.

23. imaging devices as described in claim 20-22 any one, is characterized in that, described color pixel values and described photosensitive pixel corresponding to described infrared image element value corresponding with same described filter unit.

24. imaging devices as claimed in claim 11, it is characterized in that, the output that described image processing module is used for the described photosensitive pixel described colorized optical filtering district covered is added to obtain merging pixel value, and for calculating the pixel value of described composograph according to the output of described photosensitive pixel corresponding to described merging pixel value and described infrared filtering district.

25. 1 kinds of electronic installations, is characterized in that, comprise the imaging device as described in claim 11-24 any one.

26. electronic installations as claimed in claim 25, it is characterized in that, described electronic installation comprises mobile phone.

27. electronic installations as claimed in claim 26, it is characterized in that, described imaging device comprises the Front camera of described mobile phone.

28. electronic installations as claimed in claim 25, it is characterized in that, described electronic installation comprises the central processing unit and external memory that are connected with described imaging device, described central processing unit stores described composograph for controlling described external memory.

29. electronic installations as claimed in claim 25, it is characterized in that, described electronic installation also comprises the central processing unit and display unit that are connected with described imaging device, described central processing unit shows described composograph for controlling described display unit.