[go: up one dir, main page]

CN102158632B - Method and device for capturing CFA (color filter array) - Google Patents

Method and device for capturing CFA (color filter array) Download PDF

Info

Publication number
CN102158632B
CN102158632B CN201110087810.1A CN201110087810A CN102158632B CN 102158632 B CN102158632 B CN 102158632B CN 201110087810 A CN201110087810 A CN 201110087810A CN 102158632 B CN102158632 B CN 102158632B
Authority
CN
China
Prior art keywords
cfa
color
colors
pixel
kinds
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110087810.1A
Other languages
Chinese (zh)
Other versions
CN102158632A (en
Inventor
张超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University
Original Assignee
Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University filed Critical Peking University
Priority to CN201110087810.1A priority Critical patent/CN102158632B/en
Publication of CN102158632A publication Critical patent/CN102158632A/en
Application granted granted Critical
Publication of CN102158632B publication Critical patent/CN102158632B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Color Television Image Signal Generators (AREA)

Abstract

The invention discloses a method for capturing a CFA (color filter array), which is used for realizing the better de-embedding property of CFA and avoiding the color cast problem in the imaging process. The method comprises the following steps: selecting a CFA base mode, wherein the corresponding CFA of the selected CFA base mode contains panchromatic pixel and two-color pixel; choosing pixel points, the number of which is less than a preset value, from the corresponding CFA of the selected CFA base mode; and replacing the color of the selected pixel points by the using of a third color different from the two colors, thereby acquiring the CFA. The invention also discloses a device which is used for realizing the method.

Description

一种CFA的获取方法及装置A method and device for obtaining CFA

技术领域technical field

本发明涉及光学及计算机领域,特别涉及一种CFA的获取方法及装置。The invention relates to the fields of optics and computers, in particular to a method and device for obtaining CFA.

背景技术Background technique

为了减少成本、体积和颜色之间的配准误差,静止彩色图像采集设备,如CCD(Charge-coupled Device,电荷耦合元件)静止图像数码相机中通常带有颜色过滤单元镶嵌在一起的CFA(Color Filter Array,滤色阵列)的单片传感器。在图像的每一个像素点处,传感器只能采集到一种颜色,需通过插值得到每个像素点处三基色的值,这种图像的插值过程为解镶嵌(demosaicking)过程。除了一些随机的CFA,二维CFA一般由一个最小CFA模式周期性重复覆盖整个图像传感器阵列表面来实现。不同的最小CFA模式组合后得到的CFA的结构及性能不同,因此,一种最小CFA模式(以下称为CFA模式)也就表示了该最小CFA模式组合后得到的CFA的特征。CFA模式和解镶嵌方法的设计和选择对于彩色图像的成像至关重要。In order to reduce the registration error between cost, volume and color, static color image acquisition devices, such as CCD (Charge-coupled Device, charge-coupled device) still image digital cameras, usually have CFA (Color Filter Array, color filter array) monolithic sensor. At each pixel of the image, the sensor can only collect one color, and interpolation is required to obtain the values of the three primary colors at each pixel. The interpolation process of this image is a demosaicking process. Except for some random CFAs, 2D CFAs are generally realized by periodically repeating a minimal CFA pattern covering the entire image sensor array surface. The structures and performances of CFA obtained by combining different minimum CFA modes are different. Therefore, a minimum CFA mode (hereinafter referred to as CFA mode) also expresses the characteristics of the CFA obtained by combining the minimum CFA modes. The design and selection of CFA modes and demosaicing methods are crucial for the imaging of color images.

目前应用最广的CFA模式为Bayer(拜耳)CFA模式,该BayerCFA模式采用了1/2绿色、1/4红色和1/4蓝色的模式。Bayer CFA模式虽然具有较好的解镶嵌性能,而且解镶嵌所需的软件成本较小,但因为其不包含全色像素,因此感光性能不佳。为了获得高感光性能的CFA,又出现了一些新的CFA模式,例如CFA2.0的CFA模式。这些包含有全色像素的高感光性能的CFA模式都有一些显著的缺点:这些CFA模式因其结构不合理,或包含的颜色过多,或包含的颜色不是三基色,因此解镶嵌性能较差,解镶嵌的复杂度较高,或硬件实现成本高。而如果CFA模式除了全色像素外只采用了两种颜色,则解镶嵌后获得的图像可能会出现偏色,严重影响相机的成像质量。The most widely used CFA mode at present is the Bayer (Bayer) CFA mode, which uses 1/2 green, 1/4 red and 1/4 blue modes. Although the Bayer CFA mode has better demosaicing performance, and the software cost required for demosaicing is lower, it does not contain panchromatic pixels, so the photosensitive performance is not good. In order to obtain CFA with high photosensitive performance, some new CFA modes have emerged, such as the CFA mode of CFA2.0. These high-sensitivity CFA modes that contain panchromatic pixels have some significant disadvantages: these CFA modes have poor demosaic performance because of their unreasonable structure, or contain too many colors, or contain colors that are not three primary colors , the complexity of demosaicing is high, or the cost of hardware implementation is high. However, if the CFA mode uses only two colors in addition to panchromatic pixels, the image obtained after demosaicing may have a color cast, which seriously affects the imaging quality of the camera.

发明内容Contents of the invention

本发明实施例提供一种CFA的获取方法及装置,用于实现CFA较高的感光性能和较好的解镶嵌性能,且能尽量避免图像成像过程中的偏色问题。Embodiments of the present invention provide a method and device for obtaining CFA, which are used to achieve higher photosensitivity and better demosaicing performance of CFA, and can avoid color cast problems in the image forming process as much as possible.

一种滤色阵列CFA的获取方法,包括以下步骤:A method for obtaining a color filter array CFA, comprising the following steps:

选定一周期性CFA模式作为CFA基模式,其中,所述选定的CFA基模式对应的CFA中包括全色像素及两种颜色的像素,所述两种颜色为红、绿、蓝三基色中的任意两种颜色或三基色补色青、品红、黄色中的任意两种颜色;A periodic CFA pattern is selected as the CFA base pattern, wherein the CFA corresponding to the selected CFA base pattern includes panchromatic pixels and pixels of two colors, and the two colors are the three primary colors of red, green, and blue Any two colors in or any two colors in the three primary complementary colors cyan, magenta and yellow;

在所述选定的CFA基模式对应的CFA中选择数量不超过2%的像素点,其中,所述选择的像素点为在所述CFA中随机选择数量不超过所述2%的像素点;或者为在所述CFA中以伪随机的方式选择数量不超过所述2%的像素点;或者为在所述CFA中以非随机的方式选择数量不超过所述2%的像素点;In the CFA corresponding to the selected CFA-based pattern, select a number of pixels not exceeding 2%, wherein the selected pixels are randomly selected pixels in the CFA whose number does not exceed the 2%; Or select the pixel points whose number does not exceed the 2% in a pseudo-random manner in the CFA; or select the pixel points in a non-random manner in the CFA that do not exceed the 2% number;

用除所述两种颜色之外的第三种颜色替换所选择的像素点处的颜色,获得CFA,其中,所述选择的像素点的颜色是全色像素或两种颜色的像素,所述第三种颜色为三基色中除所述两种颜色之外的颜色或三基色补色中除所述两种颜色之外的颜色。Replace the color at the selected pixel point with a third color other than the two colors to obtain a CFA, wherein the color of the selected pixel point is a panchromatic pixel or a pixel of two colors, and the The third color is a color other than the two colors in the three primary colors or a color other than the two colors in the complementary colors of the three primary colors.

一种成像方法,包括以下步骤:An imaging method, comprising the steps of:

用带有如权利要求1所述的CFA的图像传感器进行成像,并获得CFA图像;Carry out imaging with the image sensor that has CFA as claimed in claim 1, and obtain CFA image;

对所述CFA图像进行解镶嵌;Demosaicing the CFA image;

将所述CFA图像中所有像素点处已有的颜色值和解镶嵌后获得的该颜色的值进行比对,当比对结果不一致时,根据CFA图像已有的所有颜色值对解镶嵌后的整个图像的颜色进行修正。Comparing the existing color values at all pixel points in the CFA image with the value of the color obtained after demosaicing, when the comparison results are inconsistent, according to all existing color values of the CFA image, the entire The color of the image is corrected.

一种CFA的获取装置,包括:A CFA acquisition device, comprising:

选择模块,用于选定一周期性CFA模式作为CFA基模式,其中,所述选定的CFA基模式对应的CFA中包括全色像素及两种颜色的像素,所述两种颜色为红、绿、蓝三基色中的任意两种颜色或三基色补色青、品红、黄色中的任意两种颜色,及在所述选定的CFA基模式对应的CFA中选择数量不超过2%的像素点,其中,所述选择的像素点为在所述CFA中随机选择数量不超过所述2%的像素点;或者为在所述CFA中以伪随机的方式选择数量不超过所述2%的像素点;或者为在所述CFA中以非随机的方式选择数量不超过所述2%的像素点;The selection module is used to select a periodic CFA pattern as the CFA base pattern, wherein the CFA corresponding to the selected CFA base pattern includes panchromatic pixels and pixels of two colors, and the two colors are red, Any two colors of the three primary colors of green and blue or any two colors of the three complementary colors of cyan, magenta, and yellow, and the number of pixels selected in the CFA corresponding to the selected CFA base mode does not exceed 2% points, wherein, the selected pixel points are randomly selected pixels whose number does not exceed the 2% in the CFA; or pseudo-randomly selected pixels whose number does not exceed the 2% in the CFA Pixels; or non-randomly selecting pixels in the CFA whose number does not exceed the 2%;

处理模块,用于用除所述两种颜色之外的第三种颜色替换所述选择的像素点处的颜色,获得CFA,其中,所述选择的像素点的颜色是全色像素或两种颜色的像素,所述第三种颜色为三基色中除所述两种颜色之外的颜色或三基色补色中除所述两种颜色之外的颜色。A processing module, configured to replace the color at the selected pixel point with a third color other than the two colors to obtain a CFA, wherein the color of the selected pixel point is a panchromatic pixel or two colors Pixels of different colors, the third color is a color other than the two colors in the three primary colors or a color other than the two colors in the complementary colors of the three primary colors.

一种成像装置,包括:An imaging device comprising:

获取模块,用带有如权利要求1所述的CFA的图像传感器进行成像,并获得CFA图像;The acquisition module is used for imaging with the image sensor with the CFA as claimed in claim 1, and obtains the CFA image;

操作模块,用于对所述CFA图像进行解镶嵌;An operation module, configured to demosaick the CFA image;

校正模块,用于将所述CFA图像中所有像素点处已有的颜色值和解镶嵌后获得的该颜色的值进行比对,当比对结果不一致时,根据CFA图像已有的所有颜色值对解镶嵌后的整个图像的颜色进行修正。A correction module, configured to compare the existing color values at all pixel points in the CFA image with the value of the color obtained after demosaicing, and when the comparison results are inconsistent, according to all existing color values of the CFA image The color of the entire image after demosaicing is corrected.

一种CFA,所述CFA是按照如权利要求1所述方法生成的,所述CFA包括:A kind of CFA, described CFA is generated according to the method as claimed in claim 1, and described CFA comprises:

全色像素、两种颜色像素及除所述全色像素及两种颜色之外的第三种颜色像素;Panchromatic pixels, two-color pixels, and third color pixels other than said panchromatic pixels and two-color pixels;

全色像素所占的比例约为1/2以上,其它两种颜色所占的比例均约为1/4以下;The proportion of panchromatic pixels is about 1/2 or more, and the proportions of other two colors are about 1/4 or less;

所述第三种颜色所占的像素点的数量不超过设定值;The number of pixels occupied by the third color does not exceed a set value;

所述两种颜色为三基色或补色三基色中的任意两种颜色,所述第三种颜色为三基色或补色三基色中除所述两种颜色之外的颜色;The two colors are any two colors in the three primary colors or the three primary colors of complementary colors, and the third color is a color other than the two colors in the three primary colors or the three primary colors of complementary colors;

其中,通过使用所述第三种滤片替换全色像素滤片或两种颜色的滤片。Wherein, the panchromatic pixel filter or the two-color filter is replaced by using the third filter.

本发明实施例选定CFA基模式,其中,所述CFA基模式对应的CFA中包括全色像素及两种颜色的像素;在所述CFA中选择数量不超过设定值的像素点;用除所述两种颜色之外的第三种颜色替换所选像素点处的颜色,获得所需的CFA。因CFA中有全色像素,因此CFA的感光性能较好;因CFA中除全色像素外还有至少两种颜色像素,因此能获得彩色图像;因第三种颜色所占的比例不超过设定值,因此可以认为选定的具有良好解镶嵌性能的CFA的解镶嵌性能仍然好,其解镶嵌的复杂度较小;在所述CFA中选择数量不超过设定值的像素点,用第三种颜色替换所选像素点处的颜色,此第三种颜色可以作为颜色参照,以校准和纠正图像成像过程中出现的偏色。The embodiment of the present invention selects the CFA base mode, wherein, the CFA corresponding to the CFA base mode includes panchromatic pixels and pixels of two colors; selects pixels whose number does not exceed the set value in the CFA; A third color other than the two colors replaces the color at the selected pixel to obtain the desired CFA. Because there are panchromatic pixels in CFA, the photosensitivity of CFA is better; because there are at least two color pixels in CFA in addition to panchromatic pixels, color images can be obtained; because the proportion of the third color does not exceed the set Therefore, it can be considered that the demosaicing performance of the selected CFA with good demosaicing performance is still good, and the complexity of its demosaicing is small; in the CFA, select the number of pixels that do not exceed the set value, and use the first Three colors replace the color at the selected pixel, and this third color can be used as a color reference to calibrate and correct color casts that occur during image formation.

附图说明Description of drawings

图1为本发明实施例中CFA的获取方法的主要流程图;Fig. 1 is the main flowchart of the acquisition method of CFA in the embodiment of the present invention;

图2为本发明实施例中成像方法的主要流程图;Fig. 2 is the main flowchart of the imaging method in the embodiment of the present invention;

图3A为本发明实施例中CFA的获取方法的详细流程图;FIG. 3A is a detailed flowchart of a method for obtaining CFA in an embodiment of the present invention;

图3B为本发明实施例中成像方法的详细流程图;3B is a detailed flowchart of the imaging method in the embodiment of the present invention;

图4为本发明实施例中CFA的获取装置的主要结构图;Fig. 4 is the main structural diagram of the acquisition device of CFA in the embodiment of the present invention;

图5A为本发明实施例中LRLB CFA基模式的示意图;Fig. 5 A is the schematic diagram of LRLB CFA base model in the embodiment of the present invention;

图5B为本发明实施例中MWY CFA基模式的示意图;Figure 5B is a schematic diagram of the MWY CFA base mode in an embodiment of the present invention;

图5C为本发明实施例中一种一般双色CFA基模式的示意图;Figure 5C is a schematic diagram of a general two-color CFA-based mode in an embodiment of the present invention;

图6A为本发明实施例中用第三种颜色来替换选择的像素点处的颜色后CFA局部的示意图;FIG. 6A is a schematic diagram of a part of the CFA after replacing the color at the selected pixel with a third color in an embodiment of the present invention;

图6B为本发明实施例中用第三种颜色来替换选择的像素点处的颜色后CFA局部的示意图;FIG. 6B is a schematic diagram of the CFA part after replacing the color at the selected pixel point with a third color in the embodiment of the present invention;

图6C为本发明实施例中用第三种颜色来替换选择的像素点处的颜色后CFA局部的示意图;FIG. 6C is a schematic diagram of a part of the CFA after replacing the color at the selected pixel with a third color in an embodiment of the present invention;

图7为本发明实施例中成像装置的主要结构图。FIG. 7 is a main structural diagram of an imaging device in an embodiment of the present invention.

具体实施方式Detailed ways

本发明实施例选定CFA基模式,其中,所述CFA基模式对应的CFA中包括全色像素及两种颜色像素;在所述CFA中选择数量不超过设定值的像素点;用除所述两种颜色之外的第三种颜色替换所选择像素点处的颜色,获得所需的CFA。全色是指包含了所有可见光谱的颜色,即所有颜色的混合色,而颜色是指只包含一部分光谱的颜色。因CFA中有全色像素,因此CFA的感光性能较好;因第三种颜色所占的比例不超过设定值,因此可以认为选定的CFA的良好的解镶嵌性能可以保持,解镶嵌的复杂度较小;在所述CFA中选择数量不超过设定值的像素点,用第三种颜色替换所选像素点处的颜色,此第三种颜色可以作为颜色参照,以校准和纠正图像成像过程中出现的偏色。The embodiment of the present invention selects the CFA base mode, wherein the CFA corresponding to the CFA base mode includes panchromatic pixels and two-color pixels; selects pixels whose number does not exceed the set value in the CFA; Replace the color at the selected pixel with a third color other than the above two colors to obtain the desired CFA. Panchromatic refers to the color that contains all the visible spectrum, that is, the mixed color of all colors, while color refers to the color that only contains part of the spectrum. Because there are panchromatic pixels in the CFA, the photosensitive performance of the CFA is better; because the proportion of the third color does not exceed the set value, it can be considered that the good demosaicing performance of the selected CFA can be maintained, and the demosaicing performance Less complex; select pixels whose number does not exceed the set value in the CFA, replace the color at the selected pixel with a third color, this third color can be used as a color reference to calibrate and correct the image Color cast that occurs during imaging.

下面通过具体流程来介绍CFA的获取方法。The following describes how to obtain CFA through specific procedures.

参见图1,本发明实施例中CFA获取的主要方法流程如下:Referring to Fig. 1, the main method flow of CFA acquisition in the embodiment of the present invention is as follows:

步骤101:选定CFA基模式,其中,所述CFA基模式包括全色像素及两种颜色像素。因CFA是由一个CFA模式周期性重复覆盖整个图像传感器阵列表面而得到的,因此在选择CFA基模式时只需从CFA模式中选择性能好的即可。较佳的,其中包括不小于1/2的全色像素。Step 101: Select a CFA-based pattern, wherein the CFA-based pattern includes panchromatic pixels and two-color pixels. Since the CFA is obtained by periodically covering the entire surface of the image sensor array with a CFA pattern, it is only necessary to select a CFA pattern with good performance when selecting a CFA base pattern. Preferably, it includes no less than 1/2 panchromatic pixels.

步骤102:在所述CFA基模式对应的CFA中选择数量不超过设定值的像素点。此设定值可以是2%,即在一个CFA中选择的像素点的数量最好不超过此CFA中像素点总数量的2%。其中,在CFA中,每个像素点处是一个不对可见光进行过滤的全色滤片或一个单色的滤片。因为在解镶嵌性能好的CFA中变更颜色,会使CFA的结构变复杂,其解镶嵌性能也会变差,而变更的像素数在所述设定值范围内,使得加入的第三种颜色像素数量少,因此基本不会影响到CFA原有的解镶嵌性能。其中,变更像素的选择方式可以是随机选择,也可以用伪随机的方法选择,或者用非随机的方法选择。其中,非随机方法有配额方法、公式计算方法与判断方法等,主要是指人为进行选择。选择的像素点的颜色可以是同一种颜色,也可以是不同颜色,也可以是全色像素。Step 102: Select pixels whose number does not exceed a set value in the CFA corresponding to the CFA base pattern. This setting value may be 2%, that is, the number of pixels selected in one CFA is preferably not more than 2% of the total number of pixels in this CFA. Among them, in CFA, each pixel is a panchromatic filter that does not filter visible light or a monochromatic filter. Because changing the color in the CFA with good demosaicing performance will complicate the structure of CFA, and its demosaicing performance will also deteriorate, and the number of changed pixels is within the range of the set value, making the added third color The number of pixels is small, so it will basically not affect the original demosaicking performance of CFA. Wherein, the selection method of the changed pixels may be random selection, pseudo-random selection, or non-random selection. Among them, non-random methods include quota method, formula calculation method and judgment method, etc., which mainly refer to artificial selection. The colors of the selected pixels can be the same color, different colors, or full-color pixels.

步骤103:用除所述全色像素及两种颜色之外的第三种颜色替换所选像素点处的颜色。其中,第三种颜色为与确定的CFA基模式中的两种颜色均不同的颜色,此第三种颜色可以任意选择,但为了保证解镶嵌性能,及降低成本,此第三种颜色最好选择红、绿、蓝三基色中除CFA中原有的两种颜色之外的颜色或三基色补色青、品红、黄色中除CFA中原有的两种颜色之外的颜色。Step 103: Replace the color at the selected pixel with a third color other than the panchromatic pixel and the two colors. Among them, the third color is a color different from the two colors in the determined CFA-based pattern, and this third color can be selected arbitrarily, but in order to ensure demosaicing performance and reduce costs, this third color is the best Select a color other than the original two colors in the CFA among the three primary colors of red, green, and blue or a color other than the two original colors in the CFA among the three complementary colors cyan, magenta, and yellow.

参见图2,本发明实施例中成像的主要方法流程如下:Referring to Fig. 2, the main method flow of imaging in the embodiment of the present invention is as follows:

步骤201:用带有所述CFA的图像传感器进行成像,并获得CFA图像。Step 201: Imaging with an image sensor with the CFA, and obtaining a CFA image.

步骤202:对CFA图像进行解镶嵌。用解镶嵌算法对获得的CFA图像进行解镶嵌。Step 202: Demosaicking the CFA image. The obtained CFA image is demosaiced with a demosaic algorithm.

步骤203:用所述CFA图像中已有的全色像素值和三种颜色值对每个像素点处解镶嵌后获得的三种颜色值进行校准及修正。以获得无偏色或偏色较少的图像。例如,选择的CFA基模式是LRLB CFA模式,其中,例如某一个像素点处的颜色为红色,解镶嵌后,此像素点处的颜色可以由红、绿、蓝三基色来表示。因LRLB CFA模式中已有红、蓝两种颜色,因此通过将已有的红色与解镶嵌后的红色进行比对、及将已有的蓝色与解镶嵌后的蓝色进行比对,可以获知解镶嵌后获得的红色和蓝色是否有偏色现象,并且,在本发明实施例中,用除全色像素、两种颜色之外的第三种颜色替代了选择的像素点处的颜色,较佳的,此第三种颜色可以选择绿色,则可以用此绿色与解镶嵌后获得的绿色进行比对,以确定解镶嵌后获得的绿色是否有偏色现象。Step 203: Using the existing panchromatic pixel values and three color values in the CFA image to calibrate and correct the three color values obtained after de-mosaicing at each pixel. For an image with no or less color cast. For example, the selected CFA base mode is LRLB CFA mode, in which, for example, the color at a certain pixel point is red, after demosaicing, the color at this pixel point can be represented by three primary colors of red, green, and blue. Because there are two colors of red and blue in the LRLB CFA model, by comparing the existing red with the red after demosaicing, and comparing the existing blue with the blue after demosaicing, you can It is known whether there is a color cast in the red and blue obtained after demosaicing, and, in the embodiment of the present invention, the color at the selected pixel point is replaced by a third color other than the full-color pixel and two colors , preferably, the third color can be green, and then this green can be compared with the green obtained after demosaicing to determine whether there is a color cast in the green obtained after demosaicing.

参见图3A,本发明实施例中获取CFA的详细方法流程如下:Referring to Figure 3A, the detailed method flow for obtaining CFA in the embodiment of the present invention is as follows:

步骤3001:选定CFA基模式。选择CFA模式可以通过选择CFA基模式来实现。例如,选择的CFA基模式为LRLB CFA模式。Step 3001: Select a CFA base model. Selecting the CFA mode can be achieved by selecting the CFA base mode. For example, the selected CFA base mode is LRLB CFA mode.

步骤3002:在LRLB CFA基模式对应的CFA中选择数量不超过设定值的像素点。例如,设定值为2%。Step 3002: Select pixels whose number does not exceed the set value in the CFA corresponding to the LRLB CFA base mode. For example, the set value is 2%.

步骤3003:用选定的CFA中除所述全色像素及两种颜色之外的第三种颜色替换所选像素点处的颜色。例如,第三种颜色为绿色。Step 3003: Replace the color at the selected pixel point with a third color in the selected CFA except the panchromatic pixel and the two colors. For example, the third color is green.

参见图3B,本发明实施例中成像的详细方法流程如下:Referring to FIG. 3B, the detailed method flow of imaging in the embodiment of the present invention is as follows:

步骤3101:用带有所述CFA的图像传感器进行成像,以获得CFA图像。Step 3101: Imaging with the image sensor with the CFA to obtain a CFA image.

步骤3102:对CFA图像进行解镶嵌。Step 3102: Demosaic the CFA image.

步骤3103:将CFA图像中已有的红、绿、蓝三种颜色的值分别与一个像素点处解镶嵌后获得的红、绿、蓝三种颜色的值进行比对,判断是否一致。当判断结果为否时,继续步骤307,否则继续步骤308。将CFA图像中已有的红、绿、蓝三种颜色的值分别与解镶嵌后获得的红、绿、蓝三种颜色的值进行比对。比对过程可以是:每种颜色都有一个值,可以根据颜色获知此颜色的值。例如对红色进行比对,判断解镶嵌后获得的红色的值与CFA图像中已有的红色的值是否一致。Step 3103: Compare the existing red, green, and blue color values in the CFA image with the red, green, and blue color values obtained after de-mosaicing at a pixel, and judge whether they are consistent. When the judgment result is no, go to step 307 , otherwise go to step 308 . Compare the existing red, green, and blue color values in the CFA image with the red, green, and blue color values obtained after demosaicing. The comparison process can be: each color has a value, and the value of this color can be obtained according to the color. For example, red is compared to determine whether the red value obtained after demosaicing is consistent with the existing red value in the CFA image.

步骤3104:对产生偏色的颜色值进行修正。例如,解镶嵌后在一个像素点处获得的红色的值与CFA图像中已有的红色的值不一致,则确定该像素点处解镶嵌后获得的红色出现了偏色现象,可以根据CFA图像中已有的红色的值对该解镶嵌后获得的红色的值进行修正,使这两个值之间的误差最小。较佳的,可以将该像素点处解镶嵌后获得的红色的值修正为与CFA中已有的红色的值相同。Step 3104: Correct the color value that produces color cast. For example, if the red value obtained at a pixel point after demosaicing is inconsistent with the existing red value in the CFA image, it is determined that the red color obtained after demosaicing at this pixel point has a color cast phenomenon, which can be based on the CFA image The existing red value is corrected to the red value obtained after demosaicing to minimize the error between these two values. Preferably, the red value obtained after demosaicking at the pixel can be corrected to be the same as the existing red value in the CFA.

步骤3105:判断是否有未进行比对的像素点。当判断结果为是时,继续步骤3103,否则结束流程。确保对所有像素点都进行了比对及修正,以获得质量较高的图像。Step 3105: Determine whether there are pixels that have not been compared. When the judgment result is yes, continue to step 3103, otherwise end the process. Make sure all pixels are aligned and corrected to get a higher quality image.

参见图4,本发明实施例中CFA的获取装置包括选择模块401及处理模块402。Referring to FIG. 4 , the apparatus for obtaining CFA in the embodiment of the present invention includes a selection module 401 and a processing module 402 .

选择模块401用于选定CFA基模式,其中,所述选定的CFA基模式对应的CFA中包括全色像素及两种颜色像素,及在所述选定的CFA基模式对应的CFA中选择数量不超过设定值的像素点。选定的CFA基模式可以是如图5A所示的LRLB CFA模式,其包括1/2的全色像素,其中,W表示全色像素,R表示红色像素,B表示蓝色像素,或者如图5B所示的MWY CFA模式,其包括1/2的全色像素,其中,W表示全色像素,M表示品红像素,Y表示黄色像素,或者均可以将选定的CFA基模式表示为如图5C所示的一般双色CFA模式,其中,W表示全色像素,F表示第一种颜色像素,S表示第二种颜色像素,F和S需为不同的颜色。较佳的,为了降低解镶嵌的复杂度,本发明实施例中F和S为三基色中的任意两种,例如,F和S为红色和蓝色,或者F和S为红色和绿色,或者F和S为蓝色和绿色等。较佳的,第一种颜色F和第二种颜色S所占的比例可以均不大于1/4,以力求达到最佳效果。选定CFA基模式后,选择模块401继续在CFA基模式对应的CFA中选择数量不超过设定值的像素点。选择模块401可以将选择后的结果进行记录,以确保在解镶嵌时可以获知哪些像素点的颜色发生了改变。The selection module 401 is used to select a CFA-based mode, wherein the CFA corresponding to the selected CFA-based mode includes panchromatic pixels and two-color pixels, and selects from the CFA corresponding to the selected CFA-based mode The number of pixels does not exceed the set value. The selected CFA base pattern can be the LRLB CFA pattern shown in Figure 5A, which includes 1/2 panchromatic pixels, where W represents panchromatic pixels, R represents red pixels, B represents blue pixels, or The MWY CFA mode shown in 5B includes 1/2 panchromatic pixels, wherein W represents panchromatic pixels, M represents magenta pixels, and Y represents yellow pixels, or the selected CFA base mode can be expressed as The general two-color CFA mode shown in FIG. 5C , wherein W represents a full-color pixel, F represents a first color pixel, and S represents a second color pixel, and F and S need to be different colors. Preferably, in order to reduce the complexity of demosaicing, in the embodiment of the present invention, F and S are any two of the three primary colors, for example, F and S are red and blue, or F and S are red and green, or F and S are blue and green etc. Preferably, the proportion of the first color F and the second color S can be no more than 1/4, so as to achieve the best effect. After the CFA-based mode is selected, the selection module 401 continues to select pixels whose number does not exceed the set value in the CFA corresponding to the CFA-based mode. The selection module 401 can record the selected result, so as to ensure that the color of which pixels have changed during demosaicing.

处理模块402用于用除所述全色像素及两种颜色之外的第三种颜色替换所选像素点处的颜色,获得所需的CFA。当选择模块401在确定的CFA中选择数量不超过设定值的像素点后,处理模块402用第三种颜色来替换选择模块401所选择的像素点处的颜色。例如,选定的CFA基模式为WFS模式,则替换后的CFA对应的CFA模式可以如图6A、图6B或图6C所示,或者还可以是其它形式。其中,W表示全色像素,F及S分别表示第一种颜色及第二种颜色,T表示处理模块402用于替代某处颜色的第三种颜色,T的位置可以是随机选择,也可以用伪随机的方法选择,或者用非随机的方法选择,T的数目为不超过设定值。本发明实施例中均以在CFA基模式对应的一个CFA中替换一个像素点处的颜色为例。The processing module 402 is used to replace the color at the selected pixel point with a third color other than the panchromatic pixel and the two colors to obtain the required CFA. After the selection module 401 selects pixels whose number does not exceed the set value in the determined CFA, the processing module 402 replaces the color at the pixels selected by the selection module 401 with a third color. For example, if the selected CFA base pattern is the WFS pattern, the CFA pattern corresponding to the replaced CFA may be as shown in FIG. 6A , FIG. 6B or FIG. 6C , or may be in other forms. Wherein, W represents a full-color pixel, F and S represent the first color and the second color respectively, T represents the third color used by the processing module 402 to replace a certain color, and the position of T can be randomly selected or can be Select by pseudo-random method, or select by non-random method, the number of T is not more than the set value. In the embodiments of the present invention, the replacement of the color at a pixel point in a CFA corresponding to the CFA base pattern is taken as an example.

在用本发明实施例中在CFA的获取装置获取CFA之后,可以继续根据获得的CFA进行成像操作,以获得感光度较高且偏色较少的图像。After the CFA is obtained by the CFA obtaining device in the embodiment of the present invention, the imaging operation can be continued according to the obtained CFA, so as to obtain an image with higher sensitivity and less color cast.

参见图7,本发明实施例还提供一种成像装置,所述装置可以包括获取模块403、操作模块404及校正模块405。所述装置用于根据用CFA的获取装置获取的CFA进行成像,以获得无偏色或偏色较少的图像。Referring to FIG. 7 , an embodiment of the present invention also provides an imaging device, which may include an acquisition module 403 , an operation module 404 and a correction module 405 . The device is used for imaging according to the CFA acquired by the CFA acquisition device, so as to obtain an image with no color cast or less color cast.

获取模块403用于用带有所述CFA的图像传感器进行成像,以获得CFA图像。The acquiring module 403 is configured to use the image sensor with the CFA to perform imaging to obtain a CFA image.

操作模块404用于对CFA图像进行解镶嵌。操作模块404用于用解镶嵌算法对获得的CFA图像进行解镶嵌。其中,可以对每一个像素点分别进行解镶嵌,也可以同时对所有像素进行解镶嵌,以在每个像素点处获得三基色。The operation module 404 is used for demosaicing the CFA image. The operation module 404 is used for demosaicking the obtained CFA image with a demosaicing algorithm. Wherein, demosaicing may be performed on each pixel separately, or all pixels may be demosaiced simultaneously, so as to obtain three primary colors at each pixel.

校正模块405用于用CFA图像中已有的全色像素值和三种颜色像素值对每个像素点处解镶嵌后获得的三种颜色进行校准及修正。如果校正模块405比对之后确定解镶嵌后获得的颜色出现了偏色现象,则根据CFA图像中已有的全色像素值和三种颜色像素值对解镶嵌后获得的颜色进行修正,使它们之间的误差最小。在解镶嵌过程中,由于选择模块401选择的CFA基模式除全色像素外有两种颜色,而解镶嵌时,将每一个像素点处获得的一种颜色的能量恢复出三基色值。即,无论选择了哪一种CFA基模式,无论一个像素点处用的是哪种颜色,解镶嵌后,每个像素点处的得到颜色都由红、绿、蓝三基色表示。校正模块405可以根据颜色获取该颜色的值。如果选择的CFA基模式为MWYCFA模式,则选择模块401可以选择青色作为第三种颜色,此MWY CFA基模式对应的CFA图像解镶嵌后,每个像素点处的颜色也可以由红、绿、蓝三基色来表示,而品红、黄色和青色都是三基色的补色,与三基色之间都可以无偏差的互相转换,校正模块405可以将已有的品红、黄色和青色均转换为三基色,再将解镶嵌后在每个像素点处获得的颜色分别与转换后得到的颜色进行比对及修正,不影响比对结果。The correction module 405 is used for calibrating and correcting the three colors obtained after demosaicking at each pixel by using the existing panchromatic pixel values and three color pixel values in the CFA image. If the correction module 405 compares and determines that the color obtained after demosaicing has a color cast phenomenon, the color obtained after demosaicing is corrected according to the existing panchromatic pixel values and three color pixel values in the CFA image, so that they The error between them is the smallest. During the demosaicing process, since the CFA base pattern selected by the selection module 401 has two colors except panchromatic pixels, when demosaicing, the energy of one color obtained at each pixel point is restored to three primary color values. That is, no matter which CFA base mode is selected, no matter which color is used at a pixel point, after demosaicing, the color obtained at each pixel point is represented by the three primary colors of red, green, and blue. The correction module 405 can acquire the value of the color according to the color. If the selected CFA base mode is the MWYCFA mode, then the selection module 401 can select cyan as the third color. After the CFA image corresponding to the MWY CFA base mode is de-mosaiced, the color at each pixel can also be changed from red, green, blue three primary colors, and magenta, yellow and cyan are the complementary colors of the three primary colors, and can be interchanged without deviation between the three primary colors. The correction module 405 can convert the existing magenta, yellow and cyan into Three primary colors, and then compare and correct the color obtained at each pixel point after demosaicing with the converted color without affecting the comparison result.

本发明实施例选定CFA基模式,其中,所述CFA基模式对应的CFA中包括全色像素及两种颜色像素;在所述CFA中选择数量不超过设定值的像素点;用除所述两种颜色之外的第三种颜色替换所选像素点处的颜色,获得所需的CFA。因CFA中有全色像素,因此CFA的感光性能较好;因第三种颜色所占的比例不超过设定值,因此可以认为选定的CFA解镶嵌的复杂度较小;在所述CFA中选择数量不超过设定值的像素点,用第三种颜色替换所选像素点处的颜色,因每个像素点处解镶嵌后获得的均为三基色,而加入第三种颜色后的CFA也有三种颜色,因此在成像过程中,可以用这三种颜色分别作为参照,来校准及修正解镶嵌后获得的颜色,以避免出现偏色现象而影响相机的性能,从而得到感光度较高、偏色较少、质量较好的图像。选定的CFA基模式中除全色像素外的三种颜色可以为三基色,因此解镶嵌的复杂度较小;且只在设定值范围内用第三种颜色替代某处颜色,在解镶嵌过程中此第三种颜色可以忽略,基本不会影响到CFA的解镶嵌性能。The embodiment of the present invention selects the CFA base mode, wherein the CFA corresponding to the CFA base mode includes panchromatic pixels and two-color pixels; selects pixels whose number does not exceed the set value in the CFA; Replace the color at the selected pixel with a third color other than the above two colors to obtain the desired CFA. Because there are panchromatic pixels in the CFA, the photosensitivity of the CFA is better; because the proportion of the third color does not exceed the set value, it can be considered that the complexity of the demosaicing of the selected CFA is small; in the CFA Select the number of pixels that do not exceed the set value, and replace the color at the selected pixel with the third color, because each pixel is obtained after demosaicing is three primary colors, and after adding the third color CFA also has three colors. Therefore, in the imaging process, these three colors can be used as references to calibrate and correct the colors obtained after demosaicing, so as to avoid color cast and affect the performance of the camera. Higher, better quality images with less color cast. In the selected CFA base mode, the three colors except panchromatic pixels can be three primary colors, so the complexity of demosaicing is small; and only a third color is used to replace a certain color within the set value range, and in the solution The third color can be ignored during the mosaic process, and basically does not affect the demosaic performance of CFA.

本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) having computer-usable program code embodied therein.

本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and combinations of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a Means for realizing the functions specified in one or more steps of the flowchart and/or one or more blocks of the block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart flow or flows and/or block diagram block or blocks.

显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (9)

1. the acquisition methods of a color filtering array CFA is characterized in that, may further comprise the steps:
Selected one-period property CFA pattern is as CFA basic mode formula, wherein, comprise panchromatic pixels and two kinds of color pixel among described selected CFA basic mode formula and the corresponding CFA, described two kinds of colors are any two kinds of colors in any two kinds of colors in the red, green, blue three primary colors or three primary colors complementary color green grass or young crops, magenta, the yellow;
Select quantity to be no more than 2% pixel in the CFA of described selected CFA basic mode formula correspondence, wherein, the pixel of described selection is for to select quantity to be no more than described 2% pixel in described CFA at random; Perhaps in described CFA, to select quantity to be no more than described 2% pixel in pseudorandom mode; Perhaps in described CFA, to select quantity to be no more than described 2% pixel in nonrandom mode;
The color of replacing the pixel place of described selection with the third color except described two kinds of colors, obtain CFA, wherein, the color of selected pixel is panchromatic pixels or two kinds of color pixel, and described the third color is the color except described two kinds of colors in the color except described two kinds of colors or the three primary colors complementary color in the three primary colors.
2. the method for claim 1 is characterized in that, the shared ratio of panchromatic pixels among the CFA of described CFA basic mode formula and correspondence is not less than 1/2; Two kinds of shared ratios of color all are not more than 1/4.
3. a formation method is characterized in that, may further comprise the steps:
Carry out imaging with the imageing sensor that has CFA as claimed in claim 1, and obtain the CFA image;
The CFA image is carried out solution to be inlayed;
The existing color value in all pixel places in the described CFA image is conciliate the value of inlaying this color that the back obtains compare, when comparison result was inconsistent, the color of the entire image after according to the existing all colours value of CFA image solution being inlayed was revised.
4. method as claimed in claim 3 is characterized in that, the CFA that described CFA obtains for the acquisition methods according to CFA.
5. the deriving means of a CFA is characterized in that, comprising:
Select module, be used for selected one-period property CFA pattern as CFA basic mode formula, wherein, comprise panchromatic pixels and two kinds of color pixel among the CFA of described selected CFA basic mode formula correspondence, described two kinds of colors are any two kinds of colors in any two kinds of colors in the red, green, blue three primary colors or three primary colors complementary color green grass or young crops, magenta, the yellow, and in the CFA of described selected CFA basic mode formula correspondence, select quantity to be no more than 2% pixel, wherein, the pixel of described selection is for to select quantity to be no more than described 2% pixel in described CFA at random; Perhaps in described CFA, to select quantity to be no more than described 2% pixel in pseudorandom mode; Perhaps in described CFA, to select quantity to be no more than described 2% pixel in nonrandom mode;
Processing module, be used for the color that the third color except described two kinds of colors is replaced the pixel place of described selection, obtain CFA, wherein, the color of the pixel of described selection is panchromatic pixels or two kinds of color pixel, and described the third color is the color except described two kinds of colors in the color except described two kinds of colors or the three primary colors complementary color in the three primary colors.
6. device as claimed in claim 5 is characterized in that, the shared ratio of panchromatic pixels among the CFA of described CFA basic mode formula correspondence is not less than 1/2; The shared ratio of other two kinds of color pixel all is not more than 1/4.
7. an imaging device is characterized in that, comprising:
Acquisition module carries out imaging with the imageing sensor that has CFA as claimed in claim 1, and obtains the CFA image;
Operational module is used for that described CFA image is carried out solution and inlays;
Correction module, be used for the value that this color of back acquisition is inlayed in the existing color value reconciliation in all pixel places of described CFA image is compared, when comparison result was inconsistent, the color of the entire image after according to the existing all colours value of CFA image solution being inlayed was revised.
8. device as claimed in claim 7 is characterized in that, the CFA that described CFA obtains for the acquisition methods according to CFA.
9. CFA, described CFA generates according to method according to claim 1, it is characterized in that described CFA comprises:
The filter disc of panchromatic pixels filter disc, two kinds of colors and the third color filter disc except described panchromatic pixels filter disc and two kinds of color filter discs;
The shared ratio of panchromatic pixels filter disc is not less than 1/2, and the shared ratio of other two kinds of color filter discs all is not more than 1/4;
The quantity of the pixel that described the third color filter disc is shared is no more than set point;
Described two kinds of colors are any two kinds of colors in three primary colors or the three primary colors complementary color, and the third color is the color except described two kinds of colors in three primary colors or the three primary colors complementary color;
Wherein, by using described the third filter disc to replace the filter disc of panchromatic pixels filter disc or two kinds of colors.
CN201110087810.1A 2011-04-08 2011-04-08 Method and device for capturing CFA (color filter array) Expired - Fee Related CN102158632B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110087810.1A CN102158632B (en) 2011-04-08 2011-04-08 Method and device for capturing CFA (color filter array)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110087810.1A CN102158632B (en) 2011-04-08 2011-04-08 Method and device for capturing CFA (color filter array)

Publications (2)

Publication Number Publication Date
CN102158632A CN102158632A (en) 2011-08-17
CN102158632B true CN102158632B (en) 2013-07-10

Family

ID=44439792

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110087810.1A Expired - Fee Related CN102158632B (en) 2011-04-08 2011-04-08 Method and device for capturing CFA (color filter array)

Country Status (1)

Country Link
CN (1) CN102158632B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1455910A (en) * 2000-07-18 2003-11-12 索尼电子有限公司 Color cast detection and removal in digital images
CN101233762A (en) * 2005-07-28 2008-07-30 伊斯曼柯达公司 Image sensor with improved lightsensitivity
CN101455075A (en) * 2005-10-13 2009-06-10 Rjs科技公司 System and method for a high performance color filter mosaic array

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1455910A (en) * 2000-07-18 2003-11-12 索尼电子有限公司 Color cast detection and removal in digital images
CN101233762A (en) * 2005-07-28 2008-07-30 伊斯曼柯达公司 Image sensor with improved lightsensitivity
CN101455075A (en) * 2005-10-13 2009-06-10 Rjs科技公司 System and method for a high performance color filter mosaic array

Also Published As

Publication number Publication date
CN102158632A (en) 2011-08-17

Similar Documents

Publication Publication Date Title
CN102131040B (en) Adaptive lens shading correction
TWI504276B (en) Image sensor for capturing a color image
CN107534735B (en) Image processing method, device and terminal of terminal
EP2733944B1 (en) Image pickup apparatus and signal value correction method
JP5095040B1 (en) Color image sensor
JP2007251393A5 (en)
JP6104985B2 (en) Digital image sensor, image acquisition method, image reconstruction method, and execution system thereof
TWI449027B (en) Adaptive pixel compensation method
JP2016523013A (en) Device for acquiring bimodal images
CN105993169A (en) System and method for image demosaicing
JP5600814B2 (en) Image processing apparatus and method, and imaging apparatus
CN103650487A (en) Image pickup apparatus, image pickup element, and sensitivity difference correction method
CN103444183A (en) Color imaging element, imaging device, and imaging program
TW201123853A (en) Method for removing color fringe in digital image.
US8929682B2 (en) Calibrating image sensors
US9160999B2 (en) Image processing device and imaging device
CN113301278A (en) Method of calibrating image sensor and apparatus for calibrating image sensor
TWI528820B (en) Spatial binning method, spatial binning circuit and computer readable medium
JP2014158267A (en) Color filter, imaging element, image processing device, and image processing method
CN102158632B (en) Method and device for capturing CFA (color filter array)
CN103621070A (en) Imaging device and imaging program
JP6843682B2 (en) Image sensor and image sensor
JP6794989B2 (en) Video processing equipment, shooting equipment, video processing methods and programs
JP2005333418A (en) Color solid state imaging apparatus
CN106852190B (en) Image processing unit, filming apparatus and image processing method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130710

Termination date: 20160408