JP2011066505A - Method for reading moving image signal of solid-state imaging device and imaging apparatus - Google Patents

Abstract

A high-definition moving image signal is read from a solid-state imaging device.
Out of the red filter pixels R and r, the green filter pixels G and g, and the blue filter pixels B and b that are arrayed at positions shifted by 1/2 pixel in the vertical and horizontal directions, pixel thinning readout is performed, and When adding and synthesizing to obtain a moving image signal, two consecutive rows are alternately set in a signal reading area and non-reading areas 45, 46, 47, and 48, and the color arrangement of the synthesized moving image signal is a Bayer arrangement. The thinning readout and the addition processing are performed so that
[Selection] Figure 5

Description

  The present invention relates to a method for reading a moving image signal from a solid-state image sensor for capturing a single-plate color image, and an imaging apparatus.

  In recent years, the number of pixels has been increased in a solid-state imaging device, and it has become common to mount 10 million pixels or more. Along with this, the saturation charge amount of one miniaturized pixel is reduced, making it difficult to perform high-sensitivity imaging, and it is also difficult to capture an image with a wide dynamic range.

  Therefore, as shown in FIG. 13, even-numbered pixels are shifted from the odd-numbered pixels by a ½ pixel pitch, and one pixel in the odd-numbered rows and even-numbered rows (the pixels in the odd-numbered rows are seen as pixels). The array is a square lattice array, and the pixel array is a square lattice array even when only pixels in even rows are viewed.) RGB color filters are arranged in a Bayer array, and RGB (upper Bayer) is also applied to the other pixels in the odd and even rows. In order to distinguish from the arrangement, a solid-state image pickup device in which color filters of rgb are expressed in a small letter is used.

  By adopting such a pixel arrangement and color filter arrangement, two diagonally adjacent pixels become the same color pixel, and by adding signals of the same color pixels of these two pixels, high-sensitivity shooting is possible. By changing the exposure time of one pixel of the same color to the exposure time of the other and adding both signals, it is possible to shoot a wide dynamic range, and by reading out the signal of each pixel individually and reproducing the image, shooting a high-definition image Is possible.

  As the prior art having the color filter array of FIG. 13 described above, there are Patent Documents 1 and 2 disclosing a CCD solid-state image sensor and Patent Document 3 disclosing a CMOS solid-state image sensor.

JP 2009-60342 A Japanese Patent Laid-Open No. 2004-55786 JP 2007-124137 A

  In order to capture a high-definition still image, the number of pixels of the solid-state imaging device has been increased. However, it is impossible to capture a moving image while maintaining the same high-definition as a still image. Therefore, only the pixel signals at discrete positions on the solid-state image sensor are read (so-called thinning-out reading), and the signals of the same color pixels that are close to each other are added to increase the sensitivity, thereby reducing the moving image from the still image. An image is generated.

  When a moving image is captured by an imaging apparatus capable of capturing a high-definition still image, the user's support cannot be obtained unless the moving image has a sense of detail. For this reason, there is a problem of how to perform decimation readout and addition processing with a solid-state imaging device having the pixel arrangement and color filter arrangement shown in FIG. .

  An object of the present invention is to provide a reading method and an imaging apparatus that read moving image data with a fine feeling from a solid-state imaging device having a pixel array and a color filter array illustrated in FIG.

  The method of reading a moving image signal of a solid-state image pickup device according to the present invention includes a plurality of pixels arrayed in a square lattice pattern on the surface of a semiconductor substrate, and a primary color red filter, green filter, and blue filter are arranged in a Bayer array. A primary color red filter, a green filter, and a blue filter are arranged in a Bayer array, which is composed of one pixel group and a plurality of pixels arrayed in a square lattice pattern on the surface of the semiconductor substrate in a region overlapping the first pixel group. Both of them are a moving image signal readout method for a solid-state imaging device comprising a second pixel group having pixels at positions shifted by a ½ pixel pitch in both the vertical and horizontal directions with respect to the respective pixels of the first pixel group. A total of two pixel rows of the solid-state imaging device, ie, odd and even rows, are set as signal readout regions, and the signal readout regions are alternately set with non-readout regions of a predetermined number of pixel rows, Th said non Read out a signal having the same color pixel on which a predetermined number of red filters are mounted from the two signal readout regions on the upper side and the lower side in the vertical direction of the output region, and the red center of gravity of the same color pixel being in the non-read region And reading out signals from the signal readout region that have the same color pixel with a green filter and whose green centroid position of the same color pixel is in the same row as the red centroid location, The same color pixel having a predetermined number of green filters mounted from the two lower signal readout regions, and reading out a signal whose green barycentric position of the same color pixel is in the non-readout region, and from the signal readout region, a blue filter Read out a signal in which the blue barycentric position of the same color pixel is in the same row as the green barycentric position, and the red barycentric position, the green barycentric position, and the blue barycenter Wherein the reading the signal sequence of the location is Bayer array as a moving image signal.

  An image pickup apparatus according to the present invention includes the solid-state image pickup device described above and an image pickup device driving unit that executes the moving image signal reading method described above.

  According to the present invention, since the color arrangement at the barycentric position of the same color pixel when pixel thinning / pixel addition is performed is a Bayer arrangement, moving image data with high definition can be obtained.

It is a functional block block diagram of the imaging device which concerns on one Embodiment of this invention. It is a surface schematic diagram of the CCD type solid-state imaging device shown in FIG. It is a figure which shows the color filter arrangement | sequence of the CCD type solid-state image sensor shown in FIG. FIG. 4 is a diagram illustrating only a pixel portion (reading region) for reading moving image data in the color filter array of FIG. 3. FIG. 5 is a diagram for describing pixel addition of four pixels of the same color among the pixels in the readout region shown in FIG. 4. FIG. 6 is a diagram for explaining a method for reading / driving a vertical charge transfer path of a CCD type solid-state imaging device when performing pixel addition shown in FIG. 5. FIG. 7 is a diagram for explaining a continuous line memory and horizontal charge transfer path driving method in FIG. 6; FIG. 7 is a diagram illustrating a method for reading / driving a vertical charge transfer path according to an embodiment instead of FIG. 6. FIG. 9 is a diagram for explaining a continuous line memory and horizontal charge transfer path driving method in FIG. 8; It is a figure explaining the pixel addition method replaced with FIG. It is a figure explaining the reading / driving method of the vertical charge transfer path of a CCD type solid-state image sensor in the case of performing pixel addition shown in FIG. It is a figure explaining the drive method of the continuous line memory and horizontal charge transfer path to FIG. It is a figure which shows an example of the pixel arrangement | sequence and color filter arrangement | sequence which this invention applies.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a functional block diagram of an imaging apparatus according to an embodiment of the present invention (the illustrated example is a digital still camera with a moving image shooting function; hereinafter referred to as a digital camera).

  The digital camera 20 includes an imaging unit 21, an analog signal processing unit 22 that performs analog processing such as automatic gain adjustment (AGC) and correlated double sampling processing (CDS) on analog image data output from the imaging unit 21, and An analog / digital conversion unit (A / D) 23 that converts analog image data output from the analog signal processing unit 22 into digital image data, and an A / D 23, analog signal according to an instruction from a system control unit (CPU) 29 described later. A processing unit 22, a driving unit (including a timing generator TG) 24 that controls driving of the imaging unit 21, and a flash 25 that emits light in response to an instruction from the CPU 29 are provided.

  The imaging unit 21 collects light by an optical lens system 21a that collects light from the object scene, a diaphragm that restricts the light that has passed through the optical lens system 21a, a mechanical shutter 21b that is used when capturing a still image, and an optical lens system 21a. A CCD type solid-state imaging device 100 for imaging a single-plate color image that receives light and is focused by a diaphragm and outputs captured image data (analog image data). A CMOS type solid-state imaging device can also be used.

  The digital camera 20 of the present embodiment further captures digital image data output from the A / D 23, white balance correction, RGB / YC conversion processing, and synthesis processing of detection signals of the first pixel group and the second pixel group described later. , A digital signal processing unit 26 that performs a synchronization process to obtain RGB three-color signals at one pixel position from surrounding signals, and compresses or reversely decompresses the image data into image data such as JPEG format A compression / decompression processing unit 27 for displaying, a display unit 28 for displaying a menu and the like, a through image and a captured image, a system control unit (CPU) 29 for overall control of the entire digital camera, and an internal memory such as a frame memory 30 and a media interface (I / F) that performs interface processing between the JPEG image data and the like recording medium 32 And 31, and a bus 40 for connecting these to each other, also, the system control unit 29, an operation unit 33 for inputting instructions from the user is connected.

  The user operation unit 33 includes an instruction switch for setting a shooting mode to a still image shooting mode or a moving image shooting mode, a range width instruction button for a dynamic range, a shutter release button, and the like. The CPU 29 performs drive control of the solid-state image sensor 100 via the image sensor drive unit 24 in accordance with the input content from the user operation unit 33.

  FIG. 2 is a schematic view of the surface of the solid-state image sensor 100. In the digital camera 20 of the present embodiment, a CCD solid-state image sensor having a so-called honeycomb pixel arrangement in which pixels are arranged in a checkered pattern is used as the solid-state image sensor 100.

  A plurality of pixels (photoelectric conversion elements: photodiodes PD) 101 are arranged in a two-dimensional array on the surface portion of the semiconductor substrate. Then, even-numbered pixel rows are formed with a 1/2 pixel pitch shift with respect to odd-numbered pixel rows.

  If only the pixels (first pixel group) in even rows (or odd rows) are viewed, each pixel (photoelectric conversion element) is arranged in a square lattice, and a color filter (R = Red, G = green, B = blue) are arranged in a Bayer array. If only the pixels (second pixel group) in the odd-numbered rows (or even-numbered rows) are viewed, each pixel is arranged in a square lattice, and a color filter (r = red, g = green, b = blue) is arranged in a Bayer array.

  The upper case RGB and the lower case rgb are the same in color, but are only used properly in order to easily distinguish the first pixel group and the second pixel group. Hereinafter, a pixel mounted with an R filter is referred to as an R pixel, a pixel mounted with a G filter is referred to as a G pixel,..., A pixel mounted with a b filter is referred to as a b pixel.

  As a result, the color filter array of the solid-state imaging device 100 of the present embodiment is the same as that in FIG. 13, and as shown in FIG. 3, the first pixel group and the second pixel group are the same region on the surface portion of the semiconductor substrate. Are arranged so as to be shifted by one pixel in an oblique direction.

  In FIG. 3, the G filter is arranged in an obliquely upward right direction. In other words, the G filters are arranged in an obliquely upward left direction. Even in this arrangement, each embodiment of the present invention is applicable.

  Returning to FIG. 2, along each pixel column, a vertical charge transfer path (VCCD) 102 meanders so as to avoid each pixel 101, and horizontally along the transfer direction end of each vertical charge transfer path 102. A charge transfer path (HCCD) 103 is provided, and an amplifier 104 that outputs a voltage value signal corresponding to the amount of transferred charges as imaging data is provided at the output portion of the horizontal charge transfer path 103.

  In the present embodiment, a line memory 105 having a buffer area corresponding to each vertical charge transfer path is provided between the transfer direction end of each vertical charge transfer path 102 and the horizontal charge transfer path 103.

  The line memory 105 takes the timing when the signal charge received and temporarily held from each vertical charge transfer path 102 is transferred to the horizontal charge transfer path 103 as described in, for example, JP-A-2002-112119. Thus, pixel addition on the horizontal charge transfer path 103 of the same color signal charge can be easily performed.

  In addition, when signal read driving in which signal charges of the same color are continuously performed on one vertical charge transfer path 102, a plurality of signal charges are received in the corresponding buffer region, so that the pixels on the line memory 105 are received. Addition is possible.

  V1 to V8 shown on the left side of FIG. 2 indicate pulse application pads of the transfer electrodes V1 to V8 constituting the vertical charge transfer path 102. For example, when a read pulse is applied to the transfer electrodes V1 and V5, When the accumulated charges in the group pixels R, G, and B are read out in the potential packet under the transfer electrodes (also used as readout electrodes) V1 and V5, and a readout pulse is applied to the electrodes V3 and V7, the second group pixel r, The accumulated charges g and b are read out in the potential packet below the transfer electrodes (also used as read electrodes) V3 and V7. The example shown in FIG. 2 is the case of 8-phase driving, but driving methods such as 16-phase driving and 32-phase driving are also possible.

  Although the terms “horizontal” and “vertical” are used for explanation, this means only “one direction” along the surface of the semiconductor substrate and “a direction substantially perpendicular to the one direction”.

  When shooting a high-definition still image using such a solid-state imaging device 100, it is only necessary to individually acquire detection signals of individual pixels and reproduce a subject image. A bright image can be obtained by adding signals of pixels of the same color adjacent to each other diagonally, and when shooting an image with a wide dynamic range, exposure is performed simultaneously by changing the exposure time of the first pixel group and the second pixel group. Then, signals of the same color pixels that are obliquely adjacent may be added.

  Next, a method for generating moving image data will be described. The moving image data is generated by thinning out and reading out only the necessary pixels among the pixels for capturing a still image, and adding the same color pixels.

  FIG. 4 is a diagram showing pixel positions where pixel thinning is performed in order to generate moving image data in the present embodiment. Moving image data is generated using pixels described as RGBrgb, and is shown by blanks. The pixel is not used as moving image data without reading a signal.

  That is, two consecutive pixel rows (signal readout region) are used, the next two consecutive pixel rows (non-readout region) are not used, and the next two consecutive pixel rows are used. In the example shown in FIG. 4, moving image data is generated using 1/2 of all the pixels. As a result, each non-read region (2 rows in this example) 45, 46, 47, and 48 that is not used is divided into two pixel rows (first pixel group (RGB) and second pixel group (rgb)). The signal reading area) is sandwiched. In each pixel column, only the same color pixels (g pixel, R pixel, b pixel, G pixel) are arranged.

  Pixel thinning is performed in this way, and then moving image data is generated by mixing and adding signals of four pixels of the same color. 5, R, G, and B shown in FIG. 5 indicate the barycentric positions of the four pixels when the surrounding four pixels of the same color are mixed and added. The barycentric position obtained by mixing and adding a total of four R pixels of the upper two pixels and the lower two pixels of the non-reading area 45 comes to the center of gravity in the non-reading area 45, and the added signal becomes an R signal of this barycentric position .

  The centroid position obtained by adding the four G pixels adjacent to the four R pixels to be added comes to the position next to the R centroid position (R with a circle) in the non-readout region 45, and the signal of the mixed addition pixel G It becomes. The same applies to the non-readout area 47, but since the drawings are complicated, only the mixed addition pixels R and G are indicated by R and G with a circle in the non-readout area 47.

  The four pixels to be added of the R pixel and the G pixel described above all use the R pixel and the G pixel of the first pixel group. However, in the next non-read regions 46 and 48, the g pixel of the second pixel group. , B pixels are used for mixed addition. If the arrow indicating the addition destination is illustrated in the non-reading area 46, the drawing becomes complicated. Therefore, only the mixed addition pixels G and B are indicated by a circle, and the arrow indicating the addition destination is illustrated only in the non-reading area 48.

  Through the above four-pixel mixed addition, moving image data can be generated using all of the pixels to be used. As a result, when viewing the arrangement of R, G, and B pixels with a circle, the signal colors whose center of gravity is located in the non-readout regions 45 and 47 are aligned with RGRG. Will line up with GBGB.

  The color arrangement at the center of gravity (RGB with o) is basically a Bayer arrangement, although there is a slight shift in the vertical and horizontal pitches. Since the Bayer array has the same vertical and horizontal definition, moving image data is obtained using the added pixels RGB, and the moving image data is processed simultaneously to obtain RGB three-color signals at the respective centroid positions. A moving image with a fine sense can be obtained.

  The signal readout by “pixel thinning” and “pixel addition” explained in FIG. 5 can read out the signal of an arbitrary pixel by XY scanning in the case of a CMOS type solid-state imaging device, so the signals after readout are added by image processing. However, since the solid-state imaging device of the present embodiment is a CCD type, a driving procedure for performing mixed addition reading in the solid-state imaging device will be described below.

  6 shows a vertical charge transfer path 102 (originally a vertical charge transfer path formed in a meandering manner as shown in FIG. 2, but is shown in a straight line in FIG. 6. Also, in FIG. 6 shows an example in which the vertical charge transfer path is driven by 16-phase driving. FIG. 6 shows a case in which two pixels are mixed and added and transferred, and FIG. Then, a mixed addition of 2 pixels + 2 pixels = 4 pixels is performed using the line memory 105 and the horizontal charge transfer path 103.

  In the example of pixel thinning shown in FIG. 5, the leftmost pixel in the first column is only g pixels, and these g pixels are added two by two in the vertical charge transfer path. The pixels in the second column are only R pixels, and the R pixels are added in the vertical charge transfer path by two pixels, and the pixels in the third column are only b pixels. Since the pixels in the fourth column are only G pixels, the G pixels are added two by two in the vertical charge transfer path, and so on.

  First, as shown in FIG. 6, every other signal charge of the same color pixels arranged in the odd columns and the same color pixels arranged in the even columns is read out to the respective vertical charge transfer paths by the first read pulse. Then, the vertical charge transfer path is transferred in the vertical direction until the potential packet position storing the first signal charge reaches the pixel position that has not been read the first time, and the second signal reading is performed. Thereby, pixel addition of two pixels of the same color is performed on the vertical charge transfer path. Thereafter, the transfer of the vertical charge transfer path is repeated. In FIG. 6, two pixels of the same color to be added are surrounded by a dotted line.

  When the transfer of the vertical charge transfer path is performed in this way, as shown in FIG. 7A, the signal charge obtained by adding two pixels is transferred to each vertical charge transfer path. This is transferred to the line memory 105 for one line. First, only the G signal charge is horizontally added to perform 4-pixel addition, and then the B signal charge is horizontally added to 4 pixels. Accordingly, the 4-pixel mixed addition (with circle) GBGB... Line described in FIG. 5 is completed, and this GB signal charge is horizontally transferred and output from the amplifier 104 as a captured image signal.

  Next, the same operation is performed for the remaining RG lines, and output from the amplifier 104 of the 4-pixel mixed addition RGRG... Line is performed.

  As described above, the moving image data read from the solid-state imaging device according to the present embodiment has a Bayer array. For example, G signals are arranged in a checkered pattern in the vertical direction and the horizontal direction in comparison with the G stripe array, so that the number of pixels is the same. Therefore, the luminance resolution is improved and the sense of detail is improved.

  At the same time, since only one color signal charge is arranged in each vertical charge transfer path, even if a transfer failure occurs in the vertical charge transfer path, vertical stripes due to color rotation do not stand out, and the manufacturing yield of the solid-state imaging device Can be improved.

  Further, since only the same colors (primary colors) are added, high color reproducibility can be maintained, and furthermore, the exposure and accumulation times are the same for the pixels located on the odd lines and the pixels located on the even lines. is there. That is, since the exposure time is the same for each color, there is an effect that white balance adjustment when adjusting the exposure time using the electronic shutter is facilitated.

  Note that signal charges accumulated in each pixel in the non-readout region are discarded in the semiconductor substrate by reading out each signal in the signal readout region and then applying an electronic shutter (OFD pulse) to the semiconductor substrate.

  8 and 9 are diagrams for explaining a method of driving a CCD solid-state imaging device according to another embodiment. Also in this embodiment, pixel thinning and pixel addition described in FIG. 5 are performed. The difference between FIG. 6 and FIG. 7 is in the driving method of the vertical charge transfer path, the horizontal charge transfer path, and the line memory.

  In the driving method of the present embodiment, as shown in FIG. 8, the 16-phase driving vertical charge transfer path is handled and driven as if it were 8 phases. First, an odd column read operation is performed to read signals from all pixels other than the non-read region to the vertical charge transfer path. At this time, pixel addition in the vertical direction is not performed in the vertical charge transfer path.

  Next, vertical transfer is performed to move the potential packet containing the signal charge to the corresponding pixel position in the even column. Then, the signal reading operation from each pixel is completed by performing the reading operation for the even columns. Thereafter, the vertical transfer, the line memory, and the horizontal charge transfer path are repeatedly performed, thereby adding four pixels on the horizontal charge transfer path and sequentially outputting them.

  FIGS. 9A and 9B are diagrams schematically showing the procedure of the horizontal pixel addition operation. First, a vertical transfer operation is performed to transfer one signal line to the line memory. At this time, in order to operate the vertical charge transfer path as eight phases, only the signal charge for one pixel enters the line memory.

  Next, the vertical transfer operation is performed again. At this time, for the GB row, the mixed addition of two vertical pixels is performed in the line memory. On the other hand, the RG row contains a signal for one pixel (as shown in FIG. 8, since the first signal charge in the even-numbered column is not a charge to be added and is considered invalid). .

  Then, the signal charge obtained by adding two pixels on the line memory is transferred from the line memory 105 to the horizontal charge transfer path, and pixel mixing of 2 pixels + 2 pixels = 4 pixels is performed in the horizontal charge transfer path. Horizontal pixel addition is performed, and this GB row signal is output.

  Next, when vertical transfer is performed, vertical two-pixel addition of the RG row is performed in the line memory. Then, in the same manner as described above, the horizontal 4 pixel addition of the RG row is performed, and the signal output of the RG row is performed. Thereafter, the pixel addition operation for the GB row is performed again, and thereafter, the signal output for the GB row and the RG row is sequentially performed.

  As described above, the driving method of the present embodiment is characterized in that the vertical charge transfer path is regarded as 8-phase driving and vertical addition is alternately performed in the line memory.

  In this embodiment, the same effects as those of the embodiments described with reference to FIGS. 6 and 7 can be obtained. Further, by performing an operation in which the vertical charge transfer path is regarded as an 8-phase drive, a single vertical transfer operation can be performed. There is a feature that the number of transfer stages is small. Thereby, the vertical transfer efficiency is improved and the yield is further improved.

  FIG. 10 is a diagram for explaining pixel addition positions according to another embodiment instead of FIG. The pixel positions to be thinned out are the same as in FIG. 4, and for the R and B pixels, the four pixel positions to be added are the same as in FIG. Only the center-of-gravity position after the mark is indicated by R and B with a circle.

  In this embodiment, the position of the G pixel to which four pixels are added is changed from that in FIG. 5, and as shown in FIG. 10, the first pixel group and the first pixel group which are the pixel rows closest to the non-reading region across the non-reading region. Neighboring four pixels of the two-pixel group are added.

  In FIG. 5, the four pixels to which G pixels are added all belong to the first pixel group in the circled RG line, and all belong to the second pixel group in the circled GB line. However, in the embodiment of FIG. 10, two pixels belonging to the first pixel group and two pixels belonging to the second pixel group are added.

  The two g pixels belonging to the second pixel group to be added to the two G pixels belonging to the first pixel group are shifted by a ½ pixel pitch in the horizontal direction. Compared with the embodiment of FIG. 5, the positions of the two lower pixels of the four pixels to be added are shifted by a ½ pixel pitch in the vertical direction.

  As a result, the center-of-gravity position after the addition of four pixels in this embodiment is a position that is shifted by a ½ pixel pitch in both the vertical direction and the horizontal direction as compared with the embodiment of FIG. As a result, the color arrangement of the barycentric positions after the addition of four pixels in this embodiment is a Bayer arrangement as in FIG. 5, but the barycentric arrangement pitches of the G pixels after addition are equally spaced. Thereby, the luminance resolution further increases in the moving image data of the present embodiment.

  11 and 12 are diagrams for explaining a method of driving a CCD solid-state imaging device that realizes the pixel addition of FIG. In the present embodiment, the arrangement of the four pixels to be added by the R pixel and the B pixel is the same as that in FIG. 5, but the positions of the four pixels to be added to the G pixel are different. For this reason, for the G pixel, signal charges in the same vertical charge transfer path are not added together. The order of reading and transferring signal charges to the vertical charge transfer path in FIG. 11 is the same as that in FIG.

  FIG. 12 is a diagram schematically illustrating an operation method of horizontal addition. First, a vertical transfer operation is performed to transfer one signal line to the line memory. At this time, in order to operate the vertical charge transfer path as eight phases, the line memory contains only signal charges for one pixel (FIG. 12A).

  Next, only the G signal charge is transferred to the line memory. Then, the G signal charge is moved in the horizontal charge transfer path, and further vertical transfer is performed. At this time, vertical two-pixel addition of the B signal charge is performed in the line memory.

  Then, only the G signal charge is transferred to the line memory. At this time, the horizontal two-pixel addition of the G signal charge is performed in the horizontal charge transfer path. After that, horizontal two pixel addition of the G signal charge and the B signal charge is performed, the signal addition operation is completed, and the addition signal of the GB line is output from the amplifier 104.

  Next, in the same manner as described above, the addition operation of the RG line is performed, and the signal of the RG line after the addition is output. By repeating such an operation, moving image data constituted by repetition of the RG line and the GB line is output from the solid-state imaging device.

  As described above, in this embodiment, the pixel addition is performed on the same vertical charge transfer path for the R signal charge and the B signal charge, while the pixel memory is not added on the same vertical charge transfer path for the G signal charge. 4-pixel addition is performed using the horizontal charge transfer path.

  According to the present embodiment, the same effects as those of the above-described embodiment can be obtained, and the center of gravity arrangement of G pixels after pixel addition is completely evenly spaced, so that the resolution of the moving image can be further improved.

  In the above-described embodiment, as shown in FIG. 4, pixel thinning is performed in which two consecutive rows of all pixels are a signal readout region and the next two consecutive rows are non-readout regions. Even if there are two rows and non-readout regions are continuous n rows (n = 3, 4,...), The added barycentric arrangement after the addition of four pixels can be a Bayer arrangement.

  If n = even, only the same color signal charge is read out to one vertical charge transfer path as in the above-described embodiment, but if n = odd, different colors are displayed in one vertical charge transfer path. Since signal charges are transferred, it is preferable to use a CCD solid-state imaging device with high transfer efficiency.

  However, in the case of a CMOS type, even if n = odd or n = even, there is no problem in transfer efficiency, and pixel addition may be performed by image processing after reading.

  In the above-described embodiment, since moving image data is generated using all the pixels included in the signal readout region, a shift occurs in the color arrangement pitch of the centroid position after addition. Alternatively, the pixels to be added may be selected from the signal readout region so that the color arrangement pitch of the pixels is equal.

  In this case, a pixel that does not use a signal is generated among the pixels in the signal readout region. Therefore, if it is a CCD type, the driving method is a little complicated. However, the CMOS type can be realized without any problem because signal reading is free. Furthermore, although only the 4-pixel addition has been described in the embodiment, it goes without saying that 6-pixel addition (upper and lower 3 pixels), 8-pixel addition (upper and lower 4 pixels), and so on can be performed.

  Even in such a case, the solid-state imaging device of the present embodiment performs pixel thinning of two or more rows in units of pixel rows because the pixel arrangement and the color filter arrangement are both Bayer arrangements in the first pixel group and the second pixel group. However, if pixel addition is performed using the same number of same color pixels in the upper and lower areas of the non-readout area, moving image data having a Bayer array can be easily obtained.

  As described above, the moving image signal readout method of the solid-state imaging device according to the present embodiment is composed of a plurality of pixels arranged in a square lattice pattern on the surface of the semiconductor substrate, and the primary color system red filter, green filter, blue A primary pixel red filter, a green filter, and a first pixel group in which a filter is arranged in a Bayer pattern, and a plurality of pixels arrayed in a square lattice pattern on the surface of the semiconductor substrate in a region overlapping the first pixel group; And a second pixel group having a pixel at a position shifted by a ½ pixel pitch in both the vertical direction and the horizontal direction with respect to each pixel of the first pixel group. A moving image signal readout method, wherein a total of two pixel rows of the solid-state imaging device, ie, odd and even rows, are used as a signal readout region, and the signal readout region is a non-readout region having a predetermined number of pixel rows. Alternately with A predetermined number of red filters from the two signal reading areas on the upper and lower sides of the odd-numbered non-reading area, and the red barycentric position of the same color pixel is Read out a signal within the readout area and read out a signal from the signal readout area that has the same color pixel mounted with a green filter and whose green centroid position of the same color pixel is in the same row as the red centroid position. Read out a signal in which a predetermined number of green filters are mounted from the two signal reading areas on the upper side and the lower side in the vertical direction of the reading area and the green barycentric position of the same color pixel is in the non-reading area In addition, a signal having the same color pixel with a blue filter mounted thereon and a blue barycentric position of the same color pixel in the same row as the green barycentric position is read from the signal reading area, and the red barycentric position and the green barycentric position are read. Wherein the reading the signal sequence of the center of gravity position blue barycentric position is Bayer array as a moving image signal.

  Further, in the moving image signal readout method of the solid-state imaging device according to the embodiment, when the signals are read so that the arrangement of the red centroid position, the green centroid position, and the blue centroid position is a Bayer arrangement, the centroid positions are equally spaced. The same color pixels are selected from the signal readout region.

  The moving image signal readout method of the solid-state imaging device according to the embodiment is characterized in that the solid-state imaging device is a CMOS type.

  In addition, the imaging apparatus of the embodiment includes the above-described CMOS solid-state imaging device, imaging device driving means for reading signals from each pixel of the CMOS-type solid-state imaging device by the above-described moving image signal readout method, and the CMOS type Signal processing means for generating a moving image of a subject by adding signals of the same color pixels using a signal read from a solid-state image sensor;

  Further, the moving image signal readout method of the solid-state imaging device according to the embodiment is characterized in that the solid-state imaging device is a CCD type.

  The moving image signal readout method of the solid-state imaging device according to the embodiment is characterized in that the predetermined number of pixel rows in the non-readout area is an even number.

  The moving image signal readout method of the solid-state imaging device according to the embodiment is characterized in that the signal is read out to a vertical charge transfer path provided for each pixel column and two pixels of the same color are mixed and added in the vertical charge transfer path. And

  Further, the moving image signal readout method of the solid-state imaging device according to the embodiment includes the vertical charge transfer path, the horizontal charge transfer path, and the line memory provided between the vertical charge transfer path and the horizontal charge transfer path. It is characterized in that the mixed addition is performed.

  An imaging apparatus according to the embodiment includes the CCD solid-state imaging device described above, imaging device driving means for driving the CCD solid-state imaging device by the moving image signal readout method described above, and the CCD solid-state imaging device. Signal processing means for generating a moving image of the subject based on the output signal.

  According to the embodiment described above, since the color arrangement at the barycentric position of the same color pixel when pixel thinning / pixel addition is performed is a Bayer arrangement, moving image data with high definition can be obtained.

  The moving image signal readout method of the solid-state imaging device according to the present invention is such that when a reduced image for moving image is generated by performing pixel thinning / pixel addition from a high-definition captured image for still image capturing, the color array is a Bayer array. Reduced image data can be obtained, and moving image data with high definition can be obtained. Therefore, it is useful when applied to digital still cameras, digital video cameras, camera-equipped mobile phones, camera-equipped electronic devices, surveillance cameras, endoscopes, in-vehicle cameras, and the like.

20 imaging device 21 imaging unit 24 driving unit (imaging element driving means)
26 Digital signal processing unit 45, 46, 47, 48 Non-readout area 100 CCD type solid-state imaging device 101 Pixel 102 Vertical charge transfer path (VCCD)
103 Horizontal charge transfer path (HCCD)
104 Output amplifier 105 Line memory R, r Red filter G, g Green filter B, b Blue filter RGB First pixel group color filter rgb Second pixel group color filter

Claims (9)

A first pixel group composed of a plurality of pixels arrayed in a square lattice pattern on the surface of the semiconductor substrate and in which primary-color red filters, green filters, and blue filters are Bayer-arrayed, and an area overlapping the first pixel group A plurality of pixels arranged in a square lattice pattern on the surface of the semiconductor substrate, and primary color red filters, green filters, and blue filters are arranged in a Bayer array and are perpendicular to each pixel of the first pixel group. A method of reading a moving image signal of a solid-state imaging device comprising a second pixel group having pixels at positions shifted by a ½ pixel pitch in both the horizontal and horizontal directions,
A total of two pixel rows of the odd-numbered and even-numbered rows of the solid-state imaging device are set as signal readout regions and the signal readout regions are alternately set with non-readout regions of a predetermined number of pixel rows,
Odd-numbered non-reading areas of the same color pixel having a predetermined number of red filters from the two signal reading areas on the upper and lower sides in the vertical direction, and the red center of gravity position of the same color pixel is within the non-reading area And reading out a signal in which the green color centroid position of the same color pixel is in the same row as the red centroid position of the same color pixel mounted with a green filter from the signal readout region,
The same color pixels having a predetermined number of green filters from the two signal readout regions above and below the even numbered non-read region in the vertical direction, and the green barycentric position of the same color pixel is within the non-read region And reading out a signal in which the blue color centroid position of the same color pixel is in the same row as the green centroid position of the same color pixel mounted with a blue filter from the signal readout region,
A moving image signal reading method for a solid-state imaging device, which reads out the signal in which the arrangement of the red centroid position, the green centroid position, and the blue centroid position is a Bayer arrangement as a moving image signal.   The moving image signal readout method for a solid-state imaging device according to claim 1, wherein when the signals are read out such that the arrangement of the red centroid position, the green centroid position, and the blue centroid position is a Bayer arrangement. A moving image signal reading method for a solid-state imaging device, wherein the same color pixels having equal intervals are selected from the signal reading region.   3. A moving image signal reading method for a solid-state imaging device according to claim 1 or 2, wherein the solid-state imaging device is a CMOS type.   A CMOS solid-state image pickup device according to claim 3, an image pickup device driving means for reading a signal from each pixel of the CMOS solid-state image pickup device by the moving image signal reading method according to claim 3, and the CMOS solid-state image pickup device An image pickup apparatus comprising: a signal processing unit that adds a signal of the same color pixel using a signal read out from a signal to generate a moving image of a subject.   3. A moving image signal reading method for a solid-state imaging device according to claim 1 or 2, wherein the solid-state imaging device is a CCD type.   6. The moving image signal reading method for a solid-state imaging device according to claim 1, wherein the predetermined number of pixel rows in the non-reading area is an even number.   7. The moving image signal readout method for a solid-state imaging device according to claim 6, wherein the signal is read out to a vertical charge transfer path provided for each pixel column, and two pixels of the same color are mixed and added in the vertical charge transfer path. A moving image signal reading method for a solid-state image sensor.   8. A moving image signal readout method for a solid-state imaging device according to claim 5, wherein a vertical charge transfer path, a horizontal charge transfer path, the vertical charge transfer path, and the horizontal charge transfer path A moving image signal reading method for a solid-state imaging device, wherein the signals are mixed and added with a line memory provided therebetween.   9. A CCD solid-state image pickup device according to claim 5, and an image pickup device for driving the CCD solid-state image pickup device by the moving image signal readout method according to any one of claims 5 to 8. An imaging apparatus comprising: a driving unit; and a signal processing unit that generates a moving image of a subject based on a signal output from the CCD solid-state imaging device.

Images