JP2005117276A - Imaging device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device capable of obtaining a beautiful recorded image while displaying an image of an object in real time for a period of exposure operations for recording. <P>SOLUTION: Two photosensitive parts (upper photosensitive part 111a and lower photosensitive part 111b) are provided to one vertical transfer path 112 by dividing the photosensitive face of a photosensitive part 111 in the divided pixels of an imaging element 11 into two (upper photosensitive part 111a and lower photosensitive part 111b) in order to display the state of an object on an LCD 4 even during main exposure operations in a long-second monitoring mode. Then the pixel signal of the upper photosensitive part 111a of the divided pixels is read for the period of the exposure operations and a live view image is generated by using the pixel signal. Further, when a shutter button 9 is used to indicate the end of the main exposure operations, a recorded image is generated by using the pixel signals of general pixels and the pixel signals outputted from the lower photosensitive part 111b in the divided pixels. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus having a function of displaying an image of a subject during an exposure operation for generating a pixel signal for recording.

  Conventionally, in a digital camera equipped with a display such as a liquid crystal display, there is a technique described in, for example, Japanese Patent Application Laid-Open No. 2004-151867 as a technique that enables a subject being exposed to be confirmed on the display.

In Patent Document 1, the pixel array surface of the image sensor is divided into two fields for every two horizontal lines, and image data obtained from the pixel lines of one field is used for recording, and A technique for using image data obtained from a pixel line for display on a liquid crystal display or the like is disclosed.
JP 2002-135626 A

  However, in the technique disclosed in Patent Document 1, an image signal is read out from approximately half of the number of pixels of the image sensor during exposure. Therefore, when the number of pixels of the image sensor increases, the image signal from the image sensor. It takes time to read out the image, and the display period of the image on the display device becomes longer. In this case, since a pixel signal for recording cannot be obtained from the pixels used for display on the display device, image distortion or the like occurs if image interpolation processing is not performed in this portion, and a beautiful recorded image is obtained. Is difficult to get.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an imaging apparatus capable of displaying a subject image in real time during a recording exposure period and obtaining a beautiful recorded image. To do.

  The invention according to claim 1 includes a plurality of types of pixels that receive different colors, and a plurality of pixel lines formed by arranging each pixel in one direction are arranged in a crossing direction intersecting the one direction, The first pixel line arranged at a predetermined interval in the intersecting direction among the plurality of pixel lines is configured by a pixel including two or more light receiving portions for receiving light of the same color with respect to one transfer portion. An input operation unit for instructing the image sensor to start an exposure operation for generating a recording pixel signal to be recorded in a predetermined recording unit, and when the exposure start instruction is performed by the input operation unit, An imaging control unit that outputs a pixel signal at a predetermined time interval from a part of the light receiving units of each pixel located in the first pixel line, and a pixel that is generated by the pixel signal obtained from the part of the light receiving unit. 1 image generator and front An imaging apparatus characterized by comprising an image display unit for displaying an image generated by the first image generation unit.

  According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, when the exposure start instruction is given by the input operation unit, the light receiving unit other than the part of the light receiving units in the imaging element A second image generation unit that generates an image to be recorded in the predetermined recording unit by using a pixel signal obtained by an exposure operation, and an image generated by the second image generation unit in the predetermined recording unit And a recording control unit for recording.

  According to a third aspect of the present invention, in the imaging device according to the second aspect, a light receiving area of each light receiving portion of a pixel located on the first pixel line is a second pixel other than the first pixel line. When the light receiving area of each light receiving unit of the pixel located on the line is different from the light receiving area, the second image generating unit calculates the pixel value of the pixel signal obtained by each light receiving unit in each pixel located on the first pixel line, as described above. Amplifying with a different amplification factor from the pixel value of the pixel signal obtained by each light receiving portion of the pixel located in the second pixel line.

  According to a fourth aspect of the present invention, in the imaging device according to the third aspect of the present invention, a light receiving unit other than the part of the light receiving units in the pixels located on the first pixel line is a part of the light receiving unit. When having a light receiving area of n times, the second image generating unit uses the pixel signal obtained by the light receiving unit of the pixel located in the second pixel line as the amplification factor of the pixel signal obtained by the other light receiving unit. It is characterized by being set to approximately (1 + 1 / n) times the amplification factor.

  According to a fifth aspect of the present invention, in the imaging apparatus according to the first or second aspect, the imaging element includes an interline in which each pixel includes two light receiving units for receiving light of the same color with respect to one transfer unit. It is a type of image sensor.

  According to the first aspect of the present invention, when an exposure start instruction is given by the input operation unit, the first unit is configured by a pixel including two or more light receiving units that receive light of the same color for one transfer unit. A pixel signal is output at a predetermined time interval from a part of the light receiving units of each pixel of the pixel line, an image is generated by the pixel signal obtained from the part of the light receiving unit, and the image is displayed on the image display unit Thus, the subject image can be reliably displayed in real time on the image display unit while performing an exposure operation for generating a recording pixel signal to be recorded in the predetermined recording unit.

  According to the second aspect of the present invention, when an exposure start instruction is given by the input operation unit, a pixel signal obtained by an exposure operation by a light receiving unit other than the part of the light receiving units in the image sensor is used. Since an image to be recorded in a predetermined recording unit is generated, a beautiful image can be obtained as compared with the conventional case.

  That is, in the conventional case where only one light receiving unit is provided in one pixel and a specific pixel line is used for display on the image display unit, a pixel signal constituting a recorded image is not output from the pixel of this pixel line. Therefore, the image is lost at a portion corresponding to the specific pixel line in the recorded image. On the other hand, according to the present invention, the pixel signal of the other light receiving unit in each pixel of the first pixel line is used as the pixel signal of the pixel of the first pixel line, whereby the first pixel line Thus, a pixel signal constituting a recorded image can be obtained, so that a beautiful image having no missing part can be obtained.

  According to the third aspect of the present invention, when the light receiving area of each light receiving portion of the pixel located on the first pixel line is different from the light receiving area of each light receiving portion of the pixel located on the second pixel line, The pixel value of the pixel signal obtained by each light receiving unit in each pixel located in one pixel line is amplified with a different amplification factor from the pixel value of the pixel signal obtained by each light receiving unit in the pixel located in the second pixel line. Thus, the amplification factor of each pixel signal can be set according to the level difference between these pixel values. In addition, since the amplification factor is changed for each line, the hardware configuration including the image sensor becomes simpler than the configuration in which the amplification factor is changed for each pixel.

  According to the fourth aspect of the present invention, when the other light receiving portion in the pixels of the first pixel line has a light receiving area that is n times that of the partial light receiving portion, the pixel obtained by the other light receiving portion. Since the amplification factor of the signal is set to approximately (1 + 1 / n) times the amplification factor of the pixel signal obtained by the light receiving portion of the pixel located in the second pixel line, When a recorded image is generated using a pixel signal obtained by pixels of two pixel lines, a pixel signal level obtained by the other light receiving unit is obtained by a pixel located on the second pixel line. It is equivalent to the signal level. As a result, it is possible to obtain a beautiful recorded image with no partial pixel value level difference or a small level difference.

  According to the fifth aspect of the present invention, since an interline type image pickup device having two light receiving portions for receiving light of the same color for each pixel with respect to one transfer portion is employed as the image pickup device, the cost is reduced. It is possible to realize a configuration in which an image of a subject is displayed on the image display unit when the start of an exposure operation for generating a recording pixel signal to be recorded in a predetermined recording unit is instructed while being suppressed.

  An embodiment of an imaging apparatus according to the present invention will be described.

  FIG. 1 is a front view of the imaging apparatus 1, and FIG. 2 is a rear view of the imaging apparatus 1.

  As shown in FIGS. 1 and 2, the imaging apparatus 1 includes a power button 2, an optical system 3, an LCD (Liquid Crystal Display) display unit 4, an optical finder 5, a built-in flash 6, and a mode setting switch 7. A quadruple switch 8, a shutter button 9, and a long-second monitoring switch 10.

  The power button 2 is used to switch on / off the power of the imaging apparatus 1.

  The optical system 3 includes a zoom lens, an unillustrated mechanical shutter, and the like, and forms an optical image of a subject on an imaging surface of an imaging element 11 (see FIG. 3) such as a CCD (Charge Coupled Device). is there.

  The LCD 4 displays a live view image and an image (recorded image) recorded on a memory card m (see FIG. 3), which will be described later, and reproduces and displays an image recorded on the memory card m.

  The live view image is an image picked up by the image pickup device 11 that is switched and displayed on the LCD 4 at a constant period (1/30 second) until the image of the subject is recorded. The state is displayed on the LCD 4 in substantially real time, and the photographer can check the state of the subject on the LCD 4.

  The optical viewfinder 5 enables optical observation of a range where a subject is photographed.

  The built-in flash 6 irradiates the subject with illumination light when the amount of exposure to the image sensor 11 is insufficient.

  The mode setting switch 7 is a “shooting mode” for shooting a subject image, a “playback mode” for playing back and displaying a shot image recorded on the memory card m on the LCD 4, and a “menu mode” for setting various functions. "Is a switch for setting the mode switching between the The mode setting switch 7 is composed of a three-contact slide switch that slides up and down. When the switch is set down, the image pickup apparatus 1 is set to the shooting mode. When the switch is set at the center, the playback mode is set. Is done.

  Although not described in detail, the quadruple switch 8 is a switch for performing movement of the zoom lens in the optical axis direction, exposure correction, frame advance of a recorded image to be reproduced on the LCD 4, and the like. Further, the imaging apparatus 1 of the present embodiment includes a program AE mode, an aperture priority AE mode, a shutter speed priority AE mode, a manual mode, and a bulb shooting mode as shooting mode types. These modes can be switched by operating the quadruple switch 8 with the mode set.

  The program AE mode is a mode in which a combination of an aperture value and a shutter speed is automatically set according to a preset AE (Auto Exposure) program. The aperture priority AE mode is an aperture value preset by a photographer. The shutter speed setting AE mode is a mode in which an image is taken by setting an aperture value at a shutter speed preset by the photographer, and the manual mode is a mode in which the photographer takes a picture. In this mode, imaging is performed with an exposure time at a shutter speed and an aperture value set in advance.

  The bulb shooting mode is a mode in which the photographer instructs the shutter button 9 to open and close the mechanical shutter (not shown), and the shutter button 9 is completely pressed down (hereinafter, this operation is fully pressed). The exposure operation for recording is started by the electronic shutter, and the mechanical shutter is closed by releasing the full press of the shutter button 9 and the exposure operation is ended. Therefore, in this bulb photography mode, the subject can be photographed by exposing the imaging device 1 to a relatively long time (for example, 10 seconds).

  The shutter button 9 is a button that is pressed in two stages (half-press and full-press), and is used to indicate the timing of exposure control. In each of the shooting modes, when the shutter button 9 is not operated, an optical image of the subject is captured every 1/30 (second), and a live view image is displayed on the LCD 4. In addition, in the above-described program AE mode, aperture priority AE mode, shutter speed priority AE mode, and manual mode, the imaging apparatus 1 is configured such that the shutter speed 9 By setting to an imaging standby state in which an aperture value and the like are set and being fully pressed, an optical image of a subject to be recorded on the memory card m is determined. The function of the shutter button 9 in the bulb shooting mode is as described above.

  Here, the imaging apparatus 1 of the present embodiment is configured to perform an exposure operation for generating a recording pixel signal when any one of the above-described photographing modes is set and the long-second monitoring mode described later is set. The state of the subject (more precisely, the image recorded in the memory card m) is not only during the period until the start of the main exposure operation (hereinafter referred to as the main exposure operation) is instructed by the shutter button 9, but also during the main exposure operation. Is displayed on the LCD 4 in real time as a live view image.

  In the program AE mode and the aperture priority AE mode, the main exposure operation period (recording pixel signal generation period) corresponds to the shutter speed calculated by the imaging apparatus 1 after the shutter button 9 is fully pressed. In the shutter speed priority AE mode, after the shutter button 9 is fully pressed, this corresponds to the shutter open period corresponding to the shutter speed set in advance by the photographer. This corresponds to a period from when the shutter button 9 is fully pressed until a time preset by the photographer (exposure time) elapses. In the bulb shooting mode, the shutter button 9 is kept fully pressed. Equivalent to.

  The long-second monitoring switch 10 performs the main exposure when the main exposure operation period is significantly longer than a preset live view image display cycle (for example, 1/30 second) when any of the above-described shooting modes is set. This is for setting a mode for displaying a live view image on the LCD 4 even during the operation period (long-second monitoring mode). Each time the button is pressed, setting / non-setting of the long-second monitoring mode is switched alternately. Note that this long-second monitoring mode is particularly effective when the bulb shooting mode is set. Therefore, in the following description, the case where the imaging apparatus 1 is set to the bulb shooting mode will be described. And

  FIG. 3 is a block configuration diagram showing a system of the imaging apparatus 1. In the figure, the same members as those shown in FIGS. 1 and 2 are denoted by the same reference numerals.

  The imaging apparatus 1 includes an optical system 3, an LCD 4, an imaging device 11, a timing generator 12, a signal processing unit 13, an A / D conversion unit 14, an image memory 15, and a VRAM (Video Random Access Memory) 16. The operation unit 17 and the control unit 18 are provided.

  The optical system 3 corresponds to the optical system 3 shown in FIG. 1 and includes a mechanical shutter as described above. The LCD 4 corresponds to the LCD 4 shown in FIG.

  FIG. 4 is a diagram showing a pixel arrangement structure (a) in the image sensor 11, a pixel (b) used for displaying a live view image, and a pixel (c) used for recording on the memory card m. is there.

  The imaging device 11 includes a plurality of photoelectric conversion elements, such as photodiodes, that are two-dimensionally arranged in a matrix. For example, R (red) and G (green) having different spectral characteristics are formed on the light receiving surface of each photoelectric conversion element. ), B (blue) color filter with Bayer arrangement in which color filters of 1: 2: 1 are arranged. Hereinafter, the photoelectric conversion element in which a color filter is provided is referred to as a pixel of the image sensor 11. The imaging device 11 converts the optical image of the subject formed by the optical system 3 into analog electrical signals (image signals) of R (red), G (green), and B (blue) color components. , B are output as image signals of respective colors.

  Although not described in detail, the image pickup device 11 is an interline type image pickup device including a light receiving unit made of a photodiode or the like, a vertical transfer unit, a horizontal transfer unit, and the like. The charge of each pixel is determined by a progressive transfer method. Is taken out. That is, the charges accumulated in each light receiving unit are transferred to the vertical transfer unit by a vertical synchronization signal, and the charges transferred to each vertical transfer unit are sequentially transferred from the pixels close to the horizontal transfer path by the horizontal synchronization signal to the horizontal transfer path. The charge is taken out as a pixel signal. The timing of starting and ending the imaging operation such as reading (horizontal synchronization and vertical synchronization) of the output signal of each pixel in the imaging device 11 and the exposure operation by the imaging device 11 is controlled by a timing generator 12 described later. The

  According to such a progressive transfer method, when the main exposure operation is completed when the long-second monitoring mode is set and when it is not set, pixel signals are extracted from almost all pixels.

  In addition to the above configuration, in the present embodiment, when the long second monitoring mode is set, in order to realize a configuration in which a live view image is displayed on the LCD 4 even during the main exposure operation, the image sensor 11 is arranged in the vertical direction. The light receiving surface of the light receiving unit 111 is divided into two for the pixels located in the above-described specific pixel line (for example, the third, eighth, and thirteenth pixel lines in FIG. 4) among the plurality of arranged pixel lines. Yes. Pixels in which the light receiving surface of the light receiving unit 111 is divided into two are divided pixels, the upper light receiving unit of the divided pixels is the upper light receiving unit 111a, the lower light receiving unit is the lower light receiving unit 111b, and the pixels other than the divided pixels in the image sensor 11 ( In FIG. 4, pixels other than the third, eighth, and thirteenth light receiving portions 111 are divided into two parts). The upper light receiving unit 111a and the lower light receiving unit 111b in each pixel receive light of the same color.

  Then, in the bulb exposure mode with the setting of the long-second monitoring mode, when an instruction to start the main exposure operation (start generation of a recording pixel signal) is issued by starting full-pressing operation of the shutter button 9, the image sensor 11 The exposure operation is performed by substantially all the pixels. Then, pixel signals are extracted from the upper light receiving unit 111a in the divided pixels at predetermined time intervals, and live view images are sequentially generated using the extracted pixel signals. As a result, live view images are displayed on the LCD 4 at regular time intervals. At this time, the lower light receiving unit 111b and the general pixels in the divided pixels continuously perform the exposure operation without extracting the pixel signal. After that, when the shutter button 9 is fully pressed, the end of the main exposure operation is instructed, and when a pixel signal is extracted from the lower light receiving unit 111b and the general pixel in the divided pixels, a recorded image is obtained using the extracted pixel signal. Is generated.

  At that time, as will be described later, the lower light receiving unit 111b in each divided pixel has a light receiving area that is approximately half that of the light receiving unit 111 of each general pixel, so that the exposure amount is about ½ that of the general pixel. It becomes. Therefore, since the pixel value of the pixel signal output from the upper light receiving unit 111a and the lower light receiving unit 111b is approximately half the level of the pixel value of the pixel signal of the general pixel, the live view image is displayed in that state. When generated, the image displayed on the LCD 4 is dark overall, and when the recorded image is generated, the above-described portion having a low pixel value (the portion corresponding to the position of the pixel line of the divided pixels) is present. It appears as an image P with darker stripes than the surroundings (see FIG. 8D).

  Therefore, the amplification factors of the pixel signals output from the upper light receiving unit 111a and the lower light receiving unit 111b in each divided pixel are approximately the same level as the pixel value of the pixel signal of each general pixel. To prevent or suppress the generation of streaks as described above.

  On the other hand, when the long-second monitoring mode is not set, when an instruction to start the main exposure operation (start generation of a recording pixel signal) is issued by starting the full pressing operation of the shutter button 9, almost all of the image sensor 11 is set. An exposure operation using pixels is performed. Then, during the period until the full pressing operation of the shutter button 9 is released, the exposure operation is continuously performed for almost all pixels without extracting the pixel signal. For this reason, nothing is displayed on the LCD 4. Thereafter, when the full-pressing operation of the shutter button 9 is released, the exposure operation is continued and the main exposure operation with almost all the pixels that have accumulated the charge is completed, and pixel signals are extracted from these pixels, and the extracted signals are extracted. A recorded image is generated using the pixel signal. At this time, the pixel signals output from the upper light receiving unit 111a and the lower light receiving unit 111b are added in the vertical transfer path 112 and output as a pixel signal of one pixel.

  Note that, when the long-second monitoring mode is set and not set, the period until the main exposure operation is started by starting the full-pressing operation of the shutter button 9 is as shown in FIG. A live view image is generated using the pixel signals obtained from the units 111a and 111b. At this time, the pixel signals output from both light receiving portions 111a and 111b in each divided pixel are added by the vertical transfer path 112, and then output as a pixel signal of one pixel.

  The specific pixel lines selected to display the live view image on the LCD 4 have different pixel lines alternately positioned so that an appropriate color is reproduced (selected pixels are in a Bayer array). Is selected as follows.

  Further, the imaging device 1 is equipped with the imaging device 11 in which a specific pixel line is selected according to the ratio between the number of pixels of the imaging device 11 and the number of display pixels of the LCD 4. For example, in FIG. 4, when the number of pixels in the vertical direction of the image sensor 11 is 1200 (pieces) and the number of display pixels in the vertical direction of the LCD 4 is 240 (pieces), one pixel line for every five pixel lines. Shows the structure of the image sensor 11 set as a divided pixel line.

  Based on the reference clock CLK0 transmitted from the control unit 18, the timing generator 12 controls the readout of the drive control signal for the image sensor 11, for example, the timing signal for integration start / end (exposure start / end), and the light reception signal of each pixel. A clock signal such as a signal (horizontal synchronization signal, vertical synchronization signal, etc.) is generated and output to the image sensor 11.

  The signal processing unit 13 performs predetermined analog signal processing on the analog pixel signal output from the image sensor 11. The signal processing unit 13 includes a CDS (correlated double sampling) circuit and an AGC (auto gain control) circuit, reduces noise of the pixel signal by the CDS circuit, and adjusts the level of the pixel signal by the AGC circuit.

  In the present embodiment, for example, when one second has elapsed after the start of the main exposure operation, an image obtained when the pixel signal is temporarily read from the lower light receiving portion 111b of the general pixel and the divided pixel is shown in FIG. The image P of a plurality of stripes that are darker than the surroundings, which are indicated by black lines in this figure, are pixels generated by the pixel signal output from the lower light receiving unit 111b. FIG. 8 will be described later.

  When the main exposure operation ends when the long-second monitoring mode is set, the signal processing unit 13 sets the amplification factor of the pixel signal output from the lower light receiving unit 111b of each divided pixel to a level equivalent to the pixel signal of the general pixel. As such, the amplification factor for the general pixel is set to about twice. Thereby, when the recorded image is generated, the level difference between the pixel value of the pixel signal output from the lower light receiving unit 111b of the divided pixel line and the pixel value of the pixel signal of the general pixel is reduced, and the recorded image is displayed. It is possible to prevent the generation of the streak image P as shown in FIG. 5 or make the streak inconspicuous.

  The A / D conversion unit 14 converts the analog R, G, and B pixel signals output from the signal processing unit 13 into digital pixel signals composed of a plurality of bits, respectively.

  The image memory 15 is a memory that temporarily stores the pixel signal output from the A / D conversion unit 14 and is used as a work area for performing processing described later on the image signal by the control unit 18. .

  The VRAM 16 is a buffer memory for pixel signals of an image reproduced and displayed on the LCD 4, and has a pixel signal recording capacity corresponding to the number of pixels of the LCD 4.

  The operation unit 17 includes a switch for detecting a release operation of the shutter button 9, a mode setting switch 7, a quadruple switch 8, a long-second monitoring switch 10, and the like.

  The control unit 18 is composed of, for example, a microcomputer in which a storage unit (including first and second image storage units 29 and 30 described later) including a ROM that stores a control program and a RAM that temporarily stores data is incorporated. The drive of each member mentioned above is related and controlled.

  Here, the significance of displaying the live view image on the LCD 4 even during the main exposure operation when the long second monitoring mode is set, and the light receiving surface of the light receiving unit 111 for the pixels located in the divided pixel line of the image sensor 11 is divided into two. The significance of doing this will be explained.

  When the exposure time is longer than a predetermined value in the long-second monitoring mode (for example, when the shutter button 9 is fully pressed for a relatively long time in the bulb shooting mode), the image sensor 11 that is performed after the start of the full-press operation is performed. When all the pixel signals obtained by the exposure operation are used for recording in the memory card m, there is no pixel signal that can be used for live view image display. The state of the image recorded on the card m cannot be displayed on the LCD 4 as a live view image.

  Further, even when the above-described configuration for displaying the live view image on the LCD 4 is provided during the main exposure operation, the configuration in which an image showing the state of the subject at each time point is displayed as a live view image is as follows. The following problems occur.

  FIG. 6 shows a live view image displayed on the LCD 4 at each time point in the 12-second period for three fireworks continuously launched for 12 seconds after the start of the main exposure operation. In FIG. 6, the state of the subject imaged 1/30 second before that is displayed as a live view image at each time point.

  In such a live view image display method, when the end of the main exposure operation is to be instructed at any timing within the 12 seconds, the fireworks locus is not displayed on the LCD 4 until the instructed timing. The person directly recognizes the state of the fireworks, predicts the timing when the desired state such as the state of the fireworks becomes the most vivid, for example, and determines the subject image to be captured at the prediction timing.

  However, in this case, it is unclear what image was obtained until a series of imaging operations of the imaging device 1 is completed, and the image recorded on the memory card m is significantly different from the desired image. There is.

  In view of the above points, in the present embodiment, the imaging apparatus 1 includes the long-second monitoring mode as described above, and when the long-second monitoring mode is set, a period until the shutter button 9 is fully pressed, That is, in addition to the period until the start of the main exposure operation is instructed, when the exposure time of the main exposure operation is significantly longer than the live view image display cycle (for example, 1/30 second), The state of the image recorded on the memory card m is also displayed on the LCD 4 in real time as a live view image (substantially equivalent to the period during which the pressed state continues).

  And in order to implement | achieve such a structure, as mentioned above, the light-receiving surface of the light-receiving part 111 in the division | segmentation pixel in the image pick-up element 11 is divided into 2 (upper light-receiving part 111a and lower light-receiving part 111b), and one perpendicular | vertical is carried out. Two light receiving parts (upper light receiving part 111a and lower light receiving part 111b) are provided for the transfer path 112, and the pixel signal output from the upper light receiving part 111a of this pixel is set to a constant period (during the period of the main exposure operation). For example, a live view image is sequentially generated using the read pixel signals and displayed on the LCD 4.

  In the present embodiment, since the state of the image recorded on the memory card m is displayed on the LCD 4, as shown in FIG. 7, when the long second monitoring mode is set, the lower light receiving unit 111b and the general pixel in the divided pixels are set. By generating a live view image of this time by adding a live view image (more precisely, an added image described later) generated in the previous cycle and an image obtained in the current cycle in the main exposure operation period of Then, a live view image in which images captured at each time point are superimposed is displayed.

  For example, as shown in FIG. 7, after 12 seconds from the start of the full-pressing operation of the shutter button 9, the image is superimposed as if the three fireworks launched with a time difference during the 12-second period were opened simultaneously. A live view image is generated, and the live view image is displayed on the LCD 4.

  When the exposure time set by calculation or manually in the shooting modes other than the bulb shooting mode has elapsed due to the release of the full-press operation of the shutter button 9 in the bulb shooting mode, A recorded image is generated using pixel signals output from the light receiving unit 111b and the general pixels.

  In order to realize the configuration as described above, as shown in FIG. 3, the control unit 18 functionally includes a first imaging control unit 19, a first recording control unit 20, an addition processing unit 21, and an aspect correction processing unit 22. The second imaging control unit 23, the second recording control unit 24, the recorded image generation unit 25, the image processing unit 26, the display control unit 27, the image compression unit 28, the first image storage unit 29, and the second image storage unit 30. I have.

  When the long-second monitoring mode is set, the first imaging control unit 19 extracts the pixel signal from the upper light receiving unit 111a of the divided pixel at a predetermined period (for example, 1/30 second) during the main exposure operation, The clock signal output from the timing generator 12 to the image sensor 11 is controlled so that an exposure operation is performed without taking out a pixel signal from the lower light receiving portion 111b and the general pixel of the pixel.

  FIG. 8 shows three fireworks fired continuously for 12 seconds from the start of the full-pressing operation of the shutter button 9 in the bulb shooting mode when the long-second monitoring mode is set, and 1 second from the start timing. For example, an image (a) obtained from the upper light receiving portion 111a of the divided pixel at each time point, and an added image (b) described later, taking as an example the time point after 4 seconds, the time point after 8 seconds, and the time point after 12 seconds. ), An aspect-corrected image (c), an image (d) generated by pixel signals obtained from the lower light receiving portion 111b and the general pixel of the divided pixels, and a recorded image (e) to be recorded on the memory card m. It is a thing.

  In the present embodiment, it is assumed that the pixel signal is read from the lower light receiving portion 111b and the general pixel of the divided pixel when, for example, 1 second has elapsed after the start of the main exposure operation by starting the full pressing operation of the shutter button 9. The image obtained in this case is an image as shown in FIG. 8 (d-1), and the image generated by the pixel signal of the upper light receiving portion 111a of the divided pixel is indicated by the black line in FIG. 8 (d-1). It corresponds to a plurality of line-shaped images P.

  In the period until the start of the main exposure operation is instructed, the first imaging control unit 19 extracts pixel signals from the upper light receiving unit 111a and the lower light receiving unit 111b of the divided pixels and uses the pixel signals to perform live view images. Is generated. When the long-second monitoring mode is not set, the pixel signal is taken out from the upper light receiving unit 111a and the lower light receiving unit 111b of the divided pixel until the start of the main exposure operation is instructed, and a live view image is obtained from the pixel signal. When the generation and the start of the main exposure operation are instructed, almost the entire pixel is made to perform the main exposure operation without taking out the pixel signal.

  The first recording control unit 20 is output from the upper light receiving unit 111a of the divided pixels through the A / D conversion unit 14 and the like during the period from the start to the end of the main exposure operation when the long second monitoring mode is set. A pixel signal (pixel signal corresponding to the line-shaped image P shown in FIG. 8D) is temporarily recorded in the first image storage unit 29. As shown in FIG. 8A, the first recording control unit 20 generates an image in which the plurality of line-shaped images P described above are adjacent in the vertical direction, and records this image in the first image storage unit 29. To do.

  The addition processing unit 21 sets the long-second monitoring mode every time an image is recorded in the first image storage unit 29 by the first recording control unit 20 after the second period after the start of the main exposure operation. An added image obtained by adding these images is generated, and the added image is recorded in the first image storage unit 29. Note that during the period until the main exposure operation is started when the long-second monitoring mode is set and when it is not set, the addition processing by the addition processing unit 21 is not performed, and the images captured at each time point are switched and displayed. Is done.

  As shown in FIG. 8, at the time when, for example, 1 second has elapsed after the start of the main exposure operation, the addition processing unit 21 displays an image (a-1) composed of pixel signals of the upper light receiving unit 111a of the divided pixels at that time. Then, an added image (b-1) is generated by adding the added image generated one cycle (for example, 1/30 second) before that time. Similarly, after the start of the main exposure operation, for example, when 4 seconds have elapsed, when 8 seconds have elapsed, and when 12 seconds have elapsed, the addition processing unit 21 is output from the upper light receiving unit 111a of the divided pixels at each time point. Image (a-2), (a-3), (a-4) composed of pixel signals and an added image obtained by adding an added image generated one cycle (for example, 1/30 second) before that time (B-2), (b-3), and (b-4) are generated.

  As described above, when an image composed of pixel signals obtained in the current cycle is expressed as Pn (n = 1, 2,..., K−1, k), the exposure operation by the upper light receiving unit 111a of the divided pixels and The added image Gn when the readout of the pixel signal obtained by this exposure operation is repeated n times is Gn = P1 + P2 +... + Pn.

  When the addition image generated by the addition processing unit 21 is displayed on the LCD 4, as shown in FIG. 8C, the aspect correction processing unit 22 corrects the addition image to the aspect of the LCD 4, and the aspect correction image Are recorded in the second image storage unit 30. As a result, when the long-second monitoring mode is set, a live view image (moving object trajectory) in which the subject image at each time point is superimposed during the main exposure operation period (period in which the shutter button 9 is fully pressed) is performed. Can be displayed on the LCD 4.

  When the end of the main exposure operation is instructed by releasing the full-pressing operation of the shutter button 9, the second imaging control unit 23 sets the pixels from the lower light receiving unit 111b and the general pixels of the divided pixels when the long second monitoring mode is set. The clock signal output from the timing generator 12 to the image sensor 11 is controlled so as to output a signal, and when the long-second monitoring mode is not set, substantially all pixels including the upper light receiving unit 111a and the lower light receiving unit 111b of the divided pixels. The clock signal output from the timing generator 12 to the image sensor 11 is controlled so as to output the pixel signal from.

  The second recording control unit 24 temporarily records the pixel signal obtained through the A / D conversion unit 14 and the like under the control of the second imaging control unit 23 in the second image storage unit 30.

  The recorded image generation unit 25 generates a recorded image to be recorded on the memory card m using the pixel signal recorded in the second image storage unit 30 by the second recording control unit 24. That is, when the long-second monitoring mode is set, the recorded image generation unit 25 performs the main exposure operation when 12 seconds have elapsed from the start of the main exposure operation, for example, as shown in FIGS. 8 (d-4) and (e). As a result, the recorded image generation unit 25 uses the pixel signal obtained from the lower light receiving unit 111b and the general pixel of the divided pixels to the A / D conversion unit 14 and the like at this time to generate a recorded image. Generate.

  The recorded image generation unit 25 generates a recorded image using substantially all pixel signals recorded in the second image storage unit 30 when the long second monitoring mode is not set.

  The image processing unit 26 performs black level correction for correcting the black level to a reference black level for the aspect corrected image output from the aspect correction processing unit 22 or the recording image output from the recording image generation unit 25, and the light source. Based on the corresponding white standard, white balance adjustment, R (red), G (green), B (blue), digital signal level conversion of each color component, R (red), G (green), B Γ correction is performed to correct the γ characteristic of the digital signal of each color of (blue).

  The display control unit 27 transfers pixel data of the image to the VRAM 16 so that the image output from the image processing unit 26 is displayed on the LCD 4. As a result, when the long second monitoring mode is not set, the main exposure operation is started in the period until the main exposure operation is started. When the long second monitoring mode is set, the main exposure operation is performed in addition to the period until the main exposure operation is started. Even during the period, the state of the subject (the state of the image recorded in the memory card m in the long second monitoring mode) can be displayed in real time as a live view image by the LCD 4.

  The image compression unit 28 uses the JPEG (Joint Picture Experts Group) method such as two-dimensional DCT (Discrete Cosine Transform) conversion and Huffman coding on the pixel data of the recorded image subjected to the above-described various processes by the image processing unit 26. Compressed image data is generated by performing a predetermined compression process, and an image file obtained by adding information (information such as a compression rate) relating to a captured image to the compressed image data is recorded in the memory card m.

  In the memory card m, image data is recorded in time series, and for each frame, the compressed image compressed by the JPEG method includes index information (frame number, exposure value, shutter speed, compression) about the captured image. Information such as rate, shooting date, flash on / off data at the time of shooting, and scene information).

  Next, imaging processing at the time of setting the long-second monitoring mode, which is a characteristic part of the imaging apparatus 1 of the present embodiment, will be described using a time chart shown in FIG.

  As shown in FIG. 9, when the long second monitoring mode is set, a live view image is generated by the pixel signal of the upper light receiving unit 111a of the divided pixels until the shutter button 9 is fully pressed at time T = T1. Then, the display control unit 27 displays the live view image on the LCD 4. Here, since it is assumed that the imaging device 1 is set to the bulb photography mode, the mechanical shutter is kept open until the full pressing operation of the shutter button 9 is released, and the upper part of the divided pixels is The light receiving unit 111a, the lower light receiving unit 111b, and the general pixels continuously perform the exposure operation until the release point.

  When the fully-pressing operation of the shutter button 9 is started at time T = T1, the first imaging control unit 19 starts from the time T = T2, which is delayed for a predetermined time from the full-pressing start timing, and the upper light receiving unit of the divided pixels. While the pixel signal is output to 111a at a period of 1/10 second, the exposure operation is continuously performed without outputting the pixel signal from the lower light receiving unit 111b and the general pixel of the divided pixels.

  Then, after clearing the storage area of the first image storage unit 29, the first recording control unit 20 reads the pixel signal read from the upper light receiving unit 111a of the divided pixels at a period of 1/10 second. 29. If the acquired pixel signal is obtained in the first cycle after the start of full-pressing of the shutter button 9, the addition processing by the addition processing unit 21 is not performed, and the aspect correction processing unit 22 and the image are processed. The processing unit 26 performs various processes such as an aspect correction process. On the other hand, when the read pixel signal is obtained in the second and subsequent cycles, the addition processing unit 21 is output from the upper light receiving unit 111a of the divided pixels at each time point, and the first image storage unit 29. After performing the addition process of adding the image recorded in the image and the addition image generated one cycle before that point, the aspect correction processing unit 22 and the image processing unit 26 perform various processes such as the aspect correction process. Apply.

  When the processing such as the aspect correction processing is completed, the display control unit 27 displays the image after this processing on the LCD 4, and the above-described processing is repeatedly performed until the full pressing operation of the shutter button 9 is released. As a result, a live view image on which images captured at each time point are superimposed is displayed on the LCD 4.

  In FIG. 9, since the display cycle of the live view image is 1/30 second, until the pixel signal obtained in the next cycle is obtained (1/10 second), the upper light receiving unit 111a of the divided pixel is used. It shows that an image composed of pixel signals in each cycle is displayed on the LCD 4 three times each. For example, after the start of the main exposure operation, the pixel signal “output 1” obtained from the upper light receiving portion 111a of the divided pixel in the first cycle, that is, the period of “accumulation 1”, is “LCD 1” three times as “image 1”. Is displayed. In addition, the pixel signal “output 2” obtained from the upper light receiving portion 111a of the divided pixel in the second cycle, that is, the period of “accumulation 2” is the “image 2” constituted by this pixel signal and the above-mentioned “ “Image 1” is added, and this added image “Image 1 + 2” is displayed on the LCD 4 three times. In FIG. 9, the pixel signal read operation (charge transfer to the vertical transfer path, etc.) of the upper light receiving unit 111a for live view image display during the main exposure operation is periodically performed 50 times. It shows that.

  When the full-press operation of the shutter button 9 is released at time T = T3, the mechanical shutter is closed, and after the start of the full-press operation of the shutter button 9 at time T = T4 delayed by a predetermined time from the release timing, The exposure operation by the lower light receiving unit 111b and the general pixel of the divided pixel that has been continuously performed is finished, and the second imaging control unit 23 performs the “accumulation α” from time T = T2 to time T = T4. The pixel signal “output α” generated by the exposure operation by the lower pixel light receiving unit 111b and the general pixel continuously performed without reading out the pixel signal for the period, the lower light receiving unit 111b and the general pixel of the divided pixel. The second recording control unit 20 stores the pixel signal “output α” in the second image storage unit 30.

  Thereafter, the image processing unit 26 performs processing such as black level correction on the pixel signal “output α” stored in the second image storage unit 30, and then the image compression unit 28 performs compression processing to perform this compression. The later image is recorded on the memory card m. The display control unit 27 displays an image obtained by performing various processes such as an aspect correction process on the added image “1+... +49” generated immediately before the full press operation of the shutter button 9 is released for a predetermined time. To display.

  As described above, in the present embodiment, the image pickup device 11 in which the light receiving surface of the light receiving unit 111 of a pixel located in a specific pixel line is divided into two is mounted on the image pickup apparatus 1 and the shutter is set when the long second monitoring mode is set. A live view image is generated using the pixel signal output from the upper light receiving unit 111a in the divided pixel and the lower light receiving unit in the divided pixel for a period until the main exposure operation is ended by releasing the full pressing operation of the button 4. Since the main exposure operation is performed by the 111b and the general pixels, it is possible to reliably display the live view image on the LCD 4 in real time while performing the main exposure operation.

  Further, in the conventional case where only one light receiving unit 111 is provided for one pixel and a specific pixel line is used for an image displayed on the LCD 4, when the recording of the subject image is instructed, the specific pixel line is used. Since a pixel signal for generating a recorded image cannot be obtained from the pixels of the pixel line, an image is lost at a portion corresponding to this specific pixel line in the recorded image. On the other hand, in the present embodiment, since the lower light receiving unit 111b in the divided pixels is used for generating a recorded image, a pixel signal for generating a recorded image is obtained from the pixel line of the divided pixels. Compared with this, it is possible to obtain a beautiful image having no missing part.

  In addition, since the amplification factor of the pixel signal output from the upper light receiving unit 111a and the lower light receiving unit 111b in the divided pixels is set to twice that of the general pixel, the pixel signal output from the upper light receiving unit 111a and the lower light receiving unit 111b The pixel value becomes substantially the same level as the pixel value of the pixel signal of the general pixel, thereby preventing occurrence of a streak that differs in color and brightness from the surrounding portion at a position corresponding to the divided pixel in the recorded image or Can be suppressed.

  Furthermore, since the image pickup device 11 employs a pixel line of divided pixels set so that the pixel arrangement of the live view image is a Bayer arrangement, it is possible to obtain a beautiful live view image reproducing an appropriate color. it can.

  The present invention is not limited to the above embodiment, and other embodiments (1) to (9) can also be employed.

  (1) In the above-described embodiment, the image sensor 11 configured with the third, eighth, and thirteenth pixel lines as pixel lines of the divided pixels is mounted. However, the present invention is not limited to this. For example, when the number of pixels in the vertical direction is 2880 (pieces) and the number of display pixels in the vertical direction of the LCD 4 is 240 (pieces), one pixel line is set as a divided pixel line for every 12 pixel lines. As described above, an image sensor configured by setting pixel lines set in accordance with a ratio between the number of pixels of the image sensor 11 and the number of display pixels of the LCD 4 as pixel lines of divided pixels may be mounted.

  (2) In the above-described embodiment, the imaging device 11 including the pixels obtained by dividing the light receiving unit 111 into two parts is used only in a specific pixel line. However, the imaging device 11 is not limited thereto, and imaging is performed as illustrated in FIG. Almost all the pixels of the element 11 may use a general interline type imaging device having two light receiving parts (upper light receiving part 111a ′ and lower light receiving part 111b ′) for one transfer path. .

  In the imaging apparatus 1 equipped with such an imaging element 11, as shown in FIG. 10A, when the long-second monitoring mode is set, the period of the main exposure operation is a specific pixel line (FIG. 10A). In FIG. 5, the pixel signal from the upper light receiving portion 111a ′ of the pixels of the third, eighth, and thirteenth pixel lines is read, and a live view image is generated based on the read pixel signals.

  When the end of the main exposure operation is instructed by the shutter button 9, as shown in FIG. 10C, the lower light receiving unit 111 b of the pixel in the specific pixel line and other than the specific pixel line Pixel signals are read out from the upper light receiving unit 111a ′ and the lower light receiving unit 111b ′ of the pixel in the pixel line. At this time, for the pixels located in the other pixel lines, the pixel signals read from the upper light receiving unit 111a ′ and the lower light receiving unit 111b ′ are added through the vertical transfer path, and the pixel signals after the addition are sequentially horizontal. It is transferred to the transfer path. Then, a recorded image is generated from these pixel signals.

  In this case, unlike the above-described embodiment, it is not necessary to form a special image sensor in which the light receiving unit is divided into two only for pixels located in a specific pixel line, and an interline type image sensor that is generally used By using this, it is possible to realize display of a live view image and generation of a beautiful recorded image during the main exposure operation when the long-second monitoring mode is set.

  Note that pixel signals obtained from the upper light receiving unit 111a and the lower light receiving unit 111b in the specific pixel line are used for the period until the main exposure operation is started when the long-second monitoring mode is set or not set. A live view image is generated. Also in this case, the pixel signals output from both the light receiving units 111a and 111b in each divided pixel are added by the vertical transfer path 112, and then output as the pixel signal of the divided pixel, whereby the amplification processing as described above is performed. Can be omitted.

  (3) In the above embodiment, since the light receiving unit 111 is divided into two, the pixel signal obtained from each of the light receiving units 111a and 111b of the divided pixels is set to twice the amplification factor with respect to the general pixel. , 111b has a light receiving area of, for example, 1/3 of a general pixel, the pixel signal obtained from the light receiving portions 111a, 111b of the divided pixels may be set to three times the amplification factor for the general pixel. Generally, when the light receiving areas of the light receiving portions 111a and 111b of the divided pixels are n times that of the general pixels, the pixel signal obtained from the light receiving portions 111a and 111b is set to 1 / n times the amplification factor for the general pixels. Good.

  (4) In the above embodiment, the case where the imaging apparatus 1 is set to the long-time monitoring mode when the bulb shooting mode is set has been described. However, when the other shooting modes including the manual mode are set. Even when the long-second monitoring mode is set, during the main exposure operation, the pixel signal is read from the upper light receiving unit 111a of the divided pixel and a live view image is displayed. A recorded image may be generated by obtaining a pixel signal from the light receiving unit 111b and the general pixel.

  (5) In the above embodiment, the LCD 4 is provided to display the subject image, and the live view image or the like is displayed on the LCD 4. However, the present invention is not limited to this, and an electronic viewfinder is provided instead of the optical viewfinder 5. In such a case, the live view image may be displayed on the electronic viewfinder.

  (6) In the above embodiment, the progressive transfer type image sensor is adopted from the viewpoint of easy generation of the drive control signal for driving the image sensor, but the image pickup apparatus adopts the interlace transfer type image sensor. The present invention can also be applied.

  (7) In the above-described embodiment, the memory card m is used as a means for recording an image. However, the present invention is not limited to this, and the imaging apparatus 1 may be a device having a storage capacity such as a computer, a communication cable, or a communication network. If it is configured to be communicable via a computer, an image may be recorded on a device such as the computer.

  (8) The present invention can also be applied to a so-called honeycomb CCD in which octagonal pixels are arranged in a checkered pattern as shown in FIG.

  That is, as shown in FIG. 11, an adjacent RGB pixel column is regarded as one pixel line (for example, R1, R2), and an image sensor in which pixels in a specific pixel line are divided is the same as in the above embodiment. The image pickup apparatus 1 may be mounted, or an R, B pixel column is regarded as one pixel line and a G pixel column is regarded as one pixel line, and the pixels in a specific pixel line are divided. An element may be mounted on the imaging apparatus 1. In the latter case, in order to obtain a beautiful live view image with less image distortion and false color, the arrangement of pixel signals taken out for LV display is perpendicular to the R and B pixel lines and the G pixel line. It is preferable to extract pixel signals alternately (in the vertical direction in FIG. 11).

  (9) In the above embodiment, as the image sensor 11, an image sensor in which primary color filters (R (red), G (green), and B (blue) color filters) are disposed on the light receiving surface of each photoelectric conversion element. However, the present invention is not limited to this, and an image pickup device provided with complementary color filters (C (cyan), M (magenta), Y (yellow)) may be used.

  The imaging device 1 described above mainly includes the inventions shown in the following supplementary notes 1 to 8.

[Supplementary Note 1] A plurality of types of pixels each receiving light of different colors, and a plurality of pixel lines in which pixels are arranged in one direction are arranged in a crossing direction intersecting the one direction, and the plurality of pixel lines An image sensor comprising a pixel having two or more light receiving parts for receiving light of the same color for one transfer part, wherein the first pixel lines arranged at predetermined intervals in the intersecting direction, and predetermined recording An input operation unit for instructing the image sensor to start an exposure operation for generating a recording pixel signal to be recorded in the unit, and when the exposure start instruction is given by the input operation unit, the first pixel An imaging control unit that outputs pixel signals at predetermined time intervals from a part of the light receiving units of each pixel located on the line; and a first image generation unit that generates an image based on the pixel signals obtained from the part of the light receiving units; The first image generation An image display apparatus comprising: an image display unit that displays an image generated by the unit.

  [Supplementary Note 2] When the exposure start instruction is given by the input operation unit, the predetermined recording is performed using a pixel signal obtained by an exposure operation by a light receiving unit other than the part of the light receiving units in the image sensor. And a recording control unit configured to record an image generated by the second image generation unit in the predetermined recording unit. The imaging apparatus according to 1.

  [Appendix 3] When the light receiving area of each light receiving portion of the pixel located on the first pixel line is different from the light receiving area of each light receiving portion of the pixel located on the second pixel line other than the first pixel line The second image generation unit obtains the pixel value of the pixel signal obtained by each light receiving unit in each pixel located in the first pixel line by each light receiving unit of the pixel located in the second pixel line. The imaging apparatus according to claim 2, wherein amplification is performed at an amplification factor different from a pixel value of a pixel signal to be obtained.

  [Supplementary Note 4] When a light receiving unit other than the part of the light receiving units in the pixel located in the first pixel line has a light receiving area that is n times that of the part of the light receiving units, the second image generation unit. Set the amplification factor of the pixel signal obtained by the other light receiving unit to approximately (1 + 1 / n) times the amplification factor of the pixel signal obtained by the light receiving unit of the pixel located in the second pixel line. The imaging apparatus according to claim 3.

  [Supplementary Note 5] The image pickup device according to claim 1 or 2, wherein the image pickup device is an interline type image pickup device in which each pixel receives two light receiving portions that receive light of the same color with respect to one transfer portion. The imaging device described.

  [Appendix 6] When the exposure start instruction is given by the input operation unit, the first image generation unit receives light from a light receiving unit of a part of each pixel located on the first pixel line at each predetermined time. The imaging apparatus according to any one of appendices 1 to 5, wherein an addition image obtained by sequentially adding the obtained pixel signals is generated, and the image display unit displays the addition image.

  According to the present invention, when an exposure start instruction is given by the input operation unit, an addition image formed by sequentially adding pixel signals obtained from the partial pixel lines every predetermined time is generated. Since it is displayed on the image display unit, when an exposure start instruction is given by the input operation unit, an image obtained from the pixel signal output from the image sensor at a predetermined time interval is superimposed and displayed on the image display unit. The Thereby, the photographer can confirm the change in the state of the subject by visually recognizing the image displayed on the image display unit.

  [Supplementary Note 7] The input operation unit further has a function of instructing an exposure time of an exposure operation by the imaging device for obtaining an image to be recorded in the predetermined recording unit, and the image generation unit includes: The imaging apparatus according to any one of appendices 1 to 6, wherein the image is generated when an exposure time instructed by the input operation unit is longer than the predetermined time.

  According to the present invention, since the image is generated when the exposure time instructed by the input operation unit is longer than the predetermined time, the exposure by the image sensor for obtaining the image to be recorded in the predetermined recording unit During the period, the image of the subject can be displayed on the image display unit at predetermined time intervals.

  [Supplementary Note 8] The supplementary notes 1 to 7 are characterized in that the imaging element is configured by dissimilar pixel lines alternately arranged every predetermined number of pixel lines in the intersecting direction as the first pixel line. The imaging device according to any one of the above. According to the present invention, since the imaging device is configured by dissimilar pixel lines alternately arranged every predetermined number of pixel lines in the intersecting direction as the first pixel line, image distortion and false color It is possible to display a relatively beautiful image with a small amount on the image display unit.

It is a front view of the imaging device concerning the present invention. It is a rear view of the imaging device concerning the present invention. It is a block block diagram which shows the system of an imaging device. (A) is a pixel arrangement structure in the image sensor, (b) is a pixel used for displaying a live view image during the main exposure operation when the long-second monitoring mode is set, and (c) is a memory card. It is a figure which shows the pixel used for recording. (A) is a pixel arrangement structure in the image sensor, (b) is a pixel used for live view image display when long-second monitoring is not set, and (c) is for recording on a memory card. It is a figure which shows the pixel used. It is a figure which shows an example of the conventional live view image. It is a figure which shows an example of the live view image displayed in the imaging device which concerns on this invention. 3 seconds of fireworks fired continuously for 12 seconds after the shutter button full-press operation was started when the long second monitoring mode was set, when 1 second passed, 4 seconds passed, 8 seconds passed As an example, the time point of 12 seconds and the time point when 12 seconds have elapsed, at each time point, an image obtained by the exposure operation of the upper light receiving unit in the divided pixels, an added image and an aspect correction image, which will be described later, and the lower light receiving unit and the general pixels in the divided pixels FIG. 6 is a diagram illustrating an image obtained from pixel signals output from and a recorded image to be recorded on a memory card. It is a time chart which shows the imaging process in the long second monitoring imaging | photography mode of the imaging device which concerns on this invention. It is a figure which shows the modification of an image pick-up element. It is a figure which similarly shows the modification of an image pick-up element.

Explanation of symbols

1 Imaging device 4 LCD
9 Shutter button 10 Long-second monitoring switch 11 Image sensor 12 Timing generator 18 Control unit 19 First imaging control unit 20 First recording control unit 21 Addition processing unit 22 Aspect correction processing unit 23 Second imaging control unit 24 Second recording control unit 25 Recorded Image Generation Unit 26 Image Processing Unit 27 Display Control Unit 28 Image Compression Unit 29 First Image Storage Unit 30 Second Image Storage Unit

Claims (5)

A plurality of types of pixels each receiving a different color are provided, and a plurality of pixel lines formed by arranging the pixels in one direction are arranged in a crossing direction intersecting the one direction, and the intersection among the plurality of pixel lines An image sensor comprising a first pixel line arranged in a direction at a predetermined interval, the pixel including two or more light receiving units for receiving light of the same color with respect to one transfer unit;
An input operation unit for instructing the image sensor to start an exposure operation for generating a recording pixel signal to be recorded in a predetermined recording unit;
An imaging control unit for outputting a pixel signal at a predetermined time interval from a light receiving unit of a part of each pixel located in the first pixel line when the exposure start instruction is performed by the input operation unit;
A first image generation unit that generates an image based on pixel signals obtained from the partial light receiving units;
An imaging apparatus comprising: an image display unit that displays an image generated by the first image generation unit.   When the exposure start instruction is given by the input operation unit, recording is performed on the predetermined recording unit using a pixel signal obtained by an exposure operation by a light receiving unit other than the part of the light receiving units in the image sensor. 2. The apparatus according to claim 1, further comprising: a second image generation unit that generates an image for recording; and a recording control unit that records the image generated by the second image generation unit in the predetermined recording unit. Imaging device.   When the light receiving area of each light receiving portion of a pixel located on the first pixel line is different from the light receiving area of each light receiving portion of a pixel located on a second pixel line other than the first pixel line, the second The image generation unit calculates a pixel value of a pixel signal obtained by each light receiving unit in each pixel located on the first pixel line, and calculates a pixel value obtained by each light receiving unit of the pixel located on the second pixel line. The imaging apparatus according to claim 2, wherein amplification is performed at an amplification factor different from the pixel value.   When the other light receiving parts other than the part of the light receiving parts in the pixels located in the first pixel line have a light receiving area that is n times that of the part of the light receiving parts, the second image generation unit The amplification factor of the pixel signal obtained by the light receiving unit is set to approximately (1 + 1 / n) times the amplification factor of the pixel signal obtained by the light receiving unit of the pixel located in the second pixel line. The imaging device according to claim 3.   The image pickup device according to claim 1, wherein the image pickup device is an interline type image pickup device in which each pixel receives two light receiving portions that receive light of the same color with respect to one transfer portion. .

Images