[go: up one dir, main page]

WO2018124057A1 - Dispositif d'imagerie et son procédé de commande - Google Patents

Dispositif d'imagerie et son procédé de commande Download PDF

Info

Publication number
WO2018124057A1
WO2018124057A1 PCT/JP2017/046601 JP2017046601W WO2018124057A1 WO 2018124057 A1 WO2018124057 A1 WO 2018124057A1 JP 2017046601 W JP2017046601 W JP 2017046601W WO 2018124057 A1 WO2018124057 A1 WO 2018124057A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
images
imaging apparatus
exposure
imaging device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2017/046601
Other languages
English (en)
Japanese (ja)
Inventor
直人 末廣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Publication of WO2018124057A1 publication Critical patent/WO2018124057A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/618—Noise processing, e.g. detecting, correcting, reducing or removing noise for random or high-frequency noise

Definitions

  • the present disclosure relates to an imaging apparatus and a control method thereof.
  • Patent Document 1 A technique described in Patent Document 1 is known as an image sensor using an organic photoelectric conversion element.
  • the imaging apparatus processing for reducing random noise is performed. Specifically, the imaging device captures a plurality of images continuously and calculates an average of the obtained plurality of images to obtain a corrected image.
  • this method has a problem that the image quality of a moving image is deteriorated because shooting times of a plurality of images are strictly different.
  • an object of the present disclosure is to provide an imaging apparatus or a control method thereof that can suppress a decrease in image quality.
  • An imaging apparatus uses a non-destructive readout image sensor and a non-destructive readout to obtain a corrected image using a plurality of images obtained by the imaging device by one exposure.
  • a correction unit to be generated.
  • the present disclosure can provide an imaging apparatus or a control method thereof that can suppress a decrease in image quality.
  • FIG. 1 is a block diagram of an imaging apparatus according to an embodiment.
  • FIG. 2A is a diagram illustrating an appearance example of the imaging apparatus according to the embodiment.
  • FIG. 2B is a diagram illustrating an appearance example of the imaging apparatus according to the embodiment.
  • FIG. 3 is a diagram illustrating a configuration of the image sensor according to the embodiment.
  • FIG. 4 is a circuit diagram illustrating a configuration of a pixel according to the embodiment.
  • FIG. 5 is a flowchart illustrating the operation of the imaging apparatus according to the embodiment.
  • FIG. 6 is a diagram illustrating the operation of the imaging apparatus according to the embodiment.
  • FIG. 7 is a diagram illustrating a modified example of the operation of the imaging apparatus according to the embodiment.
  • FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 100 according to the present embodiment.
  • 2A and 2B are diagrams illustrating an example of the appearance of the imaging apparatus 100.
  • the imaging apparatus 100 is a camera such as a digital still camera or a digital video camera.
  • the imaging device 101 is a solid-state imaging device (solid-state imaging device) that converts incident light into an electrical signal (image) and outputs the obtained electrical signal.
  • the imaging device 101 is an organic sensor using an organic photoelectric conversion device.
  • the control unit 102 controls the image sensor 101.
  • the control unit 102 performs various signal processing on the image obtained by the imaging element 101, and displays the obtained image on the display unit 103 or stores it in the storage unit 104.
  • the image output from the control unit 102 may be output to the outside of the imaging apparatus 100 via an input / output interface (not shown).
  • control unit 102 includes a correction unit 105 that corrects an image obtained by the image sensor 101.
  • FIG. 3 is a block diagram illustrating a configuration of the image sensor 101.
  • 3 includes a plurality of pixels (unit pixel cells) 201 arranged in a matrix, a vertical scanning unit 202, a column signal processing unit 203, a horizontal readout unit 204, and a row.
  • Each of the plurality of pixels 201 outputs a signal corresponding to the incident light to the vertical signal line 207 provided in the corresponding column.
  • the vertical scanning unit 202 resets the plurality of pixels 201 via the plurality of reset control lines 205.
  • the vertical scanning unit 202 sequentially selects the plurality of pixels 201 in units of rows via the plurality of address control lines 206.
  • the column signal processing unit 203 performs signal processing on the signals output to the plurality of vertical signal lines 207, and outputs the plurality of signals obtained by the signal processing to the horizontal reading unit 204.
  • the column signal processing unit 203 performs noise suppression signal processing represented by correlated double sampling, analog / digital conversion processing, and the like.
  • the horizontal readout unit 204 sequentially outputs a plurality of signals after the signal processing by the plurality of column signal processing units 203 to the horizontal output terminal 208.
  • FIG. 4 is a circuit diagram illustrating a configuration of the pixel 201.
  • the pixel 201 includes a photoelectric conversion unit 211, a charge storage unit 212, a reset transistor 213, an amplification transistor 214 (source follower transistor), and a selection transistor 215.
  • the photoelectric conversion unit 211 generates signal charges by photoelectrically converting incident light. A voltage Voe is applied to one end of the photoelectric conversion unit 211.
  • the photoelectric conversion unit 211 includes a photoelectric conversion layer made of an organic material.
  • the photoelectric conversion layer may include a layer made of an organic material and a layer made of an inorganic material.
  • the charge storage unit 212 is connected to the photoelectric conversion unit 211 and stores the signal charge generated by the photoelectric conversion unit 211. Note that the charge storage unit 212 may be configured with a parasitic capacitance such as a wiring capacitance instead of a dedicated capacitance element.
  • the reset transistor 213 is used to reset the potential of the signal charge.
  • the gate of the reset transistor 213 is connected to the reset control line 205, the source is connected to the charge storage unit 212, and the reset voltage Vreset is applied to the drain.
  • drain and source generally depend on circuit operation, and are often not specified from the element structure.
  • one of the source and the drain is referred to as a source and the other of the source and the drain is referred to as a drain.
  • the drain may be replaced with the source and the source may be replaced with the drain.
  • the amplification transistor 214 amplifies the voltage of the charge storage unit 212 and outputs a signal corresponding to the voltage to the vertical signal line 207.
  • the gate of the amplification transistor 214 is connected to the charge storage unit 212, and the power supply voltage Vdd or the ground voltage Vss is applied to the drain.
  • the selection transistor 215 is connected in series with the amplification transistor 214, and switches whether to output the signal amplified by the amplification transistor 214 to the vertical signal line 207.
  • the selection transistor 215 has a gate connected to the address control line 206, a drain connected to the source of the amplification transistor 214, and a source connected to the vertical signal line 207.
  • the voltage Voe, the reset voltage Vreset, and the power supply voltage Vdd are voltages commonly used in all the pixels 201.
  • Non-destructive reading is a process of reading image data during an exposure period and continuing exposure.
  • conventional readout hereinafter referred to as destructive readout
  • nondestructive reading it is possible to read the image data exposed up to that time during the exposure period and continue the exposure. Thereby, a plurality of images having different exposure times can be obtained by one exposure.
  • the electronic ND control is a process for electrically controlling the transmittance of the image sensor.
  • the transmittance means the proportion of light that is converted into an electrical signal in the incident light. That is, by setting the transmittance to 0%, it is possible to electrically shield the light.
  • the transmittance is controlled by controlling the voltage Voe shown in FIG. Thereby, exposure can be electrically terminated without using a mechanical shutter.
  • the image sensor 101 includes a mechanical shutter and may use both electronic ND control and light shielding by the mechanical shutter, or may use light shielding by the mechanical shutter without using the electronic ND control.
  • the image sensor 101 is an organic sensor.
  • the image sensor 101 only needs to realize nondestructive reading or electronic ND control, and may be other than an organic sensor.
  • the photoelectric conversion layer included in the photoelectric conversion unit 211 may be made of an inorganic material.
  • the photoelectric conversion layer may be made of amorphous silicon or chalcopyrite semiconductor.
  • FIG. 5 is a flowchart showing an operation flow of the imaging apparatus 100.
  • FIG. 6 is a diagram for explaining the operation of the imaging apparatus 100.
  • the imaging apparatus 100 first performs exposure (S101). Specifically, after the exposure is started, the exposure is terminated by performing light shielding by the above-described electronic ND control or the mechanical shutter.
  • the imaging apparatus 100 performs nondestructive reading a predetermined number of times (S102), and then generates an image by performing destructive reading (S103).
  • the imaging apparatus 100 generates a corrected image in which random noise is reduced using the plurality of images obtained in steps S102 and S103 (S104).
  • reducing the random noise means reducing the increase / decrease in the luminance value caused by the random noise included in each pixel.
  • the imaging apparatus 100 generates a corrected image by averaging the obtained plurality of images.
  • the random noise is, for example, noise generated in the signal readout path, and the position (pixel) where the noise is generated and the strength of the noise are random. Therefore, since random noise cannot be grasped in advance, correction cannot be performed based on the amount of noise grasped in advance.
  • the pixel values of pixels in which random noise is generated can be averaged with the pixel values of normal pixels in other images, so that the influence of random noise can be reduced. .
  • the imaging apparatus 100 may determine the presence or absence of noise in each pixel included in each of a plurality of images, and generate a corrected image using pixels without noise, instead of addition averaging.
  • the presence of noise means that there is more noise than a predetermined value, and that there is no noise means that the noise is less than a predetermined value.
  • the pixel value of a pixel in which random noise is generated is a value that is distant from the pixel value of the pixel at the same position in another plurality of images. Therefore, the imaging apparatus 100 determines whether or not random noise is generated in each pixel of each image based on the variation in the pixel value of each pixel between images, and a pixel in which random noise is not generated. May be combined to generate a correction image.
  • the imaging device 100 calculates, for each pixel, an average value of the pixel values of the pixels included in the plurality of images, and randomly selects a pixel having a value separated from the average value by a predetermined value or more. It is determined that the pixel is generated, and other pixels are determined as normal pixels without random noise.
  • the imaging apparatus 100 generates a corrected image by combining normal pixels. For example, the imaging apparatus 100 may use the average value of the pixel values of normal pixels as the pixel value of the pixel of the corrected image, or use one of the pixel values of the normal pixel of the corrected image. You may use as a pixel value of the pixel concerned.
  • the imaging apparatus 100 uses the image obtained by destructive readout as a basic image, and calculates the pixel value or average of the pixels in which noise included in the basic image is generated by nondestructive readout. It may be replaced with a value.
  • some processing such as noise removal processing performed at the time of destructive reading is not performed. That is, an image obtained by destructive readout has higher image quality than an image obtained by nondestructive readout. Therefore, the image quality of the correction image can be improved by using the image obtained by destructive readout as the basic image.
  • nondestructive reading may be performed during the exposure period as shown in FIG.
  • nondestructive readings is arbitrary and is not limited to the number shown in FIGS. Further, destructive reading may not be performed.
  • the imaging apparatus 100 uses the imaging element 101 capable of non-destructive readout and the non-destructive readout to obtain a plurality of images obtained by the imaging element by one exposure. And a correction unit 105 that generates a corrected image with reduced random noise.
  • the imaging apparatus 100 can use a plurality of images obtained by single exposure using nondestructive readout, it is possible to suppress deterioration in image quality (for example, subject blur) in a moving image.
  • image quality for example, subject blur
  • the photographing time can be shortened compared to a case where a plurality of exposures are performed.
  • the correction unit 105 acquires a plurality of images using nondestructive reading after stopping the exposure. Thereby, since the imaging device 100 can use a plurality of images obtained with the same exposure time, it is possible to further suppress deterioration in image quality in a moving image.
  • An imaging apparatus 100 uses an imaging element 101 capable of nondestructive readout and a plurality of images obtained by the imaging element 101 by a single exposure using nondestructive readout. And a correction unit 105 that generates an image.
  • the correction unit 105 may acquire a plurality of images using nondestructive reading after stopping the exposure.
  • the correction unit 105 may generate a corrected image by averaging a plurality of images.
  • the correction unit 105 may determine the presence or absence of noise in each pixel included in each of the plurality of images, and generate a corrected image using pixels without noise.
  • the correction unit 105 may generate a corrected image using a plurality of images and an image acquired by destructive reading.
  • the image sensor 101 may be an organic sensor.
  • the control method according to an aspect of the present disclosure is a control method of the imaging apparatus 100 including the imaging element 101 capable of nondestructive readout, and is obtained by the imaging element 101 by one exposure using nondestructive readout. And a correction step (S104) for generating a corrected image using the plurality of images.
  • the imaging device according to the embodiment of the present disclosure has been described above, but the present disclosure is not limited to this embodiment.
  • each processing unit included in the imaging apparatus is typically realized as an LSI that is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them.
  • circuits are not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor.
  • An FPGA Field Programmable Gate Array
  • reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.
  • each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component.
  • Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
  • the present disclosure may be realized as a control method executed by the imaging apparatus.
  • circuit configuration shown in the circuit diagram is an example, and the present disclosure is not limited to the circuit configuration. That is, similar to the circuit configuration described above, a circuit that can realize the characteristic function of the present disclosure is also included in the present disclosure. Moreover, all the numbers used above are illustrated for specifically explaining the present disclosure, and the present disclosure is not limited to the illustrated numbers.
  • division of functional blocks in the block diagram is an example, and a plurality of functional blocks can be realized as one functional block, a single functional block can be divided into a plurality of functions, or some functions can be transferred to other functional blocks. May be.
  • functions of a plurality of functional blocks having similar functions may be processed in parallel or time-division by a single hardware or software.
  • the imaging device has been described based on the embodiment, but the present disclosure is not limited to this embodiment. Unless it deviates from the gist of the present disclosure, various modifications conceived by those skilled in the art have been made in this embodiment, and forms constructed by combining components in different embodiments are also within the scope of one or more aspects. May be included.
  • the present disclosure can be applied to an imaging apparatus such as a digital still camera or a digital video camera.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

La présente invention concerne un dispositif d'imagerie (100) qui est pourvu : d'un élément d'imagerie (101) qui peut être lu de manière non destructive ; et d'une unité de correction (105) qui utilise une lecture non destructive, et génère une image corrigée à l'aide d'une pluralité d'images obtenues par l'élément d'imagerie (101) suite à une exposition. L'unité de correction (105) peut acquérir la pluralité d'images à l'aide d'une lecture non destructive après l'arrêt de l'exposition. L'unité de correction (105) peut générer l'image corrigée en réalisant la moyenne de la pluralité d'images.
PCT/JP2017/046601 2016-12-27 2017-12-26 Dispositif d'imagerie et son procédé de commande Ceased WO2018124057A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016254485A JP2018107733A (ja) 2016-12-27 2016-12-27 撮像装置及びその制御方法
JP2016-254485 2016-12-27

Publications (1)

Publication Number Publication Date
WO2018124057A1 true WO2018124057A1 (fr) 2018-07-05

Family

ID=62709347

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/046601 Ceased WO2018124057A1 (fr) 2016-12-27 2017-12-26 Dispositif d'imagerie et son procédé de commande

Country Status (2)

Country Link
JP (1) JP2018107733A (fr)
WO (1) WO2018124057A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005269452A (ja) * 2004-03-19 2005-09-29 Olympus Corp 撮像素子および撮像装置
JP2011171950A (ja) * 2010-02-18 2011-09-01 Sony Corp 信号処理装置、半導体装置、固体撮像装置、撮像装置、電子機器、ノイズ抑制方法
WO2015045828A1 (fr) * 2013-09-27 2015-04-02 富士フイルム株式会社 Dispositif d'imagerie et procédé d'imagerie

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005269452A (ja) * 2004-03-19 2005-09-29 Olympus Corp 撮像素子および撮像装置
JP2011171950A (ja) * 2010-02-18 2011-09-01 Sony Corp 信号処理装置、半導体装置、固体撮像装置、撮像装置、電子機器、ノイズ抑制方法
WO2015045828A1 (fr) * 2013-09-27 2015-04-02 富士フイルム株式会社 Dispositif d'imagerie et procédé d'imagerie

Also Published As

Publication number Publication date
JP2018107733A (ja) 2018-07-05

Similar Documents

Publication Publication Date Title
CN207369180U (zh) 全局快门成像像素和包括成像像素阵列的图像传感器
JP6727938B2 (ja) 撮像装置、撮像装置の制御方法、及び撮像システム
JP5516960B2 (ja) 固体撮像装置、固体撮像装置の駆動方法、および、電子機器
JP5499789B2 (ja) 固体撮像装置、固体撮像装置の駆動方法、及び、電子機器
US9584745B2 (en) Image sensors with N-row parallel readout capability
JP6045156B2 (ja) 固体撮像装置
JP5871496B2 (ja) 撮像装置及びその駆動方法
CN109997352B (zh) 摄像装置、相机以及摄像方法
JP5959834B2 (ja) 撮像装置
JP2008263546A (ja) 固体撮像装置、固体撮像装置の駆動方法、及びこれを用いた撮像システム
WO2011083541A1 (fr) Dispositif de capture d'image à semi-conducteurs et dispositif de capture d'image
JP5936386B2 (ja) 撮像装置
JP2016167773A (ja) 撮像装置及び撮像装置の処理方法
WO2020022120A1 (fr) Circuit de correction de traînage, dispositif de capture d'image, et appareil électronique
JP2008017100A (ja) 固体撮像装置
JP2009284328A (ja) 撮像装置
JP5672363B2 (ja) 固体撮像素子およびカメラシステム
JP2007266760A (ja) 撮像素子
JP2012235193A (ja) 撮像素子、撮像装置、およびその制御方法、並びに制御プログラム
WO2018124054A1 (fr) Dispositif d'imagerie et son procédé de commande
JP6748979B2 (ja) 撮像装置及びその制御方法
JP6049304B2 (ja) 固体撮像装置および撮像装置
JP2011151461A (ja) 固体撮像素子
JP6775408B2 (ja) 放射線撮像装置及び放射線撮像システム
WO2018124057A1 (fr) Dispositif d'imagerie et son procédé de commande

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17889381

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17889381

Country of ref document: EP

Kind code of ref document: A1