[go: up one dir, main page]

WO2018150790A1 - Système d'imagerie et dispositif d'imagerie - Google Patents

Système d'imagerie et dispositif d'imagerie Download PDF

Info

Publication number
WO2018150790A1
WO2018150790A1 PCT/JP2018/001183 JP2018001183W WO2018150790A1 WO 2018150790 A1 WO2018150790 A1 WO 2018150790A1 JP 2018001183 W JP2018001183 W JP 2018001183W WO 2018150790 A1 WO2018150790 A1 WO 2018150790A1
Authority
WO
WIPO (PCT)
Prior art keywords
digital code
unit
latch
signal
adc
Prior art date
Application number
PCT/JP2018/001183
Other languages
English (en)
Japanese (ja)
Inventor
直樹 河津
敦史 鈴木
純一郎 薊
裕一 本橋
Original Assignee
ソニーセミコンダクタソリューションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2017197508A external-priority patent/JP6748622B2/ja
Application filed by ソニーセミコンダクタソリューションズ株式会社 filed Critical ソニーセミコンダクタソリューションズ株式会社
Priority to CN201880009122.3A priority Critical patent/CN110291784B/zh
Priority to US16/481,685 priority patent/US10785435B2/en
Priority to DE112018000861.4T priority patent/DE112018000861T5/de
Publication of WO2018150790A1 publication Critical patent/WO2018150790A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/78—Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters

Definitions

  • the present disclosure relates to an imaging system and an imaging apparatus that capture an image.
  • pixels including photodiodes are arranged in a matrix, and each pixel generates an electrical signal corresponding to the amount of received light.
  • an AD conversion circuit Analog Digital Converter
  • an electrical signal an electrical signal generated in each pixel into a digital signal.
  • Patent Document 1 discloses an imaging device that randomizes signals read from a pixel array (for example, Patent Document 1).
  • An imaging system includes an imaging device and a processing device.
  • the imaging device is mounted on a vehicle and generates an image by imaging a peripheral region of the vehicle.
  • the processing device is mounted on the vehicle and executes processing related to the function of controlling the vehicle based on the image.
  • the imaging device includes a first pixel, a second pixel, a first signal line, a second signal line, a first latch, a second latch, a transfer unit, and a diagnosis unit. Have.
  • the first signal line is connected to the first pixel.
  • the second signal line is connected to the second pixel and is different from the first signal line.
  • the first latch is connected to the first signal line and stores the first digital code.
  • the second latch is connected to the second signal line, is adjacent to the first latch, and stores the second digital code.
  • the transfer unit transfers the digital code output from the first latch and the second latch.
  • the diagnosis unit performs diagnosis processing based on the digital code transferred from the first latch and the second latch.
  • the processing device limits the function of controlling the vehicle based on the result of the diagnostic processing.
  • a first imaging device includes a first pixel, a second pixel, a first signal line, a second signal line, a first latch, and a second latch
  • a latch, a transfer unit, and a diagnosis unit are included.
  • the first signal line is connected to the first pixel.
  • the second signal line is connected to the second pixel and is different from the first signal line.
  • the first latch is connected to the first signal line and stores the first digital code.
  • the second latch is connected to the second signal line, is adjacent to the first latch, and stores the second digital code.
  • the transfer unit transfers the digital code output from the first latch and the second latch.
  • the diagnosis unit performs diagnosis processing based on the digital code transferred from the first latch and the second latch.
  • the second imaging device includes a plurality of signal lines, a plurality of pixels, a plurality of conversion units, a processing unit, and a transfer unit.
  • the plurality of pixels apply pixel voltages to the plurality of signal lines, respectively.
  • the plurality of conversion units are provided corresponding to the plurality of signal lines, and each of the plurality of conversion units generates a digital code by performing AD conversion based on the voltage of the corresponding signal line among the plurality of signal lines.
  • a code is output, and the digital code to be output is set to a predetermined digital code in the first period.
  • the processing unit performs predetermined processing based on the digital code and performs diagnostic processing in the first period.
  • the transfer unit transfers the digital code output from each of the plurality of conversion units to the processing unit.
  • the transfer unit transfers the digital code output from the first latch storing the first digital code
  • the digital code output from the second latch in which the second digital code is stored is transferred.
  • a diagnosis process is performed based on the digital code transferred from the first latch and the second latch.
  • a digital code is generated by performing AD conversion based on the voltage of the corresponding signal line in each of the plurality of conversion units. Then, the digital code output from each of the plurality of conversion units is transferred to the processing unit by the transfer unit. In each converter, the digital code to be output is set to a predetermined digital code in the first period.
  • the first latch storing the first digital code and the second latch storing the second digital code. Since the digital code output from is transferred, self-diagnosis can be performed.
  • the digital code output from each conversion unit is set to a predetermined digital code in the first period, so that self-diagnosis can be performed. it can.
  • the effect described here is not necessarily limited, and there may be any effect described in the present disclosure.
  • FIG. 2 is a circuit diagram illustrating a configuration example of a pixel array illustrated in FIG. 1.
  • FIG. 4 is another circuit diagram illustrating a configuration example of the pixel array illustrated in FIG. 1.
  • FIG. 4 is another circuit diagram illustrating a configuration example of the pixel array illustrated in FIG. 1.
  • FIG. 4 is another circuit diagram illustrating a configuration example of the pixel array illustrated in FIG. 1.
  • FIG. 5 is a circuit diagram illustrating a configuration example of a voltage generation unit illustrated in FIG. 4.
  • FIG. 5 is a circuit diagram illustrating a configuration example of one reading unit illustrated in FIG. 4.
  • FIG. 5 is a circuit diagram illustrating a configuration example of another reading unit illustrated in FIG. 4.
  • FIG. 2 is a block diagram illustrating a configuration example of a signal processing unit illustrated in FIG. 1. It is explanatory drawing showing the example of 1 structure of the imaging device shown in FIG.
  • FIG. 3 is a timing diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 3 is a timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 7B is an explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7A.
  • FIG. 7B is an explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7B.
  • FIG. 14 is a timing chart illustrating an operation example of the reading unit illustrated in FIGS. 13A and 13B.
  • FIG. 14 is another timing chart illustrating an operation example of the reading unit illustrated in FIGS. 13A and 13B.
  • FIG. 6 is an explanatory diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 11 is another timing waveform diagram illustrating an operation example of the imaging apparatus illustrated in FIG. 1.
  • FIG. 7B is another explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7A.
  • FIG. 8B is another explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7B.
  • FIG. 24 is a timing diagram illustrating an operation example of the reading unit illustrated in FIGS. 23A and 23B.
  • FIG. 7B is another explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7A.
  • FIG. 8B is another explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7B.
  • FIG. 26 is a timing chart illustrating an operation example of the reading unit illustrated in FIGS. 25A and 25B.
  • FIG. 7B is another explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7A.
  • FIG. 8B is another explanatory diagram illustrating an operation example of the reading unit illustrated in FIG. 7B.
  • FIG. 28 is a timing chart illustrating an operation example of the reading unit illustrated in FIGS. 27A and 27B. It is a circuit diagram showing the example of 1 structure of the pixel array which concerns on a modification. It is a circuit diagram showing the example of 1 structure of the pixel array which concerns on another modification. It is explanatory drawing showing the operation example of the read-out part which concerns on another modification. It is another explanatory drawing showing the example of 1 operation of the reading part concerning other modifications.
  • FIG. 32 is a timing diagram illustrating an operation example of the reading unit illustrated in FIGS. 31A and 31B. It is explanatory drawing showing the operation example of the read-out part which concerns on another modification.
  • FIG. 34 is a timing chart illustrating an operation example of the reading unit illustrated in FIGS. 33A and 33B. It is a block diagram which shows an example of a schematic structure of a vehicle control system. It is explanatory drawing which shows an example of the installation position of a vehicle exterior information detection part and an imaging part. It is explanatory drawing showing the example of 1 structure of the imaging device which concerns on another modification. It is explanatory drawing showing an example of the circuit arrangement
  • FIG. 1 illustrates a configuration example of an imaging apparatus (imaging apparatus 1) according to an embodiment.
  • the imaging apparatus 1 includes a pixel array 10, a scanning unit 21, signal generation units 22 and 23, a reading unit 40 (reading units 40 ⁇ / b> S and 40 ⁇ / b> N), a control unit 50, and a signal processing unit 60.
  • the pixel array 10 has a plurality of pixels P arranged in a matrix.
  • the plurality of pixels P include a plurality of pixels P1, a plurality of light shielding pixels P2, a plurality of dummy pixels P3, and a plurality of dummy pixels P4.
  • the pixel P1 includes a photodiode and generates a pixel voltage Vpix corresponding to the amount of received light.
  • the light-shielded pixel P2 is a pixel that is shielded from light, and is for detecting a dark current of the photodiode, as will be described later.
  • the dummy pixels P3 and P4 are pixels that do not have a photodiode.
  • the pixel array 10 is provided with a normal pixel region R1, light shielding pixel regions R21 and R22, and dummy pixel regions R3 and R4.
  • the plurality of pixels P1 are arranged in the normal pixel region R1
  • the plurality of light shielding pixels P2 are arranged in the light shielding pixel regions R21 and R22
  • the plurality of dummy pixels P3 are arranged in the dummy pixel region R3
  • the plurality of dummy pixels P4 are It is arranged in the dummy pixel region R4.
  • the dummy pixel region R4, the dummy pixel region R3, the light-shielded pixel region R21, the light-shielded pixel region R22, and the normal pixel region R1 from the top to the bottom in the vertical direction (vertical direction in FIG. 1). are arranged in this order.
  • the pixel array 10 has a plurality of signal lines SGL (4096 signal lines SGL (0) to SGL (4095) in this example) extending in the vertical direction (vertical direction in FIG. 1).
  • the plurality of signal lines SGL are arranged so as to penetrate the normal pixel region R1, the light-shielding pixel regions R21 and R22, and the dummy pixel regions R3 and R4.
  • the pixels P for one column and the two signal lines SGL are alternately arranged in the horizontal direction (the horizontal direction in FIG. 1).
  • the even-numbered signal lines SGL (SGL (0), SGL (2),...) Are connected to the reading unit 40S, and the odd-numbered signal lines SGL (SGL (1), SGL (3),. Connected to the unit 40N.
  • FIG. 2 shows a configuration example of the normal pixel region R1.
  • the pixel array 10 includes a plurality of control lines TGL, a plurality of control lines SLL, and a plurality of control lines RSTL in the normal pixel region R1.
  • the control line TGL extends in the horizontal direction (lateral direction in FIG. 2), and a control signal TG is applied to the control line TGL by the scanning unit 21.
  • the control line SLL extends in the horizontal direction, and the control signal SL is applied to the control line SLL by the scanning unit 21.
  • the control line RSTL extends in the horizontal direction, and the control signal RST is applied to the control line RSTL by the scanning unit 21.
  • the plurality of pixels P1 includes a plurality of pixels P1A and a plurality of pixels P1B.
  • the pixel P1A and the pixel P1B have the same circuit configuration.
  • the pixels P1A and P1B are alternately arranged in the vertical direction (vertical direction in FIG. 2).
  • the pixel P1 (pixels P1A and P1B) includes a photodiode 11 and transistors 12 to 15.
  • the transistors 12 to 15 are N-type MOS (MetalMOSOxide Semiconductor) transistors in this example.
  • the photodiode 11 is a photoelectric conversion element that generates an amount of electric charge corresponding to the amount of received light and accumulates it inside.
  • the anode of the photodiode 11 is grounded, and the cathode is connected to the source of the transistor 12.
  • the gate of the transistor 12 is connected to the control line TGL, the source is connected to the cathode of the photodiode 11, and the drain is connected to the floating diffusion FD.
  • the gate of the transistor 12 of the pixel P1A and the gate of the transistor 12 of the pixel P1B below the pixel P1A are connected to the same control line TGL.
  • the transistor 12 is turned on based on the control signal TG, and the charge generated in the photodiode 11 of the pixel P1 is transferred to the floating diffusion FD (charge transfer operation). .
  • the gate of the transistor 13 is connected to the control line RSTL, the power supply voltage VDD is supplied to the drain, and the source is connected to the floating diffusion FD.
  • the gate of the transistor 13 of the pixel P1A and the gate of the transistor 13 of the pixel P1B below the pixel P1A are connected to the same control line RSTL.
  • the transistor 13 is turned on based on the control signal RST, and the power supply voltage VDD is supplied to the floating diffusion FD. Thereby, in the pixel P1, the voltage of the floating diffusion FD is reset (reset operation).
  • the gate of the transistor 14 is connected to the floating diffusion FD, the power supply voltage VDD is supplied to the drain, and the source is connected to the drain of the transistor 15.
  • the gate of the transistor 15 is connected to the control line SLL, the drain is connected to the source of the transistor 14, and the source is connected to the signal line SGL.
  • the source of the transistor 15 in the pixel P1A is connected to the even-numbered signal line SGL (for example, the signal line SGL (0)), and the source of the transistor 15 in the pixel P1B is connected to the odd-numbered signal line SGL (for example, the signal line SGL (1) ))It is connected to the.
  • the transistor 15 is turned on, so that the transistor 14 is connected to a current source 44 (described later) of the reading unit 40.
  • the transistor 14 operates as a so-called source follower, and outputs a voltage corresponding to the voltage of the floating diffusion FD to the signal line SGL through the transistor 15 as the signal SIG.
  • the transistor 14 outputs a reset voltage Vreset corresponding to the voltage of the floating diffusion FD at that time as a signal SIG in the P-phase (Pre-charge phase) period PP after the voltage of the floating diffusion FD is reset. To do.
  • the transistor 14 has a pixel voltage Vpix corresponding to the amount of received light corresponding to the voltage of the floating diffusion FD at that time in the D phase (Data phase) period PD after the charge is transferred from the photodiode 11 to the floating diffusion FD. Is output as a signal SIG.
  • the light shielding pixel regions R21 and R22 will be described. As shown in FIG. 1, two rows of light-shielded pixels P2 are arranged in the light-shielded pixel region R21, and two rows of light-shielded pixels P2 are arranged in the light-shielded pixel region R22. Since the configuration of the light-shielding pixel region R22 is the same as that of the light-shielding pixel region R21, the light-shielding pixel region R21 will be described below as an example.
  • FIG. 3 shows a configuration example of the light-shielding pixel region R21.
  • the scanning unit 21 is also drawn.
  • the pixel array 10 includes a control line TGL, a control line SLL, and a control line RSTL in the light-shielding pixel region R21.
  • the control line TGL extends in the horizontal direction (lateral direction in FIG. 3), and the control signal TG is applied to the control line TGL by the scanning unit 21.
  • the control line SLL extends in the horizontal direction, and the control signal SL is applied to the control line SLL by the scanning unit 21.
  • the control line RSTL extends in the horizontal direction, and the control signal RST is applied to the control line RSTL by the scanning unit 21.
  • the plurality of light shielding pixels P2 include a plurality of light shielding pixels P2A and a plurality of light shielding pixels P2B.
  • the light shielding pixel P2A and the light shielding pixel P2B have the same circuit configuration.
  • the light shielding pixel P2A is a pixel in the upper row of the light shielding pixels P2 for two rows
  • the light shielding pixel P2B is a pixel in the lower row of the light shielding pixels P2 for two rows.
  • the light shielding pixel P2 (light shielding pixels P2A and P2B) includes a photodiode 11 and transistors 12 to 15.
  • the light-shielding pixel P2 has the same circuit configuration as the pixel P1 (FIG. 2), and is different from the pixel P1 in that light is shielded so as not to enter the photodiode 11.
  • the transistor 15 is turned on, so that the transistor 14 outputs the signal SIG corresponding to the voltage of the floating diffusion FD to the transistor 15 To the signal line SGL. Since the light shielding pixel P2 is shielded from light, the voltage of the floating diffusion FD in the D-phase period PD becomes a voltage corresponding to the dark current of the photodiode 11. Therefore, the transistor 14 outputs the pixel voltage Vpix corresponding to the dark current as the signal SIG in the D-phase period PD.
  • the dummy pixel regions R3 and R4 will be described. As shown in FIG. 1, two rows of dummy pixels P3 are arranged in the dummy pixel region R3, and two rows of dummy pixels P4 are arranged in the dummy pixel region R4.
  • FIG. 4 shows a configuration example of the dummy pixel region R3.
  • the pixel array 10 includes a control line SLL, a control line VMAL, and a control line VMBL in the dummy pixel region R3.
  • the control line SLL extends in the horizontal direction (lateral direction in FIG. 4), and the control signal SL is applied to the control line SLL by the scanning unit 21.
  • the control line VMAL extends in the horizontal direction, and a control signal VMA is applied to the control line VMAL by a voltage generation unit 30A (described later) of the signal generation unit 22.
  • the control line VMBL extends in the horizontal direction, and a control signal VMB is applied to the control line VMBL by a voltage generation unit 30B (described later) of the signal generation unit 22.
  • the plurality of dummy pixels P3 includes a plurality of dummy pixels P3A and a plurality of dummy pixels P3B.
  • the dummy pixel P3A and the dummy pixel P3B have the same circuit configuration.
  • the dummy pixel P3A is a pixel in the upper row of the dummy pixels P3 for two rows
  • the dummy pixel P3B is a pixel in the lower row of the dummy pixels P3 for two rows.
  • the dummy pixel P3 (dummy pixels P3A and P3B) includes transistors 14 and 15. That is, the dummy pixel P3 is obtained by omitting the photodiode 11 and the transistors 12 and 13 from the pixel P1 (FIG. 2).
  • the gate of the transistor 14 is connected to the control line VMAL, the power supply voltage VDD is supplied to the drain, and the source is connected to the drain of the transistor 15.
  • the gate of the transistor 15 is connected to the control line SLL, the drain is connected to the source of the transistor 14, and the source is connected to the even-numbered signal line SGL (for example, the signal line SGL (0)).
  • the gate of the transistor 14 is connected to the control line VMBL, the power supply voltage VDD is supplied to the drain, and the source is connected to the drain of the transistor 15.
  • the gate of the transistor 15 is connected to the control line SLL, the drain is connected to the source of the transistor 14, and the source is connected to the odd-numbered signal line SGL (for example, the signal line SGL (1)).
  • the transistor 14 transmits the signal SIG corresponding to the voltage of the control signal VMA through the transistor 15 in the P-phase period PP and the D-phase period PD. To the signal line SGL.
  • the transistor 14 transmits a signal SIG corresponding to the voltage of the control signal VMB through the transistor 15 in the P-phase period PP and the D-phase period PD. The signal is output to the signal line SGL.
  • FIG. 5 shows a configuration example of the dummy pixel region R4.
  • the pixel array 10 has a control line SLL and a control line SUNL in the dummy pixel region R4.
  • the control line SLL extends in the horizontal direction (lateral direction in FIG. 5), and the control signal SL is applied to the control line SLL by the scanning unit 21.
  • the control line SUNL extends in the horizontal direction, and the control signal SUN is applied to the control line SUNL by the signal generator 23.
  • the plurality of dummy pixels P4 includes a plurality of dummy pixels P4A and a plurality of dummy pixels P4B.
  • the dummy pixel P4A and the dummy pixel P4B have the same circuit configuration.
  • the dummy pixel P4A is a pixel in the upper row of the dummy pixels P4 for two rows
  • the dummy pixel P4B is a pixel in the lower row of the dummy pixels P4 for two rows.
  • the dummy pixel P4 (dummy pixels P4A and P4B) includes transistors 14 and 15.
  • the dummy pixel P4 has the same circuit configuration as the dummy pixel P3 (FIG. 4).
  • the gate of the transistor 14 is connected to the control line SUNL, the power supply voltage VDD is supplied to the drain, and the source is connected to the drain of the transistor 15.
  • the gate of the transistor 15 is connected to the control line SLL, the drain is connected to the source of the transistor 14, and the source is connected to the signal line SGL.
  • the source of the transistor 15 of the dummy pixel P4A is connected to the even-numbered signal line SGL (for example, the signal line SGL (0)), and the source of the transistor 15 of the dummy pixel P4B is connected to the odd-numbered signal line SGL (for example, the signal line SGL). (1)).
  • the transistor 15 is turned on.
  • the dummy pixel P4 applies a voltage corresponding to the voltage to the control signal SUN via the transistor 15 in a predetermined period before the P-phase period PP. To the signal line SGL.
  • the dummy pixel P4 has a voltage of the signal SIG so that the voltage of the signal SIG does not become too low in a predetermined period before the P-phase period PP. To come to a limit.
  • the scanning unit 21 sequentially drives a plurality of pixels P1 in the normal pixel region R1 based on an instruction from the control unit 50, and includes, for example, a shift register and an address decoder. It is. Specifically, the scanning unit 21 sequentially applies the control signal RST to the plurality of control lines RSTL in the normal pixel region R1, sequentially applies the control signal TG to the plurality of control lines TGL, and performs a plurality of control operations. A control signal SL is sequentially applied to the line SLL.
  • the scanning unit 21 also has a function of driving a plurality of light-shielding pixels P2 in the light-shielding pixel regions R21 and R22 and a plurality of dummy pixels P3 in the dummy pixel region R3 during the blanking period P20. ing.
  • the scanning unit 21 has a function of driving the dummy pixel P4 in the dummy pixel region R4.
  • the signal generator 22 applies the control signal VMA to the control line VMAL in the pixel array 10 and applies the control signal VMB to the control line VMBL based on an instruction from the controller 50.
  • the signal generation unit 22 includes two voltage generation units 30 (voltage generation units 30A and 30B). Since the voltage generator 30A and the voltage generator 30B have the same circuit configuration, the voltage generator 30A will be described below as an example.
  • FIG. 6 shows a configuration example of the voltage generation unit 30A.
  • the voltage generation unit 30 ⁇ / b> A includes a resistance circuit unit 31, a selector 32, a temperature sensor 33, and a selector 34.
  • the resistance circuit unit 31 includes a plurality of resistance elements connected in series, and generates a plurality of voltages by dividing the power supply voltage VDD.
  • the selector 32 selects and outputs one of a plurality of voltages generated in the resistance circuit unit 31 based on the control signal supplied from the control unit 50.
  • the temperature sensor 33 detects a temperature and generates a voltage Vtemp according to the detected temperature.
  • the selector 34 selects one of the voltage supplied from the selector 32 and the voltage Vtemp supplied from the temperature sensor 33 based on the control signal supplied from the controller 50, and outputs the selected signal as a control signal VMA. It is.
  • Control signals are separately supplied from the control unit 50 to the voltage generation unit 30A and the voltage generation unit 30B.
  • the voltage generators 30A and 30B can generate the same control signals VMA and VMB, or can generate different control signals VMA and VMB.
  • the signal generator 23 applies the control signal SUN to the control line SUNL in the pixel array 10 based on an instruction from the controller 50.
  • the control signal SUN is set so that the voltage of the signal SIG does not become too low in a predetermined period before the P-phase period PP when the imaging apparatus 1 images a very bright subject. This is for limiting the voltage of the signal SIG.
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) by performing AD conversion based on the signal SIG supplied from the pixel array 10 via the signal line SGL. Is.
  • the reading unit 40S is connected to even-numbered signal lines SGL (signal lines SGL (0), SGL (2), SGL (4),...), And in this example, the vertical direction (vertical direction in FIG. 1). ,
  • the pixel array 10 is disposed below.
  • the readout section 40N is connected to odd-numbered signal lines SGL (signal lines SGL (1), SGL (3), SGL (5),). In this example, the readout section 40N is arranged above the pixel array 10 in the vertical direction. Is arranged.
  • FIG. 7A shows a configuration example of the reading unit 40S
  • FIG. 7B shows a configuration example of the reading unit 40N
  • 7A shows the control unit 50 and the signal processing unit 60 in addition to the reading unit 40S
  • FIG. 7B shows the control unit 50 and the signal processing unit 60 in addition to the reading unit 40N. I also draw.
  • the reading unit 40 includes a plurality of AD (Analog to Digital) converters ADC (AD converters ADC (0), ADC (1), ADC (2), etc And a plurality of switch units. SW (switch units SW (0), SW (1), SW (2), etc And bus wiring 100 (bus wirings 100S and 100N) are provided.
  • AD Analog to Digital
  • the AD converter ADC converts the pixel voltage Vpix into a digital code CODE by performing AD conversion based on the signal SIG supplied from the pixel array 10.
  • the plurality of AD conversion units ADC are provided corresponding to the plurality of signal lines SGL.
  • the 0th AD conversion unit ADC (0) is provided corresponding to the 0th signal line SGL (0)
  • the second AD conversion unit ADC ( 2) is provided corresponding to the second signal line SGL (2)
  • the fourth AD conversion unit ADC (4) is provided corresponding to the fourth signal line SGL (4).
  • the reading unit 40N FIG.
  • the first AD conversion unit ADC (1) is provided corresponding to the first signal line SGL (2)
  • the third AD conversion unit ADC (3) are provided corresponding to the third signal line SGL (3)
  • the fifth AD converter ADC (5) is provided corresponding to the fifth signal line SGL (5).
  • the AD conversion unit ADC includes capacitive elements 41 and 42, a current source 44, a comparator 45, and a counter 46.
  • a reference signal REF supplied from the control unit 50 is supplied to one end of the capacitive element 41, and the other end is connected to the positive input terminal of the comparator 45.
  • This reference signal REF has a so-called ramp waveform in which the voltage level gradually decreases with time in the P-phase period PP and the D-phase period PD.
  • One end of the capacitive element 42 is connected to the signal line SGL, and the other end is connected to the negative input terminal of the comparator 45.
  • the current source 44 allows a current having a predetermined current value to flow from the signal line SGL to the ground.
  • the comparator 45 compares the input voltage at the positive input terminal with the input voltage at the negative input terminal, and outputs the comparison result as a signal CMP.
  • the reference signal REF is supplied to the positive input terminal of the comparator 45 via the capacitive element 41, and the signal SIG is supplied to the negative input terminal via the capacitive element 42.
  • the comparator 45 also has a function of performing zero adjustment for electrically connecting the positive input terminal and the negative input terminal in a predetermined period before the P-phase period PP.
  • the counter 46 performs a counting operation based on the signal CMP supplied from the comparator 45, the clock signal CLK supplied from the control unit 50, and the control signal CC. With this configuration, the AD conversion unit ADC performs AD conversion based on the signal SIG, and outputs the count value CNT of the counter 46 as a digital code CODE having a plurality of bits (13 bits in this example). Yes.
  • the switch unit SW supplies the digital code CODE output from the AD conversion unit ADC to the bus wiring 100 based on the control signal SEL supplied from the control unit 50.
  • the plurality of switch units SW are provided corresponding to the plurality of AD conversion units ADC.
  • the 0th switch unit SW (0) is provided corresponding to the 0th AD converter unit ADC (0)
  • the second switch unit SW (2 ) Is provided corresponding to the second AD conversion unit ADC (2)
  • the fourth switch unit SW (4) is provided corresponding to the fourth AD conversion unit ADC (4).
  • the reading unit 40N FIG.
  • the first switch unit SW (1) is provided corresponding to the first AD conversion unit ADC (1), and the third switch unit SW (3)
  • the fifth AD converter unit ADC (3) is provided corresponding to the third AD converter unit ADC (3)
  • the fifth switch unit SW (5) is provided corresponding to the fifth AD converter unit ADC (5).
  • the switch unit SW is configured by using the same number of transistors (13 in this example) as the number of bits of the digital code CODE. These transistors are ON / OFF controlled based on each bit (control signals SEL [0] to SEL [4095]) of the control signal SEL supplied from the control unit 50.
  • the 0th switch unit SW (SW (0)) (FIG. 7A) is configured so that each transistor is turned on based on the control signal SEL [0], so that the 0th AD conversion unit The digital code CODE output from the ADC (0) is supplied to the bus wiring 100S.
  • the first switch unit SW (SW (1)) (FIG. 7B) is configured so that each transistor is turned on based on the control signal SEL [1], so that the first AD conversion unit ADC ( The digital code CODE output from 1) is supplied to the bus wiring 100N.
  • the other switch units SW is configured by using the same number of transistors (13 in this example) as the number of bits of the digital code CODE. These transistors are ON /
  • the bus wiring 100S (FIG. 7A) has a plurality of (in this example, 13) wirings and transmits the digital code CODE output from the AD conversion unit ADC of the reading unit 40S.
  • the reading unit 40S supplies a plurality of digital codes CODE supplied from the AD conversion unit ADC of the reading unit 40S to the signal processing unit 60 as the image signal DATA0S.
  • the bus wiring 100N (FIG. 7B) has a plurality of wirings (13 in this example) and transmits the digital code CODE output from the AD conversion unit ADC of the reading unit 40N.
  • the reading unit 40N uses the bus wiring 100N to supply a plurality of digital codes CODE supplied from the AD conversion unit ADC of the reading unit 40N to the signal processing unit 60 as the image signal DATA0N.
  • the control unit 50 (FIG. 1) supplies control signals to the scanning unit 21, the signal generation units 22, 23, the reading unit 40 (reading units 40S, 40N), and the signal processing unit 60, and controls the operation of these circuits. By doing so, the operation of the imaging apparatus 1 is controlled.
  • the control unit 50 has a reference signal generation unit 51.
  • the reference signal generation unit 51 generates a reference signal REF.
  • the reference signal REF has a so-called ramp waveform in which the voltage level gradually decreases with time in the P-phase period PP and the D-phase period PD.
  • the reference signal generation unit 51 is configured to be able to change the slope of the ramp waveform and the voltage offset amount OFS in the reference signal REF. Then, the reference signal generation unit 51 supplies the generated reference signal REF to the AD conversion unit ADC of the reading unit 40 (reading units 40S and 40N).
  • the control unit 50 supplies a control signal to the scanning unit 21, so that the scanning unit 21 sequentially drives the plurality of pixels P1 in the normal pixel region R1, and in the blanking period P20, Control is performed so as to drive a plurality of light-shielding pixels P2 in the light-shielding pixel regions R21 and R22 and a plurality of dummy pixels P3 in the dummy pixel region R3.
  • the control unit 50 supplies, for example, a control signal to the scanning unit 21, thereby causing the pixel P1 in the normal pixel region R1, the light shielding pixel P2 in the light shielding pixel regions R21 and R22, and the dummy pixel in the dummy pixel region R3.
  • P3 is selected as a reading target
  • the scanning unit 21 controls to drive the dummy pixel P4 in the dummy pixel region R4.
  • control unit 50 supplies a control signal to the signal generation unit 22, so that the signal generation unit 22 applies the control signal VMA to the control line VMAL in the dummy pixel region R3, and the control line VMBL. Is controlled to apply the control signal VMB.
  • control unit 50 supplies the control signal to the signal generation unit 23 so that the signal generation unit 23 applies the control signal SUN to the control line SUNL in the dummy pixel region R4. .
  • control unit 50 sends a reference signal REF, a clock signal CLK, a control signal CC, and a control signal SEL (control signals SEL [0] to SEL [4095]) to the reading unit 40 (reading units 40S and 40N).
  • the reading unit 40 is controlled to generate the image signal DATA0 (image signals DATA0S, DATA0N) based on the signal SIG.
  • the control unit 50 controls the operation of the signal processing unit 60 by supplying a control signal to the signal processing unit 60.
  • FIG. 8 shows a configuration example of the signal processing unit 60.
  • the signal processing unit 60 performs predetermined signal processing based on the image signal DATA0 (image signals DATA0S and DATA0N) supplied from the reading unit 40, and outputs the image signal subjected to the signal processing as the image signal DATA. It is.
  • the signal processing unit 60 also has a function of performing diagnosis processing based on the image signal DATA0 (image signals DATA0S, DATA0N) and outputting a diagnosis result RES.
  • the signal processing unit 60 includes processing units 70 and 80 and a diagnosis unit 61.
  • the processing unit 70 performs dark current correction based on the image signal DATA0 (image signals DATA0S, DATA0N) by subtracting the dark current contribution of the photodiode 11 from the digital code CODE included in the image signal DATA0.
  • the processing unit 70 includes an average value calculation unit 71, an offset amount calculation unit 72, an average value calculation unit 73, a correction value calculation unit 74, and a correction unit 75.
  • the average value calculation unit 71 calculates an average value of the digital code CODE related to the plurality of light shielding pixels P2 in the light shielding pixel region R21, which is included in the image signal DATA0. That is, when the scanning unit 21 drives the plurality of light-shielded pixels P2 in the light-shielded pixel region R21, and the reading unit 40 generates the digital code CODE by performing AD conversion based on the signal SIG, the average value calculating unit Reference numeral 71 denotes an average value of these digital codes CODE.
  • the offset amount calculation unit 72 calculates the voltage offset amount OFS of the reference signal REF in the D-phase period PD based on the calculation result of the average value calculation unit 71. Then, the offset amount calculation unit 72 supplies the calculation result to the control unit 50.
  • the control unit 50 stores the voltage offset amount OFS in a register, and the reference signal generation unit 51 of the control unit 50 generates the reference signal REF based on the voltage offset amount OFS. Thereby, the reference signal generation unit 51 thereafter generates the reference signal REF whose voltage is shifted by the voltage offset amount OFS in the D-phase period PD.
  • the scanning unit 21 drives the plurality of light shielding pixels P2 in the light shielding pixel region R22, and the reading unit 40 generates a digital code CODE by performing AD conversion using the reference signal REF based on the signal SIG. To do.
  • the average value calculation unit 73 calculates an average value of the digital code CODE related to the plurality of light shielding pixels P2 in the light shielding pixel region R22, which is included in the image signal DATA0.
  • This digital code CODE is generated by the reading unit 40 using the reference signal REF whose voltage is shifted by the voltage offset amount OFS in the D-phase period PD.
  • the average value calculation unit 73 calculates the average value of the digital code CODE generated in this way.
  • the correction value calculation unit 74 calculates the correction value of the digital code CODE based on the calculation result of the average value calculation unit 73.
  • the correction unit 75 uses the correction value calculated by the correction value calculation unit 74 to correct the digital code CODE related to the plurality of pixels P1 in the normal pixel region R1 included in the image signal DATA0.
  • the processing unit 70 obtains the influence of the dark current of the photodiode 11 on the digital code CODE based on the digital code CODE related to the plurality of light-shielded pixels P2 in the light-shielded pixel regions R21 and R22, and the normal pixel region R1 The contribution of dark current is subtracted from the digital code CODE related to the plurality of pixels P1.
  • the processing unit 80 performs processing for correcting an image when, for example, a line-shaped streak occurs in the image due to the pixel P1 for one row or the pixel P1 for one column not operating normally.
  • the processing unit 80 includes a row average value calculation unit 81, a determination unit 82, a horizontal stripe correction unit 83, a determination unit 84, a vertical stripe correction unit 85, a selection control unit 86, and a selector 87.
  • the row average value calculation unit 81 calculates the average value of the digital code CODE related to the pixels P1 for one row in the normal pixel region R1 based on the image signal supplied from the processing unit 70.
  • the determination unit 82 determines whether or not a line-shaped line extending in the horizontal direction is generated based on the average value of the digital codes CODE for a plurality of rows supplied from the row average value calculation unit 81. Specifically, for example, the difference between the average value of the digital code CODE related to the pixel P1 in the focused row and the average value of the digital code CODE related to the pixel P1 in the row above the focused row is larger than a predetermined value.
  • the determination unit 82 when the difference between the average value of the digital code CODE related to the pixel P1 in the focused row and the average value of the digital code CODE related to the pixel P1 in the lower row of the focused row is larger than a predetermined value, the determination unit 82, it is determined that a line-shaped streak occurs in the focused row. Then, the determination unit 82 supplies the determination result to the selection control unit 86.
  • the horizontal streak correction unit 83 relates to the pixel P1 in the focused row based on the digital code CODE related to the pixel P1 in the row above the focused row and the digital code CODE related to the pixel P1 in the row below the focused row.
  • the digital code CODE is calculated.
  • the horizontal stripe correction unit 83 obtains, for example, an average value of the digital code CODE related to the pixel P1 above the focused pixel P1 and the digital code CODE related to the pixel P1 below the focused pixel P1.
  • the digital code CODE related to the focused pixel P1 is obtained.
  • the determination unit 84 includes the digital code CODE related to the pixel of interest P1 included in the image signal supplied from the processing unit 70, the digital code CODE related to the left pixel P1 of the pixel of interest P1, and the pixel P1 of interest. Based on the digital code CODE related to the right pixel P1, it is determined whether or not a line-like line extending in the vertical direction can be generated. Specifically, for example, the difference between the digital code CODE related to the focused pixel P1 and the digital code CODE related to the left pixel P1 of the focused pixel P1 is larger than a predetermined value, and the digital code related to the focused pixel P1 is used.
  • the determination unit 84 may generate a line-like line in the column including the focused pixel P1. It is determined. Then, the determination unit 84 supplies the determination result to the selection control unit 86.
  • the vertical stripe correction unit 85 is focused by, for example, obtaining an average value of the digital code CODE related to the right pixel P1 of the focused pixel P1 and the digital code CODE related to the left pixel P1 of the focused pixel P1.
  • the digital code CODE related to the pixel P1 is obtained.
  • the selection control unit 86 is supplied from the digital code CODE supplied from the processing unit 70, the digital code CODE supplied from the horizontal stripe correction unit 83, and the vertical stripe correction unit 85 based on the determination results by the determination units 82 and 84.
  • a selection signal for instructing a digital code CODE to be selected from the digital codes CODE is generated.
  • the selector 87 is supplied from the digital code CODE supplied from the processing unit 70, the digital code CODE supplied from the horizontal stripe correction unit 83, and the vertical stripe correction unit 85 based on the selection signal supplied from the selection control unit 86.
  • One of the digital codes CODE is selected and output.
  • the processing unit 80 detects line-shaped streaks based on the image signal supplied from the processing unit 70, and corrects the digital code CODE so that the line-shaped streaks are not noticeable. Then, the processing unit 80 outputs the processed image signal as the image signal DATA.
  • the processing unit 80 is provided in the imaging device 1, but the present invention is not limited to this, and the imaging unit 1 is not provided with the processing unit 80, and a signal processing unit different from the imaging device 1 is provided. The processing of the processing unit 80 may be performed.
  • the processing unit 80 causes the line streaks to be inconspicuous when line streaks occur in the image because the pixels P1 for one row and the pixels P1 for one column do not operate normally.
  • the digital code CODE is corrected, but the present invention is not limited to this.
  • the digital code CODE may be similarly corrected when line-like streaks occur in the image due to the pixels P1 for two adjacent rows not operating normally.
  • the diagnosis unit 61 performs diagnosis processing based on the image signal DATA0 (image signals DATA0S and DATA0N). Specifically, the diagnosis unit 61 performs diagnosis processing by confirming whether the digital code CODE included in the image signal DATA0 satisfies a predetermined specification, and outputs a diagnosis result RES. .
  • the block shown in FIG. 1 may be formed on a single semiconductor substrate. Further, the block shown in FIG. 1 may be formed on a plurality of semiconductor substrates. Specifically, for example, as illustrated in FIG. 9, each block of the imaging device 1 may be formed by being divided into two semiconductor substrates (an upper substrate 201 and a lower substrate 202). In this example, the upper substrate 201 and the lower substrate 202 are stacked and connected to each other via a plurality of vias 203. On the upper substrate 201, for example, the pixel array 10, the control lines TGL, SLL, RSTL, VMAL, VMBL, SUNL, the signal line SGL, the scanning unit 21, and the signal generation units 22 and 23 can be formed.
  • the reading unit 40 (reading units 40S and 40N), the control unit 50, and the signal processing unit 60 can be formed on the lower substrate 202.
  • the signal line SGL in the upper substrate 201 is connected to the reading unit 40 in the lower substrate 202 through the plurality of vias 203A (first connection unit) of the plurality of vias 203.
  • the arrangement of each circuit is not limited to this, and for example, the signal generation units 22 and 23 may be formed on the lower substrate 202.
  • the plurality of control lines VMAL, VMBL, and SUNL in the upper substrate 201 are connected to the signal generation units 22 and 23 in the lower substrate 202 via the plurality of vias 203B (second connection portions) of the plurality of vias 203. Connected to.
  • the imaging apparatus 1 can diagnose these problems even when, for example, a short circuit between adjacent vias 203 or a voltage is fixed.
  • FIG. 38 shows an example of circuit arrangement on the upper substrate 201 and the lower substrate 202.
  • the pixel array 10 is formed on the upper substrate 201. That is, the upper substrate 201 includes a plurality of pixels P1 (pixels P1A and P1B), a plurality of light shielding pixels P2 (light shielding pixels P2A and P2B), a plurality of dummy pixels P3 (dummy pixels P3A and P3B), and a plurality of dummy pixels P4. (Dummy pixels P4A, P4B), control lines TGL, SLL, RSTL, VMAL, VMBL, SUNL, and signal lines SGL are formed.
  • the upper substrate 201 is provided with electrode regions 201A, 201B, and 201C.
  • the electrode region 201A is provided on the lower side of the upper substrate 201
  • the electrode region 201B is provided on the upper side of the upper substrate 201
  • the electrode region 201C is provided on the left side of the upper substrate 201.
  • a plurality of electrodes are formed in the electrode region 201A, and the plurality of electrodes are connected to a plurality of even-numbered signal lines SGL in the pixel array 10 via vias such as TCV (Through Chip Via), for example. .
  • a plurality of electrodes are formed in the electrode region 201B, and the plurality of electrodes are connected to the odd-numbered signal lines SGL in the pixel array 10 via vias such as TCV, for example.
  • a plurality of electrodes are formed in the electrode region 201C, and these electrodes are connected to control lines TGL, SLL, RSTL, VMAL, VMBL in the pixel array 10 via vias such as TCV, for example.
  • a scanning unit 21, reading units 40S and 40N, a reference signal generation unit 51, and a processing unit 209 are formed on the lower substrate 202.
  • the processing unit 209 corresponds to a circuit other than the reference signal generation unit 51 in the control unit 50, the signal generation units 22 and 23, and the signal processing unit 60.
  • the processing unit 209 is disposed near the center in the vertical direction in FIG. 38, the scanning unit 21 is disposed on the left side of the processing unit 209, the reference signal generation unit 51 is disposed on the right side of the processing unit 209, and the reading unit 40S. Is disposed below the processing unit 209, and the reading unit 40N is disposed above the processing unit 209.
  • the reference signal REF supplied from the reference signal generator 51 to the two reading units 40S and 40N preferably has the same waveform in the two reading units 40S and 40N. Therefore, it is desirable that the distance between the reference signal generation unit 51 and the reading unit 40S is equal to the distance between the reference signal generation unit 51 and the reading unit 40N.
  • one reference signal generation unit 51 is provided.
  • the present invention is not limited to this.
  • two reference signal generation units 51 reference signal generation units 51 (reference signal generation units 51S and 51N) are provided to provide reference signals.
  • the reference signal REF generated by the generation unit 51S may be supplied to the reading unit 40S, and the reference signal REF generated by the reference signal generation unit 51N may be supplied to the reading unit 40N.
  • the lower substrate 202 is provided with electrode regions 202A, 202B, and 202C.
  • the electrode region 202A is provided on the lower side of the lower substrate 202 so as to be adjacent to the reading unit 40S
  • the electrode region 202B is provided on the upper side of the lower substrate 202 so as to be adjacent to the reading unit 40N.
  • 202C is provided on the left side of the lower substrate 202 so as to be adjacent to the scanning unit 21.
  • a plurality of electrodes are formed in the electrode region 202A, and the plurality of electrodes are connected to the reading unit 40S via vias such as TCV, for example.
  • a plurality of electrodes are formed in the electrode region 202B, and the plurality of electrodes are connected to the reading unit 40N via vias such as TCV, for example.
  • a plurality of electrodes are formed in the electrode region 202C, and the plurality of electrodes are connected to the scanning unit 21 and the signal generation units 22 and 23 in the processing unit 209 through vias such as TCV, for example.
  • the upper substrate 201 and the lower substrate 202 are bonded to each other. Accordingly, the plurality of electrodes in the electrode region 201A of the upper substrate 201 are electrically connected to the plurality of electrodes in the electrode region 202A of the lower substrate 202, and the plurality of electrodes in the electrode region 201B of the upper substrate 201 are electrically connected to the lower substrate 202. The plurality of electrodes in the electrode region 202B of the upper substrate 201 are electrically connected to the plurality of electrodes in the electrode region 202C of the lower substrate 202.
  • the scanning unit 21 and the signal generation units 22 and 23 of the lower substrate 202 transmit the control signals TG, SL, RST, and the like to the pixel array 10 of the upper substrate 201 via the plurality of electrodes in the electrode regions 201C and 202C.
  • VMA, VMB, SUN are supplied.
  • the pixel array 10 of the upper substrate 201 supplies a signal SIG to the reading units 40S and 40N of the lower substrate 202 through the plurality of electrodes in the electrode regions 201A and 202A and the plurality of electrodes in the electrode regions 201B and 202B.
  • the reading units 40S and 40N of the lower substrate 202 generate an image signal DATA0 (image signals DATA0S and DATA0N) by performing AD conversion based on the signal SIG.
  • the signal processing unit 60 of the lower substrate 202 performs diagnosis processing based on the image signal DATA0 based on the image signal DATA0, and outputs a diagnosis result RES.
  • diagnosis processing based on the image signal DATA0 based on the image signal DATA0, and outputs a diagnosis result RES.
  • the upper substrate 201 can be manufactured by using a semiconductor manufacturing process specialized for pixels by mainly disposing the pixel array 10 on the upper substrate 201 in this way. That is, since there are no transistors other than the pixel array 10 on the upper substrate 201, for example, even when there is a step of annealing at 1000 degrees, circuits other than the pixel array 10 are not affected. Therefore, when manufacturing the upper substrate 201, for example, a high-temperature process for white spot countermeasures can be introduced, and as a result, the characteristics of the imaging device 1 can be improved.
  • the signal line SGL corresponds to a specific example of “signal line” in the present disclosure.
  • the pixel P1 corresponds to a specific example of “pixel” in the present disclosure.
  • the AD conversion unit ADC corresponds to a specific example of “first latch” and “second latch” in the present disclosure.
  • the plurality of switch units SW and bus wirings 100S and 100N correspond to a specific example of “transfer unit” in the present disclosure.
  • the signal generator 22 generates control signals VMA and VMB.
  • the signal generator 23 generates a control signal SUN.
  • the scanning unit 21 sequentially drives the plurality of pixels P1 in the normal pixel region R1.
  • the pixel P1 in the normal pixel region R1 outputs the reset voltage Vreset as the signal SIG in the P-phase period PP, and outputs the pixel voltage Vpix corresponding to the amount of received light as the signal SIG in the D-phase period PD.
  • the scanning unit 21 drives the plurality of light shielding pixels P2 in the light shielding pixel regions R21 and R22 and the plurality of dummy pixels P3 in the dummy pixel region R3 in the blanking period P20.
  • the light-shielded pixel P2 in the light-shielded pixel regions R21 and R22 outputs the reset voltage Vreset as the signal SIG in the P-phase period PP, and outputs the pixel voltage Vpix corresponding to the dark current as the signal SIG in the D-phase period PD.
  • the dummy pixel P3A in the dummy pixel region R3 outputs a signal SIG corresponding to the voltage of the control signal VMA in the P phase period PP and the D phase period PD
  • the dummy pixel P3B is a signal SIG corresponding to the voltage of the control signal VMB. Is output.
  • the scanning unit 21 detects the dummy pixel region R4 when the pixel P1 in the normal pixel region R1, the light shielding pixel P2 in the light shielding pixel regions R21 and R22, and the dummy pixel P3 in the dummy pixel region R3 are selected as reading targets.
  • the dummy pixel P4 is driven.
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) by performing AD conversion based on the signal SIG.
  • the signal processing unit 60 performs predetermined signal processing based on the image signal DATA0, outputs the image signal subjected to the signal processing as the image signal DATA, performs diagnostic processing based on the image signal DATA0, and performs a diagnosis result. RES is output.
  • the control unit 50 supplies control signals to the scanning unit 21, the signal generation units 22, 23, the reading unit 40 (reading units 40S, 40N), and the signal processing unit 60, and controls the operation of these circuits. The operation of the imaging device 1 is controlled.
  • the plurality of pixels P1 in the normal pixel region R1 accumulates charges according to the amount of received light, and outputs a pixel voltage Vpix according to the amount of received light as a signal SIG. This operation will be described in detail below.
  • FIG. 10 shows an example of the operation of scanning the pixel P1 in the normal pixel region R1.
  • FIG. 11 illustrates an example of the operation of the imaging apparatus 1.
  • FIG. 11A illustrates the waveform of the horizontal synchronization signal XHS
  • FIG. 11B illustrates the (n ⁇ 1) th control line RSTL (n ⁇ 1).
  • the waveform of the control signal RST (n-1) is shown
  • (C) shows the waveform of the control signal TG (n-1) in the (n-1) th control line TGL (n-1)
  • (D) shows the waveform of the control signal RST (n-1).
  • the waveform of the control signal SL (n-1) in the (n-1) th control line SLL (n-1) is shown, and (E) shows the control signal RST (n) in the nth control line RSTL (n). (F) shows the waveform of the control signal TG (n) in the nth control line TGL (n), and (G) shows the control signal SL (n) in the nth control line SLL (n). (H) indicates a control signal RST (n + 1) in the (n + 1) th control line RSTL (n + 1).
  • (I) shows the waveform of the control signal TG (n + 1) in the (n + 1) th control line TGL (n + 1)
  • (J) shows the control signal in the (n + 1) th control line SLL (n + 1).
  • the waveform of SL (n + 1) is shown.
  • the imaging device 1 performs the accumulation start drive D1 in order from the top in the vertical direction with respect to the pixel P1 in the normal pixel region R1 during the period of timing t0 to t1.
  • the scanning unit 21 outputs the control signals RST (n ⁇ 1) and TG (n ⁇ 1) having pulse waveforms. (FIGS. 11B and 11C). Specifically, the scanning unit 21 changes the voltage of the control signal RST (n ⁇ 1) and the control signal TG (n ⁇ 1) from the low level to the high level at the timing t22, and the control signal RST (n (n) at the timing t23. -1) and the voltage of the control signal TG (n-1) are changed from a high level to a low level.
  • both the transistors 12 and 13 are turned on at the timing t22.
  • the voltage of the floating diffusion FD and the voltage of the cathode of the photodiode 11 are set to the power supply voltage VDD.
  • both the transistors 12 and 13 are turned off.
  • the photodiode 11 starts to accumulate electric charges according to the amount of received light. In this way, the accumulation period P10 starts in the pixel P1.
  • the scanning unit 21 generates control signals RST (n) and TG (n) having pulse waveforms (FIGS. 11E and 11F). Thereby, the pixel P1 to which the control signals RST (n) and TG (n) are supplied starts to accumulate electric charges according to the amount of received light at the timing t26.
  • the scanning unit 21 generates control signals RST (n + 1) and TG (n + 1) having pulse waveforms (FIGS. 11H and 11).
  • the pixel P1 to which the control signals RST (n + 1) and TG (n + 1) are supplied starts to accumulate charges according to the amount of received light at the timing t29.
  • the scanning unit 21 sequentially starts accumulation of electric charges in the pixel P1 by performing the accumulation start drive D1. In each pixel P1, charges are accumulated in the accumulation period P10 until the reading drive D2 is performed.
  • the scanning unit 21 performs the reading drive D2 in order from the top in the vertical direction with respect to the pixel P1 in the normal pixel region R1 in the period of timing t10 to t11.
  • the scanning unit 21 controls the control signals RST (n ⁇ 1), TG (n ⁇ 1), TG having a pulse waveform.
  • SL (n ⁇ 1) is generated (FIGS. 11B to 11D).
  • the pixel P1 supplied with the control signals RST (n ⁇ 1), TG (n ⁇ 1), and SL (n ⁇ 1) outputs a signal SIG as will be described later.
  • the pixel P1 outputs the reset voltage Vreset as the signal SIG in the P-phase period PP, and outputs the pixel voltage Vpix as the signal SIG in the D-phase period PD.
  • the reading unit 40 (reading units 40S and 40D) generates a digital code CODE by performing AD conversion based on the signal SIG.
  • the scanning unit 21 generates control signals RST (n), TG (n), and SL (n) having pulse waveforms (FIGS. 11E to 11G). )). Accordingly, the pixel P1 supplied with the control signals RST (n), TG (n), and SL (n) outputs the signal SIG, and the reading unit 40 performs digital conversion by performing AD conversion based on the signal SIG. A code CODE is generated.
  • the scanning unit 21 generates control signals RST (n + 1), TG (n + 1), and SL (n + 1) having pulse waveforms (FIGS. 11H to (J). )). Accordingly, the pixel P1 supplied with the control signals RST (n + 1), TG (n + 1), and SL (n + 1) outputs the signal SIG, and the reading unit 40 performs digital conversion by performing AD conversion based on the signal SIG.
  • a code CODE is generated.
  • the imaging device 1 sequentially performs AD conversion based on the signal SIG (reset voltage Vreset and pixel voltage Vpix) from the pixel P1 by performing the reading drive D2.
  • the imaging apparatus 1 repeats such accumulation start drive D1 and readout drive D2. Specifically, as shown in FIG. 10, the scanning unit 21 performs the accumulation start drive D1 in the period from the timing t2 to t3, and performs the read drive D2 in the period from the timing t12 to t13. In addition, the scanning unit 21 performs the accumulation start drive D1 during the period from the timing t4 to t5, and performs the readout drive D2 during the period from the timing t14 to t15.
  • FIG. 12 shows an example of the operation of the readout drive D2 in the pixel P1 of interest.
  • A shows the waveform of the horizontal synchronization signal XHS
  • B shows the waveform of the control signal RST
  • C Indicates the waveform of the control signal TG
  • D indicates the waveform of the control signal SL
  • E indicates the waveform of the reference signal REF
  • F indicates the waveform of the signal SIG
  • G indicates AD conversion.
  • the waveform of the signal CMP output from the comparator 45 of the unit ADC is shown
  • (H) shows the waveform of the clock signal CLK
  • I shows the count value CNT in the counter 46 of the AD conversion unit ADC.
  • a reference signal REF in FIG. 12E shows a waveform at the positive input terminal of the comparator 45
  • a signal SIG in FIG. 12F shows a waveform at the negative input terminal of the comparator 45.
  • the scanning unit 21 in a certain horizontal period (H), the scanning unit 21 first performs a reset operation on the pixel P1, and the AD conversion unit ADC resets the pixel P1 output in the subsequent P-phase period PP. AD conversion is performed based on the voltage Vreset. Then, the scanning unit 21 performs a charge transfer operation on the pixel P1, and the AD conversion unit ADC performs AD conversion based on the pixel voltage Vpix output from the pixel P1 in the D-phase period PD. This operation will be described in detail below.
  • the scanning unit 21 changes the voltage of the control signal SL from low level to high level at timing t42 (FIG. 12D). Accordingly, in the pixel P1, the transistor 15 is turned on, and the pixel P1 is electrically connected to the signal line SGL.
  • the scanning unit 21 changes the voltage of the control signal RST from the low level to the high level (FIG. 12B).
  • the transistor 13 is turned on, and the voltage of the floating diffusion FD is set to the power supply voltage VDD (reset operation).
  • the comparator 45 performs zero adjustment for electrically connecting the positive input terminal and the negative input terminal during the period of timing t43 to t45.
  • the scanning unit 21 changes the voltage of the control signal RST from a high level to a low level (FIG. 12B). Thereby, in the pixel P1, the transistor 13 is turned off. Then, after the timing t44, the pixel P1 outputs a voltage (reset voltage Vreset) corresponding to the voltage of the floating diffusion FD at this time (FIG. 12F).
  • the comparator 45 finishes the zero adjustment and electrically disconnects the positive input terminal and the negative input terminal. Then, at this timing t45, the reference signal generation unit 51 changes the voltage of the reference signal REF to the voltage V1 (FIG. 12E).
  • the reading unit 40 performs AD conversion based on the reset voltage Vreset. Specifically, first, at timing t46, the control unit 50 starts generating the clock signal CLK (FIG. 12 (H)). At the same time, the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V1 with a predetermined change degree (variation pattern) (FIG. 12E). In response to this, the counter 46 of the AD conversion unit ADC starts a count operation and sequentially changes the count value CNT (FIG. 12 (I)).
  • the comparator 45 of the AD conversion unit ADC changes the voltage of the signal CMP from a high level to a low level (FIG. 12G).
  • the counter 46 stops the counting operation (FIG. 12 (I)).
  • the control unit 50 stops generating the clock signal CLK with the end of the P-phase period PP (FIG. 12 (H)).
  • the reference signal generation unit 51 stops changing the voltage of the reference signal REF, and changes the voltage of the reference signal REF to the voltage V2 at the subsequent timing t49 (FIG. 12E). Accordingly, since the voltage of the reference signal REF exceeds the voltage of the signal SIG (reset voltage Vreset) (FIGS. 12E and 12F), the comparator 45 of the AD conversion unit ADC reduces the voltage of the signal CMP to a low level. From 1 to a high level (FIG. 12G).
  • the counter 46 of the AD conversion unit ADC inverts the polarity of the count value CNT based on the control signal CC (FIG. 12 (I)).
  • the scanning unit 21 changes the voltage of the control signal TG from the low level to the high level (FIG. 12C).
  • the transistor 12 is turned on, and as a result, the charge generated in the photodiode 11 is transferred to the floating diffusion FD (charge transfer operation).
  • the voltage of the signal SIG decreases (FIG. 12F).
  • the scanning unit 21 changes the voltage of the control signal TG from the high level to the low level (FIG. 12C). Thereby, in the pixel P1, the transistor 12 is turned off. Then, after the timing t52, the pixel P1 outputs a voltage (pixel voltage Vpix) corresponding to the voltage of the floating diffusion FD at this time (FIG. 12F).
  • the reading unit 40 performs AD conversion based on the pixel voltage Vpix. Specifically, first, at timing t53, the control unit 50 starts generating the clock signal CLK (FIG. 12 (H)). At the same time, the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V2 with a predetermined change degree (variation pattern) (FIG. 12E). In response to this, the counter 46 of the AD conversion unit ADC starts a count operation and sequentially changes the count value CNT (FIG. 12 (I)).
  • the voltage of the reference signal REF falls below the voltage of the signal SIG (pixel voltage Vpix) (FIGS. 12E and 12F).
  • the comparator 45 of the AD conversion unit ADC changes the voltage of the signal CMP from a high level to a low level (FIG. 12G).
  • the counter 46 stops the counting operation (FIG. 12 (I)).
  • the AD conversion unit ADC obtains the count value CNT corresponding to the difference between the pixel voltage Vpix and the reset voltage Vreset. Then, the AD conversion unit ADC outputs the count value CNT as a digital code CODE.
  • the control unit 50 stops generating the clock signal CLK with the end of the D-phase period PD ((H) in FIG. 12).
  • the reference signal generation unit 51 stops changing the voltage of the reference signal REF, and changes the voltage of the reference signal REF to the voltage V3 at the subsequent timing t56 (FIG. 12E). Accordingly, since the voltage of the reference signal REF exceeds the voltage of the signal SIG (pixel voltage Vpix) (FIGS. 12E and 12F), the comparator 45 of the AD conversion unit ADC reduces the voltage of the signal CMP to a low level. From 1 to a high level (FIG. 12G).
  • the scanning unit 21 changes the voltage of the control signal SL from a high level to a low level ((D) in FIG. 12). Thereby, in the pixel P1, the transistor 15 is turned off, and the pixel P1 is electrically disconnected from the signal line SGL.
  • the counter 46 of the AD conversion unit ADC resets the count value CNT to “0” based on the control signal CC (FIG. 12 (I)).
  • the imaging device 1 performs the counting operation based on the reset voltage Vreset in the P-phase period PP, and after reversing the polarity of the count value CNT, performs the counting operation based on the pixel voltage Vpix in the D-phase period PD. I did it. Thereby, the imaging device 1 can acquire the digital code CODE corresponding to the difference voltage between the pixel voltage Vpix and the reset voltage Vreset. Since the imaging apparatus 1 performs such correlated double sampling, noise components included in the pixel voltage Vpix can be removed, and as a result, the image quality of the captured image can be improved.
  • the reading unit 40 receives the digital code CODE output from the plurality of AD conversion units ADC via the bus wiring 100 (bus wirings 100S and 100N) as an image signal DATA0 (image signals DATA0S and DATA0N). ) To the signal processing unit 60. Next, this data transfer operation will be described in detail.
  • FIG. 13A schematically shows an example of the data transfer operation in the reading unit 40S
  • FIG. 13B schematically shows an example of the data transfer operation in the reading unit 40N.
  • a thick line indicates a bus wiring of a plurality of bits (13 bits in this example).
  • 13A and 13B for example, “0” in the AD conversion unit ADC indicates the 0th AD conversion unit ADC (0), and “1” indicates the first AD conversion unit ADC (1).
  • FIGS. 13A and 13B show timing charts of the data transfer operation shown in FIGS. 13A and 13B.
  • FIG. 14A shows the waveform of the horizontal synchronization signal XHS
  • FIG. 14B shows the even bits of the control signal SEL
  • C indicates odd bits of the control signal SEL.
  • “0” is the “0” -th bit (control) of the even bits (control signals SEL [0], SEL [2], SEL [4],...) Of the control signal SEL. Only signal SEL [0]) is active and the other bits are inactive.
  • FIG. 14A shows the waveform of the horizontal synchronization signal XHS
  • FIG. 14B shows the even bits of the control signal SEL
  • C indicates odd bits of the control signal SEL.
  • “0” is the “0” -th bit (control) of the even bits (control signals SEL [0], SEL [2], SEL [4],...) Of the control signal SEL. Only signal SEL [0]) is active and the other bits are inactive
  • “1” is the “1” -th bit among the odd bits (control signals SEL [1], SEL [3], SEL [5],...) Of the control signal SEL. Only the bit (control signal SEL [1]) is active and the other bits are inactive.
  • the even bits of the control signal SEL become active in the order of the control signal SEL [0], the control signal SEL [2], and the control signal SEL [4] as shown in FIG.
  • the digital code CODE of the 0th AD conversion unit ADC (0) is supplied to the bus wiring 100S, and then the second AD conversion unit ADC (2).
  • the digital code CODE is supplied to the bus wiring 100S, and then the digital code CODE of the fourth AD conversion unit ADC (4) is supplied to the bus wiring 100S.
  • the digital code CODE is transferred to the signal processing unit 60 as the image signal DATA0S sequentially from the left AD conversion unit ADC (transfer order F).
  • the odd bits of the control signal SEL become active in the order of the control signal SEL [1], the control signal SEL [3], and the control signal SEL [5] as shown in FIG.
  • the digital code CODE of the first AD conversion unit ADC (1) is first supplied to the bus wiring 100N, and then the third AD conversion unit ADC (3).
  • the digital code CODE is supplied to the bus line 100N, and then the digital code CODE of the fifth AD converter ADC (5) is supplied to the bus line 100N.
  • the digital code CODE is transferred to the signal processing unit 60 as the image signal DATA0N sequentially from the left AD conversion unit ADC (transfer order F).
  • FIG. 15 shows another example of the data transfer operation, where (A) shows the waveform of the horizontal synchronization signal XHS, (B) shows the even bits of the control signal SEL, and (C) shows the control signal. Indicates the odd bits of SEL.
  • the even bits of the control signal SEL become active in the order of the control signal SEL [4094], the control signal SEL [4092], and the control signal SEL [4090], as shown in FIG.
  • the digital code CODE of the 4094th AD conversion unit ADC (4094) is supplied to the bus wiring 100S, and then the digital code CODE of the 4092th AD conversion unit ADC (4092) is supplied.
  • the digital code CODE of the 4090th AD converter ADC (4090) is supplied to the bus line 100S.
  • the digital code CODE is transferred to the signal processing unit 60 as the image signal DATA0S in order from the right AD conversion unit ADC.
  • the odd bits of the control signal SEL become active in the order of the control signal SEL [4095], the control signal SEL [4093], and the control signal SEL [4091].
  • the digital code CODE of the 4095th AD conversion unit ADC (4095) is supplied to the bus wiring 100N, and then the digital code CODE of the 4093th AD conversion unit ADC (4093) is supplied.
  • the digital code CODE of the 4091th AD converter ADC (4091) is supplied to the bus line 100N.
  • the digital code CODE is transferred to the signal processing unit 60 as the image signal DATA0N in order from the right AD conversion unit ADC.
  • the imaging apparatus 1 the order in which the digital code CODE is transferred from the plurality of AD conversion units ADC to the signal processing unit 60 can be changed. Thereby, in the imaging device 1, a captured image with the left and right reversed is easily obtained.
  • the period from timing t11 to t12 is a so-called blanking period P20 (vertical blanking period), and the imaging apparatus 1 does not perform the reading drive D2. That is, during this period, the signal line SGL does not transmit the reset voltage Vreset and the pixel voltage Vpix related to the pixel P1 in the normal pixel region R1.
  • the imaging apparatus 1 performs self-diagnosis using this blanking period P20.
  • the imaging apparatus 1 can perform one of the self-diagnosis described below in one blanking period P20 and can perform different self-diagnosis for each blanking period P20.
  • the imaging apparatus 1 may perform a plurality of self-diagnosis among self-diagnosis described below in one blanking period P20.
  • the self-diagnosis A1 mainly diagnoses whether the signal line SGL can normally transmit the signal SIG along with the basic operation of the AD converter ADC. Specifically, the voltage generation units 30A and 30B of the signal generation unit 22 apply the control signal VMA to the control line VMAL and apply the control signal VMB to the control line VMBL. Then, the dummy pixel P3 outputs a signal SIG corresponding to the voltages of the control signals VMA and VMB to the signal line SGL in the blanking period P20.
  • the reading unit 40 generates a digital code CODE by performing AD conversion based on the signal SIG. Then, the diagnosis unit 61 performs diagnosis processing based on the digital code CODE. This operation will be described in detail below.
  • FIG. 16 shows an example of self-diagnosis A1.
  • the voltage generation unit 30A of the signal generation unit 22 generates the control signal VMA by generating the voltage V10 in the P-phase period PP and generating the voltage V11 lower than the voltage V10 in the D-phase period PD.
  • the voltage generator 30B generates the control signal VMB by generating the voltage V10 in the P-phase period PP and generating the voltage V12 lower than the voltage V11 in the D-phase period PD.
  • the voltage generators 30A and 30B generate different voltages in the D-phase period PD.
  • the dummy pixel P3A in the dummy pixel region R3 outputs a signal SIG corresponding to the voltage of the control signal VMA to the even-numbered signal line SGL (for example, the signal line SGL (0)) in the P-phase period PP and the D-phase period PD.
  • the dummy pixel P3B outputs a signal SIG corresponding to the voltage of the control signal VMB to the odd-numbered signal line SGL (for example, the signal line SGL (1)). Accordingly, in the D-phase period PD, the voltage of the even-numbered signal line SGL (for example, the signal line SGL (0)) and the odd-numbered signal line SGL (for example, the signal line SGL (1)) adjacent to the signal line SGL.
  • the voltages are different from each other.
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) by performing AD conversion based on the signal SIG, and the diagnosis unit 61 of the signal processing unit 60 uses the image. Diagnosis processing is performed based on the signal DATA0, and a diagnosis result RES is output.
  • dummy pixel P3 (dummy pixel P3A) connected to the 0th signal line SGL (0) and the dummy pixel P3 (dummy pixel P3B) connected to the first signal line SGL (1).
  • the self-diagnosis A1 will be described.
  • FIG. 17 shows an example of the operation of the self-diagnosis A1, where (A) shows the waveform of the horizontal synchronizing signal XHS, (B) shows the waveform of the control signal SL, and (C) shows the control signal VMA. (D) shows the waveform of the control signal VMB, (E) shows the waveform of the reference signal REF, and (F) shows the waveform of the signal SIG (signal SIG (0)) in the signal line SGL (0). (G) shows the waveform of the signal SIG (signal SIG (1)) in the first signal line SGL (1), (H) shows the waveform of the clock signal CLK, and (I) shows the 0th signal line.
  • the count value CNT (count value CNT (0)) in the counter 46 of the AD conversion unit ADC (0) is shown
  • (J) is the count value CNT (count value CNT in the counter 46 of the first AD conversion unit ADC (1). (1)).
  • FIGS. 17C and 17D the waveform of each signal is shown with the same voltage axis.
  • FIGS. 17E to 17G the waveform of each signal is shown with the same voltage axis. Show.
  • the scanning unit 21 changes the voltage of the control signal SL from low level to high level at timing t62 (FIG. 17B).
  • the transistor 15 is turned on, the dummy pixel P3A is electrically connected to the signal line SGL (0), and the dummy pixel P3B is electrically connected to the signal line SGL (1).
  • the dummy pixel P3A outputs a voltage corresponding to the voltage (voltage V10) of the control signal VMA as the signal SIG (0) (FIGS. 17C and 17F)
  • the dummy pixel P3B outputs a voltage corresponding to the voltage (voltage V10) of the control signal VMB as a signal SIG (1) (FIGS. 17D and 17G).
  • the comparator 45 performs zero adjustment for electrically connecting the positive input terminal and the negative input terminal during the period of the timing t63 to t64.
  • the comparator 45 finishes the zero adjustment and electrically disconnects the positive input terminal and the negative input terminal. Then, at the timing t64, the reference signal generation unit 51 changes the voltage of the reference signal REF to the voltage V1.
  • the reading unit 40 performs AD conversion. Specifically, first, at timing t65, the control unit 50 starts generating the clock signal CLK (FIG. 17 (H)). At the same time, the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V1 with a predetermined degree of change (FIG. 17E). The counter 46 of the AD conversion unit ADC (0) starts the count operation and sequentially changes the count value CNT (0) (FIG. 17 (I)). Similarly, the counter 46 of the AD conversion unit ADC (1) Then, the count operation is started, and the count value CNT (1) is sequentially changed (FIG. 17J).
  • the control unit 50 stops generating the clock signal CLK with the end of the P-phase period PP (FIG. 17 (H)).
  • the reference signal generation unit 51 stops changing the voltage of the reference signal REF, and changes the voltage of the reference signal REF to the voltage V2 at the subsequent timing t68 (FIG. 17E).
  • the counter 46 of the AD conversion unit ADC (0) inverts the polarity of the count value CNT (0) based on the control signal CC (FIG. 17 (I)), and similarly AD conversion is performed.
  • the counter 46 of the unit ADC (1) inverts the polarity of the count value CNT (1) based on the control signal CC (FIG. 17 (J)).
  • the voltage generation unit 30A of the signal generation unit 22 changes the voltage of the control signal VMA to the voltage V11 (FIG. 17C), and the voltage generation unit 30B sets the voltage of the control signal VMB to the voltage. The voltage is changed to V12 (FIG. 17D). In response to this, the voltages of the signals SIG (0) and SIG (1) decrease (FIGS. 17F and 17G).
  • the reading unit 40 performs AD conversion. Specifically, first, at timing t71, the control unit 50 starts generating the clock signal CLK (FIG. 17 (H)). At the same time, the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V2 with a predetermined degree of change (FIG. 17E). In response to this, the counter 46 of the AD conversion unit ADC (0) starts the count operation and sequentially changes the count value CNT (0) (FIG. 17 (I)). Similarly, the AD conversion unit ADC (1 The counter 46 starts counting operation and sequentially changes the count value CNT (1) (FIG. 17J).
  • the counter 46 of the AD conversion unit ADC (0) stops the count operation. (FIG. 17I). Then, the AD conversion unit ADC (0) outputs the count value CNT (0) as a digital code CODE.
  • the counter 46 of the AD conversion unit ADC (1) stops the count operation. (FIG. 17J). Then, the AD conversion unit ADC (1) outputs the count value CNT (1) as a digital code CODE.
  • the control unit 50 stops generating the clock signal CLK as the D-phase period PD ends (FIG. 17 (H)).
  • the reference signal generation unit 51 stops changing the voltage of the reference signal REF, and changes the voltage of the reference signal REF to the voltage V3 at the subsequent timing t75 (FIG. 17E).
  • the scanning unit 21 changes the voltage of the control signal SL from a high level to a low level (FIG. 17B).
  • the transistor 15 is turned off, the dummy pixel P3A is electrically disconnected from the signal line SGL (0), and the dummy pixel P3B is electrically disconnected from the signal line SGL (1).
  • the counter 46 of the AD conversion unit ADC (0) resets the count value CNT (0) to “0” based on the control signal CC (FIG. 17 (I)).
  • the counter 46 of the conversion unit ADC (1) resets the count value CNT (1) to “0” based on the control signal CC (FIG. 17 (J)).
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) including a digital code CODE generated by AD conversion, and the diagnosis unit 61 of the signal processing unit 60 outputs the image signal DATA0.
  • the diagnosis process is performed based on the above.
  • the diagnosis unit 61 can diagnose, for example, whether the signal line SGL in the pixel array 10 is disconnected based on the digital code CODE. Specifically, for example, the diagnosis unit 61 confirms whether or not the value of the generated digital code CODE is within a predetermined range according to the voltages V11 and V12 having different fixed voltage values. It is possible to diagnose whether or not the signal line SGL is disconnected. In particular, as shown in FIG. 9, when the upper substrate 201 on which the pixel array 10 is formed and the lower substrate 202 on which the reading unit 40 is formed are connected by the via 203, the diagnosis unit 61 is configured to use a digital code. Based on the CODE, for example, it is possible to diagnose whether there is a connection failure due to the via 203.
  • the diagnosis unit 61 can diagnose, for example, whether adjacent signal lines SGL are short-circuited based on the digital code CODE.
  • the signal generator 22 sets the voltages of the control signals VMA and VMB to different voltages in the D-phase period PD, the voltage of the even-numbered signal line SGL (for example, the signal line SGL (0))
  • the voltages of odd-numbered signal lines SGL adjacent to the signal line SGL are different from each other. Therefore, for example, when these signal lines SGL are short-circuited, the digital code CODE is the same.
  • the diagnosis unit 61 can diagnose whether the adjacent signal line SGL is short-circuited based on the digital code CODE.
  • the diagnosis unit 61 can diagnose whether, for example, the signal line SGL is short-circuited with another wiring such as a power supply line or a ground line based on the digital code CODE. That is, when such a short circuit occurs, the voltage of the signal line SGL is fixed to the same voltage as a predetermined voltage in the shorted wiring (power supply line or the like). It becomes a value according to a predetermined voltage.
  • the diagnosis unit 61 can diagnose whether the signal line SGL is short-circuited with other wiring based on the digital code CODE.
  • diagnosis unit 61 can diagnose whether the current source 44 is connected to the signal line SGL and whether the current source 44 is short-circuited with other wiring based on the digital code CODE.
  • the diagnosis unit 61 can diagnose the dynamic range of the imaging apparatus 1 by appropriately setting the voltages V11 and V12, for example.
  • the voltage V12 can be set to a voltage equivalent to highlight.
  • the diagnosis unit 61 can diagnose the characteristics of the AD conversion unit ADC based on the digital code CODE. Specifically, for example, the diagnosis unit 61 can diagnose whether AD conversion can be performed in the P-phase period PP. That is, since the P-phase period PP has a shorter time length than the D-phase period PD, the operation margin is small. Therefore, for example, the diagnosis unit 61 diagnoses the operation margin in the P-phase period PP by checking the count value CNT (0) after the end of the P-phase period PP when the voltage V10 is set to various voltages. be able to.
  • the imaging device 1 changes the conversion gain in the AD conversion unit ADC by changing the change degree (variation pattern) of the voltage of the reference signal REF in order to capture a dark subject and a bright subject.
  • the reference signal generation unit 51 diagnoses whether or not the change degree of the voltage of the reference signal REF can be changed. Specifically, the reference signal generation unit 51 changes the voltage change degree of the reference signal REF in the P-phase period PP and the D-phase period PD in the blanking period P20.
  • the signal generator 22 generates the same control signals VMA and VMB.
  • the dummy pixel P3 outputs a signal SIG corresponding to the voltages of the control signals VMA and VMB to the signal line SGL in the blanking period P20.
  • the reading unit 40 generates a digital code CODE by performing AD conversion based on the signal SIG using the reference signal REF whose degree of change is changed.
  • the diagnosis unit 61 performs a diagnosis process based on the digital code CODE. This operation will be described in detail below.
  • FIG. 18 shows an example of the operation of the self-diagnosis A2, where (A) shows the waveform of the horizontal synchronization signal XHS, (B) shows the waveform of the control signal SL, and (C) shows the control signal VMA. (D) shows the waveform of the reference signal REF, (E) shows the waveform of the signal SIG (signal SIG (0)) in the signal line SGL (0), and (F) shows the waveform of the clock signal CLK. (G) indicates the count value CNT (count value CNT (0)) in the counter 46 of the 0th AD converter (0).
  • the reference signal generation unit 51 generates the reference signal REF having a smaller voltage change degree than in the case of the self-diagnosis A1.
  • the reference signal REF in the self-diagnosis A1 is indicated by a broken line.
  • the scanning unit 21 changes the voltage of the control signal SL from low level to high level at timing t62 (FIG. 18B). Thereby, after this timing t62, the dummy pixel P3A outputs a voltage corresponding to the voltage (voltage V10) of the control signal VMA as the signal SIG (0) (FIGS. 18C and 18E).
  • the comparator 45 performs zero adjustment for electrically connecting the positive input terminal and the negative input terminal during the period of timing t63 to t64. Then, at timing t64, the reference signal generation unit 51 changes the voltage of the reference signal REF to the voltage V4 (FIG. 18D).
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V4 with a predetermined change degree (FIG. 18D).
  • the counter 46 of the AD conversion unit ADC (0) starts the count operation at the timing t65 and stops the count operation at the timing t66 (FIG. 18 (G)).
  • the reference signal generation unit 51 stops the change in the voltage of the reference signal REF, and at the subsequent timing t68, changes the voltage of the reference signal REF to the voltage V5 (FIG. 18D). Then, at timing t69, the counter 46 of the AD conversion unit ADC (0) inverts the polarity of the count value CNT (0) based on the control signal CC ((G) in FIG. 18).
  • the voltage generation unit 30A of the signal generation unit 22 changes the voltage of the control signal VMA to the voltage V13 (FIG. 18C). In response to this, the voltage of the signal SIG (0) decreases (FIG. 18E).
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V5 with a predetermined change degree (FIG. 18D).
  • the counter 46 of the AD conversion unit ADC (0) starts the count operation at the timing t71 and stops the count operation at the timing t72 ((G) in FIG. 18). Then, the AD conversion unit ADC (0) outputs the count value CNT (0) as a digital code CODE.
  • the reference signal generation unit 51 stops the change in the voltage of the reference signal REF, and at the subsequent timing t75, changes the voltage of the reference signal REF to the voltage V6 (FIG. 18D).
  • the scanning unit 21 changes the voltage of the control signal SL from the high level to the low level (FIG. 18B).
  • the counter 46 of the AD conversion unit ADC (0) resets the count value CNT (0) to “0” based on the control signal CC (FIG. 18 (G)).
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) including a digital code CODE generated by AD conversion, and the diagnosis unit 61 of the signal processing unit 60 outputs the image signal DATA0.
  • the diagnosis process is performed based on the above.
  • the diagnosis unit 61 can diagnose, for example, whether the reference signal generation unit 51 can change the degree of inclination of the reference signal REF based on the digital code CODE. That is, in the imaging apparatus 1, for example, the inclination degree of the reference signal REF is changed so that a bright subject or a dark subject can be captured. Specifically, when imaging a dark subject, the imaging apparatus 1 increases the conversion gain in the AD conversion unit ADC by reducing the inclination degree of the reference signal REF. For example, the conversion gain when capturing a dark subject can be 30 [dB] higher than the conversion gain when capturing a bright subject. For example, the diagnosis unit 61 diagnoses whether the reference signal generation unit 51 can change the inclination degree of the reference signal REF based on the digital code CODE generated when the inclination degree of the reference signal REF is changed. be able to.
  • the diagnosis unit 61 confirms the count value CNT (0) after the end of the P-phase period PP when, for example, the inclination degree of the reference signal REF is set to various values.
  • the operation margin in the P-phase period PP can be diagnosed.
  • the imaging device 1 adjusts the voltage offset amount OFS of the reference signal REF in the D-phase period PD in order to subtract the dark current contribution of the photodiode 11.
  • the reference signal generation unit 51 diagnoses whether or not the voltage of the reference signal REF in the D-phase period PD can be changed. Specifically, the reference signal generation unit 51 changes the voltage offset amount OFS of the reference signal REF in the D-phase period PD in the blanking period P20.
  • the signal generator 22 generates the same control signals VMA and VMB.
  • the dummy pixel P3 outputs a signal SIG corresponding to the voltages of the control signals VMA and VMB to the signal line SGL in the blanking period P20.
  • the reading unit 40 generates a digital code CODE by performing AD conversion based on the signal SIG using the reference signal REF whose degree of change is changed.
  • the diagnosis unit 61 performs a diagnosis process based on the digital code CODE. This operation will be described in detail below.
  • FIG. 19 shows an operation example of the self-diagnosis A3, where (A) shows the waveform of the horizontal synchronization signal XHS, (B) shows the waveform of the control signal SL, and (C) shows the control signal VMA. (D) shows the waveform of the reference signal REF, (E) shows the waveform of the signal SIG (signal SIG (0)) in the signal line SGL (0), and (F) shows the waveform of the clock signal CLK. (G) indicates the count value CNT (count value CNT (0)) in the counter 46 of the 0th AD converter ADC (0).
  • the reference signal generator 51 lowers the voltage level of the reference signal REF in the D-phase period PD as compared with the case of the self-diagnosis A1.
  • the reference signal REF in the self-diagnosis A1 is indicated by a broken line.
  • the scanning unit 21 changes the voltage of the control signal SL from the low level to the high level at the timing t62 (FIG. 19B). Thereby, after this timing t62, the dummy pixel P3A outputs a voltage corresponding to the voltage (voltage V10) of the control signal VMA as the signal SIG (0) (FIGS. 19C and 19E).
  • the comparator 45 performs zero adjustment for electrically connecting the positive input terminal and the negative input terminal during the period of timing t63 to t64. Then, at timing t64, the reference signal generation unit 51 changes the voltage of the reference signal REF to the voltage V4 (FIG. 18D).
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V1 with a predetermined degree of change (FIG. 19D).
  • the counter 46 of the AD conversion unit ADC (0) starts the count operation at timing t65 and stops the count operation at timing t66 (FIG. 19 (G)).
  • the reference signal generation unit 51 stops the change in the voltage of the reference signal REF, and at the subsequent timing t68, changes the voltage of the reference signal REF to the voltage V7 (FIG. 19D). Then, at timing t69, the counter 46 of the AD conversion unit ADC (0) inverts the polarity of the count value CNT (0) based on the control signal CC (FIG. 19 (G)).
  • the voltage generation unit 30A of the signal generation unit 22 changes the voltage of the control signal VMA to the voltage V14 (FIG. 19C). In response to this, the voltage of the signal SIG (0) decreases (FIG. 19E).
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V7 with a predetermined change degree (FIG. 19D).
  • the counter 46 of the AD conversion unit ADC (0) starts the count operation at the timing t71 and stops the count operation at the timing t72 (FIG. 19 (G)). Then, the AD conversion unit ADC (0) outputs the count value CNT (0) as a digital code CODE.
  • the reference signal generating unit 51 stops changing the voltage of the reference signal REF, and at the subsequent timing t75, changes the voltage of the reference signal REF to the voltage V3 (FIG. 19D).
  • the scanning unit 21 changes the voltage of the control signal SL from a high level to a low level (FIG. 19B).
  • the counter 46 of the AD conversion unit ADC (0) resets the count value CNT (0) to “0” based on the control signal CC (FIG. 19 (G)).
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) including a digital code CODE generated by AD conversion, and the diagnosis unit 61 of the signal processing unit 60 outputs the image signal DATA0.
  • the diagnosis process is performed based on the above.
  • the diagnosis unit 61 can diagnose, for example, whether the reference signal generation unit 51 can change the voltage of the reference signal REF in the D-phase period PD based on the digital code CODE. That is, in the imaging device 1, in order to subtract the contribution of the dark current of the photodiode 11, the voltage offset amount OFS of the reference signal REF in the D-phase period PD is adjusted. Specifically, the imaging device 1 increases the voltage offset amount OFS when the dark current is large. In the diagnosis unit 61, for example, based on the digital code CODE acquired when the voltage of the reference signal REF in the D phase period PD is changed, the reference signal generation unit 51 changes the voltage of the reference signal REF in the D phase period PD. You can diagnose whether you can.
  • the imaging apparatus 1 uses the dummy pixel P4 to set the voltage of the signal SIG so that the voltage of the signal SIG does not become too low in a predetermined period before the P-phase period PP. Restrict. This operation will be described below.
  • FIG. 20 shows an example of the operation of the readout drive D2 in the pixel P1 of interest.
  • A shows the waveform of the horizontal synchronization signal XHS
  • B shows the waveform of the control signal SUN
  • C Shows the waveform of the control signal RST
  • D shows the waveform of the control signal TG
  • E shows the waveform of the control signal SL
  • F shows the reference signal REF (reference signals REF1, REF2, REF3).
  • a waveform is shown
  • (G) shows the waveform of signal SIG (signal SIG1, SIG2, SIG3).
  • the waveform of each signal is shown by the same voltage axis.
  • the reference signal REF1 and the signal SIG1 are the reference signal REF and the signal SIG when a subject with normal brightness is imaged. That is, the reference signal REF1 and the signal SIG1 are the same as those shown in FIG.
  • the reference signal REF2 and the signal SIG2 are the reference signal REF and the signal SIG when a very bright subject is imaged, and are signals when the dummy pixel P4 does not function.
  • the reference signal REF3 and the signal SIG3 are a reference signal REF and a signal SIG signal when a very bright subject is imaged, and are signals when the dummy pixel P4 functions.
  • the AD conversion unit ADC When a subject with normal brightness is imaged, the AD conversion unit ADC performs AD conversion in the P-phase period PP based on the signal SIG1 using the reference signal REF1 as in the case of FIG. In the D phase period PD, AD conversion is performed. Then, the AD conversion unit ADC outputs the count value CNT as the digital code CODE as in the case of FIG.
  • the AD conversion unit ADC performs AD conversion in the P-phase period PP and also performs AD conversion in the D-phase period PD.
  • the AD conversion unit ADC outputs a value close to “0” as the digital code CODE. That is, although the subject is very bright, the digital code CODE becomes a value close to “0”.
  • the imaging device 1 uses the dummy pixel P4 to limit the voltage of the signal SIG in a predetermined period before the P-phase period PP.
  • the signal generator 23 sets the control signal SUN to a high voltage during the period from timing t43 to t45 (FIG. 20B).
  • the dummy pixel P4 outputs a voltage corresponding to the control signal SUN to the signal line SGL during the period from timing t43 to t45. Therefore, the voltage drop of the signal SIG3 is suppressed during the period from the timing t43 to t45.
  • the voltage of the signal SIG3 is limited to a voltage corresponding to the voltage of the control signal SUN.
  • the reference signal REF3 is also higher than the reference signal REF2. Then, at timing t45, when the voltage of the control signal SUN decreases (FIG. 20B), the voltage of the signal SIG3 decreases to the same level as the voltage of the signal SIG2. The voltage of the signal SIG3 is always lower than the reference signal REF2 in the P-phase period PP. Therefore, the counter 46 of the AD conversion unit ADC continues to count during the P-phase period PP, and reaches a predetermined count value (full count value) at the timing t48 when the generation of the clock signal CLK is stopped.
  • the imaging apparatus 1 avoids the digital code CODE from becoming a value close to “0” even though the subject is very bright.
  • the imaging device 1 uses the dummy pixel P4 to prevent the signal SIG from being too low in a predetermined period before the P-phase period PP. Limit the voltage.
  • the signal generator 22 sets the control signals VMA and VMB to a low voltage.
  • the signal generator 22 generates the same control signals VMA and VMB.
  • the dummy pixel P3 outputs a signal SIG corresponding to the voltages of the control signals VMA and VMB to the signal line SGL in the blanking period P20.
  • the reading unit 40 generates a digital code CODE by performing AD conversion based on the signal SIG.
  • the diagnosis unit 61 performs a diagnosis process based on the digital code CODE. This operation will be described in detail below.
  • FIG. 21 shows an example of the operation of the self-diagnosis A4.
  • A shows the waveform of the horizontal synchronization signal XHS
  • B shows the waveform of the control signal SL
  • C shows the control signal SUN.
  • D shows the waveform of the control signal VMA
  • E shows the waveform of the reference signal REF
  • F shows the waveform of the signal SIG (signal SIG (0)) in the signal line SGL (0).
  • G shows the waveform of the clock signal CLK.
  • the scanning unit 21 changes the voltage of the control signal SL from low level to high level at timing t62 (FIG. 21B).
  • the signal generation unit 22 changes the voltage of the control signal VMA to the low voltage V15 (FIG. 21D).
  • the signal SIG (0) also decreases (FIG. 21 (F)).
  • the signal generation unit 23 changes the voltage of the control signal SUN to a high voltage. Thereby, a decrease in the signal SIG (0) is suppressed (FIG. 21 (F)).
  • the comparator 45 performs zero adjustment for electrically connecting the positive input terminal and the negative input terminal during the period of the timing t63 to t64.
  • the signal generation unit 23 changes the voltage of the control signal SUN to a low voltage (FIG. 21C). In response to this, the signal SIG (0) decreases (FIG. 21 (F)).
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V1 with a predetermined change degree at timing t65 (FIG. 21E).
  • the counter 46 of the AD conversion unit ADC (0) starts a count operation at timing t65.
  • the counter 46 of the AD conversion unit ADC (0) continues counting in the P-phase period PP, and the clock signal At a timing t67 when generation of CLK is stopped, a predetermined count value (count value CNTF1) is reached. Accordingly, the counter 46 determines that the count operation should be continued in the next D-phase period PD regardless of the signal CMP output from the comparator 45.
  • the reference signal generation unit 51 stops changing the voltage of the reference signal REF, and at the subsequent timing t68, changes the voltage of the reference signal REF to the voltage V2 (FIG. 21E). Thereafter, although not shown, the counter 46 of the AD converter ADC (0) inverts the polarity of the count value CNT (0) based on the control signal CC.
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V2 at a predetermined change degree at timing t71 (FIG. 21E).
  • the counter 46 of the AD conversion unit ADC (0) starts a count operation at timing t71.
  • the counter 46 continues counting in the D-phase period PD regardless of the signal CMP output from the comparator 45. Thereby, the counter 46 becomes a predetermined count value (count value CNTF2) at the timing t74 when the generation of the clock signal CLK is stopped.
  • the AD conversion unit ADC (0) outputs the count value CNT (0) as a digital code CODE.
  • the reference signal generating unit 51 stops changing the voltage of the reference signal REF, and at the subsequent timing t75, changes the voltage of the reference signal REF to the voltage V3 (FIG. 21E).
  • the scanning unit 21 changes the voltage of the control signal SL from a high level to a low level (FIG. 21B). Thereafter, although not shown, the counter 46 resets the count value CNT (0) to “0” based on the control signal CC.
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) including a digital code CODE generated by AD conversion, and the diagnosis unit 61 of the signal processing unit 60 outputs the image signal DATA0.
  • the diagnosis process is performed based on the above.
  • the diagnosis unit 61 diagnoses whether or not the function of limiting the voltage of the signal SIG works based on the digital code CODE. Specifically, the diagnosis unit 61 diagnoses that the function of limiting the voltage of the signal SIG works by confirming that the digital code CODE is a predetermined count value (count value CNTF2), for example. be able to.
  • the diagnosis unit 61 can confirm the operation of the counter 46 based on the digital code CODE. Specifically, in this operation, using the fact that the counter 46 keeps counting, the diagnosis unit 61 counts the count value CNT (0) after the end of the P-phase period PP and the count after the end of the D-phase period PD. By checking the value CNT (0), it is diagnosed whether the counter 46 can perform the count operation normally. Further, the diagnosis unit 61 confirms the count value CNT (0) after the end of the P-phase period PP and the count value CNT (0) before the start of the D-phase period PD, so that the counter 46 changes the polarity of the count value CNT. It can be confirmed whether or not to reverse. Further, the diagnosis unit 61 can confirm whether the counter 46 can reset the count value CNT to “0” after the D-phase period PD based on the digital code CODE.
  • the two voltage generation units 30 ⁇ / b> A and 30 ⁇ / b> B each have a temperature sensor 33. Thereby, the imaging device 1 can detect temperature.
  • the temperature sensor 33 diagnoses whether the voltage Vtemp according to temperature can be produced
  • the signal generator 22 outputs the voltage Vtemp output from the temperature sensor 33 as the control signals VMA and VMB during the D-phase period PD within the blanking period P20. In this example, the signal generator 22 generates the same control signals VMA and VMB.
  • the dummy pixel P3 outputs a signal SIG corresponding to the voltages of the control signals VMA and VMB to the signal line SGL in the blanking period P20.
  • the reading unit 40 generates a digital code CODE by performing AD conversion based on the signal SIG.
  • the diagnosis unit 61 performs a diagnosis process based on the digital code CODE. This operation will be described in detail below.
  • FIG. 22 shows an operation example of the self-diagnosis A5.
  • A shows the waveform of the horizontal synchronization signal XHS
  • B shows the waveform of the control signal SL
  • C shows the control signal VMA.
  • D shows the waveform of the control signal VMB
  • E shows the waveform of the reference signal REF
  • F shows the waveform of the signal SIG (signal SIG (0)) in the signal line SGL (0).
  • G) shows the waveform of the signal SIG (signal SIG (1)) on the signal line SGL (1)
  • H shows the waveform of the clock signal CLK
  • I shows the 0th AD converter.
  • the count value CNT count value CNT (0)) in the counter 46 of the ADC (0) is shown
  • (J) is the count value CNT (count value CNT (1) in the counter 46 of the first AD conversion unit ADC (1). ).
  • the scanning unit 21 changes the voltage of the control signal SL from the low level to the high level at the timing t62 (FIG. 22B).
  • the dummy pixel P3A outputs a voltage corresponding to the voltage (voltage V10) of the control signal VMA as the signal SIG (0) (FIGS. 22C and 22F)
  • the dummy pixel P3B outputs a voltage corresponding to the voltage (voltage V10) of the control signal VMB as a signal SIG (1) (FIGS. 22D and 22G).
  • the comparator 45 performs zero adjustment for electrically connecting the positive input terminal and the negative input terminal during the period of timing t63 to t64. Then, at timing t64, the reference signal generation unit 51 changes the voltage of the reference signal REF to the voltage V1 (FIG. 22E).
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V1 with a predetermined degree of change (FIG. 22E).
  • the counter 46 of the AD converter ADC (0) starts the count operation at timing t65 and stops the count operation at timing t66 (FIG. 22 (I)).
  • the counter 46 of the AD conversion unit ADC (1) starts the count operation at timing t65 and stops the count operation at timing t66 (FIG. 22 (J)).
  • the reference signal generation unit 51 stops the change in the voltage of the reference signal REF, and at the subsequent timing t68, changes the voltage of the reference signal REF to the voltage V2 (FIG. 22 (E)).
  • the counter 46 of the AD conversion unit ADC (0) inverts the polarity of the count value CNT (0) based on the control signal CC (FIG. 22 (I)), and similarly AD conversion is performed.
  • the counter 46 of the unit ADC (1) inverts the polarity of the count value CNT (1) based on the control signal CC (FIG. 22 (J)).
  • the voltage generation unit 30A of the signal generation unit 22 outputs the voltage Vtemp output from the temperature sensor 33 of the voltage generation unit 30A as the control signal VMA (FIG. 22 (C)).
  • the voltage generator 30B outputs the voltage Vtemp output from the temperature sensor 33 of the voltage generator 30B as the control signal VMB (FIG. 22D).
  • the voltages of the signals SIG (0) and SIG (1) decrease (FIGS. 22F and 22G).
  • the reading unit 40 performs AD conversion.
  • the reference signal generation unit 51 of the control unit 50 starts to decrease the voltage of the reference signal REF from the voltage V2 with a predetermined degree of change (FIG. 22 (E)).
  • the counter 46 of the AD conversion unit ADC (0) starts the count operation at the timing t71 and stops the count operation at the timing t72 (FIG. 22 (I)). Then, the AD conversion unit ADC (0) outputs the count value CNT (0) as a digital code CODE.
  • the counter 46 of the AD conversion unit ADC (1) starts the count operation at the timing t71 and stops the count operation at the timing t72 ((J) in FIG. 22). Then, the AD conversion unit ADC (1) outputs the count value CNT (1) as a digital code CODE.
  • the reference signal generation unit 51 stops the change in the voltage of the reference signal REF, and then changes the voltage of the reference signal REF to the voltage V3 at timing t75 (FIG. 22 (E)).
  • the scanning unit 21 changes the voltage of the control signal SL from a high level to a low level (FIG. 22B).
  • the counter 46 of the AD conversion unit ADC (0) resets the count value CNT (0) to “0” based on the control signal CC (FIG. 22 (I)).
  • the counter 46 of the converter ADC (1) resets the count value CNT (1) to “0” based on the control signal CC (FIG. 22 (J)).
  • the reading unit 40 (reading units 40S and 40N) generates an image signal DATA0 (image signals DATA0S and DATA0N) including a digital code CODE generated by AD conversion, and the diagnosis unit 61 of the signal processing unit 60 outputs the image signal DATA0.
  • the diagnosis process is performed based on the above.
  • the diagnosis unit 61 can diagnose whether, for example, the temperature sensor 33 of the voltage generation units 30A and 30B can generate the voltage Vtemp according to the temperature, based on the digital code CODE. Specifically, for example, the diagnosis unit 61 confirms whether or not the value of the generated digital code CODE is within a predetermined range, so that the temperature sensor 33 generates the voltage Vtemp corresponding to the temperature. Can be diagnosed. Moreover, in the imaging device 1, since the voltage generation units 30A and 30B have the temperature sensor 33 having the same circuit configuration, the voltage Vtemp generated by the temperature sensor 33 of the voltage generation unit 30A and the voltage generation unit 30B The voltages Vtemp generated by the temperature sensor 33 are substantially equal to each other.
  • the voltage of the even-numbered signal line SGL (for example, signal line SGL (0)) and the voltage of the odd-numbered signal line SGL (for example, signal line SGL (1)) adjacent to the signal line SGL are substantially equal to each other.
  • the diagnosis unit 61 determines whether or not there is a malfunction in the temperature sensor 33 based on the digital code CODE. Can be diagnosed.
  • Self-diagnosis A6 In the self-diagnosis A6, it is mainly determined whether or not the digital code CODE output from the plurality of AD conversion units ADC can be supplied to the signal processing unit 60 via the bus wiring 100 (bus wirings 100S and 100N). Diagnose. Specifically, a latch (not shown) provided in the output unit of the plurality of AD conversion units ADC outputs a digital code CODE having a predetermined bit pattern based on the control signal CC in the blanking period P20. Then, the control unit 50 generates a control signal SEL, and the plurality of switch units SW of the reading unit 40S outputs the digital code CODE output from the AD conversion unit ADC of the reading unit 40S based on the control signal SEL as an image signal.
  • a latch not shown
  • the control unit 50 generates a control signal SEL
  • the plurality of switch units SW of the reading unit 40S outputs the digital code CODE output from the AD conversion unit ADC of the reading unit 40S based on the control signal SEL as an image
  • the data is sequentially transferred to the signal processing unit 60 as DATA0S, and the plurality of switch units SW of the reading unit 40N outputs the digital code CODE output from the AD conversion unit ADC of the reading unit 40N as the image signal DATA0N based on the control signal SEL.
  • the data is sequentially transferred to the processing unit 60.
  • the diagnosis unit 61 performs a diagnosis process based on the digital code CODE.
  • the imaging device 1 performs this series of operations a plurality of times while changing the bit pattern and the transfer order.
  • the AD conversion unit ADC (for example, the AD conversion unit ADC (0)) corresponds to a specific example of “first latch” in the present disclosure.
  • the AD conversion unit ADC (for example, the AD conversion unit ADC (2)) corresponds to a specific example of “second latch” in the present disclosure. This operation will be described in detail below.
  • FIG. 23A and 23B schematically show an example of the data transfer operation in the first diagnosis A61 of the self-diagnosis A6, FIG. 23A shows the operation in the reading unit 40S, and FIG. 23B shows the operation in the reading unit 40N.
  • the operation is shown.
  • 23A and 23B among the plurality of AD conversion units ADC, the AD conversion unit ADC that is not shaded (for example, the AD conversion units ADC (0), ADC (1), ADC (4), ADC (5), ...) outputs a digital code CODE in which all bits are "0" based on the control signal CC.
  • the shaded AD conversion unit ADC for example, the AD conversion unit ADC (2), ADC (3), ADC (6), ADC (7), etc Has all the bits based on the control signal CC.
  • the digital code CODE which is “1” is output.
  • FIGS. 23A and 23B show timing charts of the data transfer operation shown in FIGS. 23A and 23B.
  • FIG. 24A shows the waveform of the horizontal synchronization signal XHS
  • FIG. 24B shows the even bits of the control signal SEL
  • C) shows the odd bits of the control signal SEL
  • D shows the image signal DATA0S
  • E shows the image signal DATA0N.
  • a portion where “L” is not shaded indicates a digital code CODE in which all bits are “0” (first logical value).
  • the portion shaded with “H” indicates a digital code CODE in which all bits are “1” (second logical value).
  • the even bits of the control signal SEL become active in the order of the control signal SEL [0], the control signal SEL [2], and the control signal SEL [4] as shown in FIG.
  • the digital code CODE of the 0th AD conversion unit ADC (0) is supplied to the bus wiring 100S. Since the AD converter ADC (0) outputs the digital code CODE in which all the bits are “0” (FIG. 23A), all the bits of the image signal DATA0S at this time become “0” (FIG. 23). 24 (D)). Next, the digital code CODE of the second AD conversion unit ADC (2) is supplied to the bus wiring 100S.
  • the AD conversion unit ADC (2) Since the AD conversion unit ADC (2) outputs the digital code CODE in which all the bits are “1” (FIG. 23A), all the bits of the image signal DATA0S at this time become “1” (FIG. 23). 24 (D)).
  • the digital code CODE of the fourth AD converter ADC (4) is supplied to the bus wiring 100S. Since the AD conversion unit ADC (4) outputs the digital code CODE in which all the bits are “0” (FIG. 23A), all the bits of the image signal DATA0S at this time become “0” (FIG. 23). 24 (D)).
  • the digital code CODE in which all the bits are “0” and the digital code CODE in which all the bits are “1” are sequentially switched from the left AD conversion unit ADC (transfer order F).
  • the image signal DATA0S is transferred to the signal processing unit 60 (FIGS. 23A and 24 (D)).
  • CODE in which all bits are “0” and the digital code in which all bits are “1” in order from the left AD conversion unit ADC (transfer order F). CODE is alternately transferred to the signal processing unit 60 as the image signal DATA0N (FIGS. 23B and 24 (E)).
  • the diagnosis unit 61 of the signal processing unit 60 Based on the image signal DATA0 (image signals DATA0S and DATA0N), the diagnosis unit 61 of the signal processing unit 60 performs diagnosis processing by comparing each bit of the digital code CODE included in the image signal DATA0 with an expected value. .
  • the diagnosis unit 61 for example, in the reading unit 40S (FIG. 23A), the AD conversion unit ADC (2) of the bus wiring connecting the 0th AD conversion unit ADC (0) and the bus wiring 100S. And a line close to the AD conversion unit ADC (0) among the bus lines connecting the second AD conversion unit ADC (2) and the bus line 100S is diagnosed as to whether or not they are short-circuited. be able to.
  • FIG. 25A and 25B schematically show an example of the data transfer operation in the second diagnosis A62 of the self-diagnosis A6,
  • FIG. 25A shows the operation in the reading unit 40S
  • FIG. 25B shows the operation in the reading unit 40N.
  • the operation is shown.
  • FIG. 26 shows a timing chart of the data transfer operation shown in FIGS. 25A and 25B.
  • the bit pattern of the digital code CODE output from each AD converter ADC is different from the bit pattern in the first diagnosis A61 (FIGS. 23A and 23B). It has a pattern.
  • the second diagnosis A62 outputs a digital code CODE in which all bits are “1”.
  • the AD converters ADC (2), ADC (3), ADC (6), ADC (7),... The digital code CODE in which all the bits are “1” in the first diagnosis A61.
  • the second diagnosis A62 outputs a digital code CODE in which all bits are “0”.
  • the digital code CODE of the 0th AD conversion unit ADC (0) is supplied to the bus wiring 100S (FIG. 26B). Since the AD converter ADC (0) outputs the digital code CODE in which all the bits are “1” (FIG. 25A), all the bits of the image signal DATA0S at this time become “1” (FIG. 25). 26 (D)).
  • the digital code CODE of the second AD conversion unit ADC (2) is supplied to the bus wiring 100S (FIG. 26B). Since the AD converter ADC (2) outputs the digital code CODE in which all the bits are “0” (FIG. 25A), all the bits of the image signal DATA0S at this time become “0” (FIG. 25). 26 (D)).
  • the digital code CODE of the fourth AD conversion unit ADC (4) is supplied to the bus wiring 100S (FIG. 26B). Since the AD converter ADC (4) outputs the digital code CODE in which all the bits are “1” (FIG. 25A), all the bits of the image signal DATA0S at this time become “0” (FIG. 25). 26 (D)). In this way, the digital code CODE in which all the bits are “1” and the digital code CODE in which all the bits are “0”, in turn from the left AD conversion unit ADC (transfer order F), The image signal DATA0S is transferred to the signal processing unit 60 (FIGS. 25A and 26 (D)).
  • CODE in which all bits are “1” and the digital code in which all bits are “0” in order from the left AD conversion unit ADC (transfer order F). CODE is alternately transferred to the signal processing unit 60 as the image signal DATA0N (FIGS. 25B and 26 (E)).
  • the diagnosis unit 61 of the signal processing unit 60 performs the second diagnosis A62 (FIGS. 25A, 25B, and 26) in addition to the first diagnosis A61 (FIGS. 23A, 23B, and 24), thereby allowing the AD conversion unit ADC to It is possible to diagnose whether such bus wiring is short-circuited with other wiring such as a power supply line and a ground line. In other words, when such a short circuit occurs, the voltage of the shorted line of the bus lines is fixed.
  • the diagnosis unit 61 the bit pattern of the digital code CODE output from each AD conversion unit ADC is different between the first diagnosis A61 and the second diagnosis A62. Whether it can be detected. As a result, the diagnosis unit 61 can diagnose whether the bus wiring related to the AD conversion unit ADC is short-circuited with other wiring.
  • FIG. 27A and 27B schematically show an example of the data transfer operation in the third diagnosis A63 of the self-diagnosis A6,
  • FIG. 27A shows the operation in the reading unit 40S
  • FIG. 27B shows the operation in the reading unit 40N.
  • the operation is shown.
  • FIG. 28 shows a timing chart of the data transfer operation shown in FIGS. 27A and 27B.
  • the transfer order F is different from that of the first diagnosis A61.
  • the even bits of the control signal SEL become active in the order of the control signal SEL [4094], the control signal SEL [4092], and the control signal SEL [4090] as shown in FIG.
  • the digital code CODE of the 4094th AD conversion unit ADC (4094) is supplied to the bus wiring 100S. Since the AD conversion unit ADC (4094) outputs the digital code CODE in which all the bits are “1”, all the bits of the image signal DATA0S at this time become “1” (FIG. 28D). ). Next, the digital code CODE of the 4092th AD conversion unit ADC (4092) is supplied to the bus wiring 100S (FIG. 28B).
  • the AD conversion unit ADC (4092) Since the AD conversion unit ADC (4092) outputs the digital code CODE in which all the bits are “0”, all the bits of the image signal DATA0S at this time become “0” (FIG. 28D). ).
  • the digital code CODE of the 4090th AD conversion unit ADC (4090) is supplied to the bus wiring 100S (FIG. 28B). Since the AD conversion unit ADC (4090) outputs the digital code CODE in which all the bits are “1”, all the bits of the image signal DATA0S at this time become “1” (FIG. 28D). ).
  • the image signal DATA0S is transferred to the signal processing unit 60 (FIGS. 27A and 28D).
  • CODE in which all the bits are “1” and the digital code in which all the bits are “0” in order from the right AD conversion unit ADC (transfer order F). CODE is alternately transferred to the signal processing unit 60 as the image signal DATA0N (FIGS. 27B and 28E).
  • diagnosis unit 61 of the signal processing unit 60 can change the transfer order when transferring the digital code CODE from the plurality of AD conversion units ADC to the signal processing unit 60 by performing the third diagnosis A63. Can be diagnosed.
  • the imaging apparatus 1 since the imaging apparatus 1 performs the self-diagnosis in the blanking period P20, the imaging apparatus 1 can perform the imaging operation while imaging the subject without affecting the imaging operation. Presence or absence can be diagnosed.
  • the signal generation unit 22 In the imaging device 1, in the blanking period P20, the signal generation unit 22 generates the control signals VMA and VMB, and the plurality of dummy pixels P3 in the dummy pixel region R3 outputs the signal SIG corresponding to the control signals VMA and VMB as signal lines. Since the signal is output to the SGL, for example, a malfunction that has occurred in the pixel array 10 such as disconnection of the signal line SGL can be diagnosed. Further, since the image pickup apparatus 1 can set the voltages of the control signals VMA and VMB to various voltages, various operations in the image pickup apparatus 1 can be diagnosed, so that diagnostic performance can be improved.
  • the imaging apparatus 1 since the plurality of AD conversion units ADC output the digital code CODE having a predetermined bit pattern based on the control signal CC in the blanking period P20, the plurality of AD conversion units ADC The data transfer operation from the signal processing unit 60 to the signal processing unit 60 can be diagnosed.
  • the imaging device 1 can change the bit pattern of the digital code CODE output from the AD conversion unit ADC and the transfer order, so that the diagnostic performance can be improved.
  • the signal line SGL or the bus wiring 100S is short-circuited by detecting the difference between the digital code converted by each AD conversion unit ADC and the digital code transferred to the diagnosis unit 61.
  • the present invention is not limited to this embodiment.
  • a configuration may be adopted in which a diagnostic digital code is forcibly injected into a latch provided on the downstream side of each AD conversion unit ADC by a diagnostic digital code injection unit (not shown).
  • a digital code in which all the bits are “0” is forcibly injected into a first latch provided downstream of the first AD conversion unit
  • the first A digital code in which all the bits are “1” is forcibly injected into a second latch provided on the downstream side of the second AD conversion unit adjacent to the AD conversion unit.
  • the diagnosis unit 61 determines that the digital code transferred from the first latch is a digital code in which all bits are “0”, and all the digital codes transferred from the second latch are When it is determined that the digital code is “1”, the bus wiring 100S is diagnosed as having no defect (not short-circuited).
  • diagnosis unit 61 determines that the digital code transferred from the first latch is not a digital code in which all bits are “0”, or the digital code transferred from the second latch However, if it is determined that the digital code is not all bits of “1”, the signal line SGL or the bus wiring 100S is diagnosed as being defective (short-circuited).
  • the above diagnosis is performed.
  • the signal generation unit 22 in the blanking period, the signal generation unit 22 generates the control signals VMA and VMB, and the plurality of dummy pixels P3 in the dummy pixel region R3 are signals corresponding to the control signals VMA and VMB. Is output to the signal line, for example, it is possible to diagnose a problem occurring in the pixel array.
  • FIG. 29 illustrates an example of the normal pixel region R1 in the pixel array 10A of the imaging device 1A according to the present modification.
  • one column of pixels P1 and four signal lines SGL are alternately arranged in the horizontal direction (the horizontal direction in FIG. 29).
  • the even-numbered signal lines SGL (SGL (0), SGL (2),...) are connected to the reading unit 40S, and the odd-numbered signal lines SGL (SGL (1), SGL (3),.
  • the plurality of pixels P1 include a plurality of pixels P1A, a plurality of pixels P1B, a plurality of pixels P1C, and a plurality of pixels P1D.
  • the pixels P1A to P1D have the same circuit configuration.
  • the pixels P1A, P1B, P1C, and P1D are arranged to circulate in this order in the vertical direction (vertical direction in FIG. 29). Pixels P1A, P1B, P1C, and P1D are connected to the same control lines TGL, SLL, and RSTL.
  • the pixel P1A is connected to, for example, the signal line SGL (0)
  • the pixel P1B is connected to, for example, the signal line SGL (1)
  • the pixel P1C is connected to, for example, the signal line SGL (2)
  • the pixel P1D is, for example, It is connected to the signal line SGL (3).
  • the normal pixel region R1 has been described as an example, but the same applies to the light-shielded pixel regions R21 and R22 and the dummy pixel regions R3 and R4.
  • FIG. 30 illustrates an example of a normal pixel region in the pixel array 10B of another imaging device 1B according to this modification.
  • one column of pixels P1 and one signal line SGL are alternately arranged in the horizontal direction (the horizontal direction in FIG. 30).
  • the even-numbered signal lines SGL (SGL (0), SGL (2),...) are connected to the reading unit 40S, and the odd-numbered signal lines SGL (SGL (1), SGL (3),. Connected to the unit 40N.
  • the pixels P1 arranged in parallel in the vertical direction (vertical direction in FIG. 30) are connected to mutually different control lines TGL, SLL, RSTL.
  • the normal pixel region R1 has been described as an example, but the same applies to the light-shielded pixel regions R21 and R22 and the dummy pixel regions R3 and R4.
  • one bus line 100S is provided in the reading unit 40S and one bus line 100N is provided in the reading unit 40N.
  • the present invention is not limited to this. Instead, for example, a plurality of bus lines may be provided in each of the reading units 40S and 40N. Below, this modification is demonstrated in detail.
  • FIG. 31A and 31B schematically show a configuration example of the reading unit 40C (reading units 40SC and 40NC) of the imaging apparatus 1C according to the present modification, and FIG. 31A shows an example of the reading unit 40SC.
  • FIG. 31B shows an example of the reading unit 40NC.
  • the reading unit 40SC has four bus wires 100S0, 100S1, 100S2, and 100S3.
  • the bus wiring 100S0 supplies a plurality of digital codes CODE as image signals DATA0S to the signal processing unit 60
  • the bus wiring 100S1 supplies a plurality of digital codes CODE as image signals DATA1S to the signal processing unit 60.
  • the bus wiring 100S2 supplies a plurality of digital codes CODE as the image signal DATA2S to the signal processing unit 60
  • the bus wiring 100S3 supplies the plurality of digital codes CODE as the image signal DATA3S to the signal processing unit 60. Is.
  • the AD conversion units ADC (0), ADC (2), ADC (4), and ADC (6) are associated with the bus wiring 100S0. Specifically, the AD conversion units ADC (0), ADC (2), ADC (4), and ADC (6), when the corresponding switch unit SW is in the ON state, the digital code CODE to the bus wiring 100S0. Supply each.
  • the AD conversion units ADC (8), ADC (10), ADC (12), ADC (14) are associated with the bus wiring 100S1
  • the AD conversion units ADC (16), ADC (18), ADC ( 20) and ADC (22) are associated with the bus line 100S2
  • the AD converters ADC (24), ADC (26), ADC (28), and ADC (30) are associated with the bus line 100S3.
  • the AD conversion units ADC (32), ADC (34), ADC (36), and ADC (38) are associated with the bus wiring 100S0, and the AD conversion units ADC (40), ADC (42), and ADC (44).
  • ADC (46) are associated with the bus line 100S1
  • the AD converters ADC (48), ADC (50), ADC (52), ADC (54) are associated with the bus line 100S2, and AD conversion is performed.
  • the parts ADC (56), ADC (58), ADC (60), and ADC (62) are associated with the bus wiring 100S3. The same applies to even-numbered AD conversion units ADC after the AD conversion unit ADC (64).
  • the reading unit 40NC has four bus wirings 100N0, 100N1, 100N2, and 100N3 as shown in FIG. 31B.
  • the bus wiring 100N0 supplies a plurality of digital codes CODE as image signals DATA0N to the signal processing unit 60
  • the bus wiring 100N1 supplies a plurality of digital codes CODE as image signals DATA1N to the signal processing unit 60.
  • the bus wiring 100N2 supplies a plurality of digital codes CODE as the image signal DATA2N to the signal processing unit 60
  • the bus wiring 100N3 supplies the plurality of digital codes CODE as the image signal DATA3N to the signal processing unit 60. Is.
  • the AD conversion units ADC (1), ADC (3), ADC (5), and ADC (7) are associated with the bus wiring 100N0. Specifically, the AD conversion units ADC (1), ADC (3), ADC (5), and ADC (7), when the corresponding switch unit SW is in the ON state, the digital code CODE to the bus wiring 100N0. Supply each.
  • the AD conversion units ADC (9), ADC (11), ADC (13), and ADC (15) are associated with the bus wiring 100N1
  • the AD conversion units ADC (17), ADC (19), ADC ( 21) and ADC (23) are associated with the bus line 100N2
  • the AD converters ADC (25), ADC (27), ADC (29), and ADC (31) are associated with the bus line 100N3.
  • the AD conversion units ADC (33), ADC (35), ADC (37), and ADC (39) are associated with the bus wiring 100N0, and the AD conversion units ADC (41), ADC (43), and ADC (45).
  • ADC (47) are associated with the bus line 100N1
  • the AD converters ADC (49), ADC (51), ADC (53), ADC (55) are associated with the bus line 100N2, and AD conversion is performed.
  • the sections ADC (57), ADC (59), ADC (61), and ADC (63) are associated with the bus wiring 100N3. The same applies to odd-numbered AD conversion units ADC after the AD conversion unit ADC (65).
  • the imaging apparatus 1C since the plurality of bus wirings are provided in each of the reading units 40SC and 40NC, the data transfer time from the plurality of AD conversion units ADC to the signal processing unit 60 can be shortened. .
  • the AD conversion unit ADC (for example, AD conversion unit ADC (0), ADC (1), ADC (4), ADC (5)) that is not shaded among the plurality of AD conversion units ADC. ,... Output a digital code CODE in which all bits are “0” based on the control signal CC in the blanking period P20.
  • the shaded AD converters ADC (for example, AD converters ADC (2), ADC (3), ADC (6), ADC (7),...)) Are based on the control signal CC in the blanking period P20.
  • the digital code CODE in which all bits are “1” is output.
  • FIG. 32 shows a timing chart of the data transfer operation according to this modification.
  • A shows the waveform of the horizontal synchronization signal XHS
  • B shows the even bits of the control signal SEL
  • C Indicates odd bits of the control signal SEL
  • D shows image signals DATA0S, DATA1S, DATA2S, DATA3S, respectively
  • H -(K) indicate image signals DATA0N, DATA1N, DATA2N, DATA3N, respectively. Show.
  • the control signals SEL [0], SEL [8], SEL [16], and SEL [24] are activated.
  • the digital code CODE of the AD conversion unit ADC (0) is supplied to the bus line 100S0
  • the digital code CODE of the AD conversion unit ADC (8) is supplied to the bus line 100S1
  • the AD conversion unit ADC The digital code CODE of (16) is supplied to the bus wiring 100S2, and the digital code CODE of the AD conversion unit ADC (24) is supplied to the bus wiring 100S3.
  • AD conversion units ADC (0), ADC (8), ADC (16), and ADC (24) output the digital code CODE in which all the bits are “0” (FIG. 31A), at this time All the bits of the image signals DATA0S, DATA1S, DATA2S, and DATA3S are “0” (FIGS. 32D to 32G).
  • the control signals SEL [2], SEL [10], SEL [18], SEL [26] are activated (FIG. 32 (B)).
  • the digital code CODE of the AD conversion unit ADC (2) is supplied to the bus wiring 100S0
  • the digital code CODE of the AD conversion unit ADC (10) is supplied to the bus wiring 100S1
  • the digital code CODE of (18) is supplied to the bus wiring 100S2
  • the digital code CODE of the AD conversion unit ADC (26) is supplied to the bus wiring 100S3. Since the AD conversion units ADC (2), ADC (10), ADC (18), and ADC (26) output the digital codes CODE in which all the bits are “1” (FIG. 31A), at this time All the bits of the image signals DATA0S, DATA1S, DATA2S, and DATA3S are “1” (FIGS. 32D to 32G).
  • the digital code CODE in which all the bits are “0” and the digital code CODE in which all the bits are “1” are alternately transferred to the signal processing unit 60 as the image signal DATA0S (see FIG. 32 (D)).
  • FIG. 33A and 33B schematically show a configuration example of the reading unit 40D (reading units 40SD and 40ND) of the imaging apparatus 1D according to the present modification, and FIG. 33A shows an example of the reading unit 40SD.
  • FIG. 3DB shows an example of the reading unit 40ND.
  • the reading unit 40SD has four bus lines 100S0, 100S1, 100S2, and 100S3 as shown in FIG. 33A.
  • the AD conversion units ADC (0), ADC (2), ADC (4) are associated with the bus wiring 100S0
  • the AD conversion units ADC (6), ADC (8), ADC (10) are
  • the AD converters ADC (12), ADC (14), ADC (16) are associated with the bus wiring 100S1
  • the AD converters ADC (18), ADC (20), ADC ( 22) is associated with the bus wiring 100S3.
  • the AD converters ADC (24), ADC (26), and ADC (28) are associated with the bus wiring 100S0
  • the AD converters ADC (30), ADC (32), and ADC (34) are bus wiring.
  • the AD converters ADC (36), ADC (38), and ADC (40) are associated with the bus wiring 100S2, and the AD converters ADC (42), ADC (44), and ADC (46) are associated with 100S1. Are associated with the bus wiring 100S3. The same applies to even-numbered AD conversion units ADC after the AD conversion unit ADC (48).
  • the reading unit 40ND has four bus wirings 100N0, 100N1, 100N2, and 100N3.
  • the AD conversion units ADC (1), ADC (3), ADC (5) are associated with the bus wiring 100N0
  • the AD conversion units ADC (7), ADC (9), ADC (11) are
  • the AD converters ADC (13), ADC (15), and ADC (17) are associated with the bus line 100N1
  • the AD converters ADC (19), ADC (21), and ADC (17) are associated with the bus line 100N2. 23) is associated with the bus wiring 100N3.
  • the AD converters ADC (25), ADC (27), and ADC (29) are associated with the bus wiring 100N0, and the AD converters ADC (31), ADC (33), and ADC (35) are bus wiring.
  • the AD converters ADC (37), ADC (39), and ADC (41) are associated with 100N1
  • the AD converters ADC (43), ADC (45), and ADC (47) are associated with the bus wiring 100N2. Is associated with the bus wiring 100N3. The same applies to odd-numbered AD conversion units ADC after the AD conversion unit ADC (49).
  • the shaded AD converters ADC (for example, AD converters ADC (2), ADC (3), ADC (6), ADC (7),...)) Are based on the control signal CC in the blanking period P20.
  • the bit patterns A and B are 1/0 alternating patterns, which are mutually inverted patterns.
  • FIG. 34 shows a timing chart of the data transfer operation according to this modification.
  • A shows the waveform of the horizontal synchronization signal XHS
  • B shows the even bits of the control signal SEL
  • C Indicates odd bits of the control signal SEL
  • D)-(G) indicate image signals DATA0S, DATA1S, DATA2S, DATA3S, respectively
  • H -(K) indicate image signals DATA0N, DATA1N, DATA2N, DATA3N, respectively.
  • the control signals SEL [0], SEL [6], SEL [12], and SEL [18] are activated.
  • the digital code CODE of the AD conversion unit ADC (0) is supplied to the bus wiring 100S0
  • the digital code CODE of the AD conversion unit ADC (6) is supplied to the bus wiring 100S1
  • the AD conversion unit ADC The digital code CODE of (12) is supplied to the bus wiring 100S2
  • the digital code CODE of the AD conversion unit ADC (18) is supplied to the bus wiring 100S3. Since the AD conversion units ADC (0) and ADC (12) output the digital code CODE having the bit pattern A (FIG.
  • the digital codes CODE of the image signals DATA0S and DATA2S at this time are the bit patterns.
  • A (FIGS. 34D and 34F). Since the AD conversion units ADC (6) and ADC (18) output the digital code CODE having the bit pattern B (FIG. 33A), the digital codes CODE of the image signals DATA1S and DATA3S at this time are: It has a bit pattern B (FIGS. 34E and 34G).
  • the control signals SEL [2], SEL [8], SEL [14], SEL [20] are activated (FIG. 34 (B)).
  • the digital code CODE of the AD conversion unit ADC (2) is supplied to the bus wiring 100S0
  • the digital code CODE of the AD conversion unit ADC (8) is supplied to the bus wiring 100S1
  • the digital code CODE of (14) is supplied to the bus wiring 100S2
  • the digital code CODE of the AD conversion unit ADC (20) is supplied to the bus wiring 100S3. Since the AD converters ADC (2) and ADC (14) output the digital code CODE having the bit pattern B (FIG.
  • the digital code CODE of the image signals DATA0S and DATA2S at this time is the bit pattern.
  • B (FIGS. 34D and 34F). Since the AD conversion units ADC (8) and ADC (20) output the digital code CODE having the bit pattern A (FIG. 33A), the digital codes CODE of the image signals DATA1S and DATA3S at this time are It has a bit pattern A (FIGS. 34E and 34G).
  • the digital code CODE having the bit pattern A and the digital code CODE having the bit pattern B are alternately transferred to the signal processing unit 60 as the image signal DATA0S (FIG. 34 (D)).
  • the image signals DATA2S, DATA0N, and DATA2N are alternately transferred to the signal processing unit 60 as the image signal DATA01S (FIG. 34E).
  • the image signals DATA3S, DATA1N, and DATA3N are alternately transferred to the signal processing unit 60 as the image signal DATA01S (FIG. 34E).
  • the bit pattern of the digital code CODE is changed to the 1/0 alternating pattern. For example, whether adjacent wirings among the bus wirings related to the AD conversion unit ADC are short-circuited with each other. Can be diagnosed. Specifically, for example, in the reading unit 40SD (FIG. 33A), the diagnosis unit 61 short-circuits adjacent wirings in the bus wiring connecting the 0th AD conversion unit ADC (0) and the bus wiring 100S0. Can be diagnosed if not.
  • the technology according to the present disclosure can be applied to various products.
  • the technology according to the present disclosure may be any type of movement such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, a robot, a construction machine, and an agricultural machine (tractor).
  • FIG. 35 is a block diagram illustrating a schematic configuration example of a vehicle control system 7000 that is an example of a mobile control system to which the technology according to the present disclosure can be applied.
  • the vehicle control system 7000 includes a plurality of electronic control units connected via a communication network 7010.
  • the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, a vehicle exterior information detection unit 7400, a vehicle interior information detection unit 7500, and an integrated control unit 7600. .
  • the communication network 7010 for connecting the plurality of control units conforms to an arbitrary standard such as CAN (Controller Area Network), LIN (Local Interconnect Network), LAN (Local Area Network), or FlexRay (registered trademark). It may be an in-vehicle communication network.
  • Each control unit includes a microcomputer that performs arithmetic processing according to various programs, a storage unit that stores programs executed by the microcomputer or parameters used for various calculations, and a drive circuit that drives various devices to be controlled. Is provided.
  • Each control unit includes a network I / F for communicating with other control units via a communication network 7010, and is connected to devices or sensors inside and outside the vehicle by wired communication or wireless communication. A communication I / F for performing communication is provided. In FIG.
  • control unit 7600 As a functional configuration of the integrated control unit 7600, a microcomputer 7610, a general-purpose communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, an audio image output unit 7670, An in-vehicle network I / F 7680 and a storage unit 7690 are illustrated.
  • other control units include a microcomputer, a communication I / F, a storage unit, and the like.
  • the drive system control unit 7100 controls the operation of the device related to the drive system of the vehicle according to various programs.
  • the drive system control unit 7100 includes a driving force generator for generating a driving force of a vehicle such as an internal combustion engine or a driving motor, a driving force transmission mechanism for transmitting the driving force to wheels, and a steering angle of the vehicle. It functions as a control device such as a steering mechanism that adjusts and a braking device that generates a braking force of the vehicle.
  • the drive system control unit 7100 may have a function as a control device such as ABS (Antilock Brake System) or ESC (Electronic Stability Control).
  • a vehicle state detection unit 7110 is connected to the drive system control unit 7100.
  • the vehicle state detection unit 7110 includes, for example, a gyro sensor that detects the angular velocity of the rotational movement of the vehicle body, an acceleration sensor that detects the acceleration of the vehicle, an operation amount of an accelerator pedal, an operation amount of a brake pedal, and steering of a steering wheel. At least one of sensors for detecting an angle, an engine speed, a rotational speed of a wheel, or the like is included.
  • the drive system control unit 7100 performs arithmetic processing using a signal input from the vehicle state detection unit 7110, and controls an internal combustion engine, a drive motor, an electric power steering device, a brake device, or the like.
  • the body system control unit 7200 controls the operation of various devices mounted on the vehicle body according to various programs.
  • the body system control unit 7200 functions as a keyless entry system, a smart key system, a power window device, or a control device for various lamps such as a headlamp, a back lamp, a brake lamp, a blinker, or a fog lamp.
  • the body control unit 7200 can be input with radio waves or various switch signals transmitted from a portable device that substitutes for a key.
  • the body system control unit 7200 receives input of these radio waves or signals, and controls a door lock device, a power window device, a lamp, and the like of the vehicle.
  • the battery control unit 7300 controls the secondary battery 7310 that is a power supply source of the drive motor according to various programs. For example, information such as battery temperature, battery output voltage, or remaining battery capacity is input to the battery control unit 7300 from a battery device including the secondary battery 7310. The battery control unit 7300 performs arithmetic processing using these signals, and controls the temperature adjustment of the secondary battery 7310 or the cooling device provided in the battery device.
  • the outside information detection unit 7400 detects information outside the vehicle on which the vehicle control system 7000 is mounted.
  • the outside information detection unit 7400 is connected to at least one of the imaging unit 7410 and the outside information detection unit 7420.
  • the imaging unit 7410 includes at least one of a ToF (Time Of Flight) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras.
  • the outside information detection unit 7420 detects, for example, current weather or an environmental sensor for detecting weather, or other vehicles, obstacles, pedestrians, etc. around the vehicle equipped with the vehicle control system 7000. At least one of the surrounding information detection sensors.
  • the environmental sensor may be, for example, at least one of a raindrop sensor that detects rainy weather, a fog sensor that detects fog, a sunshine sensor that detects sunlight intensity, and a snow sensor that detects snowfall.
  • the ambient information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (Light Detection and Ranging, Laser Imaging Detection andRanging) device.
  • the imaging unit 7410 and the outside information detection unit 7420 may be provided as independent sensors or devices, or may be provided as a device in which a plurality of sensors or devices are integrated.
  • FIG. 36 shows an example of installation positions of the imaging unit 7410 and the vehicle outside information detection unit 7420.
  • the imaging units 7910, 7912, 7914, 7916, and 7918 are provided at, for example, at least one of the front nose, the side mirror, the rear bumper, the back door, and the upper part of the windshield in the vehicle interior of the vehicle 7900.
  • An imaging unit 7910 provided in the front nose and an imaging unit 7918 provided in the upper part of the windshield in the vehicle interior mainly acquire an image in front of the vehicle 7900.
  • Imaging units 7912 and 7914 provided in the side mirror mainly acquire an image of the side of the vehicle 7900.
  • An imaging unit 7916 provided in the rear bumper or the back door mainly acquires an image behind the vehicle 7900.
  • the imaging unit 7918 provided on the upper part of the windshield in the passenger compartment is mainly used for detecting a preceding vehicle or a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or
  • FIG. 36 shows an example of shooting ranges of the respective imaging units 7910, 7912, 7914, and 7916.
  • the imaging range a indicates the imaging range of the imaging unit 7910 provided in the front nose
  • the imaging ranges b and c indicate the imaging ranges of the imaging units 7912 and 7914 provided in the side mirrors, respectively
  • the imaging range d The imaging range of the imaging part 7916 provided in the rear bumper or the back door is shown. For example, by superimposing the image data captured by the imaging units 7910, 7912, 7914, and 7916, an overhead image when the vehicle 7900 is viewed from above is obtained.
  • the vehicle outside information detection units 7920, 7922, 7924, 7926, 7928, and 7930 provided on the front, rear, sides, corners of the vehicle 7900 and the upper part of the windshield in the vehicle interior may be, for example, an ultrasonic sensor or a radar device.
  • the vehicle outside information detection units 7920, 7926, and 7930 provided on the front nose, the rear bumper, the back door, and the windshield in the vehicle interior of the vehicle 7900 may be, for example, LIDAR devices.
  • These outside information detection units 7920 to 7930 are mainly used for detecting a preceding vehicle, a pedestrian, an obstacle, and the like.
  • the vehicle exterior information detection unit 7400 causes the imaging unit 7410 to capture an image outside the vehicle and receives the captured image data. Further, the vehicle exterior information detection unit 7400 receives detection information from the vehicle exterior information detection unit 7420 connected thereto. When the vehicle exterior information detection unit 7420 is an ultrasonic sensor, a radar device, or a LIDAR device, the vehicle exterior information detection unit 7400 transmits ultrasonic waves, electromagnetic waves, or the like, and receives received reflected wave information.
  • the outside information detection unit 7400 may perform an object detection process or a distance detection process such as a person, a car, an obstacle, a sign, or a character on a road surface based on the received information.
  • the vehicle exterior information detection unit 7400 may perform environment recognition processing for recognizing rainfall, fog, road surface conditions, or the like based on the received information.
  • the vehicle outside information detection unit 7400 may calculate a distance to an object outside the vehicle based on the received information.
  • the outside information detection unit 7400 may perform image recognition processing or distance detection processing for recognizing a person, a car, an obstacle, a sign, a character on a road surface, or the like based on the received image data.
  • the vehicle exterior information detection unit 7400 performs processing such as distortion correction or alignment on the received image data, and combines the image data captured by the different imaging units 7410 to generate an overhead image or a panoramic image. Also good.
  • the vehicle exterior information detection unit 7400 may perform viewpoint conversion processing using image data captured by different imaging units 7410.
  • the vehicle interior information detection unit 7500 detects vehicle interior information.
  • a driver state detection unit 7510 that detects the driver's state is connected to the in-vehicle information detection unit 7500.
  • Driver state detection unit 7510 may include a camera that captures an image of the driver, a biosensor that detects biometric information of the driver, a microphone that collects sound in the passenger compartment, and the like.
  • the biometric sensor is provided, for example, on a seat surface or a steering wheel, and detects biometric information of an occupant sitting on the seat or a driver holding the steering wheel.
  • the vehicle interior information detection unit 7500 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 7510, and determines whether the driver is asleep. May be.
  • the vehicle interior information detection unit 7500 may perform a process such as a noise canceling process on the collected audio signal.
  • the integrated control unit 7600 controls the overall operation in the vehicle control system 7000 according to various programs.
  • An input unit 7800 is connected to the integrated control unit 7600.
  • the input unit 7800 is realized by a device that can be input by a passenger, such as a touch panel, a button, a microphone, a switch, or a lever.
  • the integrated control unit 7600 may be input with data obtained by recognizing voice input through a microphone.
  • the input unit 7800 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device such as a mobile phone or a PDA (Personal Digital Assistant) that supports the operation of the vehicle control system 7000. May be.
  • the input unit 7800 may be, for example, a camera.
  • the passenger can input information using a gesture.
  • data obtained by detecting the movement of the wearable device worn by the passenger may be input.
  • the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by a passenger or the like using the input unit 7800 and outputs the input signal to the integrated control unit 7600.
  • a passenger or the like operates the input unit 7800 to input various data or instruct a processing operation to the vehicle control system 7000.
  • the storage unit 7690 may include a ROM (Read Only Memory) that stores various programs executed by the microcomputer, and a RAM (Random Access Memory) that stores various parameters, calculation results, sensor values, and the like.
  • the storage unit 7690 may be realized by a magnetic storage device such as an HDD (Hard Disc Drive), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.
  • General-purpose communication I / F 7620 is a general-purpose communication I / F that mediates communication with various devices existing in the external environment 7750.
  • General-purpose communication I / F7620 is a cellular communication protocol such as GSM (registered trademark) (Global System of Mobile communications), WiMAX, LTE (Long Term Evolution) or LTE-A (LTE-Advanced), or a wireless LAN (Wi-Fi). (Also referred to as (registered trademark)) and other wireless communication protocols such as Bluetooth (registered trademark) may be implemented.
  • GSM Global System of Mobile communications
  • WiMAX Wireless LAN
  • LTE Long Term Evolution
  • LTE-A Long Term Evolution-A
  • Wi-Fi wireless LAN
  • Bluetooth registered trademark
  • the general-purpose communication I / F 7620 is connected to a device (for example, an application server or a control server) existing on an external network (for example, the Internet, a cloud network, or an operator-specific network) via, for example, a base station or an access point. May be.
  • a device for example, an application server or a control server
  • an external network for example, the Internet, a cloud network, or an operator-specific network
  • the general-purpose communication I / F 7620 uses, for example, a P2P (Peer To Peer) technology, a terminal (for example, a driver, a pedestrian or a store terminal, or an MTC (Machine Type Communication) terminal) You may connect with.
  • P2P Peer To Peer
  • a terminal for example, a driver, a pedestrian or a store terminal
  • MTC Machine Type Communication
  • the dedicated communication I / F 7630 is a communication I / F that supports a communication protocol formulated for use in vehicles.
  • the dedicated communication I / F 7630 is a standard protocol such as WAVE (Wireless Access in Vehicle Environment) (DSAVE), DSRC (Dedicated Short Range Communications), or cellular communication protocol, which is a combination of the lower layer IEEE 802.11p and the upper layer IEEE 1609. May be implemented.
  • the dedicated communication I / F 7630 typically includes vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian (Vehicle to Pedestrian). ) Perform V2X communication, which is a concept that includes one or more of the communications.
  • the positioning unit 7640 receives, for example, a GNSS signal from a GNSS (Global Navigation Satellite System) satellite (for example, a GPS signal from a GPS (Global Positioning System) satellite), performs positioning, and performs latitude, longitude, and altitude of the vehicle.
  • the position information including is generated.
  • the positioning unit 7640 may specify the current position by exchanging signals with the wireless access point, or may acquire position information from a terminal such as a mobile phone, PHS, or smartphone having a positioning function.
  • the beacon receiving unit 7650 receives, for example, radio waves or electromagnetic waves transmitted from a radio station installed on the road, and acquires information such as the current position, traffic jam, closed road, or required time. Note that the function of the beacon receiving unit 7650 may be included in the dedicated communication I / F 7630 described above.
  • the in-vehicle device I / F 7660 is a communication interface that mediates the connection between the microcomputer 7610 and various in-vehicle devices 7760 present in the vehicle.
  • the in-vehicle device I / F 7660 may establish a wireless connection using a wireless communication protocol such as a wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB).
  • the in-vehicle device I / F 7660 is connected to a USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), or MHL (Mobile) via a connection terminal (and a cable if necessary).
  • Wired connection such as High-definition (Link) may be established.
  • the in-vehicle device 7760 may include, for example, at least one of a mobile device or a wearable device that a passenger has, or an information device that is carried into or attached to the vehicle.
  • In-vehicle device 7760 may include a navigation device that searches for a route to an arbitrary destination.
  • the in-vehicle device I / F 7660 exchanges control signals or image signals with these in-vehicle devices 7760.
  • the in-vehicle network I / F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010.
  • the in-vehicle network I / F 7680 transmits and receives signals and the like in accordance with a predetermined protocol supported by the communication network 7010.
  • the microcomputer 7610 of the integrated control unit 7600 is connected via at least one of a general-purpose communication I / F 7620, a dedicated communication I / F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I / F 7660, and an in-vehicle network I / F 7680.
  • the vehicle control system 7000 is controlled according to various programs based on the acquired information. For example, the microcomputer 7610 calculates a control target value of the driving force generation device, the steering mechanism, or the braking device based on the acquired information inside and outside the vehicle, and outputs a control command to the drive system control unit 7100. Also good.
  • the microcomputer 7610 realizes ADAS (Advanced Driver Assistance System) functions including vehicle collision avoidance or impact mitigation, following traveling based on inter-vehicle distance, vehicle speed maintaining traveling, vehicle collision warning, or vehicle lane departure warning. You may perform the cooperative control for the purpose. Further, the microcomputer 7610 controls the driving force generator, the steering mechanism, the braking device, or the like based on the acquired information on the surroundings of the vehicle, so that the microcomputer 7610 automatically travels independently of the driver's operation. You may perform the cooperative control for the purpose of driving.
  • ADAS Advanced Driver Assistance System
  • the microcomputer 7610 is information acquired via at least one of the general-purpose communication I / F 7620, the dedicated communication I / F 7630, the positioning unit 7640, the beacon receiving unit 7650, the in-vehicle device I / F 7660, and the in-vehicle network I / F 7680.
  • the three-dimensional distance information between the vehicle and the surrounding structure or an object such as a person may be generated based on the above and local map information including the peripheral information of the current position of the vehicle may be created.
  • the microcomputer 7610 may generate a warning signal by predicting a danger such as a collision of a vehicle, approach of a pedestrian or the like or an approach to a closed road based on the acquired information.
  • the warning signal may be, for example, a signal for generating a warning sound or lighting a warning lamp.
  • the audio image output unit 7670 transmits an output signal of at least one of audio and image to an output device capable of visually or audibly notifying information to a vehicle occupant or the outside of the vehicle.
  • an audio speaker 7710, a display unit 7720, and an instrument panel 7730 are illustrated as output devices.
  • Display unit 7720 may include at least one of an on-board display and a head-up display, for example.
  • the display portion 7720 may have an AR (Augmented Reality) display function.
  • the output device may be other devices such as headphones, wearable devices such as glasses-type displays worn by passengers, projectors, and lamps.
  • the display device can display the results obtained by various processes performed by the microcomputer 7610 or information received from other control units in various formats such as text, images, tables, and graphs. Display visually. Further, when the output device is an audio output device, the audio output device converts an audio signal made up of reproduced audio data or acoustic data into an analog signal and outputs it aurally.
  • At least two control units connected via the communication network 7010 may be integrated as one control unit.
  • each control unit may be configured by a plurality of control units.
  • the vehicle control system 7000 may include another control unit not shown.
  • some or all of the functions of any of the control units may be given to other control units. That is, as long as information is transmitted and received via the communication network 7010, the predetermined arithmetic processing may be performed by any one of the control units.
  • a sensor or device connected to one of the control units may be connected to another control unit, and a plurality of control units may transmit / receive detection information to / from each other via the communication network 7010. .
  • the imaging device 1 according to this embodiment described with reference to FIG. 1 can be applied to the imaging unit 7410 in the application example illustrated in FIG.
  • the vehicle control system 7000 it is possible to diagnose whether the imaging unit 7410 is operating normally by performing self-diagnosis. If a malfunction occurs in the imaging unit 7410, for example, the vehicle control system 7000 can recognize that a malfunction has occurred in the imaging unit 7410 by notifying the microcomputer 7610 of the diagnosis result. .
  • the vehicle control system 7000 for example, it is possible to perform appropriate processing such as urging the driver to call attention, so that reliability can be improved.
  • the function of controlling the vehicle can be limited based on the result of the diagnostic process.
  • the vehicle control function includes a vehicle collision avoidance or collision mitigation function, a following traveling function based on the inter-vehicle distance, a vehicle speed maintaining traveling function, a vehicle collision warning function, a vehicle lane departure warning function, and the like.
  • diagnosis processing when it is determined that a problem has occurred in the imaging unit 7410, the function of controlling the vehicle can be limited or prohibited.
  • the vehicle control system 7000 can prevent an accident caused by erroneous detection based on the malfunction of the imaging unit 7410.
  • a plurality of pixels P1A arranged in parallel in the vertical direction are connected to one AD conversion unit ADC, but the present invention is not limited to this.
  • a plurality of pixels P belonging to one area AR may be connected to one AD conversion unit ADC as in the imaging device 1E illustrated in FIG.
  • the imaging device 1E is formed by being divided into two semiconductor substrates (an upper substrate 211 and a lower substrate 212).
  • a pixel array 10 is formed on the upper substrate 211.
  • the pixel array 10 is divided into a plurality of (in this example, nine) areas AR, and each area AR includes a plurality of pixels P.
  • a reading unit 40 is formed on the lower substrate 212.
  • the AD conversion unit ADC connected to the plurality of pixels P belonging to the area AR is formed on the lower substrate 212 in a region corresponding to the area AR on the upper substrate 211.
  • the upper substrate 211 and the lower substrate 212 are electrically connected by, for example, Cu—Cu bonding.
  • the pixel array 10 is divided into nine areas AR.
  • the present invention is not limited to this.
  • the pixel array 10 may be divided into eight areas or less, or ten or more areas AR. .
  • a plurality of signal lines A plurality of pixels each applying a pixel voltage to the plurality of signal lines; Provided corresponding to the plurality of signal lines, each of which generates a digital code by performing AD conversion based on the voltage of the corresponding signal line of the plurality of signal lines, and the digital code
  • a plurality of converters capable of outputting and setting the digital code to be output in the first period to a predetermined digital code;
  • a processing unit that performs predetermined processing based on the digital code and performs diagnostic processing in the first period;
  • An image pickup apparatus comprising: a transfer unit that transfers the digital code output from each of the plurality of conversion units to the processing unit.
  • the predetermined digital code includes a first code and a second code, The plurality of conversion units set the digital codes of the conversion units adjacent to each other among the plurality of conversion units to different codes of the first code and the second code. ).
  • Each bit of the first code is set to a first logical value;
  • the imaging device according to (2), wherein each bit of the second code is set to a second logical value.
  • a first logic value and a second logic value are alternately set, The imaging device according to (2), wherein each bit of the second code is obtained by inverting a corresponding bit in the first code.
  • the transfer unit includes the digital code output from the conversion unit set in the first code and the conversion unit set in the second code among the plurality of conversion units.
  • the imaging device according to any one of (2) to (4), wherein the output digital code is alternately transferred.
  • the imaging device The imaging device according to any one of (1) to (5), wherein the transfer unit is capable of changing a transfer order when transferring the digital code output from each of the plurality of conversion units. .
  • the first period is a period within a blanking period.
  • the plurality of conversion units output the generated digital code in a second period different from the first period.
  • the transfer unit Bus wiring A plurality of conversion units provided corresponding to the plurality of conversion units, each of which is turned on to supply the digital code output from the corresponding conversion unit among the plurality of conversion units to the bus wiring
  • the imaging apparatus according to any one of (1) to (8), further including a switch unit.
  • the transfer unit Multiple bus wiring Provided corresponding to the plurality of conversion units, each of which is turned on, the digital code output from the corresponding conversion unit of the plurality of conversion unit is one of the plurality of bus wiring
  • the imaging device according to any one of (1) to (8), further including:

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

La présente invention concerne un système d'imagerie qui comprend : un dispositif d'imagerie qui est monté dans un véhicule, et qui capture des images à partir de la région dans la périphérie du véhicule afin de générer une image ; et un dispositif de traitement qui, sur la base de l'image, exécute un processus se rapportant à une fonction de commande de véhicule. Le dispositif d'imagerie comprend : des premiers pixels ; des seconds pixels ; une première ligne de signal reliée aux premiers pixels ; une seconde ligne de signal qui est différente de la première ligne de signal et qui est reliée aux seconds pixels ; des premiers verrous qui sont reliés à la première ligne de signal et stockent un premier code numérique ; des seconds verrous qui sont reliés à la seconde ligne de signal, sont adjacents aux premiers verrous, et stockent un second code numérique ; des unités de transfert qui transfèrent des codes numériques délivrés en sortie par les premiers verrous et seconds verrous ; et une unité de diagnostic qui effectue un traitement de diagnostic sur la base des codes numériques transférés à partir des premiers verrous et des seconds verrous. Sur la base du résultat du traitement de diagnostic, le dispositif de traitement restreint la fonction de commande de véhicule.
PCT/JP2018/001183 2017-02-16 2018-01-17 Système d'imagerie et dispositif d'imagerie WO2018150790A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201880009122.3A CN110291784B (zh) 2017-02-16 2018-01-17 摄像系统和摄像装置
US16/481,685 US10785435B2 (en) 2017-02-16 2018-01-17 Imaging system and imaging device
DE112018000861.4T DE112018000861T5 (de) 2017-02-16 2018-01-17 Abbildungssystem und abbildungsvorrichtung

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2017-026824 2017-02-16
JP2017026824 2017-02-16
JP2017197508A JP6748622B2 (ja) 2017-02-16 2017-10-11 撮像システムおよび撮像装置
JP2017-197508 2017-10-11

Publications (1)

Publication Number Publication Date
WO2018150790A1 true WO2018150790A1 (fr) 2018-08-23

Family

ID=63170562

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/001183 WO2018150790A1 (fr) 2017-02-16 2018-01-17 Système d'imagerie et dispositif d'imagerie

Country Status (1)

Country Link
WO (1) WO2018150790A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006120815A1 (fr) * 2005-05-11 2006-11-16 Matsushita Electric Industrial Co., Ltd. Dispositif de lecture d’images a semi-conducteurs, camera, vehicule et dispositif de surveillance
JP2009118427A (ja) * 2007-11-09 2009-05-28 Panasonic Corp 固体撮像装置およびその駆動方法
US20140078364A1 (en) * 2012-09-19 2014-03-20 Aptina Imaging Corporation Image sensors with column failure correction circuitry

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006120815A1 (fr) * 2005-05-11 2006-11-16 Matsushita Electric Industrial Co., Ltd. Dispositif de lecture d’images a semi-conducteurs, camera, vehicule et dispositif de surveillance
JP2009118427A (ja) * 2007-11-09 2009-05-28 Panasonic Corp 固体撮像装置およびその駆動方法
US20140078364A1 (en) * 2012-09-19 2014-03-20 Aptina Imaging Corporation Image sensors with column failure correction circuitry

Similar Documents

Publication Publication Date Title
JP7078822B2 (ja) 光検出装置および光検出システム
JP6748622B2 (ja) 撮像システムおよび撮像装置
US11146753B2 (en) Imaging apparatus, signal processing method for imaging apparatus, and electronic equipment
JP7098346B2 (ja) 撮像装置および撮像システム
WO2019163511A1 (fr) Dispositif, système et procédé de capture d'image
US11671728B2 (en) Sensing device, electronic apparatus, and method for controlling sensing device
WO2019151065A1 (fr) Dispositif d'imagerie et procédé détalonnage
WO2019239746A1 (fr) Convertisseur analogique-numérique, procédé de conversion analogique-numérique, et dispositif d'imagerie
JP7242551B2 (ja) 撮像装置
TW202029730A (zh) 攝像裝置
WO2018150790A1 (fr) Système d'imagerie et dispositif d'imagerie
WO2022149555A1 (fr) Dispositif d'imagerie à semi-conducteur et instrument électronique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18754282

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 18754282

Country of ref document: EP

Kind code of ref document: A1