JP5926980B2 - Imaging apparatus and imaging system - Google Patents

Description

  The present invention relates to, for example, an imaging apparatus and an imaging system capable of outputting, as image information, an electrical signal after photoelectric conversion from a pixel arbitrarily designated as a readout target among a plurality of pixels for imaging.

  Conventionally, in the medical field, an endoscope system is used when observing an organ of a subject such as a patient. An endoscope system has, for example, a flexible elongated shape, an insertion portion that is inserted into a body cavity of a subject, and an imaging element (imaging device) that is provided at the distal end of the insertion portion and captures an in-vivo image. And a display unit capable of displaying an in-vivo image captured by the image sensor. When acquiring an in-vivo image using an endoscope system, after inserting the insertion portion into the body cavity of the subject, irradiate the living tissue in the body cavity with illumination light such as white light from the distal end of the insertion portion. The image sensor picks up an in-vivo image. The insertion unit performs A / D conversion and the like on the video signal picked up by the image sensor, and outputs the processed video signal to the display unit side. A user such as a doctor observes the organ of the subject based on the in-vivo image displayed by the display unit.

  By the way, in the endoscope system having the above-described imaging unit, when a problem occurs, it is necessary to specify a failure location. Here, in the case where an abnormality has occurred in the displayed image, each part (insertion section) is specified when specifying which part (failure) has occurred among the above-described insertion section, imaging device, and display section. , Replace the imaging device and the display unit) with another one.

  In addition, when an abnormality occurs in the endoscope system, for example, when the image sensor operates normally in the insertion unit and there is an abnormality in the signal processing unit, a pseudo video signal synchronized with the output of the image sensor is also stored. A technique for displaying a pseudo image on a display unit is disclosed (for example, see Patent Document 1). With this technique, it is possible to prevent the images continuously displayed on the display unit from being displayed due to an abnormality of the signal processing unit, and it is possible to display the image obtained by the image sensor without interruption.

JP 2006-346357 A

  However, in the technology disclosed in Patent Document 1, on the assumption that the image sensor operates, it is detected whether the entire processing unit other than the image sensor is abnormal and uses a pseudo video signal. It is not possible to specify in detail the abnormal part in the configuration of.

  The present invention has been made in view of the above, and an object of the present invention is to provide an imaging apparatus and an imaging system that can specify an abnormal location in the imaging apparatus in detail.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention includes an imaging unit that outputs electrical signals after photoelectric conversion from a plurality of pixels as image information, and an image output from the imaging unit. An imaging apparatus comprising: a signal processing unit that performs signal processing of a signal including information; and a transmission unit that transmits a signal processed by the signal processing unit to the outside. The imaging unit, the signal processing unit, and the transmission unit Is characterized by generating a discrimination signal used for discrimination of its own operation state.

  An imaging device according to the present invention is the above-described invention, wherein the imaging device, the signal processing unit, and the transmission unit are capable of individually determining the presence or absence of an abnormality based on the determination signal. And a reset control unit that individually resets the operation of the part that is determined to be abnormal by the abnormality determination unit.

  In the imaging device according to the present invention, in the above invention, the abnormality determination unit is included in a signal transmitted by the imaging device, and an optical black region or a blanking region that is not exposed to light among the plurality of pixels. On the basis of data corresponding to the determination signal added to the signal, the presence or absence of abnormality in the imaging unit, the signal processing unit, and the transmission unit is individually determined.

  Further, in the imaging apparatus according to the present invention, in the above invention, the abnormality determination unit is configured to select the imaging unit, the signal processing unit, It is characterized in that the presence or absence of abnormality in the transmission unit is individually determined.

  In addition, an imaging system according to the present invention includes an imaging unit that outputs electrical signals after photoelectric conversion from a plurality of pixels as image information, and a signal processing unit that performs signal processing of signals including image information output from the imaging unit A first transmission unit that transmits at least a signal processed by the signal processing unit, a first reception unit that receives a signal from the outside, and a control unit that controls the operation of the imaging apparatus. The imaging unit, the signal processing unit, and the first transmission unit are each connected to the imaging device that generates a determination signal used to determine its own operation state, and is connected to the imaging device, and is externally connected. A second receiving unit that receives the signal, a second transmitting unit that transmits the signal to the outside, the imaging unit in the imaging device based on the determination signal, the signal processing unit, and the Difference in the first transmitter An external determination device that includes an abnormality determination unit that performs determination, and a reset control unit that generates a reset signal that resets the operation of the abnormal portion that has been determined to be abnormal by the abnormality determination unit. The operation of the abnormal part is reset based on the reset signal.

  In the imaging system according to the present invention as set forth in the invention described above, the first transmission unit superimposes the discrimination signal on the image information and transmits it to the external device.

  Further, in the imaging system according to the present invention, in the above invention, the abnormality determination unit is configured to select the imaging unit, the signal processing unit, and the signal processing unit based on a pixel value of an optical black region that is not exposed to light among the plurality of pixels. The presence or absence of abnormality in the first transmission unit is individually determined.

  According to the present invention, the imaging unit, the signal processing unit, and the transmission unit each generate a discrimination signal for discriminating its own operation state, and based on the generated discrimination signal, the imaging unit, the signal processing unit, Since the presence / absence of an abnormality in the transmission unit and the reception unit is individually determined, there is an effect that an abnormal part in the imaging apparatus can be specified in detail.

FIG. 1 is a diagram illustrating a schematic configuration of an endoscope system according to the first embodiment of the present invention. FIG. 2 is a block diagram illustrating a functional configuration of a main part of the endoscope system according to the first embodiment of the present invention. FIG. 3 is a diagram for explaining the abnormality determination process of the endoscope system according to the first embodiment of the present invention. FIG. 4 is a diagram for explaining the abnormality determination process of the endoscope system according to the first embodiment of the present invention. FIG. 5 is a diagram for explaining the abnormality determination process of the endoscope system according to the first embodiment of the present invention. FIG. 6 is a diagram for explaining abnormality determination processing of the endoscope system according to the first modification of the first embodiment of the present invention. FIG. 7 is a diagram illustrating a signal output mode of the endoscope system according to the second modification of the first embodiment of the present invention. FIG. 8 is a block diagram illustrating a functional configuration of a main part of the endoscope system according to the second embodiment of the present invention. FIG. 9 is a block diagram illustrating a functional configuration of a main part of the endoscope system according to the third embodiment of the present invention. FIG. 10 is a schematic diagram illustrating an example of an electrical signal of the endoscope system according to the third embodiment of the present invention. FIG. 11 is a flowchart showing disconnection detection processing according to another embodiment of the present invention.

  Hereinafter, as a mode for carrying out the present invention (hereinafter, referred to as “embodiment”), a medical endoscope system that captures and displays an image of a body cavity of a subject such as a patient will be described. Moreover, this invention is not limited by this embodiment. Furthermore, the same code | symbol is attached | subjected to the same part in description of drawing. Furthermore, the drawings are schematic, and it should be noted that the relationship between the thickness and width of each member, the ratio of each member, and the like are different from the actual ones. Moreover, the part from which a mutual dimension and ratio differ also in between drawings. In the following description, an endoscope system will be described as an example of an imaging system.

(Embodiment 1)
FIG. 1 is a diagram illustrating a schematic configuration of the endoscope system according to the first embodiment. FIG. 2 is a block diagram illustrating a functional configuration of a main part of the endoscope system 1. As shown in FIG. 1, an endoscope system 1 includes an endoscope 2 that captures an in-vivo image of a subject by inserting a distal end portion into a body cavity of a subject, and an in-vivo image captured by the endoscope 2. A control device 3 (external device) that performs predetermined image processing and comprehensively controls the operation of the entire endoscope system 1; a light source device 4 that generates illumination light emitted from the distal end of the endoscope 2; And a display device 5 that displays an in-vivo image subjected to image processing by the control device 3.

  The endoscope 2 includes an insertion portion 21 having an elongated shape having flexibility, an operation portion 22 that is connected to a proximal end side of the insertion portion 21 and receives input of various operation signals, and an insertion portion from the operation portion 22. And a universal cord 23 that includes various cables that extend in a direction different from the direction in which 21 extends and that are connected to the control device 3 and the light source device 4.

  The insertion portion 21 is connected to a distal end portion 24 incorporating an image pickup device to be described later, a bendable bending portion 25 constituted by a plurality of bending pieces, and a proximal end side of the bending portion 25, and has a flexible length. And a flexible tube portion 26 having a scale shape.

  The distal end portion 24 is configured by using a glass fiber or the like, and forms a light guide path for light generated by the light source device 4. An illumination lens 242 provided at the distal end of the light guide 241. An imaging device 244 as an imaging device that is provided at an imaging position of the optical system 243, receives light collected by the optical system 243, photoelectrically converts the light into an electrical signal, and performs predetermined signal processing; A treatment instrument channel (not shown) through which the treatment instrument for the endoscope 2 passes. The optical system 243 includes one or a plurality of lenses.

  The configuration of the image sensor 244 will be described with reference to FIG. As shown in FIG. 2, the image sensor 244 photoelectrically converts the light from the optical system 243 and outputs an electrical signal as image information, and the electrical signal output by the sensor unit 244a. The analog front end 244b (hereinafter referred to as “AFE unit 244b”) as a signal processing unit for performing noise removal and A / D conversion and the digital signal output from the AFE unit 244b are converted into parallel / serial and transmitted to the outside. P / S conversion unit 244c (transmission unit, first transmission unit), drive timing of sensor unit 244a, timing generator 244d that generates various signal processing pulses in AFE unit 244b and P / S conversion unit 244c, and imaging A control unit 244e that controls the operation of the element 244 and a storage unit 244k that stores various setting information are included. The image sensor 244 is a CMOS image sensor. The timing generator 244d receives various drive signals transmitted from the control device 3. Further, the control unit 244e receives various control signals transmitted from the control device 3. In the first embodiment, the control unit 244e is described as functioning as the first reception unit. However, the transmission / reception unit (the first reception unit and the first reception unit) that collectively transmits and receives control signals, setting data, and the like. May be separately provided).

  The sensor unit 244a includes a light receiving unit 244f in which a plurality of pixels each having a photodiode that accumulates a charge corresponding to the amount of light and an amplifier that amplifies the charge accumulated by the photodiode are arranged in a two-dimensional matrix, and a light receiving unit 244f. A readout unit 244g that reads out, as image information, an electrical signal generated by a pixel arbitrarily set as a readout target among the plurality of pixels.

  The AFE unit 244b reduces the noise component included in the electrical signal and adjusts the amplification factor of the electrical signal to maintain a constant output level, and outputs it via the CDS (Correlated Double Sampling) unit 244h and the CDS unit 244h. An A / D converter 244i that performs A / D conversion on the electrical signal that has been converted, and a correction unit 244j that corrects the electrical signal digitally converted by the A / D converter 244i. The CDS unit 244h performs noise reduction using, for example, a correlated double sampling method. The correction unit 244j performs image correction and color correction (tone correction (γ correction) of the RGB video signal) for pixel defects.

  The control unit 244e controls various operations of the distal end portion 24 according to the setting data received from the control device 3. The control unit 244e is configured using a CPU (Central Processing Unit) or the like. Further, the control unit 244e is based on a signal to which a determination signal (determination data) generated from each unit (for example, the sensor unit 244a, the AFE unit 244b, the P / S conversion unit 244c, and the timing generator 244d) is added. In addition, there are an abnormality determination unit 244l for determining the presence / absence of an abnormality in each unit, and a reset control unit 244m for individually resetting the abnormality part when the abnormality determination part 244l determines that there is an abnormality part.

  The storage unit 244k is realized by using a semiconductor memory such as a flash memory or a DRAM (Dynamic Random Access Memory). The storage unit 244k includes identification information of the control device 3, observation information indicating a frame sequential type or simultaneous type observation method, and an imaging element 244. Setting information such as imaging speed (frame rate), reading speed of pixel information from any pixel of the sensor unit 244a, shutter control setting, setting data of the AFE unit 244b, P / S conversion unit 244c, and timing generator 244d, In addition, the transmission control information of the pixel information read by the AFE unit 244b, reference information for determining the abnormal part, and the like are stored.

  A collective cable 245 in which a plurality of signal lines for transmitting and receiving electric signals to and from the control device 3 are bundled is connected between the operation unit 22 and the tip unit 24, and the operation unit 22 and the connector unit 27 are connected. A collective cable 224 is connected between them. The plurality of signal lines include a signal line for transmitting the video signal output from the image pickup device 244 to the control device 3, a signal line for transmitting the control signal output from the control device 3 to the image pickup device 244, and the like. Further, for transmission / reception of electrical signals, a system (differential transmission) in which one signal is transmitted using two signal lines (differential signal lines) is used. By making the voltage between the differential signal lines positive (+) and negative (-, phase inversion), it is possible to cancel even if noise is mixed in each line. High-speed transmission is possible. The differential transmission described above is preferably used when the length of the universal cord 23 or the flexible tube portion 26 is long. When the length is short, the single end signal transmission using a single end signal is used. Is applicable.

  The operation unit 22 includes a bending knob 221 that bends the bending unit 25 in the vertical direction and the left-right direction, a treatment tool insertion unit 222 that inserts a treatment tool such as a biological forceps, a laser knife, and an inspection probe into the body cavity, an air supply unit, A plurality of first input switches 223a for inputting signals for switching between water supply means, gas supply means, and the like, and a switch 223 consisting of a plurality of second input switches 223b for inputting settings of the control device 3 and the light source device 4. Have. The treatment tool inserted from the treatment tool insertion portion 222 is exposed from the opening via the treatment tool channel of the distal end portion 24 (not shown). Here, when the signal is transmitted from the connector portion 27 to the distal end portion 24, a circuit that relays the signal with the universal cord 23 and converts the differential signal into a single-ended signal is provided. Further, when a differential signal is transmitted to the distal end portion 24, a conversion circuit for converting the differential signal into a single-ended signal may be a differential buffer, or a differential signal transmitted from the distal end portion 24 to the connector portion 27 may be transmitted. It is possible to relay once and arrange a differential buffer.

  The universal cord 23 includes at least a light guide 241 and a collective cable 224. The universal cord 23 has a connector portion 27 (see FIG. 1) that is detachably attached to the light source device 4. The connector portion 27 has a coiled coil cable 27a extending therein, and has an electrical connector portion 28 that is detachable from the control device 3 at the extending end of the coil cable 27a. The connector unit 27 includes a control unit 271 that controls the endoscope 2, an FPGA (Field Programmable Gate Array) 272, and an EEPROM 273 that records configuration data.

  Next, the configuration of the control device 3 will be described. The control device 3 includes an S / P conversion unit 301, an image processing unit 302, a brightness detection unit 303, a light control unit 304, a read address setting unit 305, a drive signal generation unit 306, and an input unit 307. , A storage unit 308, a control unit 309, and a reference clock generation unit 310. In the present embodiment, a frame sequential configuration will be described as an example of the control device 3, but it can be applied to a simultaneous type.

  The S / P converter 301 performs serial / parallel conversion on the video signal (electrical signal) received from the distal end portion 24.

  The image processing unit 302 generates an in-vivo image displayed by the display device 5 based on the parallel video signal output from the S / P conversion unit 301. The image processing unit 302 includes a synchronization unit 302a, a white balance (WB) adjustment unit 302b, a gain adjustment unit 302c, a γ correction unit 302d, a D / A conversion unit 302e, a format change unit 302f, and a sample-use unit. It has a memory 302g and a still image memory 302h.

  The synchronization unit 302a inputs a video signal input as pixel information to three memories (not shown) provided for each pixel, and associates them with the pixel addresses of the light receiving unit 244f read by the reading unit 244g. Thus, the values of the respective memories are held while being sequentially updated, and the video signals of these three memories are synchronized as RGB video signals. The synchronization unit 302a sequentially outputs the synchronized RGB video signals to the white balance adjustment unit 302b, and outputs a part of the RGB video signals to the sample memory 302g for image analysis such as brightness detection.

  The white balance adjustment unit 302b automatically adjusts the white balance of the RGB video signal. Specifically, the white balance adjustment unit 302b automatically adjusts the white balance of the RGB video signal based on the color temperature included in the RGB video signal.

  The gain adjusting unit 302c adjusts the gain of the RGB video signal. The gain adjustment unit 302c outputs the RGB signal subjected to gain adjustment to the γ correction unit 302d, and a part of the RGB signal for still image display, enlarged image display, or emphasized image display 302h. Output to.

  The γ correction unit 302 d performs gradation correction (γ correction) of the RGB video signal in correspondence with the display device 5.

  The D / A converter 302e converts the RGB video signal after gradation correction output from the γ correction unit 302d into an analog signal.

  The format changing unit 302 f changes the video signal converted into the analog signal to a moving image file format such as a high-definition method and outputs the video signal to the display device 5.

  The brightness detection unit 303 detects the brightness level corresponding to each pixel from the RGB video signal held in the sample memory 302g, records the detected brightness level in a memory provided therein, and the control unit 309. Output to. Also, the brightness detection unit 303 calculates a white balance adjustment value, a gain adjustment value, and a light irradiation amount based on the detected brightness level, and outputs the gain adjustment value to the gain adjustment unit 302c. In addition, the white balance adjustment value, the white balance adjustment unit 302 b, and the light irradiation amount are output to the dimming unit 304.

  Under the control of the control unit 309, the light control unit 304 sets the type of light generated by the light source device 4, the light amount, the light emission timing, and the like based on the light irradiation amount calculated by the brightness detection unit 303. A light source synchronization signal including the set conditions is transmitted to the light source device 4.

  The read address setting unit 305 has a function of setting the pixel to be read on the light receiving surface of the sensor unit 244a and the reading order by communicating with the control unit 271 in the endoscope 2. The control unit 271 reads out the type information of the sensor unit 224 a stored in the EEPROM 273 and transmits it to the control device 3. The read address setting unit 305 has a function of setting the pixel address of the sensor unit 244a read by the AFE unit 244b. Further, the read address setting unit 305 outputs the set address information of the pixel to be read to the synchronization unit 302a.

  The drive signal generation unit 306 generates drive timing signals (horizontal synchronization signal (HD) and vertical synchronization signal (VD)) for driving the endoscope 2, and is included in the FPGA 272 and the collective cables 224 and 245. The signal is transmitted to the timing generator 244d (image sensor 244) via a predetermined signal line. This timing signal includes address information of a pixel to be read.

  The input unit 307 inputs various signals such as an operation instruction signal for instructing the operation of the endoscope system 1 such as freeze, release, various image adjustments (enhancement, electronic enlargement, color tone, etc.) set by the front panel or the keyboard. Accept.

  The storage unit 308 is realized using a semiconductor memory such as a flash memory or a DRAM (Dynamic Random Access Memory). The storage unit 308 stores various programs for operating the endoscope system 1 and data including various parameters necessary for the operation of the endoscope system 1. The storage unit 308 stores identification information and observation information of the control device 3. Here, the identification information includes the unique information (ID) of the control device 3, the year, the specification information of the control unit 309, and the transmission rate information.

  The control unit 309 is configured using a CPU or the like, and performs drive control of each component including the endoscope 2 and the light source device 4, input / output control of information with respect to each component, and the like. The control unit 309 receives setting data and the like for imaging control by the FPGA 272 of the connector unit 27, and transmits signals and data necessary for the imaging device 244 via a predetermined signal line included in the collective cables 224 and 245. To 244e. In addition, you may provide separately the transmission part which transmits various signals to the front-end | tip part 24 side.

  The reference clock generation unit 310 generates a reference clock signal that serves as a reference for the operation of each component of the endoscope system 1 and supplies the generated reference clock signal to each component of the endoscope system 1.

  Next, the configuration of the light source device 4 will be described. The light source device 4 includes a light source 41, a light source driver 42, a rotary filter 43, a drive unit 44, a drive driver 45, and a light source control unit 46.

  The light source 41 is configured using a white LED (Light Emitting Diode), a xenon lamp, or the like, and generates white light under the control of the light source control unit 46. The light source driver 42 causes the light source 41 to generate white light by supplying current to the light source 41 under the control of the light source control unit 46. Light generated by the light source 41 is irradiated from the tip of the tip portion 24 via the rotary filter 43, a condenser lens (not shown), and the light guide 241.

  The rotary filter 43 is disposed on the optical path of white light emitted from the light source 41, and rotates to transmit only the light having a predetermined wavelength band through the white light emitted from the light source 41. Specifically, the rotating filter 43 includes a red filter 431, a green filter 432, and a blue filter 433 that transmit light having respective wavelength bands of red light (R), green light (G), and blue light (B). Have. The rotary filter 43 sequentially transmits light having wavelength bands of red, green, and blue (for example, red: 600 nm to 700 nm, green: 500 nm to 600 nm, blue: 400 nm to 500 nm) by rotating. As a result, the white light emitted from the light source 41 can sequentially emit one of the narrow-band red light, green light, and blue light to the endoscope 2.

  The drive unit 44 is configured using a stepping motor, a DC motor, or the like, and rotates the rotary filter 43 with reference to the synchronization signal transmitted from the control device 3. The drive driver 45 supplies a predetermined current to the drive unit 44 under the control of the light source control unit 46.

  The light source control unit 46 controls the amount of current supplied to the light source 41 according to the dimming signal transmitted from the dimming unit 304. Further, the light source control unit 46 rotates the rotary filter 43 by driving the drive unit 44 via the drive driver 45 under the control of the control unit 309.

  The display device 5 has a function of receiving and displaying the in-vivo image generated by the control device 3 via the video cable from the control device 3. The display device 5 is configured using, for example, liquid crystal or organic EL (Electro Luminescence).

  In the endoscope system 1 having the above-described configuration, determination signals are received from respective parts (for example, the sensor part 244a, the AFE part 244b, the P / S conversion part 244c, and the timing generator 244d) of the endoscope 2 (tip part 24). (Determination data) is generated, and the abnormality determination unit 244l determines whether there is an abnormality based on a signal output from the P / S conversion unit 244c and added with the determination signal of each unit. When the abnormality determining unit 244l determines that there is an abnormal part, the reset control unit 244m individually resets the abnormal part.

  Next, the abnormal part determination process will be described. First, the abnormality determination unit 244l determines whether or not each unit (for example, the sensor unit 244a, the AFE unit 244b, the P / S conversion unit 244c, and the timing generator 244d) is abnormal based on a signal output from the P / S conversion unit 244c. Determine.

3 to 5 are diagrams for explaining the abnormality determination process of the endoscope system 1 according to the first embodiment. Here, an area where the pixels of the light receiving unit 244f are arranged is referred to as a pixel arrangement area R, and an area where pixels (effective pixels) used in actual imaging are arranged in the pixel arrangement area R is an effective pixel area. R _a is provided around the effective pixel area R _a , for example, a pixel for noise correction, and is a light-shielded pixel area as an optical black (OB) area R _b .

At this time, each unit of the image sensor 244, for example, the sensor unit 244a, the AFE unit 244b, and the P / S conversion unit 244c are generated at different timings in the region corresponding to the optical black region _Rb or the blanking region in the image data. A discrimination signal is added as discrimination data. This place corresponds to, for example, the regions R _{d1 to} R _d3 shown in FIGS. Thereafter, each unit of the image sensor 244 outputs the image data with the determination data added thereto as an electric signal to the abnormality determination unit 244l.

The regions R _{d1 to} R _d3 may have the same size or different sizes as long as the data for determination of each part can be added. Further, the determination data of the CDS unit 244h, the A / D conversion unit 244i, and the correction unit 244j are added to the additional area of the AFE unit 244b.

When an electrical signal to which discrimination data is added is input, the abnormality determination unit 244l extracts the determination data of each unit and determines whether there is an abnormality. When the abnormality determination of the sensor unit 244a is performed, the abnormality determination unit 244l stores, for example, an SN ratio that is a ratio of a signal (Signal) and noise (Noise) of the optical black region _{Rb in} the storage unit 244k in advance. It is determined whether or not there is an abnormality as compared with a reference (standard S / N ratio).

  When performing abnormality determination of the CDS unit 244h and the A / D conversion unit 244i, the abnormality determination unit 244l uses, for example, a predetermined test pattern or a clamped OB value as the determination data, and is stored in the storage unit 244k in advance. It is determined whether or not it is abnormal compared with a reference (reference test pattern or reference OB value).

  When performing abnormality determination of the correction unit 244j, the abnormality determination unit 244l uses, for example, a reference (pseudo correction target correction) stored in advance in the storage unit 244k using the determination pseudo correction target generated by the correction unit 244j. Compared with the expected value of the effect), it is determined whether or not it is abnormal. Specifically, in the case of flaw correction, the abnormality discriminating unit 244l compares the correction effect on the flaw data generated by the correcting unit 244j for a predetermined level for discrimination with the expected value of the correction effect on the flaw data. Then, abnormality determination is performed. Further, in the case of color correction, the abnormality determination unit 244l compares the correction effect for the correction to the predetermined level color data for determination generated by the correction unit 244j with the expected value of the correction effect for the color data. I do.

  When performing abnormality determination of the P / S conversion unit 244c, the abnormality determination unit 244l uses, for example, a predetermined test pattern as the determination data and compares it with a reference (reference test pattern) stored in advance in the storage unit 244k. Then, it is determined whether or not it is abnormal.

  Further, when performing abnormality determination of the timing generator 244d, the abnormality determination unit 244l acquires, for example, a signal input to the timing generator 244d and a signal output from the timing generator 244d, and the output signal is predetermined. It is determined whether or not it is abnormal by determining whether or not it is toggled at this timing. For example, each counter value of a first counter that confirms toggle of the input signal and a second counter that confirms toggle of the output signal reset by the first counter is compared to determine abnormality.

  The abnormality determination unit 244l acquires only the signal output from the timing generator 244d, compares this output signal with reference data stored in advance in the storage unit 244k, and determines whether or not there is an abnormality. It may be a thing. It is also possible to determine an abnormality with respect to the output of the timing generator 244d using a watch dog timer.

  When the abnormality determination processing for each unit as described above is completed and the abnormality determination unit 244l determines that an abnormal part exists, the reset control unit 244m individually resets the part determined to be an abnormal part. When there is an abnormality in the sensor unit 244a and the P / S conversion unit 244c, the reset control unit 244m turns off the power of the light receiving unit 244f for a predetermined time, and then turns it on to start up. When there is an abnormality in the timing generator 244d, the CDS unit 244h, and the A / D conversion unit 244i, the reset control unit 244m reads the setting information stored in the storage unit 244k again and reloads it. When there is an abnormality in the correction unit 244j, the reset control unit 244m causes the correction unit 244j to reload various parameters stored in the storage unit 244k.

  If the timing generator 244d is abnormal, the counter value may be reset. Further, in the timing generator 244d, the CDS unit 244h, and the A / D conversion unit 244i, when the abnormal state is not resolved even by reloading, the power is turned off for a predetermined time and then turned on and activated.

  According to the first embodiment described above, the sensor unit 244a, the AFE unit 244b, the P / S conversion unit 244c, and the timing generator 244d are each caused to generate a determination signal for determining their own operation state, and the video signal Since the abnormality determination unit 244l individually determines the presence / absence of abnormality in each unit based on this signal, the abnormal part in the endoscope 2, particularly the abnormality in the image sensor 244 is detected. The location can be specified in detail.

  Further, according to the first embodiment, since the reset control unit 244m individually resets the location where an abnormality has occurred, even when there is an abnormality, the time required to return from the abnormal state is shortened. It becomes possible.

  In the first embodiment described above, the discrimination signal generated by each unit may be added to the video signal obtained by the sensor unit 244a, or the discrimination signal is used as the abnormality discrimination mode. It may be output separately from the video signal.

  Further, in the first embodiment described above, the light source device 4 has been described as a surface sequential type having the rotation filter 43. However, if the image sensor 244 has a color filter, the rotation filter 43 is used. It may be a simultaneous type that does not have.

FIG. 6 is a diagram for explaining an abnormality determination process of the endoscope system according to the first modification of the first embodiment. In the first embodiment described above, it has been described that the discrimination data of each part is added to the pixel arrangement region R corresponding to one frame corresponding to one image, which consists of a plurality of pixels. One determination data may be added. For example, as shown in FIG. 6, the discrimination data at any of the above-mentioned locations is added to the region D _d4 of the pixel arrangement region R corresponding to a certain frame, and for different frames, this frame For the region R _d4 of the pixel array region R, data for determination at different locations is added.

  Further, for the pixels arranged in a two-dimensional matrix, the discrimination data added to the output signal may be different between the odd lines and the even lines. Further, the determination data added in terms of time may be different.

  Here, in addition to the first embodiment and the first modification described above, the abnormality determination unit determines the abnormality of each unit by using the pixel value of the OB region (S / N ratio or average value of the OB value). Also good. For example, when the S / N ratio is higher than a predetermined numerical value, it can be determined that the thermal noise due to the temperature increase is increased in the sensor unit 224a. Further, when the average value is different from the set value, it can be determined in the CDS unit 244h and the A / D conversion unit 244i that a clamping abnormality has occurred. Here, when it is assumed that the OB value is constant within a predetermined range, the P / S conversion unit 224c adds a determination signal so that the P / S is added to the sensor unit 244a and the AFE unit 244b. It is possible to determine abnormality of the conversion unit 224c.

  FIG. 7 is a diagram for explaining a signal output mode of the endoscope system according to the second modification of the first embodiment. In the first embodiment described above, after each part adds discrimination data (discrimination signal) to the video signal output from the sensor unit 244a, the P / S conversion unit 244c uses the abnormality discrimination unit 244l for discrimination. However, as shown in FIG. 7, each unit may individually output a determination analog / digital signal to the abnormality determination unit 244l.

  At this time, each unit may continuously output a determination signal, or may output a determination signal in a set line according to an odd line and an even line. In addition, each unit may generate and output a discrimination signal at a predetermined time interval.

  In the abnormality determination according to the first embodiment and the first and second modifications described above, if it is determined that at least the timing generator 244d is abnormal, the sensor unit 244a and the AFE unit 244b (CDS unit 244h, A / D conversion) Unit 244i, correction unit 244j) and P / S conversion unit 244c depend on timing generator 244d, so that reset control unit 244m masks sensor unit 244a, AFE unit 244b and P / S conversion unit 244c to perform timing. It is preferable to reset the generator 244d with priority.

(Embodiment 2)
FIG. 8 is a block diagram illustrating a functional configuration of a main part of the endoscope system 1a according to the second embodiment. In addition, the same code | symbol is attached | subjected to the location same as the structure concerning the endoscope system 1 mentioned above. In the first embodiment described above, the tip 24 is described as performing abnormality determination and reset control. However, the abnormality determination and reset control may be performed on the control device 3 (external device) side.

  In the endoscope system 1a, as shown in FIG. 8, instead of the abnormality determination unit 244l and the reset control unit 244m provided in the control unit 244 of the endoscope system 1, the control unit 309 of the control device 3a includes: An abnormality determination unit 309a and a reset control unit 309b are included. Further, the storage unit 308 stores setting information such as setting data of the AFE unit 244b, the P / S conversion unit 244c, and the timing generator 244d, reference information for determining an abnormal location, and the like in addition to the various types of information described above. To do.

  The abnormality determination unit 309a receives each unit (for example, the sensor unit 244a, the AFE unit 244b, the P / S conversion unit 244c, and the timing) received by the control unit 309 separately from the video signal as a determination signal (control signal) from the distal end portion 24a. Based on the determination data of the generator 244d), the presence or absence of an abnormality is determined. The discrimination process for each unit is the same as that in the first embodiment described above.

  The reset control unit 309b generates a reset signal for individually resetting the location determined as an abnormal location and outputs the reset signal to the control unit 309 when the abnormality determination unit 309a determines that an abnormal location exists. The control unit 309 outputs the generated reset signal to the control unit 244e of the distal end portion 24a. The reset process performed by the control unit 244e based on the reset signal is the same as that in the first embodiment (the reset process performed by the reset control unit 244m). In the second embodiment, the control unit 309 is described as functioning as a second receiving unit and a second transmitting unit. However, as a communication interface, transmission / reception that transmits and receives control signals and setting data in a batch is performed. The unit (corresponding to the second receiving unit and the second transmitting unit) may be provided separately.

  According to the second embodiment described above, as in the first embodiment described above, the determination that causes the sensor unit 244a, the AFE unit 244b, the P / S conversion unit 244c, and the timing generator 244d to determine its own operating state. Signal is generated, and based on the determination signal, the abnormality determination unit 309a individually determines the presence / absence of abnormality in each unit. The abnormal part can be specified in detail.

  Further, according to the second embodiment, the reset control unit 309b generates a reset signal and individually resets the location where there was an abnormality. Therefore, even if there is an abnormality, recovery from the abnormal state is performed. It is possible to shorten the time required for the operation.

  Further, according to the second embodiment, since abnormality determination and reset signal generation are performed on the control device 3a side, when there is an abnormality or when the reset signal is generated, the display device 5 is displayed. This makes it possible for the observer to confirm the state of the endoscope 2.

(Embodiment 3)
FIG. 9 is a block diagram illustrating a functional configuration of a main part of the endoscope system 1b according to the third embodiment. In addition, the same code | symbol is attached | subjected to the location same as the structure concerning the endoscope system 1 and 1a mentioned above. In the first embodiment described above, the tip 24 is described as performing abnormality determination and reset control. However, the abnormality determination and reset control may be performed on the control device 3 (external device) side. In the second embodiment described above, it is described that the determination data transmitted as the determination signal is used separately from the video signal. However, as in the third embodiment, the determination signal is superimposed on the video signal. You may do.

  In the endoscope system 1b, as shown in FIG. 9, a control unit 309 of the control device 3a is replaced with an abnormality determination unit 244l and a reset control unit 244m provided in the control unit 244 of the endoscope system 1 described above. An abnormality determination unit 309a and a reset control unit 309b are included. Further, the storage unit 308 stores setting information such as setting data of the AFE unit 244b, the P / S conversion unit 244c, and the timing generator 244d, reference information for determining an abnormal location, and the like in addition to the various types of information described above. To do.

  The tip 24b is provided between the AFE unit 244b and the P / S conversion unit 244c of the image sensor 244n, and includes a sensor unit 244a and an AFE unit 244b (CDS unit 244h, A / D conversion unit 244i, correction unit 244j). A superimposing unit 244o that superimposes the generated discrimination signal on the video signal is provided.

FIG. 10 is a schematic diagram illustrating an example of an electrical signal of the endoscope system according to the third embodiment. Superimposing section 244o is the blanking period of the image data _{D p,} which corresponds to one frame (blanking region of the synchronizing signal _{S s),} it superimposes the identification data _D 1 to D _4. The determination data D _{1 to} D ₄ include, for example, each determination data of the sensor unit 244a, the CDS unit 244h, the A / D conversion unit 244i, and the correction unit 244j. Further, it is possible to determine abnormality of each part by superimposing own determination data of the superimposing unit 244o and determination data of the P / S conversion unit 244c and the timing generator 244d.

  The abnormality determination unit 309a includes each unit (for example, the sensor unit 244a, the AFE unit 244b, the P / S conversion unit 244c, and the timing generator) superimposed on the video signal output from the P / S conversion unit 244c to the S / P conversion unit 301. The presence / absence of an abnormality is determined based on the determination signal 244d). The discrimination process for each unit is the same as that in the first embodiment described above.

  The reset control unit 309b generates a reset signal for individually resetting the location determined as an abnormal location and outputs the reset signal to the control unit 309 when the abnormality determination unit 309a determines that an abnormal location exists. The control unit 309 outputs the generated reset signal to the control unit 244e of the distal end portion 24b. The reset process performed by the control unit 244e based on the reset signal is the same as that in the first embodiment (the reset process performed by the reset control unit 244m). In the third embodiment, it is assumed that the S / P conversion unit 301 functions as a second reception unit and the control unit 309 functions as a second transmission unit. However, as a communication interface, a control signal, setting data, or the like is used. The transmission / reception unit (corresponding to the second reception unit and the second transmission unit) that transmits and receives the data collectively may be provided separately.

  According to the third embodiment described above, as in the first embodiment described above, the determination that causes the sensor unit 244a, the AFE unit 244b, the P / S conversion unit 244c, and the timing generator 244d to determine its own operating state. Signal is generated, and based on the determination signal, the abnormality determination unit 309a individually determines the presence / absence of abnormality in each unit. Therefore, the abnormal part in the endoscope 2, particularly the imaging element 244n The abnormal part can be specified in detail.

  Further, according to the third embodiment, the reset control unit 309b generates a reset signal and individually resets the location where the abnormality occurred, so that even if there is an abnormality, the return from the abnormal state is possible. It is possible to shorten the time required for the operation.

(Other embodiments)
FIG. 11 is a flowchart showing an abnormality detection process according to another embodiment of the present invention. As in the above-described embodiment, in addition to determining the abnormality of each part using the determination signal (determination data), it is also possible to detect the abnormality of each component using the video signal and the detection signal. Is possible. In the present embodiment, the control unit 271 of the connector unit 27 is described as performing abnormality detection with respect to the configuration of the first embodiment described above.

  First, the control part 271 starts signal transmission with the front-end | tip part 24 after starting (step S101). Here, the control unit 271 transmits a predetermined detection signal to the distal end portion 24 via the FPGA 272. At this time, the control unit 244e of the distal end portion 24 detects whether or not a predetermined detection signal is received, and feeds back to the connector portion 27 side by register communication.

  After feedback by the control unit 244e, the control unit 271 determines whether or not a video signal and a detection signal are received from the distal end portion 24 side (step S102). Here, when the control unit 271 determines that the video signal and the detection signal are received from the distal end portion 24 side (step S102: Yes), the control unit 271 determines whether failure information is included in the received detection signal (step S102: Yes). Step S103). When determining that the failure information is not included in the detection signal (step S103: No), the control unit 271 ends the abnormality detection process.

  When the control unit 271 determines that the failure information is included in the detection signal (step S103: Yes), the control unit 271 proceeds to step S104, outputs the failure information to the control unit 309 of the control device 3, and The unit 24 is notified that there is a failure. At this time, the control unit 309 displays a failure message on the display device 5 or the like based on the received failure information.

  On the other hand, when the control unit 271 determines that the video signal and the detection signal are not received from the distal end portion 24 side (step S102: No), it is determined whether the unreceived signal is both the video signal and the detection signal. It is determined whether the other is present (step S105). When the control unit 271 determines that the unreceived signal is both the video signal and the detection signal (step S105: Yes), the control unit 271 determines that the distal end portion 24 is not activated (step S106), and the distal end portion 24. Is notified to the control unit 309 of the control device 3 (step S107).

  In addition, when the control unit 271 determines that the unreceived signal is one of the video signal and the detection signal (step S105: No), the control unit 271 determines whether the unreceived signal is a video signal. (Step S108). Here, if the control unit 271 determines that the unreceived signal is a video signal (step S108: Yes), the control unit 271 determines that the output of the video signal is abnormal and indicates that the video signal output is abnormal. 3 is notified to the control unit 309 (step S109).

  On the other hand, when the control unit 271 determines that the unreceived signal is a detection signal (step S108: No), the control unit 271 determines that the detection signal output is abnormal and indicates that the detection signal output is abnormal. Is notified to the control unit 309 (step S110).

  By the abnormality detection process described above, it is possible to detect whether there is an abnormality in the distal end portion 24 or which output part is abnormal. Further, when this abnormality detection process is performed and it is determined that there is an abnormality in the distal end portion 24, the abnormality determination process is more efficiently performed by performing the abnormality determination of each part of the first to third embodiments described above. Is possible.

1, 1a, 1b Endoscope system 2 Endoscope 3 Control device 4 Light source device 5 Display device 21 Insertion part 22 Operation part 23 Universal code 24, 24a, 24b Tip part 25 Bending part 26 Flexible tube part 27 Connector part 28 Electrical connector section 41 Light source 42 Light source driver 43 Rotating filter 44 Drive section 45 Drive driver 46 Light source control section 221 Bending knob 222 Treatment instrument insertion section 223 Switch 241 Light guide 242 Illumination lens 243 Optical system 244, 244n Image sensor 244a Sensor section 244b Analog Front end 244c P / S conversion unit 244d Timing generator 244e, 271, 309 Control unit 244f Light receiving unit 244g Reading unit 244h CDS unit 244i A / D conversion unit 244j Correction unit 244k, 308 Storage unit 2 4l, 309a abnormality judgment unit 244m, 309b reset controller 245 collective cable 272 FPGA
302 Image processing unit 303 Brightness detection unit 304 Dimming unit 305 Read address setting unit 306 Drive signal generation unit 307 Input unit 310 Reference clock generation unit

Claims (3)

An imaging unit that outputs electric signals after photoelectric conversion from a plurality of pixels as image information, a signal processing unit that performs signal processing of a signal including image information output from the imaging unit, and a signal processed by the signal processing unit In an imaging device that is a CMOS imaging device including a transmission unit that transmits
The imaging unit, the signal processing unit, and the transmission unit each generate a determination signal used to determine its own operation state ,
An image pickup apparatus , wherein the determination signal is added to an optical black area or a blanking area where light is not irradiated in the plurality of pixels in the signal . Based on the determination signal, an abnormality determination unit capable of individually determining presence or absence of abnormality in the imaging unit, the signal processing unit, and the transmission unit;
A reset control unit for individually resetting the operation of the portion determined to be abnormal by the abnormality determination unit;
The imaging apparatus according to claim 1, further comprising: An imaging unit that outputs electric signals after photoelectric conversion from a plurality of pixels as image information, a signal processing unit that performs signal processing of a signal including image information output from the imaging unit, and at least the signal processing unit processed A first transmission unit that transmits a signal to the outside; a first reception unit that receives a signal from the outside; and a control unit that controls its own operation; the imaging unit, the signal processing unit, and An imaging apparatus that is a CMOS imaging element in which each of the first transmission units generates a determination signal used to determine its own operation state;
In the imaging device based on the determination signal, a second receiving unit that is connected to the imaging device and receives a signal from the outside, a second transmitting unit that transmits the signal to the outside, and the like An abnormality determination unit that performs abnormality determination of the imaging unit, the signal processing unit, and the first transmission unit, and a reset that generates a reset signal that resets the operation of the abnormal portion determined to be abnormal by the abnormality determination unit An external device having a control unit;
With
The imaging device transmits the signal obtained by adding the determination signal to an optical black area, or a blanking area, which is not exposed to light among the plurality of pixels,
The said control part resets operation | movement of the said abnormal location based on the said reset signal, The imaging system characterized by the above-mentioned.

Images