JPH03125573A - Imaging device for high temperature object - Google Patents

Abstract

PURPOSE:To facilitate identification of a high temperature object by modulating a luminance signal of a visual light video image picked up by a visual light television camera with a luminance signal of an infrared-ray video image picked up by an infrared-ray television camera so as to output a video signal emphasizing a visual light image of the high temperature object. CONSTITUTION:An infrared-ray television camera picks up an image by using an infrared-ray area and a visual light television camera picks up an image by using a visual light area and an optical coupling means 10 couples the images picked up by the infrared-ray television camera and the visual light television camera coaxially at a location toward the image from an image forming lens respectively. Then a 1st signal processing means 14 modulates a luminance signal of a visual light video image picked up by the visual light television camera with a luminance signal of an infrared-ray video image picked up by the infrared-ray television camera and outputs a video signal emphasizing the visual light image of a high temperature object 1. A picture display means 15 displays the video signal outputted from the 1st signal processing means 14. Thus, the identification of the high temperature object is facilitated.

Description

[Detailed Description of the Invention] [Industrial Field of Application] This invention relates to signal processing of infrared images and visible light images respectively captured by an optically coupled infrared television camera and visible light television camera. The present invention relates to a high-temperature object imaging device that enables display of a visible light image of a high-temperature object with emphasis or color.

[Prior art] Currently, CCD (Charge Coupled Device) in the far infrared region (wavelength of approximately 3 μm to 15 μm) is used.
ce) Cameras have been put into practical use at a level of perfection equivalent to that of a high-definition TV, and remote sensing of temperature distribution using a mechanical scanning (e.g. mirror scanning) imager called thermovision has already become commonplace. There is. As a technical document in this field, for example, Mitsubishi Electric Technical Report, vol.
, 82, No. 5.1988, Seto et al., “512
There are X5121RcsD imaging devices "P, 65-68.

The above document describes a charge sweep D (CS D) system in which 512 x 512 infrared detection elements are arranged on a silicon substrate and scanning is performed by an electronic circuit on the substrate.
discloses a technology for an infrared imaging device using In addition, the detection wavelength band of the above device is 3 to 5 μm.
The image detected using the above wavelength band is displayed as a black and white TV image compliant with the NTSC system (TV system in the United States and Japan).

[Problems to be Solved by the Invention] The image obtained from the conventional infrared (hereinafter referred to as IR for short) TV left camera as described above is
The detection wavelength band of the IR is the visible light wavelength band (0.4~0.
(approximately 75 μm), so for the human eye, which is accustomed to visible light images, the IR caused by spontaneous blackbody radiation is
The image is not familiar and may be hard to understand. For example, it's like looking at a charcoal flame or a red-hot piece of metal (such as nichrome wire) in a pitch-black room, but if you knew in advance that there was a brazier or electric heater in the room. ,
You can tell by looking at the image of a flame or a red-hot nichrome wire in the IR wavelength band, but in other cases, unless you turn on a light and look at the optical image of visible light, you can't tell what it is just by looking at the IR optical image. I don't understand.

In other words, since conventional IR imaging devices display optical images only in the IH wavelength band, there is a problem in that in order to identify an imaged object without prior knowledge, it is necessary to also see an optical image in visible light. Ta.

The present invention has been made in order to solve such problems, and is an imaging device for high-temperature objects that organically combines an image of IR self-luminescence and an image of visible reflected light, thereby making it possible to easily identify high-temperature objects. The purpose is to obtain.

[Means for Solving the Problems] A high temperature object imaging device according to the first invention includes:
An infrared television camera that captures images in the infrared region, a visible light television camera that captures images in the visible light region, and the infrared television camera and visible light television camera are coaxially arranged in sections on the image side from their respective imaging lenses. An image in which the visible light image of the high-temperature object is emphasized by modulating the brightness signal of the visible light image captured by the visible light television camera with the optical coupling means for coupling and the brightness signal of the infrared image captured by the infrared television camera. The apparatus includes a first signal processing means that outputs a signal, and an image display means that displays a video signal outputted from the first signal processing means.

The high-temperature object imaging device according to the second invention includes:
In the first aspect, the first signal processing means processes the luminance signal of the infrared image itself or a signal obtained by processing the same, and the luminance signal of the visible light image or the R, G, and B color 3 signals.
It has a multiplication means for performing multiplication with the primary color signal.

The imaging device for a high-temperature object according to the third invention includes:
In the first invention, instead of the first signal processing means, the video signal of either the infrared image or the visible light image is used to perform binary processing by nonlinear processing, blurring processing, and contour confirmation of the other video signal. The apparatus is equipped with a second signal processing means that performs one of the regionalization processes or a combination of the above processes.

The imaging device for a high-temperature object according to the fourth invention includes:
In the first, second, or third invention, when the infrared television camera and the visible light television camera take images asynchronously, or the total number of pixels or the pixel distribution form of the two television cameras is different, Each image data imaged by the two television cameras is stored in an address of a frame memory corresponding to the display position of the image data, and the stored data is stored in the first signal processing means or the second signal processing means. It is equipped with a digital scan converter that supplies

The imaging device for a high-temperature object according to the fifth invention includes:
In the first invention, in place of the first signal processing means, when the visible light television camera is a monochrome television camera, an infrared image captured by the infrared television camera is used. The apparatus is equipped with a third signal processing means for outputting a color video signal in which a black and white video is colored with at least two or more colors.

[Function] In the first invention, the infrared television camera captures images in the infrared region, the visible light television camera captures images in the visible light region, and the optical coupling means connects the infrared television camera and the visible light television camera. are coupled coaxially in a section on the image side of each imaging lens. The first signal processing means modulates the brightness signal of the visible light image taken by the visible light television camera using the brightness signal of the infrared image taken by the infrared television camera, and emphasizes the visible light image of the high temperature object. A video signal is output, and the image display means displays the video signal output from the first signal processing means.

In this second invention, the multiplication means included in the first signal processing means in the first invention combines the luminance signal of the infrared image itself or a signal obtained by signal processing thereof, and the luminance signal of the visible light image or Multiplication with the three primary color signals of RlG and B is performed.

In this third invention, instead of the first signal processing means in the first invention, the second signal processing means generates an image of the other by using a video signal of either the infrared image or the visible light image. Any one of signal non-linear processing, blurring processing, binary region processing by contour confirmation, or a combination of the above processing is performed.

In this fourth invention, a digital scan converter is provided in the first, second, or third invention, and the digital scan converter is configured such that the infrared television camera and the visible light television camera take images asynchronously;
Alternatively, when the total number of pixels or the pixel distribution format of the two television cameras is different, each image data imaged by the two television cameras is stored in a frame memory address corresponding to the display position of the image data. , supplies the stored data to the first signal processing means or the second signal processing means.

In this fifth invention, in place of the first signal processing means in the first invention, when the visible light television camera is a monochrome television camera, the third signal processing means A color video signal is output by coloring the black and white video taken by the monochrome television camera with at least two colors using the taken infrared video.

[Example] FIG. 1 is a structural diagram showing an optical connection between an infrared television camera and a visible light television camera according to the present invention, where 1 is a high temperature object such as a soldering iron, 2 is a high temperature object such as a soldering iron, visible light is reflected, IR
The mirror 3 for passing light is an IR lens made of germanium, 4 is a visible light lens made of glass or plastic, and 5 is a visible light CC that receives a visible light image.
D.

6 is an IR CCD that receives an IR image, 7 is a heat shield,
8 is a cooler such as a Stirling cycle refrigerator, which is used to reduce the dark current of the IR detection element.
It is also necessary to suppress black body radiation from objects around the element. 9 is a heat sink.

In FIG. 1, an infrared TV left camera receiving light by an IR CCD 6 and a visible light TV left camera receiving light by a normal visible light CCD 5 are connected to respective imaging lenses 3 and 4.
They are coaxially connected in the section on the image side. The mirror 2 has a function of distributing visible light and IR based on the difference in their wavelength bands. I of the target high temperature object 1 with the above optical configuration
An image of R self-emission and an image of visible reflected light are obtained from the IR CCD 6 and the visible light CCD 5, respectively.

FIG. 2 is an explanatory diagram showing a signal processing method for an infrared image and a visible light image according to the present invention. FIG. 4(a) is an example of an image obtained by IR self-luminescence, in which a high-temperature object 1 (for example, the head of a soldering iron or a red-hot nichrome wire) appears to shine well due to the self-luminescence, but its overall shape cannot be seen.

FIG. 5B is an example of an image obtained by receiving visible light, and although the overall shape of the soldering iron and the like can be clearly seen, it is not clear whether the soldering iron is at a high temperature or not. Therefore, by modulating the visible light image in (b) with the data of the high brightness part (i.e. high temperature part) of both IR images in (a) and displaying this modulated part as an image with emphasis or coloring, it is possible to easily identify hot objects. A device is obtained. FIG. 3C is an example of a visible light image modulated with the data of the high brightness portions of both IR images.

As a method of modulating the above visible light image using both IR images, for example, a luminance signal Y obtained by an IRTV camera is used.
IR + itself or a signal processed by it, and visible light T
V Multiplying the luminance signal Y obtained by the left camera, or multiplying the luminance signal Y of the IR by the luminance signal Y of the IR, R of the color display
There is a method of equally multiplying the three primary color signals of SG and B.

FIG. 3 is a block diagram of the first high-temperature object imaging apparatus according to the present invention, and numerals 2 to 6 are the same as those in FIG. 1. 10 is an optical coupling part between an infrared television camera and 1 a visible light television camera. 11 is #
1 camera control unit (hereinafter referred to as #ICCU), 12 is #2CCU, 13 is #ICCU11 and #2
A synchronization signal generator for the CCU 12 to generate a synchronization signal for reading images from each CCD; 14 a signal processing section for performing signal processing between infrared images and visible light images according to the present invention; This is an image display device that displays video signals.

In FIG. 3, based on the synchronization signal output from the common synchronization signal generator J3, #ICCU11 and $2CC
U12 reads out image data synchronously from corresponding pixels of the IR CCD 6 and the visible light CCD 5, and supplies them to the signal processing section 14. As explained above, one specific example of the signal processing method performed by the signal processing unit 14 is to process the luminance signal ``IR itself'' obtained by the IR CCD 6 or a signal obtained by signal processing it by the visible light CCD 5. This is to perform multiplication processing with the obtained luminance signal Y or the three primary color signals of R, G, and B.

Another specific example of this signal processing method is to perform non-linear processing on visible light images using 12R video data, image blur processing, binary region conversion by checking the image outline, and processing. or a combination of the above processes. Furthermore, another one of this signal processing method
Alternatively, the image to be processed and the video data used for processing may be exchanged, and the above signal processing may be performed on the IR image using visible light video data.

Image data subjected to such signal processing is displayed on the image display 15. Therefore, hot objects can be easily identified on the display screen of the image display 15.

FIG. 4 is a block diagram of a second high-temperature object imaging apparatus according to the present invention, and 2 to 6, 10 to 12, 14, and 15 are the same as those in FIG. 3. 13-1 is the #1 synchronization signal generator, 13-2 is the #2 synchronization signal generator, and 16 is the digital scan converter (hereinafter referred to as DSC), which has multiple frame memories and is imaged using IR and visible light. It has a function of storing each image data at an address of the frame memory corresponding to the two-dimensional display position of the image data.

FIG. 4 shows an example of a configuration in which the TV synchronization signals for IR and visible light are asynchronous. #ICCUll reads the image data from the IR CCD 6 using the #1 synchronization signal from the #1 synchronization signal generator 13-1 and outputs the IR data in DSClB.
write to the frame memory for

Similarly, the #2 CCU 12 reads the image data from the visible light CCD 5 using the #2 synchronization signal (asynchronous with the #1 synchronization signal) from the #2 synchronization signal generator 13-2 and outputs the image data from the visible light CCD 5.
Write to visible light frame memory in 1B. The signal processing unit 14 reads two image data for IR and visible light from the corresponding addresses of the IR and visible frame memories in DSClB, performs signal processing as explained in FIG. The processed image data is displayed on the image display 15.

In addition, in Fig. 4, the infrared television camera and the visible light television camera not only operate asynchronously, but also the total number of pixels such as CCD, which is a light receiving element, and the pixel distribution form (vertical x horizontal distribution of two-dimensional display). ) are different (
In general, infrared television cameras have lower resolution), and D
The SC1B stores each image data of IR and visible light at the address of each frame memory corresponding to the two-dimensional display position of the image data.

Therefore, two successive pieces of image data from light-receiving elements having different numbers of pixels and different arrangements can be stored at addresses corresponding to their respective display positions. Therefore, the signal processing section 14 is a DSC.
It is possible to read data at a corresponding address from each frame memory in IB and execute signal processing between two pieces of video data.

Further, when the visible light television camera is a monochrome television camera, the signal processing unit 14 uses high-intensity video data of an infrared image obtained by the IR television camera, and uses the high-intensity video data of the infrared image obtained by the IR television camera to It is also possible to output a color video signal colored with at least two or more colors and display it in color using a color image display.

Further, as an application example of the present invention, the visible light television camera may be controlled to search for the high brightness portion of the IR self-emission with an IR television camera and zoom in and image the high brightness portion of the IR self-emission. can. In this case, an automatic pattern recognition system that recognizes both IR images into an appropriate pattern is used.
This is required on the R television camera side, and a zoom mechanism or optical swing mechanism is also required on the visible light television camera side.

Further, in the case of the above application example, the IR optical system may be a directional point sensor, and this may be installed on the swinging mechanism of a visible light television camera to search for a high brightness portion of IR self-emission.

[Effects of the Invention] As described above, according to the present invention, an infrared television camera and a visible light television camera are optically coupled, and various types of infrared video signals and visible light video signals captured by the respective television cameras are transmitted. Perform signal processing to enhance the visible light image of a high-temperature object with an infrared video signal, or color a monochrome visible light image with an infrared video signal, or use one video signal to perform non-linear processing or blur processing of the other video signal. , Contour 6 Confirmation has been made into a binary region and can be displayed, making it possible to remotely and easily objectively automatically confirm and identify high-temperature objects, such as forgotten soldering irons and stoves. The following effect can be obtained.

Furthermore, since the visible light image and the infrared image are displayed as a composite image after signal processing, a display image with characteristics that cannot be obtained from each image alone can be obtained.

[Brief explanation of the drawing]

FIG. 1 is a structural diagram showing an optical connection between an infrared television camera and a visible light television camera according to the present invention, and FIG. 2 is an explanatory diagram showing a signal processing method for an infrared image and a visible light image according to the present invention. FIG. 3 is a block diagram of a first high-temperature object imaging apparatus according to the present invention, and FIG. 4 is a block diagram of a second high-temperature object imaging apparatus according to the present invention. In the figure, 1 is a high temperature object, 2 is a mirror, 3 is an IR lens, 4 is a visible light lens, 5 is a visible light CCD, 6 is an IR CCD, 7 is a heat shield, 8 is a cooler, and 9 is a radiator, 10 is an optical coupling part of two television cameras, 11 is #ICCU, 12 is #2CCU, 18 is a synchronization signal generator, 13-1 and 13-2 are #1 and #2 synchronization signal generators, 14 is a signal processing unit, 15 is an image display device, and 16 is a DSC.
It is.

Claims (5)

[Claims] (1) An infrared television camera that captures images in the infrared region, a visible light television camera that captures images in the visible light region, and the infrared television camera and visible light television camera are shared in a section on the image side from their respective imaging lenses. An optical coupling means for axially coupling and a luminance signal of the visible light image taken by the visible light television camera is modulated by the brightness signal of the infrared image taken by the infrared television camera, and a visible light image of the high temperature object is obtained. An imaging apparatus for a high-temperature object, comprising: a first signal processing means for outputting an emphasized video signal; and an image display means for displaying the video signal output from the first signal processing means. (2) The first signal processing means multiplies the luminance signal of the infrared image itself or a signal obtained by processing the same by the luminance signal of the visible light image or the three primary color signals of R, G, and B. 2. The apparatus for imaging a hot object according to claim 1, further comprising means. (3) Instead of the first signal processing means, based on the video signal of either the infrared video or the visible light video, the other video signal is subjected to non-linear processing, blurring processing, and binary region conversion processing by contour confirmation. 2. The imaging apparatus for a high-temperature object according to claim 1, further comprising a second signal processing means for performing any one of the above processings or a combination processing of any one of the above processings. (4) When the infrared television camera and the visible light television camera take images asynchronously, or when the total number of pixels or the pixel distribution form of the two television cameras is different, each of the images taken by the two television cameras A claim comprising a digital scan converter that stores image data at addresses of a frame memory corresponding to display positions of the image data and supplies the stored data to the first signal processing means or the second signal processing means. Item 1
Alternatively, the imaging device for a high-temperature object according to claim 2 or 3. (5) In place of the first signal processing means, when the visible light television camera is a monochrome television camera, a black and white image photographed by the monochrome television camera is generated based on an infrared image photographed by the infrared television camera. 2. The imaging apparatus for a high-temperature object according to claim 1, further comprising a third signal processing means for outputting a color video signal colored with at least two or more colors.