JP2011029847A - Imaging display system - Google Patents

Abstract

An imaging display system is provided that can arrange an imaging device and an image display device so that the imaging device is not exposed due to being exposed.
An image display device 2 is attached to a frame 3 having a rectangular frame shape, and an imaging device 1 with an optical axis facing forward is housed on both sides of the image display device 2 in the frame 3. A prism 4 is attached to the frame 3 in front of the imaging device 1. The prism 4 is made of a transparent material, and controls the field of view of the imaging device 1 so that the region of interest Pv defined in front of the image display device 2 is included in the field of view of the imaging device 1.
[Selection] Figure 1

Description

  The present invention relates to an imaging display system that includes an imaging device that captures an image of a person watching an image display device and displays an image captured by the imaging device on the image display device.

  Conventionally, this type of imaging display system has a configuration in which an imaging device and an illuminating device are arranged behind the image display device, and a user existing in front of the image display device is used as an object to be imaged by the imaging device. A configuration has been proposed in which an image is captured and the captured image is displayed on an image display device (see, for example, Patent Document 1).

  In the configuration described in Patent Document 1, a high-transmission liquid crystal display device is used as an image display device, and an imaging mode in which an imaging target is imaged by the imaging device through the image display device without performing display on the image display device, and an imaging mode The display mode is switched to the display mode for displaying the image of the imaging target imaged by the imaging device on the image display device.

  On the other hand, a configuration has also been proposed in which imaging devices are arranged in front, side, back, etc. of a user, and images captured by a plurality of imaging devices are displayed side by side on an image display device (for example, Patent Documents). 2).

JP 2004-297733 A JP 2001-25004 A

  In the configuration described in Patent Document 1, since the imaging device and the illumination device are arranged behind the image display device, it is not possible to perform imaging by the imaging device while an image is displayed on the image display device. There is a discrepancy between the period for imaging by the imaging apparatus and the period for displaying an image on the image display apparatus. In other words, there is a problem that the user cannot see herself in real time. In addition, it is necessary to switch between an image capturing mode for temporarily storing an image captured by the image capturing device and a display mode for displaying the stored image on the image display device.

  On the other hand, in the configuration described in Patent Document 2, since the imaging device is arranged in a portion that does not overlap the screen of the image display device, the appearance of the user imaged by the imaging device is displayed on the image display device in real time. In addition, the appearance of the user seen from a plurality of directions can be displayed on the image display device, but the image pickup device is exposed, and the device is devised to arrange the image pickup device and the image display device in a good-looking manner. Not.

  In particular, when imaging from the side of the user, as in the case of imaging from the back, if the image display device and the imaging device are separated, the position when installing the imaging device and the image display device In addition to the time and effort required for alignment (distance and orientation), the user may be stressed because the imaging device is exposed.

  The present invention has been made in view of the above-described reasons, and its purpose is to enable an image captured by an imaging device to be displayed on an image display device in real time, and to expose the imaging device in an exposed manner. It is an object of the present invention to provide an imaging display system in which an imaging apparatus and an image display apparatus can be arranged with good looks.

  In order to achieve the above object, according to the present invention, at least one of an image display device attached to a frame and both sides of the image display device is disposed in the frame with the optical axis facing the front of the image display device. The imaging device includes an image processing device that displays an image captured by the imaging device on the image display device, and a region of interest that is attached to the frame in front of the imaging device and defined in front of the image display device. And an imaging prism made of a transparent material for controlling the field of view of the imaging device.

  In addition, an illuminating device disposed in the frame with the radiation direction directed to the front of the image display device on at least one of both sides of the image display device, and attached to the frame in front of the illuminating device and in front of the image display device It is desirable to adopt a configuration in which an illumination prism made of a transparent material for controlling the illumination range is added so that the specified region of interest is included in the illumination range.

  Furthermore, it is desirable that the imaging prism and the illumination prism are integrated and shared by the imaging device and the illumination device, and the illumination range of the illumination device and the field of view of the imaging device overlap.

  In this case, it is desirable that the imaging device and the illumination device use the same surface of the prism as the reflecting surface.

  In addition, a half mirror arranged on the screen of the image display device is added, and as the half mirror, the transmittance is defined so as to transmit the image displayed on the image display device, and the mirror in the non-display state of the image display device A configuration in which the reflectance is defined so as to function as the above may be adopted.

  In this configuration, the imaging devices are arranged on both sides of the image display device so as to capture the left side and the right side of the user at the site of interest, respectively, and the left side of the user imaged by the left imaging device And an image processing device that displays the right side of the user imaged by the right imaging device in the right half region of the screen of the image display device. Can be adopted.

  According to the configuration of the present invention, the imaging device with the optical axis facing forward is disposed on the side of the image display device attached to the frame, and the prism is attached to the frame in front of the imaging device, and the field of view of the imaging device is obtained by this prism. Therefore, when setting the field of view of the imaging device, there is no need to tilt and mount the imaging device, so that the imaging device is not exposed to exposure by being exposed from the frame, and the prism is made of a transparent material. Since the prism is formed, the prism has a decorative effect, and the imaging device and the image display device can be arranged with good appearance. Further, since the imaging device is arranged on the side of the image display device, it is possible to display an image captured by the imaging device on the image display device in real time.

  In addition, when a configuration in which an illumination device is provided and an illumination range is controlled by an illumination prism is employed, the illumination device can be disposed in the frame, thereby preventing the appearance from being damaged by the illumination device.

  Furthermore, in the configuration in which the imaging prism and the illumination prism are integrated and shared by the imaging device and the illumination device, the field of view of the imaging device and the illumination range of the illumination device can be easily overlapped. In addition, since one prism can be used for both imaging and illumination, the number of parts is reduced and the configuration is simplified.

  In particular, in the configuration in which the same surface of the prism is used as the reflecting surface in the imaging device and the illumination device, it is easy to overlap the field of view of the imaging device and the illumination range of the illumination device.

  In addition, in the configuration including a half mirror arranged on the screen of the image display device, when the user is in a region of interest in front of the image display device, a reflected image of the front of the user is projected by the half mirror Thus, the left and right side portions of the user can be displayed on the image display device and simultaneously viewed.

  Furthermore, if an image processing device is provided and an image of the left imaging device is displayed in the left half area of the image display device and an image of the right imaging device is displayed in the right half region of the image display device, The user can enjoy the same convenience as a three-sided mirror having three mirrors.

Embodiment is shown, (a) is a front view, (b) is a top view. A comparative example is shown, (a) is a front view, and (b) is a plan view. It is a block diagram of an embodiment. It is a front view which shows the example of a display same as the above.

  In the embodiment described below, a case where two imaging devices 1 are used will be described as an example as shown in FIG. 1, but a configuration in which only one imaging device 1 is provided may be employed. In the following description, the downward direction in FIG. 1B is defined as the front of the apparatus.

  The imaging device 1 is disposed on both the left and right sides of the image display device 2 and is attached to a frame 3 that holds the image display device 2. The frame 3 has a rectangular frame shape and surrounds the entire periphery of the image display device 2. In other words, the image display device 2 is housed in the frame 3, and the screen is exposed from the opening window provided at the center of the frame 3.

  As will be described later, in the present embodiment, since the imaging device 1 is designed to capture the face of the user, the position of the imaging device 1 is set so as to be the height position of the face. Further, the visual field in the vertical direction is limited to a relatively narrow area. Of course, in an application for imaging other than the face as in the appearance, the position and field of view of the imaging device 1 are different from those in the embodiments described below.

  The image display device 2 uses a flat panel display such as a liquid crystal display or a plasma display. The imaging apparatus 1 has a configuration in which an imaging element such as a CCD image sensor or a MOS image sensor is housed in a case, and a light receiving optical system (light receiving lens) disposed in front of the imaging element is attached to the case. In the present embodiment, it is assumed that the imaging device 1 and the image display device 2 handle color images.

  In the present embodiment, the imaging device 1 is arranged in the frame 3 so that the optical axis of the light receiving optical system is directed forward (downward in FIG. 1B), and a visual field is provided in front of each imaging device 1, respectively. An imaging prism 4 that controls the above is disposed. The field of view of the imaging device 1 through the prism 4 is set so that a user existing in front of the image display device 2 can be imaged.

  Assuming that the prism 4 is not provided as shown in FIG. 2, two imaging devices 1 are arranged at a distance of 2 W (for example, 1000 mm) on the left and right sides, and the left and right sides of the screen of the image display device 2 are arranged. It is assumed that a site of interest Pv separated by a distance D (for example, 300 mm) forward from the center in the direction corresponds to the center in the horizontal direction of the imaging surface of the imaging device 1.

  In this case, in order to position the region of interest Pv in front of the imaging device 1, it is necessary to incline the front surface of the imaging device 1 with respect to the screen of the image display device 2 by an angle θ that satisfies tan θ = W / D. . In the above numerical example, θ≈60 °. This angle θ is an angle formed by the direction of the center line of the field of view by the imaging device 1 with respect to the front-rear direction. In the example shown in FIG. 2, the optical axis of the imaging device 1 passes through the site of interest Pv. The direction in which the imaging device 1 is viewed from the part Pv coincides with the direction of the center line of the visual field by the imaging device 1.

  As shown in FIG. 2, when the front surfaces of the two imaging devices 1 are inclined with respect to the front surface of the image display device 2, the front surfaces of the imaging devices 1 are not inclined with respect to the front surface of the image display device 2. In comparison, the dimension in the front-rear direction occupied by the image pickup apparatus 1 becomes larger. Therefore, if the image pickup apparatus 1 is stored in the frame 3, the thickness dimension in the front-rear direction of the frame 3 increases. Instead of increasing the thickness dimension of the frame 3 in the front-rear direction, a part of the imaging device 1 can be protruded from the front surface of the frame 3, but the imaging device 1 becomes conspicuous and the appearance is impaired.

  Therefore, in the configuration example shown in FIG. 1, the field of view of the imaging device 1 is controlled using the prism 4 formed of a transparent material such as transparent synthetic resin or glass instead of housing the imaging device 1 in the frame 3. Is adopted. The prism 4 has a turning portion 4 a formed of a triangular prism formed in a right triangle shape in a horizontal section, and at least the turning portion 4 a of the prism 4 protrudes from the front surface of the frame 3.

  One surface sandwiching a right angle in the turning portion 4 a faces the imaging device 1, and the other surface is orthogonal to the front surface of the frame 3. The other surfaces of both prisms 4 face each other. That is, the other surface is the right surface of the left prism 4 and the left surface of the right prism 4. Further, the inclined surface in the turning portion 4a is inclined at an appropriate angle with respect to the direction of the optical axis (front-rear direction) of the imaging device 1, and functions as a reflecting surface. That is, the slope is inclined to the right in the left prism 4 and to the left in the right prism 4.

  The angle φ formed by the inclined surface serving as the reflecting surface with respect to the frame 3 is θ≈60 °, and if the refractive index of the material of the prism 4 is 1.5, φ≈55 °. Further, the dimension at which the turning portion 4a protrudes to the front side of the frame 3 (actually, the distance between the position of the intersection of the optical axis of the imaging device 1 and the slope of the turning portion 4a and the front surface of the image display device 2). C varies depending on the interval between the prisms 4.

  That is, the angle θ formed by the direction of the center line of the visual field of the imaging device 1 controlled by the prism 4 with respect to the front-rear direction, and the distance between the left and right prisms 4 (distance between the optical axes of the imaging device 1) 2V Using the distance D from the screen of the image display device 2 to the site of interest Pv, the projecting dimension C of the turning portion 4a from the frame 3 is C = D−V · tan θ, θ = 60 °, D In the case of = 300 mm, C≈300−0.588V. That is, when V = 500 mm, C≈6 mm, and when V = 400 mm, C≈65 mm.

  Since the prism 4 is made of a transparent material as described above and has a triangular cross section, even if the prism 4 protrudes from the front surface of the frame 3, the appearance is not greatly impaired. It is recognized as part of the design and can provide an excellent appearance.

  Further, as is apparent from the above description, when the position where the prism 4 is provided is changed, the field of view of the imaging device 1 can be made the same field by changing the projecting dimension of the direction changing portion 4a. It is possible to reduce the size of the image pickup apparatus 1 by reducing the interval size.

  However, as can be seen from the above equation, as the distance dimension (2V) between the left and right imaging devices 1 is decreased, the projecting dimension (C) of the turning portion 4a is increased. In addition to the size of 3, it is necessary to design so as not to impair the appearance in consideration of the protruding size of the prism 4. In addition, although the field of view of the imaging device 1 changes, the distance (2 V) between the left and right imaging devices 1 can be reduced by changing the angle φ formed by the inclined surface serving as the reflection surface of the prism 4 with respect to the frame 3. It is possible to reduce the protruding dimension (C) of the turning portion 4a. Although the field of view of the image pickup apparatus 1 can be controlled by using a mirror instead of the prism 4, the use of the mirror impairs the appearance as in the case where the image pickup apparatus 1 is disposed at an angle.

  In the above-described example, the prism 4 employs a configuration that protrudes only in a part in the vertical direction at the left and right end portions of the frame 3, but does not have the function of the prism 4, but has the same shape as the prism 4 in the horizontal section. If the decorative member 5 is placed on top and bottom of the prism 4, the decorativeness of the prism 4 can be further enhanced. By providing such a decorative member 5, the user is less likely to be conscious of the prism 4 as an optical member, and the imaging device 1 is less likely to be conscious so that the aesthetic appearance can be improved. The decorative member 5 can be disposed over the entire length in the vertical direction on both the left and right sides of the frame 4, but may be disposed in a part in the vertical direction. Further, instead of providing the decorative member 5 separately from the prism 4, the decorative member 5 may be provided integrally with the prism 4.

  By the way, as shown in FIG. 3, the images captured by the left and right imaging devices 1 are input to the image processing device 10 and subjected to image processing described later. The video signal subjected to the image processing in the image processing device 10 is input to the image display device 2, and an image corresponding to the video signal is displayed on the screen of the image display device 2.

  The image processing apparatus 10 includes an A / D conversion unit 11 that converts image signals output from the left and right imaging devices 1 into digital signal image data, and stores the converted image data in the image storage unit 12. The image storage unit 12 includes a working storage area as a buffer memory that temporarily stores image data captured by the left and right imaging devices 1. The work storage area temporarily stores, for example, image data of a period of about 1 to 2 frames of a moving image.

  Since the image storage unit 12 stores two types of image data corresponding to the left and right imaging devices 1, a selection unit 13 is provided to select which image data to output to the image display device 2. It is. The selection unit 13 selects image data to be read from the image storage unit 12 according to an instruction from the operation unit 14 such as a switch operated by the user. In the present embodiment, four types of states can be selected: a state in which both image data are selected, a state in which one of the left and right image data is selected, and a state in which neither of the image data is selected.

  The image data read by the selection unit 13 from the image storage unit 12 is input to the display adjustment unit 15, and the display adjustment unit 15 designates in which position on the image display device 2 the image corresponding to the image data is displayed. . The display position of the image on the screen of the image display device 2 is adjusted by instructing the display adjustment unit 15 from the operation unit 14 described above. The image data output from the display adjustment unit 15 is given to the image display device 2 and displayed on the screen of the image display device 2.

  Note that the image storage unit 12, the selection unit 13, and the display adjustment unit 15 included in the image processing apparatus 10 are realized by executing appropriate programs with a microcomputer. The A / D converter 11 may be provided in a microcomputer or provided separately from the microcomputer.

  Now, assuming that the user's face is positioned within the field of view of the imaging device 1 adjusted by the prism 4 and is facing the direction of viewing the image display device 2 in front, the user's face is in the vicinity of the target site Pv. Thus, the user's face can be imaged from the left and right front sides by the left and right imaging devices 1.

  Since the image picked up by the image pickup device 1 is displayed on the screen of the image display device 2 with a delay time of about 1 to 2 frames, the user's own left and right profile (front side) within the time that can be regarded as real time. It is possible to confirm the face as seen from. Since the user can check the side face without facing sideways with the face facing the image display device 2, the user has the advantage of not taking the trouble of twisting the neck to check the side face.

  As described above, since the image data to be displayed on the image display device 2 can be selected by operating the operation unit 14, it can be hidden if the side face display is unnecessary. It is also possible to display only one of the left and right side faces, or to display both the left and right side faces. In displaying the left and right side faces on the image display apparatus 2, as shown in FIG. 4, the left side face Vg is displayed in the left half area of the screen of the image display apparatus 2, and the right side face Vd is displayed on the image display apparatus 2. It is desirable to display in the right half area of the screen. It is also desirable to display the left side face Vg facing right and the right side face Vd facing left.

  By the way, the half mirror 6 is overlapped on the screen of the image display device 2. The half mirror 6 has a transmittance so that an image displayed on the image display device 2 can be viewed from the front, and can function as a normal mirror in a state where the image display device 2 is not displayed. The reflectivity is defined so that it can be done. Therefore, when an image is displayed on the image display device 2, the image appears in an appropriate area of the mirror.

  That is, the front face Vf of the user in front of the image display device 2 is displayed as a reflection image by the half mirror 6, and the left and right side faces Vg and Vd of the user are displayed on the screen of the image display device 2. Is transmitted as a transmission image. With such a display form, the display is similar to that of a three-way mirror, and is easy to understand for the user. In this case, the display adjusting unit 1 adjusts the display size so that the size of the side faces Vg and Vd is approximately the same as the size of the front face Vf of the person at the target site Pv. The display size can be adjusted as appropriate by the user by operating the operation unit 14. Note that the half mirror 6 is not indispensable, and only the image displayed on the image display device 2 may be visible.

  The imaging display system having the above configuration can be used for a washstand and a vanity. In this way, mainly for viewing the face, it is desirable to provide an illumination device 7 (see FIG. 1) that irradiates the face with light so that the details of the face can be seen. The illuminating device 7 uses a light emitting diode whose emission color is white as a light source, and is disposed in the vicinity of each of the left and right imaging devices 1 and built in the frame 3.

  The direction in which light is emitted from the illuminating device 7 is substantially matched to the direction of the optical axis of the imaging device 1, and the light radiated from the illuminating device 7 is irradiated to the vicinity of the site of interest Pv through the prism 4. That is, the illumination range by the illumination device 7 is overlapped with the field of view by the imaging device 1. In this configuration, the imaging device 1 and the illumination device 7 share the prism 4, and the imaging device 1 and the illumination device 7 use the same surface of the prism 4 as a reflection surface. The field of view is easily aligned.

  The left and right illumination devices 7 may be turned on when the left and right imaging devices 1 capture images. For example, the left side image of the user captured by the left imaging device 1 is displayed on the image display device 2. Only the left side lighting device 7 is turned on when displaying the image, and only the right side lighting device 7 is turned on when displaying the right side image of the user captured by the right side imaging device 1 on the image display device 2. Also good. In this case, the lighting devices 7 are turned on / off in conjunction with image selection by the selection unit 13.

  Alternatively, images on both sides of the user imaged by the left and right imaging devices 1 are displayed on the image display device 2, or images of each side surface of the user imaged by the left and right imaging devices 1 are displayed as images. Regardless of whether or not the image is displayed on the device 2, when the image captured by the imaging device 1 is displayed on the image display device 2, both the left and right illumination devices 7 may be turned on.

  Furthermore, the lighting device 7 may be turned on for the convenience of the user by operating the operation unit 14 without interlocking the lighting / lighting-off of the lighting device 7 and the imaging by the imaging device 1. Note that, instead of using the single prism 4 as the imaging device 1 and the illumination device 7, the imaging prism corresponding to the imaging device 1 and the illumination prism corresponding to the illumination device 7 are used separately. Also good. Moreover, as the direction change part 4a of the prism 4, it can replace with a triangular prism and the thing of suitable shapes, such as another polygonal prism, can be used.

  The numerical values exemplified in the above-described embodiments are examples, and are not intended to limit the technical idea of the present invention, but are appropriately set according to the setting of the field of view of the imaging device 1 and the setting of the position of the region of interest Pv with respect to the image display device 2. Can be changed.

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Image display device 3 Frame 4 Prism 5 Decoration member 7 Illumination device 6 Half mirror 10 Image processing device Pv Region of interest

Claims (6)

  An image display device attached to the frame, an image pickup device arranged in the frame with the optical axis facing the front of the image display device on at least one of both sides of the image display device, and an image taken by the image pickup device An image processing device to be displayed on the image display device, and a transparent material that controls the field of view of the imaging device so that the region of interest attached to the frame in front of the imaging device and defined in front of the image display device is included in the field of view of the imaging device An imaging display system comprising: an imaging prism.   An illuminating device arranged in a frame with a radiation direction directed to the front of the image display device on at least one of both sides of the image display device, and attached to the frame in front of the illuminating device and in front of the image display device The imaging display system according to claim 1, further comprising an illumination prism made of a transparent material that controls the illumination range so that the specified region of interest is included in the illumination range.   The imaging prism and the illumination prism are integral, and are shared by the imaging device and the illumination device, and the illumination range by the illumination device and the field of view of the imaging device overlap. The imaging display system according to claim 2.   The imaging display system according to claim 3, wherein the imaging device and the illumination device use the same surface of the prism as a reflection surface.   A half mirror arranged so as to overlap the screen of the image display device is added. The half mirror has a transmittance defined so as to transmit an image displayed on the image display device, and serves as a mirror in a non-display state of the image display device. The imaging display system according to claim 1, wherein the reflectance is defined so as to function.   The imaging device is arranged on both sides of the image display device so as to respectively capture the left side and the right side of the user at the site of interest, and the left side of the user imaged by the left imaging device Is displayed in the left half area of the screen of the image display device, and the right side of the user imaged by the right imaging device is displayed in the right half area of the screen of the image display device. The imaging display system according to claim 5.

Images