[go: up one dir, main page]

WO2000036845A1 - Appareil et procede de controle d'images stereoscopiques - Google Patents

Appareil et procede de controle d'images stereoscopiques Download PDF

Info

Publication number
WO2000036845A1
WO2000036845A1 PCT/GB1999/004143 GB9904143W WO0036845A1 WO 2000036845 A1 WO2000036845 A1 WO 2000036845A1 GB 9904143 W GB9904143 W GB 9904143W WO 0036845 A1 WO0036845 A1 WO 0036845A1
Authority
WO
WIPO (PCT)
Prior art keywords
observer
viewing
dimensional
object field
image
Prior art date
Application number
PCT/GB1999/004143
Other languages
English (en)
Inventor
Graham Stewart Brandon Street
Original Assignee
Street Graham S B
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Street Graham S B filed Critical Street Graham S B
Publication of WO2000036845A1 publication Critical patent/WO2000036845A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/158—Switching image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
    • H04N13/359—Switching between monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/376—Image reproducers using viewer tracking for tracking left-right translational head movements, i.e. lateral movements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/337—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using polarisation multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Definitions

  • This invention is concerned with the field of three-dimensional imaging and particularly with the effective control of image content for a system which can provide different viewpoints of a subject to respectively the left and right eyes of an observer.
  • the tracking mechanism does not meet these requirements and the image content at one viewing zone differs from that at the other, as is the requirement for a three- dimensional image to be observed, then, the observed image could become confusing, allowing the possibility of pseudoscopic viewing or two images being seen by one eye, simultaneously.
  • apparatus for the control of the image of an object field provided by a display system for viewing by an observer comprises automated and/or observer controlled means either for selecting two different perspective views of said object field for substantially simultaneous viewing by each respective eye of the observer, to provide a three-dimensional image, or for selecting a single perspective view of said object field for two-dimensional viewing.
  • the display system is autostereoscopic and provides a right eye viewing zone and a left eye viewing zone and comprises means for sensing the location of the observer; control means for co-locating each viewing zone with a respective eye of the observer; and means for providing selectively the same or a different perspective image for viewing at each respective viewing zone.
  • the location sensing means comprises first means for providing a signal indicative of said location when this is available; second means for providing a second signal indicating, in use, whether the observer's location has been sensed or is unavailable; and means for selecting image data from a single perspective view for presentation at all viewing zones when said location has not been sensed.
  • a camera system for obtaining the perspective views of the object field comprises means for sensing the distance of the camera system from the object field; and means for detecting when said distance is less than a preset limit, whereby, in use, said single perspective view is selected for viewing two-dimensionally by the observer.
  • the distance sensing means may comprise an auto-focus facility within the camera system.
  • the distance sensing means comprises a system for measuring the parallax between corresponding points within each of the perspective views provided by the camera system.
  • a visual indicator is provided to show whether the system is operating as a three-dimensional or two-dimensional display system
  • an audible alarm may be provided to indicate that the system has ceased to operate as a three-dimensional display system.
  • the image of an object 1 is captured from respectively right and left eye points of view by two video cameras 2 and 3.
  • An autostereoscopic display 4, capable of providing an observer 5 with different images for respectively the right eye 6 and the left eye 7, is fed with one or both of the video signals from the cameras 2 and 3.
  • the apparatus required to determine when to provide both video signals or a selected one of them is shown schematically as module 8. This part of the system controls switches 9 and 10 as follows.
  • an observer tracking camera 1 provides the display system 4 with the information required to generate two distinct viewing zones 12 and 13 at the observer's location. Typically the position of these zones remain locked to the observer's location providing the latter remains within certain boundaries, shown as lines 14 and 15.
  • the observer's right eye 6 observes an image corresponding to the video signal supplied via switch 9 by camera 2 and the observer's left eye 7 receives an image corresponding to the video signal supplied via switch 10 by camera 3.
  • switch control module 8 indicating that tracking has ceased and including information concerning the last known location of the observer.
  • switch 10 is changed to position 16, shown in broken line form in Figure 1, so as to provide the right eye image to both eyes of the observer.
  • switch 9 is operated to provide both eyes with the left eye image.
  • the display system provides both a left and right eye image for viewing within each respective viewing zone.
  • the observer is provided with a conventional 2D (flat) image, either from a right eye perspective or a left eye perspective, thus avoiding any false perspective or confusion and discomfort of the observer.
  • the apparatus of Figure 1 is shown as one half of a glasses-free teleconferencing system, in which object 1 is one of the participants and the observer 5 is the other.
  • object 1 is one of the participants and the observer 5 is the other.
  • a 3D image can be relayed to an observer.
  • a stereoscopic endoscope may replace the pair of cameras 2 and 3, and provide a surgeon with a 3D image of the operative field.
  • it is not only the failure to track the observer which can make a 2D image more suitable for viewing than the 3D image.
  • the camera pair is brought too close to the object field, the corresponding stereo-image pair generated can become quite difficult to fuse into a single three-dimensional image.
  • each of the two images can provide a useful magnified 2D close-up of the subject matter of interest.
  • a manual override in the form of a separate input (not shown) to switch control module 8, is conveniently provided through a user activated switch, operated either manually or by voice control.
  • a proximity detection mechanism within the camera system, can have a preset limit on distance to the subject matter, so that, when this is approached too closely, a signal is generated to switch to 2D presentation of the image.
  • Such proximity detection can be provided, for example, by an auto-focus mechanism or by measuring the parallax between corresponding image points within the left and right image fields provided by the camera system.
  • switching to a 2D image presentation is forced by an automated system, such as a failure to track the observer or passing of a preset proximity limit, it is found to be useful for a visual or audible warning (not shown) to be provided by the switch control module, thereby alerting the observer to take the required action, if any.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

L'invention porte sur un système d'acquisition et présentation d'images stéréoscopiques comportant un mécanisme de présentation des images en trois ou en deux dimensions. Le mode de fonctionnement de l'affichage peut être choisi automatiquement ou par l'observateur, ce qui évite de présenter des paires d'images difficiles à fusionner pour l'observateur en une image tridimensionnelle. Dans une version du système dite autostéréoscopique, on peut suivre la position de l'observateur et les zones de vision sont positionnées de manière à rester co-localisées avec les yeux de l'observateur. Si l'observateur sort du domaine de poursuite du système l'imagerie présente par défaut une vue en deux dimensions. Le système peut également comporter des moyens de détection de la distance séparant une caméra stéréo du champ de l'objet et fournissant les perspectives nécessaires à une vue en trois dimensions. Lorsque la distance caméra-champ est inférieure à un minimum préétabli, l'imagerie présente par défaut une vue en deux dimensions pour éviter la parallaxe au delà d'un niveau confortable.
PCT/GB1999/004143 1998-12-15 1999-12-14 Appareil et procede de controle d'images stereoscopiques WO2000036845A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB9827546.4A GB9827546D0 (en) 1998-12-15 1998-12-15 Apparatus and method for image control
GB9827546.4 1998-12-15

Publications (1)

Publication Number Publication Date
WO2000036845A1 true WO2000036845A1 (fr) 2000-06-22

Family

ID=10844223

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB1999/004143 WO2000036845A1 (fr) 1998-12-15 1999-12-14 Appareil et procede de controle d'images stereoscopiques

Country Status (2)

Country Link
GB (1) GB9827546D0 (fr)
WO (1) WO2000036845A1 (fr)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003009218A1 (fr) * 2001-07-18 2003-01-30 Intel Zao Reconnaissance gestuelle dynamique a partir de sequences stereo
EP1621153A1 (fr) * 2004-07-28 2006-02-01 BrainLAB AG Appareil de visualisation stéréoscopique de données d'imagerie médicale et d'images vidéo combinées
RU2280894C2 (ru) * 2001-07-18 2006-07-27 Зао Интел Распознавание жестов в динамике для последовательности стереокадров
US7165029B2 (en) 2002-05-09 2007-01-16 Intel Corporation Coupled hidden Markov model for audiovisual speech recognition
US7171043B2 (en) 2002-10-11 2007-01-30 Intel Corporation Image recognition using hidden markov models and coupled hidden markov models
US7203277B2 (en) 2003-04-25 2007-04-10 Brainlab Ag Visualization device and method for combined patient and object image data
US7203368B2 (en) 2003-01-06 2007-04-10 Intel Corporation Embedded bayesian network for pattern recognition
US7209883B2 (en) 2002-05-09 2007-04-24 Intel Corporation Factorial hidden markov model for audiovisual speech recognition
US7274800B2 (en) 2001-07-18 2007-09-25 Intel Corporation Dynamic gesture recognition from stereo sequences
US7463823B2 (en) 2003-07-24 2008-12-09 Brainlab Ag Stereoscopic visualization device for patient image data and video images
US7472063B2 (en) 2002-12-19 2008-12-30 Intel Corporation Audio-visual feature fusion and support vector machine useful for continuous speech recognition
WO2013169327A1 (fr) 2012-05-07 2013-11-14 St. Jude Medical, Atrial Fibrillation Division, Inc. Affichage stéréoscopique d'un système de navigation d'un dispositif médical
WO2019017207A1 (fr) * 2017-07-19 2019-01-24 Sony Corporation Processeur d'image et procédé de commande de processeur d'image

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0425985A2 (fr) * 1989-10-25 1991-05-08 Hitachi, Ltd. Système de production d'images stéréoscopiques
EP0716330A2 (fr) * 1994-12-07 1996-06-12 Canon Kabushiki Kaisha Appareil pour afficher une image stéreoscopique et appareil de prise de vues
EP0830034A1 (fr) * 1996-09-11 1998-03-18 Canon Kabushiki Kaisha Traitement d'images obtenues par une caméra multioculaire
EP0829743A2 (fr) * 1996-09-12 1998-03-18 Sharp Kabushiki Kaisha Dispositif d'affichage directionnel avec système de suivi de l'observateur
US5978143A (en) * 1997-09-19 1999-11-02 Carl-Zeiss-Stiftung Stereoscopic recording and display system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0425985A2 (fr) * 1989-10-25 1991-05-08 Hitachi, Ltd. Système de production d'images stéréoscopiques
EP0716330A2 (fr) * 1994-12-07 1996-06-12 Canon Kabushiki Kaisha Appareil pour afficher une image stéreoscopique et appareil de prise de vues
EP0830034A1 (fr) * 1996-09-11 1998-03-18 Canon Kabushiki Kaisha Traitement d'images obtenues par une caméra multioculaire
EP0829743A2 (fr) * 1996-09-12 1998-03-18 Sharp Kabushiki Kaisha Dispositif d'affichage directionnel avec système de suivi de l'observateur
US5978143A (en) * 1997-09-19 1999-11-02 Carl-Zeiss-Stiftung Stereoscopic recording and display system

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2280894C2 (ru) * 2001-07-18 2006-07-27 Зао Интел Распознавание жестов в динамике для последовательности стереокадров
US7274800B2 (en) 2001-07-18 2007-09-25 Intel Corporation Dynamic gesture recognition from stereo sequences
WO2003009218A1 (fr) * 2001-07-18 2003-01-30 Intel Zao Reconnaissance gestuelle dynamique a partir de sequences stereo
US7209883B2 (en) 2002-05-09 2007-04-24 Intel Corporation Factorial hidden markov model for audiovisual speech recognition
US7165029B2 (en) 2002-05-09 2007-01-16 Intel Corporation Coupled hidden Markov model for audiovisual speech recognition
US7171043B2 (en) 2002-10-11 2007-01-30 Intel Corporation Image recognition using hidden markov models and coupled hidden markov models
US7472063B2 (en) 2002-12-19 2008-12-30 Intel Corporation Audio-visual feature fusion and support vector machine useful for continuous speech recognition
US7203368B2 (en) 2003-01-06 2007-04-10 Intel Corporation Embedded bayesian network for pattern recognition
US7203277B2 (en) 2003-04-25 2007-04-10 Brainlab Ag Visualization device and method for combined patient and object image data
US7463823B2 (en) 2003-07-24 2008-12-09 Brainlab Ag Stereoscopic visualization device for patient image data and video images
EP1621153A1 (fr) * 2004-07-28 2006-02-01 BrainLAB AG Appareil de visualisation stéréoscopique de données d'imagerie médicale et d'images vidéo combinées
WO2013169327A1 (fr) 2012-05-07 2013-11-14 St. Jude Medical, Atrial Fibrillation Division, Inc. Affichage stéréoscopique d'un système de navigation d'un dispositif médical
EP2822516A4 (fr) * 2012-05-07 2015-11-25 St Jude Medical Atrial Fibrill Affichage stéréoscopique d'un système de navigation d'un dispositif médical
WO2019017207A1 (fr) * 2017-07-19 2019-01-24 Sony Corporation Processeur d'image et procédé de commande de processeur d'image
US11109009B2 (en) 2017-07-19 2021-08-31 Sony Corporation Image processor and control method of image processor

Also Published As

Publication number Publication date
GB9827546D0 (en) 1999-02-10

Similar Documents

Publication Publication Date Title
JP3443271B2 (ja) 立体映像表示装置
JP3157384B2 (ja) 立体映像装置
RU2441341C2 (ru) Стереоскопическая телевизионная система, стереоскопический телевизионный приемник и очки для просмотра стереоскопического изображения
US7440004B2 (en) 3-D imaging arrangements
US5175616A (en) Stereoscopic video-graphic coordinate specification system
WO2000036845A1 (fr) Appareil et procede de controle d'images stereoscopiques
EP2982292B1 (fr) Système endoscope destiné à afficher des images 3-d
US20020050986A1 (en) Image display apparatus and method, and storage medium
KR101960897B1 (ko) 입체 영상 표시 장치 및 그 표시 방법
EP1763258A3 (fr) Système d'observation stéréo médical
CN105230013A (zh) 具有位置感测和适配数量的视图的多视图三维显示系统和方法
JPH095643A (ja) 立体内視鏡装置
JP2001133696A5 (fr)
JP3469884B2 (ja) 立体映像表示装置
JPH11341518A (ja) 多視点同時観察型水平配置立体画像表示システム
US20100259820A1 (en) Stereoscopic image display
US8274555B2 (en) Image synthesizing apparatus and image synthesizing method
US20130201304A1 (en) System for Displaying Stereoscopic Images
EP2506587A2 (fr) Appareil d'affichage stéréoscopique
JP3425402B2 (ja) 立体画像を表示する装置および方法
JPH099300A (ja) 立体表示装置
JP5474530B2 (ja) 立体画像表示装置
JP3420060B2 (ja) 水平配置立体画像表示システム
JP2004282217A (ja) 多眼式立体映像表示装置
US7106504B2 (en) Enhanced shutter control for images that are faded into a stereo microscope

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase