[go: up one dir, main page]

WO2018187724A8 - System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium - Google Patents

System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium

Info

Publication number
WO2018187724A8
WO2018187724A8 PCT/US2018/026516 US2018026516W WO2018187724A8 WO 2018187724 A8 WO2018187724 A8 WO 2018187724A8 US 2018026516 W US2018026516 W US 2018026516W WO 2018187724 A8 WO2018187724 A8 WO 2018187724A8
Authority
WO
WIPO (PCT)
Prior art keywords
light field
display medium
appear
software
field camera
Prior art date
Application number
PCT/US2018/026516
Other languages
French (fr)
Other versions
WO2018187724A1 (en
Inventor
Richard S. FREEMAN
Scott A. HOLLINGER
Original Assignee
Maxx Media Group, LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/481,447 external-priority patent/US10136121B2/en
Priority claimed from US15/829,861 external-priority patent/US10475233B2/en
Application filed by Maxx Media Group, LLC filed Critical Maxx Media Group, LLC
Publication of WO2018187724A1 publication Critical patent/WO2018187724A1/en
Publication of WO2018187724A8 publication Critical patent/WO2018187724A8/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10052—Images from lightfield camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)

Abstract

System, method and software for producing imagery with enhanced 3D effects that is viewed on a display medium (14). To create the imagery with enhanced 3D effects, a light field camera (17) images a scene that contains at least one subject (20). At a given moment in time, the subject (20) is positioned in an initial orientation. Upon imaging, the light field camera (17) produces light field image data (16) that represents the scene. The light field image data (16) is edited to add enhanced 3D effects. Once edited, the enhanced image data (43) is played on a display medium (12), where the added 3D effects cause the subject to appear, at least in part, to extend vertically above, or in front of, the display medium (14).
PCT/US2018/026516 2017-04-06 2018-04-06 System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium WO2018187724A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US15/481,447 US10136121B2 (en) 2016-04-08 2017-04-06 System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display
US15/481,447 2017-04-06
US15/829,861 US10475233B2 (en) 2016-04-08 2017-12-01 System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium
US15/829,861 2017-12-01

Publications (2)

Publication Number Publication Date
WO2018187724A1 WO2018187724A1 (en) 2018-10-11
WO2018187724A8 true WO2018187724A8 (en) 2019-05-02

Family

ID=63712660

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/026516 WO2018187724A1 (en) 2017-04-06 2018-04-06 System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium

Country Status (1)

Country Link
WO (1) WO2018187724A1 (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4903240B2 (en) * 2009-03-31 2012-03-28 シャープ株式会社 Video processing apparatus, video processing method, and computer program
US8749620B1 (en) * 2010-02-20 2014-06-10 Lytro, Inc. 3D light field cameras, images and files, and methods of using, operating, processing and viewing same
US8665304B2 (en) * 2011-03-21 2014-03-04 Sony Corporation Establishing 3D video conference presentation on 2D display
US10136121B2 (en) * 2016-04-08 2018-11-20 Maxx Media Group, LLC System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display

Also Published As

Publication number Publication date
WO2018187724A1 (en) 2018-10-11

Similar Documents

Publication Publication Date Title
US11076142B2 (en) Real-time aliasing rendering method for 3D VR video and virtual three-dimensional scene
US9094675B2 (en) Processing image data from multiple cameras for motion pictures
EP3107065A1 (en) Methods and systems for providing virtual lighting
CN106302132A (en) A kind of 3D instant communicating system based on augmented reality and method
WO2016103024A3 (en) Three dimensional imaging with a single camera
US10271038B2 (en) Camera with plenoptic lens
WO2019085022A1 (en) Generation method and device for optical field 3d display unit image
CN104539925A (en) 3D scene reality augmentation method and system based on depth information
CA2927046A1 (en) Method and system for 360 degree head-mounted display monitoring between software program modules using video or image texture sharing
SA519410265B1 (en) System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display
HK1232329A1 (en) Motion tracking system
CN108600729B (en) Dynamic 3D model generation device and image generation method
CN103269430A (en) Three-dimensional scene generation method based on building information model (BIM)
EP3057316B1 (en) Generation of three-dimensional imagery to supplement existing content
CN102647602B (en) System for converting 2D (two-dimensional) video into 3D (three-dimensional) video on basis of GPU (Graphics Processing Unit)
KR101453531B1 (en) 3D Real-Time Virtual Studio System And Method For Producting Virtual Studio Image In Real-Time Virtual Studio System
CN110784728B (en) Image data processing method and device and computer readable storage medium
KR101920113B1 (en) Arbitrary View Image Generation Method and System
CN119865594A (en) Image rendering method and device, display device and naked eye 3D display system
WO2018187724A8 (en) System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium
CN101292516A (en) Systems and methods for capturing picture data
CN106954060B (en) A kind of three-dimensional video-frequency generation method and auxiliary filming apparatus towards smart phone
KR102145017B1 (en) 3D virtual studio system, and 3D virtual studio image synthesis method
CN109379579B (en) Processing method for acquiring real three-dimensional data of light field in real time
WO2019111052A3 (en) Inserting virtual objects in between two real objects in an augmented reality environment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18781716

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18781716

Country of ref document: EP

Kind code of ref document: A1