CN107430378A - Apply holographic effects to prints - Google Patents
Apply holographic effects to prints Download PDFInfo
- Publication number
- CN107430378A CN107430378A CN201680018749.6A CN201680018749A CN107430378A CN 107430378 A CN107430378 A CN 107430378A CN 201680018749 A CN201680018749 A CN 201680018749A CN 107430378 A CN107430378 A CN 107430378A
- Authority
- CN
- China
- Prior art keywords
- model
- printed
- holograms
- series
- hologram
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
- G03H1/0272—Substrate bearing the hologram
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B29—WORKING OF PLASTICS; WORKING OF SUBSTANCES IN A PLASTIC STATE IN GENERAL
- B29C—SHAPING OR JOINING OF PLASTICS; SHAPING OF MATERIAL IN A PLASTIC STATE, NOT OTHERWISE PROVIDED FOR; AFTER-TREATMENT OF THE SHAPED PRODUCTS, e.g. REPAIRING
- B29C67/00—Shaping techniques not covered by groups B29C39/00 - B29C65/00, B29C70/00 or B29C73/00
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
- G03H1/024—Hologram nature or properties
- G03H1/0244—Surface relief holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0465—Particular recording light; Beam shape or geometry
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0476—Holographic printer
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2249—Holobject properties
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0465—Particular recording light; Beam shape or geometry
- G03H2001/0469—Object light being reflected by the object
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2270/00—Substrate bearing the hologram
- G03H2270/10—Composition
- G03H2270/13—Metallic
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2270/00—Substrate bearing the hologram
- G03H2270/52—Integrated surface relief hologram without forming layer
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Holo Graphy (AREA)
Abstract
Description
相关申请的交叉引用Cross References to Related Applications
本申请涉及实际上与此一起提交的题为“在反光表面上记录全息数据”的美国申请序列号(案卷号139703-011800)和实际上与此一起提交的题为“可重照明全息图”的美国申请序号(案卷号139703-011600)。这些申请的全部公开内容通过引用并入本文。This application is related to U.S. Application Serial No. (Docket No. 139703-011800) entitled "Recording Holographic Data on Reflective Surfaces," which was actually filed herewith, and to which was actually filed herewith, and was entitled "Reilluminatable Holograms" US Application Serial No. (Docket No. 139703-011600). The entire disclosures of these applications are incorporated herein by reference.
技术领域technical field
本公开涉及将全息效果应用于二维和三维打印件。This disclosure relates to the application of holographic effects to 2D and 3D prints.
背景技术Background technique
计算机所使用的常规二维打印机在纸上逐行打印出数据。当这种打印方法被扩展到一层接一层地多层打印时,它能够打印出三维模型。三维(3D)打印是将计算机模型转印成物理对象的过程。不同于主要通过减去剔除材料的过程来创建模型的常规过程,3D打印是一种加法过程,其中物理对象由多层材料构建而成。因此,除了不需要在常规减法过程下生产不同型号所需的昂贵改组外,材料的浪费也较少。加法过程由3D打印机在包括用于执行打印程序的模块的计算设备的控制下进行。这样能够在工厂生产实际对象之前快速且经济地获得模型。随着技术的成熟,3D打印机不仅越来越多地用于打印简单的模型,而且用于打印各种产品,诸如精密机械部件、药片、或者甚至牙科医生使用的牙冠。Conventional 2D printers used by computers print out data line by line on paper. When this printing method is extended to print multiple layers, layer by layer, it is able to print three-dimensional models. Three-dimensional (3D) printing is the process of transferring a computer model into a physical object. Unlike conventional processes, which create models primarily through a subtractive process of removing material, 3D printing is an additive process in which physical objects are built from multiple layers of material. Thus, in addition to eliminating the costly retooling required to produce different models under the conventional subtractive process, there is less waste of material. The additive process is performed by the 3D printer under the control of a computing device that includes modules for executing the printing program. This makes it possible to quickly and economically obtain models before the factory produces the actual objects. As the technology matures, 3D printers are increasingly being used to print not only simple models, but a wide variety of products, such as precision mechanical parts, pills, or even dental crowns used by dentists.
发明内容Contents of the invention
本公开内容涉及用于生成对象的模型的系统和方法,所述模型不仅包括对象表面的深度信息而且包括照明信息。在一些实施例中公开了生成对象的模型的方法。该方法可以由包括一个或多个处理器的设备执行。该方法包括在包括处理器的设备处接收一系列打印全息图,每个打印全息图包括至少一个全息像素,该全息像素对对象表面的多个区域之一的照明信息进行编码。对象可以是真实对象或虚拟对象。设备打印对象的物理模型,其中物理模型的表面包括多个部分,每个部分对应于对象的多个区域中的相应一个区域。在一些实施例中,对象的模型是二维模型。在一些实施例中,对象的模型是三维模型。在一些实施例中,打印对象的物理模型还包括由设备接收对象的三维图像并根据三维图像打印对象的三维模型。The present disclosure relates to systems and methods for generating a model of an object that includes not only depth information of the object's surface but also lighting information. In some embodiments a method of generating a model of an object is disclosed. The method can be performed by a device including one or more processors. The method includes receiving, at a device including a processor, a series of printed holograms, each printed hologram including at least one holographic pixel encoding illumination information for one of a plurality of regions of a surface of an object. Objects can be real objects or virtual objects. The device prints a physical model of the object, wherein a surface of the physical model includes a plurality of portions, each portion corresponding to a respective one of the plurality of regions of the object. In some embodiments, the model of the object is a two-dimensional model. In some embodiments, the model of the object is a three-dimensional model. In some embodiments, printing the physical model of the object further includes receiving, by the device, the three-dimensional image of the object and printing the three-dimensional model of the object according to the three-dimensional image.
在一些实施例中,该系列打印全息图被附着到物理模型,使得每个打印全息图被附着到物理模型的对应于对象表面的相应区域的那部分,该相应区域的照明信息被编码在附着的打印全息图中。在一些实施例中,包括该系列打印全息图的至少一个子集的全息片被包裹在模型上。在一些实施例中,多个打印全息图中的每一个在打印期间被贴附到模型表面的相应部分。在一些实施例中,打印的一系列全息图是可重照明(relightable)全息图。在一些实施例中,打印全息图的每个部分的面积在0.000001平方毫米至0.25平方毫米之间。In some embodiments, the series of printed holograms is attached to the physical phantom such that each printed hologram is attached to that portion of the physical phantom corresponding to a respective region of the object surface for which illumination information is encoded on the attached hologram. of printable holograms. In some embodiments, a hologram comprising at least a subset of the series of printed holograms is wrapped on the model. In some embodiments, each of the plurality of printed holograms is affixed to a corresponding portion of the model surface during printing. In some embodiments, the printed series of holograms are relightable holograms. In some embodiments, the area of each portion of the printed hologram is between 0.000001 mm2 and 0.25 mm2.
在一些实施例中,公开了包括一系列打印全息图的全息片。全息片被分成多个打印全息图,其中每个打印全息图包括该系列的至少一个全息图。多个打印全息图中的每一个被附着到物理模型的对应于对象表面的相应区域的那部分,该相应区域的照明被编码在附着的打印全息图中。In some embodiments, a hologram comprising a series of printed holograms is disclosed. The holographic sheet is divided into a plurality of printed holograms, wherein each printed hologram comprises at least one hologram of the series. Each of the plurality of printed holograms is attached to that portion of the physical model corresponding to a respective region of the object surface, the illumination of which is encoded in the attached printed hologram.
在一些实施例中,公开了一种包括处理器和存储介质的装置,该存储介质用于在其上有形地存储用于由处理器执行以生成对象的模型的程序逻辑。程序逻辑包括由处理器执行的接收逻辑,用于在设备处接收一系列打印全息图,每个打印全息图包括至少一个全息像素,所述全息像素对对象表面的多个区域之一的照明信息进行编码。在一些实施例中,编程逻辑包括由处理器执行的打印逻辑,用于打印对象的物理模型,其中物理模型的表面包括多个部分,每个部分对应于多个对象区域中的相应一个区域。编程逻辑还包括由处理器执行的附着逻辑,用于将一系列打印全息图附着到物理模型,每个打印全息图被附着到物理模型的对应于对象表面的相应区域的那部分,该相应区域的照明信息被编码在附着的打印全息图中。在一些实施例中,附着逻辑包括由处理器执行的逻辑,用于将包括一系列打印全息图中的至少两个的全息片包裹在模型上。In some embodiments, an apparatus is disclosed that includes a processor and a storage medium for tangibly storing thereon program logic for execution by the processor to generate a model of an object. The program logic includes receiving logic executed by the processor to receive at the device a series of printed holograms, each printed hologram including at least one holographic pixel, the holographic pixel providing illumination information for one of the plurality of regions of the surface of the object to encode. In some embodiments, the programming logic includes printing logic executed by the processor to print a physical model of the object, wherein the surface of the physical model includes a plurality of portions, each portion corresponding to a respective one of the plurality of object regions. The programming logic also includes attachment logic executed by the processor for attaching a series of printed holograms to the physical model, each printed hologram being attached to a portion of the physical model corresponding to a corresponding region of the surface of the object, the corresponding region The illumination information is encoded in an attached printed hologram. In some embodiments, the attaching logic includes logic executed by the processor to wrap a hologram comprising at least two of the series of printed holograms over the model.
在一些实施例中,处理器进一步执行划分逻辑,用于将包括一系列打印全息图的全息片划分成多个打印全息图,其中每个打印全息图包括该系列的至少一个全息图。处理器还执行应用逻辑,用于将多个打印全息图中的每一个应用于物理模型的对应于对象表面的相应区域的那部分,该相应区域的照明被编码在附着的打印全息图中。在一些实施例中,处理器执行图像接收逻辑,用于接收对象的三维图像,并且由处理器执行逻辑,以根据三维图像打印对象的三维模型。In some embodiments, the processor further executes partitioning logic for partitioning the holographic sheet comprising the series of printed holograms into a plurality of printed holograms, wherein each printed hologram comprises at least one hologram of the series. The processor also executes application logic for applying each of the plurality of printed holograms to that portion of the physical model corresponding to a corresponding region of the object surface whose illumination is encoded in the attached printed hologram. In some embodiments, the processor executes image receiving logic to receive a three-dimensional image of the object, and the processor executes logic to print a three-dimensional model of the object based on the three-dimensional image.
在一个实施例中公开了一种包括处理器可执行指令的非暂时性计算机可读介质。指令包括用于接收一系列打印全息图的指令,每个打印全息图包括至少一个全息像素,所述全息像素对对象表面的多个区域之一的照明信息进行编码。指令还包括:用于打印对象的物理模型的指令,其中物理模型的表面包括多个部分,每个部分对应于多个区域中的相应一个区域;以及用于将一系列打印全息图附着到物理模型的指令。这些指令使得每个打印全息图被附着到物理模型的对应于对象表面的相应区域的那部分,该相应区域的照明信息被编码在附着的打印全息图中。In one embodiment, a non-transitory computer-readable medium comprising processor-executable instructions is disclosed. The instructions include instructions for receiving a series of printed holograms, each printed hologram including at least one holographic pixel encoding illumination information for one of the plurality of regions of the surface of the object. The instructions also include: instructions for printing a physical model of the object, wherein the surface of the physical model includes a plurality of parts, each part corresponding to a respective one of the plurality of regions; and for attaching a series of printed holograms to the physical Model directives. These instructions cause each printed hologram to be attached to that portion of the physical model corresponding to a corresponding region of the object surface for which illumination information is encoded in the attached printed hologram.
在一些实施例中,用于将打印的一系列全息图附着到模型的指令还包括用于将包括一系列打印全息图的至少一个子集的全息片包裹在模型上的处理器可执行指令。在一些实施例中,用于将打印的一系列全息图附着到模型的指令还包括用于将包括一系列打印全息图的全息片划分成多个打印全息图的处理器可执行指令,其中每个打印全息图包括该系列的至少一个全息图和指令,所述指令用于将多个打印全息图中的每一个应用于物理模型的对应于对象表面的相应区域的那部分,该相应区域的照明被编码在附着的打印全息图中。In some embodiments, the instructions for attaching the printed series of holograms to the model further comprise processor-executable instructions for wrapping a holographic sheet comprising at least a subset of the series of printed holograms on the model. In some embodiments, the instructions for attaching the printed series of holograms to the model further comprise processor-executable instructions for dividing the holographic sheet comprising the series of printed holograms into a plurality of printed holograms, each A printed hologram comprises the series of at least one hologram and instructions for applying each of the plurality of printed holograms to that portion of the physical model corresponding to a corresponding area of the object surface, the corresponding area of Illumination is encoded in an attached printed hologram.
在一些实施例中,公开了一种对象的模型。该模型包括多个部分,其中模型的每个部分对应于对象的多个区域中的相应一个区域。该模型还包括贴附到多个模型部分的多个全息打印件,其中每个全息打印件包括对象的多个区域中的相应一个区域的照明信息。多个全息打印件中的至少一个被贴附于多个模型部分中的与对象的多个区域中的相应一个区域对应的一个模型部分,相应一个区域的照明信息包括在所述至少一个全息打印件中。在一些实施例中,包括在至少一个全息打印件中的照明信息是多个对象区域中的相应一个对象区域的双向反射率分布函数(BRDF)。每个全息打印件的面积范围在0.000001平方毫米至0.25平方毫米之间。对象的模型可以是二维模型或三维模型。在一些实施例中,从模型表面反射的光的性质类似于从对象表面反射的光的性质。In some embodiments, a model of an object is disclosed. The model includes a plurality of parts, wherein each part of the model corresponds to a respective one of the plurality of regions of the object. The model also includes a plurality of holograms attached to the plurality of model portions, wherein each hologram includes illumination information for a corresponding one of the plurality of regions of the object. At least one of the plurality of holographic prints is attached to one of the plurality of model parts corresponding to a corresponding one of the plurality of regions of the object, the illumination information of the corresponding one of the regions included in the at least one holographic print in the file. In some embodiments, the illumination information included in the at least one holographic print is a bi-directional reflectance distribution function (BRDF) of a corresponding one of the plurality of object regions. The area of each holographic print ranges from 0.000001 square millimeter to 0.25 square millimeter. The model of the object can be a two-dimensional model or a three-dimensional model. In some embodiments, the properties of the light reflected from the surface of the model are similar to the properties of the light reflected from the surface of the object.
在一实施例中,公开了一种生成对象的3D模型的方法。该方法包括获得对象的金属模型。该对象包括多个区域。模型由金属制成,并且还包括多个部分,使得模型的每个部分对应于对象区域中的相应一个区域。在一实施例中,第一处理器接收对象的照明信息,其中照明信息包括对象区域的反射率数据。对象的照明信息由第一处理器打印为一系列全息图,该系列的每个全息图包括对对象区域中的相应一个区域的反射率数据进行编码的至少一个全息像素。每个全息图被打印在模型的与对象区域中的相应一个区域对应的一部分上。在一些实施例中,对象的模型由能够用诸如金或银的金属打印金属模型的三维打印机来打印。In one embodiment, a method of generating a 3D model of an object is disclosed. The method includes obtaining a metal model of the object. The object includes multiple regions. The model is made of metal, and also includes a plurality of parts such that each part of the model corresponds to a corresponding one of the object regions. In an embodiment, the first processor receives illumination information of the object, wherein the illumination information includes albedo data for an area of the object. The illumination information of the object is printed by the first processor as a series of holograms, each hologram of the series including at least one holographic pixel encoding reflectance data for a respective one of the object areas. Each hologram is printed on a portion of the model corresponding to a respective one of the object regions. In some embodiments, the model of the object is printed by a three-dimensional printer capable of printing metal models in metals such as gold or silver.
在一实施例中,公开了一种生成包括对象的反射率数据的金属模型的方法。该方法包括:由包括处理器的设备接收包括多个区域的对象的照明信息,该照明信息包括各部分的反射率数据。对象的模型由设备打印,其中模型由金属制成,并且模型的表面包括多个部分,模型表面的每个部分对应于对象区域中的相应一个区域。对象的照明信息作为一系列全息图通过该设备传送到模型,该系列的每个全息图包括至少一个全息像素,所述全息像素对各区域中的相应一个区域的反射率数据进行编码,并且每个全息图被打印在模型的与该相应区域对应的部分上。In one embodiment, a method of generating a metallic model including reflectivity data for an object is disclosed. The method includes receiving, by a device including a processor, illumination information of an object comprising a plurality of regions, the illumination information including reflectivity data for the portions. A model of the object is printed by the device, wherein the model is made of metal, and the surface of the model includes a plurality of parts, each part of the model surface corresponding to a respective one of the object areas. Illumination information of the object is transmitted by the device to the phantom as a series of holograms, each hologram of the series comprising at least one holographic pixel encoding reflectance data for a corresponding one of the regions, and each A hologram is printed on the part of the model corresponding to the corresponding area.
在一些实施例中,设备接收对象的三维图像并根据该三维图像打印对象的三维模型。类似地,如果设备接收对象的二维图像,则根据该二维图像打印对象的二维模型。In some embodiments, a device receives a three-dimensional image of an object and prints a three-dimensional model of the object based on the three-dimensional image. Similarly, if the device receives a two-dimensional image of an object, it prints a two-dimensional model of the object from the two-dimensional image.
在一实施例中,公开了一种制作包括多个区域的对象的全息图的方法。该方法包括从单个固定视点获得针对相应多个光源的对象表面的多个反射率数据集。该方法还包括以下步骤:利用相对于对象位于特定位置的多个光源中的一个光源照亮对象表面;以及记录在特定位置处对象表面相对于光源的相应反射率数据。光源移动例如0.5mm-1.0mm之间的距离到达与特定位置邻近的新位置,并且对于多个光源中的每个光源,将照亮、记录和移动步骤重复预定次数。In one embodiment, a method of making a hologram of an object comprising a plurality of regions is disclosed. The method includes obtaining a plurality of reflectivity data sets of an object surface for a corresponding plurality of light sources from a single fixed viewpoint. The method also includes the steps of: illuminating the surface of the object with a light source of the plurality of light sources located at a particular location relative to the object; and recording corresponding reflectance data for the surface of the object at the particular location relative to the light source. The light source is moved, for example, by a distance between 0.5mm-1.0mm to a new location adjacent to the particular location, and for each of the plurality of light sources, the steps of illuminating, recording and moving are repeated a predetermined number of times.
通过对从用于对象表面的每个区域的多个反射率数据集获得的反射率数据进行叠加,由计算设备生成用于对象表面的每个区域的汇总的反射率数据。利用对象表面的多个区域中的至少一个区域的汇总的反射率数据照射光敏介质,并且由光敏介质制作至少一个区域的全息图。在一些实施例中,全息图被包含在具有0.000001平方毫米至0.25平方毫米之间的区域的基底上。Summarized reflectance data for each region of the object surface is generated by the computing device by superimposing reflectance data obtained from the plurality of reflectance data sets for each region of the object surface. The photosensitive medium is illuminated with aggregated reflectance data for at least one of the plurality of regions of the surface of the object, and a hologram of the at least one region is made from the photosensitive medium. In some embodiments, the hologram is contained on a substrate having an area between 0.000001 mm2 and 0.25 mm2.
在一些实施例中,对象是真实世界的对象,并且利用灯光舞台装置来获得多个反射率数据集。在一些实施例中,对象是虚拟对象,并且利用计算设备来获得多个反射率数据集。In some embodiments, the objects are real world objects, and a light stage arrangement is utilized to obtain the plurality of albedo datasets. In some embodiments, the object is a virtual object, and the computing device is utilized to obtain the plurality of reflectance data sets.
在一实施例中,公开了一种包括作为全息图的衍射结构的基底。全息图包括彼此叠加的虚拟或真实对象的多个图像,并且多个图像中的每个图像对在相应照明条件下从单个视点记录的对象表面的区域的反射率数据进行编码。在一些实施例中,基底在0.000001平方毫米至0.25平方毫米之间扩展。在一些实施例中,相应照明条件至少包括相对于对象和视点位于相应位置处的光源。由全息图从光源入射到全息图上的光产生反射光线,由全息图产生的反射光线与当由光源照射时由对象表面的区域产生的反射光线具有相同的性质。In one embodiment, a substrate including a diffractive structure that is a hologram is disclosed. A hologram comprises multiple images of a virtual or real object superimposed on each other, and each of the multiple images encodes reflectance data for a region of the object's surface recorded from a single viewpoint under corresponding lighting conditions. In some embodiments, the base extends between 0.000001 square millimeters and 0.25 square millimeters. In some embodiments, the respective lighting conditions include at least light sources located at respective positions relative to the object and the viewpoint. Light incident on the hologram from a light source by the hologram produces reflected rays having the same properties as those produced by regions of the surface of the object when illuminated by the light source.
参考以下详细描述和附图,这些和其他实施例对于本领域普通技术人员将是显而易见的。These and other embodiments will become apparent to those of ordinary skill in the art upon reference to the following detailed description and accompanying drawings.
附图说明Description of drawings
附图不是按比例绘制的并且在几个视图中相同的附图标记表示相同的元件,在附图中:The figures are not drawn to scale and like reference numerals denote like elements throughout the several views, in the figures:
图1是流程图,其示出了根据一些实施例的生成对象的模型的方法。Fig. 1 is a flowchart illustrating a method of generating a model of an object according to some embodiments.
图2是流程图,其详细描述了根据一些实施例的生成对象的模型的方法。Figure 2 is a flowchart detailing a method of generating a model of an object according to some embodiments.
图3是流程图,其详细描述了根据一些实施例的生成对象的模型的方法。Figure 3 is a flowchart detailing a method of generating a model of an object according to some embodiments.
图4示出了流程图,其详细描述了根据一些实施例的生成可以与对象的3D打印模型一起使用的可重照明全息图的照明信息的方法。4 shows a flowchart detailing a method of generating illumination information for a reilluminable hologram that can be used with a 3D printed model of an object, according to some embodiments.
图5详细描述了根据一些实施例的生成可重照明全息图的方法。Figure 5 details a method of generating a reilluminable hologram in accordance with some embodiments.
图6是根据一些实施例的描绘包括针对个人获得的一系列图像的照明信息的示图。6 is a diagram depicting lighting information including a series of images obtained for an individual, according to some embodiments.
图7示出了根据本文详细描述的实施例生成的对象的模型。Figure 7 shows a model of an object generated according to an embodiment described in detail herein.
图8示出了根据一些实施例的计算设备的内部架构。Figure 8 illustrates the internal architecture of a computing device according to some embodiments.
图9示出了根据一些实施例的用于打印3D模型的3D打印机装置。Fig. 9 shows a 3D printer apparatus for printing a 3D model according to some embodiments.
具体实施方式detailed description
下面将参考附图更全面地描述主题,附图构成示例性实施例的一部分并且通过说明的方式示出了具体示例性实施例。然而,主题可以以各种不同的形式来体现,并且因此,被涵盖或要求保护的主题旨在解释为不限制于本文阐述的任何示例性实施例;提供示例性实施例仅仅是为了说明。同样,要求保护或涵盖的主题的范围相当广泛。此外,例如,主题可以被体现为方法、设备、部件或系统。因此,实施例可以例如采取硬件、软件、固件或其任何组合的形式。因此,下面的详细描述并不旨在被认为是限制性的。The subject matter will be described more fully hereinafter with reference to the accompanying drawings, which form a part hereof and show specific example embodiments by way of illustration. However, subject matter may be embodied in a variety of different forms, and thus, it is intended that covered or claimed subject matter be construed as not limited to any exemplary embodiments set forth herein; exemplary embodiments are provided for illustration only. Likewise, the range of subject matter claimed or covered is quite broad. Also, for example, the subject matter may be embodied as a method, apparatus, component, or system. Thus, embodiments may, for example, take the form of hardware, software, firmware or any combination thereof. Accordingly, the following detailed description is not intended to be considered limiting.
在附图中,一些特征可以被夸大以示出特定部件的细节(并且附图中所示的任何尺寸、材料和类似细节旨在是说明性的而不是限制性的)。因此,本文所公开的特定的结构细节和功能细节不应被解释为限制性的,而是仅作为教导本领域技术人员多方面应用所公开的实施例的代表性基础。In the drawings, some features may be exaggerated to show details of particular components (and any dimensions, materials and similar details shown in the drawings are intended to be illustrative and not limiting). Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the disclosed embodiments.
下面参考框图以及方法和设备的操作说明来描述本公开,以选择并呈现与特定主题相关的媒体。应当理解,框图或操作说明的各个框以及框图或操作说明中的各框的组合可以通过模拟或数字硬件以及计算机程序指令来实现。这些计算机程序指令可以提供给通用计算机的处理器、专用计算机、ASIC或其他可编程数据处理装置,使得经由计算机的处理器或其他可编程数据处理装置执行的指令实现在框图或操作框中指定的功能/动作。The present disclosure is described below with reference to block diagrams and operational illustrations of methods and apparatus to select and present media related to a particular topic. It will be understood that each block of the block diagrams or operational illustrations, and combinations of blocks in the block diagrams or operational illustrations, can be implemented by analog or digital hardware and computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, an ASIC or other programmable data processing devices, so that the instructions executed via the processor of the computer or other programmable data processing devices realize the functions specified in the block diagrams or operation blocks. function/action.
在一些替代实施方式中,各框中指出的功能/动作可以不按操作说明书中指出的顺序执行。例如,依次显示的两个框实际上可以基本上同时执行,或者各框有时可以以相反的顺序执行,这取决于所涉及的功能/动作。此外,为了提供对技术的更完整理解,通过示例的方式提供了作为本公开中的流程图呈现和描述的各方法的实施例。所公开的方法不限于本文呈现的操作和逻辑流程。可以考虑替代实施例,其中各个操作的顺序改变,并且其中被描述为较大操作的一部分的子操作被独立地执行。In some alternative implementations, the functions/acts noted in the blocks may occur out of the order noted in the operating instructions. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, embodiments of the methods presented and described as flowcharts in this disclosure are provided by way of example in order to provide a more complete understanding of the techniques. The disclosed methods are not limited to the operations and logical flow presented herein. Alternative embodiments are contemplated in which the order of individual operations is changed and in which sub-operations described as part of a larger operation are performed independently.
计算设备能够诸如经由有线或无线网络发送或接收信号,或者能够诸如在物理存储器状态的存储器中处理或存储信号,并且因此可以作为服务器来操作。因此,例如,能够作为服务器操作的设备可以包括例如专用机架式服务器、台式计算机、膝上型计算机、机顶盒、组合各个特征(诸如前述设备的两个或更多个特征)的集成设备等。服务器在配置或能力上可以变化很大,但是服务器通常可以包括一个或多个中央处理单元和存储器。服务器还可以包括一个或多个大容量存储设备、一个或多个电源、一个或多个有线或无线网络接口、一个或多个输入/输出接口、或者一个或多个操作系统(诸如Windows服务器、Mac OS X、Unix、Linux、FreeBSD等)。A computing device is capable of sending or receiving signals, such as via a wired or wireless network, or processing or storing signals, such as in memory in a physical memory state, and thus may operate as a server. Thus, for example, a device capable of operating as a server may include, for example, a dedicated rack server, a desktop computer, a laptop computer, a set-top box, an integrated device combining individual features such as two or more of the aforementioned devices, and the like. Servers can vary widely in configuration or capabilities, but typically servers can include one or more central processing units and memory. The server may also include one or more mass storage devices, one or more power supplies, one or more wired or wireless network interfaces, one or more input/output interfaces, or one or more operating systems (such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, etc.).
在整个说明书和权利要求书中,术语可以具有在上下文中明确陈述的含义之外的暗示或隐含的细微差别。类似地,如本文所使用的短语“在一个实施例中”不一定表示相同的实施例,并且在本文使用的短语“在另一实施例中”不一定表示不同的实施例。例如,要求保护的主题包括全部或部分的示例性实施例的组合。通常,术语可以至少部分地从上下文中的用法来理解。例如,如本文所使用的诸如“和”、“或”或者“和/或”的术语可以包括可以至少部分地根据使用这些术语的上下文的各种含义。通常,如果用于关联列表(诸如A、B或C),“或”旨在表示这里以包含性意义使用的A、B和C,以及这里以排他性意义使用的A、B或C。此外,这里至少部分地根据上下文使用的术语“一个或多个”可以用来描述单数意义上的任何特征、结构或特点,或者可以用来描述复数意义上的特征、结构或特点的组合。类似地,至少部分地根据上下文,还可以理解诸如“一(a、an)”或“该”之类的术语来传达单数用法或传达复数用法。此外,术语“基于”可以理解为不一定旨在传达一组排他的因素,并且可以替代地至少部分地根据上下文而再次允许存在不一定明确描述的附加因素。Throughout the specification and claims, terms may have implied or implied nuances other than those expressly stated in the context. Similarly, the phrase "in one embodiment" as used herein does not necessarily mean the same embodiment, and the phrase "in another embodiment" as used herein does not necessarily mean a different embodiment. For example, claimed subject matter includes combinations of all or part of the exemplary embodiments. In general, a term can be understood at least in part from its usage in context. For example, terms such as "and", "or" or "and/or" as used herein can include various meanings that can depend at least in part on the context in which these terms are used. In general, "or", if used in an associated list such as A, B or C, is intended to mean A, B and C as used herein in the inclusive sense, and A, B or C as used herein in the exclusive sense. In addition, the term "one or more" as used herein at least in part depending on the context may be used to describe any feature, structure or characteristic in the singular or may be used to describe a combination of features, structures or characteristics in the plural. Similarly, terms such as "a, an" or "the" may also be understood to convey singular usage or to convey plural usage, depending at least in part on context. Furthermore, the term "based on" may be understood as not necessarily intended to convey an exclusive set of factors, and may instead allow, again, at least in part, the presence of additional factors not necessarily expressly described, depending on context.
打印技术的改进将纸上的数据的二维打印转换成用于从馈送到计算机的图像数据打印三维模型的加法过程。目前使用的三维打印机通过将打印材料分层(例如每次一微米)来构建三维模型。通过三维打印创建的模型可以包括坚固的内部结构,这对常规模具是不可能的。可以使用不同材料(例如不同颜色的塑料、金属或树脂)经由三维打印过程来构建模型。尽管针对三维打印的用法可以使用各种颜色和材料,但是当前的三维打印技术仍限于主要打印表面呈现出简单反射率的模型,例如朗伯(Lambertian)表面,其不能表达正在被建模的实际对象的真实反射行为。Improvements in printing technology have transformed two-dimensional printing of data on paper into an additive process for printing three-dimensional models from image data fed to a computer. Three-dimensional printers currently in use build three-dimensional models by layering the printing material, eg, one micron at a time. Models created by 3D printing can include strong internal structures, which is not possible with conventional moulds. The model can be built via a three-dimensional printing process using different materials, such as different colored plastics, metals or resins. Although a variety of colors and materials are available for 3D printing usage, current 3D printing techniques are limited to models whose primary printing surfaces exhibit simple reflectivity, such as Lambertian surfaces, which do not represent the actual The true reflective behavior of the object.
虽然三维打印机能够对埃菲尔铁塔的详细结构进行建模,但是它无法在模型中捕获构成实际埃菲尔铁塔的金属的真实反射率特性。反射率特性不能被三维打印机正确捕获的复杂结构的另一示例是人(或其他物种)的面部。活体的面部包含色调和阴影的复杂集合并以即使利用最好的高分辨率三维(3D)打印机也无法捕获的复杂方式来反射光。例如,目前可用的是分辨率精细度达16-30微米的三维打印机。因此,当打印面部时,诸如头发和毛孔的特征可以被打印出来。然而,即使是利用具有最佳分辨率的三维打印机打印出的模型看起来也不真实,尽管其精确地复制了对象结构。这是因为对象的光反射特性由复杂的因素集决定,这些因素不仅包括对象的物理性质(诸如微观表面细节和颜色),而且包括对象本身的化学性质。如果没有本文阐述的改进,则3D打印模型无法准确地捕获对象如何与光相互作用的这种细节。While a 3D printer is capable of modeling the detailed structure of the Eiffel Tower, it cannot capture in the model the true reflectivity properties of the metals that make up the actual Eiffel Tower. Another example of a complex structure whose reflectivity properties cannot be properly captured by a 3D printer is the face of a human (or other species). Living faces contain complex collections of tones and shades and reflect light in complex ways that even the best high-resolution three-dimensional (3D) printers cannot capture. For example, currently available are 3D printers with a resolution as fine as 16-30 microns. Thus, when printing faces, features such as hair and pores can be printed. However, even 3D printers with the best resolutions can look unrealistic even though they accurately reproduce the object's structure. This is because the light reflection properties of an object are determined by a complex set of factors, including not only the physical properties of the object (such as microscopic surface details and color), but also the chemical properties of the object itself. Without the improvements set forth in this paper, 3D printed models cannot accurately capture this detail of how objects interact with light.
目前存在用于详细地捕获和记录对象(诸如生物的面部或皮肤)的复杂光反射特性的技术。将在下文中进一步详细描述的灯光舞台是一个示例。类似地,还存在通过计算设备产生对象的反射特性的技术。例如,利用基于图像的再照明技术在任何照明条件下产生对象的逼真图像。这种技术的应用尤其包括在电影的场景中插入字符。Techniques currently exist for capturing and recording complex light reflection properties of objects such as the face or skin of a living being in detail. A light stage, described in further detail below, is one example. Similarly, techniques also exist for generating reflective properties of objects by computing devices. For example, image-based relighting techniques are used to produce realistic images of objects in any lighting condition. Applications of this technique include inter alia the insertion of characters in scenes of movies.
使用诸如圆顶状灯光舞台或移动灯光舞台之类的装置,用于通过从不同方向照射对象来捕获对象的反射率数据。捕获对象的多个图像,其中每个图像中的对象被来自与其他图像不同方向的光照亮。因此,可以针对每个像素捕获来自各个方向的光的强度,这能够在未被诸如灯光舞台之类的装置捕获的任何其他照明条件下通过使用数学模型来重建对象的图像。这可以通过将反射率模型拟合到从针对对象表面的灯光舞台获得的反射率测量值来实现。此外,可以使用诸如Lambertian、Phong或Ward模型之类的模型来推算针对特定方向获得的一组反射率测量值,从而获得未被包括在测量组中的入射角的强度。Use a setup such as a dome-shaped light stage or a moving light stage for capturing reflectivity data for objects by illuminating them from different directions. Multiple images of an object are captured, where the object in each image is illuminated by light from a different direction than in the other images. Thus, the intensity of light from various directions can be captured for each pixel, which enables the reconstruction of an image of an object by using a mathematical model under any other lighting conditions not captured by a device such as a light stage. This can be achieved by fitting an albedo model to albedo measurements obtained from a light stage against the object's surface. In addition, a set of reflectance measurements obtained for a particular direction can be extrapolated using a model such as the Lambertian, Phong or Ward model to obtain intensities for angles of incidence not included in the set of measurements.
各个表面与光的相互作用可以用双向反射率分布函数(BRDF)来描述。通常,光被反射(或透射)的程度取决于观察者以及相对于表面法线和切线的光位置。由于BRDF指示光是如何被反射的,因此必须捕获反射光的视角和光依赖性质。因此,BRDF是光相互作用点处入射(光)方向和出射(视角)方向相对于局部取向的函数。然而,目前尚不存在赋予3D打印模型以各种光反射特性(例如由对象表面的BRDF表达的那些特性)的技术。The interaction of individual surfaces with light can be described by a bidirectional reflectance distribution function (BRDF). In general, the degree to which light is reflected (or transmitted) depends on the viewer and the position of the light relative to the surface normal and tangent. Since the BRDF indicates how light is reflected, it is necessary to capture the viewing angle and light-dependent properties of the reflected light. Thus, the BRDF is a function of the incoming (light) and outgoing (viewing angle) directions at the point of light interaction with respect to the local orientation. However, currently there is no technology for endowing 3D printed models with various light reflective properties such as those expressed by the BRDF of the object's surface.
本文公开的实施例能够提供对象的模型,其具有对象的光反射特性,从而使得模型也以类似于对象的方式反射光,由此与从常规3D打印机打印的模型相比看起来更像实际对象。更具体地,本文描述的实施例能够记录对象的光相互作用特性并将这些特性应用于对象的模型。这赋予模型以对象的光反射特性,从而使模型看起来与对象基本相同。在一个实施例中,可以由3D打印机打印模型,使得对象表面的深度信息被捕获在3D打印机接收的数据中,该数据传输到打印的模型。在一个实施例中,所捕获的反射率数据经由本文详细描述的可重照明的全息技术被传送到3D打印模型。包括实际对象的深度和光相互作用属性两者的3D打印模型将比从3D打印机获得的模型看起来更真实。Embodiments disclosed herein can provide a model of an object that has the object's light reflective properties such that the model also reflects light in a manner similar to the object, thereby appearing more like the actual object than a model printed from a conventional 3D printer . More specifically, embodiments described herein are capable of recording light interaction properties of an object and applying these properties to a model of the object. This gives the model the light-reflecting properties of the object, making the model appear essentially the same as the object. In one embodiment, the model may be printed by a 3D printer such that depth information of the object's surface is captured in data received by the 3D printer which is transmitted to the printed model. In one embodiment, the captured reflectance data is transferred to the 3D printed model via the re-illuminable holographic technique detailed herein. A 3D printed model that includes both the depth and light interaction properties of the actual object will look more realistic than a model obtained from a 3D printer.
在一些实施例中,对象的反射率数据作为贴附于3D打印模型的可重照明全息图被打印出来。全息照相是一种用于记录对象的照明信息并在以后在没有对象的情况下再现它从而产生存在对象的错觉的技术。为了生成对象的全息图,用诸如相干光源(如激光)或光谱过滤光源之类的光源来照射对象。从对象反射的光与参考光束组合,该参考光束可以是来自光源的直接光。由反射光束与参考光束的干涉产生的图案被捕获在诸如照片之类的记录介质上。然而,通过采用全息照相捕获的记录图案比诸如照片之类的简单聚焦图像包含更多的信息。这使得能够再现对象的三维图像,导致存在对象的错觉。In some embodiments, the object's reflectivity data is printed as a reilluminable hologram attached to the 3D printed model. Holography is a technique for recording the lighting information of an object and later reproducing it without the object to create the illusion that the object is present. To generate a hologram of an object, the object is illuminated with a light source, such as a coherent light source (such as a laser) or a spectrally filtered light source. The light reflected from the object is combined with a reference beam, which may be direct light from the light source. The pattern produced by the interference of the reflected beam with the reference beam is captured on a recording medium such as a photograph. However, recorded patterns captured by employing holography contain more information than simple focused images such as photographs. This enables the reproduction of a three-dimensional image of the object, leading to the illusion that the object is present.
图1是流程图100,其示出了根据一些实施例的生成对象的模型的方法。该方法从102开始,其中获得对象的模型。在一些实施例中,对象可以是真实对象,例如但不限于人、动物或其他真实世界的有生命/无生命的对象。在一些实施例中,对象可以是在真实世界中可以存在或可以不存在的虚拟/虚构对象,其可以包括但不限于有生命或无生命的实体。这些虚拟对象的属性(例如但不限于外观,可以包括形状、尺寸、颜色、纹理、反射特性以及其他可见和不可见特性)可以由他们的创作者/设计者确定。可以通过本文所述的减法或加法过程在102处获得真实或虚拟对象的模型。对象的图像被输入到3D打印机。再次,基于对象是真实对象还是虚拟对象,输入到3D打印机的图像可以是来自相机的照片或处理器生成的图像。通过对材料(诸如粉末状树脂)重复分层,在加法过程中由3D打印机从所接收的图像生成模型。由于3D打印机可以再现对象的详细结构,所以可以通过3D模型精确地表示对象表面的深度信息。在一实施例中,模型包括彩色表面,其包括红色、绿色、蓝色、青色、黄色等中的一种或多种。在一实施例中,模型被制作成与对象的尺寸相同。Figure 1 is a flowchart 100 illustrating a method of generating a model of an object according to some embodiments. The method begins at 102, where a model of an object is obtained. In some embodiments, the objects may be real objects such as, but not limited to, humans, animals, or other real-world animate/inanimate objects. In some embodiments, objects may be virtual/fictional objects that may or may not exist in the real world, which may include, but are not limited to, animate or inanimate entities. Properties of these virtual objects (such as but not limited to appearance, which may include shape, size, color, texture, reflective properties, and other visible and invisible characteristics) may be determined by their creators/designers. A model of a real or virtual object may be obtained at 102 through a subtractive or additive process as described herein. The image of the object is input to the 3D printer. Again, depending on whether the object is real or virtual, the image input to the 3D printer can be a photo from a camera or a processor-generated image. A model is generated by the 3D printer from the received images in an additive process by repeated layering of materials such as powdered resin. Since the 3D printer can reproduce the detailed structure of the object, the depth information of the object surface can be accurately represented by the 3D model. In an embodiment, the model includes a colored surface including one or more of red, green, blue, cyan, yellow, and the like. In one embodiment, the model is made to be the same size as the object.
在104处,获得对象的照明信息。在104处获得的照明信息不仅可以表示反射,而且可以表示光与对象表面相互作用时发生的其他复杂现象。这可以包括其他现象,例如但不限于光吸收和/或透射,其包括但不限于衍射和散射效应。在一个实施例中,104处的照明信息可以从诸如灯光舞台的成像装置获得。在一实施例中,除了其他部件之外,灯光舞台还包括相机和其强度能够被控制的光源。灯光舞台被配置用于产生梯度照明图案。光源被配置和布置成用梯度照明图案照射对象的表面。从被照射的对象表面反射的光被相机接收,相机产生表示反射光的数据。在一些实施例中,数据可以包括用于产生对象表面的全息图的干涉图案。在一些实施例中,来自相机的数据由计算系统处理,以便估计对象表面的表面法线图。At 104, lighting information for the object is obtained. The illumination information obtained at 104 may represent not only reflections, but other complex phenomena that occur when light interacts with object surfaces. This may include other phenomena such as but not limited to light absorption and/or transmission including but not limited to diffraction and scattering effects. In one embodiment, the lighting information at 104 may be obtained from an imaging device such as a light stage. In an embodiment, the light stage includes, among other components, a camera and a light source whose intensity can be controlled. The light stage is configured to produce gradient lighting patterns. The light source is configured and arranged to illuminate the surface of the subject with a gradient illumination pattern. Light reflected from the surface of the illuminated object is received by the camera, which produces data representing the reflected light. In some embodiments, the data may include an interference pattern used to generate a hologram of the object's surface. In some embodiments, data from the camera is processed by the computing system to estimate a surface normal map of the object's surface.
对象表面的镜面反射法线图和漫射法线图可以通过分别将偏振器放置在光源上和相机前方而产生,以便利用偏振的球面梯度照明图案来照射对象的表面。在一实施例中,来自灯光舞台的数据可以用来估计对象表面的其他属性。例如,可以采用用于对由镜面反射率、单散射以及浅层和深层次表面散射组成的分层面部反射来建模的技术。对于这些层中的每一层,可以使用如上文所述的模型来估计适当反射模型的参数,例如,从单个视点在几秒钟内通过灯光舞台记录的仅20张照片。Specular and diffuse normal maps of the object's surface can be generated by placing polarizers on the light source and in front of the camera, respectively, to illuminate the object's surface with a polarized spherical gradient illumination pattern. In an embodiment, data from the light stage can be used to estimate other properties of the object's surface. For example, techniques for modeling layered face reflections consisting of specular albedo, single scattering, and shallow and deep surface scattering can be employed. For each of these layers, a model as described above can be used to estimate the parameters of an appropriate reflection model, e.g. just 20 photographs recorded from a single viewpoint through a light stage in a few seconds.
在一个实施例中,可以从计算设备获得104处的照明信息。例如,可以利用双向反射率分布函数(“BRDF”)来建模对象表面外观。如本文所述,可以从使用分析模型导出的数学函数来评估表面的BRDF。可以使用不同的模型来确定不同类型材料的反射率特性。实际上,也可以从多个来源访问所测量的BRDF数据库。在一个实施例中,可以使用路径跟踪在计算机中以数学方式计算对象表面的光相互作用特性。路径跟踪是一种用于渲染三维场景图像的计算机图形蒙特卡罗方法。事实上,在CG(计算机图形,computer graphics)渲染中存在技术来计算甚至复杂的光相互作用特性,诸如亚毫米分辨率(例如1像素)的色散和散射。因此,可以在104处通过一个或多个物理或数学程序获得对象表面的多个区域的照明信息。In one embodiment, the lighting information at 104 may be obtained from a computing device. For example, a bidirectional reflectance distribution function ("BRDF") can be utilized to model object surface appearance. As described herein, the BRDF of a surface can be estimated from mathematical functions derived using an analytical model. Different models can be used to determine the reflectance properties of different types of materials. In fact, measured BRDF databases can also be accessed from multiple sources. In one embodiment, the light interaction properties of the object's surface can be calculated mathematically in a computer using path tracing. Path tracing is a computer graphics Monte Carlo method for rendering images of 3D scenes. In fact, techniques exist in CG (computer graphics) rendering to calculate even complex light interaction properties, such as dispersion and scattering with submillimeter resolution (eg 1 pixel). Accordingly, illumination information for multiple regions of the object surface may be obtained at 104 by one or more physical or mathematical procedures.
对于对象表面的多个区域,在104处获得照明信息。在一些实施例中,针对对象表面的各区域,可以在104处收集照明信息。可以基于所获得图像的期望分辨率来确定每个区域的面积。期望分辨率越大,每个区域的面积就越小。因此,对象表面可被假想地划分为多个区域以便获得照明信息。Illumination information is obtained at 104 for regions of the object surface. In some embodiments, illumination information may be collected at 104 for regions of the surface of the object. The area of each region can be determined based on the desired resolution of the image obtained. The larger the desired resolution, the smaller the area of each region. Therefore, the object surface can be fictitiously divided into a plurality of regions in order to obtain illumination information.
根据用于获得照明信息的方法,在104处获得的用于多个对象区域的照明信息可以对多个视角或多个照明条件进行编码。例如,数字全息图的每个像素为给定光源的多个视角进行编码。用于这种数字全息图的照明信息通过递增的相机运动来捕获,同时将对象和光源保持在固定位置。Depending on the method used to obtain the lighting information, the lighting information obtained at 104 for multiple object regions may encode multiple viewing angles or multiple lighting conditions. For example, each pixel of a digital hologram encodes multiple viewing angles for a given light source. Illumination information for such digital holograms is captured through incremental camera movements while keeping objects and light sources in fixed positions.
在一些实施例中,用于对象表面的每个区域的照明信息可以对可用于打印可重照明全息图的多个照明条件进行编码。这可以根据下文进一步详细描述的实施例通过将相机和对象保持在固定位置同时改变光源和照明信息的区域聚集来实现。In some embodiments, the lighting information for each region of the object's surface can encode a number of lighting conditions that can be used to print a reilluminable hologram. This may be achieved according to embodiments described in further detail below by keeping the camera and object in fixed positions while varying light sources and area aggregation of illumination information.
在106处,将在104处获得的对象表面的各区域的照明信息作为一系列全息图打印出来。该系列的每个全息图包括对象表面的区域之一的照明信息或对其进行编码。通过说明而不是限制的方式,该系列的每个全息图可以包括照明信息,例如对象表面的区域之一的反射率数据。因此,在104处获得的对象表面的每个区域的反射率数据在106处作为全息图打印出来。在一实施例中,用于对象表面的每个区域的反射率数据由BRDF表示。因此,在106处打印出的一系列全息图对对象表面的各区域的BRDF进行编码。因此,在106处打印的全息图被配置成产生正确的波前(wave front),使得全息图对对象可以暴露的所有不同的照明条件进行编码。在一实施例中,包括一系列全息图的单张片在106处被打印出来。可以使用各种已知的方法(例如由ZEBRA IMAGING使用的那些方法)来获得一系列全息图。At 106, the illumination information obtained at 104 for regions of the object surface is printed out as a series of holograms. Each hologram of the series includes or encodes illumination information for one of the regions of the object's surface. By way of illustration and not limitation, each hologram of the series may include illumination information, such as reflectivity data for one of the regions of the object's surface. Thus, the reflectance data obtained at 104 for each region of the object surface is printed at 106 as a hologram. In an embodiment, the reflectance data for each region of the object surface is represented by a BRDF. Thus, the series of holograms printed at 106 encode the BRDFs of the regions of the object's surface. Thus, the hologram printed at 106 is configured to generate the correct wave front such that the hologram encodes all the different lighting conditions to which the subject may be exposed. In an embodiment, a single sheet comprising a series of holograms is printed at 106 . A series of holograms can be obtained using various known methods such as those used by ZEBRA IMAGING.
在一些实施例中,该方法直接移动到步骤110,用于标识3D打印模型的与对象表面的各区域对应的各部分,使得适当的照明信息可以应用于3D打印模型。打印的3D模型的表面可以以与对象表面相似的方式被假想地划分为多个部分。通过说明而不是限制的方式,对象表面的区域的数量可以等于3D模型表面的假想部分的数量。因此,对象表面的每个假想区域对应于模型表面的相应部分。In some embodiments, the method moves directly to step 110 for identifying portions of the 3D printed model corresponding to regions of the object surface so that appropriate lighting information can be applied to the 3D printed model. The surface of a printed 3D model can be imaginary divided into parts in a similar manner to the surface of an object. By way of illustration and not limitation, the number of regions of the object surface may be equal to the number of imaginary portions of the 3D model surface. Thus, each imaginary area of the object surface corresponds to a corresponding portion of the model surface.
然后,该方法进行到步骤112,用于将全息片贴附到模型,因此可以省去步骤108。在112处,在106处产生的全息片被附着于3D打印模型,使得包括对象表面的与模型的特定部分对应的一个特定区域的照明数据的每个全息图被定位并贴附到模型的该特定部分。例如,全息片可以定位并收缩包裹在模型上,使得包括对象表面的特定区域的照明数据的特定全息图被贴附到模型的相应部分。The method then proceeds to step 112 for attaching the hologram to the model, so step 108 can be omitted. At 112, the holograms produced at 106 are attached to the 3D printed model such that each hologram comprising illumination data for a particular region of the object surface corresponding to a particular portion of the model is positioned and attached to that portion of the model. specific part. For example, a hologram may be positioned and shrink-wrapped onto the model such that a particular hologram comprising illumination data for a particular region of the object's surface is affixed to the corresponding portion of the model.
在一些实施例中,该方法移动到步骤108,其中包括一系列全息图的片被切割或划分为多个片段或多个全息小片。在一实施例中,片被划分成使得每个片段或小片包括打印出的一系列全息图中的一个全息图。作为这种分离的结果,在108处获得多个打印全息图,其中每个打印全息图包括对象表面的区域之一的反射率数据。再次,可以理解的是,在步骤108生成的打印全息图或全息小片的数量可以等于对象表面区域的数量或者相应地等于模型表面部分的数量。通过说明而不是限制的方式,在108处获得的打印全息图的面积可以在0.000001平方毫米至0.25平方毫米之间扩展。在一实施例中,片可以被划分成使得一张片包含两个或更多个全息图。因此,可以理解的是,在108处生成的多张全息片可以包括一个或多个全息图,每个全息图对对象表面的各个区域的反射率数据进行编码。In some embodiments, the method moves to step 108, where a sheet comprising a series of holograms is cut or divided into segments or holographic tiles. In an embodiment, the slices are divided such that each segment or tile comprises one hologram in a series of holograms that are printed. As a result of this separation, a plurality of printed holograms are obtained at 108, wherein each printed hologram includes reflectance data for one of the regions of the object surface. Again, it will be appreciated that the number of printed holograms or holographic patches generated at step 108 may be equal to the number of object surface areas or correspondingly equal to the number of model surface portions. By way of illustration and not limitation, the area of the printed hologram obtained at 108 may extend between 0.000001 square millimeters and 0.25 square millimeters. In an embodiment, slices may be divided such that one slice contains two or more holograms. Thus, it will be appreciated that the plurality of holograms generated at 108 may include one or more holograms, each hologram encoding reflectivity data for a respective region of the object's surface.
在一些实施例中,该方法从步骤108移动到110,其中标识3D模型的与对象表面的各区域对应的各部分。在108处生成的全息片的小片在112处被附着或贴附于模型的对应部分。由于3D打印过程是加法过程,因此可以对3D打印机进行编程,以在模型的最终层被打印时将全息片的小片贴附于3D模型的对应部分。例如,当构建3D模型的相应部分时,可以对3D打印机的机械喷墨进行编程以喷射全息片的多个小片。In some embodiments, the method moves from step 108 to 110, where portions of the 3D model corresponding to regions of the object surface are identified. Small pieces of the hologram generated at 108 are attached or affixed at 112 to corresponding portions of the model. Since the 3D printing process is additive, a 3D printer can be programmed to attach small pieces of the hologram to corresponding parts of the 3D model as the final layers of the model are printed. For example, the mechanical jetting of a 3D printer can be programmed to jet multiple small pieces of the hologram when building the corresponding part of the 3D model.
作为图1中详细描述的过程的结果,获得了不仅传送对象表面的深度信息而且被进一步赋予对象表面的反射率特性的3D打印模型。当光线入射到这样的3D打印模型上时,其以与实际对象基本相同的方式被反射。这是因为模型上的全息片被编码以实际对象表面的反射特性,因此模拟了对象表面的反射性特性。As a result of the process detailed in FIG. 1 , a 3D printed model is obtained that not only conveys depth information of the object surface but is further endowed with reflectivity properties of the object surface. When light is incident on such a 3D printed model, it is reflected in essentially the same way as an actual object. This is because the holograms on the model are encoded with the reflective properties of the actual object's surface, thus simulating the reflective properties of the object's surface.
可以理解的是,全息片被整体包裹或被分离的过程在流程图100中仅通过说明而不是限制的方式单独描述。事实上,在生成3D模型时,这些步骤不必相互排斥,而是可以在生成单个3D模型时一起使用。例如,可以存在这样的部分,其使得包含多个全息图的全息片贴附或包裹于3D模型的一部分,而包含单个全息图的全息片的片段或小片贴附于同一3D模型的其他部分。It can be understood that the process of the holographic sheet being packaged as a whole or separated in the flowchart 100 is only described by way of illustration rather than limitation. In fact, these steps need not be mutually exclusive when generating a 3D model, but can be used together when generating a single 3D model. For example, there may be parts such that a hologram comprising multiple holograms is attached or wrapped to one part of a 3D model, while a fragment or small piece of a hologram comprising a single hologram is attached to other parts of the same 3D model.
图2是根据一些实施例的详细描述生成对象的模型的方法的流程图200。该方法从202开始,其中获得由诸如金属之类的反射材料制成的模型。该模型可以由诸如金或银之类的金属制成。在一些实施例中,该模型具有与对象相同的尺寸,并且可以由3D打印机通过加法过程或者通过蚀刻或凿刻金属块/片来获得。在204处,获得包括对象的各区域的反射率数据的照明信息。在一实施例中,在204处获得的反射率数据类似于在104获得的反射率数据。在一实施例中,如果在104处记录对象的反射率数据,则可以重新使用这样的数据,从而使步骤204冗余。在206处,标识模型表面的与对象的相应区域对应的各个部分。在一实施例中,模型表面可以与对象区域具有相同的尺寸,因此,在模型上标识的多个部分可以与在对象表面上标识的各区域具有相同的尺寸。在210处,对于对象表面的每个区域获得的照明信息被编码在模型表面的对应部分上。FIG. 2 is a flowchart 200 detailing a method of generating a model of an object, according to some embodiments. The method starts at 202, where a model made of reflective material, such as metal, is obtained. The model can be made of metals such as gold or silver. In some embodiments, the model has the same dimensions as the object and can be obtained by a 3D printer through an additive process or by etching or chiseling a metal block/sheet. At 204, illumination information including reflectivity data for regions of the object is obtained. In an embodiment, the reflectance data obtained at 204 is similar to the reflectance data obtained at 104 . In an embodiment, if reflectivity data for the object was recorded at 104, such data may be reused, thereby making step 204 redundant. At 206, portions of the model surface corresponding to respective regions of the object are identified. In an embodiment, the model surface may be the same size as the object area, and thus, portions identified on the model may be the same size as the areas identified on the object surface. At 210, the illumination information obtained for each region of the object surface is encoded on the corresponding portion of the model surface.
在一实施例中,照明信息包括针对从不同方向入射在该区域上的光线的用于该区域的反射率数据。因此,针对多个照明条件的反射率数据被编码在用于每个区域的模型表面上。在一实施例中,该模型可以由3D打印机打印,并且包括反射率数据的照明信息可以例如通过全息打印机蚀刻在其上。In an embodiment, the illumination information includes reflectivity data for the region for light rays incident on the region from different directions. Thus, reflectance data for multiple lighting conditions is encoded on the model surface for each region. In an embodiment, the model may be printed by a 3D printer and illumination information including reflectivity data may be etched on it, eg by a holographic printer.
在一实施例中,反射率数据可以包括对象表面的每个区域的BRDF,并且全息打印机可以在金属模型的表面上蚀刻衍射光栅,其改变模型表面的折射率。当金属模型被用作参考光束的光源照射时,衍射光栅将可操作以产生全息图,该全息图以模仿对象的光反射的方式反射光。这消除了如图1所述的打印、划分及附着全息膜到模型表面的需要。在一实施例中,如本文所述的金属模型可用于对金属对象建模。In an embodiment, the reflectance data may include the BRDF for each region of the object's surface, and the holographic printer may etch a diffraction grating on the surface of the metal model, which changes the refractive index of the model surface. When the metal model is illuminated by a light source used as a reference beam, the diffraction grating will be operable to produce a hologram that reflects light in a manner that mimics that of the object. This eliminates the need to print, divide and attach the holographic film to the surface of the model as described in FIG. 1 . In an embodiment, a metal model as described herein may be used to model metal objects.
可以理解的是,对象表面的不同部分可以具有不同的属性。虽然对象表面的一些区域可能是扩散的,但是对象表面的其他部分可能更有光泽。因此,图3是详细描述了根据一些实施例的生成对象的模型的方法的流程图300。该方法从302开始,其中包括例如对象表面的区域的反射率数据的照明信息通过附接到3D打印机的计算设备获得。在一实施例中,利用诸如灯光舞台之类的装置获得对象的反射率数据。在一实施例中,通过计算设备在304处分析反射率数据,以确定对象表面的性质。在306处,基于304处的分析,确定对象表面是否具有无光泽的光洁度或者对象表面是否具有更有光泽的光洁度。例如,如果反射率数据符合Lambertian模型,则可以在306处确定对象表面具有无光泽的光洁度(matterfinish),否则可以确定对象表面具有光泽的光洁度(glossy finish)。例如,如果反射率数据拟合Lambertian模型,则可在306处确定对象表面具有无光泽的光洁度,否则可以确定对象表面具有光泽的光洁度。如果对象表面具有无光泽的光洁度,则可以喷射适当颜色的油墨以产生3D模型的层,如308处所示。如果确定对象的对象表面的一部分更有光泽,那么在310处通过喷射油墨打印或构建对象表面的该特定部分,并且随后在312处例如通过附着根据本文所述实施例的全息膜的微小片而应用全息数据。因此,可以理解的是,根据本文所述的实施例,整个模型不需要被全息打印件覆盖。相反,模型表面的与对象的更光泽表面对应的部分可以被根据下文进一步详细描述的实施例生成的全息打印件覆盖,而模型的与更扩散对象表面对应的部分可以经由常规3D打印接收无光泽的光洁度。It will be appreciated that different portions of the object's surface may have different properties. While some areas of the object's surface may be diffuse, other parts of the object's surface may be more glossy. Accordingly, FIG. 3 is a flowchart 300 detailing a method of generating a model of an object in accordance with some embodiments. The method begins at 302, where illumination information including reflectivity data for a region of, for example, a surface of an object is obtained by a computing device attached to a 3D printer. In one embodiment, the reflectance data of the object is obtained using a device such as a light stage. In an embodiment, the reflectance data is analyzed at 304 by a computing device to determine properties of the object's surface. At 306, based on the analysis at 304, it is determined whether the object surface has a matte finish or whether the object surface has a more glossy finish. For example, if the reflectance data conforms to the Lambertian model, it may be determined at 306 that the object surface has a matte finish, otherwise it may be determined that the object surface has a glossy finish. For example, if the reflectance data fits a Lambertian model, it may be determined at 306 that the object surface has a matte finish, otherwise it may be determined that the object surface has a glossy finish. If the object surface has a matte finish, ink of the appropriate color may be jetted to create layers of the 3D model, as shown at 308 . If it is determined that a portion of the object surface of the object is more glossy, then at 310 that particular portion of the object surface is printed or constructed by jetting ink, and then at 312, for example, by attaching a tiny piece of a holographic film according to embodiments described herein. Apply holographic data. Thus, it will be appreciated that according to the embodiments described herein, the entire model need not be covered by a holographic print. Conversely, the portion of the model surface corresponding to the more glossy surface of the object can be covered by a holographic print produced according to an embodiment described in further detail below, while the portion of the model corresponding to the more diffuse object surface can receive a matte finish via conventional 3D printing. of smoothness.
在一些实施例中,可重照明全息图用于更光泽的表面,如图3中详细描述的。通常,全息图在固定照明条件下对变化的视点进行编码。例如,给定固定对象和光源时,相机被编程用于微观的递增运动以产生用于打印出数字全息图的数据。因此,当观看者在观看打印全息图时改变观看位置时,全息图似乎已经移动到观看者。图4示出了流程图400,其详细描述了根据一些实施例的产生可以与对象的3D打印模型一起使用的可重照明全息图的照明信息的方法。根据一些实施例的可重照明全息图从单个视点对多个照明条件进行编码。根据一些实施例,通过在围绕对象移动光源的同时将真实世界对象和相机保持在固定位置,物理地收集反射率数据用于可重照明全息图。本领域已知的用于收集反射率数据的装置可以包括但不限于可用来执行例如图4中详细描述的方法的灯光舞台或便携式灯光舞台。在一些实施例中,反射率数据可以完全由针对多个照明条件的用于真实世界对象或虚拟对象的计算设备生成。在一些实施例中,反射率数据还可以通过对计算设备进行编程来部分地生成,以使用已知的数学模型来推断针对多个照明条件的子集获得的用于真实世界对象的数据。In some embodiments, a reilluminable hologram is used for a glossier surface, as detailed in FIG. 3 . Typically, holograms encode varying viewpoints under fixed lighting conditions. For example, given a stationary object and light source, a camera is programmed for microscopic incremental movements to generate data for printing out a digital hologram. Therefore, when the viewer changes the viewing position while viewing the printed hologram, the hologram appears to have moved to the viewer. FIG. 4 shows a flowchart 400 detailing a method of generating illumination information for a reilluminable hologram that can be used with a 3D printed model of an object, according to some embodiments. A reilluminable hologram according to some embodiments encodes multiple lighting conditions from a single viewpoint. According to some embodiments, the reflectance data is physically collected for the reilluminable hologram by keeping the real world object and the camera in fixed positions while moving the light source around the object. Apparatus known in the art for collecting reflectivity data may include, but are not limited to, light stages or portable light stages that may be used to perform methods such as those detailed in FIG. 4 . In some embodiments, the albedo data may be generated entirely by a computing device for a real-world object or a virtual object for multiple lighting conditions. In some embodiments, reflectance data may also be generated in part by programming a computing device to use known mathematical models to extrapolate data for real world objects obtained for a subset of lighting conditions.
利用物理过程收集真实世界对象的反射率数据开始于402,其中利用一个或多个光源从一个或多个方向照亮其照明信息待被收集的对象。在一些实施例中,光源固定于灯光舞台的圆顶状结构,并且对象放置在圆顶的中间。在其他实施例中,光源是可独立移动的。在404处,获得对象表面的区域信息。例如,区域可以包括对象表面上的微观区域,其中例如由计算设备估计包括在区域或微观区域的图像中的像素的数量。在406处,用于照亮对象的光源被编程为基于在404处获得的区域信息而移动。在一实施例中,光源被编程为在0.5mm-1.0mm的范围内做微小移动,并且光源移动的次数可以取决于对象表面上的区域的数量。例如,如果对象表面的图像的期望分辨率为300PPI(每英寸像素),则当收集对象表面的反射率数据时,光源可以每英寸移动300次。在408处,捕获对象表面的区域的照明信息。在一实施例中,照明信息可以包括与源自多个光源且入射在对象表面的区域上的多条光线的反射率相关联的数据。Collecting reflectance data for a real world object using a physical process begins at 402 with one or more light sources illuminating the object whose illumination information is to be collected from one or more directions. In some embodiments, the light source is fixed to the dome-like structure of the light stage, and the object is placed in the middle of the dome. In other embodiments, the light sources are independently movable. At 404, area information of the object surface is obtained. For example, a region may include a microscopic region on a surface of an object, wherein the number of pixels included in an image of the region or microscopic region is estimated, for example, by a computing device. At 406 , a light source for illuminating the object is programmed to move based on the area information obtained at 404 . In one embodiment, the light source is programmed to make small movements in the range of 0.5 mm - 1.0 mm, and the number of times the light source moves may depend on the number of areas on the surface of the object. For example, if the desired resolution of the image of the object's surface is 300 PPI (pixels per inch), the light source may move 300 times per inch when collecting reflectance data for the object's surface. At 408, illumination information for a region of the object surface is captured. In an embodiment, the illumination information may include data associated with reflectivity of a plurality of light rays originating from a plurality of light sources and incident on a region of the surface of the object.
当在408处获得区域的照明信息时,在410处确定是否存在需要收集照明信息的更多区域。如果存在,则如412处所示移动光源,并且过程返回到408,其中获得下一个区域的照明信息。可以重复包括步骤408、410和412在内的循环,直到对象表面的所有区域都被成像。在414处,确定是否存在需要应用于对象以便收集反射率数据的更多照明条件。如果存在,则该方法移动到416,其中选择新的照明条件。在416处选择的新的照明条件可以包括但不限于不同的光源,其中RGB的各种值可以应用于对象以便获得进一步的反射率数据。当在416处选择新的照明条件之后,该方法循环回到步骤402,其中用新选择的照明条件照亮对象,并通过如上所述的方式移动光源来获得反射率数据。When lighting information for an area is obtained at 408, it is determined at 410 whether there are more areas for which lighting information needs to be collected. If so, the light source is moved as shown at 412, and the process returns to 408, where lighting information for the next area is obtained. The loop comprising steps 408, 410 and 412 may be repeated until all regions of the object surface have been imaged. At 414, it is determined whether there are more lighting conditions that need to be applied to the object in order to collect reflectance data. If so, the method moves to 416 where a new lighting condition is selected. The new lighting conditions selected at 416 may include, but are not limited to, different light sources, where various values of RGB may be applied to the object in order to obtain further reflectance data. After a new lighting condition is selected at 416, the method loops back to step 402, where the subject is illuminated with the newly selected lighting condition, and reflectance data is obtained by moving the light source as described above.
图4中描述的成像过程为每个照明条件生成对象的大量图像。例如,图4的过程在执行单一照明条件时,可以生成大约8000张图像。图5详细描述了根据一些实施例的生成可重照明全息图的方法。该方法在502处开始,其在多个照明条件下获得对象的多个区域的照明信息,如图4中详细所述。在一实施例中,可以在502处获得区域方面的反射率数据,作为由一个或多个光源从不同位置照亮的对象的一系列图像。在504处,对如此获得的对象表面的多个区域的照明信息进行汇总。在一些实施例中,将在多个照明条件下收集的对象的每个区域的图像彼此叠加以汇总照明信息。由于图像是从单个相机视点拍摄的(虽然在不同的照明条件下),所以当对象在彼此叠加时似乎是被白光照亮的。这与从多个视点收集照明信息以用于生成数字全息图的常规方法形成对照,在常规方法中汇总这种照明信息将导致模糊、失焦的图像。本领域技术人员可以理解的是,对于如本文所述的对象表面的微小区或区域而言,视角可能不会对模型的外观做出像适当反射率那样显著的贡献。The imaging process described in Figure 4 generates a large number of images of the subject for each lighting condition. For example, the process of Figure 4 can generate approximately 8,000 images when executed for a single lighting condition. Figure 5 details a method of generating a reilluminable hologram in accordance with some embodiments. The method begins at 502 by obtaining lighting information for multiple regions of an object under multiple lighting conditions, as described in detail in FIG. 4 . In an embodiment, area-wise reflectance data may be obtained at 502 as a series of images of an object illuminated by one or more light sources from different locations. At 504, the thus obtained illumination information for multiple regions of the surface of the object is aggregated. In some embodiments, images of each region of the subject collected under multiple lighting conditions are superimposed on each other to summarize lighting information. Since the images are taken from a single camera viewpoint (albeit under different lighting conditions), objects appear to be illuminated with white light when superimposed on top of each other. This is in contrast to conventional methods of collecting illumination information from multiple viewpoints for use in generating digital holograms, where summarizing such illumination information would result in blurry, out-of-focus images. Those skilled in the art will appreciate that for small regions or regions of an object's surface as described herein, viewing angle may not contribute as significantly to the appearance of the model as proper reflectivity.
在506处获得针对对象的每个区域的汇总照明信息的全息打印件。在一些实施例中,将针对多个区域中的每一个区域的汇总照明信息记录在光敏介质上,利用已知方法从光敏介质中生成全息打印件。可用于生成全息图的光敏介质的示例可以包括但不限于照相乳剂、光敏聚合物、光致抗蚀剂和类似物质。在506处获得的全息打印件包括多个可重照明全息图,每个全息图针对对象的每个区域对多个照明条件进行编码,与在正常全息像素中编码的多个视角相反。因此,当正常全息图能够从不同的视角提供图像数据时,根据本文所述实施例的可重照明全息图在由合适的照明条件照亮时提供反射率数据。A holographic print of the aggregated illumination information for each region of the object is obtained at 506 . In some embodiments, the aggregated illumination information for each of the plurality of regions is recorded on a photosensitive medium from which a holographic print is generated using known methods. Examples of photosensitive media that can be used to generate holograms can include, but are not limited to, photographic emulsions, photopolymers, photoresists, and the like. The holographic print obtained at 506 includes multiple re-illuminable holograms, each hologram encoding multiple lighting conditions for each region of the subject, as opposed to multiple viewing angles encoded in normal holographic pixels. Thus, while normal holograms are capable of providing image data from different viewing angles, re-illuminable holograms according to embodiments described herein provide reflectance data when illuminated by suitable lighting conditions.
在一些实施例中,如果506处生成的可重照明全息图由光源从与收集反射率数据时存在的那些方向基本相似的方向点亮,则光以与在502处记录光相互作用的对象基本相似的方式被反射。因此,当对象的3D模型被如本文所述的可重照明全息图覆盖时,深度和光相互作用数据都被捕获,从而生成比仅由3D打印机生成的对象复制品更加真实的对象复制品。In some embodiments, if the re-illuminable hologram generated at 506 is illuminated by a light source from directions substantially similar to those that existed when the reflectance data was collected, the light interacts with the object recorded at 502 in a substantially similar manner. Similar way is reflected. Thus, when a 3D model of an object is overlaid with a reilluminable hologram as described herein, both depth and light interaction data are captured, resulting in a more realistic replica of the object than would be produced by a 3D printer alone.
图6是根据一些实施例的描绘包括所获对象的一系列图像602的照明信息的示图600。当相机和对象保持在固定位置时,可以将一个或多个光源编程为微小的移动。可以理解的是,本文仅通过说明而不是限制的方式示出和讨论具有25个图像的图像系列602。可以基于光源的多个位置为图像系列602生成任何数量的图像。多个图像602中的每个图像604针对光源的给定位置捕获对象的区域或微观区的照明信息。多个图像602是通过将光源例如从对象的左侧顺序地移动到其右侧同时将对象和相机保持在固定位置而生成的。因此,考虑到作为5x 5矩阵的图像系列602,位置5x 5处的图像是位置l x 1处的图像的镜像。可以通过采用多个照明条件来生成多个这样的图像系列606。可以使用具有不同属性(例如但不限于光的强度、颜色/波长、类型)的光源来生成多个图像序列606。FIG. 6 is a diagram 600 depicting lighting information including a series of images 602 acquired of an object, according to some embodiments. One or more light sources can be programmed to move slightly while the camera and subject remain in a fixed position. It will be appreciated that the image series 602 having 25 images is shown and discussed herein by way of illustration only and not limitation. Any number of images may be generated for image series 602 based on multiple positions of light sources. Each image 604 of plurality of images 602 captures illumination information for a region or microscopic region of an object for a given location of a light source. Multiple images 602 are generated by sequentially moving a light source, eg, from the left side of the subject to its right side, while maintaining the subject and camera at fixed positions. Thus, considering the series of images 602 as a 5x5 matrix, the image at position 5x5 is the mirror image of the image at position lxl. Multiple such series of images 606 may be generated by employing multiple lighting conditions. Multiple sequence of images 606 may be generated using light sources having different properties (eg, but not limited to, intensity, color/wavelength, type of light).
根据一些实施例,针对给定图像像素将来自多个系列606的每个系列602的每个对应单个图像604的照明信息进行叠加,并且将所得图像作为包括多个微小全息图610的一张可重照明全息图608而打印出来。例如,假设当光源和对象处于特定位置时多个系列606中的位置l x 1处的每个图像表示成像的对象表面的照明信息,则通过叠置或叠加来自多个图像系列606的每个1x 1图像而生成对象表面的可重照明全息图。因此,通过将表示特定光源/对象位置的每个N x N图像与表示来自多个图像系列606的相同位置的其他图像叠加而生成可重照明全息图。According to some embodiments, the illumination information for each corresponding individual image 604 from each series 602 of the plurality of series 606 is superimposed for a given image pixel, and the resulting image is presented as a single image comprising a plurality of tiny holograms 610 . The hologram 608 is re-illuminated for printing. For example, assuming that each image at position l x 1 in series 606 represents illumination information for the imaged object surface when the light source and object are at a particular position, then by stacking or superimposing each 1 x image from series 606 of images 1 image to generate a reilluminable hologram of the object's surface. Thus, a reilluminable hologram is generated by overlaying each N x N image representing a particular light source/object location with other images representing the same location from a plurality of image series 606 .
由于可重照明全息图608的每个全息图610对对象表面的单个对应区域的多个照明条件的照明信息进行编码,所以将多个照明条件中的一个照明条件应用在可重照明全息图608的片上导致视图将基本上复制对象表面在该照明条件下照亮时看起来的那样。通过将可重照明全息像素应用于对象表面的3D打印模型上,可以进一步增强效果以使看起来更真实。本文实施例中概述的过程可以有助于生成更真实的对象复制品,例如但不限于因此可以从3D打印模型生成的人的面部,其不仅被赋予了深度信息,而且被赋予了人面部的反射率数据。Since each hologram 610 of reilluminable hologram 608 encodes illumination information for multiple illumination conditions for a single corresponding region of the subject surface, applying one of the multiple illumination conditions to reilluminable hologram 608 The on-chip view will essentially replicate what the object's surface would look like when lit under that lighting condition. The effect can be further enhanced to make it appear more realistic by applying reilluminable holographic pixels to the 3D printed model of the object's surface. The process outlined in the embodiments herein can facilitate the generation of more realistic replicas of objects such as, but not limited to, a human face which can thus be generated from a 3D printed model endowed with not only depth information but also the reflectivity data.
图7示出了根据本文详细描述的实施例生成的对象模型700。在一些实施例中,对象的深度和照明信息可以通过采用诸如灯光舞台之类的工具以执行物理数据收集过程来获得。显示深度信息的模型的物理结构由3D打印机制作。照明信息通过包括如本文详细描述的可重照明全息图的全息片被传送到模型。基于对象的照明信息,可以存在可具有无光泽光洁度并且不需要全息图的某些部分(例如,模型700的轮胎702),而其他部分(诸如车的车体704和挡风玻璃706)具有贴附于其上的全息小片/片。FIG. 7 illustrates an object model 700 generated according to embodiments described in detail herein. In some embodiments, depth and lighting information of objects may be obtained by employing tools such as light stages to perform a physical data collection process. The physical structure of the model showing the depth information is made by a 3D printer. The illumination information is conveyed to the model through a hologram comprising a re-illuminable hologram as described in detail herein. Based on the object's lighting information, there may be certain parts (e.g., tires 702 of model 700) that may have a matte finish and do not require a hologram, while other parts (such as the body of a car 704 and windshield 706) have decals. A holographic patch/piece attached to it.
图8示出了根据一些实施例的计算设备800的内部架构。计算设备800或基本与之相似的其它设备可以包括用于由艺术家生成虚拟对象的模型和属性的模块,以便根据本文描述的实施例进一步建模。计算设备800还可以配置为包括用于生成虚拟对象或真实对象的反射率数据的编程逻辑。在一些实施例中,可以通过执行如本文详细描述的物理过程来获得真实对象的某些反射率信息,同时其他反射率信息可以对由计算设备800执行的逻辑进行编程而生成。在一些实施例中,计算设备800还可以用来操作数据采集装置,诸如本文详细描述的灯光舞台。此外,计算设备800可以包括用于驱动打印机的模块并将包括照明信息的全息片附着于打印模型,打印机可以包括但不限于3D打印机以打印对象的3D模型。Figure 8 illustrates the internal architecture of a computing device 800 in accordance with some embodiments. Computing device 800 , or another device substantially similar thereto, may include modules for generating, by an artist, models and properties of virtual objects for further modeling in accordance with embodiments described herein. Computing device 800 may also be configured to include programmed logic for generating reflectivity data for virtual objects or real objects. In some embodiments, some reflectivity information for real objects may be obtained by performing physical processes as detailed herein, while other reflectivity information may be generated by programming logic executed by computing device 800 . In some embodiments, computing device 800 may also be used to operate a data acquisition device, such as the light stage described in detail herein. In addition, the computing device 800 may include a module for driving a printer, which may include but not limited to a 3D printer to print a 3D model of an object, and attach a hologram including lighting information to a print model.
计算设备的内部架构包括与至少一个计算机总线802接口的一个或多个处理单元(本文也称为CPU)812。还与计算机总线802接口的是持久存储介质/媒介806、任何音频设备808、网络接口814、存储器804(例如随机存取存储器(RAM)、运行时瞬态存储器、只读存储器(ROM)等等)、用于驱动器(其可读取和/或写入包括可移除媒介(诸如软盘、CD-ROM、DVD等)的媒介)的媒介盘驱动器接口820、作为监视器或其他显示设备的接口的显示接口810、用于输入设备(诸如键盘)和点击设备(诸如鼠标)的输入设备接口818,以及未单独示出的各种其他接口822,诸如并行和串行端口接口、通用串行总线(USB)接口等。The internal architecture of the computing device includes one or more processing units (also referred to herein as CPUs) 812 that interface with at least one computer bus 802 . Also interfacing with the computer bus 802 are persistent storage media/media 806, any audio equipment 808, a network interface 814, memory 804 (such as random access memory (RAM), runtime transient memory, read only memory (ROM), etc. ), a media disk drive interface 820 for drives that can read and/or write to media including removable media such as floppy disks, CD-ROMs, DVDs, etc., as an interface to a monitor or other display device display interface 810, an input device interface 818 for an input device (such as a keyboard) and a pointing device (such as a mouse), and various other interfaces 822 not shown separately, such as parallel and serial port interfaces, universal serial bus (USB) interface, etc.
存储器804与计算机总线802接口,以便在执行结合有本文所描述的功能(例如本文所述的一个或多个处理流程)的软件程序(诸如操作系统、应用程序、设备驱动器,以及包含程序代码和/或计算机可执行处理步骤的软件模块)期间向CPU 812提供存储在存储器804中的信息。CPU 812首先从存储装置(例如存储器804、存储介质/媒介806、可移除媒介驱动器和/或其他存储设备)加载用于计算机可执行处理步骤的软件模块。CPU 812然后可以执行软件模块以便执行计算机可执行处理步骤。在执行计算机可执行处理步骤期间,CPU812可以访问所存储的数据,例如由存储设备存储的数据。Memory 804 interfaces with computer bus 802 to execute software programs (such as operating systems, application programs, device drivers, and programs containing program code and information stored in memory 804 is provided to CPU 812 during computer-executable processing steps (software modules). CPU 812 first loads software modules for computer-executable processing steps from storage (eg, memory 804, storage media/media 806, removable media drives, and/or other storage devices). CPU 812 may then execute software modules in order to perform computer-executable process steps. During execution of computer-executable process steps, CPU 812 may access stored data, such as data stored by a storage device.
持久的、非暂时性存储介质/媒介806是可以用于存储软件和数据(例如操作系统以及一个或多个应用程序)的计算机可读存储介质。持久存储介质/媒介806还可以用于存储设备驱动器(诸如数字相机驱动器、监控器驱动器、打印机驱动器、扫描仪驱动器或其他设备驱动器中的一种或多种)、内容和其他文件。持久存储介质/媒介806还可以包括用于实现本公开的一个或多个实施例的程序模块和数据文件。Persistent, non-transitory storage media/media 806 are computer-readable storage media that can be used to store software and data, such as an operating system and one or more application programs. Persistent storage/media 806 may also be used to store device drivers (such as one or more of a digital camera driver, monitor driver, printer driver, scanner driver, or other device drivers), content, and other files. Persistent storage medium/media 806 may also include program modules and data files for implementing one or more embodiments of the present disclosure.
图9是根据本文所述的一些实施例的用于利用全息数据打印3D模型的3D打印机900。如上所述,3D打印机900可以连接到控制器,诸如提供用于生成和/或选择待打印的模型的软件的计算设备900。可获得专用3D打印软件包,其能够在计算设备900的显示屏上生成模型。基于用户生成/选择的模型,计算设备900可以控制3D打印机900以制作或打印模型。尽管这里示出为不同的单元,但是可以理解,根据一些实施例,计算设备800也可以与3D打印机集成以形成单个单元。FIG. 9 is a 3D printer 900 for printing a 3D model using holographic data, according to some embodiments described herein. As noted above, 3D printer 900 may be connected to a controller, such as computing device 900, that provides software for generating and/or selecting models to be printed. Dedicated 3D printing software packages are available that are capable of generating models on the display screen of computing device 900 . Based on the model generated/selected by the user, computing device 900 may control 3D printer 900 to make or print the model. Although shown here as distinct units, it is understood that, according to some embodiments, computing device 800 may also be integrated with a 3D printer to form a single unit.
3D打印机900的电子设备912至少包括处理器914和非暂时性处理器或计算机可读的非暂时性存储介质916。处理器914基于存储在非暂时性存储介质916上的编程逻辑来控制3D打印机900的多个部分,从而利用附着于其上的全息数据制作3D打印模型。将包括多个可重照明全息图的片(包括待打印的对象表面的照明信息)进给到全息片切割器904,以便分离成多个打印全息图,从而在打印时附着到3D打印模型。在一些实施例中,可以从用于分离成多个打印的可重照明全息图的独立装置外部地获得多个打印的全息图。The electronic device 912 of the 3D printer 900 includes at least a processor 914 and a non-transitory processor or a computer-readable non-transitory storage medium 916 . Processor 914 controls various parts of 3D printer 900 based on programmed logic stored on non-transitory storage medium 916 to create 3D printed models from holographic data attached thereto. A sheet comprising a plurality of reilluminable holograms (including illumination information of the surface of the object to be printed) is fed to a holographic sheet cutter 904 for separation into a plurality of printed holograms for attachment to the 3D printed model when printing. In some embodiments, the multiple printed holograms may be obtained externally from a separate device for separation into the multiple printed reilluminable holograms.
根据本文所述的实施例,从切割器904或外部获得的多个打印的可重照明全息图被进给到挤出机906。挤出机904由包括罐和喷嘴的挤出机构构成,罐用于容纳可以包括如有色树脂的塑料的3D打印油墨,喷嘴用于挤出3D打印油墨以制作3D打印模型。当打印模型的对应部分时,挤出机构还可以适于发射或输出该系列的每个可重照明全息图。在一些实施例中,3D打印机900的电子设备912被编程为当3D模型的对应部分的外表面被打印时,使得挤出机904能够发射特定的可重照明全息图。According to embodiments described herein, a plurality of printed reilluminable holograms obtained from cutter 904 or externally are fed to extruder 906 . The extruder 904 consists of an extrusion mechanism comprising a tank for containing 3D printing ink, which may include plastic such as colored resin, and a nozzle for extruding the 3D printing ink to make a 3D printed model. The extrusion mechanism may also be adapted to emit or output each re-illuminable hologram of the series when printing the corresponding part of the model. In some embodiments, the electronics 912 of the 3D printer 900 are programmed to enable the extruder 904 to emit a particular re-illuminable hologram when the outer surface of the corresponding portion of the 3D model is printed.
与挤出机移动机构902组合的可调节打印机床908使得能够通过挤出机2004进行3D打印。挤出机移动机构902可以包括一个或多个可调节框架922和X-Y-Z马达924。挤出机902安装在装配有X-Y-Z马达的框架922上,X-Y-Z马达能够使挤出机904沿着框架922上的X-Y-Z轴中的一个或多个轴移动。另外,可以调节挤出机906发射油墨到其上的可调节打印机床908,从而将其它维度的灵活性加入到3D打印机900。3D打印机900中还包括诸如风扇之类的冷却机构910,使得在打印时,3D模型被冷却。因此,根据本文所述的实施例,3D打印机900能够打印具有深度信息和照明信息的真实模型。An adjustable printer bed 908 combined with the extruder movement mechanism 902 enables 3D printing with the extruder 2004 . Extruder movement mechanism 902 may include one or more adjustable frames 922 and X-Y-Z motors 924 . The extruder 902 is mounted on a frame 922 equipped with an X-Y-Z motor capable of moving the extruder 904 along one or more of the X-Y-Z axes on the frame 922 . In addition, the adjustable printer bed 908 onto which the extruder 906 fires ink can be adjusted, thereby adding another dimension of flexibility to the 3D printer 900. A cooling mechanism 910 such as a fan is also included in the 3D printer 900 such that the When printing, the 3D model is cooled. Therefore, according to the embodiments described herein, the 3D printer 900 is capable of printing a realistic model with depth information and lighting information.
为了本公开的目的,计算机可读介质存储计算机数据,所述数据可以包括机器可读形式的可由计算机执行的计算机程序代码。作为示例而非限制,计算机可读介质可以包括用于数据的有形或固定存储的计算机可读存储介质,或者用于暂时解释含代码信号的通信媒介。如本文所使用的,计算机可读存储媒介是指物理或有形存储(与信号相对),并且包括但不限于以任何方法或技术实现的用于信息的有形存储(诸如计算机可读指令、数据结构、程序模块或其他数据)的易失性和非易失性,可移除和不可移除的媒介。计算机可读存储媒介包括但不限于RAM、ROM、EPROM、EEPROM、闪速存储器或其他固态存储器技术、CD-ROM、DVD或其他光学存储器、磁带盒、磁带、磁盘存储器或其他磁存储设备,或者可用于有形地存储所需信息或数据或指令并且可由计算机或处理器访问的任何其他物理或材料介质。For the purposes of the present disclosure, a computer readable medium stores computer data, which may include computer program code in machine readable form executable by a computer. By way of example, and not limitation, a computer readable medium may comprise computer readable storage media for tangible or fixed storage of data, or communication media for the transient interpretation of a code-embedded signal. As used herein, a computer-readable storage medium refers to physical or tangible storage (as opposed to a signal), and includes, but is not limited to, any method or technology for tangible storage of information (such as computer-readable instructions, data structures, , program modules or other data), volatile and nonvolatile, removable and non-removable media. computer-readable storage media including, but not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid-state memory technology, CD-ROM, DVD or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or Any other physical or material medium that can be used to tangibly store desired information or data or instructions and that can be accessed by a computer or processor.
为了本公开的目的,模块是执行或利于本文描述的过程、特征和/或功能(有或没有人的相互作用或扩展)的软件、硬件或固件(或其组合)系统、过程或功能或其部件。模块可以包括子模块。模块的软件组成可以存储在计算机可读介质上。模块可以整合于一个或多个服务器,或者由一个或多个服务器加载并执行。一个或多个模块可以集合成引擎或应用。For the purposes of this disclosure, a module is a software, hardware or firmware (or combination thereof) system, procedure or function or its part. Modules can contain submodules. The software components of the modules may be stored on computer readable media. Modules can be integrated in one or more servers, or loaded and executed by one or more servers. One or more modules can be combined into an engine or an application.
本领域技术人员将认识到,本公开的方法和系统可以以许多方式实现,并且因此不受前述示例性实施例和示例的限制。换句话说,由单个或多个部件(以硬件和软件或固件的各种组合以及单个功能)执行的功能元件可以在客户端或服务器或者两者上分布在软件应用程序中。就此而言,本文描述的不同实施例的任何数量的特征可以组合成单个或多个实施例,并且具有少于或多于本文所描述的所有特征的替代实施例是可能的。功能也可以全部或部分地以现在已知或将来已知的方式分布在多个部件中。因此,无数软件/硬件/固件的组合在实现本文描述的功能、特征、接口和偏好方面是可能的。此外,如本领域技术人员现在和以后能够理解的,本公开的范围涵盖了用于执行所描述的特征和功能和接口的常规已知方式,以及可以对本文描述的硬件或软件或固件部件进行的那些变化和修改。Those skilled in the art will appreciate that the methods and systems of the present disclosure can be implemented in many ways, and thus are not limited by the foregoing exemplary embodiments and examples. In other words, functional elements performed by single or multiple components (in various combinations of hardware and software or firmware as well as single functions) may be distributed among software applications on a client or a server or both. In this regard, any number of features of the different embodiments described herein may be combined into a single or multiple embodiments, and alternative embodiments having less or more than all of the features described herein are possible. Functionality may also be distributed, in whole or in part, among multiple components in any manner known now or in the future. Thus, countless software/hardware/firmware combinations are possible in implementing the functions, features, interfaces and preferences described herein. Furthermore, as those skilled in the art now and hereafter will understand, the scope of the present disclosure encompasses conventionally known ways for performing the described features and functions and interfaces, and hardware or software or firmware components described herein that may be implemented those changes and modifications.
虽然已经根据一个或多个实施例描述了系统和方法,但是应当理解,本公开不必限于所公开的实施例。其旨在涵盖包括在权利要求的精神和范围内的各种修改和类似的布置,其范围应当被赋予最广泛的解释,以便包含所有这些修改和类似的结构。本公开包括所附权利要求的任何和所有实施例。While the systems and methods have been described in terms of one or more embodiments, it is to be understood that the disclosure is not necessarily limited to the disclosed embodiments. It is intended to cover various modifications and similar arrangements included within the spirit and scope of the claims, the scope of which should be given the broadest interpretation so as to encompass all such modifications and similar arrangements. The disclosure includes any and all embodiments of the appended claims.
Claims (27)
Applications Claiming Priority (7)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/670,327 | 2015-03-26 | ||
| US14/670,334 | 2015-03-26 | ||
| US14/670,344 | 2015-03-26 | ||
| US14/670,344 US10031479B2 (en) | 2015-03-26 | 2015-03-26 | Recording holographic data on reflective surfaces |
| US14/670,327 US10481553B2 (en) | 2015-03-26 | 2015-03-26 | Relightable holograms |
| US14/670,334 US10031478B2 (en) | 2015-03-26 | 2015-03-26 | Applying holographic effects to prints |
| PCT/US2016/022556 WO2016153867A1 (en) | 2015-03-26 | 2016-03-16 | Applying holographic effects to prints |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107430378A true CN107430378A (en) | 2017-12-01 |
Family
ID=56978499
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201680018710.4A Pending CN107430377A (en) | 2015-03-26 | 2016-03-15 | Illuminated holograms can be weighed |
| CN201680018722.7A Pending CN107407906A (en) | 2015-03-26 | 2016-03-16 | Holographic data is recorded on reflecting surface |
| CN201680018749.6A Pending CN107430378A (en) | 2015-03-26 | 2016-03-16 | Apply holographic effects to prints |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201680018710.4A Pending CN107430377A (en) | 2015-03-26 | 2016-03-15 | Illuminated holograms can be weighed |
| CN201680018722.7A Pending CN107407906A (en) | 2015-03-26 | 2016-03-16 | Holographic data is recorded on reflecting surface |
Country Status (5)
| Country | Link |
|---|---|
| EP (3) | EP3274770A4 (en) |
| KR (3) | KR102646706B1 (en) |
| CN (3) | CN107430377A (en) |
| HK (3) | HK1245906A1 (en) |
| WO (3) | WO2016153850A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10986326B2 (en) | 2019-02-22 | 2021-04-20 | Avalon Holographics Inc. | Layered scene decomposition CODEC with higher order lighting |
| CN116330667B (en) * | 2023-03-28 | 2023-10-24 | 云阳县优多科技有限公司 | Toy 3D printing model design method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101359215A (en) * | 2007-07-31 | 2009-02-04 | 佳能株式会社 | Computer generated hologram, exposure apparatus, and device fabrication method |
| US20110188102A1 (en) * | 2010-02-02 | 2011-08-04 | Sony Corporation | Hologram-including medium, hologram-including medium producing apparatus, and information authentication method |
| CN103873768A (en) * | 2012-12-14 | 2014-06-18 | 韩国电子通信研究院 | 3d avatar output device and method |
| CN104090476A (en) * | 2014-06-30 | 2014-10-08 | 中国科学院上海光学精密机械研究所 | Method for obtaining 3D scene information for holographic display |
| US20150079327A1 (en) * | 2013-09-18 | 2015-03-19 | Disney Enterprises, Inc. | 3d printing with custom surface reflection |
Family Cites Families (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4969700A (en) * | 1987-12-23 | 1990-11-13 | American Bank Note Holographics, Inc. | Computer aided holography and holographic computer graphics |
| CN1022265C (en) * | 1990-12-03 | 1993-09-29 | 青岛琦美图象有限公司 | Three-dimensional holographic handling method of two-dimensional photographic plate |
| WO1993003427A2 (en) * | 1991-07-26 | 1993-02-18 | Accuwave Corporation | Photorefractive systems and methods |
| JPH0651682A (en) * | 1992-07-28 | 1994-02-25 | Tootsuya:Kk | Hologram pigment and hologram composition |
| US5415950A (en) * | 1993-11-08 | 1995-05-16 | E. I. Du Pont De Nemours And Company | Holographic flake pigment |
| US5680231A (en) * | 1995-06-06 | 1997-10-21 | Hughes Aircraft Company | Holographic lenses with wide angular and spectral bandwidths for use in a color display device |
| GB0112675D0 (en) * | 2001-05-24 | 2001-07-18 | Vantico Ltd | Three-dimensional structured printing |
| US8681352B2 (en) * | 2002-04-18 | 2014-03-25 | Hewlett-Packard Development Company, L.P. | Pull based computer output devices |
| CA2488190A1 (en) * | 2002-06-10 | 2003-12-18 | Dow Global Technologies Inc. | A method for designing a plastic article having a desired appearance |
| US7177026B2 (en) * | 2002-07-17 | 2007-02-13 | New York University | BRDF analyzer |
| US7241489B2 (en) * | 2002-09-13 | 2007-07-10 | Jds Uniphase Corporation | Opaque flake for covert security applications |
| US7830522B2 (en) * | 2002-09-25 | 2010-11-09 | New York University | Method and apparatus for determining reflectance data of a subject |
| DE102004009422A1 (en) * | 2004-02-24 | 2005-09-08 | Metronic Ag | Method and device for applying diffractive elements to surfaces |
| US7202919B2 (en) * | 2004-07-13 | 2007-04-10 | Imation Corp. | Holographic data storage with PDLC spatial light modulator generating reference and object beams |
| US20080258339A1 (en) * | 2004-10-26 | 2008-10-23 | 2089275 Ontario Ltd. | Method for the Production of a Substrate Having a Holographic Appearance |
| US20080241706A1 (en) * | 2007-03-30 | 2008-10-02 | Industrial Technology Research Institute | Holographic data storage medium and fabrication method thereof |
| EP2218743A1 (en) * | 2009-02-12 | 2010-08-18 | Bayer MaterialScience AG | Prepolymer-based polyurethane formulations for producing holographic films |
| EP2553531B1 (en) * | 2010-04-01 | 2019-10-16 | SeeReal Technologies S.A. | Method and device for encoding three-dimensional scenes which include transparent objects in a holographic system |
| WO2012101393A1 (en) * | 2011-01-28 | 2012-08-02 | Hewlett-Packard Development Company, L.P. | Surface structure with light reflectance and transmission properties and method of manufacturing same |
| JP2012211801A (en) * | 2011-03-31 | 2012-11-01 | Tdk Corp | Evaluation method and evaluation device for hologram image recording medium |
| CN202533718U (en) * | 2012-03-20 | 2012-11-14 | 苏州大学 | Large-format relief structure rainbow hologram shooting device |
| US9579850B2 (en) * | 2013-09-05 | 2017-02-28 | The Boeing Company | Three dimensional printing of parts |
-
2016
- 2016-03-15 WO PCT/US2016/022483 patent/WO2016153850A1/en active Application Filing
- 2016-03-15 HK HK18105333.5A patent/HK1245906A1/en unknown
- 2016-03-15 KR KR1020177030800A patent/KR102646706B1/en active Active
- 2016-03-15 EP EP16769341.5A patent/EP3274770A4/en not_active Withdrawn
- 2016-03-15 CN CN201680018710.4A patent/CN107430377A/en active Pending
- 2016-03-16 CN CN201680018722.7A patent/CN107407906A/en active Pending
- 2016-03-16 KR KR1020177030464A patent/KR102656989B1/en active Active
- 2016-03-16 HK HK18105334.4A patent/HK1245907A1/en unknown
- 2016-03-16 EP EP16769346.4A patent/EP3274772A4/en not_active Withdrawn
- 2016-03-16 KR KR1020177030522A patent/KR102569427B1/en active Active
- 2016-03-16 EP EP16769347.2A patent/EP3274771A4/en not_active Withdrawn
- 2016-03-16 WO PCT/US2016/022570 patent/WO2016153869A1/en active Application Filing
- 2016-03-16 CN CN201680018749.6A patent/CN107430378A/en active Pending
- 2016-03-16 WO PCT/US2016/022556 patent/WO2016153867A1/en active Application Filing
- 2016-03-16 HK HK18105332.6A patent/HK1245905A1/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101359215A (en) * | 2007-07-31 | 2009-02-04 | 佳能株式会社 | Computer generated hologram, exposure apparatus, and device fabrication method |
| US20110188102A1 (en) * | 2010-02-02 | 2011-08-04 | Sony Corporation | Hologram-including medium, hologram-including medium producing apparatus, and information authentication method |
| CN103873768A (en) * | 2012-12-14 | 2014-06-18 | 韩国电子通信研究院 | 3d avatar output device and method |
| US20150079327A1 (en) * | 2013-09-18 | 2015-03-19 | Disney Enterprises, Inc. | 3d printing with custom surface reflection |
| CN104090476A (en) * | 2014-06-30 | 2014-10-08 | 中国科学院上海光学精密机械研究所 | Method for obtaining 3D scene information for holographic display |
Also Published As
| Publication number | Publication date |
|---|---|
| KR102646706B1 (en) | 2024-03-11 |
| KR20170129941A (en) | 2017-11-27 |
| WO2016153867A1 (en) | 2016-09-29 |
| KR20170129927A (en) | 2017-11-27 |
| HK1245905A1 (en) | 2018-08-31 |
| KR102656989B1 (en) | 2024-04-11 |
| KR102569427B1 (en) | 2023-08-21 |
| WO2016153850A1 (en) | 2016-09-29 |
| CN107430377A (en) | 2017-12-01 |
| CN107407906A (en) | 2017-11-28 |
| EP3274772A4 (en) | 2018-10-31 |
| KR20170130533A (en) | 2017-11-28 |
| EP3274771A1 (en) | 2018-01-31 |
| EP3274771A4 (en) | 2018-10-31 |
| WO2016153869A1 (en) | 2016-09-29 |
| HK1245906A1 (en) | 2018-08-31 |
| EP3274770A4 (en) | 2018-10-31 |
| EP3274772A1 (en) | 2018-01-31 |
| EP3274770A1 (en) | 2018-01-31 |
| HK1245907A1 (en) | 2018-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10031479B2 (en) | Recording holographic data on reflective surfaces | |
| Peers et al. | A compact factored representation of heterogeneous subsurface scattering | |
| Ratican et al. | A proposed meta-reality immersive development pipeline: Generative ai models and extended reality (xr) content for the metaverse | |
| US20190362539A1 (en) | Environment Synthesis for Lighting An Object | |
| US8903534B2 (en) | System and method for producing three-dimensional multi-layer objects from digital models | |
| US7651225B2 (en) | Three dimensional display system | |
| CN103201772A (en) | 3D physical model generation equipment | |
| US20210389724A1 (en) | Holographic display system | |
| US20130016100A1 (en) | Physical reproduction of reflectance fields | |
| JP6826937B2 (en) | Use of depth in 3D object printing to form colors that change the field of view and illumination angle | |
| Ganovelli et al. | Introduction to computer graphics: A practical learning approach | |
| US20180321639A1 (en) | Applying holographic effects to prints | |
| US10481553B2 (en) | Relightable holograms | |
| KR102646706B1 (en) | Re-illuminable hologram | |
| Jurik et al. | Geometry-corrected light field rendering for creating a holographic stereogram | |
| Dong et al. | Fabricating spatially-varying subsurface scattering | |
| US8952959B2 (en) | Embedding images into a surface using occlusion | |
| Maki et al. | 3DCG art expression on a tablet device using integral photography | |
| JP2011013475A (en) | Apparatus for generating patterned data, medium having anisotropic reflection and method for producing the medium | |
| Dong et al. | Overview of Material Fabrication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1245905 Country of ref document: HK |
|
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20171201 |
|
| WD01 | Invention patent application deemed withdrawn after publication |