Classifications

• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/04—Processes or apparatus for producing holograms
  • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
  • G03H1/2249—Holobject properties
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B29—WORKING OF PLASTICS; WORKING OF SUBSTANCES IN A PLASTIC STATE IN GENERAL
  • B29C—SHAPING OR JOINING OF PLASTICS; SHAPING OF MATERIAL IN A PLASTIC STATE, NOT OTHERWISE PROVIDED FOR; AFTER-TREATMENT OF THE SHAPED PRODUCTS, e.g. REPAIRING
  • B29C67/00—Shaping techniques not covered by groups B29C39/00 - B29C65/00, B29C70/00 or B29C73/00
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
  • G03H1/024—Hologram nature or properties
  • G03H1/0244—Surface relief holograms
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
  • G03H1/0272—Substrate bearing the hologram
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/04—Processes or apparatus for producing holograms
  • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/04—Processes or apparatus for producing holograms
  • G03H1/0465—Particular recording light; Beam shape or geometry
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/04—Processes or apparatus for producing holograms
  • G03H1/0476—Holographic printer
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
  • G03H1/04—Processes or apparatus for producing holograms
  • G03H1/0465—Particular recording light; Beam shape or geometry
  • G03H2001/0469—Object light being reflected by the object
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H2270/00—Substrate bearing the hologram
  • G03H2270/10—Composition
  • G03H2270/13—Metallic
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
  • G03H2270/00—Substrate bearing the hologram
  • G03H2270/52—Integrated surface relief hologram without forming layer

Definitions

• the present disclosure relates to applying holographic effects to two dimensional and three dimensional prints.
• Three dimensional (3D) printing is a process by which a computer model is translated into a physical object. Unlike traditional processes that create models via primarily subtractive processes of chiseling away material, 3D printing is an additive process wherein the physical object is built up with multiple layers of materials. As a result there is less wastage of material in addition to eliminating expensive retooling required to produce different models under the traditional subtractive processes.
• the additive processes are carried out by a 3D printer under the control of a computing device that comprises modules to carry out the printing procedure.
• 3D printers are increasingly used not only to print simple models but also to print various products such as models of sophisticated machinery parts, pharmaceutical tablets or even dental crowns used by dentists.
• a method of generating a model of an object is disclosed in some embodiments.
• the method can be executed by a device comprising one or more processors.
• the method comprises receiving, at the device comprising the processor, a series of printed holograms, each printed hologram comprising at least one holographic pixel that encodes lighting information of one of a plurality of regions of an object surface.
• the object can be a real object or a virtual object.
• the device prints a physical model of the object wherein a surface of the physical model comprises a plurality of portions each of which corresponds to a respective one of the plurality of regions of the object.
• the model of the object is a 2-dimensional model. In some embodiments, the model of the object is a 3-dimensional model. In some embodiments, printing a physical model of the object further comprises receiving, by the device, a three dimensional image of the object and printing the three dimensional model of the of the object from the three dimensional image.
• the series of printed holograms are attached to the physical model such that each printed hologram is attached to that portion of the physical model which corresponds to a respective region of the object surface whose lighting information is encoded in the attached printed hologram.
• a holographic sheet comprising at least a subset of the series of printed holograms is wrapped on the model.
• each of the plurality of printed holograms is affixed to the respective portions of the model surface during the printing.
• the printed series of holograms are relightable holograms.
• an area of each portion of the printed hologram ranges between 0.000001 sq. mm. to 0.25 sq. mm.
• a holographic sheet comprising the series of printed holograms.
• the sheet is divided into a plurality of printed holograms wherein each printed hologram comprises at least one hologram of the series.
• Each of the plurality of printed holograms is attached to that portion of the physical model which corresponds to a respective region of the object surface whose lighting is encoded in the attached printed hologram.
• An apparatus comprising a processor and a storage medium for tangibly storing thereon program logic for execution by the processor for generating a model of an object
• the program logic comprises, receiving logic, executed by the processor, for receiving at the apparatus, a series of printed holograms, each printed hologram comprises at least one holographic pixel that encodes lighting information of one of a plurality of regions of an object surface.
• the programming logic comprises, printing logic, executed by the processor, for printing a physical model of the object wherein a surface of the physical model comprises a plurality of portions, each of which corresponds to a respective one of the plurality of object regions.
• the programming logic further comprises attaching logic, executed by the processor, for attaching the series of printed holograms to the physical model, each printed hologram is attached to that portion of the physical model which corresponds to a respective region of the object surface whose lighting information is encoded in the attached printed hologram.
• the attaching logic comprises logic executed by the processor for wrapping a holographic sheet comprising at least two of the series of printed holograms on the model.
• the processor further executes dividing logic for dividing a holographic sheet comprising the series of printed holograms into a plurality of printed holograms wherein each printed hologram comprises at least one hologram of the series.
• the processor also executes applying logic for applying each of the plurality of printed holograms to that portion of the physical model which corresponds to a respective region of the object surface whose lighting is encoded in the attached printed hologram.
• the processor executes image receiving logic for receiving a three dimensional image of the object and logic is executed by the processor for printing the three dimensional model of the object from the three dimensional image.
• a non-transitory computer readable medium comprising processor-executable instructions is disclosed in one embodiment.
• the instructions comprise instructions for receiving a series of printed holograms, each printed hologram comprising at least one holographic pixel that encodes lighting information of one of a plurality of regions of an object surface.
• the instructions further include instructions for printing a physical model of the object wherein a surface of the physical model comprises a plurality of portions each of which corresponds to a respective one of the plurality of regions and instructions for attaching the series of printed holograms to the physical model.
• the instructions cause each printed hologram to be attached to that portion of the physical model which corresponds to a respective region of the object surface whose lighting information is encoded in the attached printed hologram.
• the instructions for attaching the printed series of holograms to the model further comprise processor-executable instructions for wrapping a holographic sheet comprising at least a subset of the series of printed holograms on the model.
• the instructions for attaching the printed series of holograms to the model further comprise processor-executable instructions for dividing a holographic sheet comprising the series of printed holograms into a plurality of printed holograms wherein each printed hologram comprises at least one hologram of the series and instructions for applying each of the plurality of printed holograms to that portion of the physical model which corresponds to a respective region of the object surface whose lighting is encoded in the attached printed hologram.
• a model of an object is disclosed in some embodiments.
• the model comprises a plurality of portions wherein each portion of the model corresponds to a respective one of a plurality of regions of the object.
• the model further comprises a plurality of holographic prints affixed to the plurality of model portions, wherein each of the holographic prints comprises lighting information of a respective one of the plurality of regions of the object.
• At least one of the plurality of holographic prints is affixed to one of the plurality of model portions that corresponds to the respective one of the plurality of regions of the object for which the lighting information is comprised in the at least one holographic print.
• the lighting information comprised in the at least one holographic print is a bi-directional reflectance distribution function (BRDF) of the respective one of the plurality of object regions.
• An area of each of the holographic prints ranges between 0.000001 sq. mm. to 0.25 sq. mm.
• the model of the object can be a two-dimensional model or a three-dimensional model.
• the properties of light reflected from a surface of the model are similar to properties of light reflected from a surface of the object.
• a method of generating a 3D model of an object comprises obtaining a metallic model of an object.
• the object comprises a plurality of regions.
• the model is made of metal and also comprises a plurality of portions such that each portion of the model corresponds to a respective one of the regions of the object.
• a first processor receives lighting information of the object wherein the lighting information comprises reflectance data of the object regions.
• the lighting information of the object is printed by the first processor, as a series of holograms, each hologram of the series comprising at least one holographic pixel that encodes the reflectance data of a respective one of the object regions.
• Each hologram is printed on a portion of the model that corresponds to the respective one of the object regions.
• the model of the object is printed by a three-dimensional printer capable of printing metallic models with metals such as gold or silver.
• a method of generating a metallic model comprising reflectance data of an object comprises, receiving, by a device comprising a processor, lighting information of an object comprising a plurality of regions, the lighting information comprising reflectance data of the portions.
• a model of an object is printed by the device wherein the model is made of metal and a surface of the model comprises a plurality of portions, each portion of the model surface corresponding to a respective one of the regions of the object.
• the lighting information of the object is transferred to the model by the device as a series of holograms, each hologram of the series comprising at least one holographic pixel that encodes a reflectance data of a respective one of the regions and each hologram is printed on a portion of the model that corresponds to the respective region.
• the device receives a three-dimensional image of the object and prints the three-dimensional model of the object from the three-dimensional image. Similarly, if the device receives a two dimensional image of the object a two- dimensional model of the object is printed from the two dimensional image.
• a method of producing a hologram of an object comprising a plurality of regions comprises obtaining, from a single fixed viewpoint, a plurality of reflectance data sets of the object surface for a respective plurality of light sources.
• the method comprises further steps of illuminating the object surface with one of the plurality of light sources located at a particular position relative to the object and recording, a respective reflectance data of the object surface with the light source at the particular position.
• the light source is moved, for example, by a distance between 0.5 mm -1.0 mm to a new position adjacent to the particular position and the illuminating, the recording and the moving steps are repeated a predetermined number of times for each of the plurality of light sources.
• Aggregated reflectance data is generated by a computing device for each region of the object surface by overlaying reflectance data obtained from the plurality of reflectance data sets for each region of the object surface.
• a light sensitive medium is illuminated with the aggregated reflectance data of at least one of the plurality of regions of the object surface and a hologram of the at least one region is manufactured from the light sensitive medium.
• the hologram is comprised on a substrate having a region between 0.000001 sq. mm to 0.25 sq. mm.
• the object is a real -world object and a light stage apparatus is used to obtain the plurality of reflectance data sets.
• the object is a virtual object and a computing device is used to obtain the plurality of reflectance data sets.
• a substrate comprising a diffraction structure which is a hologram is disclosed in an embodiment.
• the hologram comprises a plurality of images of a virtual or real object overlaid on each other and each of the plurality of images encodes reflectance data of a region of the object surface recorded from a single view point under a respective lighting condition.
• the substrate extends between 0.000001 sq. mm to 0.25 sq. mm.
• the respective lighting conditions comprise at least a light source located at a respective position relative to the object and the view point.
• a reflected ray is generated by the hologram from light incident on the hologram from the light source, the reflected ray generated by the hologram has identical properties as a reflected ray generated by the region of the object surface when illuminated by the light source.
• FIG. 1 is a flowchart that illustrates a methodology of generating a model of an object in accordance with some embodiments.
• FIG. 2 is a flowchart that details a methodology of generating a model of an object in accordance with some embodiments.
• FIG. 3 is a flowchart that details the method of generating a model of an object in accordance with some embodiments.
• FIG. 4 shows a flowchart that details a methodology of generating the lighting information for a relightable hologram which can be used with the 3D printed model of the object in accordance with some embodiments.
• FIG. 5 details a method of generating a relightable hologram in accordance with some embodiments.
• FIG. 6 is an illustration that depicts the lighting information comprising a series of images obtained for a person in accordance with some embodiments.
• FIG. 7 shows a model of an object generated in accordance with embodiments detailed herein.
• FIG. 8 illustrates internal architecture of a computing device in accordance with some embodiments.
• FIG. 9 illustrates a 3D printer apparatus for printing 3D models in accordance with some embodiments.
• the functions/acts noted in the blocks can occur out of the order noted in the operational illustrations.
• two blocks shown in succession can in fact be executed substantially concurrently or the blocks can sometimes be executed in the reverse order, depending upon the functionality/acts involved.
• the embodiments of methods presented and described as flowcharts in this disclosure are provided by way of example in order to provide a more complete understanding of the technology. The disclosed methods are not limited to the operations and logical flow presented herein. Alternative embodiments are contemplated in which the order of the various operations is altered and in which sub-operations described as being part of a larger operation are performed independently.
• a computing device may be capable of sending or receiving signals, such as via a wired or wireless network, or may be capable of processing or storing signals, such as in memory as physical memory states, and may, therefore, operate as a server.
• devices capable of operating as a server may include, as examples, dedicated rack-mounted servers, desktop computers, laptop computers, set top boxes, integrated devices combining various features, such as two or more features of the foregoing devices, or the like.
• Servers may vary widely in configuration or capabilities, but generally a server may include one or more central processing units and memory.
• a server may also include one or more mass storage devices, one or more power supplies, one or more wired or wireless network interfaces, one or more input/output interfaces, or one or more operating systems, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, or the like.
• Improvements in printing technology transformed two dimensional printing of data on a paper into an additive process for printing three-dimensional models from image data fed to computers.
• Three-dimensional printers which are currently used build three-dimensional models by layering printing materials, for example, one micron at a time.
• Models created by three- dimensional printing can comprise robust internal structure that would otherwise not be possible with regular molds.
• Models can be built via the three-dimensional printing process using different materials such as, plastic, metals or resins of different colors.
• current three dimensional printing technologies are limited to primarily printing out models whose surfaces exhibit simple reflectance, Lambertian surfaces for example, which do not convey the true reflectance behavior of the actual objects being modeled.
• a three-dimensional printer may be able to model the detailed structure of the Eiffel tower, it fails to capture in the model the true reflectance properties of the metal that makes up the actual Eiffel tower.
• Another example of a complex structure whose reflectance properties are not properly captured by the three-dimensional printer is the human (or other species) face.
• a face of a living entity comprises a complex collection of hues and shades and reflects light in complex manner that cannot be captured even with the best high-resolution three- dimensional (3D) printers.
• 3D three-dimensional printers with resolutions as fine as 16 - 30 microns are currently available.
• features such as hair and pores can be printed.
• Apparatus such as the dome-like light stage or a mobile light stage is used for capturing reflectance data of an object by illuminating it from different directions.
• a number of images of the object are captured wherein the object in each image is lit by light coming from a different direction than the other images.
• intensities of lights coming from the various directions can be captured for each pixel, which enables reconstructing the image of the object under any other lighting conditions not captured by apparatus such as the light stage via use of mathematical models.
• This can be achieved by fitting a reflectance model to the reflectance measurements obtained from light stage for the object surface.
• a set of reflectance measurements obtained for particular directions can be extrapolated using models such as the Lambertian, Phong or Ward models to obtain intensities for incident angles not included in the measured set.
• BRDF Bi-directional Reflectance Distribution Function
• Embodiments disclosed herein enable providing a model of an object with the light reflectance properties of the object so that the model also reflects light in a manner similar to the object thereby looking more like the actual object when compared to a model printed from a conventional 3D printer. More particularly, embodiments described herein enable recording the light interaction properties of an object and applying such properties to a model of the object. This endows the model with the light reflectance properties of the object thereby making the model look substantially identical to the object.
• the model can be printed by the 3D printer so that the depth information of the object surface is captured in the data received by the 3D printer which it transfers to the model it prints.
• the captured reflectance data is conveyed to the 3D printed model via the relightable holographic techniques as detailed herein.
• the 3D printed model which comprises both the depth and light interaction attributes of the actual object will look more realistic than a model obtained from a 3D printer.
• the reflectance data for the object is printed out as a relightable hologram which is affixed to the 3D printed model.
• Holography is a technique to record lighting information of an object and to reproduce it at a later time in the absence of the object thereby producing an illusion that the object is present.
• the object is illuminated with a light source such as a coherent light source like a laser or spectrally filtered light source.
• the light reflected off the object is combined with a reference beam which may be direct light from the light source.
• the pattern resulting from the interference of the reflected beam with the reference beam is captured on a recording medium like a photograph.
• the recorded pattern captured by employing holography contains much more information than a simple focused image such as a photograph. This enables reproducing a three dimensional image of the object which causes the illusion that the object is present.
• FIG. 1 is a flowchart 100 that illustrates a methodology of generating a model of an object in accordance with some embodiments.
• the method begins at 102 wherein a model of the object is obtained.
• the object can be a real object such as but not limited to a person, an animal or other real -world living/non-living object in some embodiments.
• the object can be a virtual/imaginary object that may or may not exist in the real- world which may comprise without limitation living or non-living entities. Attributes of such virtual objects such as but not limited to, the appearance which can comprise the shape, size, colors, texture, reflectance properties, and other visible and invisible properties may be determined by their creators/designers.
• the model of the real or virtual object can be obtained at 102 via the subtractive or additive processes as described herein.
• An image of object is input to the 3D printer. Again, based on whether the object is a real object or a virtual object, the image input to the 3D printer can be a photograph from a camera or a processor-generated image.
• a model is generated from the received image by the 3D printer in an additive process by repeatedly layering materials such as, powdered resin.
• the depth information of the object's surface can be accurately represented by the 3D model.
• the model comprises a colored surface which includes one or more of red, green blue, cyan, yellow or the like. In an embodiment, the model is made to be the same size as the object.
• the lighting information of the object is obtained.
• the lighting information obtained at 104 can be representative of not only the reflection but also of other complex phenomenon that occur when light interacts with an object surface. This can include other phenomenon such as but not limited to light absorption and/or transmission which include without limitation diffraction and scattering effects.
• the lighting information at 104 can be obtained from imaging apparatus such as a light stage.
• the light stage includes in addition to other components, a camera and light sources whose intensities can be controlled.
• the light stage is configured for generating gradient illumination patterns.
• the light sources are configured and arranged to illuminate the surface of the object with the gradient illumination patterns.
• the light reflected from the illuminated surface of the object is received by a camera which generates data representative of the reflected light.
• the data can comprise interference patterns for generating holograms of the object surface.
• the data from the camera is processed by a computing system so as to estimate the surface normal map of the surface of the object.
• a specular normal map and a diffuse normal map of the surface of the object can be generated separately, by placing polarizers on the light sources and in front of the camera so as to illuminate the surface of the object with polarized spherical gradient illumination patterns.
• data from the light stage can be used to estimate other attributes of the object surface.
• techniques for modeling layered facial reflectance consisting of specular reflectance, single scattering, and shallow and deep subsurface scattering can be employed. Parameters of appropriate reflectance models can be estimated using models as mentioned supra for each of these layers, e.g., from just 20 photographs recorded by the light stage in a few seconds from a single view-point.
• the lighting information at 104 can be obtained from a computing device.
• object surface appearance can be modeled utilizing bidirectional reflectance distribution functions ("BRDFs").
• BRDFs bidirectional reflectance distribution functions
• the BRDF of a surface can be evaluated from mathematical functions which are derived using analytical models. Different models can be employed for determining the reflectance characteristics of different types of materials. In fact, libraries of measured BRDF data can also be accessed from multiple sources.
• the light interaction properties of an object surface can be calculated mathematically in a computer using path tracing. Path tracing is a computer graphics Monte Carlo method of rendering images of three-dimensional scenes.
• CG computer graphics
• the lighting information is obtained at 104 for a plurality of regions of the object surface.
• the lighting information can be collected at 104 for regions of the object surface.
• the area of each region can be determined based on the desired resolution of the resultant image. The greater the desired resolution, the smaller will be the area of each region. Accordingly, object surface can be hypothetically divided into a plurality of regions for obtaining the lighting information.
• the lighting information obtained at 104 for the plurality of object regions can encode multiple viewing angles or multiple lighting conditions depending on the methodology adopted for obtaining the lighting information.
• each pixel of a digital hologram encodes multiple viewing angles for a given light source.
• the lighting information for such a digital hologram is captured via incremental camera movements while keeping the object and the light source at fixed positions.
• the lighting information for each region of the object surface can encode multiple lighting conditions which can be used to print a relightable hologram. This can be achieved by keeping the camera and the object at fixed positions while changing the light sources and region-wise aggregation of the lighting information in accordance with embodiments as detailed further infra.
• the lighting information of the regions of the object surface obtained at 104 is printed out as a series of holograms.
• Each hologram of the series comprises or encodes the lighting information of one of the regions of the object surface.
• each hologram of the series can comprise the lighting information, such as the reflectance data of one of the regions of the object surface. Therefore, reflectance data for each region of the object surface obtained at 104 is printed out as a hologram at 106.
• the reflectance data for each region of the object surface is represented by the BRDF.
• the series of holograms printed out at 106 encode the BRDFs of the regions of the object surface.
• the hologram printed at 106 is thereby configured to create the correct wave front so that the hologram encodes all the different lighting conditions that the object can be exposed to.
• a single sheet comprising the series of holograms is printed out at 106.
• Various known methodologies such as those used by ZEBRA IMAGING can be used for obtaining the series of holograms.
• the method moves directly to step 110 for identifying portions of the 3D printed model that correspond to the regions of the object surface so that the appropriate lighting information can be applied to the 3D printed model.
• a surface of the printed 3D model can be hypothetically divided into portions in a manner similar to the object surface.
• the number of regions of the object surface can be equal to the number of hypothetical portions of the 3D model surface. Therefore, each hypothetical region of the object surface corresponds to a respective portion of the model surface.
• step 112 for affixing the holographic sheet to the model, thus step 108 can be eliminated.
• the sheet of holograms generated at 106 is attached to the 3D printed model such that each of the holograms that comprises lighting data of one particular region of the object surface corresponding to a particular portion of the model is positioned and affixed to that particular portion of the model.
• the sheet of holograms can be positioned and shrink wrapped over the model such that a particular hologram that comprises lighting data of a specific region of the object surface is affixed to the corresponding portion of the model.
• the method moves to step 108, wherein the sheet comprising the series of holograms is cut up or divided into a plurality of segments or a plurality of holographic flakes.
• the sheet is divided such that each segment or flake comprises one hologram of the printed series of holograms.
• a plurality of printed holograms are obtained at 108 wherein each printed hologram comprises reflectance data of one of the regions of the object surface.
• the number of printed holograms or holographic flakes generated at step 108 can be equal to the number of object surface regions or correspondingly the number of model surface portions.
• the area of the printed holograms obtained at 108 can extend between 0.000001 sq. mm. to 0.25 sq. mm.
• the sheet can be divided such that a piece of the sheet comprises two or more holograms.
• the pieces of holograms generated at 108 can comprise one or more holograms each of which encodes reflectance data of respective regions of the object surface.
• the method moves from step 108 to 110 wherein the portions of the 3D model corresponding to the regions of the object surface are identified.
• the flakes of the holographic sheet generated at 108 are attached or affixed to the corresponding portions of the model at 112.
• a 3D printer can be programmed to affix the flakes of the holographic sheet to the corresponding portions of the 3D model as the final layer of the model is being printed.
• a mechanical inkjet of the 3D printer can be programmed to eject the plurality of flakes of the holographic sheet when building the respective portions of the 3D model.
• a 3D printed model is obtained which not only conveys the depth information of an object surface but is further endowed with the reflectance properties of the object surface.
• the holographic pieces on the model are encoded with the reflectance properties of the actual object surface and accordingly mimic the reflectance properties of the object surface.
• FIG. 2 is a flowchart 200 that details a methodology of generating a model of an object in accordance with some embodiments.
• the method begins at 202 wherein a model made of a reflective material such as a metal is obtained.
• the model can be made of metals such as gold or silver.
• the model is the same size as the object and can be obtained via additive processes from a 3D printer or by etching or chiseling a metal block/sheet.
• the lighting information comprising reflectance data of regions of the object is obtained.
• the reflectance data obtained at 204 is similar to the reflectance data obtained at 104.
• the reflectance data of the object is recorded at 104 then such data can be reused thereby rendering step 204 redundant.
• various portions of the model surface that correspond to a respective region of the object are identified.
• the model surface can be the same size as the object region and accordingly, the plurality of portions identified on the model can be the same size as the regions identified on the object surface.
• the lighting information obtained for each region of the object surface is encoded on the corresponding portion of the model surface.
• the lighting information comprises reflectance data for the region for light rays incident on the region from different directions.
• the reflectance data for a plurality of lighting conditions is encoded on the model surface for each region.
• the model can be printed by the 3D printer and the lighting information which includes the reflectance data can be etched on it for example, by a holographic printer.
• the reflectance data can comprise the BRDF of each region of the object surface and the holographic printer can etch a diffraction grating on the surface of the metallic model which changes the refractive index of the model surface.
• the metallic model is illuminated by a light source which serves as a reference beam, the diffraction grating will be operative to produce a hologram which reflects light in a manner that mimics the light reflection by the object. This mitigates the need for printing, dividing and attaching the holographic film to the model surface as described in FIG. 1.
• the metallic model as described herein can be used to model metallic objects.
• FIG. 3 is a flowchart 300 that details the method of generating a model of an object in accordance with some embodiments.
• the method begins at 302 wherein the lighting information comprising, for example, the reflectance data of a region of the object surface is obtained by a computing device attached to a 3D printer.
• the reflectance data of the object is obtained using apparatus such as the light stage.
• the reflectance data is analyzed by the computing device at 304 to determine the nature of the object surface.
• the object surface has a matte finish or if the object surface has a more glossy finish based on the analysis at 304. For example, if the reflectance data fits the Lambertian model, it may be determined at 306 that the object surface has a matte finish else it can be determined that the object surface has a glossy finish. If the object surface has a matte finish, then the ink of the appropriate color can be squirted to generate a layer of the 3D model as shown at 308.
• the holographic data is applied at 312, for example, by attaching tiny flakes of a holographic film in accordance with embodiments described herein.
• an entire model does not need to be covered by the holographic print in accordance with the embodiments described herein. Rather, portions of the model surface corresponding to the glossier surfaces of the objects may be covered with the holographic prints that are generated in accordance with embodiments detailed further infra while portions of the model corresponding to more diffusive object surfaces may receive matte finish via regular 3D printing.
• relightable holograms are used for the glossier surfaces as detailed in FIG. 3.
• holograms encode varying viewpoints under fixed lighting conditions. For example, given a fixed object and a light source, a camera is programmed for microscopic, incremental movements to generate data for printing out a digital hologram. Therefore, when a viewer changes a viewing position when looking at the printed hologram, the hologram appears to have moved to the viewer.
• FIG. 4 shows a flowchart 400 that details a methodology of generating the lighting information for a relightable hologram which can be used with the 3D printed model of the object in accordance with some embodiments.
• a relightable hologram in accordance with some embodiments encodes multiple lighting conditions from a single view point.
• the reflectance data is collected physically for the relightable hologram by maintaining a real -world object and the camera in fixed positions while moving the light source(s) around the object.
• Apparatus such as known in the art for collecting the reflectance data can comprise without limitation, a light stage or a portable light stage which may be used to execute a method as detailed in FIG. 4 for example.
• the reflectance data can be generated entirely by a computing device for either the real -world object or a virtual object for a plurality of lighting conditions.
• the reflectance data can also be partially generated by programming the computing device to extrapolate the data obtained for a real -world object for a subset of the plurality of lighting conditions using known mathematical models.
• Collecting reflectance data for a real -world object using a physical procedure begins at 402 wherein the object whose lighting information is to be collected is illuminated from one or more directions with one or more light source(s).
• the light source(s) is fixed to the dome-like structure of the light stage and the object is placed in the middle of the dome.
• the light sources are independently mobile.
• the region information of the object surface is obtained.
• the regions can comprise microscopic areas on the object surface wherein the number of pixels comprised in an image of the region or microscopic area is estimated for example, by a computing device.
• the light source(s) used to illuminate the object is programmed to move at 406 based on the region information obtained at 404.
• the light source is programmed for minute movements ranging from 0.5 mm -1.0 mm and the number of times the light source moves may depend on the number of regions on the object surface. For example, if the desired resolution of an image of the object surface is 300 PPI (pixels per inch), the light source can be moved 300 times per inch when collecting the reflectance data of the object surface.
• the lighting information of a region of the object surface is captured. In an embodiment, the lighting information can comprise the data associated with the reflectance of the plurality of light rays originating from the plurality of light sources and incident on a region of the object surface.
• the lighting information of a region is obtained at 408, it is determined at 410 if there are more regions whose lighting information needs to be collected. If yes, the light source is moved as shown at 412 and the procedure returns to 408 wherein the lighting information of the next region is obtained. The loop comprising steps 408, 410 and 412 can be repeated until all the regions of the object surface are imaged.
• FIG. 4 details a method of generating a relightable hologram in accordance with some embodiments.
• the method begins at 502 with obtaining lighting information of a plurality of regions of the object under a plurality of lighting conditions as detailed in FIG. 4.
• region-wise reflectance data can be obtained at 502 as a series of images of the object illuminated by one or more light sources from different positions.
• the lighting information of the plurality of regions of the object surface thus obtained is aggregated.
• images of each region of the object that were collected under the plurality of lighting conditions are overlaid on each other to aggregate the lighting information.
• the images are taken from a single camera view point (albeit different lighting conditions) the object appears to be lit by white light when they are overlaid on each other.
• This is in contrast to the traditional methodology of collecting lighting information from a plurality of viewpoints for generating a digital hologram wherein aggregating such lighting information would result in fuzzy, out-of-focus images.
• the view angle may not make as significant contribution to the appearance of the model as proper reflectance would.
• a holographic print of the aggregated lighting information for each region of the object is obtained at 506.
• the aggregated lighting information for each of the plurality of regions is recorded on a light sensitive medium from which the holographic print is generated using known methods.
• photo-sensitive media that can be used to generated holograms can comprise without limitation photographic emulsions, photopolymers, photoresists and similar substances.
• the holographic print obtained at 506 comprises a plurality of relightable holograms each of which encodes multiple lighting conditions for each region of the object as opposed to multiple viewing angles that are encoded in a normal holographic pixel.
• a normal hologram is able to provide image data from different viewing angles
• a relightable hologram in accordance with embodiments described herein provides reflectance data when illuminated by the appropriate lighting conditions.
• the relightable hologram generated at 506 is lit with a light source from a direction substantially similar to those present when the reflectance data was collected, then the light is reflected in a substantially similar manner as the object whose light interactions were recorded at 502.
• the depth and light interaction data are both captured thereby generating a more realistic replica of the object than what would otherwise have been generated by just the 3D printer.
• FIG. 6 is an illustration 600 that depicts the lighting information comprising a series of images 602 of an object obtained in accordance with some embodiments.
• One or more light sources can be programmed for minute movements while the camera and the object remain in fixed positions.
• the image series 602 with 25 images is shown and discussed herein only by the way of illustration and not limitation. Any number of images can be generated for the image series 602 based on the various positions of the light source(s).
• Each image 604 of the plurality of images 602 captures the lighting information of the regions or microscopic areas of the object for a given position of the light source(s).
• the plurality of images 602 were generated by moving serially the light sources, for example, from the left side of the object to its right side while keeping the object and camera in fixed positions. Accordingly, considering the series of images 602 as a 5x5 matrix, the image at the position 5x5 is a mirror image of the image at the position lxl .
• a plurality 606 of such image series can be generated by employing a plurality of lighting conditions. Light sources with varying attributes such as but not limited to the intensities, color/wavelength, type of light can be used to generate the plurality 606 of image series.
• each corresponding individual image 604 from each series 602 of the plurality 606 of series for a given image pixel are overlaid and the resulting images are printed out as a sheet of relightable holograms 608 comprising a plurality of tiny holograms 610 in accordance with some embodiments.
• a relightable hologram of the object surface is generated by superimposing or overlaying each of the lxl images from the plurality of image series 606.
• a relightable hologram is generated by superimposing the each NxN image indicative of a particular light-source/object position with other images indicative of the same position from the various images series 606.
• each hologram 610 of the relightable hologram 608 that encodes lighting information of a plurality of lighting conditions of a single corresponding region of the object surface
• applying one of the plurality of lighting conditions on the sheet of relightable hologram 608 results in a view that would substantially replicate what the object surface looks like when lit under that lighting condition.
• the effect can be further enhanced to look more realistic by application of the relightable holographic pixels on a 3D printed model of the object surface.
• the process as outlined in embodiments herein can aid in generating a more realistic replica of objects such as but not limited to a person's face which can thus be generated from the 3D printed model that is endowed with not only the depth information but also with the person's facial reflectance data.
• FIG. 7 shows a model 700 of an object generated in accordance with embodiments detailed herein.
• the depth and lighting information of the object can be obtained by executing a physical data collection process employing tools such as the light stage.
• the physical structure of the model that shows the depth information is produced by a 3D printer.
• the lighting information is transferred to the model via the holographic sheet comprising the relightable holograms as detailed herein.
• Based on the lighting information of the object there can be certain portions such as for example, the tires 702 of the model 700 that can have matte finish and do not require holograms while other portions such as the body 704 and windshield 706 of the car have holographic flakes/sheet affixed thereto.
• FIG. 8 illustrates internal architecture of a computing device 800 in accordance with some embodiments.
• the computing device 800 or another device substantially similar to it can comprise modules to generate a model and the attributes of a virtual object by an artist for further modelling in accordance with embodiments described herein.
• the computing device 800 can be further configured to include programming logic for generating reflectance data of a virtual object or a real object.
• certain reflectance information of the real object can be obtained via executing a physical procedure as detailed herein while other reflectance information can be generated by programming logic executed by the computing device 800.
• the computing device 800 can also be used to operate a data gathering apparatus such as a light stage as detailed herein.
• the computing device 800 can include modules to drive a printer which can comprise without limitation, a 3D printer to print a 3D model of the object and attach the holographic sheet comprising the lighting information to the printed model.
• the internal architecture of the computing device includes one or more processing units (also referred to herein as CPUs) 812, which interface with at least one computer bus 802. Also interfacing with computer bus 802 are persistent storage medium / media 806, any audio devices 808, network interface 814, memory 804, e.g., random access memory (RAM), run-time transient memory, read only memory (ROM), etc., media disk drive interface 820 for a drive that can read and/or write to media including removable media such as floppy, CD-ROM, DVD, etc., media, display interface 810 as interface for a monitor or other display device, input device interface 818 for input devices such as a keyboard, pointing devices such as a mouse and miscellaneous other interfaces 822 not shown individually, such as parallel and serial port interfaces, a universal serial bus (USB) interface, and the like.
• processing units also referred to herein as CPUs
• USB universal serial bus
• Memory 804 interfaces with computer bus 802 so as to provide information stored in memory 804 to CPU 812 during execution of software programs such as an operating system, application programs, device drivers, and software modules that comprise program code, and/or computer-executable process steps, incorporating functionality described herein, e.g., one or more of process flows described herein.
• CPU 812 first loads software modules for the computer-executable process steps from storage, e.g., memory 804, storage medium / media 806, removable media drive, and/or other storage device.
• CPU 812 can then execute the software modules in order to execute the computer-executable process steps.
• Stored data e.g., data stored by a storage device, can be accessed by CPU 812 during the execution of computer-executable process steps.
• Persistent, non-transitory storage medium / media 806 is a computer readable storage medium(s) that can be used to store software and data, e.g., an operating system and one or more application programs. Persistent storage medium / media 806 can also be used to store device drivers, such as one or more of a digital camera driver, monitor driver, printer driver, scanner driver, or other device drivers, content and other files. Persistent storage medium / media 806 can further include program modules and data files used to implement one or more embodiments of the present disclosure.
• FIG. 9 is a 3D printer 900 for printing 3D models with holographic data in accordance with some embodiments described herein.
• the 3D printer 900 can be connected to a controller, such as, a computing device 900 that provides the software for generation and/or selection of the models to be printed. Specialized 3D printing software packages are available that enable generating the models on a display screen of the computing device 900. Based on the model generated/selected by the user, the computing device 900 can control the 3D printer 900 to produce or print the model.
• the computing device 800 can also be integrated with the 3D printer to form a single unit in accordance with some embodiments.
• the electronics 912 of the 3D printer 900 comprises at least a processor 914 and a non-transitory processor or computer readable non-transitory storage medium 916.
• the processor 914 controls the various parts of the 3D printer 900 based on the programming logic stored on the non-transitory storage medium 916 to produce 3D printed models with holographic data attached thereto.
• a sheet comprising a plurality of relightable holograms that comprise lighting information of the object surface to be printed is fed to the holographic sheet cutter 904 for separation into a plurality of printed holograms for attaching to the 3D printed model as it is being printed.
• the plurality of printed holograms can be obtained externally from a disparate apparatus for separation into a plurality of printed, relightable holograms.
• the plurality of printed, relightable holograms obtained either from the cutter 904 or externally in accordance with embodiments described herein are fed to the extruder 906.
• the extruder 904 is made up of an extruding mechanism comprising a tank to contain the 3D printing ink which can include plastics like colored resins and a nozzle to extrude the 3D printing ink to produce the 3D printed model.
• the extruding mechanism can be further adapted to emit or output each of the relightable holograms of the series as the corresponding portion of the model is printed.
• the electronics 912 of the 3D printer 900 is programmed to enable the extruder 904 to emit particular relightable holograms as the outer surface of the corresponding portion of the 3D model is printed.
• the adjustable printer bed 908 in combination with the extruder moving mechanism 902 enables 3D printing by the extruder 2004.
• the extruder moving mechanism 902 can comprise one or more adjustable frames 922 and X-Y-Z motors 924.
• the extruder 902 is mounted on the frames 922 that are fitted with the X-Y-Z motors that enable moving the extruder 904 along one or more of the X-Y-Z axes on the frames 922.
• the adjustable printer bed 908 onto which the extruder 906 emits the ink can be adjusted adding another dimension of flexibility to the 3D printer 900.
• a cooling mechanism 910 such as a fan is also included in the 3D printer 900 so that upon being printed, the 3D model is cooled.
• the 3D printer 900 is therefore able to print realistic models with depth information and lighting information in accordance with embodiments described herein.
• a computer readable medium stores computer data, which data can include computer program code that is executable by a computer, in machine readable form.
• a computer readable medium may comprise computer readable storage media, for tangible or fixed storage of data, or communication media for transient interpretation of code-containing signals.
• Computer readable storage media refers to physical or tangible storage (as opposed to signals) and includes without limitation volatile and non-volatile, removable and non-removable media implemented in any method or technology for the tangible storage of information such as computer-readable instructions, data structures, program modules or other data.
• Computer readable storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other physical or material medium which can be used to tangibly store the desired information or data or instructions and which can be accessed by a computer or processor.
• a module is a software, hardware, or firmware (or combinations thereof) system, process or functionality, or component thereof, that performs or facilitates the processes, features, and/or functions described herein (with or without human interaction or augmentation).
• a module can include sub-modules.
• Software components of a module may be stored on a computer readable medium. Modules may be integral to one or more servers, or be loaded and executed by one or more servers. One or more modules may be grouped into an engine or an application.

Landscapes

• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Mechanical Engineering (AREA)
• Computing Systems (AREA)
• Theoretical Computer Science (AREA)
• Holo Graphy (AREA)

Applications Claiming Priority (4)

Publications (2)

Family

ID=56978499

Family Applications (3)

Family Applications After (2)

Country Status (5)

Families Citing this family (2)

Family Cites Families (27)

• 2016
  • 2016-03-15 EP EP16769341.5A patent/EP3274770A4/de not_active Withdrawn
  • 2016-03-15 CN CN201680018710.4A patent/CN107430377A/zh active Pending
  • 2016-03-15 KR KR1020177030800A patent/KR102646706B1/ko active IP Right Grant
  • 2016-03-15 WO PCT/US2016/022483 patent/WO2016153850A1/en active Application Filing
  • 2016-03-16 CN CN201680018749.6A patent/CN107430378A/zh active Pending
  • 2016-03-16 CN CN201680018722.7A patent/CN107407906A/zh active Pending
  • 2016-03-16 WO PCT/US2016/022570 patent/WO2016153869A1/en active Application Filing
  • 2016-03-16 WO PCT/US2016/022556 patent/WO2016153867A1/en active Application Filing
  • 2016-03-16 KR KR1020177030464A patent/KR102656989B1/ko active IP Right Grant
  • 2016-03-16 KR KR1020177030522A patent/KR102569427B1/ko active IP Right Grant
  • 2016-03-16 EP EP16769347.2A patent/EP3274771A4/de not_active Withdrawn
  • 2016-03-16 EP EP16769346.4A patent/EP3274772A4/de not_active Withdrawn
• 2018
  • 2018-04-24 HK HK18105332.6A patent/HK1245905A1/zh unknown
  • 2018-04-24 HK HK18105334.4A patent/HK1245907A1/zh unknown
  • 2018-04-24 HK HK18105333.5A patent/HK1245906A1/zh unknown

Also Published As

Similar Documents

Legal Events