WO2021198944A1 - A system and a method to generate and simulate 3d holographic contents - Google Patents

A system and a method to generate and simulate 3d holographic contents Download PDF

Info

Publication number
WO2021198944A1
WO2021198944A1 PCT/IB2021/052682 IB2021052682W WO2021198944A1 WO 2021198944 A1 WO2021198944 A1 WO 2021198944A1 IB 2021052682 W IB2021052682 W IB 2021052682W WO 2021198944 A1 WO2021198944 A1 WO 2021198944A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
holographic
spill
module
projected
Prior art date
Application number
PCT/IB2021/052682
Other languages
French (fr)
Inventor
Abdul Basit SABOOWALA
Original Assignee
Saboowala Abdul Basit
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Saboowala Abdul Basit filed Critical Saboowala Abdul Basit
Publication of WO2021198944A1 publication Critical patent/WO2021198944A1/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/50Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Definitions

  • the present invention relate to generation of a 3D holographic content.
  • the present disclosure describes a method and system for generating 3D holographic content.
  • a 3D hologram is a 3D projection that exists freely in space and is visible without the need for special 3D glasses.
  • 3D Holographic technology is used for displaying a stereoscopic image so that the viewer can feel a three-dimensional image.
  • various techniques such as stereoscopy, holography, and integrated imaging are being researched and developed to reproduce 3D Holographic images.
  • the available solution results in generation of spill image which is a visible noise to a viewer.
  • the available solution are highly expensive and complex.
  • An object of the present invention is to provide a system for generating 3D Holographic content. Another object of the present invention is to provide a method generating 3D Holographic content.
  • Yet another object of the present invention is to provide a method and system for creating 3D holograms without the use of a headset and by using hand gestures.
  • Yet another object of the present invention is to provide a method and system for making a 3D content of a specific format supportable by the system and converting it into a 3D Holographic content which can also be used for real time 3D Holographic Simulation.
  • Yet another object of the present invention is to remove content spill from a 3D holographic image.
  • Embodiments of the present invention discloses a system and a method to generate 3D holographic contents.
  • the system to generate 3D holographic contents comprises a projection module, configured to project one or more content related to an object, a holographic screen, configured to receive the content projected from the projection module, and generate a 3D holographic content from the projected content, and a content spill formed by an unabsorbed light spilled from the holographic screen, and a content spill neutralization module comprises a reflecting surface, configured to receive and redirect the content spill, a content spill area, adapted to receive the redirected content spill.
  • the content spill neutralization module is configured to remove the content spill from a line of sight of one or more viewers.
  • the content is an interactive content.
  • the content may comprise of but not limited to
  • the system comprises an interface, in communication with the projection module, configured to control generation and simulation of the projected content.
  • the holographic screen comprises a plurality of LED configured to illuminate peripheral border of the holographic screen thereby enhancing detailing of the generated 3D holographic content.
  • the projection module in communication with an content processing module configured to receive the content to be projected and/simulated on the holographic screen, from the content processing module.
  • the system comprises a viewing window disposed in front of the holographic screen to enable the one or more viewers to view the holographic screen.
  • the method to generate 3D holographic contents comprises steps of projecting an content related to an object, receiving the projected content on a holographic screen and generating a 3D holographic content from the projected content and a content spill from an unabsorbed light spilled from the holographic screen, and receiving and redirecting the content spill thereby removing the content spill from a line of sight of a viewer of one or more viewers.
  • the content is an interactive content.
  • the method comprises step of controlling generation and simulation of the projected content. In accordance with an embodiment of the present invention, the method comprises step of illuminating a peripheral border of the holographic screen thereby enhancing detailing of the generated 3D holographic content.
  • the method comprises step of enabling the one or more viewers to view the holographic screen using a viewing window.
  • Fig. 1 illustrates a system to generate 3D holographic contents, in accordance with an embodiment of the present invention
  • Fig. 2 illustrates a method to generate 3D holographic contents, in accordance with an embodiment of the present invention
  • Fig. 3 illustrates an information flow diagram (200), in accordance with an embodiment of the present invention
  • Fig. 4 illustrates a front view of an apparatus implementing the system to generate 3D holographic contents, in accordance with an embodiment of the present invention.
  • Fig. 5 illustrates a perspective view of the apparatus implementing the system to generate 3D holographic contents, in accordance with an embodiment of the present invention.
  • compositions or an element or a group of elements are preceded with the transitional phrase “comprising”, it is understood that we also contemplate the same composition, element or group of elements with transitional phrases “consisting of”, “consisting”, “selected from the group of consisting of, “including”, or “is” preceding the recitation of the composition, element or group of elements and vice versa.
  • Figure 1 illustrates a system (100) to generate 3D holographic contents (not shown in figure 1), in accordance with an embodiment of the present invention.
  • the 3D holographic content comprises but not limited to 3D holographic images, 3D holographic Videos, 3D holographic models, and more.
  • the system (100) may comprise a projection module (110), a holographic screen (112), a content spill neutralization module (114), an interface (106), one or more user devices (107), and a data repository (108).
  • the holographic screen (112) may be a screen absorbing light rays, a partially reflecting screen or a refracting screen.
  • the holographic screen (112) may be made of, but not limited to, transparent materials such as glass, fiber, acrylic, PVC, polymethyl methacrylate, polycarbonate, polyethylene, polyethylene terephthalate, or polylactic acid.
  • the projection module (110) is envisaged to include computing capabilities such as a memory unit configured to store machine readable instructions.
  • the machine-readable instructions may be loaded into the memory unit from a non-transitory machine-readable medium, such as, but not limited to, CD-ROMs, DVD-ROMs and Flash Drives.
  • the machine- readable instructions may be loaded in a form of a computer software program into the memory unit.
  • the memory unit in that manner may be selected from a group comprising EPROM, EEPROM and Flash memory.
  • the projection module (110) includes a processor operably connected with the memory unit.
  • the processor may be a microprocessor selected from one of, but not limited to an ARM based or Intel based processor or in the form of field-programmable gate array (FPGA), a general-purpose processor and an application specific integrated circuit (ASIC).
  • FPGA field-programmable gate array
  • ASIC application specific integrated circuit
  • the system (100) may further comprise a communication network (104) configured for enabling connection of the interface (106), the projection module (110) and the one or more user devices (107).
  • the connection may be wired or wireless.
  • the communication network (104) may include Power over Ethernet Switch, USB ports etc. These may allow transferring of data to and from the one or more user devices (107) and the interface (106) with the projection module (110) via ethernet cable, USB cable etc.
  • the communication network (104) may be an Internet of Things (IOT) module, Wi-Fi module, Bluetooth module, RF module etc. adapted to enable a wireless communication between the one or more user devices (107) and the interface (106) with the projection module (110) via the wireless communication network (104).
  • IOT Internet of Things
  • the wireless communication network (104) may be, but not limited to, Bluetooth network, RF network, NFC, WIFI network, Local Area Network (LAN) or a Wide Area Network (WAN).
  • the wireless communication network (104) may be implemented using a number of protocols, such as but not limited to, TCP/IP, 3GPP, 3GPP2, LTE, IEEE 802.x, etc.
  • the all the components of the system (100) are connected with each other via the communication network (104).
  • the system (100) also includes the interface (106).
  • the interface (106) may include a display envisaged to show one or more simulation feature to generate a 3D holographic image.
  • the display may be, but not limited to Light-emitting diode display (LED), electroluminescent display (ELD), liquid crystal display (LCD), Organic light-emitting diode (OLED) & AMOLED display.
  • the interface (106) may include accessories like keyboard, mouse, hand gesture module etc. envisaged to provide input capability to enable a user to enter details of generation and simulation of a 3D content.
  • the interface (106) may be a touch input based display, or a gesture based interface (106) that integrates the input-output functionalities.
  • the one or more user devices (107) and the interface (106) are connected with the projection module (110) via a wired or wireless connection.
  • the one or more user devices (107) may be selected from computing devices such as desktop PC, laptop, PDA or hand-held computing device such as smartphones and tablets.
  • the one or more user devices (107) are associated with one or more users.
  • the one or more user devices (107) are shown in figure 1 using dotted box.
  • the present invention supports may be, but not limited to, all or any of the devices shown in the dotted box.
  • system (100) could be implemented as a distributed system (100) where the projection module (110) the holographic screen (112), the interface (106) and the content spill neutralization module (114) may be at disposed at different locations from each other and/or functions of the projection module (110) could be implemented in a server side computing device or cloud computing environment.
  • the projection module (110) is also envisaged to implement Artificial Intelligence, Machine Learning and deep learning for data collation and processing.
  • the system (100) may also include a data repository (108).
  • the data repository (108) may be a local storage (such as SSD, eMMC, Flash, SD card, etc) or a cloud-based storage.
  • the data repository (108) is envisaged to be capable of providing the data to the projection module (110), when the data is queried appropriately using applicable security and other data transfer protocols.
  • the data repository (108) may store the images, videos, or instruments to create and simulate 3D holographic contents (1121).
  • the projection module (110) may include Al and deep learning-based trained contents using the above data, so as to generate and simulate the 3D holographic content (1121 ).
  • Figure 2 illustrates a method (1000) to generate 3D holographic contents (1121), in accordance with an embodiment of the present invention.
  • This method (1000) would be understood more clearly with the help of an exemplary implementation and information flow shown in Figures 3-5.
  • the figure 3 illustrates an information flow diagram (200), in accordance with an embodiment of the present invention.
  • the method (1000) starts at step 1010 by projecting one or more content or image of an object.
  • the projection module (110) is configured to project an image of an object on a holographic screen (112).
  • the projection module (110) may be a light emitting source or an image projector may be selected from, but not limited to, a DLP (Digital Light Processing) projector, a LCoS (Liquid Crystal on Silicon) projector, LCD (Liquid Crystal Display) projector, an LED projector or a Laser projector.
  • the projector may project a still image or a series of images or a video.
  • the projection module (110) may be in communication with the one or more user devices (107).
  • the one or more user devices (107) may be configured to provide the projection module (110) with the image/ series of images, videos to be projected and/simulated on the holographic screen (112).
  • the one or more user may select the image to be projected using the one or more user devices (107).
  • the projection module (110) may be in communication with an image processing module.
  • the image processing module may be configured to provide the projection module (110) with the images to be projected and/simulated on the holographic screen (112).
  • the projection module (110) may receive image directly from the user.
  • the projection module (110) may be configured to process the received image and project the image.
  • the image processing module is envisaged to include computing capabilities such as a memory unit configured to store machine readable instructions.
  • the machine-readable instructions may be loaded into the memory unit from a non-transitory machine-readable medium, such as, but not limited to, CD-ROMs, DVD-ROMs and Flash Drives.
  • the machine- readable instructions may be loaded in a form of a computer software program into the memory unit.
  • the memory unit in that manner may be selected from a group comprising EPROM, EEPROM and Flash memory.
  • the image processing module includes a processor operably connected with the memory unit.
  • the processor may be a microprocessor selected from one of, but not limited to an ARM based or Intel based processor or in the form of field-programmable gate array (FPGA), a general-purpose processor and an application specific integrated circuit (ASIC).
  • the holographic screen (112) is configured to receive the image projected from the projection module (110).
  • Figure 3 illustrates a front view of an apparatus (102) implementing the system (100) to generate three dimensional (3D) holographic contents (1121), in accordance with an embodiment of the present invention.
  • the holographic screen (112) then generates a 3D holographic content (1121) from the projected image.
  • the light incident on the holographic screen (112) is displayed on a transparent or a translucent screen, giving the projected image a floating aesthetic.
  • the 3D holographic content (s) may be, but not limited to a 3D image, a 3D video, a series of images, an image over image, a video over video, or an interactive 3D model.
  • the 3D holographic contents (1121) can be any information projected and the holographic screen (112).
  • the 3D holographic content (1121) formed is an interactive content.
  • the interactive content may enable one or more viewers to control generation and simulation of the projected image.
  • the viewers may control the generation and simulation of the projected image using the interface (106) connected with the projection module (110).
  • the interface (106) is in communication with the projection module (110).
  • the interface (106) may be configured to control generation and simulation of the projected image.
  • the holographic screen (112) may be unable to absorb a certain amount of light from the projected image.
  • the unabsorbed light spilled from the holographic screen (112) results in formation of a content spill.
  • the content spill is a visual noise and is visible at a certain angle.
  • the content spill is visible beyond the 3D holographic content (1121).
  • the content spill is an undesirable phenomenon which destroys the visualization experience of 3D holographic content (1121) generated.
  • the content spill neutralization module (114) is configured to remove the content spill from a line of sight of one or more viewers.
  • Figure 4 illustrates a perspective view of the apparatus (102) implementing the system (100) to generate 3D holographic contents (1121), in accordance with an embodiment of the present invention.
  • the content spill neutralization module (114) comprises a reflective surface (1141), configured to receive and redirect the content spill.
  • the reflective surface (1141) may be, but not limited to a one way or a two-way mirror.
  • the reflective surface (1141) may be a convex or a concave mirror or a combination thereof.
  • the reflective surface (1141) may be a convex or a concave lens or a combination thereof.
  • the content spill neutralization module (114) comprises a content spill area also referred to as content spill area (1142) which is adapted to receive the redirected content spill.
  • the content spill area/content spill area (1142) may be an empty area painted in black to absorb the redirected content spill.
  • the holographic screen (112) comprises a plurality of LEDs (1122).
  • the plurality of LEDs (1122) may be arranged on peripheral border of the holographic screen (112).
  • the plurality of LEDs (1122) may be configured to illuminate peripheral border of the holographic screen (112) thereby enhancing detailing of the generated 3D holographic content (1121 ).
  • the invention works in following manner:
  • the projection module (110) projects image on the holographic screen (112).
  • the holographic screen (112) is a vertical transparent projection medium producing a 3D image in the region.
  • the one or more users may provide input images to the projection module (110) directly or using the one or more user devices (107).
  • the projection module (110) may acquire images for projection from a server.
  • the projection module (110) is configured to project an image of the earth on the holographic screen (112).
  • the holographic screen (112) absorbs the light from the projection module (110) and displays a 3D holographic content (1121) of the earth on the screen.
  • the formation of 3D content of the earth results in a formation of the unwanted content spill.
  • the content spill neutralization module (114) is configured to remove the content spill of the earth from a line of sight of one or more viewers.
  • the reflective surface (1141), preferably a mirror receives and redirects the content spill of the earth.
  • the content spill area (1142) receives the redirected content spill of the earth.
  • the content spill area (1142) absorbs the redirected content spill.
  • the interface (106), preferably the gesture control module may be included that consists of one or more hand gesture sensor, such as, but not limited to, proximity sensor, accelerometer, gyroscopic sensor.
  • the gesture control module may be used by one or more viewers to control the 3D holographic content (1121). For example, any viewer of the one or more viewers may rotate, change property, revolve, animate the 3D holographic image of the earth as shown in figure 3 and figure 4.
  • the system (100) may include, but not limited to, a wearable device such as a Flead Mounted Device (FIMD) or smart eyewear glasses.
  • the wearable device is envisaged to include computing capabilities such as a memory unit configured to store machine readable instructions.
  • the machine readable instructions may be loaded into the memory unit from a non-transitory machine-readable medium, such as, but not limited to, CD-ROMs, DVD-ROMs and Flash Drives. Alternately, the machine readable instructions may be loaded in a form of a computer software program into the memory unit.
  • the memory unit in that manner may be selected from a group comprising EPROM, EEPROM and Flash memory.
  • the wearable device includes a microprocessor operably connected with the memory unit.
  • the microprocessor is one of, but not limited to, a general purpose processor, an application specific integrated circuit (ASIC) and a field-programmable gate array (FPGA).
  • the computing device is also envisaged to include a plurality of electronic components for example, a graphics processor unit (GPU) and a power source provide electrical power to the computing device.
  • a Graphics Processing Unit (GPU) is a single-chip processor primarily used to manage and boost the performance of video and graphics such as 2-D or 3-D graphics, texture mapping, hardware overlays etc.
  • the GPU may be selected from, but not limited to, NVIDIA, AMD, Intel and ARM for real time 3D imaging.
  • the interface (106) is provided to enable the viewers to interact with the 3D holographic content (1121) as well as operate the other components of the system (100).
  • Exemplary interface (106) includes, but not limited to, one or more buttons, a gesture interface (106), a knob, an audio interface (106), and a touch based interface (106), and the like.
  • the interaction with the computing device and other connected components may be, performed through pressing the button, hovering the hand and/or other body parts, providing audio input and/or tactile input through one or more fingers.
  • the gesture recognition module is capable of detecting the trajectory and gestures of a moving object such as a hand/fingers or a pencil/pen. It is envisaged to operate in combination with a depth camera and artificial intelligence module.
  • the transfer learning module is configured to store the graphics of unseen objects or the objects detected for the first time, for future use.
  • the transfer learning module enables machine learning in the system (100).
  • the artificial intelligence module and the transfer learning module may be a part of the computing device, separate remote servers or cloud based servers.
  • a communication network (104) may also be used in the system (100).
  • the communication network (104) can be a short-range communication network (104) and/or a long-range communication network (104), wire or wireless communication network (104).
  • the communication interface (106) includes, but not limited to, a serial communication interface (106), a parallel communication interface (106) or a combination thereof.
  • the present invention has various advantages.
  • the present invention is highly cost effective and efficient as compared to the existing arts other than a variety of areas applications such as education & training - especially in classroom, AV room, auditorium, seminar hall for better visualization of the concepts, laboratories - school science labs, medical, pharmacy & technical institutional labs, industry & corporate labs, R&D facilities, defence, etc, marketing, branding, events, industrial & corporate training, telecommunication, media & entertainment, gaming and advertisement, the present invention can be beneficial in real time holographic telepresence/ teleportation/ beam/ conferencing.
  • the 3D content generated is a spoil-free holographic 3D content/image/video.
  • the present invention provides a headset/eyewear free 3D holographic experience, remotely access controlled 3D holographic interactivity.
  • the present invention provides a real time 3D holographic simulation. There are no health risk involve in the current holographic experience.
  • the present invention can be used in playing of recorded holographic telepresence/ teleportation/ beam/ conferencing.
  • module refers to logic embodied in hardware or firmware, or to a collection of software instructions, written in a programming language, such as, for example, Java, C, or assembly.
  • One or more software instructions in the modules may be embedded in firmware, such as an EPROM.
  • modules may comprised connected logic units, such as gates and flip- flops, and may comprise programmable units, such as programmable gate arrays or processors.
  • the modules described herein may be implemented as either software and/or hardware modules and may be stored in any type of computer-readable medium or other computer storage device.
  • Suitable computer readable media may include volatile (e.g. RAM) and/or non-volatile (e.g. ROM, disk) memory, carrier waves and transmission media.
  • Exemplary carrier waves may take the form of electrical, electromagnetic or optical signals conveying digital data steams along a local network or a publicly accessible network such as the Internet.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Holo Graphy (AREA)

Abstract

A system (100) to generate 3D holographic content (1121) is provided. The system (100) comprises a projection module (110), configured to project one or more content related to an object, a holographic screen (112), configured to receive the content projected from the projection module (110), and generate a 3D holographic content (1121) from the projected content, and a content spill formed by an unabsorbed light spilled from the holographic screen (112), and a content spill neutralization module (114) comprising a reflective surface (1141), configured to receive and redirect the content spill, a content spill area (1142), adapted to receive the redirected content spill. Further, the content spill neutralization module (114) is configured to remove the content spill from a line of sight of one or more viewers.

Description

A SYSTEM AND A METHOD TO GENERATE AND SIMULATE 3D HOLOGRAPHIC CONTENTS
FIELD OF THE INVENTION
The present invention relate to generation of a 3D holographic content. In particular, the present disclosure describes a method and system for generating 3D holographic content.
BACKGROUND OF THE INVENTION
In recent times, research on 3D Holography and Holographic simulation is being actively conducted. In addition, the demand for 3D simulation is increasing because 3D content is more realistic and natural. A 3D hologram is a 3D projection that exists freely in space and is visible without the need for special 3D glasses.
3D Holographic technology is used for displaying a stereoscopic image so that the viewer can feel a three-dimensional image. Currently, various techniques such as stereoscopy, holography, and integrated imaging are being researched and developed to reproduce 3D Holographic images. Further, the available solution results in generation of spill image which is a visible noise to a viewer. Furthermore, the available solution are highly expensive and complex.
In pursuit of the same, there is a need for a system and method for generating and simulating 3D holograms using hand gestures to make it more user friendly.
OBJECT OF THE INVENTION
An object of the present invention is to provide a system for generating 3D Holographic content. Another object of the present invention is to provide a method generating 3D Holographic content.
Yet another object of the present invention is to provide a method and system for creating 3D holograms without the use of a headset and by using hand gestures.
Yet another object of the present invention is to provide a method and system for making a 3D content of a specific format supportable by the system and converting it into a 3D Holographic content which can also be used for real time 3D Holographic Simulation.
Yet another object of the present invention is to remove content spill from a 3D holographic image.
SUMMARY OF THE INVENTION
Embodiments of the present invention discloses a system and a method to generate 3D holographic contents.
According to a first aspect of the present invention, the system to generate 3D holographic contents is provided. The system comprises a projection module, configured to project one or more content related to an object, a holographic screen, configured to receive the content projected from the projection module, and generate a 3D holographic content from the projected content, and a content spill formed by an unabsorbed light spilled from the holographic screen, and a content spill neutralization module comprises a reflecting surface, configured to receive and redirect the content spill, a content spill area, adapted to receive the redirected content spill. The content spill neutralization module is configured to remove the content spill from a line of sight of one or more viewers.
In accordance with an embodiment of the present invention, the content is an interactive content. The content may comprise of but not limited to In accordance with an embodiment of the present invention, the system comprises an interface, in communication with the projection module, configured to control generation and simulation of the projected content.
In accordance with an embodiment of the present invention, the holographic screen comprises a plurality of LED configured to illuminate peripheral border of the holographic screen thereby enhancing detailing of the generated 3D holographic content.
In accordance with an embodiment of the present invention, the projection module in communication with an content processing module configured to receive the content to be projected and/simulated on the holographic screen, from the content processing module.
In accordance with an embodiment of the present invention, the system comprises a viewing window disposed in front of the holographic screen to enable the one or more viewers to view the holographic screen.
According to a second aspect of the present invention, the method to generate 3D holographic contents comprises steps of projecting an content related to an object, receiving the projected content on a holographic screen and generating a 3D holographic content from the projected content and a content spill from an unabsorbed light spilled from the holographic screen, and receiving and redirecting the content spill thereby removing the content spill from a line of sight of a viewer of one or more viewers.
In accordance with an embodiment of the present invention, wherein the content is an interactive content.
In accordance with an embodiment of the present invention, the method comprises step of controlling generation and simulation of the projected content. In accordance with an embodiment of the present invention, the method comprises step of illuminating a peripheral border of the holographic screen thereby enhancing detailing of the generated 3D holographic content.
In accordance with an embodiment of the present invention, the method comprises step of enabling the one or more viewers to view the holographic screen using a viewing window.
BRIEF DESCRIPTION OF THE DRAWINGS
So that the manner in which the above recited features of the present invention can be understood in detail, a more particular to the description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and are therefore not to be considered limiting of its scope, the invention may admit to other equally effective embodiments.
These and other features, benefits and advantages of the present invention will become apparent by reference to the following text figure, with like reference numbers referring to like structures across the views, wherein:
Fig. 1 illustrates a system to generate 3D holographic contents, in accordance with an embodiment of the present invention;
Fig. 2 illustrates a method to generate 3D holographic contents, in accordance with an embodiment of the present invention;
Fig. 3 illustrates an information flow diagram (200), in accordance with an embodiment of the present invention;
Fig. 4 illustrates a front view of an apparatus implementing the system to generate 3D holographic contents, in accordance with an embodiment of the present invention; and
Fig. 5 illustrates a perspective view of the apparatus implementing the system to generate 3D holographic contents, in accordance with an embodiment of the present invention.
DETAILED DESCRIPTION OF THE DRAWINGS
While the present invention is described herein by way of example using embodiments and illustrative drawings, those skilled in the art will recognize that the invention is not limited to the embodiments of drawing or drawings described and are not intended to represent the scale of the various components. Further, some components that may form a part of the invention may not be illustrated in certain figures, for ease of illustration, and such omissions do not limit the embodiments outlined in any way. It should be understood that the drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the invention is to cover all modifications, equivalents, and alternatives falling within the scope of the present invention as defined by the appended claims. As used throughout this description, the word "may" is used in a permissive sense (i.e. meaning having the potential to), rather than the mandatory sense, (i.e. meaning must).
Further, the words "a" or "an" mean "at least one” and the word “plurality” means “one or more” unless otherwise mentioned. Furthermore, the terminology and phraseology used herein is solely used for descriptive purposes and should not be construed as limiting in scope. Language such as "including," "comprising," "having," "containing," or "involving," and variations thereof, is intended to be broad and encompass the subject matter listed thereafter, equivalents, and additional subject matter not recited, and is not intended to exclude other additives, components, integers or steps. Likewise, the term "comprising" is considered synonymous with the terms "including" or "containing" for applicable legal purposes. Any discussion of documents, acts, materials, devices, articles and the like is included in the specification solely for the purpose of providing a context for the present invention. It is not suggested or represented that any or all of these matters form part of the prior art base or were common general knowledge in the field relevant to the present invention.
In this disclosure, whenever a composition or an element or a group of elements is preceded with the transitional phrase “comprising”, it is understood that we also contemplate the same composition, element or group of elements with transitional phrases “consisting of”, “consisting”, “selected from the group of consisting of, “including”, or “is” preceding the recitation of the composition, element or group of elements and vice versa.
The present invention is described hereinafter by various embodiments with reference to the accompanying drawings, wherein reference numerals used in the accompanying drawing correspond to the like elements throughout the description. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiment set forth herein. Rather, the embodiment is provided so that this disclosure will be thorough and complete and will fully convey the scope of the invention to those skilled in the art. In the following detailed description, numeric values and ranges are provided for various aspects of the implementations described. These values and ranges are to be treated as examples only and are not intended to limit the scope of the claims. In addition, a number of materials are identified as suitable for various facets of the implementations. These materials are to be treated as exemplary and are not intended to limit the scope of the invention.
Figure 1 illustrates a system (100) to generate 3D holographic contents (not shown in figure 1), in accordance with an embodiment of the present invention. In an aspect, the 3D holographic content comprises but not limited to 3D holographic images, 3D holographic Videos, 3D holographic models, and more. As shown in figure 1 , the system (100) may comprise a projection module (110), a holographic screen (112), a content spill neutralization module (114), an interface (106), one or more user devices (107), and a data repository (108). The holographic screen (112) may be a screen absorbing light rays, a partially reflecting screen or a refracting screen. The holographic screen (112) may be made of, but not limited to, transparent materials such as glass, fiber, acrylic, PVC, polymethyl methacrylate, polycarbonate, polyethylene, polyethylene terephthalate, or polylactic acid.
In accordance with an embodiment of the present invention, the projection module (110) is envisaged to include computing capabilities such as a memory unit configured to store machine readable instructions. The machine-readable instructions may be loaded into the memory unit from a non-transitory machine-readable medium, such as, but not limited to, CD-ROMs, DVD-ROMs and Flash Drives. Alternately, the machine- readable instructions may be loaded in a form of a computer software program into the memory unit. The memory unit in that manner may be selected from a group comprising EPROM, EEPROM and Flash memory. Then, the projection module (110) includes a processor operably connected with the memory unit. In various embodiments, the processor may be a microprocessor selected from one of, but not limited to an ARM based or Intel based processor or in the form of field-programmable gate array (FPGA), a general-purpose processor and an application specific integrated circuit (ASIC).
Further, as shown in figure 1 , the system (100) may further comprise a communication network (104) configured for enabling connection of the interface (106), the projection module (110) and the one or more user devices (107). The connection may be wired or wireless. In that sense, the communication network (104) may include Power over Ethernet Switch, USB ports etc. These may allow transferring of data to and from the one or more user devices (107) and the interface (106) with the projection module (110) via ethernet cable, USB cable etc. Additionally, or alternately, the communication network (104) may be an Internet of Things (IOT) module, Wi-Fi module, Bluetooth module, RF module etc. adapted to enable a wireless communication between the one or more user devices (107) and the interface (106) with the projection module (110) via the wireless communication network (104). The wireless communication network (104) may be, but not limited to, Bluetooth network, RF network, NFC, WIFI network, Local Area Network (LAN) or a Wide Area Network (WAN). The wireless communication network (104) may be implemented using a number of protocols, such as but not limited to, TCP/IP, 3GPP, 3GPP2, LTE, IEEE 802.x, etc. In one embodiment, the all the components of the system (100) are connected with each other via the communication network (104).
The system (100) also includes the interface (106). The interface (106) may include a display envisaged to show one or more simulation feature to generate a 3D holographic image. The display may be, but not limited to Light-emitting diode display (LED), electroluminescent display (ELD), liquid crystal display (LCD), Organic light-emitting diode (OLED) & AMOLED display. Furthermore, the interface (106) may include accessories like keyboard, mouse, hand gesture module etc. envisaged to provide input capability to enable a user to enter details of generation and simulation of a 3D content. In another embodiment, the interface (106) may be a touch input based display, or a gesture based interface (106) that integrates the input-output functionalities.
In accordance with an embodiment of the present invention, as shown in figure 1 , the one or more user devices (107) and the interface (106) are connected with the projection module (110) via a wired or wireless connection. Herein, the one or more user devices (107) may be selected from computing devices such as desktop PC, laptop, PDA or hand-held computing device such as smartphones and tablets. The one or more user devices (107) are associated with one or more users. The one or more user devices (107) are shown in figure 1 using dotted box. The present invention supports may be, but not limited to, all or any of the devices shown in the dotted box.
In yet another embodiment, the system (100) could be implemented as a distributed system (100) where the projection module (110) the holographic screen (112), the interface (106) and the content spill neutralization module (114) may be at disposed at different locations from each other and/or functions of the projection module (110) could be implemented in a server side computing device or cloud computing environment. It will be appreciated by a skilled addressee that there are multiple arrangement in which the present invention can be implemented, without departing from the scope of the present invention. The projection module (110) is also envisaged to implement Artificial Intelligence, Machine Learning and deep learning for data collation and processing.
In accordance with an embodiment of the present invention, the system (100) may also include a data repository (108). The data repository (108) may be a local storage (such as SSD, eMMC, Flash, SD card, etc) or a cloud-based storage. In any manner, the data repository (108) is envisaged to be capable of providing the data to the projection module (110), when the data is queried appropriately using applicable security and other data transfer protocols. The data repository (108) may store the images, videos, or instruments to create and simulate 3D holographic contents (1121). In one embodiment of the present invention, the projection module (110) may include Al and deep learning-based trained contents using the above data, so as to generate and simulate the 3D holographic content (1121 ). Figure 2 illustrates a method (1000) to generate 3D holographic contents (1121), in accordance with an embodiment of the present invention. This method (1000) would be understood more clearly with the help of an exemplary implementation and information flow shown in Figures 3-5. The figure 3 illustrates an information flow diagram (200), in accordance with an embodiment of the present invention.
As shown in figure 2, the method (1000) starts at step 1010 by projecting one or more content or image of an object. As shown in figure 3, the projection module (110) is configured to project an image of an object on a holographic screen (112). The projection module (110) may be a light emitting source or an image projector may be selected from, but not limited to, a DLP (Digital Light Processing) projector, a LCoS (Liquid Crystal on Silicon) projector, LCD (Liquid Crystal Display) projector, an LED projector or a Laser projector. The projector may project a still image or a series of images or a video. Further, in an additional or alternative embodiment, the projection module (110) may be in communication with the one or more user devices (107). The one or more user devices (107) may be configured to provide the projection module (110) with the image/ series of images, videos to be projected and/simulated on the holographic screen (112). The one or more user may select the image to be projected using the one or more user devices (107).
Furthermore, in an additional or alternative embodiment, the projection module (110) may be in communication with an image processing module. The image processing module may be configured to provide the projection module (110) with the images to be projected and/simulated on the holographic screen (112). In an embodiment, the projection module (110) may receive image directly from the user. The projection module (110) may be configured to process the received image and project the image. In accordance with an embodiment of the present invention, the image processing module is envisaged to include computing capabilities such as a memory unit configured to store machine readable instructions. The machine-readable instructions may be loaded into the memory unit from a non-transitory machine-readable medium, such as, but not limited to, CD-ROMs, DVD-ROMs and Flash Drives. Alternately, the machine- readable instructions may be loaded in a form of a computer software program into the memory unit. The memory unit in that manner may be selected from a group comprising EPROM, EEPROM and Flash memory. Then, the image processing module includes a processor operably connected with the memory unit. In various embodiments, the processor may be a microprocessor selected from one of, but not limited to an ARM based or Intel based processor or in the form of field-programmable gate array (FPGA), a general-purpose processor and an application specific integrated circuit (ASIC).
Next, at step 1020, the holographic screen (112) is configured to receive the image projected from the projection module (110). Figure 3 illustrates a front view of an apparatus (102) implementing the system (100) to generate three dimensional (3D) holographic contents (1121), in accordance with an embodiment of the present invention. As shown in figure 3, the holographic screen (112) then generates a 3D holographic content (1121) from the projected image. The light incident on the holographic screen (112) is displayed on a transparent or a translucent screen, giving the projected image a floating aesthetic. In accordance with an embodiment of the present invention the 3D holographic content (s) may be, but not limited to a 3D image, a 3D video, a series of images, an image over image, a video over video, or an interactive 3D model. Further, the 3D holographic contents (1121) can be any information projected and the holographic screen (112).
In an additional or alternative embodiment, the 3D holographic content (1121) formed is an interactive content. The interactive content may enable one or more viewers to control generation and simulation of the projected image. The viewers may control the generation and simulation of the projected image using the interface (106) connected with the projection module (110). As shown in figure 1 , the interface (106) is in communication with the projection module (110). The interface (106) may be configured to control generation and simulation of the projected image.
Further, the holographic screen (112) may be unable to absorb a certain amount of light from the projected image. The unabsorbed light spilled from the holographic screen (112) results in formation of a content spill. The content spill is a visual noise and is visible at a certain angle. Depending on a viewer, if the viewer is viewing the 3D holographic content (1121) at a certain angle, the content spill is visible beyond the 3D holographic content (1121). The content spill is an undesirable phenomenon which destroys the visualization experience of 3D holographic content (1121) generated.
Next, at step 1030, the content spill neutralization module (114) is configured to remove the content spill from a line of sight of one or more viewers. Figure 4 illustrates a perspective view of the apparatus (102) implementing the system (100) to generate 3D holographic contents (1121), in accordance with an embodiment of the present invention. As shown in figure 4, the content spill neutralization module (114) comprises a reflective surface (1141), configured to receive and redirect the content spill. The reflective surface (1141) may be, but not limited to a one way or a two-way mirror. The reflective surface (1141) may be a convex or a concave mirror or a combination thereof. Furthermore, the reflective surface (1141) may be a convex or a concave lens or a combination thereof. In accordance with an embodiment of the present invention, the content spill neutralization module (114) comprises a content spill area also referred to as content spill area (1142) which is adapted to receive the redirected content spill. The content spill area/content spill area (1142) may be an empty area painted in black to absorb the redirected content spill.
In accordance with an embodiment of the present invention, the holographic screen (112) comprises a plurality of LEDs (1122). The plurality of LEDs (1122) may be arranged on peripheral border of the holographic screen (112). The plurality of LEDs (1122) may be configured to illuminate peripheral border of the holographic screen (112) thereby enhancing detailing of the generated 3D holographic content (1121 ).
The invention works in following manner:
In an aspect, the projection module (110) projects image on the holographic screen (112). In a preferred embodiment, the holographic screen (112) is a vertical transparent projection medium producing a 3D image in the region. In an embodiment, the one or more users may provide input images to the projection module (110) directly or using the one or more user devices (107). In an embodiment, the projection module (110) may acquire images for projection from a server. For example, as shown in figure 4, the projection module (110) is configured to project an image of the earth on the holographic screen (112). The holographic screen (112) absorbs the light from the projection module (110) and displays a 3D holographic content (1121) of the earth on the screen.
The formation of 3D content of the earth results in a formation of the unwanted content spill. The content spill neutralization module (114) is configured to remove the content spill of the earth from a line of sight of one or more viewers. The reflective surface (1141), preferably a mirror receives and redirects the content spill of the earth. Furthermore, the content spill area (1142) receives the redirected content spill of the earth. The content spill area (1142) absorbs the redirected content spill. Further, in an embodiment, the interface (106), preferably the gesture control module may be included that consists of one or more hand gesture sensor, such as, but not limited to, proximity sensor, accelerometer, gyroscopic sensor. The gesture control module may be used by one or more viewers to control the 3D holographic content (1121). For example, any viewer of the one or more viewers may rotate, change property, revolve, animate the 3D holographic image of the earth as shown in figure 3 and figure 4.
Additionally, the system (100) may include, but not limited to, a wearable device such as a Flead Mounted Device (FIMD) or smart eyewear glasses. The wearable device is envisaged to include computing capabilities such as a memory unit configured to store machine readable instructions. The machine readable instructions may be loaded into the memory unit from a non-transitory machine-readable medium, such as, but not limited to, CD-ROMs, DVD-ROMs and Flash Drives. Alternately, the machine readable instructions may be loaded in a form of a computer software program into the memory unit. The memory unit in that manner may be selected from a group comprising EPROM, EEPROM and Flash memory.
Further, the wearable device includes a microprocessor operably connected with the memory unit. In various embodiments, the microprocessor is one of, but not limited to, a general purpose processor, an application specific integrated circuit (ASIC) and a field-programmable gate array (FPGA). The computing device is also envisaged to include a plurality of electronic components for example, a graphics processor unit (GPU) and a power source provide electrical power to the computing device. A Graphics Processing Unit (GPU) is a single-chip processor primarily used to manage and boost the performance of video and graphics such as 2-D or 3-D graphics, texture mapping, hardware overlays etc. The GPU may be selected from, but not limited to, NVIDIA, AMD, Intel and ARM for real time 3D imaging. The interface (106) is provided to enable the viewers to interact with the 3D holographic content (1121) as well as operate the other components of the system (100). Exemplary interface (106) includes, but not limited to, one or more buttons, a gesture interface (106), a knob, an audio interface (106), and a touch based interface (106), and the like. The interaction with the computing device and other connected components may be, performed through pressing the button, hovering the hand and/or other body parts, providing audio input and/or tactile input through one or more fingers.
In addition, the gesture recognition module is capable of detecting the trajectory and gestures of a moving object such as a hand/fingers or a pencil/pen. It is envisaged to operate in combination with a depth camera and artificial intelligence module. Besides, the transfer learning module is configured to store the graphics of unseen objects or the objects detected for the first time, for future use. The transfer learning module enables machine learning in the system (100). The artificial intelligence module and the transfer learning module may be a part of the computing device, separate remote servers or cloud based servers.
Further, one would appreciate that a communication network (104) may also be used in the system (100). The communication network (104) can be a short-range communication network (104) and/or a long-range communication network (104), wire or wireless communication network (104). The communication interface (106) includes, but not limited to, a serial communication interface (106), a parallel communication interface (106) or a combination thereof.
The present invention has various advantages. The present invention is highly cost effective and efficient as compared to the existing arts other than a variety of areas applications such as education & training - especially in classroom, AV room, auditorium, seminar hall for better visualization of the concepts, laboratories - school science labs, medical, pharmacy & technical institutional labs, industry & corporate labs, R&D facilities, defence, etc, marketing, branding, events, industrial & corporate training, telecommunication, media & entertainment, gaming and advertisement, the present invention can be beneficial in real time holographic telepresence/ teleportation/ beam/ conferencing. The 3D content generated is a spoil-free holographic 3D content/image/video.
The present invention provides a headset/eyewear free 3D holographic experience, remotely access controlled 3D holographic interactivity. The present invention provides a real time 3D holographic simulation. There are no health risk involve in the current holographic experience. Further, the holographic integration system (100) with other mobile, tablet, computer & remote-access, gadgets for convenient interactivity & enhanced accessibility. Further, the present invention can be used in playing of recorded holographic telepresence/ teleportation/ beam/ conferencing.
In general, the word “module,” as used herein, refers to logic embodied in hardware or firmware, or to a collection of software instructions, written in a programming language, such as, for example, Java, C, or assembly. One or more software instructions in the modules may be embedded in firmware, such as an EPROM. It will be appreciated that modules may comprised connected logic units, such as gates and flip- flops, and may comprise programmable units, such as programmable gate arrays or processors. The modules described herein may be implemented as either software and/or hardware modules and may be stored in any type of computer-readable medium or other computer storage device.
Further, while one or more operations have been described as being performed by or otherwise related to certain modules, devices or entities, the operations may be performed by or otherwise related to any module, device or entity. As such, any function or operation that has been described as being performed by a module could alternatively be performed by a different server, by the cloud computing platform, or a combination thereof. It should be understood that the techniques of the present disclosure might be implemented using a variety of technologies. For example, the methods described herein may be implemented by a series of computer executable instructions residing on a suitable computer readable medium. Suitable computer readable media may include volatile (e.g. RAM) and/or non-volatile (e.g. ROM, disk) memory, carrier waves and transmission media. Exemplary carrier waves may take the form of electrical, electromagnetic or optical signals conveying digital data steams along a local network or a publicly accessible network such as the Internet.
It should also be understood that, unless specifically stated otherwise as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms such as "controlling" or "obtaining" or "computing" or "storing" or "receiving" or "determining" or the like, refer to the action and processes of a computer system, or similar electronic computing device, that processes and transforms data represented as physical (electronic) quantities within the computer system’s registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
Various modifications to these embodiments are apparent to those skilled in the art from the description and the accompanying drawings. The principles associated with the various embodiments described herein may be applied to other embodiments. Therefore, the description is not intended to be limited to the embodiments shown along with the accompanying drawings but is to be providing broadest scope of consistent with the principles and the novel and inventive features disclosed or suggested herein. Accordingly, the invention is anticipated to hold on to all other such alternatives, modifications, and variations that fall within the scope of the present invention and the appended claims.

Claims

I claim:
1. A system (100) to generate 3D holographic contents (1121), the system (100) comprising: a projection module (110), configured to project one or more content related to an object; a holographic screen (112), configured to: receive the content projected from the projection module (110), and generate a 3D holographic content (1121) from the projected content, and a content spill formed by an unabsorbed light spilled from the holographic screen (112); and a content spill neutralization module (114) comprising: a reflective surface (1141), configured to receive and redirect the content spill; a content spill area (1142), adapted to receive the redirected content spill; wherein the content spill neutralization module (114) is configured to remove the content spill from a line of sight of one or more viewers.
2. The system (100) as claimed in claim 1 , wherein the 3D holographic content (1121) is an interactive content.
3. The system (100) as claimed in claim 1 , comprising an interface (106), in communication with the projection module (110), configured to control generation and simulation of the projected content.
4. The system (100) as claimed in claim 1 , wherein the holographic screen (112) comprises a plurality of LEDs (1122) configured to illuminate peripheral border of the holographic screen (112) thereby enhancing detailing of the generated 3D holographic content (1121 ).
5. The system (100) as claimed in claim 1 , wherein the projection module (110) in communication with a content processing module configured to receive the content to be projected and/simulated on the holographic screen (112), from the content processing module.
6. The system (100) as claimed in claim 1 , comprising a viewing window disposed in front of the holographic screen (112) to enable the one or more viewers to view the holographic screen (112).
7. A method (1000) to generate 3D holographic contents (1121), the method (1000) comprising steps of: projecting one or more content related to an object; receiving the projected content on a holographic screen (112) and generating a 3D holographic content (1121) from the projected content and a content spill from an unabsorbed light spilled from the holographic screen (112); and receiving and redirecting the content spill thereby removing the content spill from a line of sight of a viewer of one or more viewers.
8. The method (1000) as claimed in claim 7, wherein the content is an interactive content.
9. The method (1000) as claimed in claim 7, comprising step of controlling generation and simulation of the projected content.
10. The method (1000) as claimed in claim 7, comprising step of illuminating a peripheral border of the holographic screen (112) thereby enhancing detailing of the generated 3D holographic content (1121).
11. The method (1000) as claimed in claim 7, comprising step of enabling the one or more viewers to view the holographic screen (112) using a viewing window.
PCT/IB2021/052682 2020-03-31 2021-03-31 A system and a method to generate and simulate 3d holographic contents WO2021198944A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202021004356 2020-03-31
IN202021004356 2020-03-31

Publications (1)

Publication Number Publication Date
WO2021198944A1 true WO2021198944A1 (en) 2021-10-07

Family

ID=77927758

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2021/052682 WO2021198944A1 (en) 2020-03-31 2021-03-31 A system and a method to generate and simulate 3d holographic contents

Country Status (1)

Country Link
WO (1) WO2021198944A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011095743A (en) * 2009-10-28 2011-05-12 Seiko Epson Corp Screen system and method of forming three-dimensional display
US9946076B2 (en) * 2010-10-04 2018-04-17 Gerard Dirk Smits System and method for 3-D projection and enhancements for interactivity

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011095743A (en) * 2009-10-28 2011-05-12 Seiko Epson Corp Screen system and method of forming three-dimensional display
US9946076B2 (en) * 2010-10-04 2018-04-17 Gerard Dirk Smits System and method for 3-D projection and enhancements for interactivity

Similar Documents

Publication Publication Date Title
Santi et al. Augmented reality in industry 4.0 and future innovation programs
KR102049132B1 (en) Augmented reality light guide display
Brockmeyer et al. PAPILLON: designing curved display surfaces with printed optics
CN104205037B (en) Device for light guide display and viewing
US10115233B2 (en) Methods and systems for mapping virtual objects in an augmented or virtual reality system
EP2831658B1 (en) Light guide display for a mobile device
Wozniak et al. Possible applications of the LEAP motion controller for more interactive simulated experiments in augmented or virtual reality
Benko Beyond flat surface computing: challenges of depth-aware and curved interfaces
Čopič Pucihar et al. Evaluating dual-view perceptual issues in handheld augmented reality: device vs. user perspective rendering
CN105075246A (en) Providing a tele-immersive experience using a mirror metaphor
US11175744B2 (en) Holographic projection system
Sandnes et al. Head-mounted augmented reality displays on the cheap: a DIY approach to sketching and prototyping low-vision assistive technologies
CN114514493A (en) Reinforcing apparatus
KR102214068B1 (en) Floating Hologram display device
Lee et al. Development of real-time hand gesture recognition for tabletop holographic display interaction using azure kinect
KR20240047450A (en) Parallel renderers for electronic devices
Yamamoto et al. Floating display screen formed by airr (aerial imaging by retro-reflection) for interaction in 3d space
KR20150022158A (en) Apparatus and method for learning mechanical drawing
Lindlbauer et al. Changing the appearance of physical interfaces through controlled transparency
WO2021198944A1 (en) A system and a method to generate and simulate 3d holographic contents
García et al. Holomuseum: A hololens application for creating extensible and customizable holographic exhibitions
Colley et al. Windows to other places: exploring solutions for seeing through walls using handheld projection
Kramar et al. Peculiarities of Augmented Reality Usage in a Mobile Application: the Case of the Ivan Puluj Digital Museum.
KR20200083762A (en) A hologram-projection electronic board based on motion recognition
Tomitsch et al. Designing for mobile interaction with augmented objects

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21781920

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21781920

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21781920

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24.03.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21781920

Country of ref document: EP

Kind code of ref document: A1