WO2022124433A1 - Dispositif de génération d'hologrammes en temps réel à l'aide d'un réseau neuronal optique - Google Patents

Dispositif de génération d'hologrammes en temps réel à l'aide d'un réseau neuronal optique Download PDF

Info

Publication number
WO2022124433A1
WO2022124433A1 PCT/KR2020/017817 KR2020017817W WO2022124433A1 WO 2022124433 A1 WO2022124433 A1 WO 2022124433A1 KR 2020017817 W KR2020017817 W KR 2020017817W WO 2022124433 A1 WO2022124433 A1 WO 2022124433A1
Authority
WO
WIPO (PCT)
Prior art keywords
hologram
neural network
generating
image
optical
Prior art date
Application number
PCT/KR2020/017817
Other languages
English (en)
Korean (ko)
Inventor
정진수
홍성희
김영민
홍지수
Original Assignee
한국전자기술연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자기술연구원 filed Critical 한국전자기술연구원
Publication of WO2022124433A1 publication Critical patent/WO2022124433A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G03H2001/0033—Adaptation of holography to specific applications in hologrammetry for measuring or analysing
    • G03H2001/0044—Adaptation of holography to specific applications in hologrammetry for measuring or analysing holographic fringes deformations; holographic sensors
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0825—Numerical processing in hologram space, e.g. combination of the CGH [computer generated hologram] with a numerical optical element
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2227/00—Mechanical components or mechanical aspects not otherwise provided for
    • G03H2227/02—Handheld portable device, e.g. holographic camera, mobile holographic display

Definitions

  • the present invention relates to hologram-related technology, and more particularly, to a method and apparatus capable of generating a hologram in real time in a portable device.
  • FIG. 1 is a diagram illustrating a process of generating a CGH (Computer Generated Hologram) pattern using a light wave simulation apparatus.
  • a simulation device that calculates the diffraction pattern of light waves with respect to the original image based on the wave equation, such as a computer, is required.
  • the present invention has been devised to solve the above problems, and an object of the present invention is to improve the calculation speed and improve the calculation speed by replacing the existing high-performance computing device for calculating the hologram fringe pattern with a physical optical propagation-based optical neural network.
  • the goal is to make the graphic display lightweight and modular so that it can be applied to portable smart devices such as augmented reality glasses.
  • a method for generating a hologram includes: generating a hologram fringe pattern using an optical neural network; and generating a holographic image from the generated holographic fringe pattern using an optical element.
  • the optical neural network may be a neural network that optically implements an artificial neural network.
  • the optical neural network may perform numerical calculations using physical optical propagation.
  • the method for generating a hologram may further include displaying an image on a display device, wherein the generating step may generate a hologram fringe pattern for the image displayed in the display step.
  • the holographic fringe pattern may be generated in real time.
  • an apparatus for generating a hologram includes an optical neural network module for generating a hologram fringe pattern using an optical neural network; and an optical element for generating a holographic image from the generated holographic fringe pattern.
  • the optical neural network may be a neural network that optically implements an artificial neural network.
  • an apparatus for generating a hologram may further include a display apparatus for displaying an image, and the optical neural network module may generate a hologram fringe pattern for the image displayed on the display apparatus.
  • the hologram generating device may be a portable device.
  • the optical element may provide the generated holographic image in augmented reality.
  • a method for generating a hologram according to an embodiment of the present invention includes: displaying an image on a display device; and generating a holographic fringe pattern for the displayed image using an optical neural network.
  • an apparatus for generating a hologram includes: a display apparatus for displaying an image; and an optical neural network module that generates a holographic fringe pattern for an image displayed on the display device.
  • the holographic fringe pattern speed can be improved by replacing the existing numerical calculation with physical light propagation, and the holographic display module can be replaced with an optical neural network by replacing the existing calculation device with an optical neural network. Lightweight/miniaturization/modularization becomes easy.
  • a method of generating a hologram using an optical neural network 5.
  • An embodiment of the present invention provides an apparatus and method for generating a real-time hologram using an optical neural network.
  • CGH Computer Generated Hologram
  • FIG. 3 is a diagram illustrating a process of generating CGH using an optical neural network according to an embodiment of the present invention.
  • an original image and an image are displayed through a display device.
  • a holographic fringe pattern for the image displayed on the display device is generated using the optical neural network.
  • An optical neural network is a neural network that optically implements an artificial neural network based on physical optical propagation, replacing numerical calculation with physical optical propagation. Accordingly, the optical neural network can generate a holographic fringe pattern in real time due to its high processing speed.
  • optical neural networks can be lightweight and modular. Therefore, it is possible to speed up the hologram fringe pattern engine as well as to reduce the weight, so it is easy to apply to a portable smart device.
  • the holographic augmented reality glasses are configured to include a display device 110 , an optical neural network module 120 , and an image coupling optical element 130 .
  • the display device 110 is a device that displays an image to be restored as a hologram.
  • the optical neural network module 120 generates a holographic fringe pattern from an image displayed on the display device 110 in real time using an optical neural network.
  • the image coupling optical element 130 generates a holographic image from the holographic fringe pattern generated by the optical neural network module 120, and allows the user U to observe it.
  • the holographic image was implemented to be provided in augmented reality together with the real world image.
  • FIG. 5 is a flowchart provided to explain a method for generating a hologram using an optical neural network according to another embodiment of the present invention.
  • an original image or an image is first displayed through the display device 110 (S210).
  • the displayed original image or image is an image to be restored as a hologram.
  • the optical neural network module 120 generates a hologram fringe pattern for the image displayed in step S210 in real time using the optical neural network (S220).
  • An optical neural network is a neural network that optically implements an artificial neural network based on physical light propagation, and can generate holographic fringe patterns in real time due to its high processing speed.
  • the image coupling optical device 130 generates a holographic image from the hologram fringe pattern generated in step S220 (S230). Accordingly, the user can observe the hologram.
  • the calculation speed is improved and the holographic display is lightweight and modular, so that it can be applied to portable smart devices such as augmented reality glasses. made to be applied.
  • augmented reality glasses are mentioned as an example of a portable smart device.
  • the technical idea of the present invention may be applied to other types of portable smart devices other than augmented reality glasses, and may be a virtual reality device other than an augmented reality device.
  • the technical idea of the present invention may be applied to a stationary device other than a portable device. That is, the scope of the present invention is not limited to portable devices.
  • the holographic fringe pattern speed can be improved by replacing the existing numerical calculation with physical light propagation, and the weight reduction/miniaturization/modularization of the holographic display module by replacing the existing calculation device with an optical neural network can be facilitated.
  • the technical idea of the present invention can also be applied to a computer-readable recording medium containing a computer program for performing the functions of the apparatus and method according to the present embodiment.
  • the technical ideas according to various embodiments of the present invention may be implemented in the form of computer-readable codes recorded on a computer-readable recording medium.
  • the computer-readable recording medium may be any data storage device readable by the computer and capable of storing data.
  • the computer-readable recording medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, hard disk drive, or the like.
  • the computer-readable code or program stored in the computer-readable recording medium may be transmitted through a network connected between computers.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Holo Graphy (AREA)

Abstract

L'invention concerne un dispositif permettant de générer des hologrammes en temps réel à l'aide d'un réseau neuronal optique. Selon un mode de réalisation de la présente invention, un procédé de génération d'hologramme génère un motif de frange d'hologramme à l'aide d'un réseau neuronal optique, puis génère une vidéo d'hologramme à partir du motif de frange d'hologramme généré à l'aide d'un élément optique. Par conséquent, la vitesse du motif de frange d'hologramme peut être améliorée en remplaçant des calculs numériques existants par une propagation de lumière physique, et la réduction/miniaturisation/modularisation de poids des modules d'affichage holographique est facilitée en remplaçant les dispositifs de calcul existants par le réseau neuronal optique.
PCT/KR2020/017817 2020-12-08 2020-12-08 Dispositif de génération d'hologrammes en temps réel à l'aide d'un réseau neuronal optique WO2022124433A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2020-0170007 2020-12-08
KR1020200170007A KR20220080825A (ko) 2020-12-08 2020-12-08 광신경망을 이용한 실시간 홀로그램 생성 장치

Publications (1)

Publication Number Publication Date
WO2022124433A1 true WO2022124433A1 (fr) 2022-06-16

Family

ID=81973409

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/017817 WO2022124433A1 (fr) 2020-12-08 2020-12-08 Dispositif de génération d'hologrammes en temps réel à l'aide d'un réseau neuronal optique

Country Status (2)

Country Link
KR (1) KR20220080825A (fr)
WO (1) WO2022124433A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20240093270A (ko) * 2022-12-15 2024-06-24 한국전자기술연구원 사용자 단말의 동영상 촬영 기능을 이용한 홀로그램 제작 방법 및 상기 방법에 의해 제작된 홀로그램 보안 코드를 판독하기 위한 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180063835A (ko) * 2016-12-02 2018-06-12 한국전자통신연구원 변형 광학 뉴럴 네트워크를 이용하는 홀로그램 영상 재생 장치
KR20190083583A (ko) * 2018-01-04 2019-07-12 한국전자통신연구원 이진 홀로그램 재현 장치 및 그 방법
KR20190102651A (ko) * 2018-02-27 2019-09-04 주식회사 펀진 디지털 홀로그래피 디스플레이 장치 및 그 방법
KR20190105458A (ko) * 2018-03-05 2019-09-17 한국전자통신연구원 홀로그램 생성 방법
KR20200068507A (ko) * 2018-12-05 2020-06-15 한국전자통신연구원 홀로그래픽 디스플레이 광원의 가간섭성 평가 장치 및 그 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180063835A (ko) * 2016-12-02 2018-06-12 한국전자통신연구원 변형 광학 뉴럴 네트워크를 이용하는 홀로그램 영상 재생 장치
KR20190083583A (ko) * 2018-01-04 2019-07-12 한국전자통신연구원 이진 홀로그램 재현 장치 및 그 방법
KR20190102651A (ko) * 2018-02-27 2019-09-04 주식회사 펀진 디지털 홀로그래피 디스플레이 장치 및 그 방법
KR20190105458A (ko) * 2018-03-05 2019-09-17 한국전자통신연구원 홀로그램 생성 방법
KR20200068507A (ko) * 2018-12-05 2020-06-15 한국전자통신연구원 홀로그래픽 디스플레이 광원의 가간섭성 평가 장치 및 그 방법

Also Published As

Publication number Publication date
KR20220080825A (ko) 2022-06-15

Similar Documents

Publication Publication Date Title
CN106534835A (zh) 一种图像处理方法以及装置
WO2022124433A1 (fr) Dispositif de génération d'hologrammes en temps réel à l'aide d'un réseau neuronal optique
WO2018004154A1 (fr) Dispositif d'affichage de réalité mixte
CN106846495A (zh) 实现增强现实的方法与装置
WO2020139054A1 (fr) Appareil et procédé de production d'avatar virtuel
CN114373047A (zh) 一种基于数字孪生监控物理世界的方法、装置及存储介质
CN113379877A (zh) 人脸视频生成方法、装置、电子设备及存储介质
WO2016027910A1 (fr) Procédé de traçage de rayons, dispositif de traçage de rayons pour mettre en œuvre ledit procédé, et support d'enregistrement permettant de stocker celui-ci
João et al. Virtual and augmented reality applied in power electric utilities for human interface improvement–a study case for best practices
CN112002017A (zh) 虚拟场景生成方法、装置、终端、介质和虚拟培训系统
WO2022145505A1 (fr) Procédé de rendu d'image tridimensionnelle pour imprimante holographique
JP2005055573A (ja) 高速表示処理装置
WO2015108218A1 (fr) Dispositif et procédé de traitement graphique
WO2019124802A1 (fr) Appareil et procédé permettant de produire un pseudo-hologramme de mappage en utilisant une sortie de signal d'image individuelle
WO2023106428A1 (fr) Procédé et système de rendu fovéal d'hologramme
WO2020116692A1 (fr) Procédé de génération d'hologramme au moyen d'une segmentation
Ma Dynamic image data processing technology application in dance classroom assisted teaching under virtual environment
WO2020101197A1 (fr) Procédé et système de partage de contenu de réalité augmentée
WO2024101485A1 (fr) Procédé et système de production d'hologramme d'image animée
WO2019107637A1 (fr) Système et procédé d'application d'hologramme numérique
WO2024117556A1 (fr) Procédé de rendu d'image holographique pour impression qui ne nécessite pas de réagencement
CN111773683A (zh) 一种基于移动终端的文字显示方法及装置
CN112070227A (zh) 一种神经网络训练方法和装置以及设备
WO2012128421A1 (fr) Dispositif de rendu spatial de modèle graphique 3d et procédé de rendu 3d
Goldiez History of networked simulations

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20965189

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20965189

Country of ref document: EP

Kind code of ref document: A1