WO2022124433A1 - Device for generating holograms in real time using optical neural network - Google Patents

Device for generating holograms in real time using optical neural network Download PDF

Info

Publication number
WO2022124433A1
WO2022124433A1 PCT/KR2020/017817 KR2020017817W WO2022124433A1 WO 2022124433 A1 WO2022124433 A1 WO 2022124433A1 KR 2020017817 W KR2020017817 W KR 2020017817W WO 2022124433 A1 WO2022124433 A1 WO 2022124433A1
Authority
WO
WIPO (PCT)
Prior art keywords
hologram
neural network
generating
image
optical
Prior art date
Application number
PCT/KR2020/017817
Other languages
French (fr)
Korean (ko)
Inventor
정진수
홍성희
김영민
홍지수
Original Assignee
한국전자기술연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자기술연구원 filed Critical 한국전자기술연구원
Publication of WO2022124433A1 publication Critical patent/WO2022124433A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G03H2001/0033—Adaptation of holography to specific applications in hologrammetry for measuring or analysing
    • G03H2001/0044—Adaptation of holography to specific applications in hologrammetry for measuring or analysing holographic fringes deformations; holographic sensors
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0825—Numerical processing in hologram space, e.g. combination of the CGH [computer generated hologram] with a numerical optical element
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2227/00—Mechanical components or mechanical aspects not otherwise provided for
    • G03H2227/02—Handheld portable device, e.g. holographic camera, mobile holographic display

Definitions

  • the present invention relates to hologram-related technology, and more particularly, to a method and apparatus capable of generating a hologram in real time in a portable device.
  • FIG. 1 is a diagram illustrating a process of generating a CGH (Computer Generated Hologram) pattern using a light wave simulation apparatus.
  • a simulation device that calculates the diffraction pattern of light waves with respect to the original image based on the wave equation, such as a computer, is required.
  • the present invention has been devised to solve the above problems, and an object of the present invention is to improve the calculation speed and improve the calculation speed by replacing the existing high-performance computing device for calculating the hologram fringe pattern with a physical optical propagation-based optical neural network.
  • the goal is to make the graphic display lightweight and modular so that it can be applied to portable smart devices such as augmented reality glasses.
  • a method for generating a hologram includes: generating a hologram fringe pattern using an optical neural network; and generating a holographic image from the generated holographic fringe pattern using an optical element.
  • the optical neural network may be a neural network that optically implements an artificial neural network.
  • the optical neural network may perform numerical calculations using physical optical propagation.
  • the method for generating a hologram may further include displaying an image on a display device, wherein the generating step may generate a hologram fringe pattern for the image displayed in the display step.
  • the holographic fringe pattern may be generated in real time.
  • an apparatus for generating a hologram includes an optical neural network module for generating a hologram fringe pattern using an optical neural network; and an optical element for generating a holographic image from the generated holographic fringe pattern.
  • the optical neural network may be a neural network that optically implements an artificial neural network.
  • an apparatus for generating a hologram may further include a display apparatus for displaying an image, and the optical neural network module may generate a hologram fringe pattern for the image displayed on the display apparatus.
  • the hologram generating device may be a portable device.
  • the optical element may provide the generated holographic image in augmented reality.
  • a method for generating a hologram according to an embodiment of the present invention includes: displaying an image on a display device; and generating a holographic fringe pattern for the displayed image using an optical neural network.
  • an apparatus for generating a hologram includes: a display apparatus for displaying an image; and an optical neural network module that generates a holographic fringe pattern for an image displayed on the display device.
  • the holographic fringe pattern speed can be improved by replacing the existing numerical calculation with physical light propagation, and the holographic display module can be replaced with an optical neural network by replacing the existing calculation device with an optical neural network. Lightweight/miniaturization/modularization becomes easy.
  • a method of generating a hologram using an optical neural network 5.
  • An embodiment of the present invention provides an apparatus and method for generating a real-time hologram using an optical neural network.
  • CGH Computer Generated Hologram
  • FIG. 3 is a diagram illustrating a process of generating CGH using an optical neural network according to an embodiment of the present invention.
  • an original image and an image are displayed through a display device.
  • a holographic fringe pattern for the image displayed on the display device is generated using the optical neural network.
  • An optical neural network is a neural network that optically implements an artificial neural network based on physical optical propagation, replacing numerical calculation with physical optical propagation. Accordingly, the optical neural network can generate a holographic fringe pattern in real time due to its high processing speed.
  • optical neural networks can be lightweight and modular. Therefore, it is possible to speed up the hologram fringe pattern engine as well as to reduce the weight, so it is easy to apply to a portable smart device.
  • the holographic augmented reality glasses are configured to include a display device 110 , an optical neural network module 120 , and an image coupling optical element 130 .
  • the display device 110 is a device that displays an image to be restored as a hologram.
  • the optical neural network module 120 generates a holographic fringe pattern from an image displayed on the display device 110 in real time using an optical neural network.
  • the image coupling optical element 130 generates a holographic image from the holographic fringe pattern generated by the optical neural network module 120, and allows the user U to observe it.
  • the holographic image was implemented to be provided in augmented reality together with the real world image.
  • FIG. 5 is a flowchart provided to explain a method for generating a hologram using an optical neural network according to another embodiment of the present invention.
  • an original image or an image is first displayed through the display device 110 (S210).
  • the displayed original image or image is an image to be restored as a hologram.
  • the optical neural network module 120 generates a hologram fringe pattern for the image displayed in step S210 in real time using the optical neural network (S220).
  • An optical neural network is a neural network that optically implements an artificial neural network based on physical light propagation, and can generate holographic fringe patterns in real time due to its high processing speed.
  • the image coupling optical device 130 generates a holographic image from the hologram fringe pattern generated in step S220 (S230). Accordingly, the user can observe the hologram.
  • the calculation speed is improved and the holographic display is lightweight and modular, so that it can be applied to portable smart devices such as augmented reality glasses. made to be applied.
  • augmented reality glasses are mentioned as an example of a portable smart device.
  • the technical idea of the present invention may be applied to other types of portable smart devices other than augmented reality glasses, and may be a virtual reality device other than an augmented reality device.
  • the technical idea of the present invention may be applied to a stationary device other than a portable device. That is, the scope of the present invention is not limited to portable devices.
  • the holographic fringe pattern speed can be improved by replacing the existing numerical calculation with physical light propagation, and the weight reduction/miniaturization/modularization of the holographic display module by replacing the existing calculation device with an optical neural network can be facilitated.
  • the technical idea of the present invention can also be applied to a computer-readable recording medium containing a computer program for performing the functions of the apparatus and method according to the present embodiment.
  • the technical ideas according to various embodiments of the present invention may be implemented in the form of computer-readable codes recorded on a computer-readable recording medium.
  • the computer-readable recording medium may be any data storage device readable by the computer and capable of storing data.
  • the computer-readable recording medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, hard disk drive, or the like.
  • the computer-readable code or program stored in the computer-readable recording medium may be transmitted through a network connected between computers.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Holo Graphy (AREA)

Abstract

Provided is a device for generating holograms in real time using an optical neural network. A hologram generation method according to an embodiment of the present invention generates a hologram fringe pattern by using an optical neural network, and generates a hologram video from the generated hologram fringe pattern by using an optical element. Accordingly, the speed of the hologram fringe pattern can be improved by replacing existing numerical calculations with physical light propagation, and weight reduction/miniaturization/modularization of holographic display modules is facilitated by replacing existing calculation devices with the optical neural network.

Description

광신경망을 이용한 실시간 홀로그램 생성 장치Real-time hologram generating device using optical neural network
본 발명은 홀로그램 관련 기술에 관한 것으로, 더욱 상세하게는 포터블 디바이스에서 실시간으로 홀로그램을 생성할 수 있는 방법 및 장치에 관한 것이다.The present invention relates to hologram-related technology, and more particularly, to a method and apparatus capable of generating a hologram in real time in a portable device.
도 1은 광파 시뮬레이션 장치를 이용하여 CGH(Computer Generated Hologram, 컴퓨터 생성 홀로그램) 패턴를 생성하는 과정을 나타낸 도면이다. CGH 패턴을 생성하기 위해서는 컴퓨터 등 파동 방정식에 기반하여 원본 영상에 대한 광파의 회절 패턴을 계산하는 시뮬레이션 장치가 필요하다.1 is a diagram illustrating a process of generating a CGH (Computer Generated Hologram) pattern using a light wave simulation apparatus. In order to generate the CGH pattern, a simulation device that calculates the diffraction pattern of light waves with respect to the original image based on the wave equation, such as a computer, is required.
하지만 고해상도 CGH 패턴을 생성하기 위해서는 그 계산량이 많아 실시간으로 CGH를 생성하기 위해서는 고성능 계산 장치가 필요하다.However, in order to generate a high-resolution CGH pattern, the amount of calculation is large, and a high-performance computing device is required to generate CGH in real time.
실시간으로 CGH를 생성하기 위해서 미리 CGH 패턴을 생성하는 방법을 학습한 인공신경망을 이용한 방법이 도 2에 도시된 바와 같이 제안되었으나, 인공신경망을 구동하기 위한 플랫폼 또는 계산장치가 필요하다.In order to generate CGH in real time, a method using an artificial neural network that has learned how to generate a CGH pattern in advance has been proposed as shown in FIG. 2 , but a platform or a calculation device for driving the artificial neural network is required.
이와 같은 단점으로 인하여 증강현실 안경과 같은 포터블 스마트 디바이스 상에서 CGH를 실시간으로 생성하는 것이 어려운 실정이다.Due to such shortcomings, it is difficult to generate CGH in real time on a portable smart device such as augmented reality glasses.
본 발명은 상기와 같은 문제점을 해결하기 위하여 안출된 것으로서, 본 발명의 목적은, 기존의 홀로그램 프린지 패턴을 계산하기 위한 고성능 계산 장치를 물리적 광전파 기반의 광신경망으로 대체하여 계산속도의 향상 및 홀로그래픽 디스플레이의 경량 모듈화하여 증강현실 안경과 같은 등 포터블 스마트 디바이스에 응용할 수 있도록 함에 있다.The present invention has been devised to solve the above problems, and an object of the present invention is to improve the calculation speed and improve the calculation speed by replacing the existing high-performance computing device for calculating the hologram fringe pattern with a physical optical propagation-based optical neural network. The goal is to make the graphic display lightweight and modular so that it can be applied to portable smart devices such as augmented reality glasses.
상기 목적을 달성하기 위한 본 발명의 일 실시예에 따른, 홀로그램 생성 방법은, 광신경망을 이용하여 홀로그램 프린지 패턴을 생성하는 단계; 및 광학소자를 이용하여 생성된 홀로그램 프린지 패턴으로부터 홀로그램 영상을 생성하는 단계;를 포함한다.According to an embodiment of the present invention for achieving the above object, a method for generating a hologram includes: generating a hologram fringe pattern using an optical neural network; and generating a holographic image from the generated holographic fringe pattern using an optical element.
광신경망은, 인공신경망을 광학적으로 구현한 신경망일 수 있다. 그리고, 광신경망은, 물리적 광전파로 수치 계산을 수행할 수 있다.The optical neural network may be a neural network that optically implements an artificial neural network. In addition, the optical neural network may perform numerical calculations using physical optical propagation.
본 발명의 실시예에 따른 홀로그램 생성 방법은, 디스플레이 장치에 영상을 표시하는 단계;를 더 포함하고, 생성 단계는, 표시단계에서 표시된 영상에 대한 홀로그램 프린지 패턴을 생성할 수 있다.The method for generating a hologram according to an embodiment of the present invention may further include displaying an image on a display device, wherein the generating step may generate a hologram fringe pattern for the image displayed in the display step.
생성 단계는, 홀로그램 프린지 패턴을 실시간으로 생성할 수 있다.In the generating step, the holographic fringe pattern may be generated in real time.
한편, 본 발명의 다른 실시예에 따른, 홀로그램 생성 장치는, 광신경망을 이용하여 홀로그램 프린지 패턴을 생성하는 광신경망 모듈; 및 생성된 홀로그램 프린지 패턴으로부터 홀로그램 영상을 생성하는 광학소자;를 포함한다.Meanwhile, according to another embodiment of the present invention, an apparatus for generating a hologram includes an optical neural network module for generating a hologram fringe pattern using an optical neural network; and an optical element for generating a holographic image from the generated holographic fringe pattern.
그리고, 광신경망은, 인공신경망을 광학적으로 구현한 신경망일 수 있다.In addition, the optical neural network may be a neural network that optically implements an artificial neural network.
한편, 본 발명의 다른 실시예에 따른, 홀로그램 생성 장치는, 영상을 표시하는 디스플레이 장치;를 더 포함하고, 광신경망 모듈은, 디스플레이 장치에 표시된 영상에 대한 홀로그램 프린지 패턴을 생성할 수 있다.Meanwhile, according to another embodiment of the present invention, an apparatus for generating a hologram may further include a display apparatus for displaying an image, and the optical neural network module may generate a hologram fringe pattern for the image displayed on the display apparatus.
홀로그램 생성 장치는, 포터블 장치일 수 있다. 그리고, 광학소자는, 생성된 홀로그램 영상을 증강현실로 제공할 수 있다.The hologram generating device may be a portable device. In addition, the optical element may provide the generated holographic image in augmented reality.
본 발명의 실시예에 따른 홀로그램 생성 방법은, 디스플레이 장치에 영상을 표시하는 단계; 광신경망을 이용하여 표시된 영상에 대한 홀로그램 프린지 패턴을 생성하는 단계;를 포함한다.A method for generating a hologram according to an embodiment of the present invention includes: displaying an image on a display device; and generating a holographic fringe pattern for the displayed image using an optical neural network.
한편, 본 발명의 다른 실시예에 따른, 홀로그램 생성 장치는, 영상을 표시하는 디스플레이 장치; 및 디스플레이 장치에 표시된 영상에 대한 홀로그램 프린지 패턴을 생성하는 광신경망 모듈;를 포함한다.Meanwhile, according to another embodiment of the present invention, an apparatus for generating a hologram includes: a display apparatus for displaying an image; and an optical neural network module that generates a holographic fringe pattern for an image displayed on the display device.
이상 설명한 바와 같이, 본 발명의 실시예들에 따르면, 기존의 수치 계산을 물리적 광전파로 대신하여 홀로그램 프린지 패턴 속도를 향상시킬 수 있으며, 기존의 계산 장치를 광신경망으로 대체하여 홀로그래픽 디스플레이 모듈의 경량화/소형화/모듈화가 용이해진다.As described above, according to the embodiments of the present invention, the holographic fringe pattern speed can be improved by replacing the existing numerical calculation with physical light propagation, and the holographic display module can be replaced with an optical neural network by replacing the existing calculation device with an optical neural network. Lightweight/miniaturization/modularization becomes easy.
도 1. 광파 시뮬레이션 장치를 이용하여 CGH 패턴를 생성하는 과정Figure 1. Process of generating a CGH pattern using a light wave simulation device
도 2. 인공신경망을 이용하여 CGH를 생성하는 과정Figure 2. Process of generating CGH using an artificial neural network
도 3. 광신경망을 이용하여 CGH를 생성하는 과정Figure 3. Process of generating CGH using an optical neural network
도 4. 광신경망을 이용한 홀로그래픽 증강현실 안경Figure 4. Holographic augmented reality glasses using optical neural network
도 5. 광신경망을 이용한 홀로그램 생성 방법5. A method of generating a hologram using an optical neural network.
이하에서는 도면을 참조하여 본 발명을 보다 상세하게 설명한다.Hereinafter, the present invention will be described in more detail with reference to the drawings.
본 발명의 실시예에서는 광신경망을 이용한 실시간 홀로그램 생성 장치 및 방법을 제시한다.An embodiment of the present invention provides an apparatus and method for generating a real-time hologram using an optical neural network.
기존의 컴퓨터 상에서 구동되는 광파 시뮬레이션 또는 인공신경망을 광파에 기반한 광신경망으로 대체하여 실시간으로 CGH(Computer Generated Hologram, 컴퓨터 생성 홀로그램)를 생성함과 동시에 경량화 및 모듈화를 통해 포터블 스마트 디바이스에 적용이 용이하도록 한다.To create CGH (Computer Generated Hologram) in real time by replacing the light wave simulation or artificial neural network running on the existing computer with an optical neural network based on light waves, and at the same time to make it easier to apply to portable smart devices through lightweight and modularization. do.
도 3은 본 발명의 일 실시예에 따른 광신경망을 이용하여 CGH를 생성하는 과정을 나타낸 도면이다.3 is a diagram illustrating a process of generating CGH using an optical neural network according to an embodiment of the present invention.
도시된 바와 같이, 먼저, 디스플레이 장치를 통해 원본 이미지, 영상을 표시한다. 다음, 광신경망을 이용하여 디스플레이 장치에 표시된 영상에 대한 홀로그램 프린지 패턴을 생성한다. As shown, first, an original image and an image are displayed through a display device. Next, a holographic fringe pattern for the image displayed on the display device is generated using the optical neural network.
광신경망은 물리적 광전파 기반으로 인공신경망을 광학적으로 구현한 신경망으로, 수치 계산을 물리적 광전파로 대신한다. 이에 따라, 광신경망은 빠른 처리 속도로 인해 홀로그램 프린지 패턴을 실시간으로 생성할 수 있다.An optical neural network is a neural network that optically implements an artificial neural network based on physical optical propagation, replacing numerical calculation with physical optical propagation. Accordingly, the optical neural network can generate a holographic fringe pattern in real time due to its high processing speed.
게다가 광신경망은 경량으로 모듈화하는 것이 가능하다. 따라서, 홀로그램 프린지 패턴 엔진을 고속화할 수 있음은 물론, 경량화 할 수도 있으므로 포터블 스마트 디바이스에 적용이 용이하다.In addition, optical neural networks can be lightweight and modular. Therefore, it is possible to speed up the hologram fringe pattern engine as well as to reduce the weight, so it is easy to apply to a portable smart device.
도 4에는 광신경망을 이용한 홀로그래픽 증강현실 안경의 구조를 도시하였다. 본 발명의 다른 실시예에 따른 홀로그래픽 증강현실 안경은 도시된 바와 같이, 디스플레이 장치(110), 광신경망 모듈(120), 영상결합 광학소자(130)를 포함하여 구성된다.4 shows the structure of holographic augmented reality glasses using an optical neural network. As shown, the holographic augmented reality glasses according to another embodiment of the present invention are configured to include a display device 110 , an optical neural network module 120 , and an image coupling optical element 130 .
디스플레이 장치(110)는 홀로그램으로 복원할 영상을 표시하여 주는 장치이다. 광신경망 모듈(120)은 광신경망을 이용하여 디스플레이 장치(110)에 표시된 영상으로부터 홀로그램 프린지 패턴을 실시간으로 생성한다.The display device 110 is a device that displays an image to be restored as a hologram. The optical neural network module 120 generates a holographic fringe pattern from an image displayed on the display device 110 in real time using an optical neural network.
영상결합 광학소자(130)는 광신경망 모듈(120)에 의해 생성된 홀로그램 프린지 패턴으로부터 홀로그램 영상을 생성하여, 사용자(U)가 관측할 수 있도록 하여 준다.The image coupling optical element 130 generates a holographic image from the holographic fringe pattern generated by the optical neural network module 120, and allows the user U to observe it.
도 4에서 홀로그램 영상은 실세계 영상과 함께 증강현실로 제공되는 것으로 구현하였다.In FIG. 4 , the holographic image was implemented to be provided in augmented reality together with the real world image.
도 5는 본 발명의 또 다른 실시예에 따른 광신경망을 이용한 홀로그램 생성 방법의 설명에 제공되는 흐름도이다.5 is a flowchart provided to explain a method for generating a hologram using an optical neural network according to another embodiment of the present invention.
홀로그램 생성을 위해, 먼저 디스플레이 장치(110)를 통해 원본 이미지 또는 영상을 표시한다(S210). 표시되는 원본 이미지 또는 영상은 홀로그램으로 복원하고자하는 영상이다.In order to generate a hologram, an original image or an image is first displayed through the display device 110 (S210). The displayed original image or image is an image to be restored as a hologram.
다음, 광신경망 모듈(120)이 광신경망을 이용하여 S210단계에서 표시되는 영상에 대한 홀로그램 프린지 패턴을 실시간으로 생성한다(S220). 광신경망은 물리적 광전파 기반으로 인공신경망을 광학적으로 구현한 신경망으로, 빠른 처리 속도로 인해 홀로그램 프린지 패턴을 실시간으로 생성할 수 있다.Next, the optical neural network module 120 generates a hologram fringe pattern for the image displayed in step S210 in real time using the optical neural network (S220). An optical neural network is a neural network that optically implements an artificial neural network based on physical light propagation, and can generate holographic fringe patterns in real time due to its high processing speed.
이후, 영상결합 광학소자(130)는 S220단계에서 생성되는 홀로그램 프린지 패턴으로부터 홀로그램 영상을 생성한다(S230). 이에, 사용자는 홀로그램을 관측할 수 있게 된다.Thereafter, the image coupling optical device 130 generates a holographic image from the hologram fringe pattern generated in step S220 (S230). Accordingly, the user can observe the hologram.
지금까지, 광신경망을 이용한 실시간 홀로그램 생성 장치에 대해 바람직한 실시예를 들어 상세히 설명하였다.Up to now, a preferred embodiment of a real-time hologram generating apparatus using an optical neural network has been described in detail.
위 실시예에서는 기존의 홀로그램 프린지 패턴을 계산하기 위한 고성능 계산 장치를 물리적 광전파 기반의 광신경망으로 대체하여, 계산속도의 향상 및 홀로그래픽 디스플레이의 경량 모듈화함으로써, 증강현실 안경과 같은 포터블 스마트 디바이스에 응용할 수 있도록 하였다.In the above embodiment, by replacing the high-performance computing device for calculating the existing holographic fringe pattern with a physical optical propagation-based optical neural network, the calculation speed is improved and the holographic display is lightweight and modular, so that it can be applied to portable smart devices such as augmented reality glasses. made to be applied.
하지만, 증강현실 안경은 포터블 스마트 디바이스의 일 예로 언급한 것이다. 증강현실 안경 이외의 다른 종류의 포터블 스마트 디바이스에 대해서도 본 발명의 기술적 사상이 적용될 수 있으며, 증강현실 디바이스가 아닌 가상현실 디바이스여도 무방하다.However, augmented reality glasses are mentioned as an example of a portable smart device. The technical idea of the present invention may be applied to other types of portable smart devices other than augmented reality glasses, and may be a virtual reality device other than an augmented reality device.
나아가, 포터블 디바이스가 아닌 거치형 디바이스에 대해서도 본 발명의 기술적 사상이 적용될 수 있다. 즉, 본 발명의 범주는 포터블 디바이스로 한정되지 않는다.Furthermore, the technical idea of the present invention may be applied to a stationary device other than a portable device. That is, the scope of the present invention is not limited to portable devices.
본 발명의 실시예를 활용하면, 기존의 수치 계산을 물리적 광전파로 대신하여 홀로그램 프린지 패턴 속도를 향상시킬 수 있고, 기존의 계산 장치를 광신경망으로 대체하여 홀로그래픽 디스플레이 모듈의 경량화/소형화/모듈화가 용이해질 수 있다.By utilizing an embodiment of the present invention, the holographic fringe pattern speed can be improved by replacing the existing numerical calculation with physical light propagation, and the weight reduction/miniaturization/modularization of the holographic display module by replacing the existing calculation device with an optical neural network can be facilitated.
한편, 본 실시예에 따른 장치와 방법의 기능을 수행하게 하는 컴퓨터 프로그램을 수록한 컴퓨터로 읽을 수 있는 기록매체에도 본 발명의 기술적 사상이 적용될 수 있음은 물론이다. 또한, 본 발명의 다양한 실시예에 따른 기술적 사상은 컴퓨터로 읽을 수 있는 기록매체에 기록된 컴퓨터로 읽을 수 있는 코드 형태로 구현될 수도 있다. 컴퓨터로 읽을 수 있는 기록매체는 컴퓨터에 의해 읽을 수 있고 데이터를 저장할 수 있는 어떤 데이터 저장 장치이더라도 가능하다. 예를 들어, 컴퓨터로 읽을 수 있는 기록매체는 ROM, RAM, CD-ROM, 자기 테이프, 플로피 디스크, 광디스크, 하드 디스크 드라이브, 등이 될 수 있음은 물론이다. 또한, 컴퓨터로 읽을 수 있는 기록매체에 저장된 컴퓨터로 읽을 수 있는 코드 또는 프로그램은 컴퓨터간에 연결된 네트워크를 통해 전송될 수도 있다.On the other hand, it goes without saying that the technical idea of the present invention can also be applied to a computer-readable recording medium containing a computer program for performing the functions of the apparatus and method according to the present embodiment. In addition, the technical ideas according to various embodiments of the present invention may be implemented in the form of computer-readable codes recorded on a computer-readable recording medium. The computer-readable recording medium may be any data storage device readable by the computer and capable of storing data. For example, the computer-readable recording medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, hard disk drive, or the like. In addition, the computer-readable code or program stored in the computer-readable recording medium may be transmitted through a network connected between computers.
또한, 이상에서는 본 발명의 바람직한 실시예에 대하여 도시하고 설명하였지만, 본 발명은 상술한 특정의 실시예에 한정되지 아니하며, 청구범위에서 청구하는 본 발명의 요지를 벗어남이 없이 당해 발명이 속하는 기술분야에서 통상의 지식을 가진자에 의해 다양한 변형실시가 가능한 것은 물론이고, 이러한 변형실시들은 본 발명의 기술적 사상이나 전망으로부터 개별적으로 이해되어져서는 안될 것이다.In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Claims (12)

  1. 광신경망을 이용하여 홀로그램 프린지 패턴을 생성하는 단계; 및generating a holographic fringe pattern using an optical neural network; and
    광학소자를 이용하여 생성된 홀로그램 프린지 패턴으로부터 홀로그램 영상을 생성하는 단계;를 포함하는 것을 특징으로 하는 홀로그램 생성 방법.Generating a hologram image from the generated hologram fringe pattern using an optical element; Hologram generating method comprising the.
  2. 청구항 1에 있어서,The method according to claim 1,
    광신경망은,The optical neural network is
    인공신경망을 광학적으로 구현한 신경망인 것을 특징으로 하는 홀로그램 생성 방법.A method for generating a hologram, characterized in that it is a neural network that optically implements an artificial neural network.
  3. 청구항 2에 있어서,3. The method according to claim 2,
    광신경망은,The optical neural network is
    물리적 광전파로 수치 계산을 수행하는 것을 특징으로 하는 홀로그램 생성 방법.A method for generating a hologram, characterized in that numerical calculations are performed using physical light propagation.
  4. 청구항 1에 있어서,The method according to claim 1,
    디스플레이 장치에 영상을 표시하는 단계;를 더 포함하고,Displaying an image on a display device; further comprising,
    생성 단계는,The creation step is
    표시단계에서 표시된 영상에 대한 홀로그램 프린지 패턴을 생성하는 것을 특징으로 하는 홀로그램 생성 방법.A hologram generating method, characterized in that generating a hologram fringe pattern for the displayed image in the display step.
  5. 청구항 4에 있어서,5. The method according to claim 4,
    생성 단계는,The creation step is
    홀로그램 프린지 패턴을 실시간으로 생성하는 것을 특징으로 하는 홀로그램 생성 방법.A method of generating a hologram, characterized in that the hologram fringe pattern is generated in real time.
  6. 광신경망을 이용하여 홀로그램 프린지 패턴을 생성하는 광신경망 모듈; 및an optical neural network module for generating a holographic fringe pattern using an optical neural network; and
    생성된 홀로그램 프린지 패턴으로부터 홀로그램 영상을 생성하는 광학소자;를 포함하는 것을 특징으로 하는 홀로그램 생성 장치.An apparatus for generating a hologram comprising a; an optical element for generating a hologram image from the generated hologram fringe pattern.
  7. 청구항 6에 있어서,7. The method of claim 6,
    광신경망은,The optical neural network is
    인공신경망을 광학적으로 구현한 신경망인 것을 특징으로 하는 홀로그램 생성 장치.A hologram generating device, characterized in that it is a neural network that optically implements an artificial neural network.
  8. 청구항 6에 있어서,7. The method of claim 6,
    영상을 표시하는 디스플레이 장치;를 더 포함하고,Display device for displaying an image; further comprising,
    광신경망 모듈은,The optical neural network module is
    디스플레이 장치에 표시된 영상에 대한 홀로그램 프린지 패턴을 생성하는 것을 특징으로 하는 홀로그램 생성 장치.A hologram generating device, characterized in that for generating a hologram fringe pattern for the image displayed on the display device.
  9. 청구항 1에 있어서,The method according to claim 1,
    홀로그램 생성 장치는,The hologram generating device,
    포터블 장치인 것을 특징으로 하는 홀로그램 생성 장치.A hologram generating device, characterized in that it is a portable device.
  10. 청구항 9에 있어서,10. The method of claim 9,
    광학소자는,The optical element is
    생성된 홀로그램 영상을 증강현실로 제공하는 것을 특징으로 하는 홀로그램 생성 장치.Hologram generating device, characterized in that providing the generated holographic image in augmented reality.
  11. 디스플레이 장치에 영상을 표시하는 단계;displaying an image on a display device;
    광신경망을 이용하여 표시된 영상에 대한 홀로그램 프린지 패턴을 생성하는 단계;를 포함하는 것을 특징으로 하는 홀로그램 생성 방법.Generating a hologram fringe pattern for the displayed image by using an optical neural network;
  12. 영상을 표시하는 디스플레이 장치;a display device for displaying an image;
    디스플레이 장치에 표시된 영상에 대한 홀로그램 프린지 패턴을 생성하는 광신경망 모듈;를 포함하는 것을 특징으로 하는 홀로그램 생성 장치.An optical neural network module for generating a hologram fringe pattern for an image displayed on a display device;
PCT/KR2020/017817 2020-12-08 2020-12-08 Device for generating holograms in real time using optical neural network WO2022124433A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2020-0170007 2020-12-08
KR1020200170007A KR20220080825A (en) 2020-12-08 2020-12-08 Real-time hologram generation device using optical neural network

Publications (1)

Publication Number Publication Date
WO2022124433A1 true WO2022124433A1 (en) 2022-06-16

Family

ID=81973409

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/017817 WO2022124433A1 (en) 2020-12-08 2020-12-08 Device for generating holograms in real time using optical neural network

Country Status (2)

Country Link
KR (1) KR20220080825A (en)
WO (1) WO2022124433A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180063835A (en) * 2016-12-02 2018-06-12 한국전자통신연구원 Hologram image reconstruction using modified optical neural networks
KR20190083583A (en) * 2018-01-04 2019-07-12 한국전자통신연구원 Device and method for reproducing binary hologram
KR20190102651A (en) * 2018-02-27 2019-09-04 주식회사 펀진 Apparatus and Method for Digital Holographic Display
KR20190105458A (en) * 2018-03-05 2019-09-17 한국전자통신연구원 Holograms reconstruction method
KR20200068507A (en) * 2018-12-05 2020-06-15 한국전자통신연구원 Apparatus for evaluation of coherence of light source for holographic display and method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180063835A (en) * 2016-12-02 2018-06-12 한국전자통신연구원 Hologram image reconstruction using modified optical neural networks
KR20190083583A (en) * 2018-01-04 2019-07-12 한국전자통신연구원 Device and method for reproducing binary hologram
KR20190102651A (en) * 2018-02-27 2019-09-04 주식회사 펀진 Apparatus and Method for Digital Holographic Display
KR20190105458A (en) * 2018-03-05 2019-09-17 한국전자통신연구원 Holograms reconstruction method
KR20200068507A (en) * 2018-12-05 2020-06-15 한국전자통신연구원 Apparatus for evaluation of coherence of light source for holographic display and method thereof

Also Published As

Publication number Publication date
KR20220080825A (en) 2022-06-15

Similar Documents

Publication Publication Date Title
CN106534835A (en) Image processing method and device
WO2018004154A1 (en) Mixed reality display device
CN1669057A (en) Graphical user interface for a flight simulator based on a client-server architecture
WO2020139054A1 (en) Apparatus and method for generating a virtual avatar
WO2022124433A1 (en) Device for generating holograms in real time using optical neural network
CN113379877A (en) Face video generation method and device, electronic equipment and storage medium
WO2016027910A1 (en) Ray tracing method, ray tracing device for performing same, and recording medium for storing same
CN115661310A (en) Virtual digital human expression approximation method and device, storage medium and electronic equipment
João et al. Virtual and augmented reality applied in power electric utilities for human interface improvement–a study case for best practices
CN112002017A (en) Virtual scene generation method, device, terminal, medium and virtual training system
JP2005055573A (en) High-speed display processor
CN112070227A (en) Neural network training method, device and equipment
WO2015108218A1 (en) Graphic processing device and method
CN213518340U (en) Nuclear power plant full-operation-value operation and training system
WO2023106428A1 (en) Method and system for foveated hologram rendering
WO2020116692A1 (en) Hologram generation method using segmentation
Ma Dynamic image data processing technology application in dance classroom assisted teaching under virtual environment
WO2020101197A1 (en) Method and system for sharing augmented reality content
WO2024101485A1 (en) Moving image hologram production method and system
WO2019107637A1 (en) System and method for applying digital hologram
WO2022107951A1 (en) Method for training ultra-lightweight deep learning network
WO2024117556A1 (en) Holographic image rendering method for printing that does not require rearrangement
CN111773683A (en) Character display method and device based on mobile terminal
WO2012128421A1 (en) 3d graphic model spatial rendering device and 3d rendering method
Goldiez History of networked simulations

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20965189

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20965189

Country of ref document: EP

Kind code of ref document: A1