WO2018145463A1 - Dispositif et procédé permettant de mettre en œuvre une réalité augmentée - Google Patents

Dispositif et procédé permettant de mettre en œuvre une réalité augmentée Download PDF

Info

Publication number
WO2018145463A1
WO2018145463A1 PCT/CN2017/102439 CN2017102439W WO2018145463A1 WO 2018145463 A1 WO2018145463 A1 WO 2018145463A1 CN 2017102439 W CN2017102439 W CN 2017102439W WO 2018145463 A1 WO2018145463 A1 WO 2018145463A1
Authority
WO
WIPO (PCT)
Prior art keywords
image light
module
light
virtual image
lens
Prior art date
Application number
PCT/CN2017/102439
Other languages
English (en)
Chinese (zh)
Inventor
陈建江
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018145463A1 publication Critical patent/WO2018145463A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays

Definitions

  • the present invention relates to virtual technologies, and more particularly to an apparatus and method for implementing augmented reality.
  • Augmented Reality (AR) technology can integrate virtual information such as objects, pictures, videos, sounds, etc. into the real environment, enrich the real world and build a more comprehensive and better world.
  • AR Augmented Reality
  • augmented reality shows a gradual development trend, and famous technology companies such as Google and Microsoft have begun to develop related equipment in this area.
  • Augmented reality is in the starting stage of education, entertainment, and daily life.
  • the augmented reality system mainly includes: a micro display, an optical waveguide, and a related baseband circuit, and the like, and a software application.
  • the hardware of the augmented reality device generates left and right eye images through two microdisplays, and the image is projected to the human eye through the optical waveguide, so that the virtual image is superimposed with the real image transmitted through the optical waveguide, thereby realizing the augmented reality visual effect.
  • the present invention provides an apparatus and method for realizing augmented reality, which can easily implement augmented reality.
  • an embodiment of the present invention provides an apparatus for implementing augmented reality, including: an imaging module and a second processing module;
  • An imaging module configured to image a virtual image light
  • the second processing module is configured to reflect the virtual image light and enter the viewpoint to transmit the real image light from the outside to the viewpoint.
  • the imaging module is a lens group, including a left lens and a right lens;
  • the second processing module is a half lens including a left half lens and a right half lens; the second processing module is specifically configured to:
  • the left half lens reflects the virtual image light from the left lens and enters a left viewpoint
  • the right half lens reflects the virtual image light from the right lens and enters a right viewpoint
  • the left half lens transmits the real image light
  • the right half lens transmits the real image light and enters the right viewpoint.
  • the device further includes: a first processing module, configured to adjust a propagation direction of the virtual image light to enter the imaging module.
  • the first processing module is a reflector.
  • the device further includes: an adjustment module configured to adjust an intensity of the real image light.
  • the whole module is a liquid crystal film; or a photosensitive dimming glass.
  • the device further includes: a light shielding module configured to adjust the light intensity of the real image before entering the second processing module.
  • the device further includes: a protection module disposed to be integral with the light shielding module.
  • the device further includes: a control unit configured to sense the intensity of the external light and convert the data into control data;
  • the adjustment module is specifically configured to: according to the control data of the control unit, adjust the voltage of the adjustment module by adjusting the voltage control circuit of the module to control the transmittance of the adjustment module.
  • the embodiment of the invention further provides a method for implementing augmented reality, comprising:
  • the virtual image light is reflected and then enters the viewpoint; the real image light from the outside is transmitted to the viewpoint.
  • the method further includes: adjusting a direction of propagation of the virtual image light The imaging process is performed.
  • the method further includes:
  • the intensity of the virtual image light and/or the intensity of the real image light from the outside is adjusted.
  • the intensity of the virtual image light and/or the intensity of the real image light is adjusted by controlling the transmittance and reflectivity of the liquid crystal film or the photosensitive light-adjusting glass.
  • the technical solution of the present application at least includes an imaging module and a second processing module; wherein, the imaging module is configured to image the virtual image light; and the second processing module is configured to reflect the virtual image light and enter The viewpoint transmits light from the real image from the outside to the viewpoint.
  • the device for realizing augmented reality provided by the embodiment of the present invention simply implements augmented reality.
  • the second processing unit in the embodiment of the present invention is implemented by using a half lens, which reduces the implementation cost of the augmented reality.
  • the embodiment of the present invention utilizes a smart terminal such as a popular smart phone as a virtual image provider of the augmented reality system, which greatly reduces the threshold for the augmented reality system and facilitates the popularization of the augmented reality system.
  • the present invention balances the brightness of the virtual image light with the outside by adjusting the liquid crystal film of the external light amount through the light sensor.
  • the brightness of the light in the real image can also adjust the brightness of the virtual image light.
  • the above light sensor may utilize a smart terminal such as a sensor provided in a popular smartphone.
  • FIG. 1 is a device for implementing augmented reality according to the present invention
  • FIG. 2 is a schematic structural diagram of a first embodiment of a system for implementing augmented reality according to the present invention
  • FIG. 3 is a schematic structural diagram of a second embodiment of a system for implementing augmented reality according to the present invention.
  • FIG. 4 is a flow chart of a method for implementing augmented reality in accordance with the present invention.
  • the method includes at least an imaging module and a second processing module.
  • An imaging module configured to image virtual image light.
  • the second processing module is configured to reflect the virtual image light and enter the viewpoint to transmit the real image light from the outside to the viewpoint.
  • the imaging module can be implemented with a lens set.
  • the second processing module can be implemented with a half mirror.
  • the virtual image may be from a device capable of generating a virtual display image, such as a smart mobile terminal, a handheld game console, a mini tablet, or the like.
  • the lens set includes a left lens and a right lens;
  • the half lens includes a left half lens and a right half lens
  • the second processing module is specifically configured to: the left half lens reflects the virtual image light from the left lens and enters the left view, the right half lens The virtual image light from the right lens is reflected and enters the right viewpoint; the left half lens transmits the real image light into the left viewpoint, and the right half lens transmits the real image light into the right viewpoint.
  • the device for realizing the augmented reality of the present invention further includes: a first processing module configured to adjust a propagation direction of the virtual image light and enter the imaging module.
  • the first processing module can be implemented using a reflector.
  • the adjusting may include: adjusting a light image propagation direction of the virtual image by using a reflector, so that the display screen is in an erect state.
  • This adjustment method makes the position of the mobile terminal biased toward the direction of the person's head, adjusts the center of gravity of the device for realizing the augmented reality, thereby making the wearing device more comfortable; on the other hand, adjusting the front of the mobile terminal
  • the camera shooting direction is in the same direction as the human eye angle, and the image seen by the human eye can be captured.
  • the rear camera can capture the image behind the person to monitor the environment behind the person.
  • the device for realizing augmented reality of the present invention further comprises: an adjustment module configured to adjust the intensity of the real image light from the outside, for example, adjusting the amount of light entering the outside in a high-brightness natural environment to balance the brightness and the trueness of the virtual image.
  • the brightness of the image is a high-brightness natural environment.
  • the device for realizing augmented reality of the present invention further includes: a control unit configured to sense the intensity of the external light and convert the data into control data; accordingly,
  • the adjustment module is specifically configured to: according to the control data of the control unit, adjust the voltage of the adjustment module by adjusting the voltage control circuit of the module to control the transmittance of the adjustment module.
  • control module can be implemented by using a smart terminal such as a light sensor in a popular smartphone, related software, a data port, and the like.
  • the adjustment module can be implemented using a liquid crystal diaphragm; it can also be replaced with a photosensitive dimming glass.
  • the device for realizing augmented reality of the invention further comprises:
  • the shading module is configured to adjust the light intensity of the real image of the real environment to the second processing module, or enter the second processing module via the adjustment module.
  • the shading module can be implemented by using a hood.
  • the light shielding module is further configured to: protect the half lens and the liquid crystal film to prevent dust, external collision, touch, and the like.
  • the device for realizing the augmented reality of the invention further comprises: a protection module arranged to cooperate with the light shielding module to form a whole body, preventing dust from entering the half lens, the cavity formed by the lens group.
  • the protection module can be implemented using a protective cover.
  • the device for realizing augmented reality provided by the invention is simple, and adopts an off-the-shelf intelligent mobile terminal to complete image processing and environment detection, and simply realizes augmented reality.
  • the half lens is used as the core component, the expensive optical waveguide lens is eliminated, and the realization cost of the augmented reality is reduced.
  • the present invention utilizes a smart terminal such as a popular smartphone as a provider of virtual images of an augmented reality system, greatly reducing the barrier to entry of the augmented reality system, and facilitating the popularization of the augmented reality system.
  • a smart terminal such as a popular smartphone as a provider of virtual images of an augmented reality system
  • the present invention balances the brightness of the virtual image light with the external reality by adjusting the liquid crystal film of the external light amount through the light sensor.
  • the light level of the image At the same time, the light sensor can also adjust the brightness of the virtual image light.
  • the above-described light sensor can utilize a sensor provided in a smart terminal such as a popular smartphone.
  • FIG. 2 is a schematic structural diagram of a first embodiment of a system for implementing augmented reality according to the present invention.
  • a smart phone is used as a device capable of generating a virtual display image, as shown in FIG. 2 .
  • the system for realizing augmented reality in the first embodiment includes:
  • Smartphone 1 the display of the smartphone 1 is the image display of the augmented reality device.
  • the front and rear cameras, sensors, and the like of the smartphone 1 can be adjusted in accordance with the augmented reality device to the direction of propagation of the virtual image light, the intensity of the real image light from the outside, and the like.
  • the reflector 2 is arranged to adjust the propagation direction of the virtual image light displayed on the display screen of the smartphone 1.
  • the structural support device 3 is provided as a constituent unit of the fixed augmented reality device.
  • the lens group 4 is arranged to image the content displayed on the display screen of the smartphone 1; wherein the lens group 4 comprises a left eyeglass lens group and a right eyeglass lens group.
  • the hood 5 is arranged to adjust the intensity of the real image light from the outside into the human eye, thereby adjusting the light of the virtual image projected by the display screen and the light of the real image from the outside.
  • the half lens 6 and the liquid crystal film 7 are protected from dust, external impact, and the like.
  • the half lens sheet 6 is arranged to reflect the virtual image light formed by the display screen of the smartphone 1 into the human eye, and the real image light from the outside enters the human eye.
  • the half lens sheet 6 includes a left half lens sheet and a right half lens sheet.
  • the light transmittance and reflectance of the semi-lens sheet 6 can be set or adjusted according to the needs of the entire system. specifically,
  • the light sensing sensor of the smart phone 1 senses the intensity of the external light, and is converted into control data by the related software operation of the smart phone 1, and is transmitted from the data port of the smart phone 1 to the bias control circuit of the liquid crystal film 7. After the bias control circuit of the liquid crystal film 7 obtains the control data, the voltage applied to the liquid crystal film 7 is adjusted to control the light transmittance of the liquid crystal film 7.
  • the liquid crystal film 7 can be disposed on a side of the half lens close to the hood, and is arranged to adjust the brightness of the light, and adjust the amount of light entering the outside in a high brightness environment to balance the display screen of the smart phone 1.
  • the liquid crystal film 7 can also be replaced with a photosensitive dimming glass.
  • the protective cover 8 is integrally formed with the hood 5 to prevent dust from entering the half lens and the cavity formed by the lens group.
  • the display screen of the smartphone 1 displays an image in the left and right format, and the left image is reflected by the reflector 2 into the left lens, and is reflected again on the left half lens to enter the left eye.
  • the reflector 2 reflects the right image into the right lens and re-reflects on the right half lens to enter the right eye. Its light propagation path is shown by the solid arrow in Figure 2.
  • the half lens sheet 6 reflects, transmits and superimposes the virtual image light of the display screen of the smartphone 1 and the light of the real scene image of the outside world to form an augmented reality image into the viewpoint.
  • the front and rear cameras and various sensors in the smartphone 1 in the first embodiment are arranged to capture surrounding environment information and are applied to the augmented reality image processing to adjust the light transmittance and reflection of the liquid crystal film 7.
  • the rate allows the human eye to see both the virtual image and the real image.
  • FIG. 3 is a schematic structural diagram of a second embodiment of a system for implementing augmented reality according to the present invention.
  • a smart phone is also used as a device capable of generating a virtual display image
  • the second embodiment and the first implementation are used as an example.
  • the difference in the example is that the reflection plate 2 is omitted in the second embodiment. That is to say, in the second embodiment, the virtual image light displayed on the display screen of the smartphone 1 enters the viewpoint only by one reflection of the half lens sheet 6.
  • the device for realizing enhanced display of the present invention can be applied in many scenarios.
  • the user uses a certain method (such as remote control, voice recognition, wired control, or touchpad, etc.) to open the smartphone navigation map, wear the device for realizing the augmented reality provided by the present invention, and adjust it to the front.
  • the location of the augmented reality navigation map is superimposed on the current external real image.
  • FIG. 4 is a flowchart of a method for implementing augmented reality according to the present invention. As shown in FIG. 4, the method includes:
  • Step 400 Imaging the virtual image light.
  • This step can be achieved by using a lens set.
  • This step also includes: You can use the reflector to adjust the direction of propagation of the virtual image light and then apply the image processing in the past and the present.
  • Step 401 Reflecting the virtual image light into the viewpoint to transmit the real image light from the outside to the viewpoint.
  • the semi-lens including the left semi-lens and the right semi-lens may be used.
  • the left semi-lens reflects the virtual image light from the left lens and enters the left viewpoint, and the right semi-lens pairs from the right lens.
  • the virtual image light is reflected and enters the right viewpoint; the left half lens transmits the real image light into the left viewpoint, and the right half lens transmits the real image light into the right viewpoint.
  • the method of the present invention further includes adjusting the intensity of the virtual image light and/or the intensity of the real image light from the outside.
  • the adjustment of the intensity of the virtual image light and/or the intensity of the real image light can be achieved by controlling the light transmittance and the reflectance of the liquid crystal film, or the photosensitive light-adjusting glass.
  • adjusting the intensity of the virtual image light and/or the intensity of the real image light from the outside includes:
  • the light sensor of the intelligent terminal is used to sense the intensity of the external light, and is converted into control data through the relevant software operation of the terminal, and is transmitted from the data port of the terminal to the bias control circuit of the liquid crystal film or the photosensitive dimming glass.
  • the voltage applied to the liquid crystal film or the photosensitive light-adjusting glass is adjusted under the control of the bias control circuit to control the light transmittance of the liquid crystal film or the photosensitive light-adjusting glass.
  • the present invention also provides a computer readable storage medium storing computer executable instructions for performing the method of implementing augmented reality of any of the present invention.
  • the imaging module in the embodiment of the present invention is configured to image the virtual image light; the second processing module is configured to reflect the virtual image light into the viewpoint, and transmit the real image light from the outside to the viewpoint, simply Augmented reality has been achieved.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention se rapporte à un dispositif qui permet de mettre en œuvre une réalité augmentée, et qui comprend au moins un module d'imagerie (4) et un second module de traitement (6). Ledit module d'imagerie (4) est conçu de façon à imager des faisceaux lumineux d'image virtuelle. Le second module de traitement (6) est prévu pour réfléchir les faisceaux lumineux d'image virtuelle, puis pour entrer dans un point de vue et transmettre des faisceaux lumineux d'image réelle depuis l'environnement externe jusqu'au point de vue. Ce dispositif met en œuvre une réalité augmentée d'une manière simple. La présente invention a trait également à un procédé permettant de mettre en œuvre une réalité augmentée.
PCT/CN2017/102439 2017-02-10 2017-09-20 Dispositif et procédé permettant de mettre en œuvre une réalité augmentée WO2018145463A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710072924.6 2017-02-10
CN201710072924.6A CN108415158A (zh) 2017-02-10 2017-02-10 一种实现增强现实的装置及方法

Publications (1)

Publication Number Publication Date
WO2018145463A1 true WO2018145463A1 (fr) 2018-08-16

Family

ID=63107185

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/102439 WO2018145463A1 (fr) 2017-02-10 2017-09-20 Dispositif et procédé permettant de mettre en œuvre une réalité augmentée

Country Status (2)

Country Link
CN (1) CN108415158A (fr)
WO (1) WO2018145463A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111292703A (zh) * 2019-12-20 2020-06-16 深圳光启空间技术有限公司 一种屏幕亮度调节方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101661163A (zh) * 2009-09-27 2010-03-03 合肥工业大学 增强现实系统的立体头盔显示器
CN104317055A (zh) * 2014-10-31 2015-01-28 成都理想境界科技有限公司 与移动终端配合使用的头戴式设备
CN204613517U (zh) * 2015-05-27 2015-09-02 王志健 基于移动设备的头戴式显示装置
CN105974589A (zh) * 2016-06-24 2016-09-28 赵宇 一种头戴式护目镜的近眼式显示器

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090052169A (ko) * 2007-11-20 2009-05-25 삼성전자주식회사 두부(頭部) 장착 디스플레이

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101661163A (zh) * 2009-09-27 2010-03-03 合肥工业大学 增强现实系统的立体头盔显示器
CN104317055A (zh) * 2014-10-31 2015-01-28 成都理想境界科技有限公司 与移动终端配合使用的头戴式设备
CN204613517U (zh) * 2015-05-27 2015-09-02 王志健 基于移动设备的头戴式显示装置
CN105974589A (zh) * 2016-06-24 2016-09-28 赵宇 一种头戴式护目镜的近眼式显示器

Also Published As

Publication number Publication date
CN108415158A (zh) 2018-08-17

Similar Documents

Publication Publication Date Title
US9223138B2 (en) Pixel opacity for augmented reality
US10459230B2 (en) Compact augmented reality / virtual reality display
US9711114B1 (en) Display apparatus and method of displaying using projectors
US9360671B1 (en) Systems and methods for image zoom
US8810600B2 (en) Wearable display device calibration
US9076033B1 (en) Hand-triggered head-mounted photography
JP2016040865A (ja) 頭部装着型表示装置およびその制御方法、並びにコンピュータープログラム
KR20140125183A (ko) 프로젝터 장착 안경 및 그 제어 방법
KR102187848B1 (ko) 프로젝터를 이용한 영상 표시 방법 및 이를 구현하는 착용형 전자장치
KR101690646B1 (ko) 시 스루 디스플레이를 위한 카메라 구동 장치 및 그 방법
JP2014107725A (ja) アタッチメント及び表示システム
US11720996B2 (en) Camera-based transparent display
US9348211B2 (en) Camera module and portable device using the same
US11681148B2 (en) Compact catadioptric projector
US11442342B2 (en) Recording indicators
US20150138235A1 (en) Collimated display device for augmented reality and method thereof
US11054652B2 (en) Augmented reality apparatus
WO2020001043A1 (fr) Dispositif de lunettes à réalité augmentée
WO2018145463A1 (fr) Dispositif et procédé permettant de mettre en œuvre une réalité augmentée
KR20220111144A (ko) HMD(head mounted display)의 영상 처리 방법 및 이 방법을 실행하는 HMD
JP2019106723A (ja) 表示装置、およびコンテキストディスプレイとプロジェクタを用いた表示方法
CN104239877A (zh) 图像处理的方法和图像采集设备
CN114446262B (zh) 色偏矫正方法和头戴显示装置
WO2023098228A1 (fr) Appareil d'affichage, dispositif électronique et véhicule
JP2021017064A (ja) ヘッドアップディスプレイ装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17895704

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17895704

Country of ref document: EP

Kind code of ref document: A1