WO2019074169A1 - Lunettes de réalité augmentée à détection de mouvement - Google Patents

Lunettes de réalité augmentée à détection de mouvement Download PDF

Info

Publication number
WO2019074169A1
WO2019074169A1 PCT/KR2018/002346 KR2018002346W WO2019074169A1 WO 2019074169 A1 WO2019074169 A1 WO 2019074169A1 KR 2018002346 W KR2018002346 W KR 2018002346W WO 2019074169 A1 WO2019074169 A1 WO 2019074169A1
Authority
WO
WIPO (PCT)
Prior art keywords
augmented reality
motion detection
reality glass
user
power supply
Prior art date
Application number
PCT/KR2018/002346
Other languages
English (en)
Korean (ko)
Inventor
임채열
강동섭
Original Assignee
주식회사 카이비전
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020170130016A external-priority patent/KR102133219B1/ko
Priority claimed from KR1020180018561A external-priority patent/KR20190098892A/ko
Application filed by 주식회사 카이비전 filed Critical 주식회사 카이비전
Priority to CN201880080000.3A priority Critical patent/CN111465912A/zh
Publication of WO2019074169A1 publication Critical patent/WO2019074169A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to a motion-sensing augmented reality glass, and more particularly, to a motion-augmented augmented reality glass that can easily and accurately control an augmented reality glass without touching by hands and reduce power consumption to maximize power efficiency.
  • Augmented reality glasses which show virtual images added to actual objects, are used in many fields such as defense, medical, and industrial, and are being researched and developed for use in various fields of software and hardware.
  • Such an augmented reality glass recognizes an actual object and gives information related to the recognized object or makes a virtual image of an object that does not actually exist, thereby matching the recognized object with the recognized object.
  • FIG. 1 shows an example in which an augmented reality glass is used for surgical operation, and sensor parts 10 and 20 are attached to a surgical object and a surgical instrument, and a 3D
  • the modeling is transferred to the augmented reality glass, the 3D modeling of the surgical object and the surgical instrument is transmitted to the augmented reality glass, and the 3D modeling is superimposed on the actual image of the human body, and 3D modeling of the surgical object and the surgical instrument is performed Additional markings are given.
  • surgery can be performed while precisely grasping the positions of important parts such as arteries and nerves while minimizing incision of the affected part.
  • the manipulation of the augmented reality glass requires manipulation of various switches on the legs of the eyeglasses.
  • the hands are not free, as in the case of holding the surgical tool with both hands, it is difficult to manipulate the augmented reality glass
  • There are problems such as manipulation while holding the object, or manipulation by placing the object on another object.
  • the present invention provides an augmented reality glass capable of maximizing power efficiency by minimizing wasted power when using an augmented reality glass.
  • an augmented reality glass including a display unit disposed in front of a user's eyes and displaying a virtual image, and a spectacle leg attached to a user's face ,
  • the augmented reality glass including a display unit disposed in front of a user's eyes and displaying a virtual image, and a spectacle leg attached to a user's face ,
  • the augmented reality glass including a display unit disposed in front of a user's eyes and displaying a virtual image, and a spectacle leg attached to a user's face , The augmented reality glass
  • a power supply unit for supplying power;
  • a motion detection sensor for sensing movement of the augmented reality glass;
  • a control unit for interrupting or supplying power to the power supply unit based on a signal from the motion detection sensor.
  • the controller measures the rotation angle of the power supply unit based on the rotation angle and the rotation speed of the rotation sensor.
  • the present invention also provides an augmented reality glass comprising a display unit disposed in front of a user's eyes to display a virtual image and a spectacle leg attached to a user's face,
  • a power supply unit for supplying power;
  • a motion detection sensor for sensing movement of the augmented reality glass;
  • a controller for selecting an object by the display unit based on a signal from the motion detection sensor.
  • the controller measures the rotation angle by the motion sensor, measures the rotation speed of the rotation angle by a timer, and selects the object based on the rotation angle and the rotation speed.
  • the controller determines whether the object is a restoration motion by measuring the rotation angle and the rotation speed, and determines a selection direction of the object according to the rotation direction when the restoration motion is determined.
  • the control unit may determine that a corresponding object is selected when a restoration motion in a direction different from the direction of the rotation angle is sensed.
  • the present invention also provides an augmented reality glass comprising a display unit disposed in front of a user's eyes to display a virtual image and a spectacle leg attached to a user's face, A power supply unit for supplying power; A motion detection sensor for sensing movement of the augmented reality glass; And a controller for shutting off or supplying power to the power supply unit based on a signal from the motion detection sensor.
  • the present invention provides an augmented reality glass comprising a display unit disposed in front of a user's eyes and displaying a virtual image, and a nose support and a pair of eyeglasses to be attached to a user's face,
  • the real glass includes a power supply unit for supplying power; A contact sensor provided in the nose receiver; And a controller for shutting off or supplying power to the power supply unit based on a signal from the touch sensor.
  • the augmented reality glass further includes a motion detection sensor for detecting movement of the augmented reality glass, and the control unit controls the power supply of the augmented reality glass based on a movement angle of the motion detection sensor and a signal change by the touch sensor, It is preferable to shut off or supply the battery.
  • FIG. 1 is an exemplary view showing an example of using augmented reality glass according to the prior art
  • FIG. 2 is a block diagram showing the configuration of a motion-sensing augmented reality glass according to the present invention
  • FIG. 3 is a flowchart showing an operation process using a motion-sensing augmented reality glass according to the present invention
  • 4 and 5 are diagrams for explaining a menu selection process according to the present invention.
  • FIG. 6 is a perspective view showing an appearance of an augmented reality glass according to the present invention.
  • FIG. 7 is a structural view showing a configuration of an augmented reality glass according to the present invention.
  • Fig. 8 is a configuration diagram showing the configuration of the touch sensor in Fig. 3; Fig.
  • FIG 9 is an exemplary view showing an example of use of an augmented reality glass according to the present invention.
  • the motion sensing augmented reality glass includes a display unit 100, a power supply unit 200, a motion sensing unit 300, a motion detection sensor 400, a control unit 500, a storage unit 600).
  • the display unit 100 is formed in the shape of an eyeball and is disposed in front of the user's eyes.
  • the display unit 100 allows a user to view an image related to an actual object.
  • the display unit 100 may be configured in various forms such as an LCD projector type or an OLED waveguide type. That is, the display unit may include a transparent or translucent matrix display, and a corresponding display driver may be disposed in a glass frame such as a pair of glasses to drive the matrix display.
  • a corresponding display driver may be disposed in a glass frame such as a pair of glasses to drive the matrix display.
  • the power supply unit 200 serves to supply power to each part including the display unit.
  • the power supply unit 200 may include a battery and a plurality of wiring units, and the battery may be a non-rechargeable or rechargeable battery. Also, in the case of a rechargeable battery, it can be connected to a wired charger for a portable terminal for charging.
  • the movement detecting part 300 can detect movement of the pupil of the user and simultaneously detect blinking of the eyes.
  • the motion detection sensor 400 may be disposed in a frame such as a spectacle frame, and may include a three-axis acceleration sensor, a gyro sensor, or the like.
  • the three-axis acceleration sensor can sense the speed at which the augmented reality glass moves in space, and the gyro sensor can measure the angle change of the augmented reality glass.
  • the storage unit 600 stores an image file to be displayed to a user, and may include an internal memory or an external memory.
  • the control unit 500 manages to minimize power consumption, and recognizes the movement of the user and controls necessary parts.
  • the motion sensing sensor 400 senses the rotational motion of the augmented reality glass.
  • the motion sensor 400 measures the rotation angle and the rotation direction of the augmented reality glass, and the timer is operated in conjunction with the rotation speed. At the same time, the controller determines whether the motion is a restoration motion.
  • the controller determines that the motion is a restoration motion if the position of the augmented reality glass is within a certain range .
  • the control unit analyzes the restoration movement and performs an operation corresponding to the restoration movement.
  • the control unit controls the power supply unit to cut off the power.
  • the above movement is in a state where the user turns his / her head more than 3 ° to the right in a state facing the front, immediately turns his / her head more than 3 ° to the left, and then looks back to the front.
  • the 3 ° may be stored in the storage unit as the rotation recognition angle, and it is preferable that the rotation recognition angle can be changed by the user.
  • the acceleration sensor may be used in the control unit without measuring the rotation recognition angle by the gyro sensor. At this time, when the motion is restored by the acceleration sensor and the direction of the acceleration is changed (+ to - or - to +), the corresponding operation may be performed.
  • control unit may determine that the acceleration is a restoration motion and perform a corresponding operation.
  • the controller determines that the movement is started when the user moves at a speed higher than the predetermined movement speed at the position where the user first looks at the front side, and does not determine that the movement is started when the movement is less than the predetermined movement speed.
  • the controller detects the position that is less than the motion velocity as the last position, and determines that the motion is the restoration motion when the last position is detected within the predetermined restoration angle at the position where the first motion velocity is started. If the last position is out of the restoration angle, the control unit does not judge the restoration movement and switches to the standby state.
  • the control unit can switch the augmented reality glass to a sleep state instead of completely shutting off the power.
  • the sleep state refers to a state in which power is supplied to a control chip such as a CPU, a sensor or the like, and a power source such as a display unit directly felt by a user of the external unit.
  • the controller may control power to the display unit to release the sleep state and completely supply power when the controller detects the restoration motion.
  • the display unit 100 may display various menus, receive input from the user, and display the corresponding images again.
  • the motion sensing sensor 400 senses the motion of the augmented reality glass, and the control unit selects one of the objects based on the rotation angle, the direction, and the rotation speed.
  • the object can be selected, and various menus, objects recognized by the recognition sensor, and the like can be objects.
  • the control unit may determine that the restoration movement is performed.
  • the control unit determines whether the motion is a restoration motion by using the rotation angle and the rotation speed sensed by the motion sensor, and selects the object closest to the direction according to the rotation angle direction when it is determined that the motion is restoration motion.
  • control unit determines that the user has turned his / her head to the right and changes the menu selection to " mission oil change "
  • the controller determines that the selected menu is confirmed and displays the next image corresponding to the selected menu.
  • the above movement is in a state in which the user turns his / her head more than 4 degrees upward toward the front side, immediately turns the head more than 4 degrees downward, and then looks back to the front side.
  • the controller determines that the selection of the corresponding object is confirmed.
  • the motion sensing unit 300 may include a camera module and a line-tracking algorithm execution processor, and the camera module may acquire motion information of a user's eyeball.
  • the controller may detect that the right or left eye is drowning in the dynamic movement sensing unit and may determine that the selection of the corresponding object is confirmed when one eye is left over the critical determination time.
  • the dynamic movement sensing unit 300 may select an object according to the distance and direction in which the user's eye (particularly, the pupil) moves. At this time, the augmented reality glass rotates more than 4 degrees upward , And if it is analyzed that it has rotated more than 4 degrees in the downward direction immediately, it can be judged that the selected menu is confirmed in the control part.
  • the control unit may determine that the selected menu is confirmed.
  • the augmented reality glass can be controlled even when both hands are not free, the user can more conveniently use the same.
  • the power efficiency enhanced augmented reality glass is configured to be attached to a user's face by the eyeglass leg portion 700 and the nose receiving portion 800, A motion sensing unit 400, a control unit 500, a storage unit 600, and a contact sensor unit 900.
  • the display unit 100 is formed in the shape of an eyeball and is disposed in front of the user's eyes.
  • the display unit 100 allows a user to view an image related to an actual object.
  • the display unit 100 may be configured in various forms such as an LCD projector type or an OLED waveguide type. That is, the display unit may include a transparent or translucent matrix display, and a corresponding display driver may be disposed in a glass frame such as a pair of glasses to drive the matrix display.
  • a corresponding display driver may be disposed in a glass frame such as a pair of glasses to drive the matrix display.
  • the power supply unit 200 serves to supply power to each part including the display unit.
  • the power supply unit 200 may include a battery and a plurality of wiring units, and the battery may be a non-rechargeable or rechargeable battery. Also, in the case of a rechargeable battery, it can be connected to a wired charger for a portable terminal for charging.
  • the movement detecting part 300 can detect movement of the pupil of the user and simultaneously detect blinking of the eyes.
  • the motion detection sensor unit 400 may be disposed in a frame such as a spectacle frame, and may include a three-axis acceleration sensor, a gyro sensor, a G sensor, or the like.
  • the three-axis acceleration sensor can sense the speed at which the augmented reality glass moves in space, and the gyro sensor can measure the angle change of the augmented reality glass. Also, the G sensor can measure the tilt of the augmented reality glass.
  • the storage unit 600 stores an image file to be displayed to a user, and may include an internal memory or an external memory.
  • the control unit 500 manages to minimize power consumption, and recognizes the movement of the user and controls necessary parts.
  • the contact sensor unit 900 may be provided in the nose receiver 800 and determines whether the user wears an augmented reality glass.
  • the contact sensor may be a pressure sensor, a capacitive touch sensor, or the like.
  • the contact sensor may include two layers of polyvinylidene fluoride (PVDF) 910 and 920, and an intermediate film 930 may be provided between the PVDFs to transmit vibration.
  • PVDF polyvinylidene fluoride
  • the touch sensor provided on the nose support unit 800 is pressed against the nose of the user, and the control unit determines that the user wears the augmented reality glass by the signal of the touch sensor.
  • the touch sensor provided on the nose receiving portion is released from the pressed state, and the controller determines that the augmented reality glass is removed by the control unit.
  • the power supply unit 200 turns off the power supply or switches the power supply to the sleep state.
  • the sleep state is a state in which power is turned off to the outside such as the display unit and power is supplied only to internal parts such as a CPU. In this sleep state, there is an advantage that the display unit can be immediately activated by the user's reaction without a rebooting process.
  • the motion detection sensor unit 400 measures the rotation angle of the augmented reality glass.
  • the controller determines that the augmented reality glass is inclined .
  • the control unit controls the power supply unit by combining signals of the motion sensor unit and the touch sensor unit.
  • the controller determines that the augmented reality glass is worn.
  • the controller determines that the augmented reality glass is removed from the control unit.
  • the control unit controls the power supply unit to turn off the power or convert the power supply to the sleep state. Thereafter, when the augmented reality glass is changed to a horizontal state by the motion detection sensor unit and it is determined that the augmented reality glass is in contact with the contact sensor, the control unit again supplies power to the power supply unit.
  • the present invention it is possible to more precisely detect the wearing state of the user and to reduce the unnecessary power consumption without any operation, thereby increasing the battery usage time.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

La présente invention concerne des lunettes de réalité augmentée à détection de mouvement permettant de commander facilement et avec précision les lunettes de réalité augmentée sans le toucher avec la main. À cet effet, la présente invention concerne des lunettes de réalité augmentée à détection de mouvement comprenant une unité d'affichage qui est disposée devant les yeux de l'utilisateur pour afficher une image virtuelle, et des branches qui peuvent permettre aux lunettes d'être fixées au visage de l'utilisateur, les lunettes de réalité augmentée comprenant une unité d'alimentation électrique qui fournit de l'énergie ; un capteur de détection de mouvement qui détecte le mouvement des lunettes de réalité augmentée ; et une unité de commande qui arrête ou active l'alimentation électrique de l'unité d'alimentation électrique sur la base d'un signal provenant du capteur de détection de mouvement. Par conséquent, la présente invention présente l'avantage selon lequel les lunettes de réalité augmentée peuvent être commandées de manière très commode et précise puisque la commande souhaitée peut être effectuée sans avoir besoin de toucher avec les mains même lorsque les deux mains sont utilisées.
PCT/KR2018/002346 2017-10-11 2018-02-26 Lunettes de réalité augmentée à détection de mouvement WO2019074169A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201880080000.3A CN111465912A (zh) 2017-10-11 2018-02-26 具有运动检测功能的增强现实眼镜

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2017-0130016 2017-10-11
KR1020170130016A KR102133219B1 (ko) 2017-10-11 2017-10-11 움직임감지 증강현실 글라스
KR10-2018-0018561 2018-02-14
KR1020180018561A KR20190098892A (ko) 2018-02-14 2018-02-14 전력효율향상 증강현실 글라스

Publications (1)

Publication Number Publication Date
WO2019074169A1 true WO2019074169A1 (fr) 2019-04-18

Family

ID=66100764

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/002346 WO2019074169A1 (fr) 2017-10-11 2018-02-26 Lunettes de réalité augmentée à détection de mouvement

Country Status (2)

Country Link
CN (1) CN111465912A (fr)
WO (1) WO2019074169A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111710284A (zh) * 2020-07-17 2020-09-25 Oppo广东移动通信有限公司 智能眼镜控制方法、智能眼镜控制装置及智能眼镜

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112485907A (zh) * 2020-12-11 2021-03-12 上海影创信息科技有限公司 Ar眼镜的启动控制方法和ar眼镜

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004096224A (ja) * 2002-08-29 2004-03-25 Sony Corp 電源制御方法及びヘッドマウント装置
KR101431366B1 (ko) * 2010-07-20 2014-08-19 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 증강 현실 근접 감지
KR20150024199A (ko) * 2013-08-26 2015-03-06 엘지전자 주식회사 두부 장착형 디스플레이 장치 및 이의 제어방법
KR20150126938A (ko) * 2013-03-11 2015-11-13 매직 립, 인코포레이티드 증강 및 가상 현실을 위한 시스템 및 방법
KR101647467B1 (ko) * 2015-06-05 2016-08-11 주식회사 메드릭스 증강현실을 이용한 외과 수술용 3d 안경 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004096224A (ja) * 2002-08-29 2004-03-25 Sony Corp 電源制御方法及びヘッドマウント装置
KR101431366B1 (ko) * 2010-07-20 2014-08-19 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 증강 현실 근접 감지
KR20150126938A (ko) * 2013-03-11 2015-11-13 매직 립, 인코포레이티드 증강 및 가상 현실을 위한 시스템 및 방법
KR20150024199A (ko) * 2013-08-26 2015-03-06 엘지전자 주식회사 두부 장착형 디스플레이 장치 및 이의 제어방법
KR101647467B1 (ko) * 2015-06-05 2016-08-11 주식회사 메드릭스 증강현실을 이용한 외과 수술용 3d 안경 시스템

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111710284A (zh) * 2020-07-17 2020-09-25 Oppo广东移动通信有限公司 智能眼镜控制方法、智能眼镜控制装置及智能眼镜

Also Published As

Publication number Publication date
CN111465912A (zh) 2020-07-28

Similar Documents

Publication Publication Date Title
CN109313497B (zh) 用于六自由度混合现实输入的惯性控制器的模块化扩展
WO2014109430A1 (fr) Dispositif d'affichage facial réalisant un étalonnage du regard, et procédé de commande associé
US20170357332A1 (en) Six dof mixed reality input by fusing inertial handheld controller with hand tracking
WO2015125373A1 (fr) Appareil électronique et procédé de commande de puissance
WO2013133583A1 (fr) Système et procédé de réhabilitation cognitive par interaction tangible
EP2943835A1 (fr) Afficheur facial réalisant un étalonnage du regard, et procédé de commande associé
JP2017511041A (ja) モバイルコンピューティングデバイスと共に使用するためのヘッドマウントディスプレイゴーグル
US20200201460A1 (en) Universal Handheld Controller of a Computer System
US10976807B2 (en) Distributed artificial reality system with contextualized hand tracking
WO2019074169A1 (fr) Lunettes de réalité augmentée à détection de mouvement
WO2016080557A1 (fr) Dispositif pouvant être porté et son procédé de commande
JP2009104429A (ja) ヘッドマウントディスプレイ装置及び携帯装置
KR20190041048A (ko) 움직임감지 증강현실 글라스
WO2014077462A1 (fr) Appareil de mesure d'angle de rotation d'œil pour réglage de longueur couloir de lentille progressive et procédé pour celui—ci
WO2016208794A1 (fr) Système et procédé de surveillance d'un exercice d'utilisateur au moyen d'un dispositif portable de type ceinture vestimentaire
KR102162922B1 (ko) 촉각 피드백이 가능한 가상현실 기반의 손 재활 시스템
US9454236B2 (en) Three-dimensional mouse device and marionette control system using the same
RU176318U1 (ru) Перчатка виртуальной реальности
KR101847918B1 (ko) 모션 인식 밴드를 이용한 재활운동 방법 및 시스템
CN117784926A (zh) 控制装置、控制方法和计算机可读存储介质
CN107005668B (zh) 信息处理装置
WO2020022750A1 (fr) Dispositif électronique pouvant fournir multiples points focaux d'une lumière émise par un dispositif d'affichage
JPH0981785A (ja) 画像投影装置および機器制御装置
JPWO2020079852A1 (ja) コントローラ装置の制御装置
WO2020204594A1 (fr) Dispositif de réalité virtuelle et son procédé de commande

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18866232

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18866232

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 18866232

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22.01.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18866232

Country of ref document: EP

Kind code of ref document: A1