WO2018043920A1 - Augmented reality or virtual reality system - Google Patents

Augmented reality or virtual reality system Download PDF

Info

Publication number
WO2018043920A1
WO2018043920A1 PCT/KR2017/008093 KR2017008093W WO2018043920A1 WO 2018043920 A1 WO2018043920 A1 WO 2018043920A1 KR 2017008093 W KR2017008093 W KR 2017008093W WO 2018043920 A1 WO2018043920 A1 WO 2018043920A1
Authority
WO
WIPO (PCT)
Prior art keywords
augmented reality
information
user device
virtual reality
user
Prior art date
Application number
PCT/KR2017/008093
Other languages
French (fr)
Korean (ko)
Inventor
류재욱
정회원
Original Assignee
(주)알비케이이엠디
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)알비케이이엠디 filed Critical (주)알비케이이엠디
Publication of WO2018043920A1 publication Critical patent/WO2018043920A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H04B1/385—Transceivers carried on the body, e.g. in helmets

Definitions

  • the present invention relates to an augmented reality or virtual reality system, and more particularly, using a smart device that can implement augmented reality or virtual reality and a user device that can obtain motion information and command information from a user and deliver it to a smart device. It relates to an augmented reality or virtual reality system that can experience augmented reality or virtual reality.
  • AR augmented reality
  • the user can integrate artificial or virtual graphics with the natural surroundings of the user. For example, a user may view graphics arbitrarily displayed inside real natural environments around the user through augmented reality goggles.
  • AR augmented reality
  • AR which is generally provided, provides augmented reality depending on the user's vision through an electronic device equipped with goggles or a screen. Accordingly, the conventional augmented reality is reduced in the user's immersion degree and there is a limit to utilizing a variety of augmented reality content.
  • Augmented reality or virtual reality system of the present invention for achieving the above object, a smart device that can implement augmented reality or virtual reality; And a user device which acquires and transmits operation information or command information of the user to the smart device and receives and expresses information from the smart device.
  • the smart device may include an image generation unit for generating a virtual image, a display unit for displaying the virtual image, a first communication unit for receiving the operation information or command information from the user device, and the operation information or command information.
  • the image processing unit may determine a position or an operation of the virtual image in the augmented reality or virtual reality.
  • the user device may include a sensor unit configured to detect any one or more of a position change, a posture change or an operation of the user device by the user, and the operation information may be generated by a position change or a posture change or an operation of the user device. .
  • Augmented reality or virtual reality system of the present invention by obtaining the user's motion information and command information through the user device to the smart device and receiving information from the smart device to generate light, sound, vibration, etc. It can increase the immersion and fun of reality.
  • FIG. 2 is a view showing a specific embodiment of the augmented reality or virtual reality system according to the present invention.
  • FIG. 3 is a diagram illustrating an operation form implemented through a user device of an augmented reality or virtual reality system according to an embodiment of the present invention.
  • Figure 4 is a view showing a specific embodiment of the augmented reality or virtual reality system according to another embodiment of the present invention.
  • Augmented reality or virtual reality system according to an embodiment of the present invention, as shown in Figures 1 to 3, consists of a smart device 100 and the user device 200.
  • the augmented reality or virtual reality system can be used in a variety of fields, such as games, tourism, medical care, defense.
  • the user device 200 includes a sensor unit, a second communication unit, an output unit, and a control unit as shown in FIG. 1.
  • the user device may include a battery (not shown) to supply power to the sensor unit, the second communication unit, the output unit, and the control unit.
  • the sensor unit may include any one or more of an acceleration sensor, a gyro sensor, and a geomagnetic sensor.
  • the sensor unit may further include various other types of sensors in addition to the above sensors.
  • the second communication unit is an apparatus installed in the user device 200 and communicates with the smart device 100.
  • the second communication unit receives specific information from the smart device 100 according to an environment change in augmented reality or virtual reality implemented by the smart device 100, or changes in position, posture change or operation of the user device 200.
  • the operation information or command information according to the implementation is transmitted to the smart device 100.
  • the first communication unit and the second communication unit may use various wireless communication means such as Bluetooth and Wi-Fi.
  • the smart device 100 and the user device 200 may be connected by wire.
  • Environment change in augmented reality or virtual reality may be the occurrence of events that fit augmented reality or virtual reality, the performance of specific actions and tasks, the success or failure of the purpose / goal, and transfer from the smart device 100 to the user device 200
  • the information may be any one of a plurality of signals corresponding to various environmental changes in augmented reality or virtual reality.
  • the operation information and the command information are signals corresponding to a position change, posture change or a specific operation of the user device 200 detected by the sensor unit, and are transmitted to the smart device 100 through the second communication unit to be augmented reality or virtual. It can cause environmental changes in reality.
  • the output unit may be installed inside the user device 200 to generate sound, light, and vibration.
  • Such an output unit may be any one of a speaker, an LED lamp, and a vibration module.
  • the output unit may generate sound, light, or vibration when specific information is received from the smart device 100, or may generate sound, light, or vibration according to a position change, posture change, or motion of the user device 200. have.
  • the output unit may include all of the above-described speaker, LED lamp, vibration module or a plurality of parts thereof. Accordingly, any one of sound, light, and vibration may be generated, or two or more of sound, light, and vibration may be simultaneously generated.
  • the output unit when specific information is received from the smart device 100 through the second communication unit, the output unit generates sound, light, or vibration to inform the user of an event in augmented reality or virtual reality or the success or failure of achieving an objective / goal. to provide.
  • the output unit may change the intensity of the sound, light, vibration, and pattern according to various information transmitted from the smart device 100 to allow the user to distinguish each signal, thereby allowing the user to distinguish between environmental changes generated in augmented reality or virtual reality. You can recognize the kind.
  • the output unit may generate different vibrations according to the operation of the user device 200 to determine whether the user intended motion is correct.
  • the controller is installed inside the user device 200 to operate the second communication unit and the output unit.
  • the user device 200 includes a battery as described above, and the battery is a rechargeable secondary battery. As illustrated in FIG. 4A, the user device 200 may be formed to be worn on a user's wrist. In addition, the user device 200 may be fixed to various parts of the user's body, clothes, and the like.
  • the user device 200 may be connected to various types of smart devices 100 by a charging cable and used as an auxiliary battery for charging the smart devices 100.
  • the user device 200 may be connected to other general portable terminals to charge the connected portable terminals.
  • the user device 200 is linked with the smart device 100, and the user moves the user device 200 or performs a specific operation to create an environment in augmented reality or virtual reality. It can cause a change. That is, the user device 200 may be moved in the vertical direction or the horizontal direction, or the posture of the user device 200 may be changed, and motions such as linear motion, parabolic motion, circular motion, and rotation motion may be implemented. Specific command information or motion information is generated according to the position change, posture change, or motion of the user device 200, and the command information or motion information is transmitted to the smart device 100 through the second communication unit and the first communication unit. It is delivered and becomes an order for a task or a specific action in augmented or virtual reality.
  • the controller operates an output unit according to the information to generate sound, light or vibration of a specific intensity and pattern. Generate. Accordingly, the user holding the user device 200 may check whether the event occurred in the augmented reality or the virtual reality or the success or failure of the purpose / objective achievement.
  • the linear motion, the parabolic motion, the circular motion, and the rotary motion of the user device 200 implemented by the user may be detected and determined by the sensor part and the controller, and the output part may be one or more of sound, light, and vibration according to each motion. You can check the implementation by the user. Alternatively, it may be determined whether a specific operation to be implemented by a user is properly implemented to generate sound, light, or vibration that determines whether the corresponding operation is implemented.
  • Augmented reality or virtual reality system according to the present invention is not limited to the above-described embodiment can be implemented in various modifications within the scope of the technical idea of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to an augmented reality or virtual reality system and, more particularly, to an augmented reality or virtual reality system which enables experience of an augmented reality or a virtual reality by using a smart device which can implement an augmented reality or a virtual reality and a user device capable of acquiring operation information and command information from a user and transferring the acquired information to the smart device. The augmented reality or virtual reality system of the present invention comprises: a smart device which can implement an augmented reality or a virtual reality; and a user device for acquiring operation information or command information of a user, transferring the acquired information to the smart device, receiving information from the smart device, and expressing the received information.

Description

증강현실 또는 가상현실 시스템Augmented Reality or Virtual Reality System
본 발명은 증강현실 또는 가상현실 시스템에 관한 것으로, 보다 상세하게는 증강현실 또는 가상현실을 구현할 수 있는 스마트 기기와 사용자로부터 동작정보, 명령정보를 취득하여 스마트 기기로 전달할 수 있는 사용자 디바이스를 이용하여 증강현실 또는 가상현실을 체험할 수 있는 증강현실 또는 가상현실 시스템에 관한 것이다.The present invention relates to an augmented reality or virtual reality system, and more particularly, using a smart device that can implement augmented reality or virtual reality and a user device that can obtain motion information and command information from a user and deliver it to a smart device. It relates to an augmented reality or virtual reality system that can experience augmented reality or virtual reality.
증강현실(AR)은 실시간으로 사용자에게 디스플레이하기 위한 증강정보와 현실 세계의 장면을 혼합하여 현실 세계 및 컴퓨터 생성 데이터를 결합한 것에 초점을 맞출 수 있다. 이러한 AR의 범위는 광고, 내비게이션, 오락 등과 같은 광범위한 애플리케이션 영역으로 확장되어 제공되고 있다.Augmented Reality (AR) can focus on combining real-world and computer-generated data by mixing real-world scenes with augmented information for display to the user in real time. This range of AR is being extended to a wide range of application areas such as advertising, navigation and entertainment.
증강현실(AR) 환경에서 사용자는 인공적 또는 가상적 그래픽스를 사용자 주변의 실제 자연환경들과 통합하여 볼 수 있다. 예를 들어 사용자는 증강현실 고글 등을 통해 사용자 주변의 실제 자연환경들 내부에 임의적으로 디스플레이된 그래픽스를 볼 수 있다.In augmented reality (AR) environments, the user can integrate artificial or virtual graphics with the natural surroundings of the user. For example, a user may view graphics arbitrarily displayed inside real natural environments around the user through augmented reality goggles.
그러나 일반적으로 제공되고 있는 증강현실(AR)은 고글이나 화면을 구비한 전자기기 등을 통해 사용자의 시각에 의존한 증강현실을 제공하고 있다. 이에 따라 종래의 증강현실은 사용자의 몰입도가 감소하게 되고 다양한 증강현실 콘텐츠를 활용하는데 한계가 있다.However, augmented reality (AR), which is generally provided, provides augmented reality depending on the user's vision through an electronic device equipped with goggles or a screen. Accordingly, the conventional augmented reality is reduced in the user's immersion degree and there is a limit to utilizing a variety of augmented reality content.
(선행기술문헌)(Prior art document)
(특허문헌 1) 대한민국 공개특허공보 제10-2016-0068827호(2016.06.15.)(Patent Document 1) Republic of Korea Patent Publication No. 10-2016-0068827 (2016.06.15.)
(특허문헌 2) 대한민국 공개특허공보 제10-2016-0068837호(2016.06.15.)(Patent Document 2) Republic of Korea Patent Publication No. 10-2016-0068837 (2016.06.15.)
본 발명은 전술한 문제점을 해결하기 위한 것으로서, 증강현실 또는 가상현실을 구현할 수 있는 스마트 기기와 사용자로부터 취득한 동작정보, 명령정보를 스마트 기기로 전달하고 스마트 기기로부터 정보를 수신하여 해당 정보를 다양한 방법으로 표현할 수 있는 사용자 디바이스를 통해 증강현실이나 가상현실의 재미와 몰입도를 높일 수 있는 증강현실 또는 가상현실 시스템을 제공하는데 그 목적이 있다.The present invention is to solve the above-mentioned problems, the smart device capable of realizing augmented reality or virtual reality and the operation information, command information obtained from the user to pass the smart device to receive the information from the smart device to receive the information in various ways Its purpose is to provide an augmented reality or virtual reality system that can increase the fun and immersion of augmented reality or virtual reality through a user device that can be represented by.
상기 목적을 달성하기 위한 본 발명의 증강현실 또는 가상현실 시스템은, 증강현실 또는 가상현실을 구현할 수 있는 스마트 기기; 및 사용자의 동작정보 또는 명령정보를 취득하여 상기 스마트 기기로 전달하고, 상기 스마트 기기로부터 정보를 수신하여 표현하는 사용자 디바이스로 이루어진다.Augmented reality or virtual reality system of the present invention for achieving the above object, a smart device that can implement augmented reality or virtual reality; And a user device which acquires and transmits operation information or command information of the user to the smart device and receives and expresses information from the smart device.
그리고 상기 스마트 기기는, 가상 이미지를 생성하는 이미지 생성부와, 상기 가상 이미지를 표시하는 디스플레이부와, 상기 사용자 디바이스로부터 상기 동작정보 또는 명령정보를 수신하는 제1 통신부와, 상기 동작정보 또는 명령정보에 따라 상기 증강현실 또는 가상현실 내에서 상기 가상 이미지의 위치 또는 동작을 결정하는 이미지 처리부를 포함한다.The smart device may include an image generation unit for generating a virtual image, a display unit for displaying the virtual image, a first communication unit for receiving the operation information or command information from the user device, and the operation information or command information. The image processing unit may determine a position or an operation of the virtual image in the augmented reality or virtual reality.
그리고 상기 사용자 디바이스는 사용자에 의한 상기 사용자 디바이스의 위치변화 또는 자세변화 또는 동작 중 어느 하나 이상을 감지하는 센서부를 포함하고, 상기 동작정보는 상기 사용자 디바이스의 위치변화 또는 자세변화 또는 동작에 의해 발생한다.The user device may include a sensor unit configured to detect any one or more of a position change, a posture change or an operation of the user device by the user, and the operation information may be generated by a position change or a posture change or an operation of the user device. .
또한, 상기 사용자 디바이스는, 상기 스마트 기기로부터 전달되는 상기 정보를 수신하는 제2 통신부와, 상기 제2 통신부를 통해 수신되는 상기 정보에 따라 소리, 빛, 진동 중 어느 하나 이상을 발생시키는 출력부를 포함한다.In addition, the user device includes a second communication unit for receiving the information transmitted from the smart device, and an output unit for generating any one or more of sound, light, vibration in accordance with the information received through the second communication unit. do.
또한, 상기 사용자 디바이스는 충전 가능한 2차 전지를 포함하고, 상기 스마트 기기를 포함하는 휴대단말기와 연결되어 상기 휴대단말기를 충전시킨다.In addition, the user device includes a rechargeable secondary battery and is connected to a mobile terminal including the smart device to charge the mobile terminal.
본 발명의 증강현실 또는 가상현실 시스템은, 사용자 디바이스를 통해 사용자의 동작정보, 명령정보를 취득하여 스마트 기기로 전달하고 스마트 기기로부터 정보를 수신하여 빛, 소리, 진동 등을 발생시킴으로써 증강현실 또는 가상현실의 몰입도와 재미를 증가시킬 수 있다.Augmented reality or virtual reality system of the present invention, by obtaining the user's motion information and command information through the user device to the smart device and receiving information from the smart device to generate light, sound, vibration, etc. It can increase the immersion and fun of reality.
도 1은 본 발명의 실시예에 따른 증강현실 또는 가상현실 시스템을 개략적으로 나타낸 도면.1 is a view schematically showing an augmented reality or virtual reality system according to an embodiment of the present invention.
도 2는 본 발명에 따른 증강현실 또는 가상현실 시스템의 구체적인 일 실시예를 나타낸 도면.2 is a view showing a specific embodiment of the augmented reality or virtual reality system according to the present invention.
도 3은 본 발명의 실시예에 따른 증강현실 또는 가상현실 시스템의 사용자 디바이스를 통해 구현되는 동작형태를 예시한 도면.3 is a diagram illustrating an operation form implemented through a user device of an augmented reality or virtual reality system according to an embodiment of the present invention.
도 4는 본 발명의 다른 실시예에 따른 증강현실 또는 가상현실 시스템의 구체적인 실시예를 나타낸 도면.Figure 4 is a view showing a specific embodiment of the augmented reality or virtual reality system according to another embodiment of the present invention.
본 발명의 실시예에 따른 증강현실 또는 가상현실 시스템은 도 1 내지 도 3에 도시된 바와 같이, 스마트 기기(100)와 사용자 디바이스(200)로 이루어진다. 이러한 증강현실 또는 가상현실 시스템은 게임, 관광, 의료, 국방 등 다양한 분야에 활용할 수 있다.Augmented reality or virtual reality system according to an embodiment of the present invention, as shown in Figures 1 to 3, consists of a smart device 100 and the user device 200. The augmented reality or virtual reality system can be used in a variety of fields, such as games, tourism, medical care, defense.
스마트 기기(100)는 스마트폰, 태블릿PC와 같은 휴대단말기, 증강현실 또는 가상현실 전용 기기, 각종 스마트 웨어러블 기기 등이 될 수 있다.The smart device 100 may be a mobile terminal such as a smartphone or a tablet PC, a device for augmented reality or virtual reality, various smart wearable devices, or the like.
도 1에 도시된 바와 같이 증강현실 또는 가상현실을 구현하기 위한 스마트 기기(100)는 기본적으로, 가상 이미지를 생성하는 이미지 생성부와, 상기 가상 이미지를 표시하는 디스플레이부와, 사용자 디바이스로부터 동작정보 또는 명령정보를 수신하고 사용자 디바이스로 특정 정보를 송신하는 제1 통신부와, 상기 동작정보, 명령정보에 따라 증강현실 또는 가상현실 내에서 상기 가상 이미지의 위치 또는 동작을 결정하는 이미지 처리부를 포함하고 있다.As shown in FIG. 1, the smart device 100 for implementing augmented reality or virtual reality basically includes an image generation unit for generating a virtual image, a display unit for displaying the virtual image, and operation information from a user device. Or a first communication unit for receiving command information and transmitting specific information to a user device, and an image processing unit for determining the position or operation of the virtual image in augmented reality or virtual reality according to the operation information and the command information. .
사용자 디바이스(200)는 스마트 기기(100)와 유선 또는 무선으로 연결되어 증강현실 또는 가상현실 내의 환경변화를 일으킬 수 있으며, 도 2에 도시된 바와 같이 사용자가 한 손으로 파지할 수 있고 휴대할 수 있는 크기 및 형상으로 형성될 수 있다.The user device 200 may be connected to the smart device 100 by wire or wirelessly to cause an environment change in augmented reality or virtual reality, and as shown in FIG. 2, the user may hold and hold it with one hand. It can be formed in a size and shape.
이러한 사용자 디바이스(200)는 도 1에 도시된 바와 같이 센서부, 제2 통신부, 출력부 및 제어부를 포함한다. 또한, 사용자 디바이스는 센서부, 제2 통신부, 출력부 및 제어부에 전원을 공급하기 위하여 배터리(미도시)를 포함할 수도 있다.The user device 200 includes a sensor unit, a second communication unit, an output unit, and a control unit as shown in FIG. 1. In addition, the user device may include a battery (not shown) to supply power to the sensor unit, the second communication unit, the output unit, and the control unit.
센서부는 사용자 디바이스(200)의 내부에 설치되어 사용자 디바이스(200)의 위치변화 또는 자세변화 또는 동작을 감지한다. 이러한 사용자 디바이스(200)의 위치변화, 자세변화 및 동작의 구현은 사용자 디바이스(200)를 파지하고 있는 사용자에 의해 이루어진다. 구체적으로 사용자 디바이스(200)의 위치변화는 상하방향 이동, 수평방향 이동 등이 될 수 있고, 사용자 디바이스(200)의 자세변화는 사용자 디바이스(200)의 위치이동 없이 방향, 기울기 등의 변화가 될 수 있다. 그리고 사용자 디바이스(200)를 이용하여 구현할 수 있는 동작은 제어부에 미리 저장되며, 도 3에 도시된 바와 같은 직선 운동, 포물선 운동, 원 운동 중 어느 하나가 될 수 있다. 이러한 사용자 디바이스(200)의 위치변화, 자세변화 또는 동작의 구현을 감지하기 위하여, 센서부는 가속도 센서, 자이로 센서, 지자기 센서 중 어느 하나 이상을 포함한다. 또한, 센서부는 상기의 센서 외에 다양한 다른 종류의 센서를 더 포함할 수도 있다.The sensor unit is installed inside the user device 200 to detect a position change or posture change or motion of the user device 200. The change of position, posture change and operation of the user device 200 are implemented by the user holding the user device 200. In detail, the position change of the user device 200 may be a vertical movement, a horizontal movement, and the like, and the posture change of the user device 200 may be a change in direction, inclination, etc. without moving the position of the user device 200. Can be. In addition, an operation that may be implemented using the user device 200 may be previously stored in the controller, and may be any one of a linear motion, a parabolic motion, and a circular motion as shown in FIG. 3. In order to detect a change in position, posture, or movement of the user device 200, the sensor unit may include any one or more of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. In addition, the sensor unit may further include various other types of sensors in addition to the above sensors.
제2 통신부는 사용자 디바이스(200)의 내부에 설치되고 스마트 기기(100)와 통신하기 위한 장치이다. 이러한 제2 통신부는 스마트 기기(100)에 의해 구현되는 증강현실 또는 가상현실 내의 환경변화에 따라 스마트 기기(100)로부터 특정 정보를 수신하거나, 사용자 디바이스(200)의 위치변화, 자세변화 또는 동작의 구현에 따른 동작정보 또는 명령정보를 스마트 기기(100)로 전달한다.The second communication unit is an apparatus installed in the user device 200 and communicates with the smart device 100. The second communication unit receives specific information from the smart device 100 according to an environment change in augmented reality or virtual reality implemented by the smart device 100, or changes in position, posture change or operation of the user device 200. The operation information or command information according to the implementation is transmitted to the smart device 100.
제1 통신부와 제2 통신부는 블루투스, 와이파이 등 다양한 무선 통신수단을 이용할 수 있다. 또한, 스마트 기기(100)와 사용자 디바이스(200)는 유선으로 연결될 수도 있다.The first communication unit and the second communication unit may use various wireless communication means such as Bluetooth and Wi-Fi. In addition, the smart device 100 and the user device 200 may be connected by wire.
증강현실 또는 가상현실 내의 환경변화란 증강현실 또는 가상현실에 맞는 이벤트 발생, 특정 행위 및 임무 수행, 목적/목표 달성의 성패 등이 될 수 있고, 스마트 기기(100)로부터 사용자 디바이스(200)로 전달되는 정보는 증강현실 또는 가상현실 내의 다양한 환경변화에 대응되는 복수의 신호 중 어느 하나의 신호가 될 수 있다. 그리고 동작정보, 명령정보는 센서부에 의해 감지된 사용자 디바이스(200)의 위치변화, 자세변화 또는 특정 동작에 대응되는 신호이며, 제2 통신부를 통해 스마트 기기(100)로 전달되어 증강현실 또는 가상현실 내의 환경변화를 일으킬 수 있다.Environment change in augmented reality or virtual reality may be the occurrence of events that fit augmented reality or virtual reality, the performance of specific actions and tasks, the success or failure of the purpose / goal, and transfer from the smart device 100 to the user device 200 The information may be any one of a plurality of signals corresponding to various environmental changes in augmented reality or virtual reality. In addition, the operation information and the command information are signals corresponding to a position change, posture change or a specific operation of the user device 200 detected by the sensor unit, and are transmitted to the smart device 100 through the second communication unit to be augmented reality or virtual. It can cause environmental changes in reality.
출력부는 사용자 디바이스(200)의 내부에 설치되어 소리, 빛, 진동을 발생시킬 수 있다. 이러한 출력부는 스피커, LED램프, 진동모듈 중 어느 하나가 될 수 있다. 구체적으로 출력부는 스마트 기기(100)로부터 특정 정보가 수신되면 소리, 빛, 진동을 발생시키거나 사용자 디바이스(200)의 위치변화, 자세변화 또는 동작의 구현에 따라 소리, 빛, 진동을 발생시킬 수 있다. 또한, 출력부는 전술한 스피커, LED램프, 진동모듈을 모두 구비하거나 이 중 복수의 일부를 구비할 수 있다. 이에 따라 소리, 빛, 진동 중 어느 하나를 발생시키거나 소리, 빛, 진동 중 둘 이상을 동시에 발생시킬 수 있다.The output unit may be installed inside the user device 200 to generate sound, light, and vibration. Such an output unit may be any one of a speaker, an LED lamp, and a vibration module. In detail, the output unit may generate sound, light, or vibration when specific information is received from the smart device 100, or may generate sound, light, or vibration according to a position change, posture change, or motion of the user device 200. have. In addition, the output unit may include all of the above-described speaker, LED lamp, vibration module or a plurality of parts thereof. Accordingly, any one of sound, light, and vibration may be generated, or two or more of sound, light, and vibration may be simultaneously generated.
먼저, 제2 통신부를 통해 스마트 기기(100)로부터 특정 정보가 수신되면 출력부는 소리, 빛 또는 진동을 발생시킴으로써 사용자에게 증강현실 또는 가상현실에서 이벤트가 발생하거나 목적/목표 달성의 성패에 대한 정보를 제공한다. 그리고 출력부는 스마트 기기(100)로부터 전달되는 다양한 정보에 따라 소리, 빛, 진동의 강약, 발생 패턴 등을 달리하여 사용자가 각각의 신호를 구별할 수 있게 함으로써 증강현실 또는 가상현실에서 발생한 환경변화의 종류를 인지할 수 있다.First, when specific information is received from the smart device 100 through the second communication unit, the output unit generates sound, light, or vibration to inform the user of an event in augmented reality or virtual reality or the success or failure of achieving an objective / goal. to provide. In addition, the output unit may change the intensity of the sound, light, vibration, and pattern according to various information transmitted from the smart device 100 to allow the user to distinguish each signal, thereby allowing the user to distinguish between environmental changes generated in augmented reality or virtual reality. You can recognize the kind.
또한, 출력부는 사용자 디바이스(200)의 동작에 따라 진동의 세기, 주기 등이 다른 진동을 발생시켜 사용자가 의도한 동작이 맞는지 확인할 수도 있다.In addition, the output unit may generate different vibrations according to the operation of the user device 200 to determine whether the user intended motion is correct.
제어부는 사용자 디바이스(200)의 내부에 설치되어 제2 통신부 및 출력부를 작동시킨다.The controller is installed inside the user device 200 to operate the second communication unit and the output unit.
한편, 본 발명의 실시예에 따른 사용자 디바이스(200)는 전술한 바와 같이 배터리를 포함하며, 배터리는 충전 가능한 2차 전지이다. 그리고 도 4(a)에 도시된 바와 같이 사용자 디바이스(200)는 사용자의 손목에 찰 수 있는 형태로 이루어질 수 있다. 또한, 사용자 디바이스(200)는 사용자의 신체, 옷 등 다양한 부위에 고정될 수도 있다.Meanwhile, the user device 200 according to the embodiment of the present invention includes a battery as described above, and the battery is a rechargeable secondary battery. As illustrated in FIG. 4A, the user device 200 may be formed to be worn on a user's wrist. In addition, the user device 200 may be fixed to various parts of the user's body, clothes, and the like.
이러한 사용자 디바이스(200)는 도 4(b)에 도시된 바와 같이 다양한 종류의 스마트 기기(100)와 충전 케이블로 연결되어 스마트 기기(100)를 충전시키기 위한 보조 배터리로 이용될 수 있다. 그리고 사용자 디바이스(200)는 상술한 스마트 기기(100) 외에도 다른 일반적인 휴대단말기와 연결되어 상호 연결된 휴대단말기를 충전시킬 수도 있다.As shown in FIG. 4B, the user device 200 may be connected to various types of smart devices 100 by a charging cable and used as an auxiliary battery for charging the smart devices 100. In addition to the above-described smart device 100, the user device 200 may be connected to other general portable terminals to charge the connected portable terminals.
다음은 본 발명의 실시예에 따른 증강현실 또는 가상현실 시스템의 이용방법에 대하여 설명한다.Next, a method of using an augmented reality or virtual reality system according to an embodiment of the present invention will be described.
상술한 바와 같이 본 발명의 실시예에 따른 사용자 디바이스(200)는 스마트 기기(100)와 연동하는 것으로서, 사용자는 사용자 디바이스(200)를 이동시키거나 특정 동작을 수행함으로써 증강현실 또는 가상현실 내의 환경변화를 일으킬 수 있다. 즉 사용자 디바이스(200)를 상하방향이나 수평방향으로 이동시키거나 사용자 디바이스(200)의 자세를 변경할 수 있고, 직선 운동, 포물선 운동, 원 운동, 회전 운동 등의 동작을 구현할 수 있다. 이러한 사용자 디바이스(200)의 위치변화, 자세변화 또는 동작의 구현에 따라 특정 명령정보 또는 동작정보가 발생하고, 해당 명령정보나 동작정보는 제2 통신부와 제1 통싱부를 통해 스마트 기기(100)로 전달되어 증강현실 또는 가상현실 내에서 임무 수행이나 특정 행위를 위한 명령이 된다.As described above, the user device 200 according to an exemplary embodiment of the present invention is linked with the smart device 100, and the user moves the user device 200 or performs a specific operation to create an environment in augmented reality or virtual reality. It can cause a change. That is, the user device 200 may be moved in the vertical direction or the horizontal direction, or the posture of the user device 200 may be changed, and motions such as linear motion, parabolic motion, circular motion, and rotation motion may be implemented. Specific command information or motion information is generated according to the position change, posture change, or motion of the user device 200, and the command information or motion information is transmitted to the smart device 100 through the second communication unit and the first communication unit. It is delivered and becomes an order for a task or a specific action in augmented or virtual reality.
사용자 디바이스(200)로부터 명령정보나 동작정보를 수신하여 스마트 기기(100)에서 구현되는 증강현실 또는 가상현실 내에서 임무수행, 목적/목표 달성의 성패가 결정되면 스마트 기기(100)에서 특정 환경변화 상황에 해당하는 정보가 발생하고, 제1 통신부와 제2 통신부를 통해 사용자 디바이스(200)로 상기 정보가 전달되면 제어부는 상기 정보에 따라 출력부를 작동시켜 특정 세기 및 패턴의 소리, 빛 또는 진동을 발생시킨다. 이에 따라 사용자 디바이스(200)를 파지하고 있는 사용자는 증강현실 또는 가상현실 내의 이벤트 발생이나 목적/목표 달성의 성패를 확인할 수 있다.Receiving command information or operation information from the user device 200 and determining the success or failure of the task performance or the purpose / objective achievement in the augmented reality or virtual reality implemented in the smart device 100, the specific environment change in the smart device 100 When information corresponding to a situation occurs and the information is transmitted to the user device 200 through the first communication unit and the second communication unit, the controller operates an output unit according to the information to generate sound, light or vibration of a specific intensity and pattern. Generate. Accordingly, the user holding the user device 200 may check whether the event occurred in the augmented reality or the virtual reality or the success or failure of the purpose / objective achievement.
또는, 사용자에 의해 구현되는 사용자 디바이스(200)의 직선 운동, 포물선 운동, 원 운동, 회전 운동은 센서부와 제어부에 의해 감지 및 판별되고 출력부는 각 동작에 따라 소리, 빛, 진동 중 어느 하나 이상을 발생시켜 사용자가 구현된 동작을 확인할 수 있다. 또는, 사용자가 구현해야 할 특정 동작이 제대로 구현되었는지 판단하여 해당 동작의 구현 유무를 판별하는 소리 또는 빛 또는 진동을 발생시킬 수도 있다.Alternatively, the linear motion, the parabolic motion, the circular motion, and the rotary motion of the user device 200 implemented by the user may be detected and determined by the sensor part and the controller, and the output part may be one or more of sound, light, and vibration according to each motion. You can check the implementation by the user. Alternatively, it may be determined whether a specific operation to be implemented by a user is properly implemented to generate sound, light, or vibration that determines whether the corresponding operation is implemented.
이와 같이 본 발명의 실시예에 따른 증강현실 또는 가상현실 시스템은, 사용자 디바이스(200)의 위치변화, 자세변화 및 특정 동작에 의해 간편하게 증강현실 또는 가상현실 내의 환경변화를 일으킬 수 있고 사용자에게 특정 정보에 의한 빛, 소리, 진동 등의 신호를 제공하여 증강현실 또는 가상현실의 몰입도와 재미를 증가시킬 수 있다.As described above, the augmented reality or virtual reality system according to an exemplary embodiment of the present invention may easily cause an environment change in augmented reality or virtual reality by changing a position, a posture, and a specific operation of the user device 200 and may provide specific information to the user. By providing signals such as light, sound, and vibration by the immersion and fun of augmented reality or virtual reality can be increased.
본 발명에 따른 증강현실 또는 가상현실 시스템은 전술한 실시예에 국한되지 않고 본 발명의 기술사상이 허용되는 범위 내에서 다양하게 변형하여 실시할 수 있다.Augmented reality or virtual reality system according to the present invention is not limited to the above-described embodiment can be implemented in various modifications within the scope of the technical idea of the present invention.

Claims (5)

  1. 증강현실 또는 가상현실을 구현할 수 있는 스마트 기기; 및Smart devices capable of implementing augmented reality or virtual reality; And
    사용자의 동작정보 또는 명령정보를 취득하여 상기 스마트 기기로 전달하고, 상기 스마트 기기로부터 정보를 수신하여 표현하는 사용자 디바이스로 이루어지는 것을 특징으로 하는 증강현실 또는 가상현실 시스템.An augmented reality or virtual reality system comprising a user device for acquiring a user's operation information or command information and transmitting it to the smart device, and receiving and expressing information from the smart device.
  2. 청구항 1에 있어서,The method according to claim 1,
    상기 스마트 기기는,The smart device,
    가상 이미지를 생성하는 이미지 생성부와,An image generator which generates a virtual image,
    상기 가상 이미지를 표시하는 디스플레이부와,A display unit which displays the virtual image;
    상기 사용자 디바이스로부터 상기 동작정보 또는 명령정보를 수신하는 제1 통신부와,A first communication unit which receives the operation information or command information from the user device;
    상기 동작정보 또는 명령정보에 따라 상기 증강현실 또는 가상현실 내에서 상기 가상 이미지의 위치 또는 동작을 결정하는 이미지 처리부를 포함하는 것을 특징으로 하는 증강현실 또는 가상현실 시스템.An augmented reality or virtual reality system characterized in that it comprises an image processing unit for determining the position or operation of the virtual image in the augmented reality or virtual reality in accordance with the motion information or command information.
  3. 청구항 1에 있어서,The method according to claim 1,
    상기 사용자 디바이스는 사용자에 의한 상기 사용자 디바이스의 위치변화 또는 자세변화 또는 동작 중 어느 하나 이상을 감지하는 센서부를 포함하고,The user device includes a sensor unit for detecting any one or more of the change in position or attitude of the user device by the user or the operation,
    상기 동작정보는 상기 사용자 디바이스의 위치변화 또는 자세변화 또는 동작에 의해 발생하는 것을 특징으로 하는 증강현실 또는 가상현실 시스템.The motion information is augmented reality or virtual reality system, characterized in that generated by the position change or posture change or operation of the user device.
  4. 청구항 1에 있어서,The method according to claim 1,
    상기 사용자 디바이스는,The user device,
    상기 스마트 기기로부터 전달되는 상기 정보를 수신하는 제2 통신부와,A second communication unit which receives the information transmitted from the smart device;
    상기 제2 통신부를 통해 수신되는 상기 정보에 따라 소리, 빛, 진동 중 어느 하나 이상을 발생시키는 출력부를 포함하는 것을 특징으로 하는 증강현실 또는 가상현실 시스템.Augmented reality or virtual reality system comprising an output unit for generating any one or more of sound, light, vibration in accordance with the information received through the second communication unit.
  5. 청구항 1에 있어서,The method according to claim 1,
    상기 사용자 디바이스는 충전 가능한 2차 전지를 포함하고, 상기 스마트 기기를 포함하는 휴대단말기와 연결되어 상기 휴대단말기를 충전시키는 것을 특징으로 하는 증강현실 또는 가상현실 시스템.The user device includes a rechargeable secondary battery, connected to a portable terminal including the smart device, augmented reality or virtual reality system, characterized in that for charging the portable terminal.
PCT/KR2017/008093 2016-09-05 2017-07-27 Augmented reality or virtual reality system WO2018043920A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020160113856A KR20180026919A (en) 2016-09-05 2016-09-05 System for augmented reality or virtual reality
KR10-2016-0113856 2016-09-05

Publications (1)

Publication Number Publication Date
WO2018043920A1 true WO2018043920A1 (en) 2018-03-08

Family

ID=61300995

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/008093 WO2018043920A1 (en) 2016-09-05 2017-07-27 Augmented reality or virtual reality system

Country Status (2)

Country Link
KR (1) KR20180026919A (en)
WO (1) WO2018043920A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102118788B1 (en) * 2018-04-05 2020-06-03 전자부품연구원 Augmented Reality Companion Content Service System and Method
KR102194008B1 (en) 2018-05-24 2020-12-22 시크릿타운 주식회사 Method for providing augmented reality contents based on image of goods
KR102079395B1 (en) 2018-05-24 2020-02-19 시크릿타운 주식회사 Method for providing augmented reality contents based on location

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130034844A (en) * 2011-09-29 2013-04-08 (주)파이네트웍스 Virtual golf simulation device and its simulation method
KR20140011688A (en) * 2012-07-18 2014-01-29 주식회사 도담시스템스 Virtual reality simulation apparatus and method using motion capture technology and
US20150182855A1 (en) * 2013-12-27 2015-07-02 Ballcraft, Llc Motion detection for existing portable devices
US20150258432A1 (en) * 2014-03-14 2015-09-17 Sony Computer Entertainment Inc. Gaming device with volumetric sensing
WO2016089442A1 (en) * 2014-12-06 2016-06-09 Horsemoon Llc Hand gesture recognition system for controlling electronically controlled devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130034844A (en) * 2011-09-29 2013-04-08 (주)파이네트웍스 Virtual golf simulation device and its simulation method
KR20140011688A (en) * 2012-07-18 2014-01-29 주식회사 도담시스템스 Virtual reality simulation apparatus and method using motion capture technology and
US20150182855A1 (en) * 2013-12-27 2015-07-02 Ballcraft, Llc Motion detection for existing portable devices
US20150258432A1 (en) * 2014-03-14 2015-09-17 Sony Computer Entertainment Inc. Gaming device with volumetric sensing
WO2016089442A1 (en) * 2014-12-06 2016-06-09 Horsemoon Llc Hand gesture recognition system for controlling electronically controlled devices

Also Published As

Publication number Publication date
KR20180026919A (en) 2018-03-14

Similar Documents

Publication Publication Date Title
CN108717733B (en) View angle switch method, equipment and the storage medium of virtual environment
US9939913B2 (en) Smart home control using modular sensing device
CN110755841B (en) Method, device and equipment for switching props in virtual environment and readable storage medium
JP2021520978A (en) A method for controlling the interaction between a virtual object and a thrown object, its device, and a computer program.
CN108671543A (en) Labelled element display methods, computer equipment and storage medium in virtual scene
CN110045827B (en) Method and device for observing virtual article in virtual environment and readable storage medium
JP6523233B2 (en) Information processing method, apparatus, and program for causing a computer to execute the information processing method
CN109634413B (en) Method, device and storage medium for observing virtual environment
CN110917616B (en) Orientation prompting method, device, equipment and storage medium in virtual scene
WO2018043920A1 (en) Augmented reality or virtual reality system
CN103620527A (en) Headset computer that uses motion and voice commands to control information display and remote devices
CN103324309A (en) Wearable computer
JP6368411B1 (en) Method, program and computer executed on a computer to provide a virtual experience
KR20140011688A (en) Virtual reality simulation apparatus and method using motion capture technology and
CN105388994A (en) Wearable watch and display method thereof
CN110825333B (en) Display method, display device, terminal equipment and storage medium
CN113223129B (en) Image rendering method, electronic equipment and system
CN108744511B (en) Method, device and storage medium for displaying sighting telescope in virtual environment
CN111026318A (en) Animation playing method, device and equipment based on virtual environment and storage medium
CN112204503A (en) Electronic device and method for displaying object associated with external electronic device based on position and movement of external electronic device
WO2018034412A1 (en) Haptic device linked with augmented reality or virtual reality implementation device
JP6227732B1 (en) Method and apparatus for supporting input in virtual space, and program causing computer to execute the method
CN109806583B (en) User interface display method, device, equipment and system
WO2017061890A1 (en) Wireless full body motion control sensor
CN112604302B (en) Interaction method, device, equipment and storage medium of virtual object in virtual environment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17846845

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 04.07.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17846845

Country of ref document: EP

Kind code of ref document: A1