KR101954338B1 - Electric device for providing an augmented reality content, band device thereof and content providing system thereof - Google Patents

Electric device for providing an augmented reality content, band device thereof and content providing system thereof Download PDF

Info

Publication number
KR101954338B1
KR101954338B1 KR1020170073329A KR20170073329A KR101954338B1 KR 101954338 B1 KR101954338 B1 KR 101954338B1 KR 1020170073329 A KR1020170073329 A KR 1020170073329A KR 20170073329 A KR20170073329 A KR 20170073329A KR 101954338 B1 KR101954338 B1 KR 101954338B1
Authority
KR
South Korea
Prior art keywords
augmented reality
user
band
reality contents
information
Prior art date
Application number
KR1020170073329A
Other languages
Korean (ko)
Other versions
KR20180135336A (en
Inventor
전용덕
김동섭
Original Assignee
(주) 씽크브릿지
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주) 씽크브릿지 filed Critical (주) 씽크브릿지
Priority to KR1020170073329A priority Critical patent/KR101954338B1/en
Priority to PCT/KR2017/006709 priority patent/WO2018230760A1/en
Publication of KR20180135336A publication Critical patent/KR20180135336A/en
Application granted granted Critical
Publication of KR101954338B1 publication Critical patent/KR101954338B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H04B1/385—Transceivers carried on the body, e.g. in helmets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/029—Location-based management or tracking services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H04B1/385—Transceivers carried on the body, e.g. in helmets
    • H04B2001/3861—Transceivers carried on the body, e.g. in helmets carried in a hand or on fingers

Abstract

The present invention provides a content providing system for providing augmented reality contents using a band device in an experience space, comprising: an electronic device configured to provide augmented reality contents in the experience space; And a plurality of band devices for transmitting user information associated with the augmented reality content to an electronic device, wherein the electronic device receives user information from at least one of a plurality of band devices located within the experience space, And generates the augmented reality contents provided in the experience space based on the user information.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic device, a band device, and a content providing system for providing augmented reality contents.

The present invention relates to an electronic device, a band device, and a content providing system for providing augmented reality contents.

Conventional exhibits are kept at a certain distance from the viewers, and are produced in such a form that visitors visually observe the exhibits. However, in recent years, there has been an attempt to provide not only a visual form but also various forms of communication between the exhibit and the viewer. As a part of such an attempt, there is an experience space in which exhibits are provided in a form in which augmented reality contents can be communicated with visitors.

On the other hand, due to the change in the experience space, the necessity of providing existing exhibits and providing other types of exhibits is increasing. In accordance with this trend, the present invention proposes a contents providing system capable of effectively providing exhibits in accordance with a new experience space.

An object of the present invention is to provide augmented reality contents to a visitor located in an experience space.

It is another object of the present invention to provide augmented reality contents capable of mutual interaction between visitors located in an experience space.

Another object of the present invention is to provide augmented reality contents reflecting a body index of a visitor located in an experience space for safe experience viewing.

The electronic device according to the present invention includes a communication unit configured to communicate with a band device worn on the wrist of a user located in a experiencing space, a camera installed in the experience space and configured to photograph a user wearing the band device, And a display unit for receiving the user information related to the augmented reality contents, generating augmented reality content based on the received user information and the captured user image, and a display unit for outputting the augmented reality contents.

In one embodiment, the control unit determines the specific item image among the plurality of previously stored item images based on the received user information, and displays the selected item image on the display unit, And generates the augmented reality contents by synthesizing the captured user image and the specific item image.

In one embodiment, the control unit controls the output of the augmented reality contents by reflecting the motion information of the user.

According to an embodiment of the present invention, there is further provided a beacon signal unit capable of transmitting / receiving a beacon signal to / from the band device, wherein a plurality of display units are spaced apart from each other in the experience space, And outputs the generated augmented reality contents to a display unit provided at a position closest to the detected one of the plurality of display units.

In one embodiment, the user information includes at least one of character information related to the augmented reality contents, information related to the user's body, and history information related to the augmented reality contents.

In one embodiment, the band device transmits a control signal indicating the occurrence of the event when the occurrence of an event in contact with another band device of the user is detected, and the control section transmits a control signal And generates new augmented reality contents based on the new augmented reality contents.

In one embodiment, the controller assigns different control rights to the different augmented reality contents to the different band devices.

In one embodiment, the controller sets a function executable by the user in the augmented reality contents based on the number of band devices worn on the wrist of the user.

In one embodiment, when the notification signal indicating that a plurality of band devices are worn on the wrist of the user is received, the control unit controls the touch of the user to change the visual appearance of the generated augmented reality contents based on the received notification signal. And controls the screen.

In one embodiment, the controller is configured to receive body information from the band device that measures a user's body index, and adjust an activity index of the generated augmented reality content based on the received body information .

A band device according to the present invention includes a body formed to be worn on a part of a user's body and a communication part performing communication with the external device, a sensing part for sensing whether the body and part of the user's body are worn, And a control unit for executing the augmented reality mode when it is worn on a part of the augmented reality mode and transmitting user information related to the augmented reality contents to the connected electronic device in the augmented reality mode.

In one embodiment, the apparatus further includes a body measurement unit positioned to contact a body part of the user in contact with the body, the body measurement unit measuring the user's body information, and the controller may measure the body information measured through the body measurement unit, And transmits the data to the device in real time.

In one embodiment, the user's body information is at least one of pulse information, respiration information, and oxygen saturation.

In one embodiment, the communication unit receives user information from a band device worn by another user existing within a predetermined radius, and the control unit generates a new augmented reality based on the user information of the band device worn by the other user And transmits a control signal for content creation to the electronic device.

A content providing system for providing augmented reality contents using a band device in an experience space, the content providing system comprising: an electronic device formed to provide augmented reality contents in the experience space; And a plurality of band devices for transmitting user information related to the real contents to the electronic device, wherein the electronic device receives user information from at least one of a plurality of band devices located in the experience space, And generates the augmented reality contents provided in the experience space on the basis of the generated augmented reality contents.

According to the present invention, the user information is received from a band device worn on the wrist of a visitor located in the experience space, and the augmented reality contents are generated and provided based on the received user information, thereby providing a lively experience space to the viewer.

In addition, the present invention provides augmented reality contents on the basis of mutual actions among viewers located in the experience space, thereby inducing activities among viewers located in the experience space and providing new experiences to the visitors .

In addition, the present invention can provide a realistic experience space by providing the augmented reality contents reflecting the body index of the visitor located in the experience space.

1 is a block diagram illustrating a configuration of a content providing system for providing augmented reality contents according to the present invention.
2A is a block diagram showing a configuration of the electronic device 100. As shown in Fig.
2B is a conceptual view showing an experience space in which an electronic device is installed.
3A is a block diagram illustrating components of a band device for transmitting and receiving information related to AR contents.
FIG. 3B is a conceptual diagram showing a band device including the components of FIG. 3A.
4 is a flowchart illustrating a method of providing an augmented reality content according to an embodiment of the present invention.
5 is a conceptual diagram illustrating the control method of FIG.
FIGS. 6 and 7 are conceptual diagrams illustrating embodiments for outputting an augmented reality image.
8 is a conceptual diagram illustrating a method of providing augmented reality contents through interaction between a plurality of users.
9A and 9B are conceptual diagrams illustrating a method of controlling the augmented reality contents according to a band device worn by the user.
10A is a conceptual diagram illustrating an example of providing an augmented reality content reflecting user's body information.
FIG. 10B is a conceptual diagram illustrating an example of transmitting body information of a child user to a parent mobile terminal.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix " module " and " part " for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The experiential space described in this specification is a space for displaying exhibits and can also be referred to as an exhibition space. The exhibit may be a traditional object, or augmented reality content, a new way.

The augmented reality contents are contents in which virtual objects are superimposed on a real environment. The augmented reality contents in the present invention may be augmented reality contents suitable for the theme of the experience space. For example, in the case of an experience space for experiencing nature, the augmented reality contents may include jungle, bird, insect, leaves, and the like. As another example, in the case of a space for experiencing a battle, the augmented reality contents may include weapons, combat uniforms, and monsters. As another example, in the case of an experiential space for experiencing an indoor environment, the augmented reality contents can be a sofa, a TV, a bed, a desk, and the like.

Such augmented reality contents can be changed according to the theme of the experience space. The provider providing the experience space can provide appropriate augmented reality contents according to the theme.

Hereinafter, a method of providing the augmented reality contents in the experience space will be described with reference to the drawings.

First, a content providing system for providing the augmented reality contents according to the present invention will be described. 1 is a block diagram illustrating a configuration of a content providing system for providing augmented reality contents according to the present invention.

Referring to FIG. 1, the content providing system may include an electronic device 100 for generating and outputting augmented reality contents, and band devices for transmitting information related to a user located in the experience space.

The content providing system transmits and receives information related to the augmented reality contents through the communication between the electronic device 100 and the band devices 200, and can provide the augmented reality contents based on the transmitted and received information.

2A is a block diagram showing a configuration of the electronic device 100. As shown in Fig. 2B is a conceptual view showing an experience space in which an electronic device is installed.

2A, the electronic device 100 may include a communication unit 110, a camera 120, a plurality of display units 130, and a control unit 140.

The communication unit 110 may include one or more modules for enabling wireless communication with band devices located in the experience space. In addition, the communication unit 110 may include one or more modules that connect the electronic device 100 to one or more networks.

The communication unit 110 may include a wireless Internet module, a short distance communication module, and a beacon signal module.

The wireless Internet module refers to a module for wireless Internet access, and may be built in or enclosed in the electronic device 100. The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), and Long Term Evolution-Advanced (LTE-A) And transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above.

The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. Such a short range communication module may support wireless communication between an electronic device and a wireless communication system, a network located between the electronic device 100 and a band device via wireless area networks. The short-range wireless communication network may be a short-range wireless personal area network.

The beacon signal module is a module for transmitting / receiving a beacon signal. Such a beacon signal module may be one of a Bluetooth low energy (BLE) module. The low-power Bluetooth communication method is a short-wave wireless transmission method of 2.4 GHz band, which uses 40 channels of 2 MHz width and uses a frequency hopping technique. This solves the existing narrowband interference problem and enables basic data transmission with low power. A beacon can be arranged for each exhibit in the experience space according to the present invention.

The camera 120 can process an image frame such as a still image or a moving image photographed inside or outside the experience space through the image sensor. For example, the camera 120 may photograph an audience located inside the experience space.

The plurality of display units 130 may be disposed apart from each other in the experience space. For example, the plurality of display units 151 may be installed on the wall and the ceiling forming the experience space. Therefore, the user located in the experience space can receive the augmented reality contents in any area where the user can see,

The plurality of display units 130 may have a mutual layer structure with a touch sensor or may be integrally formed to realize a touch screen. Such a touch screen may function as a user input to provide an input interface between the electronic device 100 and a user and may provide an output interface between the electronic device 100 and a user.

The control unit 140 may control the communication unit 110, the camera 120, and the plurality of display units 130 to provide augmented reality contents. The augmented reality contents may be a graphic image or video provided in a virtual space.

Referring to FIG. 2B, the exhibits 310a, 310b, 310c and 310d may be arranged in the experience space according to the present invention. The exhibits 310a, 310b, 310c, and 310d may be disposed at positions apart from each other in the experience space.

In addition, the display units 131a, 131b, 131c, and 131d may be installed on the wall of the experience space. The display units 131a, 131b, 131c, and 131d may have the same size as the wall surface forming the experience space. Thus, in the experiential space according to the present invention, the display units can be installed in all areas that the user's eyes reach. Therefore, the user can view the augmented reality contents through the display units 131a, 131b, 131c, and 131d in the experience space, and thus experience more vivid augmented reality contents.

In the above description, the electronic device for providing the augmented reality contents in the content providing system according to the present invention has been described. Hereinafter, a band device for transmitting and receiving information related to the augmented reality contents through communication with the electronic device will be described.

FIG. 3A is a block diagram illustrating components of a band device for transmitting and receiving information related to AR contents, and FIG. 3B is a conceptual diagram illustrating a band device.

Referring to FIG. 3A, the band device 200 may include a communication unit 210, a sensing unit 220, an input unit 230, and a control unit 240.

The communication unit 210 may include one or more modules that enable wireless communication with the electronic device. The communication unit 210 can perform communication between the electronic device 100 and the band device 200, and between the band device and another band device.

At this time, the other band device 200 performing communication with the band device 200 may be an authenticated device capable of communicating with each other. For example, the band device 200 may transmit user information related to the augmented reality contents to another band device 200, or may receive user information related to augmented reality contents from other band devices. Accordingly, the present invention can provide new augmented reality contents through information exchange between users wearing the band device 200. [ Therefore, the present invention can induce the experience of the augmented reality contents through collaboration among users.

The sensing unit 220 may sense information related to the inside or outside of the band device. For example, the sensing unit 220 may sense motion information of a band device, body information of a user wearing the band device, and information related to the external environment of the band device.

The sensing unit 220 may include a body measurement unit 221 for sensing body information of a user wearing a band device. The body measurement unit 221 may be a PPG (Photo-plethysmography) sensor for measuring the pulse, respiration, and oxygen saturation of the user wearing the band device 200, an ECG (Electrocadiograph) sensor for sensing the electrical activity of the heart have. To this end, the body measurement portion 2210 may be positioned to abut a part of the user's body.

The sensing unit 220 can measure the body information in real time or at predetermined intervals. Or the sensing unit 220 may measure the body information based on the user's request. Therefore, the present invention can provide the augmented reality contents in the form in which the user's body information is reflected.

The input unit 230 may be configured to receive a user input for controlling the band device 200. The input unit 230 may be configured to input various types of input such as a button input, a touch input, a voice input, and a gesture input. The input unit 230 may include a physical key, a touch screen, a microphone, a camera, and the like in order to input the inputs of the various input methods.

The control unit 240 may control the communication unit 210, the sensing unit 220, and the input unit 230 to operate the band device. For example, the control unit 240 may control the communication unit 210 to transmit information related to the augmented reality contents to the electronic device.

3B, the band device 200 includes a main body 201 having a display portion 251 and a band 202 connected to the main body 201 and configured to be worn on the wrist.

The main body 201 includes a case that forms an appearance. As shown, the case may include a first case 201a and a second case 201b that provide an internal space for accommodating various electronic components. However, the present invention is not limited to this, and one case may be configured as a uni-body so as to provide the internal space.

The band device 200 is configured to allow wireless communication, and the main body 201 may be provided with an antenna for the wireless communication. On the other hand, the antenna can expand its performance by using a case. For example, a case comprising a conductive material may be configured to electrically connect with the antenna to extend the ground or radiating area.

A display unit 251 may be disposed on the front surface of the main body 201 to output information and a touch sensor may be provided on the display unit 251 to implement the touch screen. The window 251a of the display unit 251 may be mounted on the first case 201a to form a front surface of the terminal body together with the first case 201a.

Although not shown, the main body 201 may include a sound output unit, a camera, a microphone, a user input unit, and the like. When the display unit 251 is implemented as a touch screen, the display unit 251 may function as a user input unit, so that the main unit 201 may not have a separate key.

The band 202 is worn on the wrist so as to surround the wrist, and may be formed of a flexible material for easy wearing. As an example, the band 202 may be formed of leather, rubber, silicone, synthetic resin, or the like. In addition, the band 202 may be detachably attached to the main body 201, and may be configured to be replaceable by various types of bands according to the user's preference.

On the other hand, the band 202 can be used to extend the performance of the antenna. For example, the band may include a ground extension (not shown) that is electrically connected to the antenna and extends the ground region.

The band 202 may be provided with a fastener 202a. The fastener 202a may be embodied by a buckle, a snap-fit hook structure, or a velcro (trademark), and may include a stretchable section or material .

In the above description, the band device worn on the user's wrist has been described, but the present invention is not limited thereto. The band device 200 of the present invention can be extended to various wearable devices that can be worn on the user's body. These wearable devices include smart watch, smart glass, and head mounted display (HMD).

The wearable device can be made to be able to exchange (or interlock) data with another mobile terminal 100. The short range communication module 114 can detect (or recognize) a wearable device capable of communicating with the mobile terminal 100.

In the above, a band device for transmitting user information related to augmented reality contents has been described in the content providing system according to the present invention.

Hereinafter, a method of providing an augmented reality contents by an electronic device according to the present invention will be described. FIG. 4 is a flowchart illustrating a method of providing an augmented reality contents according to an embodiment of the present invention, and FIG. 5 is a conceptual diagram illustrating a control method of FIG.

Referring to FIG. 4, the controller 140 of the electronic device 100 according to the present invention may receive user information related to the augmented reality contents from a band device worn on the wrist of a user located in the experience space (S410).

First, a user who intends to enter the experience space can wear a band device 200 including user information related to the augmented reality contents.

The control unit 240 of the band device 200 can execute the augmented reality mode when the user wears it. The augmented reality mode is a mode capable of executing functions related to augmented reality contents.

Alternatively, the controller 240 can execute the augmented reality mode when the user enters the experience space. The entry or exit of the user in the experience space can be judged through the electronic device 100. The electronic device 100 may transmit a control signal indicating the entry or exit of the user to the band device 200 when a user's entry or exit is detected. Accordingly, when the control unit 240 receives the control signal indicating the user's position, the control unit 240 can execute the augmented reality mode.

The controller 240 may transmit user information related to the augmented reality contents to the electronic device 100 in the augmented reality mode.

The user information related to the augmented reality contents may include at least one of character information in the augmented reality contents provided in the experience space, body information related to the user's body index, and history information related to the augmented reality contents.

The character information is information on a role selected by the user among a plurality of roles provided by the augmented reality contents. For example, in a battle experience, the character information can be a character using a sword, a character using a bow, or a character using a magic character.

The character information may be set by a user's selection. Alternatively, the control unit 140 may recommend character information suitable for the user's characteristics. More specifically, the control unit 140 can detect the recommended character information among a plurality of predetermined character information based on the characteristic information of the user's face image. For example, when the user's face image is a sharp image, the control unit 140 can detect recommended character information having a sharp image.

The body information is the body information of the user detected by the sensing unit 220 of the band device 200. In addition, the body information can be extracted from the image of the user photographed through the camera 120. For example, the body information may be a key, a body shape, etc., extracted based on the image analysis result on the user image.

The history information may be information indicating a history using the experience space. For example, the history information may include role information performed by the user in the experience space, degree of experience of experiences performed in the experience space, and the like.

The control unit 140 can photograph a user located in the experience space through the camera 120 (S420).

The camera 120 may be configured to photograph the inside of the experience space. Thus, the camera 120 can photograph a user located inside the experience space.

Steps S410 and S420 may be performed simultaneously or sequentially. Also, the order of steps S410 and S420 may be changed.

The control unit 140 may generate the augmented reality contents based on the user information and the captured user image (S430).

The control unit 140 can determine a specific item image from a plurality of item images based on the character information included in the user information. The item image may be a dress image of a character, or an inorganic image of a character. That is, the item image can be stored in advance in the memory for each character.

The control unit 140 may generate the augmented reality contents corresponding to the user by combining the captured user image and the specific item image so that an image of the determined specific item is worn by the user. For example, the control unit 140 may determine the size of the specific item image according to the body type of the user, and may set the output position of the specific item image according to the position of the user to generate the augmented reality contents.

In addition, the control unit 140 can generate the augmented reality contents related to the exhibition using the images of the exhibits existing in the experience space. More specifically, the control unit 140 may generate the augmented reality contents by synthesizing the predetermined images with the graphic objects corresponding to the exhibits in the images taken inside the experience space including the user. For example, as shown in FIG. 5, when the exhibit is a dinosaur model, the controller 140 may generate augmented reality contents by synthesizing graphic objects that fire around the mouth of the dinosaur model. Therefore, the present invention can provide a lively exhibition to the user.

The augmented reality contents related to the exhibit may include guide information related to the experience method of the exhibit. Therefore, the user can get assistance in exhibit experience while checking the guide information.

The controller 140 may output the generated augmented reality contents (S440).

The control unit 140 may output the augmented reality contents on the display unit 131. [ For example, as shown in FIG. 5, the control unit 140 may output an image 510a on which a user wears a character's dress on the display unit 151. FIG.

The augmented reality content may be an image of the same size as the actual size of the user, and the graphic object corresponding to the user on the image captured by the user may be an image of wearing the character dress. Therefore, even if the user does not actually wear the dress, the user can feel the same as wearing the character's dress in the experience space.

In addition, the control unit 140 may output the inorganic image instead of the graphic object corresponding to the band device 200 photographed by the camera. That is, the control unit 140 can output the inorganic image to the output position of the band device 200, instead of outputting the captured image of the band device 200 as it is. Through this, the present invention can interlock the movement of the wrist and the movement of the weapon of the user to provide the effect that the user actually moves the weapon.

Also, the control unit 140 may output the augmented reality image related to the exhibit. For example, as shown in FIG. 5, the controller 140 may output a graphic object 520a corresponding to the display object 310b and guide information 520b related to an experience space experience around the graphic object 520 .

Also, the control unit 140 may output a background image suitable for the theme of the experience space on the display unit 131. [ For example, as shown in FIG. 5, a jungle image serving as a background of a battle can be displayed on the display unit 131 together.

The control unit 140 may control the output of the augmented reality image by reflecting the movement of the user or the position of the user in the experience space. For example, when the user takes a hand-lifting operation, the control unit 140 can change the augmented reality image to take a hand-lifting operation. Therefore, the user can experience the augmented reality more vividly while equating the image output to the display unit with himself / herself.

On the other hand, the band device 200 can end the augmented reality mode when the user's exit is detected in the experience space. In this case, the band device 200 may not transmit user information to the electronic device 100. In addition, the electronic device 100 may terminate the output of the augmented reality contents when the user's exit is detected.

In the foregoing, a method of providing an augmented reality image in the experience space according to the present invention has been described. INDUSTRIAL APPLICABILITY The present invention can provide a more vivid experience to a user by providing an exhibit using the augmented reality contents.

Hereinafter, a method of outputting the augmented reality image in the experience space will be described in more detail. FIGS. 6 and 7 are conceptual diagrams illustrating embodiments for outputting an augmented reality image.

The controller 140 can output the augmented reality image through the plurality of display units 131 installed in the experience space when the user is detected to enter the experience space.

At this time, the controller 140 may output an augmented reality image on at least one of the plurality of display units based on a predetermined condition. The predetermined condition may be a condition related to at least one of the position of the user in the experience space and the sight line information of the user. The control unit 140 may detect the position of the user through the beacon signal unit.

For example, as shown in FIG. 6, the controller 140 outputs the augmented reality contents to the display unit 131a located nearest to the user's position among the plurality of display units 131a, 131b, and 131c . Accordingly, the user can confirm the augmented reality contents through the display unit installed closest to the user's location.

As another example, the control unit 140 can determine the output position of the augmented reality contents based on the direction of the user's sight line. The control unit 140 can detect the direction of the user's gaze through the camera 120. [ The controller 140 may output the augmented reality contents to a display unit located in a direction of the user's eyes among the plurality of display units 131a, 131b, and 131c.

7, when the user's gaze of the first display unit 131a and the second display unit 131b is directed to the first display unit 131a, the control unit 140 controls the first display unit 131a, It is possible to output the augmented reality contents to the display unit 131a. Similarly, when the user's line of sight is directed to the second display unit 131b, the controller 140 may output the augmented reality content to the second display unit 131b. Therefore, the present invention can provide an effect that a user can naturally see his or her own appearance at a position where a user's eyes are in line, such as a mirror.

In addition, the control unit 140 can determine the output position of the augmented reality contents based on the combination of the user's gaze direction and the user's position. For example, the control unit 140 may detect that the first display unit and the second display unit are installed within a predetermined distance based on the position of the user. In this case, the controller 140 can output the augmented reality contents to the display unit installed at a position facing the user's line of sight of the first and second display units, based on the user's sight line direction.

In the above, a method of providing the augmented reality contents through a plurality of display units installed in the experience space has been described.

Hereinafter, a method for providing augmented reality contents through interaction among a plurality of users located in an experience space will be described. 8 is a conceptual diagram illustrating a method of providing augmented reality contents through interaction between a plurality of users.

A plurality of users can simultaneously experience the augmented reality contents while wearing the band device in the experience space providing the augmented reality contents. At this time, the band devices existing in the experience space may be an authentication device configured to communicate with each other.

The band devices existing in the experience space can perform mutual communication when the two band devices are located within a predetermined radius. That is, communication based on the proximity communication technique can be performed between the band devices.

The controller 140 of the electronic device 100 may generate the augmented reality contents based on the events related to the at least two band devices among the plurality of band devices existing in the experience space.

The event associated with the at least two band devices may be an event in which the two band devices are in contact with each other, or a control signal related to each other from two band devices is received. Here, an event in which two band devices are adjacent is an event in which two band devices are located within a predetermined radius.

For example, as shown in FIGS. 8A and 8B, the controller 140 can detect the occurrence of an event that the first band device 200a and the second band device 200b are adjacent to or in contact with each other have.

More specifically, when the first band device 200a and the second band device 200b are adjacent to each other, the first band device 200a is connected to the first and second band devices 220a and 220b, It is possible to transmit an electronic signal to the electronic device 100 to notify the occurrence. Accordingly, the control unit 140 can recognize that the two band devices are adjacent to each other.

The controller 140 may output new augmented reality contents based on the user information received from the two band devices. For example, as shown in (c) of FIG. 8A, the controller 140 may generate a new augmented reality character image by combining the character information represented by the two band devices.

The new augmented reality contents can be changed based on a combination of user information of the band devices. For example, when the first band device and the second band device are adjacent to each other, the controller 140 generates a first character image based on the first user information and the second user information, When the three-band devices are adjacent to each other, the control unit 140 may generate the second character image based on the first user information and the third user information.

That is, when an interaction using a band device is detected among a plurality of people, it is possible to experience augmented reality contents through interaction among a plurality of people. Therefore, users in the experience space can experience new virtual reality contents through interaction between each other.

As another example, the control unit 140 may receive control signals related to each other from different band devices within a predetermined time interval. More specifically, the control unit 140 can receive the first control signal from the first band device 200a and the second control signal from the second band device 200b.

Here, the first control signal and the second control signal are control signals related to each other, and based on the combination of the two signals, a control command for generating the augmented reality contents can be generated.

The first control signal and the second control signal may be generated by the user's motion. For example, as shown in (a) of FIG. 8B, the first band device 200a can generate the first control signal based on the gesture of lifting the wrist on which the first band device 200a is worn . The second band device 200b may generate a second control signal based on the gesture that the second band device 200b extends outward from the wrist on which the second band device 200b is worn.

The first band device 200a and the second band device 200b may transmit a first control signal and a second control signal, respectively, to the electronic device. As shown in FIG. 8B, when the first control signal and the second control signal are received within a predetermined time interval, the controller 140 generates new augmented reality contents based on the first control signal and the second control signal, Lt; / RTI > That is, in the experience space provided by the present invention, two or more people present in the experience space cooperate with each other to induce execution of a specific function, thereby providing an experience on new AR contents.

Meanwhile, the control unit 140 may assign different control rights to at least two band devices to control new augmented reality contents. For example, when the new AR contents are robots, the control unit 140 sets the first usable authority available in the robot to be available only to the first band device, and the second weapon use authority sets only the second band device Can be set. That is, according to the present invention, users of each band device can cooperate with each other to grant control authority to control the augmented reality contents. Therefore, the present invention can provide a method by which a plurality of users can simultaneously enjoy one augmented reality contents.

In the above description, a plurality of users located in the experience space cooperate with each other to enjoy the augmented reality contents.

Hereinafter, an embodiment in which the control authority of the augmented reality contents varies depending on the number of band devices worn by the user will be described. 9A and 9B are conceptual diagrams illustrating a method of controlling the augmented reality contents according to a band device worn by the user.

A user located in the experience space according to the present invention may wear one or more band devices. The user can select a band device to be worn before entering the experience space.

Also, the user can acquire the band device while experiencing the augmented reality contents provided in the experience space. For example, in the experiential space, a user may provide a specific mission to perform and, when the performance of a particular mission is completed, provide the band device with compensation.

Meanwhile, the controller 140 may generate the augmented reality contents based on the number of band devices worn by the user. For this, the controller 140 may determine the number of band devices worn by the user.

The control unit 140 may determine the number of band devices worn by the user based on the body index measured from the band sensing unit. For example, when the same heart rate information is received from two or more band devices, the controller 140 may determine that the user wears two or more bands.

Alternatively, the control unit 140 may determine the number of band devices worn by the user based on the user image photographed through the camera 120. For example, the control unit 140 may extract a band device from the user image based on a predetermined image analysis algorithm, and determine the number of extracted band devices.

Alternatively, the controller 140 may determine the number of the band devices based on the setting input by the user. That is, the user can input the number of band devices worn by the user into the electronic device 100 before entering the experience space.

Referring to FIGS. 9A and 9B, the controller 140 may generate different augmented reality contents according to the number of band devices worn by the user. For example, as shown in (a) of FIG. 9A, the controller 140 outputs first augmented reality contents 910 when there is one band device 200 worn by the user, , It is possible to output the second augmented reality contents 920 when there are two band devices 200a and 200b worn by the user.

In addition, the control unit 140 can set different control rights according to the number of band devices. The control authority is an execution right for the executable functions in the augmented reality contents. For example, the control unit 140 may grant the execution right for the first function when there is one band device, and may grant the execution right for the first function and the second function when there are two band devices . That is, according to the present invention, as the number of band devices increases, the number of executable contents in the augmented reality contents increases, thereby providing the user with an improved experience in the augmented reality contents.

Similarly, when providing the model house image as augmented reality contents, the electronic device 100 according to the present invention can provide a model house image differently according to the number of band devices. For example, as shown in (a) of FIG. 9B, when there is one band device, the controller 140 can output the augmented reality contents including the sofa and the sink image on the display unit. In addition, when there are two band devices, the controller 140 can output the augmented reality contents including the sofa, the sink, and the TV stand image on the display unit. Therefore, the present invention can improve space efficiency by providing various types of augmented reality contents through one experience space.

The method of experiencing the augmented reality contents according to the number of the band devices has been described above.

Hereinafter, a method of providing the augmented reality contents reflecting the user's body information will be described. FIG. 10A is a conceptual diagram illustrating an example of providing augmented reality contents reflecting user's body information, and FIG. 10B is a conceptual diagram illustrating an example of transmitting body information of a child user to a parent mobile terminal.

The controller 240 of the band device 200 according to the present invention can detect the user's body information located in the experience space in real time. For example, the control unit 240 may sense at least one of pulse, respiration, and oxygen saturation of the user.

The control unit 240 of the band device 200 can transmit the user's body information to the electronic device 100 through the communication unit 210. [ The controller 140 of the electronic device 100 may calculate body indexes related to a user's physical activity such as a user's stress index and a user's physical fitness index based on the received body information.

The controller 140 may reflect the calculated body index to the augmented reality contents. More specifically, the control unit 140 may set an HP (Hit Point) indicating the activity index of the augmented reality contents based on the body index. The HP is an index reflecting the moving speed of the augmented reality contents and the reaction with other augmented reality contents.

For example, the control unit 140 may set the HP to be low, reflecting the body index that the user's stress index is high. Alternatively, the control unit 140 may set the HP to be high, reflecting the body index that the user's physical fitness index is high.

In addition, the control unit 140 may set the activity range or response of the augmented reality contents differently according to the HP. For example, as shown in FIG. 10A, when the HP is high, the controller 140 can move the augmented reality contents at the same moving speed as the user's walking speed. On the other hand, as shown in (b) of FIG. 10, when the HP is low, the controller 140 can move the augmented reality contents at a moving speed that is slower than the user's walking speed. That is, the controller 140 may not reflect the motion of the user to the augmented reality contents. In addition, the control unit 140 may output guide information indicating 'rest is required' to induce the user to rest. In this case, the controller 140 can stop the movement of the augmented reality contents together with the guide information. Therefore, as shown in (c) of FIG. 10A, it is possible to induce the user to take a rest. On the other hand, the control unit 140 can set the HP to a high level based on the fact that the user takes a break and the body index again rises. Therefore, the present invention can provide augmented reality similar to a real environment to a user.

Meanwhile, the controller 140 may transmit the body information indicating the body index of the user to the predetermined portable terminal. That is, the present invention can transmit the physical information of a child visitor located in the experience space to the parent terminal.

Based on the body information received from the electronic device 100, the parent portable terminal can calculate the development index and the degree of development of the body, which indicate the degree of development of the body. Then, the portable terminal can determine the recommendation activity based on the body development index.

The portable terminal can output the calculated development index and recommendation activity information to the display unit. For example, as shown in (a) of FIG. 10B, a development index indicating the degree of development of the body, an image indicating the degree of development of each part of the body, and recommendation activity information may be output on the display unit. Through this, the parents can confirm the degree of development of the child's body.

In the above, a method of providing the augmented reality contents reflecting the body information has been described.

According to the present invention, the user information is received from a band device worn on the wrist of a visitor located in the experience space, and the augmented reality contents are generated and provided based on the received user information, thereby providing a lively experience space to the viewer.

In addition, the present invention provides augmented reality contents on the basis of mutual actions among viewers located in the experience space, thereby inducing activities among viewers located in the experience space and providing new experiences to the visitors .

In addition, the present invention can provide a realistic experience space by providing the augmented reality contents reflecting the body index of the visitor located in the experience space.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (15)

A communication unit configured to be able to communicate with a plurality of band devices respectively worn on the wrists of a plurality of users located in the experience space;
A camera installed in the experience space and configured to photograph a plurality of users wearing the band device;
Receiving a plurality of pieces of user information related to the augmented reality contents from the plurality of band devices,
A controller for generating an augmented reality content including a character image corresponding to each of the plurality of users based on the received plurality of user information and the captured plurality of user images; And
And a display unit for outputting the generated augmented reality contents,
Wherein,
Generating augmented reality contents including a new character image by combining character information represented by band devices adjacent to each other according to a combination of band devices adjacent to each other among the plurality of band devices,
The new character image may include:
Wherein the plurality of band devices are different depending on combinations of the band devices adjacent to each other.
The apparatus of claim 1, wherein the control unit
Determining a specific item image of the plurality of item images stored in advance based on the received user information,
And generates the augmented reality contents obtained by synthesizing the photographed user image and the specific item image so that the photographed user wears the specific item.
The apparatus of claim 1, wherein the control unit
And the output of the augmented reality contents is controlled by reflecting the motion information of the user.
The method according to claim 1,
And a beacon signal unit capable of transmitting and receiving a beacon signal with the band apparatus,
In the experience space, a plurality of display units are installed apart from each other,
The control unit
Detecting a position of each of the plurality of users based on the beacon signal portion,
And outputs the augmented reality contents to a display unit provided at a position closest to the detected one of the plurality of display units.
The method of claim 1,
Character information related to the augmented reality contents, information related to the user's body, and history information related to the augmented reality contents.
The method according to claim 1,
The band device
When a generation of an event in contact with a band device of another user is detected, a control signal for notifying occurrence of the event is transmitted,
The control unit
And generates new augmented reality contents based on a control signal informing a contact between different band devices.
7. The apparatus of claim 6, wherein the control unit
And gives different control authority to the different band devices to control the new augmented reality contents.
The apparatus of claim 1, wherein the control unit
Wherein the user sets a function executable in the augmented reality contents based on the number of band devices worn on the wrist of the user.
9. The apparatus of claim 8, wherein the control unit
And controls the display so that the visual appearance of the augmented reality contents is changed based on the received notification signal when a notification signal indicating that a plurality of band devices are worn on the wrist of the user is received.
The apparatus of claim 1, wherein the control unit
Receives the body information of the user's body index measured from the band device, and adjusts the activity index of the augmented reality contents based on the received body information.
A band device connected to an electronic device according to claim 1,
A body formed to be worn on a part of the user's body;
A communication unit for performing communication with an external device;
A sensing unit for sensing whether the body and a part of a user's body are worn;
When the main body is worn on a part of the user's body, executes the augmented reality mode,
And a controller for transmitting user information related to the augmented reality contents to the electronic device in the augmented reality mode,
Wherein,
Receiving user information from at least one other band device worn by at least one other user existing within a predetermined radius,
Wherein,
A control signal for generating augmented reality contents including a new character image according to a combination of the band device and the at least one other band device is transmitted to the electronic device based on user information of the at least one other band device .
12. The method of claim 11,
Further comprising a body measurement unit positioned to face a body part of a user in contact with the body, the body measurement unit measuring a user's body information,
The control unit
And transmits the measured body information to the electronic device through the body measurement unit in real time.
13. The method according to claim 12, wherein the user's body information
Pulse information, respiration information, and oxygen saturation.
delete A content providing system for providing augmented reality contents using a band device in an experience space,
A plurality of band devices formed to be worn on a body part of a user located in the experience space and transmitting user information related to the augmented reality contents; And
An electronic device for receiving the user information from at least one of a plurality of band devices located in the experience space and generating an augmented reality content including a character image corresponding to each user information based on the received user information,
Wherein the plurality of band devices comprise:
Generating different control signals according to a gesture of each user's body wearing the band device,
The electronic device includes:
Generating new augmented reality contents based on a combination of different control signals received from each of the plurality of band devices for a predetermined time,
Wherein the new augmented reality content comprises:
Wherein the control unit is operable to perform a specific function depending on a combination of the control signals.

KR1020170073329A 2017-06-12 2017-06-12 Electric device for providing an augmented reality content, band device thereof and content providing system thereof KR101954338B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020170073329A KR101954338B1 (en) 2017-06-12 2017-06-12 Electric device for providing an augmented reality content, band device thereof and content providing system thereof
PCT/KR2017/006709 WO2018230760A1 (en) 2017-06-12 2017-06-26 Electronic device, band device and content providing system for providing augmented reality content

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020170073329A KR101954338B1 (en) 2017-06-12 2017-06-12 Electric device for providing an augmented reality content, band device thereof and content providing system thereof

Publications (2)

Publication Number Publication Date
KR20180135336A KR20180135336A (en) 2018-12-20
KR101954338B1 true KR101954338B1 (en) 2019-05-17

Family

ID=64660971

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020170073329A KR101954338B1 (en) 2017-06-12 2017-06-12 Electric device for providing an augmented reality content, band device thereof and content providing system thereof

Country Status (2)

Country Link
KR (1) KR101954338B1 (en)
WO (1) WO2018230760A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102212511B1 (en) * 2019-10-23 2021-02-04 (주)스코넥엔터테인먼트 Virtual Reality Control System
KR102541750B1 (en) * 2022-02-18 2023-06-13 주식회사 미디어프론트 SYSTEM FOR PROVIDING EXPERIENTIAL CONTENTS USING IoT

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101539226B1 (en) * 2013-12-23 2015-07-28 한국과학기술원 Public game system in public transprotation and method for providing public game service
KR101572346B1 (en) * 2014-01-15 2015-11-26 (주)디스트릭트홀딩스 Service system and service method for augmented reality stage, live dance stage and live audition
KR101672268B1 (en) * 2015-07-30 2016-11-04 (주) 씽크브릿지 Exhibition area control system and control method thereof
KR101678009B1 (en) * 2016-03-07 2016-11-21 윤석진 Total system for providing field visualization and agents managent using wearable device and service method thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110121394A (en) * 2010-04-30 2011-11-07 엘지전자 주식회사 Apparatus for displaying image and method for operating the same
KR101732890B1 (en) * 2015-08-19 2017-05-08 한국전자통신연구원 Method of rendering augmented reality on mirror display based on motion of target of augmented reality and apparatus using the same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101539226B1 (en) * 2013-12-23 2015-07-28 한국과학기술원 Public game system in public transprotation and method for providing public game service
KR101572346B1 (en) * 2014-01-15 2015-11-26 (주)디스트릭트홀딩스 Service system and service method for augmented reality stage, live dance stage and live audition
KR101672268B1 (en) * 2015-07-30 2016-11-04 (주) 씽크브릿지 Exhibition area control system and control method thereof
KR101678009B1 (en) * 2016-03-07 2016-11-21 윤석진 Total system for providing field visualization and agents managent using wearable device and service method thereof

Also Published As

Publication number Publication date
KR20180135336A (en) 2018-12-20
WO2018230760A1 (en) 2018-12-20

Similar Documents

Publication Publication Date Title
CN108170262B (en) Haptic surround function
US10216474B2 (en) Variable computing engine for interactive media based upon user biometrics
JP7089846B2 (en) Systems and methods for tactile neural interfaces
JP6217747B2 (en) Information processing apparatus and information processing method
KR102135586B1 (en) Mobile terminal and method for controlling the same
JP6155448B2 (en) Wireless wrist computing and controlling device and method for 3D imaging, mapping, networking and interfacing
US20170109131A1 (en) Earpiece 3D Sound Localization Using Mixed Sensor Array for Virtual Reality System and Method
US20130222215A1 (en) Head mounted display and image display system
US10782782B1 (en) Devices, systems, and methods for radar-based artificial reality tracking
WO2016013269A1 (en) Image display device, image display method, and computer program
KR20160016263A (en) Mirror display device and operating method thereof
US11907423B2 (en) Systems and methods for contextualized interactions with an environment
US20180272189A1 (en) Apparatus and method for breathing and core muscle training
US11526133B2 (en) Electronic devices and systems
KR20160145284A (en) Mobile terminal and method for controlling the same
KR101954338B1 (en) Electric device for providing an augmented reality content, band device thereof and content providing system thereof
US20180095532A1 (en) Virtual Reality Head-Mounted Device
WO2017059618A1 (en) Method and device for simulating scenes
KR20170027607A (en) Wearable device and method for controlling the same
KR20170073307A (en) Mobile fitness system for strength enhancement and control method thereof
TW201816545A (en) Virtual reality apparatus
KR20160071013A (en) Glass type mobile terminal and method for controlling the same
KR20220075054A (en) System for providing health care for waist exercise and method thereof
WO2022203697A1 (en) Split architecture for a wristband system and related devices and methods
WO2023220294A1 (en) Head-worn wearable device providing indications of received and monitored sensor data, and methods and systems of use thereof

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant