KR20180044687A - Head mounted display device - Google Patents

Abstract

Disclosed is a head mounted display (HMD) device. According to an embodiment of the present invention, the HMD device comprises: a display unit displaying an image; a communication unit communicating with an external device; a sensing unit acquiring data on inclination of the HMD device; and a control unit acquiring information on inclination of a user wearing the HMD device and controlling the HMD device to operate in one of an AR mode and a VR mode based on the inclination of the user. Therefore, when the HMD device operates in the VR mode, the HMD device can display the image for controlling a massage chair.

Description

An HMD device {HEAD MOUNTED DISPLAY DEVICE}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an HMD device for changing a mode based on information on a tilt of a user wearing a HMD (Head Mounted Display) device.

In recent years, home appliances and health clubs have been developing and promoting their own health and fitness, or used for relieving fatigue and relieving stress, for example, exercise machines and massage machines such as running machines and the like.

Especially, there is a lot of interest in massage equipment because there is a lot of demand for loosening muscles and relieving fatigue and stress through massage. Massage is one of the medical aids that help the blood circulation and relieve fatigue by sweeping, nipping, pressing, pulling, tapping or moving with a hand or a special instrument. A massage device is a device that performs massage by a mechanical device. A typical example of the massage device is a massage chair that allows a user to sit comfortably and receive a massage.

On the other hand, a massage using a massage chair generally takes a long time, so a means for solving the user's free will is needed.

Accordingly, there has been a technique for providing a virtual experience using sounds, smells, images, and the like to a user who receives massage in the past, and this is disclosed in Japanese Patent Application Laid-Open No. 10-2011-0077672.

A first object of the present invention is to prevent a problem that a user can not view an image due to a change in the slope of a massage chair when an HMD (Head Mounted Display) device capable of operating in both the AR mode and the VR mode is worn , The operation mode of the HMD (Head Mounted Display) device is changed based on the information about the inclination of the user wearing the HMD (Head Mounted Display) device.

A second object of the present invention is to display an image for controlling a massage chair in order to prevent a problem that the user can not see the outside when the HMD (Head Mounted Display) device operates in the VR mode.

According to an aspect of the present invention, an HMD (Head Mounted Display) device acquires information on a slope of a user wearing a head mounted display (HMD) device, (Head Mounted Display) device can be controlled to operate in one of the AR mode and the VR mode.

According to an aspect of the present invention, an HMD (Head Mounted Display) device can display an image for controlling a massage chair when a HMD (Head Mounted Display) device operates in a VR mode .

According to the first aspect of the present invention, when the user is able to listen to a display device such as a TV, the user can recognize the surrounding situation and provide comfort by operating in the AR mode, When the user can not appreciate the display device, the user operates the VR mode to provide the TV image to the user.

According to the solution of the first aspect of the present invention, when an HMD (Head Mounted Display) device operates in the VR mode, an image for controlling a massage chair is displayed so that the user can control the massage chair It is possible to provide an environment that can be easily handled.

1 is a block diagram for explaining an HMD related to the present invention.
FIG. 2 is a conceptual view of an HMD related to the present invention viewed from one direction.
3 is a block diagram for explaining a massage chair 200 according to an embodiment of the present invention.
4 is a perspective view illustrating a structure of a massage chair 200 according to an embodiment of the present invention.
FIG. 5 is a view showing a user wearing a HMD receiving massage in a massage chair according to an embodiment of the present invention.
6 is a view for explaining a method of operating a head mounted display (HMD) device according to an embodiment of the present invention.
7 is a view for explaining an HMD (Head Mounted Display) device operating in AR mode according to an embodiment of the present invention.
FIG. 8 is a view for explaining a method of acquiring information on a slope of a user according to an embodiment of the present invention.
9 is a view for explaining an HMD (Head Mounted Display) device operating in a VR mode according to an embodiment of the present invention.
FIGS. 10 to 11 are views for explaining a slope smaller than a preset slope and a slope greater than a predetermined slope, according to an embodiment of the present invention.
FIG. 12 is a view for explaining an image display system of a HMD (Head Mounted Display) device including a massage chair, a display device, and a HMD (head mounted display) device according to an embodiment of the present invention.
13 is a diagram for explaining a method of displaying an image for controlling a massage chair in the VR mode according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for components used in the following description are given or mixed in consideration of ease of specification only and do not have their own distinct meanings or roles

The HMD described in this specification may include a wearable device (e.g., a smart glass) or the like.

However, the configuration according to the embodiments described herein may be applied to mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), PMPs (personal digital assistants) the present invention can also be applied to mobile terminals such as portable multimedia player, navigation, slate PC, tablet PC, ultrabook, and smartwatch. It will be possible.

1 is a block diagram for explaining an HMD related to the present invention.

The HMD 100 may include a communication unit 110, an input unit 120, an output unit 150, a memory 170, a control unit 180, and a power supply unit 190. The components shown in Fig. 1 are not essential for implementing the HMD, so that the HMD described in this specification can have more or fewer components than those listed above.

The HMD 100 and the HMD 100 and the HMD 100 and the mobile or fixed terminal between the HMD 100 and the wireless communication system and between the HMD 100 and the HMD 100. [ 100 and the controller, a camera installed outside the HMD 100 and capable of wireless communication), between the HMD 100 and the massage chair, or between the HMD 100 and the external server, Modules.

In addition, the communication unit 110 may include one or more modules that connect the HMD 100 to one or more networks.

The communication unit 110 includes at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, a position information module 115, and an interface unit 116 . ≪ / RTI >

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

Also, the input unit 120 may include a sensing unit 124.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do.

In addition, the memory 170 stores data supporting various functions of the HMD 100. The memory 170 may store a plurality of application programs (application programs or applications) driven by the HMD 100, data for operation of the HMD 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least a part of these application programs may be stored in the HMD 100 from the time of shipment for the basic functions of the HMD 100 (for example, screen information output function such as image, moving picture and the like, telephone call reception, 100). ≪ / RTI > Meanwhile, the application program may be stored in the memory 170, installed on the HMD 100, and may be driven by the controller 180 to perform the operation (or function) of the HMD.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the HMD 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1A in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 can operate at least two of the components included in the HMD 100 in combination with each other for driving the application program.

Under the control of the control unit 180, the power supply unit 190 receives external power and internal power, and supplies power to the components included in the HMD 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the above components may operate in cooperation with each other to implement an operation, control, or control method of the HMD according to various embodiments described below. In addition, the operation, control, or control method of the HMD can be implemented on the HMD by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 1 before explaining various embodiments implemented through the HMD 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. At least two broadcast receiving modules may be provided to the HMD 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server includes a server for generating and transmitting broadcast signals and / or broadcast-related information, a device for receiving the generated broadcast signals and / or broadcast-related information and controlling the HMD in association with the HMD or the HMD For example, a control device, a terminal, or the like). The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcasting signal may be encoded according to at least one of technical standards for transmitting and receiving a digital broadcasting signal (or a broadcasting system, for example, ISO, IEC, DVB, ATSC, etc.) It is possible to receive the digital broadcasting signal using a method conforming to the technical standard defined by the technical standards.

The broadcast-related information may be information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms, for example, an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). The broadcast signal and / or the broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 170.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the HMD 100 or externally. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short range communication module 114 is a module for communicating with the HMD 100 and the other HMD 100 between the HMD 100 and the wireless communication system via the wireless area networks, A wireless communication between the HMD 100 and the control device, a camera installed outside the HMD 100 and wireless communication between the HMD 100 and the external server, or between the HMD 100 and the external server. The short-range wireless communication network may be a short-range wireless personal area network.

Also, the short range communication module 114 can transmit data to the massage chair and receive data from the massage chair.

Here, the HMD is a device (for example, a mobile phone, a smart phone, a smartwatch, a smart phone, etc.) capable of exchanging data with the HMD 100 according to the present invention. A notebook computer, a control device, etc.). The short-range communication module 114 may sense (or recognize) a device capable of communicating with the HMD 100 around the HMD 100. Further, when the sensed device is a device authenticated to communicate with the HMD 100 according to the present invention, the control unit 180 transmits at least a part of the data processed in the HMD 100 through the short- To the device, and may transmit at least a portion of the data processed by the device to the HMD 100. [

Accordingly, the user of the HMD 100 can utilize the data processed in the device through the HMD 100. [ For example, according to this, the user can make a phone call through the HMD 100 when a phone is received in the device, or confirm the received message via the HMD 100 when a message is received in the device It is possible.

The position information module 115 is a module for obtaining the position (or current position) of the HMD, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, an HMD can acquire the position of an HMD by using a signal sent from a GPS satellite by using a GPS module. As another example, the HMD can utilize a Wi-Fi module to acquire the position of the HMD based on information of a wireless access point (wireless AP) that transmits or receives a wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other modules of the wireless communication unit 110 to obtain replacement or additionally data regarding the location of the HMD. The position information module 115 is a module used to acquire the position (or current position) of the HMD, and is not limited to a module that directly calculates or acquires the position of the HMD.

The interface unit 116 serves as a channel with various kinds of external devices connected to the HMD 100. For example, the interface unit 116 may serve as a passage for a massage chair connected to the HMD 100.

The interface unit 116 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the HMD 100, corresponding to the connection of the external device to the interface unit 116, it is possible to perform appropriate control with respect to the connected external device.

The interface unit 116 serves as a path for communication with all external devices connected to the HMD 100. The interface unit 116 receives data from an external device or supplies power to each component in the HMD 100 or allows data in the HMD 100 to be transmitted to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

Also, the interface unit 116 can transmit data to the massage chair or receive data from the massage chair.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, the HMD 100 may include one or A plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ The plurality of cameras 121 provided in the HMD 100 may be arranged to have a matrix structure and the HMD 100 may be provided with a plurality of cameras 121 having a variety of angles or foci Can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or an application program being executed) being performed by the HMD 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user. When information is input through the user input unit 123, the controller 180 can control the operation of the HMD 100 to correspond to the input information. The user input unit 123 may include a mechanical input unit (or a mechanical key such as a button located on the front / rear or side of the HMD 100, a dome switch, a jog wheel, Switches, etc.) and touch-based input means. As an example, the touch-type input means may be at least one of a touch pad and a touch panel.

The sensing unit 124 may include one or more sensors for sensing at least one of information in the HMD, surrounding environment information surrounding the HMD, and user information. For example, the sensing unit 124 may include a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, a gravity sensor (G- sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, an optical sensor (for example, a camera 121), a microphone (see 122), a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation sensor, Gas sensors, etc.), chemical sensors (e.g., electronic noses, healthcare sensors, biometric sensors, etc.). Meanwhile, the HMD disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

Meanwhile, the sensing unit 124 senses at least one of information in the HMD, surrounding environment information surrounding the HMD, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the HMD 100 or may perform data processing, function or operation related to the application program installed in the HMD 100, based on the sensing signal. Representative sensors among various sensors that can be included in the sensing unit 124 will be described in more detail.

First, the proximity sensor refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or an object existing in the vicinity of the detection surface, without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensor may be disposed in the inner area of the HMD or in proximity to the touch screen by the touch screen.

Examples of proximity sensors include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch-type input means of the user input unit 123 is electrostatic, the proximity sensor can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the user input unit 123 itself may be classified as a proximity sensor.

For the sake of convenience of explanation, the act of allowing the user to recognize that the object is located on the user input unit 123 without touching the object on the user input unit 123 is referred to as "proximity touch" Quot; contact touch ", and an action of actually touching an object on the user input unit 123 is called "contact touch. &Quot; The position where the object is touched on the user input unit 123 means the position where the object corresponds vertically to the user input unit 123 when the object is touched. The proximity sensor can sense a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Meanwhile, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor, and further displays visual information corresponding to the processed data on the display unit 151). Further, the control unit 180 controls the HMD 100 to process different operations or data (or information) according to whether the touch on the same point on the user input unit 123 is a proximity touch or a contact touch .

The touch sensor senses a touch (or touch input) applied to the user input unit 123 using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, and a magnetic field type.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the user input portion 123 or a capacitance occurring in a specific portion to an electrical input signal. The touch sensor can be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where the touch target object touching the user input unit 123 is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the user input unit 123 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object to which the user input unit 123 is touched. Whether to perform different controls or to perform the same control according to the type of the touch target object can be determined according to the operation state of the current HMD 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above may be used independently or in combination to provide a short (or tab) touch, a long touch, a multi touch, a drag touch such as a drag touch, a flick touch, a pinch-in touch, a pinch-out touch, a swipe touch, a hovering touch, Various types of touches can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information to be processed by the HMD 100. For example, the display unit 151 may display execution screen information of an application program driven by the HMD 100, or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information.

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

Generally, 3D stereoscopic images consist of left image (left eye image) and right image (right eye image). A top-down method of arranging a left image and a right image in one frame according to a method in which a left image and a right image are combined into a three-dimensional stereoscopic image, A checker board system in which pieces of a left image and a right image are arranged in a tile form, a left-to-right (right-side) Or an interlaced method in which rows are alternately arranged, and a time sequential (frame-by-frame) method in which right and left images are alternately displayed in time.

In addition, the 3D thumbnail image may generate a left image thumbnail and a right image thumbnail from the left image and right image of the original image frame, respectively, and may be generated as one image as they are combined. In general, a thumbnail means a reduced image or a reduced still image. The left image thumbnail and the right image thumbnail generated in this way are displayed on the screen with a difference of the left and right distance by the depth corresponding to the parallax between the left image and the right image, thereby exhibiting a stereoscopic spatial feeling.

The left and right images necessary for realizing the three-dimensional stereoscopic image can be displayed on the stereoscopic display unit by the stereoscopic processing unit. The stereoscopic processing unit receives a 3D image (an image at a reference time point and an image at an expansion point), sets a left image and a right image therefrom, or receives a 2D image and converts it into a left image and a right image.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals associated with functions (e.g., call signal reception sound, message reception sound, and the like) performed by the HMD 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit a tactile effect through direct contact, and can also be implemented so that a user can feel a tactile effect through muscles such as a head, a face, a finger or an arm. At least two haptic modules 153 may be provided according to the configuration of the HMD 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the HMD 100. Examples of the event generated in the HMD 100 include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an e-mail reception, reception of information through an application, and output of an image (image, video, etc.). That is, the light output unit 154 may notify that the HMD 100 is performing a specific operation (function) by the user.

The signal output by the light output unit 154 is implemented when the HMD emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated based on whether the HMD detects the user's event confirmation or ends the operation being performed in the HMD.

The identification module is a chip for storing various information for authenticating the usage right of the HMD 100 and includes a user identification module (UIM), a subscriber identity module (SIM) a universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 116 may be a communication path through which the power from the cradle is supplied to the HMD 100 when the HMD 100 is connected to an external cradle, A signal may be transmitted to the HMD 100. Various command signals or power from the cradle can be operated as a signal for recognizing that the HMD 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The HMD 100 may operate in association with a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operation related to the application program and the general operation of the HMD 100. For example, when the state of the HMD satisfies a set condition, the controller 180 may execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 may perform control and processing related to voice communication, data communication, video call, and the like, or may perform pattern recognition (e.g., voice recognition, Processing can be performed. Further, the control unit 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the HMD 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the HMD body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

On the other hand, in this specification, the term memory 170 can be used in combination with the term storage unit 170. [

Meanwhile, an HMD (Head Mounted Display) device 100 can display an image. Specifically, it is possible to receive an image provided by an external apparatus and display the received image. Here, the image may be a virtual reality (VR) image.

The sensing unit 124 may acquire data on the motion of the HMD (Head Mounted Display) device 100. Specifically, the sensing unit 124 may acquire data on at least one of a movement direction, a movement amount, a rotation direction, and a rotation amount of an HMD (Head Mounted Display) device 100.

Meanwhile, for the operation described above, the sensing unit 124 may include a plurality of sensing means. For example, the sensing unit 124 may include a sensor such as a gravity sensor, a geomagnetism sensor, a motion sensor, a gyro sensor, an acceleration sensor, an infrared sensor, an inclination sensor, a brightness sensor, A sensor, a pressure sensor, a banding sensor, an audio sensor, a video sensor, a Global Positioning System (GPS) sensor, and a touch sensor.

The communication unit 110 can be connected to a network by wire or wireless, and can transmit / receive digital data such as contents.

The control unit 180 may control the display unit 151 to display an image. Specifically, when an image is received from an external device or an image is stored in the storage unit 170, the control unit 180 may control the display unit 151 to display the image.

The control unit 180 controls the movement direction, the movement amount, and the movement direction of the HMD (Head Mounted Display) device 100 based on the data of the motion of the HMD (Device Mounted Display) The rotation direction, and the rotation amount.

Also, the control information of the HMD (Head Mounted Display) device 100 acquired by the HMD (Head Mounted Display) device 100 can be transmitted to an external device (not shown). In this case, an external device (not shown) can provide an image corresponding to the control information of the HMD (Head Mounted Display) device 100 to the HMD (Head Mounted Display) device 100.

For example, when the control information of the HMD 100 is information on the direction of the HMD 100, an external device (not shown) may be connected to a head mounted display (HMD) (100) can provide an HMD (Head Mounted Display) device (100) with an image corresponding to the direction of an MMD (Head Mounted Display) device (100).

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

FIG. 2 is a conceptual view of an HMD related to the present invention viewed from one direction.

Referring to FIG. 2, the HMD 100 related to the present invention is formed to be wearable on a head (or head, face, head) of a human body, and a frame portion (a case, a housing, a cover, etc.) . The frame part may be formed of a flexible material to facilitate wearing. In this figure, the frame portion includes a first frame 101 and a second frame 102 of different materials.

For example, the first frame 101 serves to provide a space in which at least one of the components described in FIG. 1 can be disposed, and the second frame 102 serves to provide a space in which the first frame 101 (Or fixed) to be mountable on the head of the human body.

The frame portion may be referred to as a body (or an HMD body) or a body (or an HMD body). Here, the HMD body (or the HMD body) may be understood as a concept of referring to the HMD 100 as at least one aggregate.

The frame portion is supported on the head portion, and a space for mounting various components is provided. Electronic parts such as a camera 121, an output unit, a user input unit 123, light emitting units 200a, 200b and 200c, a control unit, a sensing unit, and the like may be mounted on the first frame 101. [ Here, the display unit 151 may be formed to cover at least one of the left and right eyes of the user (or to face at least one of the left and right eyes of the user), and may be removably formed.

The second frame 102 may be provided with an electronic component such as a sound output unit 152, a light emitting unit, or the like. However, the present invention is not limited to this, and the components described in FIG. 1 and the components necessary for the HMD may be variously arranged in the first frame 101 and the second frame 102 according to the user's selection.

The control unit 180 (see FIG. 1) is configured to control various electronic components provided in the HMD 100. The control unit 180 can be understood as a configuration corresponding to the control unit 180 described with reference to FIG.

The display unit 151 is mounted on the frame unit and outputs screen information (e.g., image, image, moving picture, etc.) in front of the user's eyes. When the user wears the HMD 100, the display unit 151 may be arranged to correspond to at least one of the left and right eyes so that screen information can be displayed before the user's eyes. In this drawing, the display unit 151 is positioned so as to cover both the left and right eyes so that an image can be output toward both the left and right eyes of the user.

Also, the display unit 151 can project an image with the user's eyes using a prism. Further, the prism may be formed to be transmissive so that the user can view the projected image and the general view of the front (the range that the user views through the eyes) together.

As described above, the image output through the display unit 151 can be seen overlapping with the general view. The HMD 100 can provide an Augmented Reality (AR) in which a virtual image is superimposed on a real image or a background and displayed as a single image by using the characteristics of the display.

The camera 121 is disposed adjacent to at least one of the left eye and the right eye, and is configured to photograph a forward image. Since the camera 121 is disposed adjacent to the eye and facing forward, the camera 121 can acquire a scene viewed by the user as an image.

In this figure, one camera 121 is provided, but the present invention is not limited thereto. The plurality of cameras 121 may be provided to acquire stereoscopic images.

The HMD 100 may include a user input unit 123 operated to receive a control command. The user input unit 123 can be employed in any manner as long as it is a tactile manner in which a user touches or pushes a tactile feeling. In this drawing, it is exemplified that a user input part 123 of a push and touch input method is provided in a frame part.

In addition, the HMD 100 may include a microphone (not shown) for receiving sound and processing the sound as electrical voice data and an acoustic output unit 152 for outputting sound. The sound output unit 152 may be configured to transmit sound in a general sound output mode or a bone conduction mode. When the sound output unit 152 is implemented in a bone conduction manner, when the user wears the HMD 100, the sound output unit 152 is closely attached to the head and vibrates the skull to transmit sound.

If the frame portion including the first frame 101 and the second frame 102 is regarded as one HMD body (hereinafter referred to as "body"), the body of the HMD related to the present invention may be formed in various forms . Specifically, the body may include a plurality of surfaces 103a, 103b, and 103c having predetermined angles. The plurality of surfaces refer to the surfaces located outside the body of the HMD 100. From this viewpoint, the plurality of surfaces may mean the surface (outer surface, outer surface, etc.) of the HMD 100. Each of the plurality of surfaces 103a, 103b, and 103c may be flat or curved.

Meanwhile, the display unit 151 of the HMD related to the present invention may be located inside the main body. Specifically, the display unit 151 is disposed inside the HMD, and when the HMD is worn on the user's head, the display unit 151 can be disposed at a position facing the user's eyes.

In Fig. 2, a body is shown in which a plurality of surfaces 103a, 103b, and 103c are perpendicular to each other. Hereinafter, for the sake of convenience of explanation, an HMD formed so that a plurality of planes are perpendicular to each other will be described as an example. However, the same description is applicable to all types of HMDs including a plurality of planes having predetermined angles, Similar analogy can be applied.

The second frame 102 of the HMD may also include a plurality of surfaces. It is to be understood that in the present invention, one of the surfaces 103f included in the second frame 102 is included in a plurality of surfaces of the HMD body. The one surface 103f may be located at the back of the user.

For example, referring to FIG. 2, the HMD of the present invention may include a plurality of surfaces. The plurality of surfaces may include a front surface 103a, a left surface 103b, a bottom surface 103c, a right surface 103d, an upper surface 103e, and a rear surface 103f.

The HMD 100 related to the present invention may include a plurality of light emitting units each formed on a plurality of surfaces of the main body and emitting light to the outside of the main body. Specifically, the plurality of light emitting units may be formed on a plurality of surfaces of the main body, respectively, and may be formed to emit light to the outside of the main body. Here, the plurality of light emitting units are respectively formed on the plurality of surfaces of the main body means that a plurality of light emitting units are formed for each of the plurality of surfaces, not a plurality of light emitting units are formed for each of the plurality of surfaces do.

For example, as shown in Fig. 2, the first light emitting unit 200a is provided on the front surface 103a, the second light emitting unit 200b is provided on the left surface 103b, 3 light emitting units 200c may be provided. Although not shown, the right side surface 103d, the upper side surface 103e, and the rear surface 103f may each be provided with a light emitting unit.

The plurality of light emitting units can be used for determining (or estimating, tracking, detecting, extracting, determining, identifying, recognizing, etc.) the attitude of the HMD 100. For example, the present invention may include a control device for determining the attitude of the HMD 100, and the control device may use the plurality of light emitting units respectively formed on a plurality of surfaces of the HMD 100, It is possible to determine the posture of the robot 100.

The attitude of the HMD 100 includes a state in which the HMD is laid (a state in which the HMD is worn on the head of the user), a degree of inclination of the HMD, a direction in which the HMD is viewed, a position of the HMD, As shown in Fig. In addition, the determination of the posture of the HMD 100 in the present invention may include the determination of the posture and the movement of the user wearing the HMD 100.

Each of the plurality of light emitting units may include a plurality of light emitting elements. Each light emitting unit may be formed such that the plurality of light emitting elements have different patterns (arrays) so that a plurality of surfaces are distinguished.

For example, a pattern (or an array) in which a plurality of light emitting elements included in the light emitting unit 200a provided on the front surface 103a are arranged may be arranged on a surface (for example, the left surface 103b) May be different from the pattern in which the plurality of light emitting elements included in the light emitting unit (for example, the light emitting unit 200b provided on the right side 103b) are arranged.

The control device can identify the light emitting units based on the plurality of light emitting elements arranged on the plurality of surfaces to have different patterns and determine the posture of the HMD using the identified light emitting units.

On the other hand, the term HMD 100 may be used interchangeably with the term HMD device 100.

3 is a block diagram for explaining a massage chair 200 according to an embodiment of the present invention.

The massage chair 200 may include at least one of a control unit 210, a driving unit 220, a sensing unit 230, and a communication unit 240.

The control unit 210 can perform overall control of each configuration of the massage chair 200. [ Specifically, the control unit 210 can control operations of the driving unit 220, the sensing unit 230, and the communication unit 240.

Under the control of the control unit 210, the driving unit 220 can generate a force for performing massage.

The driving unit 220 includes a head massage unit 310 for supporting a user's head, a massage unit 320 for supporting a user's back, an arm massage unit 330 for supporting a user's arm, The hip massage unit 340 supporting the hip of the user and the leg massage unit 350 supporting the user's leg.

The driving unit 220 includes a head massage unit 310 for supporting a user's head, a massage unit 320 for supporting a user's back, an arm massage unit 330 for supporting a user's arm, And a leg massage unit 350 for supporting the legs of the user can be generated and transmitted to rotate the at least one of the hip massage unit 340 and the user's leg.

To this end, the driving unit 220 may include at least one motor for generating a rotational force and a power transmitting unit for transmitting the generated rotational force.

Each of the head massage unit 310, the back massage unit 320, the arm massage unit 330, the hip massage unit 340 and the leg massage unit 350 may include an air bag, It is possible to adjust the air pressure of each of the massage part 310, the back massage part 320, the arm massage part 330, the hip massage part 340, and the leg massage part 350, .

The sensing unit 230 may acquire data for acquiring information on at least one of the body shape, the posture, and the position of the user.

Specifically, the sensing unit 230 may include at least one sensor disposed at a portion where the user touches. Wherein the one or more sensors may include at least one of an electrostatic sensor, a pressure sensor, and a piezoelectric sensor, and may acquire data on at least one of contact surface and contact strength when the user contacts the massage chair.

In this case, the control unit 210 can acquire information on at least one of the body shape, the posture, and the position of the user, based on the data acquired by the sensing unit 230.

Meanwhile, the sensor included in the sensing unit 230 is not limited to the electrostatic sensor, the pressure sensor, and the piezoelectric sensor described above, and may include data for acquiring information on at least one of a body shape, an attitude, and a position of a user such as an ultrasonic sensor, Lt; RTI ID = 0.0 > a < / RTI >

Meanwhile, the sensing unit 230 may acquire data for acquiring information on the slope of the massage chair. Here, the information on the tilt of the massage chair includes at least one of tilt information of the head massage part, tilt information of the massage part, tilt information of the hip massage part, tilt information of the leg massage part, tilt information of the arm massage part, .

Specifically, the massage chair may include at least one of a head massage unit, a back massage unit, a hip massage unit, and a leg massage unit. The sensing unit 230 may include at least one of a head massage unit, a back massage unit, a hip massage unit, And at least one sensor capable of measuring rotation of at least one of the leg massages. Also, the entire massage chair can be rotated, and the sensing unit 230 can measure the rotation or tilt of the massage chair. The at least one sensor included in the sensing unit 230 may be at least one of an inertial sensor, a magnetic sensor, a gravity sensor, a gyroscope sensor, and an acceleration sensor.

On the other hand, the control unit 210 can acquire information about the inclination of the massage chair based on the data acquired by the sensing unit 230. [

The communication unit 240 can communicate with the HMD 100. Specifically, the communication unit 240 may be connected to the HMD 100 in a wired or wireless manner to transmit data to the HMD 100 or receive data from the HMD 100.

4 is a perspective view illustrating a structure of a massage chair 200 according to an embodiment of the present invention.

The massage chair 200 includes a head massage unit 310 for supporting a user's head, a massage unit 320 for supporting a user's back, an arm massage unit 330 for supporting a user's arm, And a leg massage unit 350 for supporting the legs of the user.

At least one of the head massage unit 310, the back massage unit 320, the arm massage unit 330, the hip massage unit 340, and the leg massage unit 350 may be moved up and down .

Each of the head massage unit 310, the back massage unit 320, the arm massage unit 330, the hip massage unit 340 and the leg massage unit 350 may include one or more rollers or one or more massage rods , And massage can be performed by performing a predetermined operation by a force transmitted from the driving unit 220.

Each of the head massage unit 310, the back massage unit 320, the arm massage unit 330, the hip massage unit 340, and the leg massage unit 350 may each include an air bag. The airbags contained in the head massage unit 310, the back massage unit 320, the arm massage unit 330, the hip massage unit 340 and the leg massage unit 350 are controlled by the air pressure, .

Meanwhile, the massage chair 200 may include a supporting frame constituting a skeleton inside the massage chair 200.

On the other hand, the entire massage chair 200 can be rotated leftward or rightward or upward or downward by the force transmitted from the driving unit 220.

Meanwhile, the massage chair 200 may include a user interface unit 370. The user interface unit 370 may include a display unit 373 for displaying information under the control of the control unit 220 and an input unit 376 for receiving the input from the user and transmitting the input to the control unit 220.

Each of the head massage unit 310, the back massage unit 320, the arm massage unit 330, the hip massage unit 340, and the leg massage unit 350 may include one or more sub-massagers. For example, the head massaging unit 310 may include at least one of a head massager capable of massaging the user's head, and a neck massager capable of massaging the user's neck. Alternatively, for example, the back massage unit 320 may include at least one of a shoulder massager capable of massaging a user's shoulder, a shoulder massager capable of massaging the user's back, and a waist massager capable of massaging the user's waist have. For example, the leg massage unit 350 may include at least one of a thigh massager capable of massaging the user's thigh, a calf massage massager capable of massaging the user's calf, and a foot massager capable of massaging the user's foot have.

Meanwhile, although the construction and operation method of the massage chair 200 have been described above, the present invention is not limited to the massage chair 200 described above. The massage chair 200 according to the embodiment of the present invention can be applied to various types of massage chairs known in the art.

FIG. 5 is a view showing a user wearing a HMD receiving massage in a massage chair according to an embodiment of the present invention.

The communication unit 110 of the HMD 100 may be connected to the communication unit 240 of the massage chair 200 to transmit and receive data.

Specifically, the control unit 180 of the HMD 100 can transmit a control command to the massage chair 200 through the communication unit 110. Here, the control command may include at least one of a control command of a massage mode, a control command of a massage intensity, a control command of a massage part, a control command of a massage speed, and a control command of a massage pattern.

On the other hand, when the control command is received from the HMD 100, the control unit 220 of the massage chair 200 can perform an operation corresponding to the control command. Specifically, based on the received control command, the control unit 220 of the massage chair 200 may adjust at least one of a massage mode, a massage intensity, a massage area, and a massage speed.

Meanwhile, the control unit 220 of the massage chair 200 may transmit the massage information to the HMD 100 through the communication unit 240. Here, the massage information may include at least one of information on the slope of the massage chair 200, information on the massage area, information on the massage mode, and information on the massage pattern.

On the other hand, when the massage information is received from the massage chair 200, the control unit 180 of the HMD 100 controls the operation of the HMD 100 or transmits the control command to the massage chair 200 based on the received massage information .

6 is a view for explaining a method of operating a head mounted display (HMD) device according to an embodiment of the present invention.

An operation method of an HMD (Head Mounted Display) device according to an embodiment of the present invention includes acquiring information on a slope of a user wearing a head mounted display (HMD) device (S610) (Head Mounted Display) device to operate in one of the AR mode and the VR mode (S630).

7 is a view for explaining an HMD (Head Mounted Display) device operating in AR mode according to an embodiment of the present invention.

The control unit 180 may control the HMD 100 so that the HMD 100 operates in one of the AR mode and the VR mode.

Here, the AR mode may be a mode in which an external image is passed through an HMD (Head Mounted Display) device 100.

Specifically, a screen on which an image is displayed in an HMD (Head Mounted Display) device 100 can pass an external image. The external image passed through the screen can be incident on the user wearing the HMD (Head Mounted Display) device 100 as it is.

For example, when the display device 300 is on the front surface of the HMD 100, the image reproduced on the display device 300 passes through the screen of the HMD 100 And can be incident on the user's eyes.

Also, the AR mode may be a mode in which an external image is received and displayed in an HMD (Head Mounted Display) device 100.

Specifically, the HMD (Head Mounted Display) device 100 may include one or more cameras 121. Meanwhile, the control unit 180 may control the display unit 151 to display an image photographed by one or more cameras 121 on the screen. Here, the image photographed by the one or more cameras 121 may be an image of the front of the HMD (Head Mounted Display) device 100.

For example, when the display device 300 is provided on the front surface of the HMD 100, the image reproduced by the display device 300 may be displayed on the camera 121 of the HMD (Head Mounted Display) ) And can be displayed on the screen of the HMD (Head Mounted Display) device 100.

On the other hand, the controller 180 obtains information on the inclination of the user wearing the HMD (Head Mounted Display) device, and based on the inclination of the user, the HMD (Head Mounted Display) Mode can be controlled.

Specifically, when the slope of the user is smaller than a preset slope, the controller 180 may control the HMD (Head Mounted Display) device 100 to operate in the AR mode.

FIG. 8 is a view for explaining a method of acquiring information on a slope of a user according to an embodiment of the present invention.

The control unit 180 of the HMD 100 may acquire information on the inclination of the wearer wearing the HMD 100.

In the first embodiment, the control unit 210 of the massage chair 200 can acquire information about the inclination of the massage chair 200. [ Here, the slope of the massage chair may mean the degree to which the user's head tilts when the user puts the head on the massage chair. For example, if the back massage unit 320 is turned back 30 degrees and the head massage unit 310 is turned back 20 degrees, the massage chair's inclination may be 50 degrees.

Meanwhile, the controller 210 of the massage chair 200 may transmit information about the inclination of the massage chair 200 to the HMD (Head Mounted Display) device 100.

In this case, the control unit 180 of the HMD (Head Mounted Display) device 100 can determine that the slope of the massage chair 200 is the slope of the user.

In the second embodiment, the sensing unit 124 of the HMD (Head Mounted Display) device 100 acquires data on the inclination of the HMD (Head Mounted Display) device 100, 100 may acquire information on the inclination of the head mounted display (HMD) device 100 based on the data.

In this case, the controller 180 of the HMD 100 may determine that the slope of the HMD 100 is the slope of the user.

That is, in both the first embodiment and the second embodiment, the slope of the user may be the slope of the head of the user.

9 is a view for explaining an HMD (Head Mounted Display) device operating in a VR mode according to an embodiment of the present invention.

The control unit 180 may control the HMD 100 so that the HMD 100 operates in one of the AR mode and the VR mode.

Here, the VR mode may be a mode in which an HMD (Head Mounted Display) device 100 receives and displays an image from an external device.

Specifically, the external device may be the display device 300. In addition, in the VR mode, the controller 180 can receive and display an image reproduced on the display device 300. FIG.

For example, when the display device 300 is disposed around the HMD 100, the controller 180 may receive the image reproduced from the display device 300 through the communication unit 110 . In addition, the controller 180 may control the display unit 151 to display the received image.

On the other hand, the controller 180 obtains information on the inclination of the user wearing the HMD (Head Mounted Display) device, and based on the inclination of the user, the HMD (Head Mounted Display) Mode can be controlled.

Specifically, if the slope of the user is greater than a preset slope, the controller 180 may control the HMD (Head Mounted Display) device 100 to operate in the VR mode.

FIGS. 10 to 11 are views for explaining a slope smaller than a preset slope and a slope greater than a predetermined slope, according to an embodiment of the present invention.

Referring to FIG. 10, the slope smaller than the predetermined slope may be a slope toward the display device 300 when the user looks at the front side.

In the AR mode, since not only the TV image but also the images around the TV are visually entered, the viewing of the TV in the AR mode is advantageous for recognizing the surrounding situation and providing comfort to the user.

The controller 180 controls the head mounted display (HMD) device 100 so that the HMD 100 operates in the AR mode when the user gazes at the user's front view toward the display device 300 .

Referring to FIG. 11, the inclination larger than the predetermined inclination may be a slope not directed toward the display device 300 when the user looks at the front side.

If the slope of the user becomes large, the user may have difficulty in viewing the TV.

The controller 180 controls the head mounted display device 100 so that the head mounted display device 100 operates in the VR mode when the user's front view does not face the display device 300 So that an image reproduced in the display device 300 can be displayed on the screen of the HMD (Head Mounted Display) device 100.

FIG. 12 is a view for explaining an image display system of a HMD (Head Mounted Display) device including a massage chair, a display device, and a HMD (head mounted display) device according to an embodiment of the present invention.

All the embodiments described above can be applied to an image display system of an HMD (Head Mounted Display) device including a massage chair, a display device, and an HMD (Head Mounted Display) device.

The massage chair 200 may acquire information about the inclination of the massage chair 200 and may transmit information about the inclination of the massage chair 200 to the HMD 100. [

On the other hand, the HMD (Head Mounted Display) device 100 receives the information about the inclination of the massage chair, and based on the information about the inclination of the massage chair, the HMD (Head Mounted Display) As shown in Fig.

In the AR mode, an HMD (Head Mounted Display) device 100 can directly acquire and display an external image. For example, the external image may be directly incident on the user's eyes through the HMD (Head Mounted Display) device 100. As another example, an HMD (Head Mounted Display) device 100 can photograph and display an external image.

Meanwhile, in the VR mode, the display device 300 can transmit an image reproduced in the display device 300 to the HMD (Head Mounted Display) device 100.

In the VR mode, an HMD (Head Mounted Display) device 100 can receive and display an image reproduced on the display device 300.

The HMD device 100 controls the HMD (Head Mounted Display) device to operate in the AR mode if the slope of the massage chair is smaller than a predetermined slope, and when the slope of the massage chair is in a predetermined slope , It is possible to control the HMD (Head Mounted Display) device to operate in the VR mode.

12, the massage chair transmits the tilt information to the HMD (Head Mounted Display) device, but the present invention is not limited thereto. In this regard, an image display system of an HMD (Head Mounted Display) device including a display device and an HMD (Head Mounted Display) device will be described.

In an image display system of an HMD (Head Mounted Display) device including a display device and an HMD (Head Mounted Display) device, an HMD (Head Mounted Display) device acquires information on the slope of an HMD , A HMD (Head Mounted Display) device can be controlled to operate in one of the AR mode and the VR mode based on the inclination of the HMD (Head Mounted Display) device.

Meanwhile, when the HMD (Head Mounted Display) device operates in the VR mode, the display device 300 can transmit an image reproduced from the display device 300 to an HMD (Head Mounted Display) device.

On the other hand, the HMD (Head Mounted Display) device 100 directly receives and displays an external image in the AR mode, and receives and displays an image displayed on the display device 100 in the VR mode from the display device 100 have.

However, the present invention is not limited to the VR mode or the AR mode based on the slope of the user.

Specifically, the control unit 180 of the HMD (Head Mounted Display) device 100 may determine whether the captured image includes the display device 300 using the image captured by the camera. Also, if the captured image includes the display device 300, the controller 180 controls the HMD (Head Mounted Display) device 100 to operate in the AR mode, and the display device 300 is included in the captured image The control unit 180 can control the HMD (Head Mounted Display) device 100 to operate in the VR mode.

13 is a diagram for explaining a method of displaying an image for controlling a massage chair in the VR mode according to an embodiment of the present invention.

When the HMD 100 operates in the VR mode, the control unit 180 displays the image 720 for controlling the massage chair 200 together with the image 710 received from the display device 100, Lt; / RTI >

Here, the image 720 for controlling the massage chair 200 may be divided into a plurality of regions 721, 722, 723, 724, 725, 726, 727, 728, 729, 730, 731, In addition, the controller 180 may display the pointer 740.

The control unit 180 may receive a user input for moving the pointer 740 and may transmit a command to the massage chair 200 to control the massage operation of the massage part corresponding to the area where the pointer 740 is located Lt; / RTI >

When the HMD (Head Mounted Display) device 100 operates in the VR mode, the user can not view the external image. Therefore, in the VR mode, the user may find it difficult to find an input device or a remote controller for controlling the massage chair 200. [

However, in the present invention, when an HMD (Head Mounted Display) device 100 operates in a VR mode, an image for controlling a massage chair is displayed to allow a user to easily control the massage chair even when the outside is not visible Environment can be provided.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, . Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: HMD 200: Massage chair
300: display device

Claims (11)

A display unit for displaying an image;
A communication unit for communicating with an external device;
A sensing unit for acquiring data on a slope of an HMD (Head Mounted Display) device; And
Acquiring information on a tilt of a user wearing the HMD (Head Mounted Display) device, and controlling the HMD (Head Mounted Display) device to operate in one of an AR mode and a VR mode based on the tilt of the user Comprising:
HMD (Head Mounted Display) device. The method according to claim 1,
In the AR mode,
A mode in which an external image is passed through the HMD (Head Mounted Display) device or the external image is received and displayed in the HMD (Head Mounted Display) device,
In the VR mode,
A mode in which the HMD (Head Mounted Display) device receives and displays an image from the external device
HMD (Head Mounted Display) device. 3. The method of claim 2,
The external device
Display device,
Wherein,
In the VR mode, an image reproduced on the display device is received and displayed
HMD (Head Mounted Display) device. The method of claim 3,
Wherein,
And controls the HMD (Head Mounted Display) device to operate in the AR mode if the slope of the user is smaller than a preset slope,
If the slope of the user is greater than a predetermined slope, the controller controls the HMD (Head Mounted Display) device to operate in the VR mode
HMD (Head Mounted Display) device. 5. The method of claim 4,
The slope, which is smaller than the preset slope,
A line of sight of the user facing the front is a slope toward the display device,
The slope, which is larger than the preset slope,
Wherein a line of sight of the user facing the front is a slope not facing the display device
HMD (Head Mounted Display) device. The method according to claim 1,
The slope of the user
The inclination of the head of the user
HMD (Head Mounted Display) device. The method according to claim 1,
Wherein,
And acquires information on the slope of the user based on data on the slope of the HMD (Head Mounted Display) device
HMD (Head Mounted Display) device. The method according to claim 1,
Wherein,
Receiving information about the tilt of the massage chair from the massage chair and acquiring information about the tilt of the user based on the information about the tilt of the massage chair
HMD (Head Mounted Display) device. 3. The method of claim 2,
Wherein,
In the VR mode, an image for controlling a massage chair is displayed while receiving and displaying an image from the external device
HMD (Head Mounted Display) device. 1. An image display system of an HMD (Head Mounted Display) device including a display device and an HMD (Head Mounted Display) device,
An HMD (Head Mounted Display) device for acquiring information on a tilt of an HMD (Head Mounted Display) device and controlling the HMD (Head Mounted Display) device to operate in one of an AR mode and a VR mode based on the tilt; And
And a display device for transmitting an image reproduced by the display device to an HMD (Head Mounted Display) device,
The HMD (Head Mounted Display)
In the AR mode, an external image is directly received and displayed,
And in the VR mode, receiving and displaying the reproduced image from the display device
An image display system of an HMD (Head Mounted Display) device including a display device and an HMD (Head Mounted Display) device. 1. An image display system of an HMD (Head Mounted Display) device including a massage chair, a display device, and an HMD (Head Mounted Display)
A massage chair for acquiring information on the inclination of the massage chair and transmitting information about the inclination of the massage chair to the HMD (Head Mounted Display) device;
An HMD (Head Mounted Display) device for controlling the HMD (Head Mounted Display) device to operate in one of an AR mode and a VR mode based on information about a tilt of the massage chair; And
And a display device for transmitting an image reproduced by the display device to the HMD (Head Mounted Display) device when the HMD (Head Mounted Display) device operates in the VR mode,
The HMD (Head Mounted Display)
(Head Mounted Display) device is controlled to operate in the AR mode if the slope of the massage chair is smaller than a preset slope, and if the slope of the massage chair is greater than a preset slope, Lt; RTI ID = 0.0 > VR < / RTI &
An image display system of an HMD (Head Mounted Display) device including a massage chair, a display device, and an HMD (Head Mounted Display) device.

Images