KR20160101846A - Head mounted display - Google Patents

Abstract

The present invention relates to a head mounted display (HMD). The HMD, according to an embodiment of the present invention, comprises: a main body which has multiple surfaces; and multiple light emitting units which are formed on the surfaces of the main body, respectively, to emit the light to the outside of the main body, wherein each of the light emitting units comprises four or more light emitting diodes arranged on a straight line to be separated from each other to determine a specific cross ratio. The cross ratios of the light emitting units are different from each other. Therefore, the present invention judges the posture of the HMD through the cross ratio.

Description

Head-mounted display {HEAD MOUNTED DISPLAY}

The present invention relates to a head mounted display (HMD) having a light emitting device.

A head-mounted display (HMD) is an image display device that is worn on a user's head like a spectacle to allow a user to view the image (contents). 2. Description of the Related Art [0002] Various wearable computers (wearable computers) have been developed in accordance with the trend of weight reduction and miniaturization of digital devices, and such HMDs are also widely used. The HMD can be combined with augmented reality technology, N-screen technology, etc., beyond the simple display function, to provide various convenience to the user.

Recently, as the usage of HMD increases, various methods of performing various functions according to the attitude of the HMD are being actively developed. Here, the attitude of the HMD includes a state in which the HMD is laid (a state in which the HMD is worn on the head of the user), a degree of inclination of the HMD, a direction in which the HMD is viewed, a position of the HMD, Concept.

To do this, it is necessary to determine (or estimate, track, detect, extract, determine, identify, recognize, etc.) the attitude of the HMD. The configuration for determining the attitude of the HMD may include a light emitting element and a camera.

Conventionally, in order to determine the attitude of the HMD, a synchronization method of synchronizing a frame (or time) in which a light emitting element provided in the HMD is turned on or off and a frame that opens and closes a shutter of the camera Respectively.

Specifically, conventionally, a plurality of light emitting elements are placed at arbitrary positions in the HMD, and patterns in which a plurality of light emitting elements are turned on / off are set differently from each other. Here, turning on the light emitting element means that the light emitting element emits light, and turning off the light emitting element means that the light emitting element does not emit light.

For example, assuming that the light emitting element is turned on by 1, the light emitting element is turned off by 0, and each pattern is formed by 10 frames, conventionally, any one of a plurality of light emitting elements The first light emitting device emits light so as to have a first pattern (for example, '1100101011'), and any second light emitting device emits a second pattern (for example, '1110010011') different from the first pattern To emit light.

Thereafter, the camera is synchronized with the HMD so that the frame in which the shutter of the camera is opened and closed and the frame in which the light emitting element is turned on or off are synchronized.

Then, conventionally, a pattern to be turned on / off for each of a plurality of light emitting devices is determined through a synchronized camera to identify each light emitting device, and the posture of the HMD is determined using the identified light emitting device.

On the other hand, when such a synchronization method is used, a separate configuration (for example, a synchronization cable) for synchronizing the frame in which the light emitting element of the HMD is turned on / off and the frame for opening / closing the shutter of the camera is required, There is a problem.

Further, in the case of using the synchronization method, since the number of frames for forming a pattern necessarily increases as the number of light emitting elements provided in the HMD increases, the time required to determine the posture of the HMD increases have.

Accordingly, in recent years, various methods for determining the posture of the HMD have been required.

An object of the present invention is to provide an HMD equipped with a light emitting device so that the attitude of the HMD is determined by an optimized method.

Another object of the present invention is to provide an HMD in which a light emitting device is disposed such that the attitude of the HMD is determined in a non-synchronization manner.

Another object of the present invention is to provide a method of determining the posture of an HMD by an optimized method.

An HMD (Head Mounted Display) according to an embodiment of the present invention includes a main body having a plurality of surfaces and a plurality of light emitting units each formed on the plurality of surfaces and emitting light to the outside of the main body, Each of the plurality of light-emitting units includes at least four light-emitting elements arranged in a straight line spaced apart so that a specific cross-ratio is determined, and the plurality of light-emitting units have different non-coherence ratios do.

In an embodiment, the non-matching ratio is determined based on a ratio of spacing distances between the at least four light emitting elements, wherein the plurality of light emitting units have different ratios of spacing distances between the at least four light emitting elements As shown in FIG.

In an embodiment, the ratio of the spacing distances between at least four light emitting elements included in any one of the plurality of light emitting units is included in a light emitting unit different from any one of the plurality of light emitting units And the distance between the at least four light emitting elements is different from the ratio of the distance between the at least four light emitting elements.

In an embodiment, the at least four light emitting devices emit light in a different manner from the remaining light emitting devices.

In an exemplary embodiment, the two light emitting devices are first light emitting devices that emit light so that the brightness of light changes at a predetermined time interval, and the remaining light emitting devices include a first light emitting device 2 light emitting elements.

In one embodiment, the first light emitting devices are light emitting devices disposed at both ends of the at least four light emitting devices, and the second light emitting devices are light emitting devices disposed between the first light emitting devices do.

In an exemplary embodiment, the brightness of light that changes in the first light emitting devices varies at or above a predetermined reference brightness.

In one embodiment of the present invention, each of the plurality of light emitting units further includes two third light emitting devices disposed at positions spaced apart from the straight line and emitting light so as to have a predetermined brightness of light.

In one embodiment, the two third light emitting devices are arranged so that straight lines formed by any two of the first and second light emitting devices and the two third light emitting devices are not parallel to each other .

In one embodiment, the two light emitting devices are the first light emitting devices.

In the embodiment, the two third light emitting elements included in any one of the plurality of light emitting units may include first, second, and third light emitting units included in the light emitting units different from any of the plurality of light emitting units. The first and second light emitting elements are disposed closer to any one of the three light emitting elements than the first and second light emitting elements included in any one of the light emitting units.

In one embodiment of the present invention, the two third light emitting devices included in any one of the light emitting units may be arranged such that a distance from the first light emitting device included in any one of the light emitting units is different from a distance Is disposed closer to the surface of the substrate.

In one embodiment of the present invention, one of the two third light emitting devices included in one of the light emitting units and one of the two first light emitting devices included in the one of the light emitting units The distance between any one of the first light emitting elements closer to the three light emitting elements is closer to the distance between the two first light emitting elements included in the other light emitting unit and the one of the third light emitting elements .

In one embodiment of the present invention, the first to third light emitting elements are spaced apart from each other by a predetermined distance or more.

According to the present invention, it is possible to provide an HMD in which at least four light emitting elements are arranged on a straight line so as to have different mutually harmonious ratios on each of a plurality of surfaces. Therefore, the present invention can provide an HMD formed to determine the attitude of the HMD through the non-harmonizing ratio.

In addition, the present invention can provide an HMD in which two light emitting elements of at least four light emitting elements arranged in a straight line are differently emitted in a manner. Accordingly, the present invention can provide an HMD in which at least four light emitting elements arranged on a straight line having a non-harmonious ratio can be extracted more easily.

In addition, the present invention is characterized in that two light emitting devices having different light emitting modes are formed so as to emit light so that the brightness of light changes at a predetermined time interval, and the brightness of the light is changed to be equal to or greater than a set reference brightness , It is possible to provide an HMD formed to facilitate tracking (or identification, recognition) of the two light emitting devices.

Also, the present invention is characterized in that at least two light emitting elements are disposed on each of the plurality of surfaces at a position spaced apart from the straight line so that the attitude of the HMD is determined, and at least four light emitting elements It is possible to provide an HMD formed so that the attitude of the HMD can be more accurately judged by using the device.

Further, the present invention is characterized in that the at least two light emitting elements arranged on one surface are disposed closer to at least four elements arranged on a straight line disposed on the one surface than the light emitting elements arranged on the other surface , It is possible to provide an HMD formed so that light emitting elements arranged on any one surface can be more easily recognized.

1 is a block diagram for explaining an HMD related to the present invention.
2A is a conceptual view of an HMD related to the present invention viewed from one direction.
2B is a conceptual diagram illustrating a light emitting device provided in the HMD.
Figs. 3A, 3B, and 3C are conceptual diagrams for explaining the non-matching ratio used to distinguish a plurality of faces of the HMD.
FIGS. 4, 5, and 6 are conceptual diagrams for explaining positions where light emitting elements are arranged in the HMD.
7A and 7B are flowcharts for explaining a control method for determining the attitude of the HMD related to the present invention.
FIG. 8 is a conceptual diagram for explaining the control method shown in FIG. 7B.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The HMD described in this specification may include a wearable device (e.g., a smart glass) or the like.

However, the configuration according to the embodiments described herein may be applied to mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), PMPs (personal digital assistants) the present invention can also be applied to mobile terminals such as portable multimedia player, navigation, slate PC, tablet PC, ultrabook, and smartwatch. It will be possible.

Referring to FIG. 1, FIG. 1 is a block diagram illustrating an HMD associated with the present invention.

The HMD 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, And the like. The components shown in Fig. 1 are not essential for implementing the HMD, so that the HMD described in this specification can have more or fewer components than those listed above.

More specifically, the wireless communication unit 110 among the above-described components can communicate with the HMD 100 and the wireless communication system, between the HMD 100 and another HMD 100, between the HMD 100 and the mobile or fixed terminal, between the HMD 100 and the HMD 100, Between the HMD 100 and the control device, a camera installed outside the HMD 100 and capable of wireless communication), or between the HMD 100 and the external server.

Also, the wireless communication unit 110 may include one or more modules that connect the HMD 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the HMD, surrounding environment information surrounding the HMD, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the HMD disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do.

The interface unit 160 serves as a channel with various kinds of external devices connected to the HMD 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the HMD 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the HMD 100. The memory 170 may store a plurality of application programs (application programs or applications) driven by the HMD 100, data for operation of the HMD 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least a part of these application programs may be stored in the HMD 100 from the time of shipment for the basic functions of the HMD 100 (for example, screen information output function such as image, moving picture and the like, telephone call reception, 100). ≪ / RTI > Meanwhile, the application program may be stored in the memory 170, installed on the HMD 100, and may be driven by the controller 180 to perform the operation (or function) of the HMD.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the HMD 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1A in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 can operate at least two of the components included in the HMD 100 in combination with each other for driving the application program.

Under the control of the control unit 180, the power supply unit 190 receives external power and internal power, and supplies power to the components included in the HMD 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the above components may operate in cooperation with each other to implement an operation, control, or control method of the HMD according to various embodiments described below. In addition, the operation, control, or control method of the HMD can be implemented on the HMD by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 1 before explaining various embodiments implemented through the HMD 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. At least two broadcast receiving modules may be provided to the HMD 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server includes a server for generating and transmitting broadcast signals and / or broadcast-related information, a device for receiving the generated broadcast signals and / or broadcast-related information and controlling the HMD in association with the HMD or the HMD For example, a control device, a terminal, or the like). The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcasting signal may be encoded according to at least one of technical standards for transmitting and receiving a digital broadcasting signal (or a broadcasting system, for example, ISO, IEC, DVB, ATSC, etc.) It is possible to receive the digital broadcasting signal using a method conforming to the technical standard defined by the technical standards.

The broadcast-related information may be information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms, for example, an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). The broadcast signal and / or the broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 170.

 The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) And an external terminal, or a server on a mobile communication network established according to a long term evolution (e. G., Long Term Evolution-Advanced).

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the HMD 100 or externally. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short range communication module 114 is a module for communicating with the HMD 100 and the other HMD 100 between the HMD 100 and the wireless communication system via the wireless area networks, A wireless communication between the HMD 100 and the control device, a camera installed outside the HMD 100 and wireless communication between the HMD 100 and the external server, or between the HMD 100 and the external server. The short-range wireless communication network may be a short-range wireless personal area network.

Here, the HMD is a device (for example, a mobile phone, a smart phone, a smartwatch, a smart phone, etc.) capable of exchanging data with the HMD 100 according to the present invention. A notebook computer, a control device, etc.). The short-range communication module 114 may sense (or recognize) a device capable of communicating with the HMD 100 around the HMD 100. Further, when the sensed device is a device authenticated to communicate with the HMD 100 according to the present invention, the control unit 180 transmits at least a part of the data processed in the HMD 100 through the short- To the device, and may transmit at least a portion of the data processed by the device to the HMD 100. [

Accordingly, the user of the HMD 100 can utilize the data processed in the device through the HMD 100. [ For example, according to this, the user can make a phone call through the HMD 100 when a phone is received in the device, or confirm the received message via the HMD 100 when a message is received in the device It is possible.

The position information module 115 is a module for obtaining the position (or current position) of the HMD, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, an HMD can acquire the position of an HMD by using a signal sent from a GPS satellite by using a GPS module. As another example, the HMD can utilize a Wi-Fi module to acquire the position of the HMD based on information of a wireless access point (wireless AP) that transmits or receives a wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other modules of the wireless communication unit 110 to obtain replacement or additionally data regarding the location of the HMD. The position information module 115 is a module used to acquire the position (or current position) of the HMD, and is not limited to a module that directly calculates or acquires the position of the HMD.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, the HMD 100 may include one or A plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ The plurality of cameras 121 provided in the HMD 100 may be arranged to have a matrix structure and the HMD 100 may be provided with a plurality of cameras 121 having a variety of angles or foci Can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or an application program being executed) being performed by the HMD 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user. When information is input through the user input unit 123, the controller 180 can control the operation of the HMD 100 to correspond to the input information. The user input unit 123 may include a mechanical input unit (or a mechanical key such as a button located on the front / rear or side of the HMD 100, a dome switch, a jog wheel, Switches, etc.) and touch-based input means. As an example, the touch-type input means may be at least one of a touch pad and a touch panel.

Meanwhile, the sensing unit 140 senses at least one of information in the HMD, surrounding environment information surrounding the HMD, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the HMD 100 or may perform data processing, function or operation related to the application program installed in the HMD 100, based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed within the HMD enclosed by the touch screen or proximity sensor 141 near the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch-type input means of the user input unit 123 is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with the change of the electric field along the proximity of the object having conductivity. In this case, the user input unit 123 itself may be classified as a proximity sensor.

For the sake of convenience of explanation, the act of allowing the user to recognize that the object is located on the user input unit 123 without touching the object on the user input unit 123 is referred to as "proximity touch" Quot; contact touch ", and an action of actually touching an object on the user input unit 123 is called "contact touch. &Quot; The position where the object is touched on the user input unit 123 means the position where the object corresponds vertically to the user input unit 123 when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data Can be output on the display unit 151. Further, the control unit 180 controls the HMD 100 to process different operations or data (or information) according to whether the touch on the same point on the user input unit 123 is a proximity touch or a contact touch .

The touch sensor senses a touch (or touch input) applied to the user input unit 123 using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, and a magnetic field type.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the user input portion 123 or a capacitance occurring in a specific portion to an electrical input signal. The touch sensor can be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where the touch target object touching the user input unit 123 is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the user input unit 123 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object to which the user input unit 123 is touched. Whether to perform different controls or to perform the same control according to the type of the touch target object can be determined according to the operation state of the current HMD 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above may be used independently or in combination to provide a short (or tab) touch, a long touch, a multi touch, a drag touch such as a drag touch, a flick touch, a pinch-in touch, a pinch-out touch, a swipe touch, a hovering touch, Various types of touches can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information to be processed by the HMD 100. For example, the display unit 151 may display execution screen information of an application program driven by the HMD 100, or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information.

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

Generally, 3D stereoscopic images consist of left image (left eye image) and right image (right eye image). A top-down method of arranging a left image and a right image in one frame according to a method in which a left image and a right image are combined into a three-dimensional stereoscopic image, A checker board system in which pieces of a left image and a right image are arranged in a tile form, a left-to-right (right-side) Or an interlaced method in which rows are alternately arranged, and a time sequential (frame-by-frame) method in which right and left images are alternately displayed in time.

In addition, the 3D thumbnail image may generate a left image thumbnail and a right image thumbnail from the left image and right image of the original image frame, respectively, and may be generated as one image as they are combined. In general, a thumbnail means a reduced image or a reduced still image. The left image thumbnail and the right image thumbnail generated in this way are displayed on the screen with a difference of the left and right distance by the depth corresponding to the parallax between the left image and the right image, thereby exhibiting a stereoscopic spatial feeling.

The left and right images necessary for realizing the three-dimensional stereoscopic image can be displayed on the stereoscopic display unit by the stereoscopic processing unit. The stereoscopic processing unit receives a 3D image (an image at a reference time point and an image at an expansion point), sets a left image and a right image therefrom, or receives a 2D image and converts it into a left image and a right image.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals associated with functions (e.g., call signal reception sound, message reception sound, and the like) performed by the HMD 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit a tactile effect through direct contact, and can also be implemented so that a user can feel a tactile effect through muscles such as a head, a face, a finger or an arm. At least two haptic modules 153 may be provided according to the configuration of the HMD 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the HMD 100. Examples of the event generated in the HMD 100 include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an e-mail reception, reception of information through an application, and output of an image (image, video, etc.). That is, the light output unit 154 may notify that the HMD 100 is performing a specific operation (function) by the user.

The signal output by the light output unit 154 is implemented when the HMD emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated based on whether the HMD detects the user's event confirmation or ends the operation being performed in the HMD.

The interface unit 160 serves as a path for communication with all external devices connected to the HMD 100. The interface unit 160 receives data from an external device or supplies power to each component in the HMD 100 or allows data in the HMD 100 to be transmitted to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the usage right of the HMD 100 and includes a user identification module (UIM), a subscriber identity module (SIM) a universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

When the HMD 100 is connected to an external cradle, the interface unit 160 may be a path through which power from the cradle is supplied to the HMD 100, or various commands A signal may be transmitted to the HMD 100. Various command signals or power from the cradle can be operated as a signal for recognizing that the HMD 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The HMD 100 may operate in association with a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operation related to the application program and the general operation of the HMD 100. For example, when the state of the HMD satisfies a set condition, the controller 180 may execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 may perform control and processing related to voice communication, data communication, video call, and the like, or may perform pattern recognition (e.g., voice recognition, Processing can be performed. Further, the control unit 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the HMD 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the HMD body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Referring to FIG. 2A, FIG. 2A is a conceptual diagram of an HMD related to the present invention as viewed from one direction.

Referring to FIG. 2A, the HMD 100 related to the present invention is configured to be worn on a head part (or a head, a face, a head) of a human body, and a frame part (a case, a housing, a cover, etc.) . The frame part may be formed of a flexible material to facilitate wearing. In this figure, the frame portion includes a first frame 101 and a second frame 102 of different materials.

For example, the first frame 101 serves to provide a space in which at least one of the components described in FIG. 1 can be disposed, and the second frame 102 serves to provide a space in which the first frame 101 (Or fixed) to be mountable on the head of the human body.

The frame portion may be referred to as a body (or an HMD body) or a body (or an HMD body). Here, the HMD body (or the HMD body) may be understood as a concept of referring to the HMD 100 as at least one aggregate.

The frame portion is supported on the head portion, and a space for mounting various components is provided. Electronic parts such as a camera 121, an output unit, a user input unit 123, light emitting units 200a, 200b and 200c, a control unit, a sensing unit, and the like may be mounted on the first frame 101. [ Here, the display unit 151 may be formed to cover at least one of the left and right eyes of the user (or to face at least one of the left and right eyes of the user), and may be removably formed.

The second frame 102 may be provided with electronic components such as an acoustic output unit 152, a light emitting unit 103f, and the like. However, the present invention is not limited to this, and the components described in FIG. 1 and the components necessary for the HMD may be variously arranged in the first frame 101 and the second frame 102 according to the user's selection.

The control unit 180 (see FIG. 1) is configured to control various electronic components provided in the HMD 100. The control unit 180 can be understood as a configuration corresponding to the control unit 180 described with reference to FIG.

The display unit 151 is mounted on the frame unit and outputs screen information (e.g., image, image, moving picture, etc.) in front of the user's eyes. When the user wears the HMD 100, the display unit 151 may be arranged to correspond to at least one of the left and right eyes so that screen information can be displayed before the user's eyes. In this drawing, the display unit 151 is positioned so as to cover both the left and right eyes so that an image can be output toward both the left and right eyes of the user.

Also, the display unit 151 can project an image using the prism to the user's eyes. Further, the prism may be formed to be transmissive so that the user can view the projected image and the general view of the front (the range that the user views through the eyes) together.

As described above, the image output through the display unit 151 can be seen overlapping with the general view. The HMD 100 can provide an Augmented Reality (AR) in which a virtual image is superimposed on a real image or a background and displayed as a single image by using the characteristics of the display.

The camera 121 is disposed adjacent to at least one of the left eye and the right eye, and is configured to photograph a forward image. Since the camera 121 is disposed adjacent to the eye and facing forward, the camera 121 can acquire a scene viewed by the user as an image.

In this figure, one camera 121 is provided, but the present invention is not limited thereto. The plurality of cameras 121 may be provided to acquire stereoscopic images.

The HMD 100 may include a user input unit 123 operated to receive a control command. The user input unit 123 can be employed in any manner as long as it is a tactile manner in which a user touches or pushes a tactile feeling. In this drawing, it is exemplified that a user input part 123 of a push and touch input method is provided in a frame part.

In addition, the HMD 100 may include a microphone (not shown) for receiving sound and processing the sound as electrical voice data and an acoustic output unit 152 for outputting sound. The sound output unit 152 may be configured to transmit sound in a general sound output mode or a bone conduction mode. When the sound output unit 152 is implemented in a bone conduction manner, when the user wears the HMD 100, the sound output unit 152 is closely attached to the head and vibrates the skull to transmit sound.

If the frame portion including the first frame 101 and the second frame 102 is regarded as one HMD body (hereinafter referred to as "body"), the body of the HMD related to the present invention may be formed in various forms . Specifically, the body may include a plurality of surfaces 103a, 103b, and 103c having predetermined angles. The plurality of surfaces refer to the surfaces located outside the body of the HMD 100. From this viewpoint, the plurality of surfaces may mean the surface (outer surface, outer surface, etc.) of the HMD 100. Each of the plurality of surfaces 103a, 103b, and 103c may be flat or curved.

Meanwhile, the display unit 151 of the HMD related to the present invention may be located inside the main body. Specifically, the display unit 151 is disposed inside the HMD, and when the HMD is worn on the user's head, the display unit 151 can be disposed at a position facing the user's eyes.

In Fig. 2A, a body is shown in which a plurality of surfaces 103a, 103b, and 103c are perpendicular to each other. Hereinafter, for the sake of convenience of explanation, an HMD formed so that a plurality of planes are perpendicular to each other will be described as an example. However, the same description is applicable to all types of HMDs including a plurality of planes having predetermined angles, Similar analogy can be applied.

The second frame 102 of the HMD may also include a plurality of surfaces. It is to be understood that in the present invention, one of the surfaces 103f included in the second frame 102 is included in a plurality of surfaces of the HMD body. The one surface 103f may be located at the back of the user.

For example, referring to FIG. 2A, the HMD of the present invention may include a plurality of surfaces. The plurality of surfaces may include a front surface 103a, a left surface 103b, a bottom surface 103c, a right surface 103d, an upper surface 103e, and a rear surface 103f.

The HMD 100 related to the present invention may include a plurality of light emitting units each formed on a plurality of surfaces of the main body and emitting light to the outside of the main body. Specifically, the plurality of light emitting units may be formed on a plurality of surfaces of the main body, respectively, and may be formed to emit light to the outside of the main body. Here, the plurality of light emitting units are respectively formed on the plurality of surfaces of the main body means that a plurality of light emitting units are formed for each of the plurality of surfaces, not a plurality of light emitting units are formed for each of the plurality of surfaces do.

2A, the first light emitting unit 200a is provided on the front surface 103a, the second light emitting unit 200b is provided on the left surface 103b, and the second light emitting unit 200b is provided on the bottom surface 103c, 3 light emitting units 200c may be provided. Although not shown, the right side surface 103d, the upper side surface 103e, and the rear surface 103f may each be provided with a light emitting unit.

The plurality of light emitting units can be used for determining (or estimating, tracking, detecting, extracting, determining, identifying, recognizing, etc.) the attitude of the HMD 100. For example, the present invention may include a control device for determining the attitude of the HMD 100, and the control device may use the plurality of light emitting units respectively formed on a plurality of surfaces of the HMD 100, It is possible to determine the posture of the robot 100.

The attitude of the HMD 100 includes a state in which the HMD is laid (a state in which the HMD is worn on the head of the user), a degree of inclination of the HMD, a direction in which the HMD is viewed, a position of the HMD, As shown in Fig. In addition, the determination of the posture of the HMD 100 in the present invention may include the determination of the posture and the movement of the user wearing the HMD 100.

A method of determining the posture of the HMD 100 using a plurality of light emitting units provided in the HMD by the control apparatus will be described later in more detail with reference to FIGS. 3A to 3C, 7A, 7B and 8 .

Each of the plurality of light emitting units may include a plurality of light emitting elements. Each light emitting unit may be formed such that the plurality of light emitting elements have different patterns (arrays) so that a plurality of surfaces are distinguished.

For example, a pattern (or an array) in which a plurality of light emitting elements included in the light emitting unit 200a provided on the front surface 103a are arranged may be arranged on a surface (for example, the left surface 103b) May be different from the pattern in which the plurality of light emitting elements included in the light emitting unit (for example, the light emitting unit 200b provided on the right side 103b) are arranged.

The control device can identify the light emitting units based on the plurality of light emitting elements arranged on the plurality of surfaces to have different patterns and determine the posture of the HMD using the identified light emitting units.

Hereinafter, referring to FIG. 2B, a light emitting unit disposed on a plurality of surfaces of the HMD 100 body according to the present invention will be described in more detail. 2B is a conceptual diagram illustrating a light emitting device provided in the HMD.

The light emitting element included in the light emitting unit of the present invention may include various elements. For example, the light emitting element may be any element as long as it is a light emitting element. For example, the light emitting element may include an infrared ray element, an LED (Light Emitting Diode) element, and the like.

Each of the plurality of light emitting units 200a, 200b, 200c, 200d, 200e, and 200f may include at least four light emitting devices spaced apart in a straight line so that a specific cross-ratio is determined.

Here, the fact that the at least four light emitting devices are arranged in a straight line means that the at least four light emitting devices are arranged in a row, which means that the at least four light emitting devices are arranged in one direction.

For example, referring to FIG. 2B, the first light emitting unit 200a provided on one of the plurality of surfaces of the HMD 100 main body (for example, the front surface 103a) (200a, 200b, 200c) provided on at least one of the plurality of surfaces (for example, the left surface (103b)) and at least four light emitting devices The unit 200b may also include at least four light emitting devices 201b, 202b, 203b, and 204b disposed in a straight line. The light emitting unit provided on each of the lower surface 103c, the right surface 103d, the upper surface 103e and the rear surface 103f may include at least four light emitting elements spaced apart in a straight line (hereinafter, The front surface 103a and the left surface 103b will be described as examples of the front surface and the left surface, and the description of the front surface and the left surface may be applied to the entire surface of the main body.

The cross-ratios of the plurality of light emitting units may be different from each other so that the plurality of surfaces are distinguished. The non-harmonizing ratio may be determined by at least four light emitting elements arranged on a straight line included in the light emitting unit. Specifically, the non-harmonization ratio may be determined based on the distance between the at least four light emitting elements arranged in a straight line or the ratio of the distance.

That is, the first light emitting unit 200a includes at least four light emitting devices 201a, 202a, 203a, and 204a arranged so as to have a first non-matching ratio (to be formed) At least four light emitting devices 201b, 202b, 203b, and 204b may be disposed on the other second light emitting unit 200b so as to have a second non-matching ratio different from the first non-matching ratio.

In addition, each of the plurality of light emitting units may further include at least two light emitting elements disposed at a position spaced from a straight line in which at least four light emitting elements are disposed. For example, referring to FIG. 2B, the first light emitting unit 200a provided on one of the plurality of surfaces (for example, the front surface 103a) includes at least four Not only the light emitting devices 201a, 202a, 203a and 204a but also at least two light emitting devices 205a and 206a disposed at positions spaced apart from the straight line 11 may be further included.

Likewise, the second light emitting unit 200b provided on the other surface (for example, the left surface 103b) of the plurality of surfaces is also provided with at least four light emitting elements 200b arranged on the straight line 12, And at least two light emitting devices 205b and 206b disposed at positions apart from the straight line 12 as well as the light emitting devices 201b, 202b, 203b, and 204b.

At least two light emitting elements arranged at a position spaced from the straight line can be used for the controller to determine the posture of the HMD. At least two light emitting elements arranged at a position spaced apart from the straight line will be described later in more detail with reference to FIG. 4 to FIG.

Hereinafter, the cross-ratio will be described in detail.

The cross-ratio can be named as the ratio, the double ratio, and the anharmonic ratio. The nonconforming ratio is the only projection invariance of the four points on the same straight line in the projected geometry. Specifically, the non-harmonization ratio may be a value (value, number) associated with four points in the collinear.

For example, if it is assumed that four points (point A, point B, point C, and point D) are arranged in the same line order (or on any one line, straight line) The non-harmonious ratios (A, B; C, D) can be defined as in Equation (1).

Where d_AC is the separation distance between points A and C, d_BD is the separation distance between points B and D, d_BC is the separation distance between points B and C, and d_AD is the separation distance between points A and D .

That is, the non-coherence ratios A, B, C, and D of points A, B, C, and D can be determined by the separation distance between the points. It can also be understood that the non-harmonious ratios A, B, C and D are determined by the ratio of the separation distance between the respective points.

For example, a ratio (d_AB) of a distance d_AB between the points A and B, a distance d_BC between the points B and C, and a distance d_CD between the points C and D, (p, q, and r are real numbers), the dynamics of the point A, the point B, the point C, and the point D (point A) , B; C, D) may be {(p + q) * (q + r)} / {q * (p + q + r)}.

On the projected line passing through the point A and the point P with respect to a point P spaced from the straight line in which the points A, B, C, and D are arranged, A point B 'existing on the projection line passing through the point P and the point C' existing on the projection line passing through the point C and the point P, Point, the point B ', and the point C' when the point D and the point D 'existing on the projection line passing through the point P and the point D are present in the same line (or straight line) (B ', C', D ') of the points D' and D 'may be as shown in the following equation (2).

Here, d_A'C 'is the distance between points A' and C ', d_B'D' is the distance between points B 'and D', d_B'C 'is the distance between points B' and C ' d_A'D 'is the distance between point A' and point D '.

Referring to Equations 1 and 2, even if d_AC and d_A'C ', d_BD and d_B'D', d_BC and d_B'C ', d_AD and d_A'D' are different from each other, (A ', B'; C ', D) of points A', B ', C' and D ' Are the same.

In other words, four projection lines (for example, first to fourth projection lines) passing through the point P and not parallel to each other and the four projection lines The intersection of the first straight line intersecting is defined as A point, B point, C point, and D point.

The intersection points of the four projection lines and the second straight line which are different from the first straight line and intersect with the four projection lines without passing through the one point P are referred to as A 'point, B' point, C ' D 'point.

Here, the point A 'exists on the same projection line (for example, the first projection line) as the point A, and the point B' exists on the same projection line (for example, the second projection line) (For example, a third projection line) identical to the point C, and the point D 'is a point on the same projection line (for example, the fourth projection line) as the point D .

In this case, the non-harmonization ratio A ', B', C 'and D' of the points A ', B', C 'and D' of the points A, B, , B '; C', D) are the same.

In other words, the non-coherence ratios of the four intersections at which the four projection lines and the arbitrary straight line intersect each other exist (constant), which are on the four projection lines passing through the one point P and not parallel to each other.

In the present invention, the attitude of the HMD and a plurality of surfaces of the HMD main body can be identified using the above-described non-harmonization ratio. That is, the points A, B, C, and D described above can be understood as corresponding to at least four light emitting elements arranged on a straight line included in the light emitting unit.

As described above, the plurality of light-emitting units respectively formed on the plurality of surfaces of the HMD body of the present invention includes at least four light-emitting elements spaced on a straight line so that a specific cross-ratio is determined .

At this time, the non-coherence ratio of the plurality of light emitting units of the present invention may be different from each other so that a plurality of faces are distinguished. The non-coherence ratio of the plurality of light-emitting units may mean a non-coherence ratio determined by at least four light-emitting elements arranged on a straight line included in the plurality of light-emitting units.

Specifically, the non-coherence ratio can be determined based on a ratio of the spacing distances among the at least four light emitting elements, and the plurality of light emitting units are arranged between the at least four light emitting elements May be formed to be different from each other.

That is, the ratio of the spacing distances between at least four light emitting elements included in any one of the plurality of light emitting units is set so that at least four light emitting units included in the light emitting units other than the one of the plurality of light emitting units May be different from the ratio of the spacing distances between the light emitting elements.

For example, referring to FIG. 2B, the first light emitting unit 200a included in the first light emitting unit 200a provided on one of the plurality of surfaces (for example, the front surface 103a) The ratio of the spacing distances between at least four light emitting devices 201a, 202a, 203a, 204a disposed can be arranged to have a first ratio (p: q: r).

In this case, the second light emitting unit 200b included in the second light emitting unit 200b provided on the other surface (for example, the left surface 103b) of the plurality of surfaces and disposed on the straight line 12 The ratio of the spacing distances between at least four light emitting devices 201b, 202b, 203b and 204b is different from the first ratio (p: q: r) (where p, q and r are real numbers) s: t: u) where s, t, u are real numbers.

Here, the fact that the plurality of light emitting units are formed so that the ratios of the spacing distances between the at least four light emitting elements are different from each other means that the spacing distances between at least four light emitting elements arranged on a straight line included in any one light emitting unit (That is, p, q, and r are different from each other). That is, the fact that the plurality of light emitting units are formed so that the ratios of the spacing distances among the at least four light emitting elements are different from each other means that the ratio of the spacing distances between the at least four light emitting elements arranged on the straight line included in the first light emitting unit (For example, (p: q: r)) is a ratio of the spacing distances between at least four light emitting elements arranged in a line on a straight line included in the second light emitting unit other than the first light emitting unit , (s: t: u)).

Here, p, q, and r may be the same or at least one may be different. The same is true for s, t, u. That is, p, q, r, s, t, and u are the ratios (p: q: r) of the spacing distances between the light emitting elements arranged on a straight line and included in the first light emitting unit among the plurality of light emitting units ) And the ratio (s: t: u) of the spacing distances between the first light emitting unit and the second light emitting unit disposed on a straight line spaced apart from each other among the plurality of light emitting units have.

For example, when the ratio of the spacing distances between at least four light emitting units arranged on a straight line and included in the first light emitting unit is (1: 2: 1), the second light emitting unit It is understood that when the ratio of the spacing distances between at least four light emitting units arranged on a straight line included in the light emitting unit is (1: 1: 2), the ratios of the spacing distances are different from each other. Accordingly, the non-coherence ratio of the light emitting units arranged such that the ratio of the spacing distances is (1: 2: 1) is set such that the ratio of the spacing distances is (1: 1: 2) different.

On the other hand, when the ratios of the distances are (2: 1: 1) and (1: 1: 2), they have the same non-coherence ratios.

In summary, the HMD 100 related to the present invention includes at least four light emitting devices 201 to 204 spaced on a straight line on a plurality of surfaces 103a to 103f, respectively, The at least four light emitting devices may be disposed on a straight line so as to have a different distance between the light emitting devices.

3A to 3C, a method of identifying a plurality of faces of the HMD 100 using at least four light emitting elements arranged so that different non-matching ratios are determined for each of a plurality of faces of the HMD body Will be described in more detail with reference to the accompanying drawings.

Figs. 3A, 3B, and 3C are conceptual diagrams for explaining the non-matching ratio used to distinguish a plurality of faces of the HMD.

3A, the present invention can be applied to a camera 300 provided outside the HMD 100 and a video image (or information, data or the like) received through the camera 300 to determine the attitude of the HMD 100 And a control unit 400 for determining the posture of the HMD 100 based on the control signal.

In this specification, for convenience of explanation, it is assumed that the control device 400 capable of communicating with the HMD 100 determines the posture of the HMD. However, the present invention is not limited to this, and the following description is made on the assumption that the HMD 100 receives an image (or information, data, etc.) from the camera 300, It is possible to determine the posture of the HMD 100 (its own posture).

The camera 300 may be provided to photograph (photograph) the HMD 100 from outside the HMD 100. The camera 300 oriented toward the HMD 100 may receive an image including a graphic object corresponding to the HMD 100. [ The camera 300 may be controlled by at least one of the HMD 100 and the controller 400. [

The camera 300 may include various types of cameras. The camera 300 may include any type of camera capable of sensing the light emitted by the light emitting device of the HMD 100, and may include an infrared camera, for example.

3A, the HMD 100 related to the present invention includes a plurality of surfaces, and each of the plurality of surfaces is provided with at least four light emitting elements (light emitting elements) A light emitting unit 200a including the light emitting units 201a, 202a, 203a, and 204a may be provided.

3A, the camera 300 is arranged to photograph any one of a plurality of surfaces of the HMD 100 (for example, the front surface 103a). 3A, the ratio of the spacing distances between at least four light emitting devices 201a, 202a, 203a, and 204a on one of the surfaces 103a is (p: q: r). Although not shown, each of the plurality of planes of the HMD may have at least four light emitting elements arranged in a straight line spaced apart from one another so as to have a different spacing ratio.

The control device 400 can determine the posture of the HMD 100 based on information (for example, preview image) received through the camera 300. Specifically, the control device 400 senses light emitted from the light emitting device provided in the HMD 100 through the camera 300, and detects light emitted from the plurality of surfaces of the HMD 100 (Or the surface facing the camera 300) through the camera 300 can be identified.

The controller 400 calculates a non-coherence ratio of at least four light emitting elements arranged on a straight line provided in the HMD 100 based on the light received through the camera 300, The face to be photographed through the camera 300 among the plurality of faces of the HMD 100 can be identified.

3B and 3C, any one of a plurality of surfaces (for example, the front surface 103a) provided in the main body of the HMD 100 will be described as an example.

The control unit 180 of the HMD 100 may control the light emitting device so that the light emitting device provided in the HMD 100 emits light based on the predetermined condition being satisfied. The predetermined condition is that the power of the HMD 100 is turned on, a control command of the user is received, and a function associated with the posture of the HMD 100 among the functions of the HMD 100 is executed A control signal for controlling emission of light from the control device 400 (or the camera 300) is received, and the like.

The control device 400 can sense the light emitted from the HMD 100 using the camera 300. Here, the camera 300 may be switched from an inactive state (or an off state) to an active state (or an on state) on the basis of satisfying the predetermined condition.

Each light emitted from at least four light emitting devices 201a, 202a, 203a, and 204a arranged on a straight line is incident on the camera 300 (or a camera lens) based on the characteristic that the light travels straight. Here, the camera 300 may correspond to one point P among the contents described with respect to the non-matching ratio in FIG. 2B.

The control device 400 determines at least four intersections 201a 'and 202a', which intersect the arbitrary straight line with the path of the received light, based on the received light in the image 350 received through the camera 300. [ , 203a ', 204a'. Thereafter, the controller 400 calculates the non-matching ratio based on the ratio of the distances between the at least four intersections 201a ', 202a', 203a ', and 204a', and based on the calculated non-matching ratio The face of the HMD 100 facing the camera 300 can be identified.

3B, a virtual line extending from the camera 300 (or a camera lens) may be formed on any one of a plurality of surfaces provided on the main body of the HMD 100 (for example, The distance between the at least four light emitting devices 201a, 202a, 203a, 204a arranged on a straight line on one of the surfaces is equal to the distance between the at least four intersection points (P: q: r) of the separation distances between the first electrodes 201a ', 202a', 203a ', and 204a'. The controller 400 calculates the non-harmonization ratio based on the ratio (p: q: r) of the distances between the at least four intersections 201a ', 202a', 203a ', 204a' Based on the non-harmonization ratio, multiple faces of the HMD 100 can be identified. In the case of FIG. 3B, the control device 400 determines whether or not the surface of the HMD 100 that is photographed through the camera 300 (or the camera 300 facing the camera 300) on the basis of the calculated non- Face) is the front face 103a.

As another example, if an imaginary line extending from the camera 300 (or camera lens) is not perpendicular to any one of the surfaces 103a (e.g., the HMD is tilted or rotated , The ratio (p: q: r) of the spacing distances between at least four light emitting devices 201a, 202a, 203a, 204a arranged on a straight line on any one of the surfaces, (N: k: i) (where n, k, i are real numbers) of the distances between the intersections 201a ', 202a', 203a 'and 204a'. That is, when the HMD 100 is tilted or rotated with respect to the camera 300, at least four light emitting devices 201a (see FIG. 1) disposed on a straight line provided in the HMD 100 viewed from the camera 300, , 202a, 203a, 204a (or the ratio of the spacing distances) is different.

However, even if the ratios (p: q: r) and (n: k: i) of the spacing distances are different, the at least four light emitting devices 201a, 202a, 203a, As shown in FIG. 3C, the light beams 201a ', 202a', 203a ', and 204a' pass through the camera 300 (one point P) exist.

Therefore, it is preferable that at least four light emitting devices 201a, 202a, 203a, and 204a having a spacing ratio of (p: q: r) The incompatibility ratios of the four intersection points 201a ', 202a', 203a 'and 204a' are the same.

The controller 400 calculates the non-harmonization ratio based on the ratio (n: k: i) of the distances between the at least four intersections 201a ', 202a', 203a ', 204a' It is possible to identify a plurality of sides of the HMD 100 based on the harmonic ratio. 3C, the control device 400 determines whether or not the face of the HMD 100 that is photographed through the camera 300 (or faces toward the camera 300) on the basis of the calculated non- Face) is the front face 103a.

With this configuration, in the present invention, by using the non-harmonizing ratio, even if the HMD 100 is rotated or tilted, it is possible to accurately distinguish (identify) a plurality of faces of the HMD 100. Further, in the present invention, it is possible to provide an HMD having at least four light emitting elements spaced apart in a straight line so as to have different non-harmonization ratios on each of the plurality of surfaces so that a plurality of surfaces of the HMD 100 are distinguished have.

Hereinafter, a position where the light emitting device is disposed in the HMD 100 related to the present invention and a method of emitting light by the light emitting device will be described in more detail with reference to the accompanying drawings.

FIGS. 4, 5, and 6 are conceptual diagrams for explaining positions where light emitting elements are arranged in the HMD.

The HMD 100 related to the present invention may include a plurality of light emitting units on each of a plurality of surfaces, and the light emitting units may include at least four light emitting elements arranged in a straight line.

Here, the non-coherence ratios of the plurality of light emitting units may be different from each other. Specifically, the plurality of light emitting units may be formed such that the ratio of the spacing distance between the at least four light emitting elements is different from each other such that the non-matching ratio of the plurality of light emitting units is different.

Referring to FIG. 4, the ratio of the spacing distances between at least four light emitting elements arranged in a straight line on each of the plurality of surfaces may be as shown in Table 1.

A plurality of faces Percentage of separation distance
(AB: BC: CD) Non-harmonizing ratio
(AC * BD) / (BC * AD) The front surface 103a 1: 3: 1 1.06 The left side 103b 1: 1: 2 1.5 The lower side 103c 1: 1: 3 1.6 The right side surface 103d 1: 1: 1 1.33 The upper surface 103e, 2: 2: 1 1.2 The rear surface 103f 2: 1: 2 1.8

Here, A, B, C, and D represent at least four light emitting elements arranged in a straight line on a plurality of planes, as shown in FIG. AB, BC, CD, AC, BD, BC and AD mean the ratio (or separation distance) of the distance between the light emitting elements.

However, at least four light emitting devices included in the HMD 100 of the present invention are not limited to the values shown in Table 1. It should be understood that the HMD 100 of the present invention is included in the scope of the present invention as long as at least four light emitting elements arranged in a straight line on a plurality of surfaces are arranged to have different non-harmonization ratios.

In FIGS. 4 and 5, reference numerals for the light emitting elements arranged on the front surface 103a are denoted by A instead of 201a, B by 202a, C by 203a, D by 204a instead of 205a, do. The light emitting elements disposed on the left side 103b, the lower side 103c, the right side 103d, the upper side 103e and the rear side 103f are denoted by the same reference numerals as the front side 103a, ) Will be mainly described. The description of the front surface 103a is made on the surface of the main body other than the front surface 103a (for example, the left surface 103b, the lower surface 103c, the right surface 103d, the upper surface 103e And the rear surface 103f) can be applied to the same / similar analogy.

The plurality of light emitting units 200a, 200b, 200c, 200d, 200e, and 200f provided on each of the plurality of surfaces 103a, 103b, 103c, 103d, 103e, and 103f includes at least four light emitting units (A, B, C, D).

Here, two light emitting devices among the at least four light emitting devices A, B, C, and D may emit light in a different manner from the remaining light emitting devices.

The two light emitting devices may emit light so that the brightness of the light changes at a predetermined time interval. Hereinafter, the two light emitting elements are referred to as a first light emitting element. In addition, the first light emitting device (the two light emitting devices) may be referred to as a 'blink light emitting device' in terms of emitting light such that the brightness of light changes at a predetermined time interval.

Meanwhile, the remaining light emitting device may emit light so as to have a predetermined brightness of light. Hereinafter, the remaining light emitting element is referred to as a second light emitting element. In addition, the second light emitting device (the remaining light emitting device) may be referred to as a 'static light emitting device' in terms of emitting light with a predetermined light brightness.

The first light emitting device that emits light in such a manner that the brightness of light changes at the predetermined time interval may include a light emitting device A and D disposed at both ends of the at least four light emitting devices A, ). In this case, the second light emitting device that emits light with the predetermined light brightness may be a light emitting device disposed between the first light emitting devices A and D.

However, the present invention is not limited to this, and the first light emitting device may be any two of the at least four light emitting devices A, B, C, For example, when the first light emitting device corresponds to B and D, the second light emitting device may be the remaining light emitting devices A and C that are in line with the first light emitting device. Hereinafter, for convenience of explanation, it is assumed that the first and second light emitting devices are A and D, and the second light emitting device is B and C, respectively.

Meanwhile, in the present invention, the brightness of light that changes in the first light emitting elements may be controlled to change at a predetermined reference brightness or more. That is, the controller 180 may emit light in such a manner that the brightness of the light is varied at predetermined time intervals in the first light emitting devices above the preset reference brightness.

For example, when the predetermined reference brightness is a brightness of 50% of the maximum brightness that the light emitting device can output, the first light emitting device A and the first light emitting device D are turned on at a predetermined time interval, (for example, 50% - > 100% - > 50% - > 100) than the predetermined reference brightness (50% % ...) can emit light. The control unit 180 controls the brightness of the light emitted from the two light emitting devices 201a and 204a to be greater than a predetermined reference brightness because the control unit 400 controls the two light emitting units 201a and 204a ) To keep track of.

However, the present invention is not limited thereto, and the first light emitting devices may emit light in a form of being turned on and off at a predetermined time interval.

The plurality of light emitting units 200a, 200b, 200c, 200d, 200e, and 200f may further include at least two light emitting devices E and F disposed at positions spaced apart from the straight line.

The at least two light emitting devices E and F may be referred to as a third light emitting device which is disposed at a position spaced from the straight line and emits light so as to have a predetermined brightness of light. Here, the third light emitting device, like the second light emitting device, may be referred to as a 'static light emitting device' in terms of emitting light with a predetermined light brightness.

At this time, the second light emitting devices B and C and the third light emitting devices E and F may emit light to have the same light brightness or emit light having different light brightness.

The third light emitting devices E and F are used to determine the posture of the HMD 100. More specifically, the control device 400 (see FIG. 3A) for determining the attitude of the HMD 100 includes at least four light emitting devices A, B, C, and D The second light emitting elements), calculates the non-matching ratio, and identifies the plurality of faces using the calculated non-matching ratio.

The control device 400 then identifies at least two light emitting elements E, F (i.e., a third light emitting element) disposed at a position spaced from the straight line, and the identified at least two light emitting elements E, (For example, movement, tilt, rotation, and movement of the HMD 100) using at least one of the light emitting elements A, B, C, Etc.).

To this end, the two third light emitting devices E and F included in each of the plurality of light emitting units may be arranged to satisfy predetermined conditions.

The at least two light emitting devices E and F may include at least two light emitting devices among at least four light emitting devices A, B, C, and D arranged on a straight line, F may not be parallel to each other.

For example, the two third light emitting devices E and F may be formed by arranging any two of the first and second light emitting devices A, B, C, and D arranged in a straight line, And the straight lines formed by the third light emitting elements E and F may not be parallel to each other.

Here, the two light emitting devices may be light emitting devices A, D disposed at both ends of the at least four light emitting devices A, B, C, The two light emitting devices may be two first light emitting devices that emit light so that the brightness of the light changes at the predetermined time interval among the at least four light emitting devices A, B, C, have.

5, the light emitting unit 200a provided on the front surface 103a includes two light emitting elements A, B, C, and D arranged on the straight line 11 and spaced apart from each other. May be formed by at least two light emitting devices (E, F) arranged at positions spaced apart from the straight line (11) so that a straight line parallel to each other is not formed.

For example, when the two light emitting devices are the light emitting devices A and D disposed at both ends of the at least four light emitting devices A, B, C and D At least two light emitting elements E and F disposed at a position spaced apart from the straight line 11 are a straight line l1 connecting the A light emitting element and the D light emitting element and the E light emitting element and the F light emitting element The straight line 13 connecting the element A and the E light emitting element is not parallel and the straight line 12 connecting the A light emitting element and the E light emitting element and the straight line 14 connecting the D light emitting element and the F light emitting element are not parallel.

(A, B), (A, C), (B), (C), (B) and (D) (E, F) are spaced apart from the straight line (l1) so that straight lines formed by the light emitting elements (E, F, C or D) and the at least two light emitting elements As shown in FIG.

The HMD 100 may be configured such that the control device 400 is connected to any one of the at least four light emitting devices A, B, C, and D arranged in a straight line on the HMD 100, May be formed to judge the attitude of the HMD based on at least two light emitting elements (E, F) (or a shape of a figure formed by them) disposed at a position spaced from the straight line.

On the other hand, at least two light emitting elements arranged at a position spaced apart from a straight line included in any one of the plurality of light emitting units are arranged in a direction intersecting the light emitting direction of the light emitting unit, The light emitting element may be disposed closer to at least four light emitting elements included in any one of the light emitting units than the element.

Here, any one of the at least two light emitting elements included in one of the light emitting units may include a light emitting element disposed at one of the at least four light emitting elements included in any one of the light emitting units, May be disposed closer to the light emitting element disposed at both ends of at least four light emitting elements included in the other light emitting units.

Wherein at least one of the at least four light emitting elements included in one of the light emitting units is a light emitting element disposed at one end of at least four light emitting elements included in any one of the light emitting units, And may be a light emitting element closer to one light emitting element.

For example, as shown in Fig. 6, at least a light emitting unit 200a disposed at a position spaced apart from a straight line included in any one of the plurality of light emitting units 200a, 200b, 200c, 200d, 200e, The two light emitting devices 205a and 206a are connected to the light emitting devices 201b and 202b included in the light emitting units 200b, 200c, and 200d other than the light emitting units 200a of the plurality of light emitting units. At least four light emitting devices 201a, 202a, 202a, 202a, 202a, 202a, 202a, 202a, 202a, 202a, and 202a are disposed on a straight line included in any one of the light emitting units 200a, , 203a, 204a.

In addition, any one of the at least two light emitting devices 205a and 206a included in one of the light emitting units 200a may include at least four light emitting devices 205a and 205b included in one of the light emitting units 200a, At least four light emitting elements 200b, 200c, and 200e included in the light emitting units 200b, 200c, and 200e having different distances d1 from the light emitting elements (for example, 201a) disposed at either one of the light emitting elements 201a, 202a, D2, d3, d4, and d5 with the light emitting devices 201b, 204b, 201c, and 201e disposed at both ends of the device.

Here, the light emitting devices disposed at either one of the at least four light emitting devices 201a, 202a, 203a, and 204a included in one of the light emitting units 200a may be included in any one of the light emitting units 200a And may be a light emitting device closer to any one of the two light emitting devices 201a and 204a disposed at both ends of at least four light emitting devices 201a, 202a, 203a, and 204a. That is, when one of the light emitting devices is the light emitting device 205a, the light emitting device disposed at one of the ends is the light emitting device 201a, and when any one of the light emitting devices is the light emitting device 206a, May be a light emitting element 204a.

In other words, a position where at least two light emitting elements disposed at a position spaced apart from a straight line included in any one of the plurality of light emitting units is disposed may be a position adjacent to any one of the at least two light emitting elements Based on the distance from the light emitting unit disposed in the light emitting unit.

For example, in the case of the light emitting device 205a disposed adjacent to the left side surface 103b of at least two light emitting devices 205a and 206a included in the light emitting unit 200a provided on the front surface 103a, The light emitting device 205a disposed adjacent to the surface 103b is disposed on the opposite side of the light emitting device 200a provided on the front surface of the light emitting device 200a. The at least four light emitting devices 201a, 202a, 203a, A distance d1 between the elements 201a and 204a and the light emitting element 201a disposed close to the left side face 103b and a distance d2 between the light emitting elements 201a and 201b disposed on both ends of at least four light emitting elements, At least four light emitting elements arranged in a straight line spaced apart from each other by distances d2 and d3 to the light emitting elements 201b and 204b, lower side 103c and upper side 103e are formed on the left side 103b The arrangement position can be determined based on the distances d4 and d5 to the light emitting elements 201c and 201e arranged close to each other. The light emitting device 205a disposed adjacent to the left side surface 103b of the at least two light emitting devices 205a and 206a included in the light emitting unit 200a provided on the front surface 103a may be arranged such that the distance d1 is smaller than the distance d2 , d3, d4, d5.

As another example, in the case of the light emitting element 206a disposed adjacent to the right side 103d of at least two light emitting elements 205a and 206a included in the light emitting unit 200a provided on the front surface 103a, The light emitting device 206a disposed adjacent to the light emitting device 200a includes at least four light emitting devices 201a, 202a, 203a, and 204a disposed on the front surface of the light emitting device 200a, A distance r1 between the light emitting element 204a and the light emitting element 204a disposed close to the right side face 103d of the light emitting element 201a, 204a, Emitting element located closer to the right side 103d of the light-emitting elements of at least four light-emitting elements arranged in a straight line and spaced apart from the lower side 103c and the upper side 103e by distances r2 and r3 from the light- 204c, and 204e based on the distances r4 and r5. The light emitting element 206a disposed adjacent to the right side surface 103d of the at least two light emitting elements 205a and 206a included in the light emitting unit 200a provided on the front surface 103a has a distance r1 equal to the distance r2, r3, r4, r5.

6, at least four light emitting devices 201a, 201b disposed in a straight line in a light emitting unit 200a provided on the front surface 103a among a plurality of surfaces, The light emitting devices 201a and 204a disposed at both ends of the first light emitting devices 202a and 203a and the second light emitting devices 202a and 203a disposed at both ends of the light emitting devices 202a and 203a emit light so that the brightness of light is different at predetermined time intervals, And is a second light emitting element. In addition, the two light emitting devices 205a and 206a disposed at the positions spaced apart from the straight line are referred to as a third light emitting device.

The two third light emitting devices 205a and 206a included in any one of the plurality of light emitting units 200a, 200b, 200c, 200d, 200e, and 200f may include any one of the plurality of light emitting units The first to third light emitting devices 201b to 206b, 201c to 206c, 201d to 206d, 201e to 206e and 201f to 201f included in the light emitting units 200b, 200c, 200d, 200e, The first and second light emitting devices 201a to 204a included in any one of the light emitting units 200a may be disposed closer to any one of the light emitting units.

Specifically, the two third light emitting devices 205a and 206a included in any one of the light emitting units 200a are connected to the first light emitting devices 201a and 204a included in any one of the light emitting units 200a. D2, d3, d4, d5, r2, r3, d4, d2, d3 and d4 of the first light emitting devices 201b, 204b, 201c, 204c, 201d, r4, r5).

For example, the third light emitting device (e.g., 205a) of any one of the two third light emitting devices 205a and 206a included in any one of the light emitting units 200a, A distance d1 between any one of the first light emitting devices 201a and 204a included in the first light emitting device 200a closer to any one of the third light emitting devices 205a is smaller than a distance d1 between the first light emitting devices 201a and 204a, The distances d2, d3, d4, d2 between the two first light emitting devices (e.g., 201b, 204b, 201c, 201e) included in the different light emitting units and the third light emitting device 205a, d5. < / RTI >

When any one of the third light emitting devices 206a is included in one of the first light emitting devices 201a and 204a included in any one of the light emitting units 200a, The distance r1 between any one of the first light emitting devices 204a closer to any one of the third light emitting devices 206a is determined by the distance r1 between two first light emitting devices included in the other light emitting unit (R2, r3, r4, r5) between the first, second, third, and fourth light emitting devices 206a, 201d, 204d, 204c, 204e and any one of the third light emitting devices 206a.

This is for identifying (distinguishing) the light emitting units provided on each of the plurality of surfaces in the control device 400. [ Identifying the light emitting units provided on each of the plurality of surfaces may be understood to mean grouping the light emitting elements provided on each surface into a group.

Specifically, the control device 400 may group at least four light emitting devices spaced apart on a straight line based on an image received through the camera 300 into a group. Then, the control device 400 controls the light emitting elements (at least two light emitting elements disposed at positions spaced apart from the straight line) other than the light emitting elements included in the group and the light emitting elements included in the group It can be identified as a light emitting unit.

At this time, the control device 400 may be arranged such that the control device 400 is disposed closer to the light emitting elements included in the group than the light emitting elements included in the other group than the light emitting elements other than the light emitting elements included in the group At least two light emitting elements can be selected. For example, the control device 400 controls the front surface 103a and the left surface 103b of the plurality of surfaces of the HMD 100 facing the camera 300 based on the image received through the camera 300. For example, , At least four light emitting devices 201a, 202a, 203a, and 204a arranged in a straight line on the front surface 103a are grouped into a first group and are spaced apart in a straight line on the left side surface 103b The at least four light emitting devices 201b, 202b, 203b, and 204b may be grouped into a second group.

Then, the control device 400 determines whether or not the light emitting elements 205a, 206a other than the light emitting elements included in the first and second groups are closer to the light emitting element included in the first group, Which is closer to the light emitting element.

For example, the control device 400 may include a light emitting device 205a disposed close to the left side surface 103b of the light emitting devices 205a and 206a and a light emitting device 205a emitting light from both ends of at least four light emitting devices included in the first group A distance d1 between the light emitting elements 201a arranged close to the left side face 103b of the elements 201a and 204a and a distance d1 between the light emitting elements 201a and 204a close to the left side face 103b of the light emitting elements 205a and 206a (Grouping) any one of the light emitting units based on the distances d2 and d3 between the first light emitting device 205a and the light emitting devices 201b and 204b of at least four light emitting devices included in the second group . When the distance d1 is shorter than the distances d2 and d3, the controller 400 determines that the light emitting device 205a disposed close to the left surface 103b is not the second group disposed on the left surface, It can be determined that the first group disposed on the first substrate 103a forms one light emitting unit.

The HMD 100 related to the present invention may be arranged such that at least one of the conditions described in FIGS. 5 and 6 is satisfied. Specifically, the plurality of light-emitting units may include at least four light-emitting elements arranged in a straight line and at least two light-emitting elements disposed at a position spaced apart from the straight line. The at least two light emitting devices may be arranged such that straight lines formed by any two light emitting devices and at least two light emitting devices among the at least four light emitting devices are not parallel to each other, And may be disposed closer to the at least four light emitting elements than the light emitting element.

Further, the light emitting devices included in the HMD 100 of the present invention may be disposed at a distance greater than a predetermined distance. Specifically, each of the at least four light emitting devices and the at least two light emitting devices (or the first through third light emitting devices) may be disposed at a predetermined distance or more apart from each other. The predetermined spacing distance is determined by the user, for example, 20 mm.

The distance between any one of the light emitting units and the light emitting units included in the light emitting units other than the light emitting units may be more than a predetermined distance. Here, the spacing distance may be at least one of a shortest distance passing through the body of the nearest light emitting elements and a shortest distance on the surface of the body of the nearest light emitting elements.

Meanwhile, the control unit 180 of the HMD 100 related to the present invention can control emission patterns of light emitting elements provided on a plurality of surfaces of the main body differently. Here, the light emission pattern may be formed so that the controller 400 can determine the posture of the HMD 100 using an asynchronous method. That is, the control unit 180 may control the manner in which at least some of the light emitting devices provided on the plurality of surfaces emit light differently from the remaining light emitting devices.

The controller 180 of the HMD 100 may emit light of two light emitting elements among at least four light emitting elements disposed in a straight line on each of the plurality of light emitting units in a manner different from that of the remaining light emitting elements.

The two light emitting devices may be light emitting devices disposed at both ends of the at least four light emitting devices.

6, the control unit 180 controls the light emitting unit 200a (for example, the light emitting unit 200a) provided on one of the plurality of surfaces (for example, the front surface 103a) The two light emitting elements of at least four light emitting elements 201a, 202a, 203a, and 204a, which are arranged in a straight line spaced apart from each other, may emit light in a different manner from the remaining light emitting elements.

The two light emitting devices may be light emitting devices 201a and 204a disposed at both ends of the at least four light emitting devices 201a, 202a, 203a, and 204a. However, the present invention is not limited thereto, and the two light emitting devices may be any two of the at least four light emitting devices 201a, 202a, 203a, and 204a.

The control unit 180 may control the two light emitting devices 201a and 204a so that the two light emitting devices 201a and 204a emit light of different brightness in a predetermined time interval. Specifically, the brightness of the light emitted by the two light emitting devices 201a and 204a may vary at predetermined time intervals. Here, changing the brightness of the light at a predetermined time interval may include a meaning that the light emitting device is flickering. This is for the purpose of enabling the controller 400 to identify at least four light emitting elements arranged on a straight line provided on the HMD body.

That is, the control device 400 extracts two light emitting devices that emit light so that the brightness of the light is different at the predetermined time intervals without performing a separate synchronization process, and the remaining light emitting devices, which are in line with the two light emitting devices, The device can be identified. Thereafter, the controller 400 calculates the non-coherence ratios of the four light emitting elements spaced apart on the straight line, and calculates the non-coherence ratios of the four light emitting elements spaced apart on the straight line among the plurality of faces of the HMD Can be identified. Accordingly, the control device 400 can control the brightness of the light emitted by the light emitting elements of the HMD 300, even though the time when the shutter of the camera 300 is opened and closed and the time when the two light emitting elements change the brightness of light are not synchronized Can be identified.

In order to prevent blur due to the light emitted from the two light emitting devices, the control device 400 may control the time of opening and closing the shutter of the camera 300, It is also possible to synchronize the time the device changes the brightness of the light.

On the other hand, the brightness of the varying light may change above a predetermined reference brightness. Specifically, when controlling the brightness of light emitted by the two light emitting devices 201a and 204a to change at a predetermined time interval, the controller 180 controls the brightness of the light emitted from the two light emitting devices 201a and 204a The number of light emitting devices 201a and 204a can be controlled.

For example, when the predetermined reference brightness is a brightness of 50% of the maximum brightness that the light emitting device can output, the two light emitting devices 201a and 204a are turned on at a predetermined time interval, (for example, 50% - > 100% - > 50% - > 100) than the predetermined reference brightness (50% % ...) You can change the brightness of the emitted light. The control unit 180 controls the brightness of the light emitted from the two light emitting devices 201a and 204a to be greater than a predetermined reference brightness because the control unit 400 controls the two light emitting units 201a and 204a ) To keep track of.

Meanwhile, the controller 180 controls the light emitting devices 202a and 203a other than the two light emitting devices 201a and 204a among the at least four light emitting devices 201a, 202a, 203a, and 204a to emit light with a predetermined brightness The remaining light emitting devices 202a and 203a can be controlled to emit light.

The control unit 180 controls the light emitting devices 205a and 205b so that the light emitting devices 205a and 206a other than the at least four light emitting devices among the light emitting devices included in the light emitting unit 200a emit light with a predetermined light brightness. 206a.

At this time, the light emitting devices 205a and 206a and the remaining light emitting devices 202a and 203a may emit light so as to have the same light brightness, or may emit light having different light brightness.

The light emitting devices 201a and 204a that emit light so that the brightness of light is changed at a predetermined time interval among the light emitting devices included in the light emitting unit may be referred to as a blink light emitting device and the remaining light emitting devices 202a, 205a, and 206a may be referred to as static light emitting devices.

The description of the light emitting unit 200a provided on any one of the plurality of surfaces 103a is the same as the light emitting units 200b, 200c, 200d, 200e, and 200f provided on each of the plurality of surfaces / Similar analogy can be applied.

Hereinafter, a method for determining the posture of the HMD 100 related to the present invention will be described in more detail with reference to the accompanying drawings. The HMD 100 may be configured such that the HMD 100 is determined to be the control device 400. However, the present invention is not limited thereto, and the HMD 100 may receive the image received by the camera 300, It is possible to determine the posture of itself (HMD 100).

FIGS. 7A and 7B are flowcharts for explaining a control method for determining the attitude of the HMD related to the present invention, and FIG. 8 is a conceptual diagram for explaining the control method shown in FIG. 7B.

Referring to FIG. 7A, the controller 400 proceeds to step S710 to receive a preview image including an image corresponding to the HMD 100 related to the present invention through the camera 300. FIG. An image 800 corresponding to the HMD 100 may be included in the preview image received through the camera 300 arranged to face the HMD 100. [

Here, the controller 400 may correct the distortion of the preview image caused by the wide-angle lens of the camera 300. [ The detailed description of the method of correcting the distortion of the preview image is omitted from the gist of the present invention and therefore will be omitted.

Thereafter, the controller 400 proceeds to step S720 of identifying an image corresponding to a plurality of light emitting units formed on each of the plurality of surfaces of the HMD, using the image corresponding to the HMD included in the preview image. Specifically, the controller 400 identifies an image corresponding to the light emitting element among the images included in the preview image, and identifies an image corresponding to the light emitting unit based on the position of the image corresponding to the identified light emitting element .

Thereafter, the control device 400 proceeds to step S730 to determine the posture of the HMD 100 using the image corresponding to the identified light emitting unit. Specifically, the control device 400 can determine the state of the HMD, the degree of tilting of the HMD, the position of the HMD, and the like by using images corresponding to the identified light emitting unit. In addition, the controller 400 may track images corresponding to the identified light emitting units, and may determine movement such as moving or rotating the HMD 100.

Hereinafter, a method (S720) for identifying a plurality of light emitting units included in the HMD will be described in more detail with reference to FIG. 7B.

Referring to FIG. 7B, the controller 400 identifies an image corresponding to at least two light emitting elements whose brightness of light changes in a predetermined time interval in the image 800 corresponding to the HMD (S721).

8, the control device 400 receives the preview image 1000 through the camera 300. The preview image 1000 may include a preview image 1000, Then, the controller 400 identifies the images 901a and 904a corresponding to at least two light emitting elements whose brightness of light among the images included in the preview image 1000 changes at predetermined time intervals.

At least two light emitting elements whose brightness of the light changes at a predetermined time interval are arranged on the opposite ends of at least four light emitting elements 201a, 202a, 203a, and 204a spaced apart on a straight line, The light emitting devices 201a and 204a may be disposed in the light emitting device 200a.

Thereafter, the control device 400 includes an image 902a corresponding to at least two light emitting devices that are in a straight line with the images 901a and 904a corresponding to the at least two light emitting devices and emit light with a predetermined light brightness, , 903a (S722).

6, at least two light emitting devices 201a, 202a, 203a, and 204a, which are spaced apart from each other in a straight line, May be light emitting devices 202a and 203a other than the light emitting devices 201a and 204a that emit light so that the brightness of light is changed at time intervals.

In addition, the control device 400 may group the identified images 901a, 902a, 903a, and 904a into one group.

Then, the controller 400 calculates the non-matching ratio based on the ratio of the distances between the images 901a, 902a, 903a, and 904a corresponding to the identified at least four light emitting devices, The surface on which the at least four identified light emitting elements are formed can be identified from among the plurality of surfaces of the HMD 100 (S723).

For example, as shown in the upper diagram of FIG. 8, the control device 400 may be based on the ratio of the distances between the images 901a, 902a, 903a, and 904a corresponding to the identified at least four light emitting devices The surface of the HMD facing the camera 300 faces the front surface 103a of the HMD, and the front surface 103a of the HMD has a light- (103a).

That is, the control device 400 displays images (901a, 902a, 903a, 904a) corresponding to the identified at least four light emitting devices among images corresponding to a plurality of surfaces of the HMD 100 included in the preview image 1000, It can be determined that the image 803a corresponding to the face including the face 803a is the image 803a corresponding to the entire face among the plurality of faces of the HMD.

Then, the control device 400 identifies the images 905a and 906a corresponding to the remaining light emitting devices except for the identified at least four light emitting devices (S724).

Specifically, the control device 400 controls the light emitting devices 901a and 904a corresponding to at least two light emitting devices whose brightness is changed at a predetermined time interval and images 902a and 903a corresponding to the light emitting devices, (905a, 906a) corresponding to the remaining light emitting elements except the light emitting elements (905a, 906a).

Thereafter, the control device 400 determines whether the images 905a and 906a corresponding to the remaining light emitting elements and the images 901a and 904a corresponding to at least two light emitting elements whose brightness of the light changes at predetermined time intervals Based on the distance, an image 900a corresponding to the light emitting unit included in the identified face can be identified.

For example, as shown in the upper diagram of FIG. 8, when the preview image 1000 includes only two images 901a and 904a corresponding to at least two light emitting devices whose light brightness changes at predetermined time intervals The control device 400 determines whether the images 905a and 906a corresponding to the remaining light emitting devices and the images 901a and 904a corresponding to the at least two light emitting devices are images 900a corresponding to any one of the light emitting units, As shown in FIG. That is, the control device 400 includes the images 901a and 904a corresponding to the at least two light emitting devices, the images 902a and 903a corresponding to the light emitting devices that are in a straight line on the images 901a and 904a, The images 905a and 906a corresponding to the remaining light emitting elements can be determined as the image 900a corresponding to one light emitting unit.

The determination of the image 900a corresponding to the one light emitting unit means that the light emitting element corresponding to the identified images 901a, 902a, 903a, 904a, 905a, It may include a meaning that it is determined to be disposed on one plane.

As another example, when the preview image 1000 includes four or more images 901a, 904a, 901b, and 904b corresponding to light emitting devices whose light brightness changes in a predetermined time interval, as shown in the lower diagram of FIG. 8, , The control device 400 determines the distance between the images 905a and 906a corresponding to the remaining light emitting elements and the images 901a, 904a, 901b, and 904b corresponding to the light emitting elements whose brightness of light is changed at the predetermined time interval (901a, 904a, 901b, 904b) corresponding to the light emitting device whose brightness changes in the predetermined time interval and the image (905a, 906a) corresponding to the remaining light emitting device It is possible to determine whether or not an image corresponding to the light emitting unit of the display unit is formed.

That is, the control device 400 controls the light emitting devices 901a, 904a, 904a corresponding to the light emitting devices whose brightness is changed at a predetermined time interval with one of the images 905a, 906a corresponding to the remaining light emitting devices, 901b, and 904b, which are closest to each other. Thereafter, the control device 400 determines whether the images 902a, 903a, and 904a (the first group) corresponding to the light emitting elements that are on the same straight line as either the first image 905a and the closest image 901a are emitted Unit 900a corresponding to the unit.

Here, identifying the image corresponding to the one light emitting unit may include identifying a surface on which the remaining light emitting elements are disposed, of the plurality of surfaces of the HMD.

Through this process, the controller 400 can identify the plurality of light emitting units provided on the plurality of surfaces of the HMD 100, respectively.

Then, the control device 400 can determine the posture of the HMD using the image corresponding to the identified light emitting unit. Specifically, the memory unit of the control device 400 may store information related to the light emitting device disposed in the HMD in the memory unit.

The information may include at least four light emitting elements in a non-coherent ratio disposed in a straight line on a plurality of planes of the HMD, a spacing distance between the light emitting elements included in each of the plurality of light emitting units, Shape information (e.g., shape and shape of a figure formed by the light emitting element whose brightness changes in a predetermined time interval and the remaining light emitting elements), and the like.

Then, the control device 400 can determine the posture of the HMD 100 using the stored information and the image corresponding to the identified light emitting unit.

For example, as shown in the upper diagram of FIG. 8, the control device 400 determines whether the brightness of light corresponding to the light emitting device whose brightness changes in the predetermined time interval included in the image 900a corresponding to the identified light emitting unit The position of the HMD 100 and the degree to which the HMD 100 is tilted based on the images 901a and 904a and the images 905a and 906a corresponding to the remaining light emitting devices.

8, when the posture of the HMD 100 is changed by the movement of the user wearing the HMD 100, the control device 400 displays the image corresponding to the identified light emitting unit Based on the images 901a and 904a corresponding to the light emitting elements whose brightness is changed at the predetermined time interval and the images 905a and 906a corresponding to the remaining light emitting elements included in the HMD 100, And the degree to which the HMD 100 is rotated can be determined.

8, when the image corresponding to the new light emitting device is identified, the control device 400 displays an image corresponding to the new light emitting device using the steps S721 to S723 It is possible to determine the surface 803b. In addition, the controller 400 identifies an image 900b corresponding to a new light emitting unit based on the image corresponding to the new light emitting element through steps S724 and S725, 900b may be used to determine the posture of the HMD 100.

As described above, according to the present invention, it is possible to provide an HMD in which at least four light emitting devices are arranged on a straight line so as to have different mutually harmonious ratios on each of a plurality of surfaces. Therefore, the present invention can provide an HMD formed to determine the attitude of the HMD through the non-harmonizing ratio.

In addition, the present invention can provide an HMD in which two light emitting elements of at least four light emitting elements arranged in a straight line are differently emitted in a manner. Accordingly, the present invention can provide an HMD in which at least four light emitting elements arranged on a straight line having a non-harmonious ratio can be extracted more easily.

In addition, the present invention is characterized in that two light emitting devices having different light emitting modes are formed so as to emit light so that the brightness of light changes at a predetermined time interval, and the brightness of the light is changed to be equal to or greater than a set reference brightness , It is possible to provide an HMD formed to facilitate tracking (or identification, recognition) of the two light emitting devices.

Also, the present invention is characterized in that at least two light emitting elements are disposed on each of the plurality of surfaces at a position spaced apart from the straight line so that the attitude of the HMD is determined, and at least four light emitting elements It is possible to provide an HMD formed so that the attitude of the HMD can be more accurately judged by using the device.

Further, the present invention is characterized in that the at least two light emitting elements arranged on one surface are disposed closer to at least four elements arranged on a straight line disposed on the one surface than the light emitting elements arranged on the other surface , It is possible to provide an HMD formed so that light emitting elements arranged on any one surface can be more easily recognized.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a controller 180 of the HMD. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (14)

As an HMD (Head Mounted Display)
A body having a plurality of surfaces; And
And a plurality of light emitting units respectively formed on the plurality of surfaces and emitting light to the outside of the body,
Each of the plurality of light-emitting units includes at least four light-emitting elements arranged in a straight line spaced apart so that a specific cross-ratio is determined,
And the non-harmonizing ratios of the plurality of light emitting units are different from each other. The method according to claim 1,
Wherein the non-harmonization ratio is determined based on a ratio of spacing distances between the at least four light emitting elements,
Wherein the plurality of light emitting units are formed such that a ratio of spacing distances between the at least four light emitting elements is different from each other. 3. The method of claim 2,
Wherein a ratio of spacing distances between at least four light emitting elements included in any one of the plurality of light emitting units,
Wherein the distance between the light emitting units of the plurality of light emitting units is different from the ratio of the distance between the light emitting units of at least four light emitting units included in the different light emitting units. The method according to claim 1,
Wherein at least two of the at least four light emitting devices emit light in a different manner than the remaining light emitting devices. 5. The method of claim 4,
The two light emitting devices are first light emitting devices that emit light so that the brightness of light changes at a predetermined time interval,
And the remaining light emitting elements are second light emitting elements that emit light with a predetermined light brightness. 6. The method of claim 5,
Wherein the first light emitting elements are light emitting elements disposed at both ends of the at least four light emitting elements,
And the second light emitting elements are light emitting elements disposed between the first light emitting elements. 6. The method of claim 5,
Wherein the brightness of light that changes in the first light emitting elements changes at a predetermined reference brightness or more. 6. The method of claim 5,
Wherein each of the plurality of light-
And a third light emitting device disposed at a position spaced apart from the straight line and emitting light so as to have a predetermined brightness of light, 9. The method of claim 8,
The two third light emitting elements may include a first light emitting element,
Wherein the straight lines formed by the two light emitting elements of the first and second light emitting elements and the two third light emitting elements are not parallel to each other. 10. The method of claim 9,
Wherein the two light emitting elements are the first light emitting elements. 9. The method of claim 8,
And two third light emitting elements included in any one of the plurality of light emitting units,
The first and second light emitting elements included in one of the plurality of light emitting units may be different from any one of the first to third light emitting elements included in the other light emitting unit, ≪ / RTI > of the HMD. 12. The method of claim 11,
The two third light emitting devices included in any one of the light emitting units may include:
Wherein a distance between the first light emitting element and the first light emitting element included in one of the light emitting units is smaller than a distance between the first light emitting element and the first light emitting element included in the other light emitting unit. 13. The method of claim 12,
The third light emitting device of any one of the two third light emitting devices included in any one of the light emitting units and the one of the two first light emitting devices included in any one of the light emitting units The distance between any one of the near first light emitting elements,
Wherein the distance between the two first light emitting elements included in the other light emitting unit and the distance between any one of the third light emitting elements is shorter than the distance between the two first light emitting elements included in the other light emitting unit. 9. The method of claim 8,
Wherein each of the first through third light emitting elements is disposed at a distance greater than or equal to a predetermined separation distance.

Images