KR20180017736A - Head mounted display and method for controlling the same - Google Patents

Abstract

The present invention relates to a head mounted display (HMD) connected to at least one of a plurality of second HMDs for playing an image of the same virtual space. The HMD comprises: a communications unit for performing a wireless connection with the at least one second HMD; a sensing unit for sensing a direction to which a front surface of the HMD is directed; a display unit for displaying an image in one area corresponding to the direction to which the front surface of the HMD is directed, among the virtual space images; and a control unit for displaying images corresponding to a part of the virtual space images displayed in each second HMD connected to the HMD in different areas on the display unit. The control unit senses a head motion of each wearer who wears the second HMD on the basis of information received from the at least one second HMD, and displays the images corresponding to a part of the virtual space images corresponding to the sensed head motion of each wearer in the different areas on the display unit. According to the present invention, a plurality of users can share an image being viewed by the users with each other.

Description

[0001] DESCRIPTION [0002] HEAD MOUNTED DISPLAY AND METHOD FOR CONTROLLING THE SAME [0003]

The present invention relates to an HMD and a control method of the HMD.

Description of the Related Art A wearable-type glass-type terminal is recently developed which can be mounted on a part of a human body. And a glass type terminal mounted on a user's head may correspond to a head mounted display (HMD).

A head mounted display (HMD) is a display device that is worn on a head of a user and can present an image directly in front of the user's eyes. The user can enjoy the contents or display the virtual space screen so that the user can enjoy the virtual space experience.

For example, the virtual space experience may be a reproduction of pre-stored specific types of image contents. For example, the specific type of image content (hereinafter referred to as VR) may be a still image or a moving image photographed 360 degrees forward or at an angle of 180 degrees for a predetermined time. In this case, the HMD can output an image of the direction of the user's head, out of 360 degrees forward or 180 degrees of view angle. When the user's head is rotated, The image can be output.

On the other hand, as the name implies, the HMD is generally worn on the wearer's head. Accordingly, the VR content output through the HMD can be provided only to a user wearing only the HMD, and the user can not share the virtual space viewed by the user. Accordingly, even if a plurality of users view the same VR content, the plurality of users can experience each virtual space separately, and the same virtual space can be experienced by a plurality of users There is a problem that it can not.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an HMD that allows a plurality of users viewing the same VR content to provide the same spatial feeling as that experienced by the plurality of users together, Method.

It is another object of the present invention to provide an HMD and a control method of the HMD which allow a plurality of users viewing the same VR content to share images they are watching with each other.

According to an aspect of the present invention, there is provided an HMD connected to at least one of a plurality of second HMDs (Head Mounted Display) for reproducing the same virtual space image, A sensing unit for sensing a direction of the front face of the HMD, and a display unit for displaying an image of one area corresponding to a direction of the front face of the HMD, And a controller for displaying the images corresponding to a part of the virtual space images displayed in each of the at least one second HMD connected to the HMD on different areas on the display unit, Based on information received from the at least one second HMD, detects movement of the head of each wearer wearing the at least one second HMD And the images corresponding to some of the virtual space image corresponding to each of the detected head movement of a wearer characterized in that displayed on the different areas on the display unit.

In one embodiment, the control unit displays images corresponding to the images displayed in the at least one second HMD on at least one display area formed in different areas on the display unit, And displays an image inside the display area on the display unit in a divided manner through a graphic object or graphic processing.

In one embodiment, the control unit displays the other area on the display unit, except for the inside of the display area, in a predetermined color, or makes the other area on the display unit opaque or blurred beyond a predetermined level, And the internal images are separately displayed.

In one embodiment, the controller displays an image displayed on the selected display area on the entire screen of the display unit when the user selects one of the display areas.

In one embodiment, the control unit groups the at least one display area into at least one group according to a user's selection or predetermined criteria, and displays the display areas included in the same group adjacent to each other .

In one embodiment, the control unit groups at least one second HMD connected to the HMD into at least one group according to a user's selection, and the at least one second HMD groups the at least one second HMD, And the position of the display area corresponding to one second HMD is determined.

In one embodiment, the control unit controls the at least one of the second HMDs based on a connection request of at least one of the second HMDs or a connection request received from at least one of the second HMDs, And the connection is performed.

In one embodiment, when the HMD operates in the voice recognition mode, the control unit detects a specific wearer corresponding to a result of recognizing the user's voice signal among the wearers wearing the plurality of second HMDs, And performs connection with the detected wearer's HMD.

According to an aspect of the present invention, there is provided an apparatus for reproducing virtual reality (VR) contents, the apparatus comprising: a plurality of virtual space images displaying one of a plurality of virtual space images constituting the VR contents; And a second HMD (Head Mounted Display), the HMD comprising: a communication unit for performing wireless connection with the at least one second HMD; a sensing unit for sensing a direction of a front surface of the HMD; A display unit for displaying an image of one area corresponding to a direction of the front of the HMD from one virtual space image selected from a user among the virtual space images constituting the VR contents, A controller for displaying images corresponding to a part of the virtual space images displayed in each of the second HMDs in different areas on the display unit Wherein the controller receives from the at least one second HMD information about the virtual space image displayed in the second HMD and the result of sensing the head movement of the wearer wearing the second HMD, Corresponding to the head movement of each of the at least one second HMD wearer, from the virtual space images respectively corresponding to the information received from the respective second HMDs among the virtual space images constituting the VR contents And displaying the extracted image on at least one display area formed on the display unit.

In one embodiment, the VR content may further include structure information indicating a relationship between virtual spaces corresponding to each of the plurality of virtual space images, and the control unit may display the VR content according to the structure information And displaying a virtual space corresponding to the virtual space image currently displayed on the display unit on the map information by the user of the HMD on the display unit in the form of map information, And displaying the virtual space in the virtual space.

In one embodiment, the control unit may be configured to generate, based on the information on the virtual space image displayed in the second HMD received from each of the at least one second HMD, And the virtual space in which the wearer is located is separately displayed.

In one embodiment, when one of the virtual spaces displayed on the map information is selected, the controller displays an image of one region corresponding to the direction of the front face of the HMD among the images of the selected virtual space .

In one embodiment, the HMD and at least one second HMD connected to the HMD are divided into a master HMD and a slave HMD according to whether a specific virtual space image can be selected or not, Wherein the control unit displays one area of a specific virtual space image selected by the user on the display unit when the HMD is set as the master HMD and displays the part of the selected virtual space image on the at least one second HMD When the HMD is set as the slave HMD, among the specific virtual space images under the control of the HMD set as the master HMD among the at least one second HMD, The image of one region corresponding to the direction in which the image is displayed.

According to an aspect of the present invention, there is provided an HMD connected to at least one of a plurality of second HMDs (Head Mounted Display) in which the same AR (augmented) related content is driven, A communication unit for performing a wireless connection with the at least one second HMD and receiving the AR-related information from a predetermined communication apparatus in the vicinity, a camera unit for sensing an image in a direction toward the front of the HMD, And an image sensing unit for sensing at least one of the image sensed by the at least one second HMD connected to the HMD and the at least one second HMD, And displaying the received AR information on a part of the display unit, wherein the AR-related content includes at least one of the HMD and the at least one second HMD The HMD according to claim 1, further comprising map information for a plurality of places including at least one of the plurality of places, wherein the control unit controls the HMD and at least one second HMD Characterized in that a specific place corresponding to the position is displayed so as to be distinguished from other places.

In one embodiment, when there is the user's selection of the AR information displayed on a part of the display unit, the controller displays the selected AR information corresponding to the selected AR information through any one of the second HMDs transmitting the selected AR information And receives the information and displays the received information.

Effects of the HMD according to the present invention and the control method of the HMD will be described as follows.

According to at least one of the embodiments of the present invention, when the same VR content provided from a server is reproduced in an HMD worn by a plurality of users, an image displayed on another user's HMD is displayed on at least a part So that the plurality of users can experience the same spatial feeling as experiencing the same virtual space together.

FIG. 1A is a block diagram illustrating a configuration of an HMD according to an embodiment of the present invention.
1B is an exemplary view showing an example of an HMD according to an embodiment of the present invention.
FIG. 1C is a diagram illustrating an example in which a plurality of HMDs according to an embodiment of the present invention reproduces and connects the same VR contents provided from a server.
FIGS. 2A and 2B are conceptual diagrams for explaining an example in which images of different regions of VR contents are displayed in a plurality of HMDs according to an embodiment of the present invention, according to the direction in which the head of each user faces.
3 is a flowchart illustrating an operation of the HMD according to an embodiment of the present invention.
4 is a flowchart illustrating an operation of generating an image according to information received from another user's HMD in the HMD according to the embodiment of the present invention.
FIG. 5A is a flowchart illustrating an operation of reproducing VR content in FIG. 3 when VR content including a plurality of images is reproduced according to the second embodiment of the present invention.
5B is a flowchart illustrating an operation of generating an image according to information received from another user's HMD according to the second embodiment of the present invention.
5C is a flowchart illustrating an operation of displaying the position of the HMD user based on a virtual space corresponding to an image displayed in the HMD of the user in the second embodiment of the present invention.
FIG. 6 is a flowchart illustrating an operation of displaying an augmented reality image in an HMD according to a third embodiment of the present invention.
FIG. 7 is a flowchart illustrating an operation of generating an image corresponding to image information received from another user's HMD, among the processes of FIG.
8A and 8B are views illustrating an example in which an image displayed in the HMD of the other user is displayed on the display unit according to a selection of a user or a request of another user in the HMD according to an embodiment of the present invention.
9 is a view illustrating examples of displaying images displayed on an HMD of a plurality of other users in an HMD according to an embodiment of the present invention.
FIG. 10 is an exemplary diagram showing other examples in which, in the HMD according to the embodiment of the present invention, images displayed in the HMDs of a plurality of other users are displayed.
11 illustrates an example of displaying an image of a virtual space according to a user's selection in an HMD according to an embodiment of the present invention when the VR contents reproduced according to the embodiment of the present invention is composed of a plurality of virtual space images Fig.
FIG. 12 is an exemplary view showing an example in which an HMD according to an embodiment of the present invention displays an AR image.
13 is an exemplary view illustrating an example of displaying an AR image displayed in another user's HMD according to a user's selection when the HMD according to the embodiment of the present invention displays the AR image.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like or similar elements are denoted by the same or similar reference numerals, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

1 is a block diagram for explaining an HMD 100 related to the present invention.

1, an HMD 100 according to an embodiment of the present invention includes a wireless communication unit 110, a camera unit 120, an input unit 130, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, a power supply unit 190, and the like. 2A are not essential for implementing the HMD 100 according to the embodiment of the present invention, so that the HMD 100 described in this specification is more or less than the above listed components Components.

More specifically, the wireless communication unit 110 includes one or more modules (not shown) that enable wireless communication between the HMD 100 and various peripheral devices, for example, a predetermined controller device or another HMD or an external server . ≪ / RTI > It may also include one or more modules that connect the HMD 100 to one or more networks.

The camera unit 120 may include at least one camera for inputting image information. The camera unit 120 may process the image information obtained by the image sensor as input for another application program or another function. The processed image information can be displayed on the display unit 151 of the HMD 100 or stored in the memory 170. [

The input unit 130 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. The input unit 130 may include a microphone 131 for inputting an audio signal, And a user input unit 132 (e.g., a touch key, a mechanical key, and the like) for receiving information from a user. The user input unit 132 may be a separate device connected to the HMD 100, that is, a controller for receiving a user input to the HMD 100. In this case, various inputs sensed through the controller may be applied to the user's input to the HMD 100. [

On the other hand, the user's input through the controller may vary. For example, the input of the user may be applied from at least one key included in the controller. Or various gestures of the user sensed through the controller may be applied to the input of the user. To this end, the controller may include one or more sensors, such as an acceleration sensor or gyroscope, so as to identify various gestures that the user grasps while holding the controller.

Meanwhile, a combination of the input of the specific key and the specific gesture described above may be applied to the input of a specific user. For example, when the user is inputting a specific key provided in the controller, or when a preset drag input such as a swipe input is applied, If the controller is moved in a specific direction by a predetermined angle or more, the input of the user may be determined as a predetermined input of the user related to the function of the HMD 100. [ That is, when the gesture of the user is sensed, the controller 180 displays various functions of the HMD 100, for example, a menu related to the reproduction of the VR contents, on the display unit 151 of the HMD 100 in response to the gesture ).

Meanwhile, the sensing unit 140 may include at least one sensor for sensing a head movement of a user wearing the HMD 100. For example, the sensing unit 140 may include an acceleration sensor 141 and a gyro sensor 142. Here, the acceleration sensor 141 and the gyro sensor 142 can sense the acceleration and the angular velocity according to the movement of the head of the user.

The output unit 150 may include a display unit 151 and an audio output unit 152 for generating an output related to visual, auditory, tactile, or the like. The display unit 151 may be installed at a position corresponding to both sides of the user when the user wears the HMD 100 so as to provide a larger size image to the user. The sound output unit 152 may be formed in the form of a headphone that can be brought into close contact with both ears of the user when the user wears the HMD 100 so that the sound signal related to the content to be reproduced can be transmitted . The output unit 150 may include a haptic module although it is not shown. By generating the vibration related to the content currently being reproduced to the user through the haptic module, the user can view the virtual reality contents more realistically have.

Meanwhile, the interface unit 160 serves as a channel with various kinds of external devices connected to the HMD 100. The interface unit 160 may include at least one of various ports such as a wired / wireless headset port, an external charger port, and a wired / wireless data port. For example, when the interface unit 160 is wired or wirelessly connected to a predetermined controller device, the interface unit 160 may serve as a channel through which various data and information are exchanged between the HMD 100 and the controller device.

In addition, the memory 170 stores data supporting various functions of the HMD 100. The memory 170 may store a plurality of application programs (application programs or applications) driven by the HMD 100, data for operation of the HMD 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may be stored in the HMD 100 from the time of shipment for the basic functions of the HMD 100 (for example, the reproduction of VR contents and the output of video signals and sound signals of reproduced VR contents) Lt; / RTI > The application program may be stored in the memory 170 and may be installed on the HMD 100 and may be driven by the controller 180 to perform the operation (or function) of the HMD 100.

Meanwhile, the control unit 180 typically controls the overall operation of the HMD 100, in addition to the operations associated with a specific application program. The control unit 180 may process or process signals, data, information, and the like input or output through the above-described components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1 to drive an application program stored in the memory 170. FIG. In addition, the controller 180 can operate at least two of the components included in the HMD 100 in combination with each other for driving the application program.

Under the control of the control unit 180, the power supply unit 190 receives external power and internal power, and supplies power to the components included in the HMD 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

1B is an exemplary view showing an example of the HMD 100 according to the embodiment of the present invention.

Referring to FIG. 1B, FIG. 1B shows an example of a user wearing an HMD according to an embodiment of the present invention. 1B, when the user wears the HMD 100, the controller 180 controls the head portion of the user wearing the HMD 100, based on the sensed values of the sensors provided in the sensing portion 140, So that the front direction 102 can be identified. When the VR content is reproduced, an image of one region corresponding to the identified front direction 102 may be displayed on the display unit 151 from the virtual space image of the reproduced VR content.

The VR contents to be reproduced may be reproduced by the HMD 100 or provided from an external server connected to the HMD 100. When the VR content is provided from a specific external server connected to the VR content server, the external server may provide the same VR content to a plurality of HMDs, and the same VR content may be reproduced from the plurality of HMDs. In the following description, an example will be described in which a plurality of HMDs are reproduced by receiving the same VR content from a predetermined external server.

FIG. 1C is an illustration showing an example in which a plurality of HMDs 100 according to an embodiment of the present invention reproduces and connects the same VR contents provided from a server.

1C, a plurality of HMDs according to an embodiment of the present invention may be connected to the external server 200, respectively. The external server 200 may provide the VR contents requested by the users of the connected HMDs. In this case, the HMDs receiving the same VR content can reproduce images in the same virtual space.

Meanwhile, the HMDs 100a, 100b, 100c, and 100d receiving the same VR contents may be connected to each other as shown in FIG. 1C. For example, the HMDs 100a, 100b, 100c, and 100d perform direct wireless communication with different HMDs, and may be connected to each other according to the result. When they are connected to each other, the HMDs 100a, 100b, 100c, and 100d can exchange various information. For example, the information to be exchanged may be voice information input from each user, or information received or generated in each HMD.

Each of the HMDs 100a, 100b, 100c, and 100d may request the same VR content to the external server 200. [ When the requested VR content is received from the external server 200, each of the HMDs 100a, 100b, 100c, and 100d reproduces the received VR content to reproduce and reproduce the video in the same virtual space, Can be transmitted to other connected HMDs.

On the other hand, the HMDs 100a, 100b, 100c, and 100d may be connected to each other via the external server 200. FIG. In this case, the external server 200 may group each of the HMDs requesting the same VR content. When the information related to the image of the virtual space reproduced in the HMD is received according to the request of one HMD, the received image can be transmitted to another HMD of the group including the HMD. Accordingly, even if the HMDs 100a, 100b, 100c, and 100d can not be directly connected to each other, the HMDs 100a, 100b, 100c, and 100d that provide the same VR content can be connected to each other.

On the other hand, even if the same VR contents are reproduced, the images displayed through the respective HMDs 100 may be different from each other. For example, when a user wearing a plurality of HMDs 100a and 100b according to an embodiment of the present invention looks in different directions, an image displayed on the display unit 151 of the HMDs 100a and 100b May be different.

FIGS. 2A and 2B are conceptual diagrams for explaining an example in which images of different regions of the same VR content are displayed in a plurality of HMDs 100a and 100b according to an embodiment of the present invention, to be.

2A is a conceptual diagram illustrating an example of displaying an image of one region of VR contents corresponding to a direction of a head of a user in a first HMD 100a among a plurality of HMDs 100a and 100b.

2A, a user of the first HMD 100a in a horizontal direction (hereinafter referred to as a horizontal direction) with respect to the ground on the basis of the VR content that is a 360-degree omnidirectional image will be described with reference to FIG. 2A, That is, an example of a view angle according to a direction in which the head of the first user faces.

2A, when the VR content is a 360-degree omnidirectional image 250, the first HMD 100a may display the VR content at a specific angle Can be set as a reference angle (0 degree) image. Then, the angle corresponding to the image viewed by the first user can be calculated according to the direction of the head of the first user centered on the set reference angle. 2A, if the first user is viewing the VR content, a horizontal view angle corresponding to the gaze direction 262 of the first user, that is, 1 The angle of the front of the user's head can be 90 degrees. Accordingly, the first HMD 100a can determine that the first user is viewing the VR content image corresponding to 90 degrees in the horizontal direction from the reference angle.

On the other hand, FIG. 2A shows an example of a view angle according to a direction in which the head of the first user is oriented in a direction perpendicular to the paper surface (hereinafter referred to as a vertical direction). The image 250 of the VR content shown in FIG. 2A is a vertical direction image of the image corresponding to the view angle of 90 degrees in the horizontal direction among the VR contents currently viewed by the first user have.

In this state, the first HMD 100a can sense the vertical angle of the head front of the first user through the sensing result of the sensing unit 140. [ That is, as shown in FIG. 2A, if the first user is in the upward direction at an angle of 30 degrees, the first HMD 100a may be configured such that the first user is at an angle of 30 degrees upward in the vertical direction It can be determined that the user is watching the video of the area. Accordingly, the view angle of the first user in the vertical direction can be +30 degrees.

On the other hand, FIG. 2A shows an example in which an image of one region of the VR contents corresponding to the direction of the head of the user of the second HMD 100b, that is, the head of the second user, among the plurality of HMDs 100a and 100b is displayed Fig. As shown in FIG. 1C, the first HMD 100a and the second HMD 100b receive and reproduce the same contents from the external server 200, so that the VR contents reproduced by the second HMD 100b May be the same VR content as the VR content reproduced in the first HMD 100a.

2A, the second HMD 100b displays a horizontal view angle from the same VR content, i.e., the same 360-degree omnidirectional image 250, toward the front of the head of the second user, Can be calculated. Similarly to the first HMD 100a, the second HMD 100b may also be configured such that, in accordance with the direction of the front of the head of the second user from the reference angle set according to the information of the received VR contents, It is possible to calculate the angle in the horizontal direction corresponding to the image being displayed. Therefore, when the second user views the direction shown in (c) of FIG. 2A, the second HMD 100b displays the image of the VR content corresponding to 180 degrees in the horizontal direction from the reference angle, It can be judged that it is watching.

2A shows an example of a view angle according to a direction in which the head of the second user faces in the vertical direction. The video 250 of the VR content shown in (d) of FIG. 2a is a video image of the video corresponding to the view angle of 180 degrees in the horizontal direction among the video currently viewed by the second user, that is, .

In this state, the second HMD 100b can sense the vertical angle of the head front of the second user in the same manner as the first HMD 100a. 2A, if the second HMD 100b is in a downward direction at an angle of 30 degrees, the second HMD 100b corresponds to an angle of 30 degrees downward in the vertical direction of the second HMD 100b It is possible to determine that the user is watching the video of the area where the video is displayed. Accordingly, the view angle in the vertical direction of the second user can be -30 degrees.

2B shows VR contents 250 displayed on the first HMD 100a and the second HMD 100b according to the viewing angles of the first user and the second user in the horizontal direction and the vertical direction, Of the images of the different regions of the image.

For example, when the VR contents 250, that is, an image photographed at an angle of view of 360 degrees in all directions is expanded according to a view angle in the horizontal direction, the VR contents 250 are arranged in a manner similar to that shown in FIG. Can be unfolded. In this case, as shown in FIGS. 2A and 2B, the area of the VR contents 250 corresponding to 90 degrees in the horizontal direction and +30 degrees in the vertical direction is the area shown in FIG. 2B (a) May be the first region 260. The area of the VR contents 250 corresponding to the horizontal direction of 180 degrees and the vertical direction of -30 degrees shown in FIGS. 2A and 2B is the same as the area of the VR contents 250 shown in FIG. 2B (a) 270). The first area 260 and the second area 270 may be displayed in the first HMD 100a and the second HMD 100b, respectively.

Therefore, as shown in FIGS. 2B and 2C, even when the same VR contents are reproduced in a plurality of HMDs, when the front direction of the heads of the respective users is different from each other, The images displayed on the display unit of the HMD may be different from each other.

Meanwhile, the HMD 100 according to the embodiment of the present invention may be connected to at least one HMD for reproducing the same VR content, as shown in FIG. 1C. And to receive information related to the image currently displayed on the display unit 151 from another connected HMD. In accordance with the user's selection, an image corresponding to the information received from the other connected HMDs may be displayed on the display unit 151. Therefore, the user of each HMD can have a sense of spaciousness that he / she shares the same VR contents with other users by watching the same VR contents.

Hereinafter, embodiments related to a control method that can be implemented in the HMD 100 according to an embodiment of the present invention will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

3 is a flowchart illustrating an operation of displaying an image of an area viewed by another user from an HMD of another user playing back the same VR content in the HMD 100 according to the embodiment of the present invention .

Referring to FIG. 3, the controller 180 of the HMD 100 according to the embodiment of the present invention can reproduce images of VR contents selected by the user (S300). The VR content may be the same as the VR content provided to at least one other user's HMD from a predetermined external server. In the following description, it is assumed that the VR contents are composed of a still image or a moving image (360-degree omni-directional image) 360 degrees in all directions for convenience of explanation.

When the VR contents are reproduced in step S300, the controller 180 forms a virtual space corresponding to the 360-degree omnidirectional image of the currently reproduced VR contents, with the HMD 100 as the center. According to the sensing result of the sensing unit 140, a part of the 360-degree omnidirectional image corresponding to the front of the user's head, that is, the face of the user can be displayed on the display unit 151 S302).

In this state, the control unit 180 can check whether there is video related information received from another HMD 100 (S304). For example, when a connection request for another user is received from the user, the controller 180 may perform a connection with another user corresponding to the received connection request.

In step S304, connection requests for other users may be received in various ways. For example, the control unit 180 may recognize an input of a specific key provided in the user input unit 132 as a connection request for the other user. That is, when a specific key is recognized, the controller 180 can perform a wireless connection with the user's HMD corresponding to the key. On the other hand, if the user input unit 132 is formed on the controller separately provided, the controller 180 performs connection with the HMD corresponding to at least one other user according to a specific gesture of the user holding the controller can do.

Meanwhile, it goes without saying that the control unit 180 may perform a connection to another user according to a result of recognizing the user's voice. To this end, the control unit 180 may further include a speech recognition module (not shown) for recognizing the user's speech information and converting the recognized speech information into text information.

In this case, the control unit 180 can receive the user's voice signal through the microphone 131 provided in the input unit 130. [ The received speech signal can be converted into text information through the speech recognition module. The converted text information may be compared with the stored information in the memory 170.

Here, the memory 170 may include information on at least one other HMD that can be connected to the HMD 100. The at least one other HMD may include information on a user currently using the HMD as text information. For example, each user using the HMD can perform user registration before wearing the HMD to be used, and the text information input in the user registration process can be stored as information of the user using each HMD have. The stored information of each user can be stored in the memory of each HMD. Accordingly, the memory 170 of the HMD 100 may also include text information corresponding to users of other HMDs.

Accordingly, the control unit 180 can identify the HMD of a specific user corresponding to the user's voice signal based on a result of comparing the text information corresponding to the user's voice signal and the information stored in the memory 170 have. Then, the controller 180 of the HMD 100 can perform wireless communication with the HMD of the specific user based on the wireless connection information corresponding to the HMD of the specific user, and in response thereto, Can be connected.

In the above description, the HMD of at least one other user is connected based on a signal input from the user of the HMD 100. Alternatively, the HMD 100 may be connected to another user's HMD through the opposite process . That is, when a wireless connection is requested to the HMD 100 from another HMD based on the above-described process, the user can be notified that there is a connection request received from another user at present. When the user accepts the connection request, the control unit 180 may perform a wireless connection with another HMD that has transmitted the connection request.

Meanwhile, when the HMD 100 is connected to another user by the above-described process, the controller 180 can receive information related to the image displayed on the HMD of the other user from the connected HMD of the other user. Here, the received video related information may be information on one area of the VR content currently being reproduced in the HMD 100. This is because the HMD of the other user connected as described above is also an HMD that reproduces the same VR content provided from a predetermined external server.

On the other hand, according to the reception result of the image related information, the controller 180 may determine that there is image related information received from the HMD of another user in step S304. If it is determined in operation S304 that there is image related information received from the HMD 100 of another user, the corresponding display area may be set in one area on the display unit 151 in operation S306.

Meanwhile, the display area can be set by various criteria. For example, the control unit 180 may generate the display area in a predetermined area on the display unit 151. Alternatively, the display area may be created around one point on the display unit 151 corresponding to the user's gaze direction.

For example, the camera unit 120 may include an internal camera for capturing a pupil image of the user in the HMD 100. In this case, the control unit 180 can detect the position of the pupil center of each user from the binocular image of the user, which is sensed through the internal camera. Then, based on the pupil center position of the detected user, one point on the display unit 151 corresponding to the user's gaze may be calculated. For example, the control unit 180 may calculate the eyeball center position of the binocular from the binocular image based on the previously stored eye modeling data. Based on the distance between the calculated eyeball center position and the pupil center position, It is possible to calculate one point on the display unit 151 that is gazing. Then, the display area may be formed at the calculated one point.

Meanwhile, the size of the display area may be determined according to various criteria. For example, the size of the display area may be determined according to a size preset by a user. Alternatively, the size of the display area may be determined according to the number of display areas displayed on the display part 151. [ That is, when there is a predetermined display area on the display unit 151, the size of the display area is changed according to the number of display areas and the number of display areas generated according to a request received from the current user or another user Can be determined. In this case, the larger the number of display areas displayed on the display part 151, the smaller the size of the display area. Meanwhile, the controller 180 may change the size of any one of the display areas according to a user's input.

On the other hand, if the display area is set in step S306, the controller 180 may generate an image to be displayed in the set display area (S308). And an image to be displayed in the display area may be an image corresponding to image related information received from the HMD of the other user. On the other hand, if it is determined in step S304 that there is a plurality of image-related information received from the plurality of different HMDs, the controller 180 performs steps S306 and S308 for each of the plurality of received video related information Of course.

Meanwhile, the image-related information may be information on one area of the VR content currently being reproduced in the HMD 100, as described above. For example, the image-related information may be image information that compresses an image of one region of the VR contents or reduces the size thereof.

On the other hand, when the displayed image itself is transmitted as image related information, the throughput may increase and the amount of data to be transmitted may increase. Accordingly, the image-related information may be coordinate information of one of the VR contents displayed in the connected HMD. For example, the coordinate information may be coordinate information on the VR contents corresponding to each vertex of the display part of the connected other HMD, or coordinate information of one point on the VR contents corresponding to the central point on the different HMD display part.

On the other hand, when the coordinate information is transmitted, when the direction of the face of the connected user is changed, the area on the VR content displayed on the display unit changes according to the changed direction. Therefore, The coordinate information of the area to be processed must be continuously calculated. In this case, a time delay may occur due to the coordinate information calculation process.

Therefore, in order to minimize the time delay corresponding to the coordinate information calculation process, the HMD 100 according to the embodiment of the present invention may directly receive the detection result detected from the connected HMD. That is, the control unit 180 may receive the result of sensing the direction of the face direction of the other user from the connected HMD, and receive the image related information. In this case, the received image related information may be information on horizontal and vertical view angles detected by the other HMD.

Meanwhile, when the information about the view angles in the horizontal and vertical directions is received as the image related information of the connected HMD, the controller 180 can generate an image corresponding to the received image related information in step S308. For example, the control unit 180 may extract an image of one region corresponding to the received view angle information from the currently reproduced VR content. From the extracted image, an image corresponding to the size of the currently set display area can be generated. Hereinafter, the operation of the controller 180 for generating an image according to the size of the currently generated display area based on the received view angle information will be described in more detail with reference to FIG.

If an image corresponding to the size of the currently generated display area is generated in step S308, the controller 180 may display the generated image on the display area in step S310. In this case, as described above, if a plurality of image-related information is received from a plurality of different HMDs, the controller 180 transmits the images generated from each of the received plurality of image-related information to each HMD Can be displayed on the corresponding display area.

Meanwhile, in step S310, the controller 180 may display the images displayed in the respective display areas separately from the images of the VR content that the user is viewing. For example, the controller 180 may display the periphery of each display area as a graphical object having a guideline shape of a predetermined color or thickness so that each display area is divided. Or the area corresponding to the inside of each display area on the display part 151 and the area corresponding to the outside of each of the display areas may be displayed with different brightness so that the user can more easily identify the image of each display area.

Alternatively, the control unit 180 may perform graphic processing in a predetermined manner on other areas on the display unit 151 excluding the display areas in step S310. For example, the control unit 180 processes (for example, darkening) another area on the display unit 151 excluding the display areas to a predetermined color, or sets another area on the display unit 151 Or blurred (e.g., blurred). In this case, only the images displayed in the respective display areas, that is, images corresponding to the image related information received from another user's HMD, may be clearly displayed on the display unit 151. [

Meanwhile, when a plurality of the display areas are provided, the controller 180 may group the display areas according to predetermined criteria. For example, the control unit 180 may group the display areas according to a user's selection, and may change the positions of the display areas according to a grouping result. In this case, the images displayed from the HMDs included in the same group can be displayed adjacent to each other.

It should be noted that the grouping criteria may be automatically determined. For example, the control unit 180 may perform the grouping based on the image displayed on the display unit 151 of the current HMD 100. In this case, the controller 180 may perform the grouping based on the view angle information of the image that the current user is viewing, among the VR contents. In this case, depending on whether the horizontal or vertical view angle of the image related information received from the other HMDs has a larger or smaller value than the view angle of the image currently viewed by the user, A group of display areas corresponding to each of the pieces of information can be determined. Hereinafter, an example in which the grouping is performed based on the preset reference or the view angle information of the image currently viewed by the user will be described in more detail with reference to FIG.

In step S302, the control unit 180 may display an image on the display unit 151 in the direction of the face of the HMD, that is, the face of the user, separately from the images displayed in the at least one display area . When the new HMD is connected according to the determination result of step S304, the display area corresponding to the connected HMD is further displayed or the existing connected HMD The display area corresponding thereto can be released.

4 is a flowchart illustrating an operation of generating an image corresponding to image related information received from the HMD of each of the other users in the HMD according to the embodiment of the present invention.

3, the control unit 180 of the HMD 100 according to the embodiment of the present invention may select one of at least one other HMD 100 according to a user's selection during playback of the VR content or a request from another user, Lt; / RTI > And information (hereinafter referred to as image related information) related to the image displayed in each HMD from each of the at least one connected HMD. In this case, the controller 180 may generate an image corresponding to each image-related information by performing the operation of FIG. 4 on each image-related information received. In the following description of FIG. 4, it is assumed that the received image related information is view angle information detected by another connected HMD.

First, when another HMD (second HMD) is connected, the controller 180 may receive information about the direction of the front of the head of the user wearing the second HMD from the second HMD (S400). In this case, the information received from the second HMD may be information obtained by sensing the direction of the front of the user's head in the second HMD, that is, view angle information, as described above. Therefore, the controller 180 can sense the direction of the front of the head of the user wearing the second HMD through the connected second HMD.

In operation S402, the controller 180 may calculate coordinates of one point corresponding to the received view angle from the 360-degree omnidirectional image of the VR content reproduced in operation S302.

In step S404, the controller 180 may extract an image having a predetermined size from the 360-degree omnidirectional image of the VR content centered on the coordinate calculated in step S402. Here, the predetermined size may be a size corresponding to a size of an area displayed on the display unit 151 of the HMD 100 among the 360-degree omnidirectional images. That is, in step S404, the controller 180 extracts an image corresponding to the received view angle having a size that can be displayed on the display unit 151, from the 360-degree omni- So that the same image as that of the VR content viewed by the user wearing the second HMD can be generated. In step S406, the control unit 180 resizes the generated image according to the size of the display area corresponding to the second HMD, and generates an image to be displayed on the display area. The image generated in step S406 may be displayed through a display area corresponding to the second HMD in step S310 of FIG.

Meanwhile, when the image of the display area is generated as described above, the controller 180 can check whether or not the connection with the second HMD is completed (S408). For example, if there is a predetermined input of a user to be applied to the display area corresponding to the second HMD, the controller 180 may terminate the connection with the second HMD. Alternatively, the control unit 180 may terminate the connection with the second HMD when a predetermined user's voice signal corresponding to the second HMD is sensed. If it is determined in step S408 that the connection with the second HMD is terminated, the controller 180 can cancel the display area corresponding to the second HMD in step S410. In step S406, the display area of the second HMD for displaying the resized image may not be displayed any more.

On the other hand, if it is determined in step S408 that the connection with the second HMD has not been completed, the controller 180 returns to step S400 to determine whether the connection from the second HMD to the view angle Information can be received. The process of steps S402 to S406 may be performed again to generate an image of a display area corresponding to the second HMD according to the received view angle information. Accordingly, until the connection with the second HMD is completed, the image displayed in the display area corresponding to the second HMD can be updated in real time according to the view angle information received from the second HMD. That is, the image displayed on the display area can be changed in real time according to the head movement of the wearer wearing the second HMD. Therefore, the control unit 180 according to the embodiment of the present invention can display an image corresponding to the head movement of the user wearing the second HMD on one area (display area) on the display unit 151 through the connected second HMD Can be displayed.

As described above, according to the present invention, a VR content image viewed by a user of the other HMD is displayed on at least a part of the display unit 151 from another HMD in which the same VR content is reproduced, So that they can share the images they watch with each other. Therefore, the present invention can share the sense of space that each user is experiencing the same virtual space with each other.

3 and FIG. 4, only the image related information is received from another HMD connected to the HMD 100 according to the embodiment of the present invention. Alternatively, the request from the other HMD It is also possible to transmit the image-related information in response to the request, or in response to the request of the user. In this case, based on the sensing value sensed by the sensing unit 140 of the HMD 100, the controller 180 may acquire information about the direction of the user's head front, that is, Can be transmitted as related information. More preferably, the other HMD may also be an HMD according to an embodiment of the present invention.

In the above description, the VR contents are only one 360-degree still image or moving picture. However, the VR contents may be implemented in any other form. For example, the VR contents may be composed of a plurality of still images or moving images having an angle of view larger than a predetermined angle. In this case, the VR contents may be reproduced through the HMD, either a still image or a moving image having a view angle of a plurality of predetermined angles or more constituting the VR contents according to the user's selection. In this case, even if a plurality of HMDs reproduce the same VR content as described above, the images reproduced in each HMD may be different images.

Hereinafter, an example in which the VR contents are composed of a plurality of still images or moving images having an angle of view larger than a predetermined angle will be described.

In order to distinguish the embodiment in the case where the HMD 100 according to the embodiment of the present invention reproduces the VR contents composed of a plurality of images as in the case of reproducing the VR contents composed of the one video, A case in which VR content composed of one video is reproduced is referred to as a first embodiment of the present invention, and a case in which VR content composed of a plurality of videos is reproduced will be referred to as a second embodiment of the present invention.

5A is a flowchart illustrating an operation of reproducing VR content in FIG. 3 when VR content composed of a plurality of videos is played according to the second embodiment of the present invention.

As described above, the VR contents may be composed of a plurality of different images (which may include still images or moving images). In this case, the images constituting the VR contents are generated as images having different view angles (for example, 360-degree omni-directional images or 180-degree images) each having a predetermined angle or more, as described above, Images. That is, the VR contents may be composed of images corresponding to a plurality of different virtual spaces, and the controller 180 may form the virtual space from the images corresponding to any one of the virtual spaces selected by the user (S500).

The control unit 180 may display a part of the image corresponding to the direction of the user's face in the 360 degrees omni-directional image on the display unit 151 according to the detection result of the sensing unit 140 (S502 ). The control unit 180 can check whether there is video-related information received from another HMD 100 (S504). In step S504, the controller 180 can connect to any one of the other HMDs in which the same VR content is being reproduced according to the user's selection, and acquires information related to the image of the virtual space displayed in the HMD from the connected HMD . Alternatively, when a connection request is received from a user of another HMD in which the same VR content is being reproduced, the control unit 180 may connect with the other HMD in response to the connection request, Can acquire information related to the image of the user. Such a connection request of the user may be made in accordance with an input such as a user's voice signal or a predetermined key or a gesture as described in step S304 of FIG.

If it is determined in operation S504 that there is image related information received from another HMD, the control unit 180 may set a display area corresponding to the received image related information on the display unit 151 (S506) . The position of the display area may be determined according to various setting criteria such as a preset area or a user's gaze direction. Also, the size of the display area may be determined according to the number of display areas displayed on the display unit 151, or may be determined according to a user's selection.

On the other hand, if the display area corresponding to the image-related information received in step S506 is set, the control unit 180 displays the image to be displayed through the display area on the basis of the image corresponding to the image- (S508). Here, the image-related information may be information on horizontal and vertical view angles detected by the other HMD, as described with reference to FIG. Hereinafter, the operation of the controller 180 for generating an image according to the size of the currently generated display area based on the received view angle information will be described in more detail with reference to FIG. 5B.

If an image corresponding to the size of the currently generated display area is generated in step S508, the controller 180 may display the generated image on the display area in step S510. If a plurality of image related information is received from a plurality of different HMDs, the controller 180 displays the images generated from each of the received plurality of image related information in a display area corresponding to each HMD Can be displayed.

The control unit 180 may display the images displayed in the respective display areas separately from the images of the VR content that the user is viewing. For example, as described with reference to FIG. 3, the controller 180 may display a predetermined graphic object or a region corresponding to the inside of the display region and an area outside the display region with different brightness, You may. Alternatively, the control unit 180 may process the other area on the display unit 151 except for each display area by a darkening process to a predetermined color, or blur the other area on the display unit 151 through the blurring process, It may be blurred.

Meanwhile, in a state where at least one display area is displayed separately, the controller 180 may check whether another virtual space is selected according to the user's selection (S512). If it is determined in step S512 that the other virtual space is not selected, the controller 180 proceeds to step S502 to display an image of the image of the currently selected virtual space facing the face of the user on the display unit 151 Can be displayed.

However, if it is determined in step S512 that another virtual space is selected, the controller 180 may form a new virtual space from the image corresponding to the selected virtual space (S514). In step S502, the controller 180 may display an image corresponding to the direction of the face of the user on the display unit 151 from the newly created virtual space. The process from step S504 to step S512 may be repeated until the reproduction of the VR content is completed.

5B is a flowchart illustrating an operation of generating an image according to information received from another user's HMD according to the second embodiment of the present invention.

First, when another HMD (second HMD) is connected, the controller 180 may acquire image-related information including information of a virtual space corresponding to an image displayed in the second HMD from the second HMD (S550). That is, as described above, when the VR contents are composed of a plurality of images corresponding to a plurality of virtual spaces, the second HMD stores the information of the virtual space corresponding to the image currently displayed on the display unit, Related information including the direction of the front of the user's head, i.e., view angle information, to the HMD 100 according to the embodiment of the present invention. Similarly, the HMD 100 according to the embodiment of the present invention also includes information of a virtual space corresponding to an image currently displayed on the display unit 151 and view angle information according to the detection result of the sensing unit 140 Related information to the second HMD. More preferably, the second HMD may be an HMD according to an embodiment of the present invention.

Meanwhile, the controller 180 may extract the information of the virtual space displayed in the second HMD from the image-related information acquired in operation S550 (S552). In step S554, the controller 180 may select one of the images of the virtual space that constitute the VR contents, corresponding to the virtual space information extracted in step S552. The control unit 180 calculates coordinates of one point corresponding to the view angle included in the image related information from the virtual space image selected in step S554 and extracts an image of a predetermined size centered on the calculated coordinates (S556). Here, the predetermined size may be a size corresponding to a size of an area displayed on the display unit 151 of the HMD 100.

In step S556, if a predetermined size image is extracted from the image of the virtual space corresponding to the received image-related information, the controller 180 controls the display unit 160 according to the size of the display area corresponding to the second HMD The image can be resized (S558). And display the resized image on the display area corresponding to the second HMD. Therefore, even if images of different virtual spaces are displayed, if the different virtual spaces are included in the same VR content, the controller 180 displays the images of the other virtual space displayed in the second HMD Can be displayed on the display unit (151). Likewise, the second HMD may display an image of the virtual space displayed on the HMD 100 on the display unit of the second HMD. Accordingly, the user of the HMD 100 and the user of the second HMD can share images of different virtual spaces viewed by the user.

Meanwhile, if the image of the virtual space displayed on the second HMD through the display area is displayed on the display unit 151, the controller 180 can check whether the connection with the second HMD is completed (S560) . If the connection with the second HMD is terminated, the controller 180 can release the setting of the display area corresponding to the second HMD (S562). Then, the display area of the second HMD may not be displayed on the display unit 151 any more.

On the other hand, if it is determined in step S560 that the connection with the second HMD has not been completed, the controller 180 proceeds to step S550 to acquire image-related information including information on the virtual space from the second HMD . Then, the processes from step S552 to step S560 may be performed again. Accordingly, when the image of the virtual space displayed through the second HMD is changed or the direction of the face of the user wearing the second HMD is changed, the changed image is displayed on the display area corresponding to the second HMD And can be displayed on the display unit 151.

As described above, when the VR contents are composed of images corresponding to a plurality of different virtual spaces, the virtual spaces corresponding to the images may be related to each other. For example, when the VR contents are virtual exhibition hall contents including a plurality of exhibition spaces, a plurality of virtual spaces constituting the VR contents may correspond to exhibition spaces constituting the virtual exhibition hall. Also, an image corresponding to each virtual space may be an image corresponding to each of the exhibition spaces.

Meanwhile, in the case of VR contents including a plurality of virtual spaces related to each other as described above, the virtual space may have structure information about a connection relationship between virtual spaces according to the association between virtual spaces. The structure information may be used to select an image of a virtual space desired by the user when the user reproduces the VR content, and may be provided from an external server providing the VR content together with the VR content.

On the other hand, when the structure information of the virtual spaces constituting the VR contents is acquired, the controller 180 displays each virtual space constituting the VR contents in the form of map information on the display unit 151 Can be displayed. The controller 180 of the HMD 100 according to the embodiment of the present invention can display the position corresponding to the virtual space currently viewed by the user using the map information. For example, the controller 180 may use the information of the virtual space obtained in step S552 of FIG. 5B to display the location of the user. 5C is a flowchart illustrating an operation of displaying the position of the second HMD user based on the virtual space information obtained from the image related information transmitted from the second HMD in the second embodiment of the present invention.

Referring to FIG. 5C, the controller 180 of the HMD 100 according to the embodiment of the present invention extracts information of the virtual space from the image related information transmitted from the second HMD in step S552 of FIG. 5B, The map information corresponding to the virtual spaces constituting the VR contents may be generated based on the structure information corresponding to the VR contents to be reproduced (S570). The generated map information may be displayed in a predetermined area on the display unit 151 (S572).

Here, the map information may include graphic objects corresponding to a plurality of virtual spaces constituting the VR contents. The graphic objects may be displayed to be connected to each other according to the association between the virtual spaces, or may be displayed such that the graphic objects are sequentially arranged according to the order or position according to the association. That is, when the VR contents are the virtual exhibition hall contents including the plurality of exhibition spaces, the controller 180 may display the virtual exhibition hall corresponding to each exhibition space according to the state where the plurality of exhibition spaces constituting the virtual exhibition hall are connected to each other Graphic objects can be displayed to be connected to each other. Or graphic objects corresponding to each exhibition space may be displayed in an area on the display unit 151 on which the map information is displayed according to a state in which a plurality of exhibition spaces constituting the virtual exhibition hall are arranged.

If the map information including the graphic objects corresponding to the virtual space constituting the VR contents is displayed on the display unit 151, the controller 180 displays the virtual space information corresponding to the virtual space information extracted in step S552 of FIG. 5 , One point on the graphic object corresponding to any one virtual space may be displayed as the location information of the connected second HMD user (S574). Accordingly, the control unit 180 according to the embodiment of the present invention identifies a virtual space in which the other HMD user is located in the VR content composed of a plurality of virtual spaces according to the image of the virtual space viewed by the user of the other HMD can do. Accordingly, the user can select another virtual space among the virtual spaces constituting the VR contents according to the location information of the other HMD user displayed through the map information, and accordingly, the user can move to the virtual space viewed by the other HMD user And may experience images of the virtual space together.

According to the above description, in the case of VR contents having a plurality of different virtual spaces, an image of a virtual space desired by the user can be displayed on the display unit according to the selection of each user. However, as shown in FIG. 1C, when a plurality of HMDs in which the VR contents composed of the plurality of virtual spaces are played back are connected to each other, the selection of a specific virtual space and the change of the virtual space are performed by the authority Of the present invention. That is, any one of the plurality of HMDs may be classified as a master according to the authority for selecting and changing the virtual space, and the remaining HMDs may be classified as slaves.

For example, the master HMD may be an HMD having authority to select and change the virtual space. Therefore, the master HMD can freely select and move a virtual space to enter. On the other hand, the slave HMDs are free to move their eyes within the virtual space in which they are currently located, but the selection and movement of the virtual space can be restricted. Accordingly, the slave HMDs can move from the master HMD to the selected virtual space, and can view an image of the virtual space selected from the master HMD.

For example, the user of the master HMD may be a curator who guides viewers. The user of the slave HMD may be a spectator who views each virtual space constituting the VR contents. In this case, the master HMD can transmit the voice information input from the user of the master HMD to the users of the slave HMD, and conversely, the voice information input from the user of the slave HMD can be transmitted to the user of the master HMD. The slave HMDs can move to a virtual space selected by the user wearing the master HMD, and images of the virtual space in which the master HMD has moved can be displayed in the slave HMDs according to the virtual space movement of the master HMD.

It goes without saying that the master HMD may transfer the master authority to another HMD according to various conditions. For example, the right to freely select and move the master right, that is, the virtual space to be entered, can be made according to the selection of the user currently set to the master HMD. In this case, any of the slave HMDs to which the master authority has been transferred can be set as the master HMD, and the existing master HMD can be converted to the slave HMD.

It should be noted that the transfer of the master authority can occur not only in the user's selection but also in a specific case. For example, when the HMD currently set as the master is disconnected from other HMDs (slave HMDs), the authority of the master HMD may be transferred to one of the slave HMDs.

While the HMD 100 according to the embodiment of the present invention plays back only the VR content, the HMD 100 according to the embodiment of the present invention is limited to reproducing the VR content Of course not. For example, when the HMD 100 according to the embodiment of the present invention further includes an external camera capable of sensing an external image, not only the VR content but also an augmented reality image can be displayed to be. Here, the augmented reality image may be an image sensed by the external camera and an image including a virtual object related to the sensed image. That is, the AR image displays information related to various objects included in the actual image as a virtual object in the actual image sensed by the external camera, and not only the image of the actual object but also various information related to the object It can be used to allow the user to check simultaneously.

Hereinafter, an example of displaying an AR image in the HMD 100 according to an embodiment of the present invention will be described. Hereinafter, an embodiment of the present invention in which the AR image is displayed is referred to as a third embodiment of the present invention in order to distinguish it from the first and second embodiments in which the VR contents are reproduced do.

6 is a flowchart illustrating an operation of displaying an augmented reality image in an HMD according to the third embodiment of the present invention.

6, a controller 180 according to an exemplary embodiment of the present invention displays images sensed by a camera for sensing images in a front direction of the HMD 100 on a display unit 151, Can be displayed. The control unit 180 can identify whether information related to the currently sensed image has been received from the currently sensed image. If the information related to the sensed image is received, the control unit 180 may display the AR object corresponding to the received information on the display unit 151 (S600).

For example, when information on a specific object is received from an external device, the controller 180 may analyze the image currently sensed through the camera to identify each object included in the sensed image. If the object corresponding to the received information is not included in the sensed image as a result of the analysis, the AR object may not be displayed. However, if the object corresponding to the received information is included in the sensed image, an AR object corresponding to the received information is generated, and the generated AR object is displayed around the corresponding object in the sensed image can do.

For example, in the case of a place such as an exhibition hall where various exhibits are displayed, an IOT (Internet Of Things) communication device (e.g., a beacon device) corresponding to each of the exhibits may be provided. In this case, the HMD 100 according to the embodiment of the present invention senses an image of an exhibit corresponding to the user's gaze through the camera equipped with the HMD 100 when the user views the direction in which the specific exhibit is displayed can do. And information related to an exhibit included in the sensed image can be received from the communication device corresponding to the exhibit. The received information can be displayed on the display unit 151 as an AR object. The control unit 180 may display various information related to an exhibit currently displayed on the display unit 151 through the AR object. For example, the control unit 180 may display information on an age of the exhibit, information of a maker of the exhibit, history of the exhibit, and the like.

Meanwhile, information received from the communication device may include information collected by the communication device corresponding to the exhibit. For example, the communication device may determine a visitor who stays for at least a preset time in the vicinity of the exhibit as a visitor who views the exhibit. And a visitor who has a residence time of the visitor who is viewing the exhibit more than the preset time or is closer to the exhibit than the predetermined distance may be determined as a visitor who shows a high interest in the exhibit. The communication device may also send information to the HMD 100 that has evaluated the response of the visitors related to the exhibit, such as the number of viewers and / or the number of visitors with the high interest. Then, the control unit 180 can display such information on the display unit 151 through the AR object.

On the other hand, in the state where the image of the specific exhibit and the AR object related to the exhibit are displayed on the display unit 151, the control unit 180 can detect whether or not the connection with the HMD of another user is made (S602) . For example, similar to the first and second embodiments, the controller 180 can perform a connection with another user's HMD based on a predetermined key input, a gesture, or a user's voice signal. Alternatively, if a connection request is received from a user of another HMD, the connection with the HMD of another user that has transmitted the connection request may be performed according to the user's selection. Meanwhile, the HMD 100 and the other HMD can receive information related to each exhibition and display the AR related contents through AR related contents such as AR related applications provided in the exhibition hall, for example, as AR objects. The predetermined AR-related contents can be transmitted from the server of the exhibition hall.

Here, the HMD 100 and another HMD may be HMDs in which the same AR-related contents are driven. For example, when the HMD 100 and another HMD are located in the same exhibition hall, the HMD 100 and another HMD receive information related to the exhibition from communication devices located in the same exhibition hall, Can be displayed on the display unit. In this case, the HMD 100 and another HMD may be HMDs in which the same AR-related contents are driven. Or HMDs provided with AR-related contents provided from the same server as described above may be HMDs in which the same AR-related contents are driven. The HMDs in which the same AR-related contents are driven may be connected to each other as shown in FIG. 1C.

If it is determined in step S602 that the HMD of another user is connected to the second HMD, the controller 180 may receive image related information from the second HMD. Here, the image related information received from the second HMD may include an image to be sensed by the camera provided in the second HMD and an AR object related to the display of the image.

Meanwhile, the control unit 180 can set a display area corresponding to the received image-related information (S604). Here, the display area may be formed in a predetermined area similar to the one described in the first and second embodiments of the present invention, or at one point on the display part 151 where the user looks. Also, the size of the display area may be determined according to a user's selection or predetermined criteria.

If the display area is set in step S604, the controller 180 may generate an image to be displayed through the display area in step S606. The image generated here may be an image received as the image-related information and an image including the AR object related to the display of the image, the image being resized according to the size of the currently set display area. If an image to be displayed through the display area is generated, the controller 180 can display the generated image in the display area set in step S604 (S608).

If it is determined in step S608 that the image of the second HMD camera and the AR objects of the objects included in the image are displayed, the controller 180 may proceed to step S600. The control unit 180 may display an image sensed by the camera of the HMD 100 in the display unit 151 area outside the display area and may display the AR information when there is related AR information . The process from step S602 to step S608 may be performed again.

Meanwhile, in step S602, the image related information received from the second HMD may include information related to the position of the second HMD. For example, when the HMD 100 and the second HMD are in the same exhibition hall, the HMD 100 and the second HMD can receive AR-related contents from the same server. In this case, the AR-related contents may include information on the structure of the exhibition hall. For example, when the exhibition hall is composed of a plurality of exhibition spaces for displaying different kinds of exhibits, the AR-related contents may include information about each exhibition space constituting the exhibition hall, The display unit 151 displays the information on the exhibition spaces.

In this case, it is needless to say that the HMDs connected to each other can exchange position information with each other. For example, such location information may be information on an exhibition space in which each HMD is currently located. In this case, each HMD can transmit image-related information including information about the currently displayed exhibition space, and the HMD having received the image-related information extracts information of the exhibition space in which the corresponding HMD is located from the received image-related information . Then, the controller 180 can display the information of the HMD corresponding to the extracted exhibition space in the structure information of the exhibition hall included in the AR-related contents, which is information on the place where the specific HMD is currently located . Thus, the third embodiment of the present invention may also display the location of other HMD users connected on the map information indicating the structure information of the exhibition hall, as described in FIG. 5C of the description of the second embodiment of the present invention .

Meanwhile, as described in step S608 of FIG. 6, the HMD 100 according to the embodiment of the present invention may be configured such that, when there is an AR object related to an exhibit included in an image sensed by a camera of the second HMD, Information may be received from the second HMD and displayed.

FIG. 7 is a flowchart illustrating an operation of the HMD 100 according to an embodiment of the present invention.

7, the controller 180 of the HMD 100 according to an exemplary embodiment of the present invention, when the AR object is included in the image displayed in the display area in step S608 of FIG. 6, (S700). ≪ / RTI > For example, the input of the user may be an input of a predetermined key provided in the user input unit 132, or a gesture of a user detected through a separate controller. Or a voice command of the user, or a tofu gesture of a predetermined user.

If the user inputs an AR object displayed in the display area in step S700, the controller 180 receives information corresponding to the AR object corresponding to the detected user input from the currently connected HMD, i.e., the second HMD, (S702). For example, the second HMD can receive information corresponding to the AR object at the request of the controller 180, and can transmit the received information to the HMD 100.

Meanwhile, if the information about the AR object corresponding to the input of the user is received from the second HMD in step S702, the controller 180 may display the received information on the display unit 151. [ For example, the control unit 180 may display the received information in a part of the display area or may display the received information in another area on the predetermined display unit 151. [ Or may display the received information in an area on the display unit 151 adjacent to the display area.

In the above description, the operation of the HMD 100 according to the embodiment of the present invention has been described in detail with reference to a plurality of flowcharts.

In the following description, various examples in which an image of a virtual space displayed in another HMD connected to each other is displayed in one area on the display unit according to an embodiment of the present invention will be described in more detail with reference to a plurality of example views .

8A and 8B are illustrations showing an example in which, in the HMD 100 related to the present invention, an image displayed in the HMD of the other user is displayed on the display unit according to a user's selection or another user's request .

8A illustrates an example of a case where an image displayed in a specific HMD according to a user request of the first HMD 100 among a plurality of HMDs reproducing the same VR content is displayed on the display unit 151 of the first HMD 100 As shown in Fig.

For example, a user's request for a particular HMD may be made as described above. For example, the request of the user may be made according to input of a preset key or gesture of a predetermined user. However, it is needless to say that, as shown in the first drawing of FIG. 8A, it may be based on the user's voice signal.

In this case, the controller 180 controls the microphone 131 only when there is a user input such as a preset user's gesture in order to distinguish the user's voice for requesting connection with the HMD of the other user, Can be identified as a voice signal for requesting connection with another user's HMD. That is, the control unit 180 can switch the operation mode to the user voice recognition mode when there is an input of a predetermined user. When the mode is switched to the voice recognition operation mode, the control unit 180 recognizes the voice of the user, Can be performed.

8A, when the user names a user name ('TOM') of a specific HMD, the controller 180 controls the microphone 131 of the HMD 100 It is possible to receive a voice signal calling the user name of a specific HMD. Then, the control unit 180 can recognize the received voice signal as text information through the voice recognition module.

The control unit 180 can search for the HMD corresponding to the recognized text information from the voice signal of the user, based on the information stored in the memory 170. For example, the memory 170 may store user information inputted by each user using the HMD before wearing the HMD. The control unit 180 can detect an HMD worn by the user corresponding to the recognized text information among the user information stored in the memory 170. [ Then, a signal for wireless connection can be transmitted to the detected HMD. According to the response to the transmitted signal, the mobile terminal can perform wireless connection with the detected HMD and receive information related to the displayed image in the connected HMD.

Meanwhile, when the user's voice signal, i.e., 'TOM' is connected to the HMD worn by the user, the controller 180 can receive image related information from the connected HMD. The image-related information received here may be horizontal and vertical view angle information sensed by the HMD of the 'TOM' as described above. That is, the image-related information may be a result of sensing the front face of the 'TOM', that is, the direction of the face, from the sensors provided in the HMD worn by the 'TOM'. Then, the controller 180 of the HMD 100 according to the embodiment of the present invention displays an image of one region corresponding to the direction of the head of the other user, which is sensed from the HMD of the other user, from the reproduced VR contents Can be displayed on the display unit (151).

In this case, the image of one area corresponding to the direction of the head of the other user can be displayed in the display area 810 previously set on the display part 151 as shown in the second drawing of FIG. 8A . In this case, the VR contents are reproduced in the same manner in the HMD 100 according to the embodiment of the present invention and the HMD worn by the 'TOM' as described above, and the image displayed in the display area 810 is May be the same image as the image displayed in the HMD of the 'TOM'.

On the other hand, contrary to the case of FIG. 8A, the connection with the HMD worn by another user may be performed according to a connection request received from another user. Fig. 8B shows an example of such a case.

First, referring to the first drawing of FIG. 8B, in the first drawing of FIG. 8B, when there is a connection request received from another user, notification information 850 for notifying the user of the connection request is displayed on the display unit 151 This is an example. In this case, as shown in the first drawing of FIG. 8B, information ('TOM') about the user who transmitted the connection request may be displayed in the notification information 850, and whether to accept the connection request may be displayed At least one graphic object may be included for selection.

In this state, the control unit 180 may detect a user's input regarding whether to accept the connection request. For example, the input of such a user may be an input of a specific key sensed through the user input unit 132 or a gesture of a particular user. For example, when the user snaps the hand holding the controller provided with the user input unit 132 in the left direction, the control unit 180 may detect the snap by accepting the connection request. On the other hand, if the user snaps the hand holding the controller in the right direction, this can be detected as a rejection of the connection request. The first diagram of FIG. 8B shows an example in which the controller 180 detects the input of the user as an acceptance of the connection request.

Meanwhile, as shown in the first diagram of FIG. 8B, when the user accepts a connection request received from another user, the controller 180 may perform a wireless connection with another user's HMD. And from the other connected HMDs, information related to the video of the VR content displayed on the other HMD. The video of one region of the VR contents corresponding to the received video related information can be displayed in the display region corresponding to the different HMD as shown in the second drawing of FIG. 8B.

In the above description, the controller 180 of the HMD 100 according to the embodiment of the present invention receives image related information from another HMD 100 connected to the HMD 100. However, Similarly, information related to the image displayed through the display unit 151 of the HMD 100 may be transmitted to another connected HMD.

9 is a diagram illustrating examples of displaying images displayed in the HMDs of a plurality of other users in the HMD 100 according to the embodiment of the present invention.

First, the controller 180 of the HMD 100 according to an embodiment of the present invention may display an image of a virtual space included in VR contents that are currently reproduced. That is, the control unit 180 can display, on the display unit 151, an image of one area corresponding to the front direction of the HMD 100 sensed through the sensing unit 140 among the images of the virtual space.

In this state, the control unit 180 may be connected to at least one other HMD based on the request of the user or the request received from the user of another HMD. And receives information related to the virtual space image currently displayed in each HMD from the connected HMD and displays the images corresponding to the received image related information on the display unit 151. [ 9A shows an example in which images displayed on a plurality of different HMDs connected to the HMD 100 are displayed on the display unit 151 of the HMD 100 according to the embodiment of the present invention It is.

9 (a), the control unit 180 of the HMD 100 according to the embodiment of the present invention displays display areas 910, 912, 914, and 912 corresponding to the number of currently connected HMDs, 916). In this case, the controller 180 can determine the size of each display area according to the number of the display areas. Alternatively, the size of each display area may be determined according to a preset size.

On the other hand, the control unit 180 can display the image corresponding to the image currently displayed in the HMD in the display area corresponding to each HMD. 9A, images displayed in a plurality of HMDs connected to the HMD 100 are displayed on the display unit 151 of the HMD 100 according to the embodiment of the present invention, .

Meanwhile, the controller 180 of the HMD 100 according to the embodiment of the present invention not only receives image related information from another HMD connected thereto, but also receives the image displayed on the display unit 151 And the like. In this case, as described above, the image related information to be transmitted is information about the direction of the front of the HMD 100 sensed as a result of the sensing by the sensing unit 140, for example, information such as horizontal and vertical view angles Lt; / RTI > Then, the other HMD receiving the image-related information transmitted from the HMD 100 according to the embodiment of the present invention also displays the image corresponding to the image displayed on the display unit 151 based on the received image- Can be generated and displayed. Therefore, the present invention allows users who wear a plurality of HMDs to reproduce the same content to share images they are watching with other users. Accordingly, the present invention allows the users to have the same spatial feeling as if they experience the same virtual space through the same contents.

Meanwhile, according to the above description, the controller 180 of the HMD 100 according to the embodiment of the present invention has mentioned that the user can arbitrarily group or automatically group the display areas corresponding to the respective HMDs . FIG. 9 (b) shows an example in which the display areas are grouped as described above.

For example, when another HMD is connected, the control unit 180 can select a specific group corresponding to the HMD from the user. Then, the control unit 180 can set the display area corresponding to the HMD to a position corresponding to the selected specific group. For example, when another HMD is connected, the controller 180 may select the HMD as the first group or the second group, and may select one of the first group and the second group adjacent to the left corner on the display unit 151 according to the group selected by the user. The display area corresponding to the HMD can be generated in the first group of areas or in the second group of areas formed adjacent to the right corner on the display part 151. [

Meanwhile, when the user does not directly group the display areas, the controller 180 may automatically group the display areas according to a predetermined reference. For example, the predetermined reference may be coordinate information on a virtual space corresponding to an image displayed on the display unit 151 at present. That is, the controller 180 can group the images corresponding to the image-related information received from the other HMD based on the coordinates of the image currently viewed by the user. Figure 9 (b) shows this example.

In this case, a reference display area 950 corresponding to an image to be a grouping reference, that is, an image displayed on the current display unit 151, may be displayed on the display unit 151. Then, the controller 180 may compare the view angle of the image displayed in the reference display area 950 with the image related information received from another HMD, that is, view angle information.

For example, the controller 180 controls the direction of the front face of the HMD 100 sensed by the current sensing unit 140, that is, the vertical component of the view angle (view angle information in the vertical direction) The image related information received from the HMD facing the direction higher than the front direction of the HMD 100 and the direction lower than the front direction of the HMD 100 are detected by comparing the vertical components of the view angles included in the HMD 100, It is possible to distinguish the image-related information received from the HMD. The HMD facing the higher direction and the HMD facing the lower direction can be divided into different groups.

Therefore, if the HMD 100 according to the embodiment of the present invention and other connected HMDs display a virtual space image as shown in FIG. 2B, the controller 180 controls the HMD 100, May be formed as the first group, and the HMDs facing the lower direction may be formed as the second group. When the first group is formed on the left of one area on the display unit 151 on which the reference display area 950 is displayed, the image corresponding to the image related information received from the HMD facing the higher direction Image 914) can be displayed on the left side of the reference display area 950. On the other hand, the images (first image: 910, second image: 912, fourth image: 914) corresponding to the image related information received from the HMDs facing toward the lower direction are displayed on the right side Can be displayed. In this case, as shown in FIG. 9 (b), among the images belonging to the same group, the position at which the image is displayed can be determined according to the result of comparing the view angle information.

According to the above description, the HMD 100 according to the embodiment of the present invention can display the display areas displayed on the display part 151 to be distinguished. FIG. 10 is an exemplary diagram illustrating other examples in which images displayed in the HMDs of a plurality of other users are displayed in the HMD according to the embodiment of the present invention.

10 (a) shows an example in which the HMD 100 according to the embodiment of the present invention darkens another portion on the display portion 151 except the region where the display regions are displayed. In this case, as shown in FIG. 10 (a), other areas on the display unit 151 excluding the display areas 910, 912, 914, and 916 are not displayed any more due to the darkening process, It may be difficult to display. Here, the darkening process may mean a process of displaying a predetermined area on the display unit 151 in a predetermined color (for example, black).

It should be noted that the display areas may be divided through other graphic processing. 10 (b), the control unit 180 blurs other portions on the display unit 151 except the display regions 910, 912, 914, and 916, It may be processed. In this case, other areas on the display unit 151 except for the display areas 910, 912, 914, and 916 may be displayed blurred due to the blurring process to be difficult to identify.

On the other hand, in the case where the VR contents are composed of a plurality of virtual space images as described in the second embodiment of the present invention, in the HMD 100 related to the embodiment of the present invention, Is displayed.

First, referring to the first drawing of FIG. 11, the first diagram of FIG. 11 shows a case where one virtual space image 1100 from VR contents consisting of a plurality of virtual space images is displayed on the display unit 151 The example shown is shown. In this case, the control unit 180 can obtain the structure information of the virtual spaces constituting the VR contents from the information related to the VR contents, and displays the structure information on the display unit 151 The virtual space corresponding to the image can be displayed separately. Then, it can be displayed as map information 1120, as shown in the first drawing of FIG.

The map information 120 may include information on the virtual spaces 1122, 1124, and 1126 constituting the VR contents, as shown in the first drawing of FIG. If the virtual space corresponding to the image currently displayed on the display unit 151 is the first virtual space 1122, the control unit 180 determines that the user is located in the first virtual space 1122 And display a graphic object ('ME') on the map information.

Meanwhile, the map information may display not only the location information of the user but also the location of the virtual space corresponding to the currently connected user of the HMD. That is, when another HMD to which the same VR content is reproduced is connected, the controller 180 can acquire image related information about the image displayed in the HMD as described above. In this case, the image related information may include information of a virtual space corresponding to an image displayed in each HMD, and the controller 180 may determine a position of a virtual space corresponding to a user of each HMD based on the information of the virtual space Can be displayed. Here, the image corresponding to the image-related information may not be displayed as much as the user selects.

On the other hand, the position of the user of each HMD can be displayed by a name set by each user. That is, if the user of the other HMDs is registered as TOM and Jane and the HMD worn by the TOM is located in the second virtual space 1124, the controller 180 reads the map information 1120 from the second virtual space 1124 (&Quot; TOM ") to indicate that the TOM is located at one point in the graphical user interface (GUI). In this way, a graphical object can be displayed to indicate that Jane is located at one point in the virtual space where the HMD worn by Jane is located.

In this state, the user may select a specific virtual space. The selection of the virtual space may be performed through the map information 1120. For example, when any one of the objects 1122, 1124, and 1126 included in the map information 1120 is selected by the user, the controller 180 displays any one of the virtual space images corresponding to the selected object Can be displayed on the display unit (151). That is, if the user selects one point on the map information 1120 corresponding to the third virtual space 1126, as shown in the second drawing of FIG. 11, The image 1150 can be displayed on the display unit 151. [

In this case, if another user is located in the virtual space, an avatar corresponding to the user may be displayed on the display unit 151. 11, if the user moves to the third virtual space 1126, the control unit 180 determines whether another user located in the third virtual space 1126, namely, Jane May be displayed on the display unit 151 as shown in FIG.

12 is an exemplary diagram illustrating an example in which an HMD according to an embodiment of the present invention displays an AR image as described in the third embodiment of the present invention.

12, the first diagram of FIG. 12 illustrates a communication device 1210 that recognizes a user when he / she is viewing a specific exhibit 1200 according to the third embodiment of the present invention. Shows an example of transmitting information related to the exhibit that the user is grateful for. For example, the communication device 1210 may determine that the user is viewing the exhibit 1200 when it is detected that the user is staying within a predetermined distance from the exhibit 1200 for a predetermined time, And may transmit various information related to the display 1200 to the HMD 100.

Meanwhile, the HMD 100 according to the embodiment of the present invention can display an image of the front surface of the HMD 100, which is sensed by the camera, on the display unit 151. Accordingly, even if the HMD 100 blocks the user's view, the user can identify the object ahead through the image displayed on the display unit 151.

12, when the user looks at the direction in which the specific exhibit 1200 is positioned, the control unit 180 displays the image 1250 of the exhibit 1200 on the display unit 151 as shown in FIG. Can be displayed. The controller 180 may receive the information transmitted from the communication device 1210 and may display the received information on the display unit 151 as information related to the display 1250 displayed on the display unit 151, Can be displayed on the screen. That is, the information received from the communication device 1210 may be displayed on the display unit 151 in the form of the AR information 1260.

On the other hand, even when the AR image is displayed through the HMD 100 according to the embodiment of the present invention, images connected to other HMDs and images corresponding to the images displayed on the different HMDs are displayed on the display unit 151 . 13 is an exemplary view illustrating an example of displaying an AR image displayed in another user's HMD according to a user's selection when the HMD according to the embodiment of the present invention displays the AR image.

13, the control unit 180 of the HMD 100 according to the embodiment of the present invention displays an image 1312 sensed from the front direction of the HMD 100 on the display unit 151 ). ≪ / RTI > If the sensed image includes an image 1314 of a specific exhibit, the AR information 1316 corresponding to the exhibit may be displayed on the display unit 151. [

Meanwhile, in this state, the control unit 180 can display information related to the position of another HMD connected to the HMD 100 through the map information 1300. [ Here, the map information 1300 may include information on the exhibition spaces constituting the exhibition hall where the current user is located, and may display the exhibition space 1310 corresponding to the current location of the user separately. For example, the location of the user may be identified by the communication device that transmitted the AR information.

On the other hand, the map information 1300 may display the exhibition space 1320 where other users are located. For example, the HMD of the other user may be previously connected to the HMD 100 according to the embodiment of the present invention by a user.

On the other hand, when there is an HMD of another user connected in this way, the control unit 180 may display an image displayed on the HMD of the other user on the display unit 151 according to a request of the user or a request received from the other user have. That is, the controller 180 can receive the image sensed by the camera of the other user's HMD. As shown in the first drawing of FIG. 13, the display area 151 1350 to display the received image.

Meanwhile, in the display area 1350, an AR object 1352 corresponding to the AR information received in the HMD of the other user may be displayed as well as the image sensed by the camera of the HMD of the other user.

Meanwhile, when the AR object 1352 is displayed in the area where the image displayed in the HMD of another user is displayed, the controller 180 can detect the input of the user applied to the AR object 1352. [ For example, the input of the user may be a preset key input or a user voice command. Alternatively, the input of the user may be applied according to a gesture of a hand holding a predetermined user's head gesture or a controller provided with the user input portion 132. [

Meanwhile, when the input of the user to the AR object 1352 is applied, the controller 180 may request the information of the AR object 1352 to the HMD of the other user. Then, the HMD of the other user can receive the information corresponding to the received request, and can transmit the received information to the HMD 100. 13, the control unit 180 generates AR information 1360 from the information received from the HMD of the other user, and displays the generated AR information 1360 on the display unit 151, Can be displayed on the screen. Accordingly, the present invention can be applied to an exhibit in a specific exhibition or other exhibition space, even if the user is not located around a specific exhibit or displayed in another exhibition space where the user is located, via the HMD of another connected user And can collect and store relevant AR information.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a controller 180 of the HMD 100. The foregoing detailed description, therefore, should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (15)

An HMD connected to at least one of a plurality of second HMDs (Head Mounted Display) for reproducing the same virtual space image,
A communication unit for performing a wireless connection with the at least one second HMD;
A sensing unit for sensing a direction of the front of the HMD;
A display unit for displaying an image of one area of the virtual space image corresponding to a direction of the front of the HMD; And
And a controller for displaying images corresponding to a part of the virtual space images displayed in each of the at least one second HMD connected to the HMD on different areas on the display unit,
Wherein,
Detecting at least one head movement of each wearer wearing the at least one second HMD based on information received from the at least one second HMD, detecting a head movement of each wearer wearing the at least one second HMD, And the corresponding images are displayed in different areas on the display unit.
The apparatus of claim 1,
Displaying images corresponding to images displayed in each of the at least one second HMDs in at least one display area formed in different areas on the display unit,
Wherein an image within the display area is displayed separately on the display unit through a predetermined graphic object or graphic processing.
3. The apparatus of claim 2,
And displaying the other area on the display unit except for the inside of the display area in a predetermined color or displaying another area on the display unit in an opaque or blurred manner over a predetermined level to divide the image inside the display area To the HMD.
3. The apparatus of claim 2,
And displays an image displayed in the selected display area on the entire display screen when the user selects one of the display areas.
3. The apparatus of claim 2,
Grouping the at least one display area into at least one group according to a user's selection or predetermined criteria,
And the display areas included in the same group are displayed adjacent to each other.
6. The apparatus of claim 5,
Grouping at least one second HMD connected to the HMD into at least one group according to a user's selection,
Wherein the at least one second HMD determines a position of a display area corresponding to each of the at least one second HMD according to a grouping result.
The apparatus of claim 1,
Wherein the HMD performs connection with at least one of the second HMDs based on a connection request of at least one of the second HMDs or a connection request received from at least one of the second HMDs.
6. The apparatus of claim 5,
When the HMD operates in the voice recognition mode, detects a specific wearer corresponding to a recognition result of the user's voice signal among the wearers wearing the plurality of second HMDs, and performs connection with the HMD of the wearer Gt; HMD < / RTI >
An HMD connected to at least one of a plurality of second HMDs (Head Mounted Display) for reproducing the same Virtual Reality (VR) content and displaying any one of a plurality of virtual space images constituting the VR content,
A communication unit for performing a wireless connection with the at least one second HMD;
A sensing unit for sensing a direction of the front of the HMD;
A display unit for displaying an image of one area corresponding to a direction of the front of the HMD from a virtual space image selected from a user among the virtual space images constituting the VR contents; And
And a controller for displaying images corresponding to a part of the virtual space images displayed in each of the at least one second HMD connected to the HMD on different areas on the display unit,
Wherein,
Receiving from the at least one second HMD information about a virtual space image displayed in the second HMD and a result of sensing a head movement of a wearer wearing the second HMD,
A second HMD corresponding to the head movement of each of the at least one second HMD wearer, from virtual space images respectively corresponding to the information received from the respective second HMDs of the virtual space images constituting the VR contents, And displays the extracted image on at least one display area formed on the display unit, respectively.
10. The method of claim 9,
The VR contents include:
Further comprising structure information indicating a relationship between virtual spaces corresponding to each of the plurality of virtual space images,
Wherein,
Each virtual space constituting the VR contents according to the structure information is displayed in one area on the display unit in the form of map information,
Wherein the HMD displays a specific virtual space corresponding to a virtual space image currently displayed on the display unit in a virtual space in which the user of the HMD is located on the map information.
11. The apparatus according to claim 10,
A virtual space in which the wearer of each of the second HMDs is located is displayed separately on the map information based on information on the virtual space image displayed in the second HMD received from each of the at least one second HMDs .
11. The apparatus according to claim 10,
And displays an image of one region of the image of the selected virtual space corresponding to a direction of the front of the HMD when any one of the virtual spaces displayed on the map information is selected.
10. The method of claim 9,
The HMD and at least one second HMD connected to the HMD are divided into a master HMD and a slave HMD according to whether a specific virtual space image can be selected or not,
Wherein,
If the HMD is set to the master HMD, display one area of a specific virtual space image selected from the user on the display unit and display the at least one second HMD to display a portion of the selected virtual space image Lt; RTI ID = 0.0 > HMD < / RTI &
When the HMD is set as the slave HMD, an image of one region corresponding to the direction of the front of the HMD among the specific virtual space images under the control of the HMD set to the master HMD among the at least one second HMD is displayed .
(HMD) connected to at least one of a plurality of second HMDs (Head Mounted Display) in which the same AR (augmented) related content is driven,
A communication unit for performing a wireless connection with the at least one second HMD and receiving the AR-related information from a neighboring predetermined communication device;
A camera unit for sensing an image in a direction of the front of the HMD;
A display unit for displaying the image sensed by the camera unit and the AR-related information corresponding to the image; And
And a control unit displaying an image sensed by a camera unit of each of the at least one second HMD connected to the HMD and the AR information received at each of the at least one second HMD on a part of the display unit,
The AR-
Further comprising map information for a plurality of locations including at least one location where the HMD and the at least one second HMD are located,
Wherein,
Wherein the HMD displays a specific place corresponding to a position of the HMD and at least one second HMDs connected to the HMD among a plurality of places included in the map information so as to be distinguished from other places.
15. The apparatus of claim 14,
If there is a user's selection of AR information displayed on a part of the display unit, the information corresponding to the selected AR information is received through any one of the second HMDs transmitting the selected AR information, and the received information is displayed Gt; HMD < / RTI >

Images