KR101692267B1 - Virtual reality contents system capable of interacting between head mounted user and people, and control method thereof - Google Patents

Abstract

Disclosed is a virtual reality contents system capable of interacting between an HMD user and the general public. The present invention includes a plurality of spectator terminals which request a server to participate in the contents of a client terminal, generates contents data including at least one of motion sensing and operating signals of a body, and transmits the contents data to the server. The server outputs the process of the contents on a main display located in an open place by converging the contents data of the spectator terminal on the contents data of the client terminal. Accordingly, a new business model converging real and virtual spaces can be created because an interaction between the HMD user and the general public can be performed.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual reality contents system capable of interacting with an HMD user and a plurality of ordinary people, and a control method thereof. [0002]

The present invention can improve the accessibility to the virtual reality contents by allowing the visitors who view the virtual reality contents output through the large electric signboard to interoperate with the HMD users, and the HMD users who can contribute to popularization, To a virtual reality content system and a control method thereof.

Recently, as IT technology has rapidly developed, interest in 3D virtual reality combined with video technology and various sensor technologies is increasing.

Such 3D virtual reality has been variously attempted to be applied to an entertainment field such as a movie or a game. A virtual reality program based on a computer recognizes a user's motion and outputs a specific situation through a video processor So that they can participate in content.

However, in the case of the existing 3D virtual reality system, various sensors including a wearable monitor are connected to a computer through a wired connection, which causes a limitation of movement due to various cables, and a factor that deteriorates the realism and immersion of contents . Especially, as the realistic demand of virtual reality increases, the output quality of video and sound increases. As the number of sensors to detect voice, position, and motion increases, the use of various wired cables also increases. The number of users of the mobile communication terminal has a problem that the movement of the user is severely restricted within a limited space.

Therefore, in the past, many techniques for solving the above-mentioned problems have been proposed. However, there is a problem in that, as the content is first-person viewpoint, mass production of enthusiasts in a real space and an isolated space is caused.

In addition, since conventional virtual reality contents are mainly marketed for first-person games, expensive equipment such as an HMD (HEAD-MOUNTED DISPLAY) is required and operation is difficult.

Korean Patent Laid-Open Publication No. 10-2015-0120755 (published on October 28, 2015) Korean Patent Publication No. 10-2013-0093886 (published on Aug. 23, 2013) Korean Registered Patent No. 10-0911719 (registered on Aug. 4, 2009)

It is an object of the present invention to provide a virtual reality contents system capable of interacting with an HMD user and a plurality of ordinary people so as to connect a virtual reality and an actual space, Method.

It is another object of the present invention to provide a virtual reality contents system and a control method therefor that enable interaction between a plurality of ordinary people and an HMD user that can be manufactured and installed at low cost and simple in operation and contribute to popularization of virtual reality contents The purpose.

The present invention also provides a content system capable of interacting with an HMD user and a plurality of ordinary people who can view and demonstrate a virtual reality content screen in an open space, And a control method therefor.

The present invention includes the following embodiments in order to achieve the above object.

A preferred embodiment of the present invention is a virtual reality contents display method for realizing virtual reality contents in a first person virtual reality contents screen executed in a client terminal which executes virtual reality contents and transmits content data according to an HMD user's motion and operation command, And a plurality of guest terminals for requesting participation in contents of the client terminal and generating content data including at least one of motion detection and operation signals of the body and transmitting the generated content data to the server, The content data of the terminal is merged with the content data of the client terminal and transmitted to the client terminal, and the content progress process according to the interaction between the viewer terminal and the client terminal received from the client terminal is displayed on the main display, either first person or third person HMD output to one content execution screen Interaction between a plurality of the public can provide virtual reality systems available content.

Therefore, the present invention has the effect of allowing the general public to participate in the virtual reality contents, and the content can be progressed by the interaction between the HMD user and a plurality of viewers, thereby creating a new business model.

In addition, the present invention enables virtual reality contents displayed by an HMD user wearing a virtual reality apparatus to be viewed in an open place, thereby inducing interest and participation of visitors, thereby improving accessibility.

Further, since the present invention can access a large number of viewers at the same time using a low-cost and easy-to-operate device, a new leisure culture combining multi-party interaction, active experience in various fields, scientific and entertainment functions There is an effect to be able to experience.

FIG. 1 is a view for explaining an outline of a virtual reality contents system and a control method thereof, in which an HMD user and a plurality of ordinary people can interact with each other according to the present invention.
2 is a block diagram illustrating a virtual reality content system capable of interacting with an HMD user of the present invention and a plurality of ordinary people.
3 is a perspective view showing an example of a mobile container of the present invention.
4 is a view showing an example of a main display and its screen of the present invention.
5 is a block diagram illustrating a fixed terminal of the present invention.
6 is a block diagram illustrating a mobile terminal of the present invention.
7 is a block diagram showing a server and a main display of the present invention.
8 is a block diagram showing a setting unit of the present invention.
9 is a flowchart illustrating a method of controlling a virtual reality contents system capable of interacting with an HMD user of the present invention and a plurality of ordinary people.
10 is a flowchart showing the step S110 in the present invention.
11 is a flowchart showing step S120 in the present invention.
12 is a flowchart showing the first embodiment of the step S200 in the present invention.
13 is a flowchart showing a second embodiment of the step S200 in the present invention.
14 is a flowchart showing the third embodiment of the step S200 in the present invention.

Hereinafter, embodiments and examples of the present invention will be described in detail so that those skilled in the art can easily carry out the present invention. It should be understood, however, that the present invention may be embodied in many different forms and is not limited to the embodiments and examples described herein.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. Also, the terms " part, " " absent, "and " means" in the specification mean units of a configuration for processing at least one function or operation and may be implemented by a combination of hardware and / Be able to

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of a virtual reality contents system and a method thereof capable of interacting with an HMD user and a plurality of ordinary people according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a view for explaining an outline of a virtual reality contents system and a control method thereof capable of interacting with an HMD user and a plurality of ordinary people according to the present invention. FIG. 2 is a block diagram showing a virtual reality contents system capable of operating.

1 and 2, the present invention includes a client terminal 500 for executing virtual reality contents, a visitor terminal 200 operated by visitors, a client terminal 500 for transmitting the virtual reality contents transmitted from the client terminal 500 and the visitor terminal 200, A main display 400 for outputting a content screen implemented by an interaction between the client terminal 500 and the visitor terminal 200 and a client terminal 500 and / And a sub display 300 for outputting a screen of the main display 400.

The present invention converts a screen of a first-person virtual reality contents of an HMD user wearing a virtual reality apparatus into a third person and outputs the converted screen to a main display 400 installed in a public place to view and participate in a plurality of viewers .

That is, a plurality of viewers can view the virtual reality contents screen executed by the HMD user at the client terminal 500, and can view the visitor terminal 200 (the fixed terminal 210 and the fixed terminal 210) (E.g., a mobile terminal 220) to participate in virtual reality content (e.g., a 3D virtual reality game) that the HMD user is executing.

Also, it is preferable that the main display 400 installed in the open place is installed on the outer wall of the building 700 (see FIG. 4) constructed by the modular method. The modular system is a generally known technology in a manner in which a plurality of assembled structures 700 and the like are assembled to complete one structure 700. Although the prefabricated building 700 has been proposed in various constructions, the prefabricated container 70 will be described as an example.

The sub-display 300 is installed indoors as a number of sub-displays. Here, the sub-display 300 is connected to the client terminal 500 and may output the same screen as the screen of the client terminal 500. Alternatively, the sub-display 300 may output the same screen as the main display 400 for the visitors located in the room as a plurality of sub-displays.

The visitor terminal 200 transmits an operation signal and / or a motion detection signal of the spectators wishing to participate in the content among the spectators watching the contents screen output from the main display 400 to the server 100 in a wired or wireless communication manner .

The client terminal 500 corresponds to a terminal that is worn and / or manipulated by the HMD user with, for example, equipment for virtual reality (e.g., HEAD MOUNTED DISPLAY). Since the client terminal 500 corresponds to a known virtual reality device, a detailed description thereof will be omitted.

The server 100 maps content data received from a plurality of guest terminals 200 to content executed in the client terminal 500 and transmits the content data to the client terminal 500. The server 100 transmits the content received from the client terminal 500 And outputs the screen to the main display 400 and / or the sub display 300 in a third person or first person screen.

For example, the server 100 outputs the screen of the main display 400 as a third-person screen if the game is one-to-many, and outputs the screen of the main display 400 as a first- can do.

The client terminal 500 determines whether the viewer terminal 200 received from the server 100 has the motion of the character according to the motion and / or the operation and the motion and the reaction of the character according to the HMD user's motion and / , And transmit the result to the server 100.

At this time, the content data of the client terminal 500 transmitted to the server 100 includes a content screen, a character of the visitor terminal 200, a character of the client terminal 500, a motion between each character, . ≪ / RTI >

Here, the subject for executing the content and determining the result of the motion and / or operation of the visitor terminal 200 and the client terminal 500 may be selected from the client terminal 500 and the server 100.

That is, the client terminal 500 and the server 100 can determine whether or not the content is to proceed based on whether an algorithm (for example, data mapping, result determination, graphics)

The content data of the visitor terminal 200 and the client terminal 500 are mapped to determine the result of the mapping so that the content is displayed on the main display 400 and / And transmits the result to the client terminal 500. [

Alternatively, when the content is executed by the client terminal 500, the server may map the content data of the visitor terminals 200 and transmit the content data to the client terminal 500. When the content containing the determination result received from the client terminal 500 And controls the data to be output to the main display 400 and / or the sub display 300.

The visitor terminal 200 can perform wired / wireless communication with the server 100 so that viewers who watch the contents execution process of the client terminal 500 output to the main display 400 and / or the sub display 300 can participate in the game directly And transmits the motion and / or operation signals of the visitors to the server 100. To this end, the visitor terminal 200 selects one of the fixed terminal 210 and the portable and / or wearable mobile terminal 220 at a predetermined position or a combination of the fixed terminal 210 and the mobile terminal 220 Lt; / RTI >

The fixed terminal 210 extracts the motion of the visitors through the video and generates game data. The specific configuration will be described later.

The mobile terminal 220 includes at least one of an operation console for transmitting an operation signal by an operation of a visitor, a sensor terminal equipped with a sensor for sensing motion worn on a part of the body, or a portable communication device (smart phone, PDA, It can be one.

Here, the fixed terminal 210 and the mobile terminal 220 may generate and / or select a character desired by the server 100 through a content screen provided by the server 100. [ Such character-related image data may be stored in the server 100 or provided at the client terminal 500.

Also, the main display 400, the fixed terminal 210, and the mobile terminal 220 have been described as being installed outdoors, but the present invention is not limited thereto. That is, in the present invention, the main display 400 may be constituted by a large transparent electronic signboard combined with a plurality of electronic signboards at a designated position in the room, or may be implemented as a single large transparent electronic signboard. Likewise, the mobile terminal 220 and the fixed terminal 210 may also communicate with the server 100 within the established area of the main display 400 installed indoors.

The description of the above-described configurations will be described in detail with reference to Figs. 3 to 8. Fig.

FIG. 3 is a perspective view showing an example of a prefabricated container of the present invention, and FIG. 4 is a view showing an example of a main display and a screen of the present invention.

3 and 4, the main display 400 according to the present invention includes a prefabricated container 70, which is applied to a modular construction method of completing one building 700 by assembling multiple buildings, for example, Lt; / RTI >

In the prefabricated container 70 applied to the present invention, at least one of the upper, lower, left, and right wall surfaces is implemented as a transparent electric sign board 411. Here, the transparent electroluminescent panel 411 may be configured as a light emitting plate, which is mounted so that a plurality of light emitting elements emit light by a power source applied from a pattern-formed wire in the transparent electrode, and a plurality of cover plates bonded as a resin to the light emitting plate . It is preferable that a plurality of double cover plates are made of a pair glass structure so that heat insulation and noise shielding are possible.

That is, according to the present invention, a large-sized main display 400 is formed by a combination of a plurality of transparent display boards 411 to 414 as a plurality of prefabricated containers 70 made of a transparent display board 411 are stacked. Can be implemented.

Although the structure of the main display 400 is described as being located on the outdoor side for illustrative purposes, it may be provided on the indoor side.

The sub display 300 displays a screen of the client terminal 500 and / or the main display 400 on the inside of the building 700 completed by assembling the prefabricated container 70 as described above.

Accordingly, the present invention can provide a screen of the client terminal 500 and / or a screen of the main display 400 located in the interior of the modular building 700 completed by a plurality of the assembled containers 70, Can be confirmed through the display 300.

The fixed terminal 210 will be described with reference to FIGS. 4 and 5. FIG.

5 is a block diagram illustrating a fixed terminal of the present invention.

Referring to FIG. 5, the fixed terminal 210 of the present invention is a terminal fixed to monitor an area set in front of the main display 400, as shown in FIG. More specifically, the fixed terminal 210 includes a camera 212 for capturing an image of a predetermined area, a motion sensing unit 213 for extracting motion of the image captured by the camera 212, A fixed control unit 211 for generating content data of the viewer terminal 200 including the motion detection signal and a control unit 211 for controlling the operation of the server 100 under the control of the fixed control unit 211. [ And a fixed communication unit 215 for transmitting the content data to the mobile station.

The camera 212 photographs the viewer A positioned in the area set in front of the main display 400 under the control of the fixed control unit 211 and outputs the captured image to the motion detection unit 213.

The object setting unit 214 sets and extracts an object from the image photographed by the camera 212 under the control of the fixed control unit 211. [

The motion detection unit 213 detects the motion of the object set by the object setting unit 214 and outputs the motion to the fixed control unit 211. Here, the motion sensing unit 213 compares the current image frame with the previous image frame in the image of the viewer A photographed by the camera 212, and determines whether the object set in the object setting unit 214 is motion Can be determined.

When the camera 212 captures an image, the fixed controller 211 controls the object setting unit 214 to classify the object of the captured image, and controls the motion sensing unit 213 to detect the motion of the object do.

For example, when the content selected by the server 100 is football (see FIG. 4), the fixed control unit 211 determines whether the character 500 'operated by the client terminal 500 is a goalkeeper, Character is set as the opponent's striker. Accordingly, when the viewer A is positioned at a predetermined position in front of the character 500 'of the client terminal 500 output to the main display 400, the fixed terminal 210 can display the movement and speed of the foot of the viewer A And generates content data.

That is, the fixed terminal 210 senses the motion of the viewer A from the virtual reality contents output to the main display 400, calculates the content data (e.g., speed, direction and position) .

The mobile terminal 220 is a terminal that can be worn or portable to the body of the visitor A and transmits to the server 100 a signal according to the operation of the viewer and content data by sensing the sensor. The mobile terminal 220 will be described with reference to FIGS. 4 and 6. FIG.

6 is a block diagram illustrating a mobile terminal 220 of the present invention.

6, the mobile terminal 220 includes a mobile communication unit 222 that communicates with the server 100, a mobile sensor unit 223 that senses the motion of a visitor, an operation command through several key panels, And a mobile control unit 221 for controlling the mobile communication unit 222 to the mobile operation unit 224. [

The mobile communication unit 222 wirelessly communicates with the server 100 and / or the fixed terminal 210. For example, the mobile communication unit 222 transmits the content data including the motion detection data of the visitor to the server 100 under the control of the mobile control unit 221.

The mobile sensor unit 223 senses the position and motion of a part of the body of the visitor A (e.g., arm, leg, neck) and outputs it to the mobile control unit 221.

The mobile operation unit 224 outputs an operation command by an operation of a visitor as any one of a joystick, a key panel, and a mouse. Alternatively, the mobile operating unit 224 may correspond to a touch screen capable of both input and output.

That is, the mobile terminal 220 may correspond to at least one of a game console, a wearable sensor, and a portable communication device (smart phone, PDA, or tablet PC).

More preferably, the mobile terminal 220 and the fixed terminal 210 generate a content data of a visitor by using a combination of the mobile terminal 220 and the fixed terminal 210, and transmit the generated content data to the server 100. For example, the fixed terminal 210 senses the gesture or the position of the viewer through the photographed image of the camera 212, and the mobile terminal 220 is worn on the body of the viewer A to sense the direction and the speed .

Accordingly, the server 100 generates content data corresponding to the position, direction and speed of the viewer through the motion detection signals of the fixed terminal 210 and the mobile terminal 220, and maps the content data to the content data of the client terminal 500 We play each other's games.

For example, in the case of a fighting game, it is determined whether or not to avoid the position or movement of the viewer through the image captured by the camera 212, 500) motion data (e.g., direction and velocity) at the time of the strike against the character.

The server 100 and the main display 400 will be described with reference to Figs. 4, 7, and 8. Fig.

FIG. 7 is a block diagram showing a server and a main display of the present invention, and FIG. 8 is a block diagram showing a setting unit of a server.

7 and 8, the server 100 of the present invention includes a server communication unit 120 (a fixed terminal 210 and / or a mobile terminal 220) for communicating with a visitor terminal 200 (a fixed terminal 210 and / or a mobile terminal 220) A setting unit 130 for setting the number and priority of the connectable visitor terminal 200 and the client terminal 500 and a setting unit 130 for setting the content data of the client terminal 500 and the contents data of the visitor terminal 200 together A mapping unit 140 mapping the contents to one content screen, a database 150 storing contents executed by the client terminal 500, an audio output unit 170 outputting sound, And a driving circuit 160 for driving and controlling the driving circuit.

The server communication unit 120 communicates with the client terminal 500 and the visitor terminal 200 as wired and / or wireless. The server communication unit 120 receives the content data of the client terminal 500 and the content data of the visitor terminal 200 under the control of the server control unit 110 and outputs them to the server control unit 110.

8, the setting unit 130 includes a limit setting module 131 for setting the number of simultaneous connectable visitor terminals 200 to limit the connection of the visitor terminal 200, a main display 400, A display control module 132 for dividing and controlling the screen of the sub display, and a ranking setting module 133 for assigning a priority to the visitor terminal 200. [

The limit setting module 131 limits the number of the guest terminals 200 that can be simultaneously connected according to the set connection conditions. For example, the limit setting module 131 restricts the connection of the visitor terminal 200 other than the currently connected visitor terminal 200 if the number of the maximum number of the visitor terminal 200 is seven.

The display control module 132 divides the screen of the main display 400 and / or the sub display into at least two or more. For example, if the client terminal 500 is two, the display control module 132 divides the screen of the main display 400 into two, and the guest terminal 200 connected to each client terminal 500 outputs a character do.

The rank setting module 133 sets the connection and / or execution priority of the visitor terminals 200. For example, in the case of a soccer game, if the character of the client terminal 500 is a goal keeper, the visitor terminal 200 becomes 10 field players. At this time, according to one soccer ball, since 10 field player characters can not simultaneously shoot in a penalty kick situation, the order of shooting is automatically set by 10 characters according to the priority order of the ranking setting module 133.

Alternatively, the rank setting module 133 may set priorities to the guest terminals 200 waiting for connection in addition to the currently connected characters according to the restriction condition of the simultaneous connection, for example, according to the connection request time zone.

The mapping unit 140 maps the content data of the visitor terminal 200 to the content data of the client terminal 500. For example, the mapping unit 140 maps the content data of the visitor terminals 200 to the content data including the motion and the position of the client terminal 500. The content data mapped by the mapping unit 140 is transmitted to the client terminal 500.

The database 150 includes a limit setting condition, unique identification information of the client terminal 500 and the visitor terminal 200, execution information of the content, identification information of the registered client terminals 500, A guidance message, and the like may be included. Or separate advertising content may be stored.

The electric display panel driver 160 sequentially and / or collectively controls a plurality of electric display panels 411 to drive the main display 400. [ Here, the main display 400 may include a plurality of electric display boards 411 and a plurality of controllers for driving and controlling the electric display boards 411. The electric sign board 411 corresponds to the transparent electric sign board 411 constituting one wall surface of the assembled container 70.

The server control unit 110 drives the mapping unit 140 to fuse both data when the content data of the client terminal 500 and the visitor terminal 200 received through the server communication unit 120 is received, . The server control unit 110 controls the electric panel driving unit 160 to output the content screen received from the client terminal 500 through the main display 400. [

Here, the client terminal 500 outputs a first-person screen, and the screen output to the main display 400 is output as a third-person or first-person view. Alternatively, the server control unit 110 may selectively convert the screen of the main display 400 according to the contents of the contents, from the first person or the third person screen.

The server control unit 110 controls the limit setting module 131 and the rank setting module 133 to determine whether or not the visitor terminal 100 is requested to access through the server communication unit 120, (200), or sequentially open or block the communication channel according to the priority set for each connected visitor terminal (200). In addition, the server control unit 110 may assign the priorities to the waiting viewer terminals 200 in accordance with the connection request time and sequentially grant the access.

The server control unit 110 drives the display control module 132 according to the number of the client terminals 500 requested to be connected through the server communication unit 120. The display control module 132 drives the electric panel driving part 160 to divide the screen according to the number of the client terminal 500. [

The server control unit 110 controls the sound output unit 170 to control the sound set according to the screen of the main display 400 and the sounds according to the character motion of the client terminal 500 and the visitor terminal 200, The sound output unit 170 may be controlled to output a voice message or the like stored in the database 150. [

The present invention can provide a control method of a virtual reality contents system capable of interacting with an HMD user and a plurality of ordinary people through the above-described configuration. This will be described with reference to Figs. 9 to 14. Fig.

9 is a flowchart illustrating a method of controlling a virtual reality contents system capable of interacting with an HMD user of the present invention and a plurality of ordinary people.

9, the present invention includes a step S100 of a visitor terminal 200 that senses motion and / or operation of a visitor terminal 200 sensed by a fixed terminal 210 and a mobile terminal 220, S200 of mapping the content data received from the visitor terminals 200 and the client terminal 500 to the main display 400 and the sub display 300 in step S200, And S310 and S320 of detecting the motion and outputting the content screen of the client terminal 500 in the main display 400 and displaying the merged content screen of the client terminal 500 and the viewer terminal 200 And S420.

First, the HMD user wears his / her client terminal 500 (e.g., HMD) in step S310 and selects content. The content selection signal is transmitted to the server 100. Further, the HMD user operates his / her client terminal 500 in step S320 to execute the content. At this time, the client terminal 500 generates content data that senses the operation of the HMD user and motion, and transmits the generated content data to the server 100.

Accordingly, the server 100 outputs the content data received from the client terminal 500 to the main display 400 in step S200. In addition, the server 100 may control the sub display 300 to output the content data of the client terminal 500.

The main display 400 outputs the content screen of the client terminal 500 in step S410. Here, the content screen in step S410 is a screen obtained by converting the screen of the first person view output from the client terminal 500 (for example, the HMD) to the third person view.

 Therefore, the main display 400 can display the content screen of the client terminal 500 and draw the viewer's attention. At this time, the server 100 may output a voice message to induce participation of the game with the client terminal 500 through the sound output unit 170. [ Alternatively, the server 100 may output a text message for inviting the viewer to participate through the main display 400. [

At this time, in step S100, the out-door viewers check the content screen output through the main display 400 and move to the set area as shown in FIG. 4 to display the fixed screen 210 and / or the mobile terminal 220, The game with the character 500 'of the client terminal 500 outputted to the main display 400 proceeds.

In step S200, the server 100 maps the content data received from the client terminal 500 and a plurality of viewer terminals 200 to output the content data through the main display 400 and the sub display 300, respectively.

In operation S100, the operation and / or motion of the viewer is sensed in the mobile terminal 220 and the motion of the viewer is sensed in the fixed terminal 210 (S120). Step S110 will be described with reference to FIG. 10 and step S120 will be described with reference to FIG.

10 is a flowchart showing the step S110 in the present invention.

Referring to FIG. 10, step S110 includes step S111 in which the mobile terminal 220 is turned on, step S112 of confirming the motion of the viewer and / or input operation command, and step S112 of detecting the motion and / And transmitting the converted format to the server 100 (S113).

 In step S111, the mobile terminal 220 is worn on the body of the visitor, or the power is turned on by the operation of the visitor. As described above, the mobile terminal 220 may include at least one of a wearable sensor that senses motion worn on the body and a terminal capable of wireless communication such as a smart phone, a portable communication device such as a PDA and a tablet PC, and an operation console Can be selected.

In the case of the wearable sensor, the wearer wears the wearer's body (e.g., at least one of a hand, an arm, and a leg) and senses the motion of the wearer's body and transmits it to the server 100 wirelessly.

The portable communication device receives and executes an application capable of inputting an operation command of content transmitted from the server 100, for example, as any one of a smart phone, a PDA, and a tablet PC, ). ≪ / RTI >

Here, the application installed in the portable communication device may be configured to input a content participation command, a creation and / or selection of a participating character, and an operation command for controlling the motion of the character.

Further, the operation console inputs a command for controlling the motion through the mobile operation unit 224, and allows the user to create and / or select his / her character through the main display 400. [

That is, the mobile terminal 220 including at least one of the portable communication device, the wearable sensor, and the operation console includes at least one of a sensor for sensing motion and a mobile operation unit 224 capable of inputting operation commands and selecting a menu. And can input character motion detection and / or manipulation commands. It is also desirable that the mobile terminal 220 be able to create and / or select its own character.

Step S112 is a step of sensing the motion of the viewer at the mobile terminal 220 and / or receiving an operation command.

As shown in Fig. 4, for example, if the character of the client terminal 500 is a goalkeeper who keeps the soccer goal, if the player wears the wearable sensor, a motion for kicking the soccer ball Take it. Accordingly, the mobile sensor unit 223 senses it and outputs it to the mobile control unit 221.

Alternatively, a viewer using the operation console or the smart phone operates the mobile operation unit 224 to input a shooting command.

Accordingly, the mobile control unit 221 confirms whether a motion sensing or manipulation command is input from the mobile sensor unit 223 and / or the mobile manipulation unit 224. [

In step S113, the mobile control unit 221 transmits the content data including the motion detection signal and the operation command input from the mobile sensor unit 223 or the mobile operation unit 224 to the server 100. [

Here, the mobile control unit 221 generates content data including the motion detection signal and / or operation command of the mobile sensor and unique identification information, and transmits the generated content data to the server 100. At this time, the transmitted content data is mapped to the content data of the client terminal 500.

In step S120, the fixed terminal 210 generates content data, which will be described with reference to FIG.

11 is a flowchart showing step S120.

Referring to FIG. 11, step S121 of photographing a visitor located in a predetermined area in the fixed terminal 210, step S122 of classifying and setting an object in the photographed image, step S123 of detecting motion of the set object, And converting the motion detection signal detected in step S123 into data of a predetermined format and transmitting the data to the server 100 in step S124.

In step S121, the camera 212 is turned on in the fixed terminal 210 to photograph a viewer located in an area set in front of the main display 400. [ Here, the fixed controller 211 turns on the camera 212 to photograph the set area. At this time, the fixed terminal 210 is turned on according to a command input from a control of the server 100 or a separate operation key panel. A known technique may be applied to the on / off operation of the fixed terminal 210, and detailed description thereof has been omitted.

In step S122, the fixed control unit 211 outputs the image photographed by the camera 212 to the object setting unit 214, and classifies and sets the object included in the photographed image. Here, the object setting unit 214 may selectively set a motion detection object for each content. For example, the object setting unit 214 sets a foot and a leg of a body as a target object in the case of a soccer game, and sets an object as a hand, a leg, a neck, a body, and a head in a case of a fighting game.

Accordingly, the object setting unit 214 extracts the set object among the images photographed by the camera 212 under the control of the fixed control unit 211, and sets the motion detection object.

In step S123, the motion detector 213 is driven by the control of the fixed controller 211 to detect the motion of the set object in the photographed image. The motion detection unit 213 compares the frames of each image and senses the motion of the set object, and outputs a detection signal to the fixed control unit 211.

In step S124, the fixed control unit 211 generates content data by combining the motion detection signal of the motion detection unit 213 and unique identification information, and transmits the generated content data to the server 100. [ The fixed control unit 211 converts the set unique identification information and the motion detection signal of the motion detection unit 213 into data of a predetermined format and controls the fixed communication unit 215 to transmit the data to the server 100.

The server 100 transmits the content data generated by the operation of the client terminal 500 in steps S310 and S320 and the operation of the mobile terminal 220 in step S110 and / And outputs the content screen of the first or third person view to the main display 400. The step S200 will be described with reference to Figs. 12 to 14. Fig.

12 is a flowchart showing a first embodiment of the step S200 of the present invention.

12, the first embodiment of the step S200 includes a step S211 of receiving an access request signal of the client terminal 500, a step S212 of receiving the content data of the client terminal 500 and outputting the content data to the main display 400 Step S213 of determining whether the visitor terminal 200 is participated, step S214 of forming a communication channel with the participant visitor terminals 200, step S214, (S215) mapping the screen to the main display 400 and the client terminal 500, and outputting the screen to the main display 400 (S216).

Step S211 is a step in which the server control unit 110 receives the connection signal of the client terminal 500 through the server communication unit 120. [ The client terminal 500 is turned on by the operation of the HMD user and executes the selected content. At this time, the client terminal 500 transmits the connection request signal to the server 100 including the unique identification information. Accordingly, the server communication unit 120 receives the connection request signal of the client terminal 500 and outputs the connection request signal to the server control unit 110. The server control unit 110 receives the connection request signal from the client terminal 500 and confirms whether or not the client terminal 500 is set as unique identification information to approve the connection.

In step S212, the server control unit 110 receives the content data from the client terminal 500 and outputs the content screen to the main display 400. [ The client terminal 500 executes the selected content and transmits data of the executed content (for example, background and character information, unique identification information for each content, character information, motion of the HMD user, sound and text message) .

Accordingly, the server control unit 110 controls the electric panel drive unit 160 to output the content data of the client terminal 500 received through the server communication unit 120 to the main display 400 and / or the sub display 300 .

The electric display panel driver 160 selectively controls the plurality of electric display panels 411 constituting the main display 400 to output a content screen (e.g., a game screen) selected by the client terminal 500. At this time, each of the controllers 421 to 424 blinks the light emitting elements provided on the respective electric sign boards 411 to 414 to output a predetermined screen. That is, the main display 400 outputs a content screen of the client terminal 500 by combining a plurality of electric display boards 411. Here, each of the electric sign boards 411 to 414 corresponds to a transparent electric signboard in which a luminescent transparent plate on which a light emitting element is mounted and a cover transparent plate are combined by resin.

In step S213, the server control unit 110 determines whether a participation request signal is received from the visitor terminal 200. [ Here, it is preferable that the number and order of the visitor terminal 200 that can request participation are set. The server control unit 110 controls the electric panel driving unit 160 and the sound output unit 170 to output game participation induction voice and / or text messages through the main display 400 and / or the sub display 300 .

Therefore, the guest confirms the message output through the main display 400 and requests participation in the game with the client terminal 500 using the fixed terminal 210 and / or the mobile terminal 220. [ Accordingly, the fixed terminal 210 and the mobile terminal 220 transmit the participation request signal including unique identification information to the server 100, respectively.

In step S214, the server 100 forms a communication channel with the guest terminals 200 transmitting the participation request signal. Here, the server control unit 110 forms a channel selectively with the viewer terminals 200 corresponding to the restriction condition and the priority condition set in the setting unit 130, and receives the content data including the motion detection and operation signal . At this time, the visitor terminals 200 transmit the content data including the motion detection and / or operation signal through step S100 described above.

In step S215, the content data received from the visitor terminals 200 is mapped to the content data of the client terminal 500 and output to the main display 400 and / or the sub display 300 in step S214.

Here, the mapping means that the motion and the operation between the client terminal 500 and the visitor terminal 200 are fused and expressed on one content screen. That is, the server control unit 110 controls the mapping unit 140 to control the mapping between the client terminal 500 and the visitor terminal 200 in the main display 400 according to the motion detection and manipulation commands of the client terminal 500 and the visitor terminal 200 200).

For example, if the output content is a soccer game, the fixed terminal 210 and / or the mobile terminal 220 senses a motion shot by the viewer and transmits the sensed motion to the server 100 in step S100.

The server 100 maps the shooting motion (direction and speed) of the visitor terminal 200 to the content screen and transmits the mapping to the client terminal 500. Then, the HMD user confirms the direction and speed of the ball shot by the viewer through his display, and takes a motion to defend it. The client terminal 500 senses the motion of the HMD user and transmits the motion to the server 100.

Accordingly, the server control unit 110 maps the content data as described above to determine the result of shooting of the visitor terminal 200 and the defense of the client terminal 500. [

In step S216, the server control unit 110 controls the electric panel driving unit 160 to output the content data mapped to the main display 400. [ The server control unit 110 outputs the results of the motions of the client terminal 500 and the visitor terminal 200 to the main display 400 and / or the sub display 300 in step S215. In addition, the server control unit 110 provides the same screen to the client terminal 500 through the server communication unit 120.

That is, according to the present invention, a content screen output through the main display 400 installed in an open place can be viewed by the general public, and viewers can participate in a game with an HMD user wearing virtual reality equipment. Therefore, HMD users can enjoy contents while communicating with a large number of people in an open space rather than an isolated space, and it is easy to create and test a new business model. In addition, the general public can experience the virtual reality contents using the viewer terminal 200 which is easy to operate, so that access to the virtual reality contents is easy.

In addition, according to the present invention, multiple visitor terminals 200 can simultaneously participate in contents or sequentially participate according to a set priority. This will be described with reference to FIG.

13 is a flowchart showing a second embodiment of the step S200 in the present invention.

Referring to FIG. 13, the second embodiment of the step S200 selectively restricts the viewer terminals 200 to be simultaneously accessed for each content, and sets a priority order. More specifically, the second embodiment of the step S200 includes a step S221 of setting a condition for each content, a step S222 of counting participating terminals, a step S223 of judging whether the condition is satisfied, And forming a channel sequentially with the visitor terminals 200 in step S224.

The step S221 is a step for setting and registering the conditions differently for each content. For example, when the content is a one-to-one fighting game, the administrator may set the number of the guest terminals 200 capable of connecting with the client terminal 500 to one, and may set the number of the guest terminals 200 as a multiple when the content is a dancing game . The server control unit 110 drives the setting unit 130 to register such a setting condition when an administrator inputs it using an operating device such as a keyboard.

In step S222, the server control unit 110 counts the number of the guest terminals 200 transmitting the participation request signal. For example, the server control unit 110 counts the number of the visitor terminals 200 that requested participation in step S213 of the first embodiment.

In step S223, the server control unit 110 determines whether the number of the visitor terminals 200 requested to participate corresponds to a setting condition. For example, when the concurrent access restriction condition registered by the setting unit 130 is 2, the server control unit 110 may transmit the attendance request signal to the visitor terminal 200, (200).

In step S224, the viewer terminals 200 corresponding to the set simultaneous access restriction conditions confirmed in step S223 are given priority in chronological order to sequentially form channels. The server control unit 110 restricts connection of the viewer terminals 200 corresponding to the simultaneous access restriction conditions registered by the limit setting module 131 of the setting unit 130. [ At this time, the server control unit 110 forms a channel in the order in which the participation request signal is received, drives the rank setting module 133, and transmits the visitor terminal 200 having the current channel, Thereby giving priority to the mobile stations 200.

That is, the rank setting module 133 sequentially assigns priorities in accordance with the time when the participation request signal is transmitted, in addition to the currently-connected guest terminals 200. When the connected visitor terminals 200 are turned off, the server control unit 110 sequentially establishes a channel with the waiting visitor terminals 200 according to the priority order, and approves the participation of the next visitor terminals 200.

In the third embodiment of the step S200, a plurality of client terminals 500 are connected to realize a plurality of contents simultaneously. More specifically, the third embodiment of the step S200 includes a step S231 of receiving a connection request signal of the client terminal 500, a step S232 of determining whether the number of the requested client terminal 500 is two or more, A step S233 of forming a group channel of the guest terminals 200 capable of executing contents for each client terminal 500 requested to be connected and a screen dividing step of dividing the screen of the main display 400 into the number of the client terminal 500 And a step S235 of outputting a screen to the main display 400 by mapping data for each group channel.

Step S231 is a step in which the server control unit 110 receives a connection request signal of the client terminal 500 from the server communication unit 120. The client terminal 500 transmits a connection request signal to the server 100 through step S310 described above.

In step S232, the server control unit 110 confirms the number of the client terminal 500 transmitting the connection request signal. For example, the client terminal 500 may select two or more different contents or the same contents to transmit the connection request signal to the server 100. The limit setting module 131 of the setting unit 130 may limit the number of the client terminals 500 that can be simultaneously connected and the ranking setting module 133 may limit the number of the client terminals 500 to be connected by the limit setting module 131 It is also possible to give priorities to client terminals 500 that are limited in waiting.

Step S233 is a step of creating a group channel for each client terminal 500 so as to group the viewer terminals 200 that can participate in the content. For example, when receiving the connection request signal from the first client terminal 500 and the second client terminal 500, the server control unit 110 transmits the participation request signal to the visitor terminal 200 are communicatively connected to each other and a viewer terminal 200 transmitting participation request signals for contents of the second client terminal 500 are communicatively connected to each other.

In step S234, the server control unit 110 controls the electric panel driving unit 160 to divide the screen of the main display 400 and output a content screen for each client terminal 500. [ The electric panel driving unit 160 selectively drives each controller according to the number of divided screens. For example, when the main display 400 divided into the first to fourth display panels 411 to 414 is divided into two screens, the first and second display panels 411 and 412 Can be divided into the first screen, and the third display panel 413 and the fourth display panel 414 can be divided into the second screen. This can be accomplished by the electric display panel driver 160 selectively controlling the first to fourth controllers 421 to 424.

In operation S235, the server control unit 110 controls the mapping unit 140 to map the content data received for each channel group and output the content data through the divided screen of the main display 400. [ The mapping unit 140 maps content data of the visitor terminals 200 received through the first channel group to the first client terminal 500 and then transmits the content data to the first client terminal 500 And displays the received content data on a set one of the divided screens on the main display 400. [

Similarly, the mapping unit 140 maps the content data of the visitor terminals 200 received through the second channel group to the second client terminal 500, and then transmits the content received from the second client terminal 500 And outputs the data to one of the divided screens on the main display 400. [

At this time, the sub-display 300 may provide a divided screen for each client terminal 500, or may output only a content screen for each client terminal 500. That is, the sub display 300 can be installed in the interior of the building 700 in which the prefabricated containers 70 are stacked.

A plurality of sub displays 300 are connected to the client terminal 500 to output a screen output from each client terminal 500 or any one of the screens divided in the main display 400 is output as a full screen . In addition, a plurality of sub-displays 300 may output a divided screen in the same manner as the main display 400.

As described above, the present invention can create various types of business models as the HMD user located in an isolated place can be interworked with a plurality of public persons in an open place. Further, the present invention provides an easy-to-operate terminal and method thereof to the general public, so that the virtual reality contents can be enjoyed at a lower cost than in the prior art, and the accessibility can be improved.

The embodiments of the video call system and method of the mobile terminal using the short range wireless communication of the present invention described above are merely illustrative and those skilled in the art will appreciate that various modifications and equivalent It will be appreciated that other embodiments are possible. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims. It is also to be understood that the invention includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims.

100: server 110:
120: server communication unit 130: setting unit
140: mapping unit 150:
160: electric panel driving part 200: visitor terminal
210: fixed terminal 211: fixed controller
212: camera 213: motion detection unit
214: object setting unit 215: fixed communication unit
220: mobile terminal 221: mobile controller
222: mobile communication unit 223: mobile sensor unit
224: Mobile operating unit 300: Sub display
400: main display 411 to 414: electric display panel
421 to 424: Controller 500:

Claims (9)

A client terminal for executing virtual reality contents and transmitting content data according to HMD user motion and manipulation commands;
A server for outputting the first-person virtual reality contents screen executed by the client terminal to the main display in one of a first person and a third person; And
And a plurality of guest terminals for requesting the server to participate in the contents of the client terminal and generating content data including at least one of motion detection and operation signals of the body and transmitting the generated content data to the server,
Wherein the server transmits the content data of the visitor terminal to the client terminal and transmits the content progress data to the client terminal, A virtual reality contents system capable of interacting with a plurality of public persons and an HMD user outputting the virtual reality contents through a content execution screen of either a first person or a third person.
A main display installed on a wall of a building;
A client terminal located in the interior of the building for executing virtual reality contents and transmitting content data according to an HMD user's motion and operation command;
A server for outputting a first-person virtual reality content screen executed by the client terminal to the main display in one of a first person and a third person; And
And a plurality of guest terminals for requesting participation of the contents to the server, generating content data including at least one of motion detection and operation signals of the body, and transmitting the generated content data to the server,
The server transmits the content data of the visitor terminal to the client terminal and transmits the content data to the client terminal, and transmits the progress of the viewer terminal and the client terminal, which are received from the client terminal, To the content execution screen of either the first person or the third person,
Wherein the building is a modular building in which a plurality of assembled containers are assembled, wherein the HMD user and the plurality of ordinary people can interact with each other.
The method as claimed in claim 1 or 2, wherein the plurality of prefabricated containers each comprise a transparent wall plate,
Wherein the main display comprises a plurality of transparent electric display boards, and the HMD user and the plurality of ordinary people can interact with each other.
The method according to claim 1 or 2, wherein the visitor terminal
A fixed terminal for sensing a motion of a user located within a set area; And
And a mobile terminal worn by a part of a body of the user, wherein the HMD user and the plurality of ordinary people can interact with each other.
The method according to claim 1 or 2, wherein the visitor terminal
A smartphone, a tablet PC, a PDA, and an operation console, wherein the HMD user and the plurality of ordinary people can interact with each other.
The system of claim 1 or 2, further comprising: an HMD user further including a plurality of sub-displays that output the same screen as at least one of the main display and the client terminal, system.
A) a client terminal selecting a virtual reality content to transmit a connection request to a server, and transmitting content data including an HMD user's motion and operation command;
B) a server for outputting a content execution screen of a first person received from the client terminal in the step a) to the main display in one of first and third persons;
C) transmitting the participation request signal to the server after the step b), and transmitting content data including at least one of a motion detection and an operation command of the user; And
Wherein the content data received from the plurality of guest terminals in the step c) is mapped with the content data of the client terminal received in the step b) to display the progress of the interaction between the client terminal and the plurality of viewer terminals And d) a step of d) outputting the content to a content execution screen of any one of a first person and a third person through a main display in a d) step of interacting with a plurality of ordinary people with the HMD user.
8. The method of claim 7, wherein step c)
C-1) transmitting a participation request signal to the server when the power is turned on;
If the participation request signal is approved from the server after step (c-1), a motion detection signal for sensing a motion of the body and at least one of an operation command input from at least one of an operation key, a mouse, a joystick, C-2) step;
(C-3) of generating content data including at least one of a motion detection signal and an operation command detected in step (c-2) and unique identification information and transmitting the generated content data to the server, and a plurality of general users A method for controlling a virtual reality contents system capable of interacting with each other.
8. The method of claim 7, wherein step c)
C-1) photographing an image of a user positioned within a set area when the power is turned on;
C-2) setting a motion sensing object in the image photographed in the step c-1);
C-3) detecting a motion of the object set in the step c-2) among the images captured in the step c-1); And
(C-4) transmitting content data including the motion detection signal and the unique identification information of the object sensed in the step (c-3) to the server, and a step A method for controlling a real content system.

Images