WO2019132521A1

WO2019132521A1 - Virtual environment control system

Info

Publication number: WO2019132521A1
Application number: PCT/KR2018/016683
Authority: WO
Inventors: 이후정; 김재영
Original assignee: 스코넥엔터테인먼트주식회사
Priority date: 2017-12-26
Filing date: 2018-12-26
Publication date: 2019-07-04

Abstract

One aspect may provide a virtual reality control system for providing a virtual image for at least a part of a virtual environment, through a wearable display device worn by a player, to the player playing in a plurality of separated spaces, the virtual reality control system comprising: at least one first detecting device for obtaining detecting information about a first play space; at least one second detecting device for obtaining detecting information about a second play space; at least one auxiliary computing device for generating a first virtual image and a second virtual image; a first wearable display device for outputting the first virtual image to a first player located in the first play space; and a second wearable display device for outputting the second virtual image to a second player located in the second play space, wherein the first virtual image is an image for an area corresponding to a field of view at a position determined on the basis of first virtual position information in the virtual environment, and the second virtual image is an image for an area corresponding to a field of view at a position determined on the basis of second virtual position information in the virtual environment.

Description

Virtual environment control system

The present invention relates to a virtual environment control system.

A virtual environment is a technology that provides a user with an arbitrary world implemented through a program, unlike the real world.

Conventionally, such a virtual environment has been provided through a display which is provided independently from a user such as a monitor, etc. However, recently, a VR, which is directly worn on a user's head and provides a virtual environment to a user at a position close to the user's eyes, AR and MR.

In providing such a virtual environment, a user who wears a wearable display device conventionally sat or stood at a fixed position, but in recent years, he has developed into a technique of playing a virtual environment in a predefined space have.

Conventionally, in providing such a space-based virtual environment, there is a limitation in accepting players by providing only one virtual environment in one space, and there is a problem in that a virtual environment can not be shared among players located in different spaces .

One task is to provide a virtual environment control system capable of providing the same virtual environment to a plurality of players playing in space with each other.

Another object of the present invention is to provide a virtual environment control system that converts the action in the real world between the players who play in the space with each other into an action in the virtual environment.

It is to be understood that the present invention is not limited to the above-described embodiments and that various changes and modifications may be made without departing from the spirit and scope of the present invention as defined by the following claims .

According to an aspect of the present invention, there is provided a virtual reality control system for providing a virtual image of at least a part of a virtual environment through a wearable display device worn by a player to a player playing in a plurality of separated spaces, At least one first detecting device for obtaining texturing information; At least one second detecting device for obtaining detecting information for a second play space; At least one auxiliary computing device for generating a first virtual image and a second virtual image; A first wearable display device for outputting the first virtual image to a first player located in the first play space; And a second wearable display device for outputting the second virtual image to a second player located in the second play space, wherein the auxiliary computing device comprises: Acquiring first virtual position information on a virtual environment corresponding to the first player based on real position information of the first player, acquiring first virtual position information as position information in a virtual environment corresponding to the first player, Acquiring second virtual position information for the second player based on the first virtual player information and second virtual position information that is a position in the virtual environment corresponding to the second player based on the real player position information of the second player And the first virtual image corresponds to an area corresponding to a field of view at a position determined based on the first virtual position information in the virtual environment And the second virtual image is an image for an area corresponding to a view at a position determined based on the second virtual position information in the virtual environment.

According to another aspect of the present invention, there is provided a wearable display device for providing a virtual image of at least a part of a virtual environment to a player playing in a plurality of separated spaces, the communication device for acquiring information about the other player; A display unit for outputting a virtual image to the player; And a controller for controlling the output of the virtual image on the display unit, wherein the virtual image output through the display unit includes a virtual image corresponding to a first virtual space corresponding to a first play space played by a player wearing the wearable display apparatus, An image for a region and an image for a second virtual region corresponding to a second play space played by at least one other player other than the player may be provided.

It is to be understood that the solution of the problem of the present invention is not limited to the above-mentioned solutions, and the solutions which are not mentioned can be clearly understood by those skilled in the art to which the present invention belongs It will be possible.

According to one aspect, it is possible to provide the same virtual environment to a plurality of players who play in space with each other.

According to another aspect, it is possible to convert the action in the real world between the players playing in the space with each other into the action in the virtual environment.

The effects of the present invention are not limited to the above-mentioned effects, and the effects not mentioned can be clearly understood by those skilled in the art from the present specification and the accompanying drawings.

1 is an environment diagram illustrating a system according to one embodiment.

2 is a block diagram illustrating a detection system in accordance with one embodiment.

3 is a block diagram illustrating a server according to one embodiment.

4 is a block diagram illustrating a secondary computing device in accordance with one embodiment.

5 is a block diagram illustrating a wearable display device according to an embodiment.

6 is an exemplary diagram illustrating an implementation of a system according to one embodiment.

7 is a schematic diagram illustrating a method of tracking a target object according to an embodiment.

8 is an exemplary diagram illustrating an implementation of a virtual environment according to an embodiment.

9 is an exemplary diagram illustrating a rotation delay according to one embodiment.

10 is an exemplary diagram showing an error of rotation delay according to an embodiment.

11 is a flowchart illustrating a rotational delay matching method according to an embodiment.

12 is an exemplary diagram illustrating final angular value acquisition according to one embodiment.

FIG. 13 is a diagram illustrating virtual image acquisition according to rotation delay matching of a detaching device and a wearable display operation sensor module according to an exemplary embodiment.

FIG. 14 is an exemplary diagram showing correction of a virtual image according to the rotational delay matching method described above.

15 is an exemplary diagram of a system for subspace matching according to one embodiment.

16 is an illustration of another system for subspace matching according to one embodiment.

17 is an exemplary diagram illustrating a subspace matching according to an embodiment.

18 is an exemplary view showing a distance relationship in the divided space matching according to an embodiment.

FIG. 19 is an exemplary view showing the matching of the field of view in the subspace matching according to an embodiment. FIG.

20 is an exemplary diagram illustrating movement in a subspace matching according to an embodiment;

21 is an exemplary diagram illustrating a shot situation in a subspace matching according to an embodiment.

22 is an exemplary diagram illustrating sound matching in a subspace matching according to one embodiment.

FIG. 23 is a diagram showing the division of space into the same space according to an embodiment. FIG.

24 is a diagram illustrating a collaboration object in a subspace matching according to one embodiment.

25 is a diagram showing a divided space matching according to another embodiment.

Figure 26 is a diagram illustrating movement from one sub-space match to another in accordance with another embodiment.

FIG. 27 is a diagram showing a shot according to a positional relation in a subspace matching according to another embodiment. FIG.

FIG. 28 is a diagram showing the sound matching in the divided space matching according to another embodiment. FIG.

29 is an exemplary view showing face registration according to an embodiment.

30 is a flowchart showing a play character acquisition method according to an embodiment.

31 is a diagram illustrating acquisition of face data through a face sensor unit according to an embodiment.

32 is an exemplary diagram showing face data of a player according to an embodiment.

FIG. 33 is a diagram illustrating acquisition of previously stored face data using identification information according to an embodiment. FIG.

34 is a diagram illustrating selection of a virtual character according to an embodiment.

35 is an exemplary view of a play character according to an embodiment.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities.

In the drawings, the thicknesses of the layers and regions are exaggerated for clarity and the element or layer is referred to as being "on" or "on" Included in the scope of the present invention is not only directly above another element or layer but also includes intervening layers or other elements in between. Like reference numerals designate like elements throughout the specification. The same reference numerals are used to designate the same components in the same reference numerals in the drawings of the embodiments.

The detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, numerals (e.g., first, second, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another.

In addition, the suffix "module" and " part "for constituent elements used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

Unlike the real world, a virtual environment can be an artificial environment generated by a program.

Such a virtual environment typically includes a VR that creates a virtual space separated from reality by a program and provides an image of the virtual space, a AR that provides a single image as a virtual image based on the real world, And MR that provides a virtual space and provides an image of the virtual space.

In describing the virtual environment described below, the virtual environment may mean an environment for providing various types of virtual space as well as the VR, AR, and MR described above.

Hereinafter, a system for providing a virtual reality according to an embodiment will be described with reference to FIG.

1 is an environment diagram illustrating a system according to one embodiment.

Referring to FIG. 1, the system may include a detection system 100, a server 200, a secondary computing device 300, a wearable display device 400, and an input device 500.

According to one embodiment, the detection system 100 may be coupled to the server 200.

Detecting system 100 may track objects to obtain detec- tion information.

The object according to one embodiment may be an object that affects an image output through the wearable display device 400. [

For example, the object may include at least one of a body part of the player, a wearable display device 400, a user, an input device 500, an object located near the user, and an object having a reference point or feature point.

In addition, tracking of the tracked object according to one embodiment may mean acquiring information about the position of the object in a real environment.

For example, tracking of a tracked object can acquire information about a position that changes in accordance with the movement of the object in a real environment. The positional information on the object may be acquired in a predetermined period, but is not limited thereto.

According to one embodiment, the detecting system 100 may provide the detaching information to the server 200.

According to one embodiment, the server 200 may be coupled to the detecting system 1000 and the secondary computing device 300.

The server 200 may obtain information from the connected configuration.

According to one embodiment, the server 200 may obtain at least one of the detecting information from the detecting system 100, the image information obtained by the detecting system 100, and the status information of the detecting system 100 .

In addition, the server 200 may obtain various information according to some embodiments to be described later.

According to one embodiment, the server 200 may control the connected configuration.

According to one embodiment, the server 200 may control the auxiliary computing device 300 or the wearable display device 400. [

For example, the server 200 may control the operation of an application installed in the auxiliary computing device 300. [ More specifically, the server 200 may control the start and / or termination of an application installed in the secondary computing device 300.

As another example, the server 200 may provide various settings needed for the operation of the detection system 100.

Also, the server 200 can generate virtual position information indicating the position of the object in the virtual environment based on the detection information.

The server 200 may also perform authentication of applications running on the secondary computing device 300.

The functions of the server 200 according to one embodiment are not limited to those described above, and the server 200 performing various functions may be provided according to the embodiment.

In addition, the server 200 according to one embodiment is not necessarily provided in a single physical configuration, but may be provided as a plurality of devices that perform the respective functions by subdividing the functions described above.

For example, the server 200 may include a detec- tion server connected to the detec- tion system 100 to obtain virtual location information based on the detec- tion information, an operation server for performing control over at least some of the configurations provided to the system, A license server that performs authentication for an application executed in at least one configuration of each configuration of the system, and the like, and can be performed in each server.

The auxiliary computing device 300 may be coupled to at least one of the server 200, the wearable display device 400, and the input device 500.

The auxiliary computing device 300 may provide an image to be provided to the user via the wearable display device 400 through a pre-installed application.

The auxiliary computing device 300 may also provide acoustic information to be provided to the user via the wearable display device 400.

According to one embodiment, the secondary computing device 300 may obtain an image to be provided to the user based on the preinstalled program and the detected information.

The auxiliary computing device 300 may also obtain input information based on the input signal obtained from the input device 500. [

The input information may include user selection information on an object and the like, information on an operation input through the input device 500, and orientation information on a direction of the input device 500.

In addition, the auxiliary computing device 300 may acquire an image to be provided to the user in consideration of the acquired input information.

According to one embodiment, the secondary computing device 300 may be provided in the form of a backpack PC that the player P can wear.

The auxiliary computing device 300 may be provided in a form bound to a bag in which the auxiliary computing device 300 may be located and may be provided in a form in which the player P is in possession of the auxiliary computing device 300 Lt; / RTI >

The wearable display device 400 may be coupled to the secondary computing device 300.

The wearable display device 400 may provide the user with an image of the virtual reality.

The wearable display device 400 may visually output to the user a virtual image obtained from the auxiliary computing device 300. [

In addition, the wearable display device 400 can output the acoustic information obtained from the auxiliary chatting device 300. [

The input device 500 may obtain a signal for a user's input to be reflected in the virtual reality.

The input device 500 may be coupled to the secondary computing device 300.

The input device 500 may provide an input signal corresponding to a user input to the auxiliary computing device 300.

The input device 500 may include an acceleration sensor, a gyroscope, a gyro sensor, a MEMS, a geomagnetism sensor, an inertia sensor (IMIU), an optical sensor, an illuminance sensor, a photosensor, an infrared sensor, Sensors, depth sensors, electromagnetic sensors, and the like.

The input device 500 may also include a button, a switch, a jog shuttle, and a wheel for acquiring a signal for the user's selection.

The input device 500 may also be connected to the auxiliary computing device 300 via at least one of wire communication and wireless communication.

The input device 500 may also include a communication module for communicating with the secondary computing device 300.

Although the input device 500 is illustrated as being connected to the auxiliary computing device 300 in FIG. 1, the input device 500 may be provided in various connection forms depending on the selection.

For example, the input device 500 may be connected to a configuration such as the server 200 and the wearable display 400 to provide an input signal.

The system described above is only an example for convenience of description. The system according to one embodiment is not limited to the configuration and connection relationship shown in FIG. 1, and may be provided in various forms according to the selection.

For example, the auxiliary computing device 300 and the wearable display device 400 may be provided in one configuration, in which case the operations performed in the auxiliary computing device 300 may be implemented in the wearable display device 400 have.

However, in the following description of the various embodiments, for the convenience of explanation, the system described above will be described as an example.

Hereinafter, a dettating system 100 according to an embodiment will be described with reference to FIG.

Referring to FIG. 2, the detection system 100 may include a light emitting unit 110 and a sensing unit 120.

The light emitting unit 110 may transmit a signal to or from the object to track the object.

For example, the light emitting unit 110 may be provided as a light emitting device that externally transmits optical signals such as visible light and infrared light.

More specifically, for example, the light emitting portion may be provided with a visible light LED and an infrared LED or the like.

The sensing unit 120 may acquire a signal from the outside.

For example, the sensing unit 120 may acquire a signal corresponding to a signal transmitted by the light emitting unit 110.

As another example, the sensing unit 120 may acquire a signal for the light reflected by the marker M provided to the object.

For example, the sensing unit 120 may be provided with an image sensor, an optical sensor, an illuminance sensor, a photosensor, an infrared sensor, a color sensor, a depth sensor, and an electromagnetic sensor.

3 is a block diagram illustrating a server 200 according to one embodiment.

3, the server 200 may include a server communication unit 210, a server storage unit 220, a server input unit 230, a server control unit 240, and a server display unit 250.

The server communication unit 210 may be connected to at least one of the detecting system 100, the auxiliary computing device 300, and the wearable display device 400 to acquire or provide data.

The server communication unit 210 may be connected to at least one of the detaching system 100, the auxiliary computing device 300, and the wearable display device 400 in at least one of a wired communication mode and a wireless communication mode.

For example, the wireless communication may include a wireless communication network such as a Wi-Fi network, a 3G, an LTE network, a 5G, a LoRa, a wireless access in vehicle environment (beacon), a zigbee, , Bluetooth low energy (BLE), and the like.

The wired communication may also include a twisted pair cable, a coaxial cable, or an optical cable.

The server communication unit 210 may be provided as a communication module for providing at least one of a wired communication and a wireless communication.

The server storage unit 220 may store data.

The server storage unit 220 may store information acquired from the outside.

The server storage unit 220 may store information necessary for the operation of the server 200. [

For example, the server storage unit 220 may store various types of data such as magnetic media such as a hard disk, a floppy disk, and a magnetic tape, an optical media such as a CD-ROM and a DVD, a floptical disk, Such as magneto-optical media and ROM, RAM, flash memory, SSD, CD-ROM, DVD-ROM or USB.

The server input unit 230 may acquire a signal corresponding to a user's input.

The user's input can be, for example, a push, a click, a touch and a drag of a button.

The server input unit 230 may be implemented by, for example, a keyboard, a key pad, a button, a jog shuttle, and a wheel.

The server control unit 240 can manage the operation of the server 200. [

For example, the server control unit 240 may control the operation of the configuration included in the server 200. [

The server control unit 240 may be implemented as a microprocessor, a microcontroller, a DSP, a processor, and an electrical unit for performing controller functions.

Also, according to a software implementation, the server control unit 240 may be implemented with separate software modules that allow at least one function or operation to be performed in embodiments such as procedures or functions. The software code may be implemented by a software application written in a suitable programming language. The software codes may also be stored in the server storage unit 220 and executed by the server storage unit 240 or components.

The server display unit 250 can output visual information.

The server display unit 250 may be provided as a monitor, a TV, a display panel, or the like for outputting visual information.

Also, when the server display unit 250 is provided as a touch screen, the server display unit 250 may perform the function of the server input unit 230.

4 is a block diagram illustrating a secondary computing device 300 in accordance with one embodiment.

4, the auxiliary computing device 300 may include an auxiliary computing communication unit 310, an auxiliary computing storage unit 320, an auxiliary computing input unit 330, and an auxiliary computing control unit 340.

The auxiliary computing communication unit 310 may be connected to at least one of the server 200, the wearable display device 400, and the input device 500.

The auxiliary computing communication unit 310 may be connected to at least one of the server 200, the wearable display device 400, and the input device 500 through at least one of a wired communication and a wireless communication.

The auxiliary computing communication unit 310 may exchange information with at least one of the connected server 200, the wearable display device 400, and the input device 500.

The auxiliary computing communication unit 310 may be provided as a communication module for providing at least one of a wireless communication and a wired communication.

The auxiliary computing storage unit 320 may store information acquired from the outside.

In addition, the auxiliary computing storage unit 320 may store data and the like necessary for the operation of the auxiliary computing device 300.

The secondary computing input 330 may obtain the signal corresponding to the input of the player.

The input of the player can be, for example, pushing, clicking, touching, dragging, etc. of the button.

For example, the auxiliary computing input unit 330 may be implemented as a keyboard, a keypad, a button, a jog shuttle, and a wheel.

The secondary computing control unit 340 may be responsible for the operation of the secondary computing device 300.

The auxiliary computing control unit 340 may be embodied as a microprocessor, a microcontroller, a DSP, a processor, an electrical unit for performing a controller function, and the like.

In addition, according to a software implementation, the secondary computing control unit 340 may be implemented with separate software modules that perform at least one function or operation, such as procedures or functions. The software code may be implemented by a software application written in a suitable programming language. The software codes may also be stored in the server storage unit 220 and executed by the server storage unit 240 or components.

5 is a block diagram illustrating a wearable display device 400 according to one embodiment.

5, the wearable display device 400 includes a wearable display communication unit 410, a wearable display storage unit 420, a wearable display sensor unit 430, a wearable display control unit 440, And a display output unit 450.

The wearable display communication unit 410 may be connected to the auxiliary computing device 300.

The wearable display communication unit 410 may be connected to the auxiliary computing device 300 through at least one of a wired communication and a wireless communication.

The wearable display storage 420 may store data.

The wearable display storage unit 420 may store a program necessary for operation of the wearable display apparatus 400. [

In addition, the wearable display storage unit 420 may store information acquired from the outside.

The wearable display sensor unit 430 may obtain a signal corresponding to the state of the wearable display device 400 and the user's input.

The wearable display sensor portion 430 according to one embodiment may include a wearable display motion sensor module 431 and a wearable display sound sensor module 432. [

The wearable display motion sensor module 431 can obtain a signal about the state of the wearable display device 400. [

For example, the wearable display motion sensor module 431 may obtain rotation information about the rotation of the wearable display device 400.

As another example, the wearable display motion sensor module 431 may obtain movement information on the movement of the wearable display device 400.

The wearable display motion sensor module 431 may be an acceleration sensor, a gyroscope, a gyroscope, a MEMS, a geomagnetic sensor, an inertial sensor (IMIU), an image sensor, an optical sensor, a light sensor, a photosensor, Or an electromagnetic wave sensor or the like.

The wearable display acoustic sensor module 432 can acquire a signal corresponding to a sound incoming from the outside.

For example, the wearable display acoustic sensor module 432 may be a microphone.

The wearable display controller 440 may control the operation of the wearable display device 400.

The wearable display control unit 440 may be embodied as a microprocessor, a microcontroller, a DSP, a processor, an electric unit for performing controller functions, and the like.

In addition, the wearable display controller 440 may be implemented with a separate software module that, according to a software implementation, embodiments such as procedures or functions may perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. The software codes may also be stored in the server storage unit 220 and executed by the server storage unit 240 or components.

The wearable display screen output unit 450 can output visual information to the user.

For example, the wearable display screen output unit 450 may output an image of a virtual reality. As another example, the wearable display screen output unit 450 may output an image of a three-dimensional virtual reality.

The wearable display screen output unit 450 may be provided as an image output device such as a liquid crystal display (LCD), an electronic paper, an LED display, an OLED display, a curved display, and a stereoscopy (three dimensional display using binocular parallax).

The wearable display sound output unit 460 can output auditory information.

The wearable display sound output unit 460 may be provided as an acoustic device such as a tuner, a playback device, an amplifier, a speaker, or the like.

Referring to FIG. 6, a system for divided space matching may be provided with a play space PA in which at least one player P plays.

Further, the player P who plays in the play space PA may be provided with the auxiliary computing device 300, the wearable display device 400, and the input device 500.

Further, the marker M may be provided to the object provided to each of the players P.

For example, when the object is the wearable display device 400 and the input device 500, the wearable display device 400 and the input device 500 may be provided with markers M of different patterns from each other.

Also, at least one detaching device 100 may be provided in the play space PA.

For example, as shown in FIG. 6, a plurality of detaching devices 100 may be provided in the play space PA.

Such a detaching device 100 may be provided at predetermined intervals around the periphery of the play space PA.

Also, the detaching apparatus 100 may be provided at a predetermined height from the ground.

Also, the detaching device 100 may be provided to direct the play space PA.

The detaching device 100 may be fixedly installed on a pre-installed frame.

For example, as shown in FIG. 6, a frame for installing the detecting device 100 may be provided around the play space PA. Also, the detecting device 100 may be fixed to the frame.

Detecting apparatus 100 may obtain detec- tion information for the play space PA.

The sensing unit 120 included in the detaching device 100 may acquire detec- tion information for at least a part of the play space PA.

For example, the sensing unit 120 included in the detaching device 100 may acquire detec- tion information on the sensing range of the sensing unit 120 in the play space PA.

Detecting apparatus 100 may provide detec- tion information to server 200.

For example, the detecting apparatus 100 may provide the server 200 with detec- tion information acquired by the sensing unit 120. [

The server 200 can obtain the current position information of the object based on the detection information.

When a plurality of detaching devices 100 are provided in the play space PA as shown in FIG. 6, the server 200 can acquire detaching information from the plurality of detaching devices 100, The current position information of the object can be obtained based on the detection information.

In addition, the server 200 may acquire virtual position information VP for at least one object based on the real position information RP of the objects.

For example, the server 200 may acquire the coordinates in the virtual reality corresponding to the coordinates included in the real position information RP in the real world of the play, as the virtual position information VP of the character C.

The server 200 may provide at least one of the real location information RP and the virtual location information VP to the auxiliary computing device 300. [

The auxiliary computing device 300 can acquire the virtual position information VP based on the real position information RP.

The secondary computing device 300 may also obtain a virtual image based on the virtual location information VP.

For example, the auxiliary computing device 300 may obtain virtual position information, which is the position of the character C in the virtual environment, based on the virtual position information VP. Or the auxiliary computing device 300 may acquire virtual position information which is the position of the virtual camera in the virtual environment based on the virtual position information VP.

The auxiliary computing device 300 may acquire the virtual image area based on the virtual location information and the virtual direction direction included in the virtual location information.

The secondary computing device 300 may obtain a virtual image for the virtual image region.

The secondary computing device 300 may obtain a virtual image for a virtual image area in a virtual environment.

The secondary computing device 300 may provide the virtual image to the wearable display device 400. [

The wearable display device 400 can output a virtual image to the user.

In addition, the server 300 may provide a virtual image to the viewing display device 700.

The server 300 may provide the virtual image acquired from the auxiliary computing device 300 to the connected display device 700. [

In addition, when the server 300 is connected to a plurality of auxiliary computing devices 300, the server 300 may acquire a virtual image from at least one of the plurality of auxiliary computing devices 300, A virtual image can be provided to the display device 700 for viewing.

For example, the server 300 may obtain a selection of the auxiliary computing device 300 to acquire a virtual image among the auxiliary computing devices 300 connected to the server 300 through the server input unit 230, The virtual image obtained from the device 300 can be provided to the display device 700 for viewing.

In addition, the server 300 may acquire the virtual location information VP from the auxiliary computing device 300 and may acquire the virtual image based on the acquired virtual location information and the preset virtual camera location. In addition, the server 300 may provide the acquired virtual image to the display device 700 for viewing.

The viewing display device 700 can output a virtual image acquired from the server 300. [

Also, the input device 500 may be provided in connection with at least one of the server 200, the auxiliary computing device 300, and the wearable display device 400.

Also, the input device 500 may be provided with at least one marker M. [

The input device 500 may be provided so that each player P can carry it.

For example, the player P1 may carry the input device 400 in his or her hand.

According to one embodiment, the server apparatus 400 may obtain the real position information of the input apparatus 400 based on the detection information obtained from the detaching apparatus 100. In addition, the real position information of the input device 400 may include at least one of the position information of the input device on the play space PA and the direction information of the input device 500.

The auxiliary computing device 300 can determine the direction of the virtual object corresponding to the input device in the virtual environment based on the real position information of the input device 400. [

In addition, the auxiliary computing device 300 may acquire a virtual image in which the direction of the virtual object corresponding to the input device in the virtual environment is considered.

As an example, the secondary computing device 300 may obtain a virtual image in which the total corresponding to the input device in the virtual environment is oriented in a direction corresponding to the direction of the input device.

Also, the auxiliary computing device 300 may acquire a virtual image in which a generation of an event according to a player's event generation command through the input device 500 is considered in a virtual environment.

The auxiliary computing device 300 may acquire a virtual image that fires a gun possessed by the character C corresponding to the player P in a virtual environment when the player provided with the input device 500 is depressed by the player P1 can do.

Referring to FIG. 7, the object tracking method can acquire information about a target object using a sensor provided externally, and determine the position of the target object based on information about the obtained target object.

Hereinafter, a case in which the object is a wearable display device 400 will be exemplarily described with reference to FIG.

Referring to FIG. 7, the object may be provided with a marker M for identifying the object.

The marker M may be provided to the object to provide a reference for identifying and tracking the object.

In order to track an object, it is necessary to identify a configuration other than the object and the object, and it is possible to identify the object by providing the marker (M) to the object.

Also, when a plurality of objects are provided, it is necessary to identify each object, and for this purpose, the marker M provided to one object can be provided to be distinguishable from the marker M provided to another object.

For example, the marker M provided to one object may be provided in a different pattern from the marker M provided to another object.

Also, the pattern may include various patterns such as a pattern formed by providing a plurality of markers M at different positions and a light pattern provided to one display panel.

The marker M may be provided as a passive marker that reflects or absorbs the optical signal transmitted from the light emitting unit 110, or as an active marker capable of transmitting an optical signal by itself.

As an example, the passive markers may include stereoscopic models with light reflective material, paper on which recognizable codes are printed, reflective tape, and the like.

The active marker may include an LED module, a radio wave generator, and the like.

According to one embodiment, the object may be provided with at least one marker M.

For example, when the system tracks the position of only one object, only one marker M may be provided to the object. In addition, a plurality of markers (M) may be provided to the object even if the system tracks the position only for one object.

Also, when the system tracks a position with respect to a plurality of objects 130, a plurality of markers M may be provided in one object to form a pattern in order to identify each of the plurality of objects.

The wearable display device 400 may be provided with a marker M in a first pattern when the object tracking the position in the system is provided by the wearable display device 400 and the input device 500 . The input device 500 may also be provided with a marker 130 in a second pattern.

The first pattern and the second pattern are different from each other. When the first pattern is detected during the position tracking, the first pattern and the second pattern can be identified by the wearable display device 400. When the second pattern is detected, can do.

In the above description, when a plurality of objects are provided, the markers M provided for each of the plurality of objects are provided to form a pattern in order to identify each of the plurality of objects. However, the present invention is not limited thereto, The markers M provided to the object can be provided by forming a pattern.

The pattern of the marker M provided to the object can also be used for identification of the user.

For example, the first pattern may be identified by the wearable display device 400 of the first user, and the second pattern may be identified by the input device 500 of the first user. Also, the third pattern may be identified by the wearable display device 400 of the second user, and the fourth pattern may be identified by the input device 500 of the second user.

Describing the tracking of the object, the server device 200 can acquire information about the object from the detec- tion system 100 and acquire detec- tion information on the position of the object based on the acquired information. In addition, the server device 200 can track the position of the object based on the detection information.

A description will now be given of a technique for the detecting system 100 to provide information on a target object to the server 200. The light emitting unit 110 of the detaching system 100 transmits a signal to at least a part of the play space PA It can send out.

For example, when the light emitting unit 110 is an infrared LED, the light emitting unit 100 may transmit an infrared signal to at least a part of the play space PA.

Also, the sensing unit 120 may provide the information acquired from the outside to the server apparatus 200. [

For example, when the sensing unit 120 is a camera, the sensing unit 120 may provide an image signal obtained from the outside to the server 200. [

Although only one sensing unit 120 is shown in FIG. 7, the present invention is not limited thereto. As described above with reference to FIG. 6, a plurality of sensing units 120 may be provided, and a plurality of sensing units 120 Can provide the acquired information to the server apparatus 200.

The server device 200 can determine the position of the object based on the information obtained from the sensing unit 120. [

The server device 200 may determine whether information on the marker M is included in the information obtained from the sensing unit 120. [ The server device 200 can identify the object based on the pattern of the marker M when the information about the marker M is included in the information acquired from the sensing unit 120. [

For example, the server device 200 may identify the wearable display device 400 when the information obtained from the sensing unit 120 includes the first pattern.

The information obtained from one sensing unit 120 may include a plurality of patterns, and the server apparatus 200 may identify a plurality of patterns.

Such a pattern can be stored in advance in the server device 200. If there is a pattern stored in advance in the acquired information, the server device 200 can determine that the corresponding pattern exists, Can be identified.

The representative point RP for each of the patterns stored in advance in the server device 200 may be set. The representative point RP may be a point representative of the pattern.

When a pattern through a plurality of markers M is provided, coordinate information for a plurality of markers M contained in the pattern is obtained, and the server device 200 obtains the representative point RP representative of the pattern as a pattern It can be obtained by the position of the corresponding object.

Accordingly, the server apparatus 200 can acquire information on the position of the object and track the object.

The location tracking of the object according to one embodiment is not limited to the above-described method, and various types of position tracking methods can be used depending on the selection.

According to an exemplary embodiment, when the sensing unit 120 is provided as an image sensor, the sensing unit 120 may acquire an image of the exterior and acquire positional information of the object based on the acquired image. .

For example, when the sensing unit 120 shown in FIG. 7 is provided on the wearable display device 400, the sensing unit 120 is provided on one side of the wearable display device 400, It is possible to obtain image information on the outside of the wearable display device 400 by being directed from the inside to the outside.

In addition, the wearable display device 400 may provide image information obtained by the auxiliary computing device 300.

According to one embodiment, the wearable display device 400 may provide image information to the secondary computing device 300 at predetermined cycles.

For example, the wearable display device 400 may provide image information to the auxiliary computing device 300 at the same cycle as the period for acquiring image information through the sensing unit 120. [

The secondary computing device 300 may obtain at least one feature point from the acquired image information.

According to one embodiment, the auxiliary computing device 300 may acquire objects included in the image information as feature points.

According to one embodiment, the auxiliary computing device 300 may acquire objects of a predetermined size or larger among the objects included in the image information as minutiae.

The auxiliary computing device 300 can identify an object included in the image information and can acquire objects of a predetermined size or more among the identified objects as minutiae. The auxiliary computing device 300 may also determine the size of the object based on the number of pixels occupied by the object included in the image information.

According to an exemplary embodiment, the auxiliary computing device 300 may acquire a predetermined type of object among the objects included in the image information as feature points.

For example, when a ball type object is set in advance, the auxiliary computing device 300 may acquire a shared object, such as a baseball ball, a soccer ball, and a basketball ball, included in image information, as feature points.

According to one embodiment, the auxiliary computing device 300 may acquire the markers included in the image information as feature points.

The auxiliary computing device 300 can identify markers such as barcodes and QR codes included in image information and acquire them as feature points.

The auxiliary computing device 300 may also determine the location of the feature points included in the image information.

The auxiliary computing device 300 may determine at least one of positional change and size change of the feature point based on the image information obtained from the wearable display device 400. [

The auxiliary computing device 300 can determine the moving direction and the moving distance of the wearable display device 400 based on the position change direction, the position change amount, and the size change amount of the feature points.

For example, the auxiliary computing device 300 may determine a change in the position of the feature point based on the image information obtained from the wearable display device 400.

The secondary computing device 300 may be configured to determine the location of the feature point based on the position change direction and the position change amount

The auxiliary computing device 300 can determine the moving direction and the moving distance of the wearable display device 400 based on the positional change amount of the feature points.

For example, the auxiliary computing device 300 may calculate the position of the feature point included in the first image information obtained at the first viewpoint and the position of the feature point included in the second image information acquired at the second viewpoint subsequent to the first viewpoint It can be determined that the wearable display device 400 has moved to the left when the position of the feature point in the first image information has moved to the right in the second image information.

In addition, the auxiliary computing device 300 can determine the movement distance of the feature point when the position of the feature point is changed.

The auxiliary computing device 300 can determine the travel distance of the feature point based on the number of pixels between the position of the feature point in the first image information and the position of the feature point in the second image information.

Or the auxiliary computing device 300 can determine the travel distance of the feature point based on the coordinates of the feature point in the first image information and the coordinates of the feature point in the second image.

In addition, the auxiliary computing device 300 may determine the moving direction and the moving distance of the wearable display device 400 based on the size variation.

The auxiliary computing device 300 compares the size of the minutiae included in the first image information acquired at the first time and the size of the minutiae included in the second image information acquired at the second time later than the first time As a result, when the position of the feature point in the first image information moves to the right in the second image information, it can be determined that the wearable display apparatus 400 has moved to the left.

Accordingly, the auxiliary computing device 300 can track the position of the object based on the positional change relative to the object from the preset initial position.

Referring to FIG. 8, the system may provide a virtual image for at least a portion of a virtual environment via the wearable display device 400.

The virtual environment may include a background, a terrain object, a virtual object, and a character.

For example, a character corresponding to the player may be provided in the virtual environment.

As another example, the virtual environment may be provided with a virtual object, such as a total, corresponding to the controller possessed by the player.

The terrain object may be provided at a predetermined location in the virtual environment.

The terrain object may also include a terrain object to which the character is movable and an unmovable terrain object.

For example, the movable terrain object may be a terrain object to which a character corresponding to the player can move when the player moves to a position corresponding to the terrain object. Also, even if the player moves to a position corresponding to the terrain object, the moving object terrain object may be a terrain object whose character corresponding to the player does not move to the terrain object.

Also, the character may include an NPC character and a player character provided by a preprogrammed program.

In the virtual environment, the location information may include at least one of real location information and virtual location information.

The real position information may include at least one of the position coordinates and the orientation direction of the object.

For example, the real location information may be a location coordinate of an object located on the play space PA.

The server 200 may store coordinate values for the play space PA in advance.

The server 200 may previously store a coordinate system for the play space PA. The coordinate system may be at least one of a plane coordinate system, a rectangular coordinate system, a polar coordinate system, a spatial coordinate system, a cylindrical coordinate system, and a spherical coordinate system.

The server 200 may obtain the coordinate values in the play space PA of the object based on the detection information and the coordinate system for the play space PA. Also, the server 200 can acquire the coordinate value in the play space PA of the acquired object as the real position information.

For example, when the detecting information is an infrared image, the server 200 determines whether or not the marker's play space (PA) based on the position of the marker corresponding to the object in the infrared image and the installation position of the detecting device 100 providing the infrared image ) Can be obtained. In addition, the server 200 can determine the pattern of the marker based on the coordinate value in the play space PA of the marker, and can identify the object corresponding to the pattern of the marker. Also, the server 200 can acquire representative points of the object based on the pattern of the marker and the coordinate values of the marker in the play space PA, and acquires the coordinate value of the representative point of the object as the real position information of the object .

The server 200 may provide realistic location information to the auxiliary computing device 300. [

The secondary computing device 300 may store coordinate values for the virtual environment VW in advance.

The auxiliary computing device 300 may previously store a coordinate system for the virtual environment VW. The coordinate system may be at least one of a plane coordinate system, a rectangular coordinate system, a polar coordinate system, a spatial coordinate system, a cylindrical coordinate system, and a spherical coordinate system.

The auxiliary computing device 300 may obtain the coordinate values in the virtual environment VW of the object based on the real position information and the coordinate system for the virtual environment VW. Also, the auxiliary computing device 300 can acquire the coordinate value in the virtual environment (VW) of the acquired object as virtual position information.

For example, the auxiliary computing device 300 may acquire the coordinate value in the virtual environment VW corresponding to the coordinate value included in the real position information, and may calculate the coordinate value in the acquired virtual environment VW as the virtual position information .

The secondary computing device 300 may obtain a virtual image to be output to the user based on the virtual location information.

According to one embodiment, the auxiliary computing device 300 may acquire virtual position information of the wearable display device 400 as virtual position information of the virtual camera, and may be based on the virtual position information of the virtual camera and the direction of the virtual camera Thereby obtaining visual information of the virtual camera.

The auxiliary computing device 300 can acquire the directing direction of the virtual camera based on the directing direction included in the real position information of the wearable display device 400. [

In addition, the auxiliary computing device 300 may acquire a predetermined area in the direction of the virtual camera in the field of view of the car camera.

The secondary computing device 300 may also obtain a virtual image corresponding to the field of view of the virtual camera in a virtual environment.

The wearable display device 400 can output the obtained virtual image to the user through the wearable display screen output unit 450.

Hereinafter, a rotational delay matching method according to an embodiment will be described.

Referring to FIG. 9, the image provided through the display unit 400 of the wearable display device 400 in the system 10 may be a region in a virtual reality.

For example, the image provided through the wearable display device 400 may be an image corresponding to a view in a direction from the position of the virtual camera provided in the virtual reality.

Also, the image provided through the display unit 400 of the wearable display apparatus 400 may be provided differently depending on the rotation state of the wearable display apparatus 400.

When the wearable display device 400 rotates left and right and up and down, the direction of the wearable display device 400 may be changed, thereby changing the direction of the virtual camera. Also, as the direction of the virtual camera is changed, the field of view of the virtual camera may be changed, so that the image provided through the wearable display device 400 may be changed.

For example, when the wearable display device 400 is oriented in a first direction at a first position in the real world, in a virtual environment, the virtual camera may be oriented in a first direction at a first position, A first image corresponding to the field of view can be provided to the user through the wearable display device 400. Also, when the wearable display device 400 is oriented in the real world to a second direction that is different from the first direction at the first position, in the virtual environment, the virtual camera may be oriented from the first position to the second direction, A second image corresponding to the field of view of the virtual camera of the wearable display device 400 may be provided to the user through the wearable display device 400. [

Information on the position and orientation of the wearable display device 400 may be obtained in various manners.

According to one embodiment, the information about the position and the orientation of the wearable display device 400 may be detected by the detec- tion information obtained by the detec- tion system 1000 and the wearable display motion sensor module of the wearable display device 400 431). &Lt; / RTI >

When acquiring information on the position and orientation of the wearable display device 400 based on the detecting system 1000 and the wearable display

motion sensor module

431, 100 and the time delay required for the sub-computing device 300 to acquire information from the wearable display operation sensor module 431 may be different from each other.

Therefore, the time of acquiring the detec- tion information for one viewpoint may be different from the time of acquiring information from the wearable display motion sensor module 431, and an error may occur accordingly.

For example, the rotation information acquired from the wearable display motion sensor module 431 obtained at the time of acquiring the detec- tion information for the first time may be transmitted to the wearable display motion sensor module 431 at a time before the first time, May be acquired rotation information.

Inaccurate position information can be obtained due to accumulated errors when acquiring position information based on the rotation information acquired through the wearable display motion sensor module 431. [ The detec- tion information obtained from the detec- ting device may have a relatively small error when compared with the rotation information acquired through the wearable display motion sensor module 431. [

Referring to FIG. 10, when the wearable display device 100 worn by the player P is rotated 30 degrees to the right, the rotation information obtained through the wearable display motion sensor module 431 indicates that the wearable display device 100 ) May be provided as being rotated to the right by 20 degrees.

Accordingly, when the server 200 acquires the position information of the wearable display device 100 based on the rotation information acquired through the wearable display motion sensor module 431 and acquires the virtual image based on the information, The area of the virtual image VI in the virtual environment needs to be moved as the actual operation position AT as shown in the virtual image VI of FIG. An error may occur.

Accordingly, the player can recognize that the screen to be moved has not moved sufficiently due to the rotation of the player himself / herself, thereby feeling nuisance such as nausea and fatigue.

Therefore, it is necessary to eliminate the error caused by the delay by matching the detec- tion information obtained from the detec- tor 100 and the rotation information acquired from the wearable display operation sensor module 431. [

Referring to FIG. 11, the rotation delay matching method according to an exemplary embodiment includes setting a first initial rotation information (S100), acquiring a first difference value (S110), setting a second initial rotation information (S140) of obtaining the second difference value, obtaining the third difference value (S140), correcting the third difference value (S150), obtaining the fourth difference value (S160) , Obtaining a final angle value (S170), and providing an image based on the final angle value (S180).

According to one embodiment, the step of obtaining the internal start value may be performed (SlOO).

The sub computing device 300 may obtain rotation information of the wearable display device 400 from the wearable display motion sensor module 430 that obtains rotation information of the wearable display device 400. [

Further, the sub-computing device 300 may set the internal start value to the acquired initial rotation information if the acquired rotation information is the first acquired rotation information.

According to an embodiment, the step of obtaining the internal difference value may be performed (S110).

The sub-computing device 300 can obtain rotation information of the wearable display device 400. [

Here, the rotation information of the wearable display device 400 acquired by the sub computing device 300 may be later than the time when the internal start value is obtained in the previous step S100.

In addition, the sub computing device 300 may acquire the first difference value based on the internal start value acquired in the previous step S100 and the rotation information about the time point before the time when the internal start value is acquired.

For example, the sub-computing device 300 may obtain the difference between the internal start value acquired at the first time point and the rotation information acquired at the second time point subsequent to the first time point, as the internal difference value.

The sub-computing device 300 may convert the internal difference value to an angle value.

According to one embodiment, the step of obtaining the external start value may be performed (S120).

The sub-computing device 300 may obtain the detaching information for the wearable display device 400 from the detaching system 100. [

In addition, the sub computing device 300 may set the external starting value if the obtained detecting information is the detaching information acquired first.

According to one embodiment, the step of obtaining the second difference value may be performed (S130).

The sub-computing device 300 may obtain the detaching information for the wearable display device 400 from the detaching system 1000. [

Here, the detaching information for the wearable display device 400 acquired by the sub computing device 300 may be later than the point at which the external start value is obtained in the previous step S120.

In addition, the sub-computing device 300 may calculate an external difference value based on the external start value acquired in the previous step S120 and the detec- tion information about the wearable display device 400 at a point later than the time when the external start value is acquired Can be obtained.

For example, the sub-computing device 300 may obtain the difference between the external start value acquired at the first time point and the detec- tion information acquired at the second time point subsequent to the first time point, as an external difference value.

According to an embodiment, the step of acquiring the inner and outer difference values may be performed (S140).

The sub-computing device 300 may obtain an internal difference value that is a difference value between the internal start value and the external difference value.

According to an embodiment, the step of correcting the internal and external difference values may be performed (S150).

The sub-computing device 300 may use the filter to correct the inner and outer difference values.

For example, the sub-computing device 300 may calibrate the difference between inside and outside using a Kalman filter.

According to one embodiment, the step of obtaining the final difference value may be performed (S160).

The sub-computing device 300 may obtain a final difference value that is a difference value between the external start value and the external difference value.

According to one embodiment, the step of obtaining the final angle value may be performed (S170).

The sub computing device 300 may obtain the final angle value obtained by multiplying the internal start value and the fourth difference value converted into the angle value.

Referring to FIG. 12, the sub-computing device 300 may convert the internal difference value into the angle value as described in step S110.

The angle value according to an embodiment may be a quaternion.

As shown in FIG. 12, the quaternion may include an X-axis value, a Y-axis value, a Z-axis value, and an angle value (W, O).

For example, the sub computing device 300 can acquire the internal start value DP1 (X1, Y1, Z1, O) converted to the angle value and calculate the fourth difference value DP2 (X2, Y2, Z2, O ') Can be obtained.

Also, the sub-computing device may multiply the internal start value DP1 (X1, Y1, Z1, O) and the fourth difference value DP2 (X2, Y2, Z2, O) to obtain the final angle value.

Referring again to FIG. 11, according to one embodiment, the step of providing an image based on the final angle value may be performed (S180).

The sub-computing device 300 may obtain a virtual view corresponding to the final angle value.

Further, the sub-computing device 300 may acquire an image corresponding to the obtained virtual field of view.

The sub-computing device 300 may also provide the acquired image to the wearable display device 400.

Referring to FIG. 13, the detaching information obtained from the detaching device 100 when the rotation of the wearable display device 400 occurs due to the operation of the player as described above with reference to FIG. 9, The rotation information obtained from the sensor module 431 has different delays so that the detection information and the rotation information can be obtained at different points in time even if the rotation is performed at the same point in time.

Accordingly, the sub-computing device 300 can obtain the rotation angle value at which the error occurs due to the rotation information at the second time point by matching the rotation information acquired at the first time point with the detection information acquired at the second time point It is possible to obtain a virtual image based on the acquired positional information based on the detected information.

Referring to FIG. 14, in the virtual image obtained as a result of determining the position of the wearable display device 400 based on the rotation information acquired from the wearable display motion sensor module 431, the object is moved to the first center position CP1 ). &Lt; / RTI >

Also, in the virtual image obtained as a result of determining the position of the display device based on the detection information obtained from the detecting device 100, the object may be located at the second center position CP2.

The auxiliary computing device 300 can acquire the angle value of the rotation of the wearable display device 100 through the rotation delay matching method described above and obtains the virtual image based on the obtained angle value, A virtual image located at the center position CP2 can be obtained.

Referring to FIG. 15, a system for divided space matching may be provided with a first play space PA1 and a second play space PA2.

The first play space PA1 may be a space in which players of the first player group play in the real world.

Also, the second play space PA2 may be a space in which the play of the second player group is played in the real world.

The first play space PA1 and the second play space PA2 may be provided in the same area but are not limited thereto and the first play space PA1 and the second play space PA2 may be provided in the same area, They can be provided in different areas.

Also, the first play space PA1 and the second play space PA2 may be provided separately from each other.

For example, the first play space PA1 and the second play space PA2 may be provided separately from each other.

The player P included in the first player group and the player P included in the second player group may be different from each other.

For example, as shown in FIG. 15, the first player P1 and the second player P2 included in the first player group can play in the first play space PA1, The third player P3 and the fourth player P4 included in the second player group can play the game.

The environment shown in FIG. 15 is only an example for convenience of description. The system for subspace matching according to an embodiment is not limited to FIG. 9, but may be provided in various forms according to an option.

For example, although the first play space PA1 and the second play space PA2 are shown in FIG. 15, the present invention is not limited thereto, and more play spaces PA may be provided as an option.

Although FIG. 15 shows that two players play in one play space PA, the present invention is not limited thereto. It is also possible to select a smaller number of players to play in one play space PA have.

Each of the player P playing in the first play space PA1 and the player P playing in the second play space PA2 is provided with the auxiliary computing device 300, the wearable display device 400, and the input device 500 ) May be provided.

For example, as shown in FIG. 15, the first player P1 is provided with a 1-1 second auxiliary computing device 300a, a 1-1 wearable display device 400a, and a 1-1 input device 500a . As shown in FIG. 10, the second player P2 is provided with a first 1-2 auxiliary computing device 300a ', a first 1-2 wearable display device 400a' and a first 1-2 input device 500a ' May be provided.

Further, in each of the third player P3 and the fourth player P4 playing in the second play space PA2, the auxiliary computing device 300, the wearable display device 400 and the input device 500 may be provided have.

For example, as shown in FIG. 15, a second-1 auxiliary computing device 300b, a second-1 wearing-in display device 400b, and a second-1 input device 500b are provided to the third player P3 . 10, the second-second auxiliary computing device 300b ', the second-second wearing display device 4002', and the second-second input device 500b 'are connected to the fourth player P4, May be provided.

Also, at least one of the auxiliary computing device 300, the wearable display device 400, and the input device 500 provided for each of the players P may be provided with a marker M. [

The wearable display device 400 provided to each player P as an example may be provided with a marker M. [

At least one detaching device 100 may be provided in each of the first play space PA1 and the second play space PA2.

For example, as shown in FIG. 15, a first detaching device 100a may be provided in the first play space PA1, and a second detaching device 100b may be provided in the second play space PA1 . The first detecting device 100a may be a detecting device 100 provided in the first play space PA1 and the second detecting device 100b may be a detaching device 100 provided in the second play space PA2. Device 100 as shown in FIG.

The first detaching device 100a provided in the first play space PA1 may obtain detec- tion information on the object located in the first play space PA1.

For example, the first detection device 100a includes a first-second auxiliary computing device 300a provided to a first player P1 located in a first play space PA1, a first-second auxiliary computing device 300a provided to a first- The first 1-2 input device 500a, the 1-2 second auxiliary computing device 300a ', the 1-2 worn display device 400a', and the 1-2th auxiliary computing device 300a 'provided to the second player P2, It is possible to obtain the detection information on the marker provided to any one of the input devices 500a '.

Also, the second detaching device 100b provided in the second play space PA2 may obtain detec- tion information on the object located in the second play space PA2.

For example, the second detecting device 100b may include a second-1 auxiliary computing device 300b, a second-1 wearing-in display device 400b provided to a third player P3 located in the second play space PA2, 2-2 auxiliary computing device 300b 'provided to the 4th player P2, the 2-2 wearing display device 400b' and the 2-2 auxiliary computing device 300b 'provided to the 4th player P2, It is possible to obtain the detec- tion information on the marker provided to any one of the input devices 500b '.

Also, the first detection device 100a and the second detection device 100b may be provided in plural.

For example, a plurality of first detaching devices 100a may be provided in the first play space PA1.

A plurality of second detaching devices 100b may be provided in the second play space PA2.

The same number of detaching devices 1000a may be provided in the first detaching device 100a and the second playing space PA2 provided in the first play space PA1 but the present invention is not limited thereto, A different number of detaching devices 100 may be provided in the first play space PA1 and the second play space PA2.

The first detection device 100 may acquire a first detection signal for the first play space PA1.

For example, the sensing unit 120 included in the first detection system 100a may acquire a detaching signal for the first play space PA1.

The first detection device 100a may provide the first detection signal to the server 200. [

For example, the first detecting device 100a may detect a first detecting information about the first playing space PA1 acquired by the sensing unit 120 included in the first detecting device 100a, .

The server 200 may obtain the real position information of the object in the first play space PA1 based on the first detection information.

15, when a plurality of detaching devices 100 are provided in the first play space PA1, the server 200 may acquire a first detaching signal from the plurality of detaching devices 100 And can acquire the first detection information based on the obtained detection signals.

A second detaching device 100b may be provided in the second play space PA2.

The second detecting device 100b may obtain the second detecting information for the second play space PA2.

For example, the sensing unit 120 included in the second detection device 100b may acquire second detection information on the second play space PA2.

The second detaching apparatus 100b may provide the server 200 with detec- tion information for the second play space PA2.

The server 200 may identify the first detection information and the second detection information.

The server 200 may store in advance the pattern of the light emitting unit 110, the sensing unit 120, the marker M, and the marker M for each object included in the first detecting apparatus 100a.

For example, the server 200 transmits identification information about the sensing unit 120 included in the sensing unit 120 included in the first sensing device 100a and the sensing unit 120 included in the second sensing device 100b to the server storage unit 220 ) In advance.

The server 200 may acquire the detection information obtained from the sensing unit 120 included in the first detection apparatus 100a as the first detection information and the second detection information included in the second detection system 100a And the detection information obtained from the sensing unit 120 may be acquired as the second detection information.

For example, the server 200 connects the detaching apparatus 100 installed in the first play space PA1 of the detaching apparatus 100 connected to the server 200 through the server communication unit 210 to the first detaching apparatus 100a Can be obtained through the server input unit 230 and the first detection information can be obtained based on the detection signal obtained from the first detection device 100a.

The server 200 determines whether or not the player is playing in a play space PA of either the first play space PA1 or the second play space PA2 based on the first detection information and the second detection information It is possible to obtain the real positional information RP at the position.

For example, the server 200 may obtain the real position information of the first player P1 and the second player P2 in the first play space PA1 based on the first detection information. The server 200 may also acquire positional information of the third player P3 and the fourth player P4 in the second play space PA2 based on the second detection information.

In addition, the server 200 can acquire the virtual position information VP of the character C corresponding to the player based on the real position information RP in the real world of the plays.

The wearable display device 400 can output a virtual image to the user.

In addition, a virtual image can be provided by the viewing display device 700. [

The other system shown in FIG. 16 may be one in which each detaching device 100 in the system described above with reference to FIG. 15 is provided in connection with a different server 200.

For example, it may be a system for providing a virtual environment through a network between servers 200 to players playing in a play space PA located in different areas.

Referring to FIG. 16, another system for divided space matching may be provided with a first play space PA1 and a second play space PA2.

In addition, the first player P1 and the second player P2 included in the first player group can play in the first play space PA1 and the first player P1 and the second player P2 included in the second player group can play in the first play space PA1. The third player P3 and the fourth player P4 can play the game.

For example, as shown in FIG. 16, the first player P1 is provided with a 1-1 second auxiliary computing device 300a, a 1-1 wearable display device 400a, and a 1-1 input device 500a . As shown in FIG. 16, the second player P2 is connected to the first 1-2 secondary computing device 300a ', the 1-2 wearable display device 400a' and the 1-2 input device 500a ' May be provided.

For example, as shown in FIG. 16, the second-first auxiliary computing device 300b, the second-first wearing display device 400b, and the second-first input device 500b are provided to the third player P3 . 16, the second-second auxiliary computing device 300b ', the second-second wearing display device 4002', and the second-second input device 500b 'are connected to the fourth player P4, May be provided.

A first detaching device 100a may be provided in the first play space PA1.

The first detecting device 100a may obtain the first detecting information for the first play space PA1.

The first detection device 100a may provide the first detection information to the first server 200a.

A second detaching system 100b may be provided in the second play space PA2.

The second detection system 100b may obtain the second detection information for the second play space PA2.

The second detection system 100b may provide the second detection information to the second server 200b.

The first server 200a and the second server 200b are connected to the first server 200a through the first server 200a and the

second server

200b, 200a in the second play space PA2 to obtain detec- tion information for the players included in the second player group.

The first server 200a may provide the second server 200b with detaching information for the players included in the first player group playing in the first play space PA1.

The second server 200b may provide the first server 200a with detec- tion information for the players included in the second player group that is played in the second play space PA2.

The first server 200a may provide detec- tion information for the first player group and the players of the second player group to the auxiliary computing devices 300 worn by the players of the first player group.

The second server 200b may provide detaching information for the players of the first player group and the second player group to the auxiliary computing devices 300 worn by the players of the second player group.

The auxiliary computing device 300 worn by the player included in the first player group and the second player group is not able to receive the auxiliary computing device 300 based on the acquired detection information for the players of the first player group and the second player group, The wearable display device 400 coupled to the display device 400 may provide an image of the virtual environment.

Referring to FIG. 17, a first play space PA1 and a second play space PA2 may be provided.

Also, the first player group can play in the first play space PA1, and the second player group can play in the second play space PA2.

For example, the first player P1 and the second player P2 can play in the first play space PA1, the third player P3 and the fourth player P4 can play in the second play space PA2, Can play.

The virtual environment includes a first player P1 and a second player P2 playing in the first play space PA1, a third player P3 and a fourth player P4 playing in the second play space PA2, A character corresponding to the character can be provided.

The first character C1 corresponding to the first player P1 in the virtual environment VW may be provided at a virtual position corresponding to the position of the first player P1 in the first play space PA1.

Referring to FIG. 17, when the first player P1 playing in the first play space PA1 is PA1 (Xa, Ya, Za), the first player P1 in the virtual environment VW, The first character C1 corresponding to the virtual environment VW may be provided at (Xc, Yc, Zc) in the virtual environment VW.

The second character P2 corresponding to the second player P2 in the virtual environment VW when the actual position information of the second player P2 playing in the second play space PA2 is (Xb, Yb, Zb) C2 may be provided to (Xd, Yd, Zd) of the virtual environment VW.

In addition, in the virtual environment, the virtual area provided with the character corresponding to the player playing in the first play space PA1 and the virtual area provided with the character corresponding to the player playing in the second play space PA2 are separately provided .

Referring to FIG. 17, when the first player P1 playing in the first play space PA1 is PA1 (Xa, Ya, Za), the first player P1 in the virtual environment VW, The first character C1 corresponding to the first virtual area VA1 may be provided to VA1 (Xc, Yc, Zc) of the first virtual area VA1.

The second character P2 corresponding to the second player P2 in the virtual environment VW when the actual position information of the second player P2 playing in the second play space PA2 is PA2 (Xb, Yb, Zb) (C2) may be provided to VA2 (Xd, Yd, Zd) in the second virtual area VA2.

The secondary computing device 300 may obtain a virtual camera position for each player based on the location of the character in the virtual environment,

As an example, the secondary computing device 300 may obtain the virtual camera position of the first player based on the position of the first character.

The secondary computing device 300 may also obtain a virtual image based on the location of the virtual camera.

As an example, the secondary computing device 300 may obtain a view to provide to the first player based on the virtual camera position of the first player, and may provide an area corresponding to the field of view of the first player to the first player in the virtual environment You can acquire a virtual image to do.

Referring to FIG. 18, a first play space PA1 and a second play space PA2 may be provided.

The first play space PA1 and the second play space PA2 may be provided independently.

For example, as shown in FIG. 18, the first play space PA1 and the second play space PA2 may be provided at predetermined distances.

Also, the first player P1 can play in the first play space PA1, and the second player P2 can play in the second play space PA2.

In the virtual environment VW, the first character C1 corresponding to the first player P1 and the second character C2 corresponding to the second player P2 may be provided.

The actual distance RD between the first player P1 and the second player P2 in the real world and the virtual distance VD between the first character C1 and the second character C2 in the virtual environment are different from each other .

For example, assuming that the coordinates of the first player P1 in the real world are (1, 1, 1) and the coordinates of the second player P2 in the real world are (1, 11, 1) Is located at a distance of 10 from the first player P1 in the Y axis, the coordinates of the first character C1 are provided as (1,1,1) in the virtual environment, and the coordinates of the second character C2 are (1, 5, 1). In the virtual environment, the first character (C1) and the second character (C2) are spaced apart from each other by 5 in the Y axis, The virtual distance VD between the real distance RD and the first character C1 and the second character C2 in the virtual environment can be provided differently from each other.

Therefore, the distance between the first character and the second character C2 viewed by the first player in the virtual image output to the first player through the wearable display device 400 is determined by the distance between the first player P1 and the second player P2 in the real world, Lt; / RTI >

For example, when the first player P1 and the second player P2 in the real world are spaced apart by 10 in the Y axis, the second character C2 in the virtual image provided through the wearable display device 400 And may be provided spaced apart by 5 on the Y axis.

Referring to FIG. 19, a first play space PA1 and a second play space PA2 may be provided.

For example, as shown in FIG. 19, the first play space PA1 and the second play space PA2 may be provided at a predetermined distance in the first direction.

As shown in FIG. 19, even if the first play space PA1 and the second play space PA2 are spaced apart from each other in the first direction, they can be provided in the second direction in the virtual environment.

19, even if the first play space PA1 and the second play space PA2 are spaced apart in the first direction, the virtual environment VW shown in FIG. 19, for example, The space PA can be provided in the horizontal direction in the virtual environment.

Even if the second player P2 is not positioned in the second direction when the first player P1 is gazing in the second direction perpendicular to the first direction, the field of view (VOF) of the virtual environment provided to the first player P1 The second character C2 may be provided.

For example, when the first player P1 directs the wearable display device 400 in a second direction perpendicular to the first direction, in the real world, even if the second player P2 is not positioned in the second direction, The second character C2 may be provided to the virtual image VI provided to the first player P1 through the device 400. [

Referring to FIG. 20, a first play space PA1 and a second play space PA2 may be provided.

In the virtual environment V1, the first virtual environment area VA1 corresponding to the first play space PA1 and the second virtual environment area VA2 corresponding to the second play space PA2 may be provided.

The first virtual environment area VA1 and the second virtual environment area VA2 may be those in which an arbitrary space is provided in an entire virtual environment.

The first character C1 corresponding to the first player P1 playing in the first play space PA1 can move in the first virtual environment area VA1.

The first character C1 corresponding to the first player P1 playing in the first play space PA1 corresponds to the second character P2 corresponding to the second player P2 playing in the second play space PA2 The movement to the second virtual environment area VA2 provided can be restricted.

The second character C2 corresponding to the second player P2 playing in the second play space PA2 can move in the second virtual environment area VA2.

The second character P2 corresponding to the second player P2 playing in the second play space PA2 corresponds to the first character P1 corresponding to the first player P1 playing in the first play space PA1 The movement to the first virtual environment area VA1 provided can be restricted.

Even if the second player P2 located in the second play space PA2 spaced from the first player P1 in the first direction moves in the first direction in the real world, The second character C2 positioned in the second direction may move in the first direction.

For example, even if the second player P2 located in the second play space PA2 provided in front of the first player P1 in the real world moves forward, the first player P1 , A virtual image in which the second character C2 positioned on the left of the first character C1 moves forward may be provided.

When the first player moves in the second direction in a state where the second player P2 is provided in the second play space PA2 spaced from the first player P1 in the first direction in the real world, VW), the first character C1 may be provided to move to the second character C2 located in the second direction.

For example, when the first player moves in the second direction in a state where the second player P2 is provided in the second play space PA2 spaced apart from the first player P1 in the first direction in the real world, In the virtual image provided to the first player P1 through the display device 400, a virtual image moving to the position of the second character C2 may be provided.

As another example, when the first player moves in the second direction in a state where the second player P2 is provided in the second play space PA2 spaced from the first player P1 in the first direction in the real world, In the virtual image provided to the second player P2 through the display device 400, a virtual image in which the first character C1 approaches in the second direction can be provided.

Referring to FIG. 21, the first play space PA1 and the second play space PA2 may be provided in a first direction.

Therefore, the player P1 may not exist in the third direction VD3 because the play space PA is not provided in the third direction perpendicular to the first direction.

Referring to FIG. 21, the first player P1 playing in the first play space PA1 can direct the held input device 400 in the third direction RD3, and the input device 400 To command to generate a predetermined event in the third direction RD3.

For example, the first player P1 playing in the first play space PA1 may direct the input device 400 toward the left side, and may push the switch provided to the input device 400 to the left side.

The virtual image VI provided to the first player through the wearable display device 400 worn by the first player P1 may be provided with an image in which a predetermined event occurs in the third direction RD3 .

For example, in the virtual image VI provided to the first player through the wearable display device 400 worn by the first player P1, the first character C1 is moved to the left in the direction of the gun, An image to be fired may be provided.

As described above with reference to FIG. 21, in the real environment, there is no player P1 in the third direction VD3, and other players may not be positioned in the direction that the first player aimed.

The second character C2 corresponding to the second player P2 is positioned in the direction in which the first character C1 corresponding to the first player P1 fires the bullet in the virtual environment VW through the divided space matching Thus, the second character C2 can be shot by the bullet emitted by the first character C1.

Therefore, even if the second player P2 is not positioned in the direction in which the first player P1 directs to the input device 400 in the real world, the first player C1 is not positioned in the direction in which the first character C1 is oriented in the virtual environment VW When the second character C2 is positioned, the first player P1 may hit the second player P2.

For example, in a real world, when the first player P1 directs the input device 400 to input a command for shooting a bullet, even if the second player P2 is not positioned in the direction toward the input device 400, When the second character C2 is positioned in the direction in which the first character C1 is oriented in the virtual environment VW, the first player P1 is notified to the first player P1 via the wearable display device 400 worn by the first player P1 The provided virtual image may be provided with an image in which the second character C2 is shot by the bullet emitted by the first character C1.

As another example, if the first player P1 directs the input device 400 to input a command for shooting a bullet in the real world, even if the second player P2 is not positioned in the direction of the input device 400, If the second character C2 is positioned in the direction in which the first character C1 is oriented in the virtual environment VW, the second player P2 is notified to the second player P2 via the wearable display device 400 worn by the second player P2 The provided virtual image may be provided with an image shot by the bullet emitted by the first character C1.

As shown in FIG. 22, in the real world, a second play space PA2 may be provided at a position apart from the first play space PA1 in the first direction.

As shown in FIG. 22, the second player P2 may be located in the second play space PA2 provided away from the first player P1 in the first direction.

The sound generated by the second player P2 in the real world can be recognized as the sound generated in the first direction to the first player P1.

In the virtual environment VW, the second character C2 corresponding to the second player P2 may be positioned in the third direction VD3 from the first character C1 corresponding to the first player P1, The sound generated by the second player P2 provided to the first player PA1 may be provided to be output so that the first player PA1 recognizes the sound generated in the third direction in which the second character C2 is located .

For example, in the real world, the second player P2 is located at a position spaced apart from the first player P1 in the first direction, and the second character P2 is positioned at a position spaced apart from the first character C1 in the third direction, The sound generated by the second player P2 spaced apart from the first player P1 in the first direction in the real world when the second player P2 is positioned on the left and right sides of the wearable display device 400, May be provided to be output through the wearable display sound output section 460 provided on the left side corresponding to the third direction in which the second character C2 is located in the virtual one of the part 460.

According to one embodiment, the auxiliary computing device 300 may be configured to communicate with the first player P1 by the second character C2 based on the positional relationship of the first character C1 and the second character C2 in the virtual environment It is possible to obtain output sound information for the generated sound.

In addition, according to one embodiment, the wearable display device 400 may provide input acoustic information obtained through the wearable display acoustic sensor module 432 to the auxiliary computing device 300.

The wearable display device 400 may also provide input acoustic information to the auxiliary computing device 300, including identification information imparted to the wearable display device 400.

In addition, the auxiliary computing device 300 may provide the acquired input sound information to the server 200 by the wearable display device 400.

The server 200 can identify the wearable display device 400 and / or the player P that provided the input sound information based on the identification information of the wearable display device 400 included in the input sound information.

The server 200 may provide input acoustic information to the secondary computing device 300 that includes identification information for the wearable display device 400 and /

The auxiliary computing device 300 generates the input sound information based on the positional relationship of the character C corresponding to the player P providing the input sound information and the input sound information and the character C corresponding to the player P receiving the sound The output sound information can be obtained.

For example, when the first player P1 is positioned at the coordinates of PA1 (Xa, Ya, Za) of the first play space PA1 and the second player P2 is positioned at the coordinates of PA2 (Xb, Yb, Za) of the second play space PA2, Zb), the auxiliary computing device 300 calculates the virtual number of the first character C1 corresponding to the first player P1 based on the coordinates in the first play space PA1 of the first player P1 (Xa, Ya, Za) in the second environment P2 can be acquired and the second character P2 corresponding to the second player P2 can be obtained based on the coordinates in the second play space PA2 of the second player P2 The coordinates VA2 (Xb, Yb, Zb) in the virtual environment of the object C2 can be obtained.

For example, when the second character C2 is located on the left side of the first character C1 as a result of determining the positions of the first character C1 and the second character C2 in the virtual environment, 2 player P2 outputs the sound input through the wearable display sound sensor module 432 through the 3D sound to the sound generated from the left side of the first player P1 in the wearable display sound output section 460 Acoustic information can be obtained.

The auxiliary computing device 300 may also provide the acquired acoustic information to the wearable display device 400 and the wearable display device 400 may provide the wearable display acoustic sensor module 432 To output a sound signal.

According to one embodiment, the auxiliary computing device 300 transmits the sound input through the wearable display sound sensor module 432 provided to the wearable display device 400 worn by the player P to the other player P A method of acquiring output sound information to provide the input signals to the players P through a sound sensor module (not shown) connected to the server 200 may be different from each other . &Lt; / RTI >

According to one embodiment, the auxiliary computing device 300 transmits the sound input through the wearable display sound sensor module 432 provided to the wearable display device 400 worn by the player P to the other player P The output sound information based on the 3D sound including the direction of the sound based on the position information between the players P can be obtained as described above.

The manner in which the auxiliary computing device 300 acquires the sound information to provide the player P with a signal input through an acoustic sensor module (not shown) The acoustic information of the 2D system which does not include the direction of the sound can be obtained.

As shown in FIG. 23, in the real world, a second play space PA2 may be provided in front of the first play space PA1.

The second player P2 may be positioned in front of the first player P1 as shown in FIG.

In the virtual environment VW, the two play spaces PA may overlap and be provided in one virtual environment VW.

For example, when the first player P1 is located at the center of the first play space PA1 and the second player P2 is located at the center of the second play space PA2, the first characters C1 and / The position of the second character C2 can be overlapped.

Therefore, the first play space PA1 and the second play space PA2 may be provided to share one virtual space VA.

For example, when the first player P1 is positioned at (X, Y, Z) in the first play space PA1 and the second player P2 is positioned at (X, Y, Z) The first character C1 and the second character C2 in the virtual environment VW may be provided at the same position.

When the first character C1 and the second character C2 are provided at the same position in the virtual environment, there may occur a case where the positions of the first character C1 and the second character C2 overlap each other and interfere with the play.

According to one embodiment, when the coordinates of the first character C1 and the second character C2 in the virtual environment are the same, the auxiliary computing device 300 transmits the first character C1 and the second character C2 to the virtual environment At least one of the coordinates of the first character C1 in the virtual environment and the coordinates of the second character C2 in the virtual environment can be corrected so as not to overlap in the virtual environment.

For example, the auxiliary computing device 300 subtracts or adds predetermined coordinate values in the virtual environment coordinates of the first character C1 and the second character C2 to calculate coordinates of the first character C1 in the virtual environment, 2 coordinates of the character C2 in the virtual environment can be corrected.

More specifically, for example, when the coordinates of the first character C1 and the second character C2 in the virtual environment are (10, 10, 10), the coordinates of the first character C1 in the virtual environment are coordinates (5, 10, 10), and the coordinate of the second character C2 in the virtual environment is obtained by adding 5 to the coordinate value of the X axis (15, 10, 10) can do.

In another concrete example, when the coordinates of the first character C1 and the second character C2 in the virtual environment are (10, 10, 10), the coordinate value of the first character C1, which is the priority, And the coordinates of (15, 10, 10) can be obtained by adding 5 to the coordinate value of the X axis in the virtual environment of the second character C2 which is the order of the second character.

As shown in FIG. 24, in the real world, a second play space PA2 may be provided in front of the first play space PA1.

As shown in FIG. 24, the first player P may carry an object OJ.

The object OJ can be shared even if the first player P1 and the second player P2 are spaced apart from each other.

The first character C1 can be output as having the object OJ in the virtual environment VW.

In the virtual image presented to the second player P2 through the wearable display device 400, the first character C1 may be output as having the object OJ.

In the real world, the second player P2 can not touch the object OJ, but in the virtual reality, the second character C2 can touch the object OJ.

Alternatively, the first character C1 corresponding to the first player P1 may carry a virtual object OJ in the virtual reality.

The first character C1 and the second character C2 can share virtual objects provided to the virtual environment.

According to one embodiment, the object OJ may be provided with a marker.

The server 200 can determine the position of the object OJ in the play space PA based on the detection information.

For example, when a pattern corresponding to the object OJ is detected in the detec- tion information acquired from the detec- tor 100 for the first play space PA1, the server 200 stores the object in the first play space PA1, It is possible to determine that the object OJ is provided, and obtain the real position information of the object OJ on the first play space PA1.

In addition, the server 200 can acquire the virtual position information of the object OJ based on the real position information of the object OJ.

The server 200 may also provide the virtual location information of the object (OJ) to the auxiliary computing device 300.

Secondary computing device 300 may render a virtual object corresponding to object OJ.

As an example, the secondary computing device 300 may render a box corresponding to the object OJ and obtain a virtual image containing the rendered box.

Secondary computing device 300 may render the virtual object based on the type of object OJ.

According to one embodiment, the secondary computing device 300 may determine the type of the object OJ based on the type of the marker M pattern provided to the object OJ, So that a virtual object can be rendered.

For example, the secondary computing device 300 may render a pre-stored soccer ball virtual object if it is a soccer ball as a result of the determination based on the type of the marker (M) pattern provided to the object OJ.

The secondary computing device 300 may also be coupled to a separate haptic device.

For example, the auxiliary computing device 300 may be connected to a glove-shaped haptic device mounted on the user's hand and a haptic device mounted on the user's body in the form of a vest.

According to one embodiment, the auxiliary computing device 300 may provide haptic feedback to the player P via the haptic device based on whether the player P and the virtual object are in contact with each other.

The auxiliary computing device 300 can determine the positional relationship between the virtual object and the player P in the virtual environment.

For example, when the hand of the player P is located within a predetermined distance range from the virtual object as a result of the determination based on at least one of the real position information and the virtual position information, the auxiliary computing device 300 may determine that the character C is a virtual object It can be judged that the contact has been made.

The secondary computing device 300 may control the haptic device to provide the corresponding haptic feedback if it determines that the character C has contacted the virtual object in the virtual environment.

Referring to FIG. 25, a first play space PA1 and a second play space PA2 may be provided.

In the first play space PA1 and the second play space PA2, one play space PA may be provided in a divided region.

The detachment system 100 may be provided in the play space PA.

Detecting system 100 may obtain detec- tion information for first play space PA1 and second play space PA2.

In the virtual environment, the character corresponding to the first play space PA1 may be located in the first layer, and the character corresponding to the second player group may be located in the second layer corresponding to the second play space PA2 Lt; / RTI > layer.

For example, when a virtual environment is provided in a plurality of layers such as a first floor, a second floor, a third floor and a fourth floor, a character corresponding to the first player group may be provided on the second floor of the virtual environment, The corresponding character can be provided on the third floor.

More specifically, the server 2000 determines whether the first player PA playing in the first play space PA1 is PA1 (10, 10 and 10 which are real position information in the second play space PA2 of the second player P2 playing in the second play space PA2, Can be obtained.

The auxiliary computing device 300 further includes a first character C1 corresponding to the first player P1 based on the real position information of the first player P1 and the second player P2 acquired from the server 200, And virtual position information of the second character C2 corresponding to the second player P2.

The auxiliary computing device 300 can acquire the virtual position information of the first character C1 by the

VA1

10,10 and 10 when the first play space PA1 is the first layer, ) Is the second layer, the virtual position information of the second character C1 is the coordinate value of the Z axis in the PA2 (10, 10, 10) which is the real position information in the second play space PA2 of the second player P2 (10, 10, 20) obtained by changing the coordinates of the first layer to the coordinates corresponding to the second layer.

Therefore, even if the first play space PA1 and the second play space PA2 are provided in the same layer, the first virtual space VA1 and the second play space PA2 corresponding to the first play space PA1 in the virtual environment, ) May be provided in different layers.

26, a play space PA may be provided in the real world, and the play space PA may include a first play space PA1, a second play space PA2, and a move region MA can do.

In the virtual environment, the first virtual area VA1 corresponding to the first play space PA1 may be provided in the first layer and the second virtual area VA2 corresponding to the second play space PA2 may be provided in the second layer. Lt; / RTI > layer.

When the first player P1 moves from the first play space PA1 to the second play area PA2 through the movement area MA, the first character C1 provided in the virtual environment is the first virtual area VA1 to the second virtual area VA2.

Thus, the first character C1 provided in the virtual environment can move from the first layer to the second layer of the virtual environment.

For example, as shown in FIG. 26, a virtual step Vstair connecting the first virtual area VA1 and the second virtual area VA2 may be provided in the virtual environment.

When the first player P1 moves from the first play space PA1 to the second play area PA2 while the first player P1 moves from the first play space PA1 to the second play area PA2, The first character C1 can move from the first virtual area VA1 to the second virtual area VA2 along the virtual step Vstair connecting the first virtual area VA2.

In the movement to another layer in the virtual environment via the movement area MA according to an embodiment, in the virtual environment, the virtual environment includes a virtual staircase connecting the first virtual area VA1 and the second virtual area VA2, (Vstair) is provided, but various types of moving means can be provided.

According to one embodiment, the virtual environment may be provided with a virtual elevator corresponding to the moving area.

For example, when the first player P1 moves from the first play area PA1 to the movement area MA in the virtual environment, the first character C1 moves to the area corresponding to the movement area MA in the virtual environment You can board the provided virtual elevator. Also, the virtual elevator may be provided with a virtual object that allows the player to select the desired number of floors.

The secondary computing device 300 may be configured to place the hand and input devices 500 at a location in the real world corresponding to the desired number of layers provided in the virtual environment or to direct the input device 500 to a predetermined When a selection is input, it can be determined that the number of layers is selected.

The auxiliary computing device 300 may provide a virtual image to the wearable display device 400 such that the virtual elevator moves to that layer.

The auxiliary computing device 300 may acquire a virtual image corresponding to the second play area PA2 in the virtual environment and provide the acquired virtual image to the wearable display device 400. [

According to one embodiment, the auxiliary computing device 300 wears a virtual image corresponding to the second play area PA2 when the first player P1 moves from the movement area MA to the second play area PA2 Type display device 400 according to the present invention.

According to an exemplary embodiment, the auxiliary computing device 300 may provide a virtual image corresponding to the second play area PA2 to the wearable display device 400 when the virtual elevator moves to the corresponding layer.

According to one embodiment, the auxiliary computing device 300 provides the virtual image corresponding to the second play area PA2 to the wearable display device 400 when the virtual elevator moves to the corresponding layer and the door of the virtual elevator is opened can do.

The secondary computing device 300 may provide a virtual image corresponding to that layer.

According to one embodiment, the auxiliary computing device 300 may provide a virtual image corresponding to the third floor when the virtual elevator moves to the third floor and the user moves to the second playing area PA2.

According to one embodiment, the auxiliary computing device 300 may provide a virtual image corresponding to the third floor when the virtual elevator moves to the third floor and the door of the virtual elevator is opened.

The auxiliary computing device 300 may provide a virtual image that is different from the other layers for at least some of the plurality of layers provided through the virtual elevator.

As an example, the first layer and the second layer may be provided with virtual environments of different backgrounds so that the virtual images for the first and second layers may be different from each other.

26, when the first player P1 moves in the second play area PA2 after selecting the second layer in the virtual elevator in the moving area MA, the auxiliary computing device 300 moves to the wearable display device When the first player P1 moves to the second play area PA2 after selecting the third layer from the virtual elevator in the moving area MA, The virtual images provided to the display device 300 may be different virtual images.

Also, according to one embodiment, a real object may be provided in the moving area MA.

As an example, a real object provided in the moving area MA may be provided with a real object through which a user can input a selection, such as a button, a switch, a stick, and the like.

The real object may also be provided with a marker.

The auxiliary computing device 300 may change the virtual space for the play area PA of at least one of the first play area PA1 and the second play area PA2 based on the real object manipulation of the player.

Referring to FIG. 26, the auxiliary computing device 300 can determine the real object manipulation of the first player P1 based on the detection information.

For example, when the first player P1 manipulates a real object provided in the movement area MA, the auxiliary computing device 300 may generate a first play area PA1 and a second play area PA2 based on the manipulation result of the real object, It is possible to determine a virtual space to be applied to at least one play area PA of the area PA2.

More specifically, if the real object is a switch, the auxiliary computing device 300 can determine the layer selected by the first player P1 based on the switch pressed by the first player P1, May apply the virtual image for the selected layer to at least one play area PA of the first play area PA1 and the second play area PA2.

As shown in FIG. 27, in the real world, a play space PA may be provided, and the play space PA may include a first play space PA1 and a second play space PA2.

Referring to FIG. 27, the first player P1 playing in the first play space PA1 has a second player P2, which plays the input device 400 possessed in the second play space PA1, It may be directed in the fifth direction RD5 and the input device 400 may be operated to command to generate a predetermined event in the third direction RD3.

For example, the first player P1 playing in the first play space PA1 directs the input device 400 toward the left where the second player P2 playing in the second play space PA1 is located, The user may command to generate an event to fire the gun to the left by depressing a switch provided on the switch 400.

The secondary computing device 300 may be configured to generate a virtual image in which a predetermined event occurs in a fifth direction RD5 in a virtual environment corresponding to a fifth direction RD5 in which the first player P1 has directed the input device 500. [ Can be obtained.

The auxiliary computing device 300 may include a first character C1 in a fifth direction RD5 in a virtual environment corresponding to a fifth direction RD5 in which the first player P1 is oriented toward the input device 500. [ You can acquire a virtual image that fires this gun.

When the first player P1 playing in the first play space PA1 is directed in the direction of the second player P2 located in the second play space PA2 and fires the gun, The first player P1 targets the second player P2 and fires the gun but in the virtual environment VW the first character C1 corresponding to the first player P1 is located on the first floor , And the second character C2 corresponding to the second player P2 may be located in the second layer.

Even if the second player P2 is positioned in the direction in which the first player P1 directs the input device 400 in the real world, the second character P2 in the virtual environment VW, The first player P1 can not hit the second player P2 if the second player P2 is not positioned.

For example, in a real world, when the first player P1 directs the input device 400 to input a command for shooting a bullet, even if the second player P2 is positioned in the direction toward the input device 400, If the second character C2 is not positioned in the direction in which the first character C1 is oriented in the environment VW, the first player P1 is allowed to move through the wearable display device 400 worn by the first player P1 The second character C2 may not be provided in the direction in which the bullet is fired.

As another example, even if the first player P1 is directed to the input device 400 and the command for the bullet shooting is input in the real world, even if the second player P2 is positioned in the direction toward the input device 400, If the second character C2 is not positioned in the direction in which the first character C1 is oriented in the environment VW, the second player P2 can be moved through the wearable display device 400 worn by the second player P2, The virtual image provided to the user may not be provided with a virtual image provided when the user is hit. More specifically, for example, a virtual image provided when a second player P2 is shot is not provided, and a virtual image that has been previously provided can be provided.

As shown in FIG. 28, in the real world, a play space PA may be provided, and the play space PA may include a first play space PA1 and a second play space PA2.

Also, the first play space PA1 and the second play space PA2 may be provided in the same layer.

In the virtual environment provided through the wearable display device 400, the first virtual area VA1 corresponding to the first play space PA1 may be provided in the first layer, and the first virtual space VA1 corresponding to the second play space PA2 may be provided A second virtual area VA2 may be provided in the second layer.

The first player P1 can play in the first play space PA1 and the second player P2 can play in the second play space PA2.

For example, as shown in FIG. 22, the second player P2 may be positioned on the left side of the first player P1.

According to one embodiment, the direction of the sound provided through the wearable display sound output portion 460 of the wearable display device 400 may be different from the direction between the players in the real world.

Referring to FIG. 28, a sound generated by the second player P2 to the first player PA1 in the real world can be recognized as a sound generated from the left.

Therefore, if only the real world is considered, the sound generated by the second player P2 provided to the first player PA1 is displayed on the left side of the wearable display sound output unit 460 provided to the first player PA1 to the left / To be output via the wearable display sound output 460 provided to the user.

28, in the virtual environment V1 provided through the wearable display device 400, the first character C1 corresponding to the first player P1 is located in the first layer, The second character C2 corresponding to the second character may be located in the second layer.

Therefore, the sound generated by the second player P2 provided to the first player PA1 can be provided to be heard above the first player P1.

29 is an exemplary view showing face registration according to an embodiment.

According to an embodiment, in a method of distinguishing players from each other in a virtual environment, each player and / or team may provide virtual characters of different colors to identify each player and / or team.

For example, the first virtual player character corresponding to the first player and the second virtual character corresponding to the second player character may be provided in different colors to identify the player.

Or a virtual character corresponding to a player belonging to the first team in a first color and a color of a virtual character corresponding to a player belonging to the second team in a second color so as to correspond to the player belonging to the first team The virtual character and the virtual character corresponding to the player belonging to the second team can be discriminated from each other.

According to one embodiment, identification information corresponding to each player and / or team is provided so as to distinguish each player and / or team in a virtual environment so that one player can identify each player and / Teams can be identified from each other.

Or the identification information for the first player and / or the first virtual character in a predetermined area adjacent to the first virtual character and / or the first virtual character corresponding to the first player, Identification information for the second player and / or the second virtual character is provided in a predetermined area adjacent to the second virtual character and / or the second virtual character to provide the identification information so as to identify the first virtual character and the second virtual character can do.

Or a virtual character corresponding to the player belonging to the first team and / or a predetermined area adjacent to the virtual character, identification information on the first team, and a virtual character corresponding to the player belonging to the second team and / The virtual character corresponding to the player belonging to the first team and the virtual character corresponding to the player belonging to the second team can be discriminated from each other by providing identification information for the second team in a predetermined area adjacent to the first team have.

When identifying each player using such a color, it may be difficult to identify which player is the player who does not remember the color assigned to the player.

There may be a variety of ways to recognize others in everyday life, but what is commonly used can be face recognition. That is, they can identify and recognize each other through facial features of other people.

Such face features can be provided in a variety of ways. Generally, in a game, the virtual characters are provided uniformly or the face features are different from one another for each virtual character, but the face features are not provided differently from one player to another.

According to one embodiment, one player can be easily distinguished from the other players by providing different facial features for each player.

In addition, according to the embodiment, the face characteristic of the player is reflected in the face data of the virtual character, so that it is possible to more clearly identify the virtual character of the player.

Referring to FIG. 30, a method for acquiring a play character includes acquiring player face data (S200), acquiring a face feature value based on player face data (S210), acquiring information about a virtual character S220), acquiring the face data of the virtual character based on the face feature value (S230), storing the play character (S500), and outputting the play character (S240).

According to an embodiment, a step of acquiring player face data may be performed (S200).

According to one embodiment, the virtual environment system may be provided with the face sensor unit 800 and the face data of the player through the face sensor unit 800 may be acquired.

The server 200 may acquire the face data of the player to obtain the face characteristic value of the player.

31 is a diagram showing acquisition of face data through the face sensor unit 800 according to an embodiment.

According to an embodiment, a face sensor unit 800 for obtaining face data of a player can be provided, and face data of a player can be obtained through the face sensor unit 800. [

According to one embodiment, the face sensor unit 800 may be provided as a camera, an image, or the like.

For example, when the face sensor unit 800 is provided as a camera, the face of the player can be captured by photographing the face of the player with the camera.

As shown in FIG. 32, the server 200 can acquire face data of the face of the player through the face sensor unit 800.

According to one embodiment, face data corresponding to the acquired player identification information among the face data stored in advance in the server 200 can be obtained.

The server 200 may store the face data acquired through the face sensor unit 800 in advance.

According to an embodiment, the face data may be stored in advance in a separate face data server.

According to one embodiment, the server 200 can acquire player identification information through the ID sensor unit 900. [

For example, the server 200 may acquire the player identification information input by the player through the input device provided in the ID sensor unit 900.

As another example, the server 200 may scan and acquire player identification information recorded on a portable recording medium held by the player via the ID sensor unit 900. [

More specifically, the server 200 may acquire player identification information by scanning a barcode recorded on the ID card held by the player via the barcode reader provided in the ID sensor unit 900. [

In addition, the server 200 can acquire the player identification information inputted by the player through the ID sensor unit 900. [ In addition, the server 200 can acquire the face data corresponding to the player identification information among the face data stored in advance.

If a separate face data server is provided, the server 200 can request the transmission of the face data corresponding to the player identification information to the face data server and acquire the face data corresponding to the player identification information from the face data server have.

According to one embodiment, the server 200 can acquire face data from a portable recording medium.

According to one embodiment, the server 200 can acquire the face data recorded on the portable recording medium held by the player through the ID sensor unit 900.

For example, the server 200 can scan the face data recorded on the portable recording medium held by the player through the ID sensor unit 900 and acquire the face data.

More specifically, the server 200 may acquire facial data by scanning a barcode recorded on an ID card held by a player through a barcode reader provided in the ID sensor unit 900. [

According to an embodiment, a step of acquiring a face feature value based on player face data may be performed (S210).

Feature values of facial data can be obtained for eye color, hair color, eyebrow color, facial skin color, nose height, width, eye size, distance between eye and eye,

The server 200 can acquire the face data of the virtual character by applying the characteristic value of the obtained face data to the predetermined virtual character face data variable value.

For example, the face data may include variables such as the height of the nose, the nose of the nose, the size of the eyes, the distance between the eyes and the eye, and the position of the eyes. In the server storage unit 220, The server control unit 240 can change the variable value of the stored face data to the feature value of the acquired face data.

For example, when the height of the nose of the acquired face data is 10 cm, the server control unit 240 may set the nose height parameter of the virtual character's face data to 10 cm.

The face data of the virtual character among the players having the feature values different from each other may be different from each other.

For example, when the feature value of the face data acquired from the first player is different from the feature value of the face data acquired from the second player, the face data of the first character and the face data of the second character may be different from each other.

In addition, since the first character acquires the face data by applying the feature value acquired from the first player, when the other player views the first character, It is possible to identify the character corresponding to one player.

The server 200 may transmit the acquired characteristic values to the auxiliary computing device 300. [

The acquisition of the feature values described above is not necessarily performed in the server 200, and may be provided in various forms according to the selection.

For example, the auxiliary computing device 300 may acquire the feature value by acquiring the face data acquired in step S100 and performing step S200.

According to an embodiment, the step of acquiring information on the virtual character may be performed (S220).

According to an embodiment, information on a selected character among a plurality of virtual characters stored in advance can be obtained.

According to an embodiment, a step of selecting at least one character among a plurality of virtual characters in the virtual environment may be provided.

For example, in a predetermined step in the game, the player may be provided with identification information for a plurality of characters.

Referring to FIG. 34, the auxiliary computing device 300 can control the wearable display device 400 to provide images for a plurality of virtual characters in a virtual environment.

Although not shown in FIG. 34, identification information for each of a plurality of virtual characters may be provided.

The auxiliary computing device 300 may also obtain a selection of the player for the at least one virtual character via the controller 500.

For example, the auxiliary computing device 300 may acquire a virtual character corresponding to a direction in which the player has directed the controller 500 as a virtual character selected by the player.

As another example, when the player depresses a predetermined selection button provided on the controller 500, the auxiliary computing device 300 may display the selection button corresponding to the direction in which the controller 500 is oriented when the player touches the predetermined selection button The virtual character can be obtained as a virtual character selected by the player.

The auxiliary computing device 300 may obtain the character information for the selected virtual character.

According to one embodiment, the character information may be data on the body excluding the face data of the virtual character as information on the appearance of the character. Alternatively, the character information may include face data of the virtual character of the character, and the face data of the virtual character may be provided with face data in which the basic character value previously assigned to the virtual character is set.

According to an exemplary embodiment, a step of acquiring face data of a virtual character based on the face feature value may be performed (S230).

The server 200 can acquire the face data of the virtual character based on the face characteristic value of the player.

According to one embodiment, the face data of the virtual character includes variable values for eye color, hair color, eyebrow color, face skin color, nose height, width, eye size, distance between eyes, can do.

The server 200 can acquire the face data of the virtual character by changing the variable value included in the face data of the virtual character to the characteristic value acquired based on the face data of the player.

For example, the server 200 may acquire face data of a virtual character by changing the height variable value of the nose included in the face data of the virtual character to a variable value obtained from the face data of the player.

According to an embodiment, the step of storing the play character may be performed (S240).

The server 200 can acquire the virtual character based on the face data of the virtual character and the body data of the virtual character.

In addition, the server 200 may store the virtual character in the server storage unit 220.

In addition, the server 200 may transmit the virtual character to the auxiliary computing device 300.

For example, the server 200 may transmit the first virtual character corresponding to the first player to the second auxiliary computing device used by the second player.

As another example, the server 200 may transmit a second virtual character corresponding to the second player to a first auxiliary computing device used by the first player.

As another example, the server 200 may transmit the first virtual character and the second virtual character to the first auxiliary computing device and the second auxiliary computing device connected to the server 200. [

According to an embodiment, the step of outputting the play character may be performed (S250).

According to one embodiment, an image of a virtual character corresponding to another player can be output through the wearable display device 400 worn by one player.

35 is an exemplary view of a play character according to an embodiment.

As shown in FIG. 35, the face data of the virtual character output in the virtual environment may be provided with face data reflecting characteristic values obtained based on the face data of the player.

For example, when the first player and the second player play the virtual environment and the virtual character corresponding to the second player is included in the view of the first player in the virtual environment, the wearable display device 400 , The virtual character corresponding to the second player can be output.

Also, if a virtual character corresponding to the first player is included in the field of view of the second player, the virtual character corresponding to the first player can be output through the wearable display device 400 worn by the second player.

When the second play character corresponding to the second player is output through the first wearable display device, the face data of the virtual character corresponding to the second player may be output with the face data reflecting the characteristic value of the second player .

Also, when the second play character corresponding to the first player is outputted through the second wearable display device, the face data of the virtual character corresponding to the second player is outputted as the face data reflecting the characteristic value of the second player .

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims

A virtual reality control system for providing a virtual image of at least a part of a virtual environment through a wearable display device worn by the player to a player playing in a plurality of separated spaces,

At least one first detection device for obtaining detection information for a first play space;

At least one second detecting device for obtaining detecting information for a second play space;

At least one auxiliary computing device for generating a first virtual image and a second virtual image;

A first wearable display device for outputting the first virtual image to a first player located in the first play space; And

And a second wearable display device for outputting the second virtual image to a second player located in the second play space,

The secondary computing device comprises:

Acquiring first real position information on the first player based on the first detection information and generating first position information on the first player based on the first position information on the first player, 1 virtual location information,

Acquires second real position information on the second player based on the second detection information, and based on the real position information on the second player, 2 virtual location information,

The first virtual image is an image for an area corresponding to a field of view at a position determined based on the first virtual position information in the virtual environment,

Wherein the second virtual image is an image for an area corresponding to a field of view at a position determined based on the second virtual position information in the virtual environment

Virtual environment control system.
The method according to claim 1,

The distance between the first player and the second player determined based on the first real position information and the second real position information is calculated based on the first virtual position information and the second virtual position information, The distance between the first character and the second character in the first character

Virtual environment control system.
3. The method of claim 2,

Wherein the first real position information, the second real position information, the first virtual position information, and the second virtual position information include coordinate values,

The difference between the coordinate values of the first real position information and the second real position information is

Wherein the first virtual position information and the second virtual position information are different from the coordinate value

Virtual environment control system.
The method according to claim 1,

Wherein the first play space and the second play space are provided in a first direction and are arranged in a first virtual space corresponding to the first play space and a second virtual space corresponding to the second play space in the virtual environment, Is provided in the second direction

Virtual environment control system.
5. The method of claim 4,

Wherein when the first wearable display device is oriented in a second direction different from the first direction in which the second player is located, the first virtual image includes the first character corresponding to the first player

Virtual environment control system.
5. The method of claim 4,

And an input device assigned to the first player,

When the input device is directed in a second direction different from the first direction in which the second player is located and an instruction for a predetermined event is obtained,

Wherein the first virtual image is a virtual image in which the first character corresponding to the first player performs the predetermined event,

Wherein the second virtual image is a virtual image of an effect imparted to the second character corresponding to the second player in accordance with the predetermined event

Virtual environment control system.
5. The method of claim 4,

Wherein the first wearable display device includes an acoustic output unit for outputting sound,

The sound obtained by the second player located in the first direction and the second character corresponding to the second player is

And outputting a sound generated in a second direction, which is the direction of the second character, from the first character corresponding to the first player in the virtual environment through the sound output unit

Virtual environment control system.
The method according to claim 1,

Wherein the first play space and the second play space are provided arranged in a first direction and the virtual environment includes a virtual area corresponding to the first play space and the second play space

Virtual environment control system.
9. The method of claim 8,

Wherein the first real position information and the second real position information include coordinate values for a plurality of axes,

If the coordinates of the same axis are the same in the first and second real position information

The second character corresponding to the second player provided in the first virtual image is provided in the same line as the first character corresponding to the first player

Virtual environment control system.
10. The method of claim 9,

An object held by the first player,

Wherein the second virtual image includes an image in which the first character possesses a virtual object corresponding to the object,

When the hand of the second player moves to a position corresponding to the position of the object, the second virtual image is provided as an image touched to the virtual object corresponding to the object by the second character

Virtual environment control system.
A wearable display device for providing a virtual image of at least part of a virtual environment to a player playing in a plurality of separated spaces,

A communication unit for acquiring information about the other player;

A display unit for outputting a virtual image to the player; And

And a control unit for controlling output of the virtual image of the display unit.

Wherein the virtual image output through the display unit includes an image for a first virtual area corresponding to a first play space played by a player wearing the wearable display device and an image for a first virtual area corresponding to at least one player An image for a second virtual area corresponding to the second play space

A wearable display device.
The method according to claim 1,

The distance between the character of the other player corresponding to the other player and the character corresponding to the player provided in the virtual image is different from the distance between the player and the other player

A wearable display device.
12. The method of claim 11,

The wearable display device includes an acoustic output unit for outputting sound,

The sound obtained by the other player positioned in the first direction from the player and the character of the other player corresponding to the other player

And outputting a sound generated in a second direction, which is the direction of the second character, from the first character corresponding to the first player in the virtual environment through the sound output unit

A wearable display device.
12. The method of claim 11,

The virtual image is obtained from a secondary computing device connected to the communication unit

A wearable display device.