KR101436914B1 - Virtual Experience System - Google Patents

Abstract

The virtual experience system includes a virtual experience hall, a camera, a camera server, a portable terminal, a wireless repeater, and a display unit. The virtual experience hall has an internal space of a predetermined size and has a plurality of markers. The camera acquires the entire image of the virtual experience hall. The camera server derives the position information of the marker from the entire image transmitted from the camera, and extracts the image identifier corresponding to the marker from the image database. The wireless repeater receives the location information of the marker and the image identifier from the camera server, transmits the location information and the image identifier to the external game server, and receives the location information and the image identifier of the other marker acquired from the external game server. The wireless terminal receives the position information of the marker, the image identifier, the position information of the other marker, and the image identifier from the wireless repeater and reflects the information on the virtual experience map. The display unit receives and displays the virtual experience map from the portable terminal.

Description

Virtual Experience System

The present invention relates to a virtual experience, and more particularly, to a virtual experience system for realizing a virtual experience in a real space.

The Augmented Reality system combines the real world with the virtual world to allow interaction with the user in real time. Techniques for applying such augmented reality technology to games have been developed, and in particular, And a technique for providing a game based on augmented reality is being actively researched.

Publication No. 10-2004-9932 discloses a mobile online game system using location-based services. The contents are composed of GPS satellite, mobile terminal, mobile communication network, location based service system, map server, game server and the like. GPS satellites transmit navigation data for position calculation. The mobile communication network calculates location information of the mobile terminal according to the request of the mobile terminal. The location-based service system calculates the latitude and longitude of the mobile terminal by using the location information received from the mobile communication network and the navigation data received from the GPS satellite, and converts the calculated latitude and longitude into coordinate values of the actual space of the mobile terminal . The map server stores geographic information about the virtual space that is the background of the game. The game server provides the geographical information of the virtual space to the mobile terminal connected through the mobile communication network and arranges the game character in the virtual space corresponding to the coordinates of the mobile terminal provided by the location based service system.

However, due to the characteristics of the GPS system, it is difficult to precisely acquire the position of a moving object in the mobile game of the related art, and an error occurs in mapping the actual space to the virtual space. In this case, an error occurs such that the position of the object is displayed differently in the virtual space, resulting in a game in which the reality or the sense of realism is lost.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems,

First, it enhances the sense of presence by providing a virtual space where virtual experients can experience virtual experiences,

Second, the actual space is precisely mapped to the virtual space,

Third, it aims to provide a virtual experience system that responds precisely and interactively to a movement of a virtual experient.

In order to achieve the above object, the virtual experience system of the present invention includes a virtual experience center, a camera, a camera server, a wireless repeater, a portable terminal, and a display unit.

The virtual experience hall has an internal space of a predetermined size and has a plurality of markers.

The camera is installed in the virtual experience hall. The camera acquires the entire image of the virtual experience hall. The camera is usually installed on the ceiling of a virtual experience hall.

The camera server is installed in the virtual experience hall. The camera server derives the marker position information from the entire image transmitted from the camera. Then, the camera server extracts the image identifier corresponding to the marker from the image database.

The wireless repeater is installed in the virtual experience hall. The wireless repeater receives location information and image identifier of the marker from the camera server and transmits it to the external game server. The wireless repeater receives location information of another marker acquired from another virtual experience hall from an external game server and an image identifier of another marker.
The external game server receives the location information and the image identifier of the other markers obtained from other virtual experience pipes and transmits them to the wireless repeater.

The wireless terminal receives from the wireless repeater the location information of the marker acquired from the virtual experience center, the image identifier, the location information of the other marker transmitted from the external game server, and the image identifier of the other marker And reflects it in the virtual experience map.

The display unit receives and displays the virtual experience map from the portable terminal. The display unit uses an HMD (Head Mounted Display) which covers the field of view.

In the virtual experience system of the present invention, the virtual experience hall and the other virtual experience hall can be configured in different sizes. In this case, the camera server derives the position information of the marker as a ratio value, and the portable terminal places the image identifier of the marker on the virtual experience map based on the ratio value.

In the virtual experience system of the present invention, the positional information of the marker may be an actual coordinate value or a change amount of coordinates.

In the virtual experience system of the present invention, the marker can be configured to be coupled to the portable terminal.

In the virtual experience system of the present invention, the display unit includes a geomagnetic sensor and a gravity sensor. In this case, the mobile terminal receives the change in the movement of the virtual player from the display unit and reflects the change in the virtual experience map in real time.

In the virtual experience system of the present invention, the camera may include a plurality of cameras. In this case, a plurality of cameras acquire an image of an allocated area, and a camera server combines acquired images of a plurality of cameras, and then obtains position information of the marker.

According to the virtual experience system of the present invention having such a configuration, it is possible to enhance the sense of presence by providing a real space in which a virtual experient can move and experience a virtual experience. In addition, the virtual experience system according to the present invention can precisely map an actual space to a virtual space, thereby allowing a precise and interactive response to the movement of a virtual experient. In addition, the virtual experience system of the present invention can be applied not only to games but also to various virtual experiences such as a jungle experience.

1 is a configuration diagram of a virtual experience system according to the present invention.
2 is a flow chart showing a data flow of the virtual experience system according to the present invention.
FIG. 3 is an example of implementing the virtual experience system according to the present invention as a virtual experience space.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the virtual experience is exemplified as a virtual game, and the virtual experience includes various virtual experiences such as exhibition hall experience, museum experience, jungle experience, and underwater experience in addition to the virtual game.

1 is a configuration diagram of a virtual game room according to a temporal example of the present invention.

1, the virtual game room includes a camera 110, a camera server 120, a portable terminal 130, a display unit 140, and a wireless repeater 150 in a real space, and the wireless repeater 150 To the external game server 160 in a wired or wireless manner.

The virtual game hall means the actual space in which the player actually plays the game. The virtual game arcade can be a space having a size enough to perform a game, for example, an indoor arena. Virtual game pipes can be made in various sizes.

The virtual game hall can be configured similar to the virtual game map. That is, a wall, a staircase, a cliff, and the like can be formed at a position similar to the actual shape.

The virtual game pipe is provided with a plurality of markers at the positions of the respective objects. Each object and marker are matched 1: 1.

In addition, the virtual game pipe may have a protection facility, for example, a sponge or the like may be formed under the cliff.

The camera 110 is installed at an upper portion of the virtual game pipe, and acquires the entire image of the virtual game pipe and transmits it to the camera server 120.

The image obtained by the camera 110 includes a plurality of markers. The markers also include fixed markers, but they also include markers that move within the virtual game tube. Here, the moving marker may be a game player. The moving marker may be attached to the portable terminal 130, the display unit 140, or the head of the player. Since the patterns are drawn differently for each marker, the marker can be identified by recognizing the pattern of the marker. The recognized markers are displayed as one virtual object in the game map.

The camera 110 may be installed on the ceiling of the virtual game pipe, but may be divided into a plurality of units at predetermined intervals when the space is large. When two or more cameras 110 are installed, each camera 110 acquires respective images for the allocated areas and transmits them to the camera server 120.

The camera 110 has a predetermined resolution, and the resolution is used to determine the coordinates of the marker.

The camera server 120 extracts a marker from the entire image transmitted from the camera 110. [ Then, the coordinates of each marker and the corresponding image identifier are extracted.

The camera server 120 extracts fixed or moving markers, and then recognizes the pattern of each marker. Pattern recognition and matching of markers can use an image pattern matching algorithm. For example, you can use Glyph 'recognition, which is provided by Aforge.net, which can be found at the Internet address http://www.aforgenet.com/articles/glyph_recognition. Can be confirmed.

The camera server 120 includes an image database matching and storing a marker pattern and an image identifier, and searches an image database to extract an image identifier matching the marker pattern.

The camera server 120 preferably calculates the coordinates of the marker as a ratio value. For example, if one camera is installed in a virtual game tube and the resolution of the camera is 1024 * 800 and a specific marker is located at X = 300, Y = 350, the ratio value of X is 300/1024 = 0.2929 , And the ratio value of Y becomes 350/800 = 0.4375. As described above, when the coordinates of the marker are calculated as the ratio values, the positions of the marker markers of each virtual experience hall can be mapped to match the virtual game map regardless of the size of the virtual experience hall.

The camera server 120 transmits the coordinate ratio value of the marker and the image identifier to the wireless repeater 150.

When the camera server 120 receives a plurality of divided images from a plurality of cameras, the camera server 120 combines the divided images received from the cameras according to the resolution of each camera, And calculates the coordinates of the marker and its ratio value according to the entire image and the entire resolution.

The portable terminal 150 receives the coordinate ratio value and the image identifier of the marker from the wireless repeater 150 and reflects the coordinate ratio value and the image identifier on the virtual game map. In other words, the position change of the marker is reflected in the virtual experience map.

The portable terminal 150 derives the virtual coordinates of the virtual game map using the coordinate ratio value of the marker received from the wireless repeater 150. [ For example, if the resolution of the virtual game map is 2560 * 1440, virtual coordinates are X = 0.2929 * 2560 = 750 and Y = 0.4375 * 1440 = 630.

The portable terminal 150 stores contents of a virtual game map, and further includes an interface program for constituting and changing a virtual game map. Upon receiving the coordinate ratio value of the marker and the image identifier from the wireless repeater 150, the interface program searches the object database matching the image identifier and the virtual object, and extracts the virtual object. Here, the imaginary object includes a fixed object such as a road, a waterfall, a land mine, a door, a stair, a wall, etc., and a moving object such as enemy, tank, or player.

Further, the interface program places the virtual object in the virtual coordinate corresponding to the coordinate ratio value. Here, the coordinate ratio value may be calculated from the coordinate value itself or may be calculated from the variation amount of the coordinate value. In any case, both the coordinate value and the change amount are one of the values indicating the marker position information.

The portable terminal 130 includes a geomagnetism sensor and a gravity sensor, and senses the direction of movement of the portable terminal 130, and then transmits the sensed direction to the wireless repeater 150. The geomagnetic sensor is a sensor that detects the direction change of north, south, south, and the gravity sensor is a sensor that detects the upward and downward inclination direction. These sensors are used to detect a user who is holding the portable terminal 130, for example, a player moving in which direction or which direction they are watching, and reflecting the game in the game map. That is, the game map can be changed in a direction that the game player is watching according to the direction detected from these sensors. Accordingly, it is possible to generate a virtual game map corresponding to the moving direction of the player in real time, and to provide a virtual game map capable of real-time interactive with the player.

The display unit 140 displays the virtual game map received from the portable terminal 130. Here, the display unit 140 may be a glasses-type display, for example, an HMD (Head Mounted Display), and is preferably formed in the form of a headset. A marker is attached to the upper surface of the display unit 140 in the form of a headset.

The display unit 140 may include a geomagnetic sensor and a gravity sensor to more accurately detect a change in the motion of the player. In this case, the portable terminal 130 installs only the interface program, and after the interface program of the portable terminal 130 receives the change of the player's movement from the display unit 140, the interface program reflects the change in the virtual game map.

The wireless repeater 150 is installed in the virtual experience center and receives the coordinate ratio value and the image identifier of the marker from the camera server 120 and transmits the coordinate ratio value and the image identifier to the portable terminal 130 and the external game server 160. The wireless repeater 150 and the external game server 160 are connected by wire or wireless.

The wireless repeater 150 receives the coordinate ratio value of the other marker acquired from the other game server 160 and the image identifier of the corresponding marker from the external game server 160, and transmits the coordinate ratio value to the portable terminal 130.

2 is a flow chart showing a data flow of a virtual experience system according to the present invention.

First, the camera 110 acquires an image in the virtual experience hall and transmits it to the camera server 120 (S210).

Then, the camera server 120 extracts the location information and the image identifier of the marker from the image acquired and transmitted by the camera server 110, and transmits it to the wireless repeater (S220). Here, since the size of the virtual experience pipe may be different, it is preferable to convert the position information of the marker into the coordinate ratio value.

In step S230, the wireless repeater 150 transmits the location information of the marker and the image identifier to the external game server 160. [ Of course, the wireless repeater 150 also transmits the location information of the marker and the image identifier to the portable terminal 130 existing in the same virtual experience hall. On the other hand, the wireless repeater 150 receives the location information and the image identifier of the other markers obtained from the other game server 160 from the other game server 160, and transmits the location information and the image identifier to the portable terminal 130.

In step S240, when the portable terminal 130 receives the location information of the marker and the image identifier, and the location information and the image identifier of the other marker from the wireless repeater 150, Reflect in the experience map. Here, the marker position information may be a coordinate ratio value indicating the coordinate value itself, or a coordinate ratio value indicating the amount of change in coordinates.

Then, the display unit 140 receives the virtual experience map from the portable terminal 130 and displays the virtual experience map.

FIG. 3 is an example of implementing the virtual experience system according to the present invention as a virtual experience space.

As shown in FIG. 3, a virtual experience hall 310 such as an indoor arena is provided, and a plurality of cameras 110 are installed on an inner ceiling of the virtual experience hall 310 at regular intervals. A camera server 120 is connected to the camera 110 at an upper portion of the virtual experience hall 310.

At the bottom of the virtual experience hall 310, objects of a shape corresponding to the virtual game map are formed. For example, sloping roads, walls, and cliffs are formed.

The game player 320 moves within the virtual experience hall 310 to perform a virtual game. The player 320 is a moving virtual object in the virtual game map. The game player 320 wears the HMD which is the display unit 140, and the portable terminal 130 is carried around the waist.

The portable terminal 130 stores a virtual game map, and the interface program receives the coordinate value or the variation amount from the wireless repeater 150 and reflects the coordinate value or the variation amount to the virtual game map in real time.

The display unit 140 has a geomagnetic sensor and a gravity sensor. The movement change of the game player 320 detected by the geomagnetic sensor and the gravity sensor of the display unit 140 is transmitted to the interface program of the portable terminal 130. The interface program changes the direction or inclination of the player 320 It reflects in real time on the virtual game map.

The game player 320 also carries the marker 330. It is preferable that the marker 330 is positioned at a position where the camera 110 on the ceiling can take a picture, for example, the head of the player 320. [ For example, on the upper surface of the display unit 140, i.e., the HMD headset.

When the game player 320 wears the display unit 140 and moves in the virtual experience hall 310, the virtual game map transmitted from the portable terminal 130 is displayed on the display unit 140. The virtual game map is displayed while real time reflecting the change of the markers in the virtual experience hall 310 in which the player 320 exists and the change of the markers in the different virtual experience hall. Here, the change includes the movement of the player 320, the movement of another player, and the switching of the view according to the change of direction of the player 320. [

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited thereto. Those skilled in the art will be able to variously modify or modify the spirit of the present invention based on this embodiment. Accordingly, the scope of the present invention is defined by the following claims, and such variations and modifications made by a person skilled in the art can be construed as being included in the scope of the present invention.

110: camera 120: camera server
130: portable terminal 140: display unit
150: wireless repeater 160: game server
310: Virtual Experience Room 320: Game Player
330: Marker

Claims (7)

In a virtual experience system,
A virtual experience hall formed of the same terrain and structure as the virtual experience map in an internal space of a predetermined size and having a plurality of markers;
A camera installed in the virtual experience hall for acquiring a full image of the virtual experience hall;
A camera server installed in the virtual experience pipe, for deriving location information of the marker from the entire image transmitted from the camera, and extracting an image identifier corresponding to the marker from the image database;
A wireless repeater installed in the virtual experience hall for receiving and transmitting the positional information of the marker and the image identifier from the camera server;
An external game server for receiving location information and an image identifier of another marker acquired from another virtual experience hall and transmitting the received location information to the wireless repeater;
Receiving, from the wireless repeater, location information of a marker obtained from the virtual experience center, the image identifier, location information of the other marker transmitted from the external game server and the image identifier of the other marker, A portable terminal for reflecting on the experience map; And
And a display unit for receiving and displaying the virtual experience map from the portable terminal,
The display unit is a head mounted display having a geomagnetic sensor and a gravity sensor,
Wherein the mobile terminal receives the change of movement of the virtual experient from the display unit, reflects the change in the virtual experience map in real time, and reflects the change in real time on the display unit. The method according to claim 1,
The virtual experience hall and the other virtual experience hall are different in size,
The camera server derives the position information of the marker as a ratio value, and
Wherein the portable terminal places the image identifier of the marker on the virtual experience map based on the ratio value. The method of claim 2, wherein the positional information of the marker
Wherein the virtual experience system is an actual coordinate value or a change amount of coordinates. delete The method according to claim 1,
The camera includes a plurality of cameras, the plurality of cameras acquire images of the allocated area,
Wherein the camera server combines the acquired images of the plurality of cameras. In a virtual experience system,
A virtual experience center having the same topography and structure as the virtual experience map in an internal space of a predetermined size and having a plurality of markers;
A camera installed in the virtual experience hall for acquiring a full image of the virtual experience hall;
A camera server installed in the virtual experience pipe, for deriving location information of the marker from the entire image transmitted from the camera, and extracting an image identifier corresponding to the marker from the image database;
And a game server installed in the virtual experience hall, receiving the positional information of the marker and the image identifier from the camera server and transmitting the positional information and the image identifier to the external game server, A wireless repeater for receiving an image identifier of the image;
Receiving the positional information of the marker, the image identifier, the position information of the other marker, and the image identifier of the other marker from the wireless repeater, and reflecting the image identifier on the virtual experience map for display; And
And a display unit for receiving and displaying the virtual experience map from the portable terminal,
The mobile terminal includes a geomagnetic sensor and a gravity sensor. The mobile terminal receives movement changes of a virtual player from the geomagnetism sensor and the gravity sensor, reflects the change in the virtual experience map output from the display unit in real time,
Wherein the display unit is a head mount display. delete

Images