KR20220000165A - Method for broadcasting virtual reality game and virtual reality system for performing the same - Google Patents

Abstract

The present application relates to a method for generating a relay screen for a virtual reality game and a virtual reality system for performing the same. The method for generating the relay screen according to one aspect of the present application comprises the following steps of: for audience near a playground where a VR game is played, detecting location of the audience in a real space with respect to the playground; setting a camera location variable in a virtual space, where the VR game is played, based on the location of the audience; generating a virtual camera in the virtual space according to the camera location variable; obtaining a video of the virtual space photographed by the virtual camera; and transmitting the relay screen photographing the virtual space to a smart device of the audience. The virtual reality system broadcasts the VR game with high sense of realism.

Description

A method for generating a relay screen for a virtual reality game and a virtual reality system for performing the same

The present application relates to a method of generating a relay screen for a virtual reality game and a virtual reality system for performing the same.

A virtual reality (VR) service made with computer graphics having an environment similar to the real one is spotlighted as a next-generation representative service as a large-scale investment is in progress. The field of application of virtual reality technology spans various fields such as education, medical care, national defense, and transportation.

Initially, virtual reality games were developed mainly for personal platforms, but recently, they are developing into a location-based entertainment form centered on theme parks and the like.

A place-based VR platform targets a variety of customer groups, unlike personal VR platforms that target gamers who are familiar with games. Because of the advantages of , it can cause motion sickness or fear, so countermeasures are being requested.

An object of the present application is to provide a method for generating a relay screen for a virtual reality game that relays a VR game with a high sense of presence, and a virtual reality system for performing the same.

The problem to be solved by the present application is not limited to the above-mentioned problems, and the problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present application belongs from the present specification and the accompanying drawings. .

According to an aspect of the present application, with respect to the audience around the playground where the VR game is performed, the method comprising: detecting a position of the audience in a real space with respect to the playground; setting a Kemera location variable in a virtual space in which the VR game is performed based on the location of the Kwak-Gak; generating a virtual camera in the virtual space according to the camera position variable; acquiring the virtual space image captured by the virtual camera; and transmitting the virtual space image to a smart device possessed by the audience.

The solutions to the problems of the present invention are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. will be able

According to the embodiment of the present application, VR can be experienced not only by the player but also by the audience by providing an image in the virtual space to the audience in consideration of the Field-Of-View (FOV) from the audience's position to view the playground. can make it

The effect of the present invention is not limited to the above-described effect, and the tasks not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and accompanying drawings.

1 is a block diagram of a virtual reality system according to an embodiment of the present specification.
2 is a schematic diagram of a virtual reality system according to an embodiment of the present specification.
3 is a flowchart of an example of a method for generating a relay screen according to an embodiment of the present specification.
4 is a diagram illustrating an example of a real space in which a VR game is performed according to an embodiment of the present specification.
5 is a diagram illustrating an example of a virtual space in which a VR game is performed according to an embodiment of the present specification.
6 is an exemplary diagram of a player screen according to an embodiment of the present specification.
7 and 8 are diagrams illustrating examples of a relay screen according to an embodiment of the present specification.

The embodiments described herein are for clearly explaining the spirit of the present invention to those of ordinary skill in the art to which the present invention pertains, so the present invention is not limited by the embodiments described herein, and the present invention It should be construed as including modifications or variations that do not depart from the spirit of the present invention.

The terms used in this specification have been selected as widely used general terms as possible in consideration of the functions in the present invention, but they may vary depending on the intention, custom, or emergence of new technologies of those of ordinary skill in the art to which the present invention belongs. can However, if a specific term is defined and used in an arbitrary sense, the meaning of the term will be separately described. Therefore, the terms used in this specification should be interpreted based on the actual meaning of the terms and the contents of the entire specification, rather than the names of simple terms.

The drawings attached to this specification are for easily explaining the present invention, and the shapes shown in the drawings may be exaggerated as necessary to help understand the present invention, so the present invention is not limited by the drawings.

In the present specification, when it is determined that a detailed description of a known configuration or function related to the present invention may obscure the gist of the present invention, a detailed description thereof will be omitted if necessary.

The present specification relates to a player emotion analysis method for a virtual reality game, a player emotion-based virtual reality service operating method, and the virtual reality system 1000 .

Hereinafter, a virtual reality system 1000 according to an embodiment of the present specification will be described with reference to FIGS. 1 and 2 .

The virtual reality system 1000 is a system that provides virtual reality to a user. Here, virtual reality (VR) may mean an artificial environment provided by using visual and auditory information created by a computer program, unlike the real world.

Virtual reality is mainly a virtual reality that provides an image by creating a virtual space separated from reality by a program, and Augmented Reality (AR: Augmented Reality) that provides a single image by overlapping virtual images based on the real world ) and mixed reality (MR: Mixed Reality), which provides a virtual space by fusing the real world and virtual reality and provides an image for it, the term 'virtual reality' is It can be interpreted as virtual reality in a broad sense.

In the present specification, the virtual reality system 1000 may provide, for example, a video game made in virtual reality (hereinafter referred to as a 'VR game') to a user (hereinafter referred to as a 'player 3').

1 is a block diagram of a virtual reality system 1000 according to an embodiment of the present specification, and FIG. 2 is a schematic diagram of a virtual reality system 1000 according to an embodiment of the present specification.

1 and 2, the virtual reality system 1000 includes a head mounted display (HMD 1100: Head-Mounted Display), a game controller 1200, an auxiliary computing device 1300, a positioning module 1400, It may include a display module 1500 , a marker 1700 , and a server 1600 .

The HMD 1100 is a device worn on the head of the player 3 and may function as an output interface for a user of a virtual reality service.

Mainly, the HMD 1100 may output visual information about the virtual environment, ie, a virtual image, to the player 3 . For example, the HMD 1100 may provide a 3D image to the player 3 through a stereoscopic display that outputs two images isolated from each other to both eyes of the wearer.

In addition, the HMD 1100 may include a speaker that selectively outputs a voice to output a voice related to the virtual environment to the wearer.

The HMD 1100 may function as a sensor for the wearer in addition to the above-described role as the output interface. For example, the HMD 1100 is equipped with a gyro sensor, an acceleration sensor, or the like, and the HMD 1100 can detect the movement of the user's head or the posture of the head using this.

In addition, a marker used for tracking the position, posture, and motion of the wearer's head by the positioning model of the virtual reality system 1000 may be installed on the exterior of the HMD 1100 .

The game controller 1200 functions as an input interface for a user of the virtual reality service.

The game controller 1200 is mainly provided in a stick shape or a gun shape as shown in FIG. 2 and can be gripped by the player 3 .

The game controller 1200 may include an operation button for receiving an operation of the player 3 . For example, the player 3 may fire a gun in the virtual space through an operation button of the game controller 1200 .

In addition, the game controller 1200 may include a gyro sensor or an acceleration sensor that detects the posture of the game controller 1200 adjusted according to the manipulation of the player 3 . For example, the player 3 may adjust the firing direction of the gun in the virtual space by adjusting the posture of the game controller 1200 .

In addition, a marker used for tracking the position, posture, motion, etc. of the game controller 1200 by the positioning model of the virtual reality system 1000 may be installed on the exterior of the game controller 1200 .

The positioning module 1400 may measure the position of the player 3 or the game controller 1200 in real space.

The virtual space in the VR game may be matched with the playground 1, which is a real space in which the VR game is performed. For example, in the real space, the player 3 plays the playground 1 on the When positioned, the virtual reality system 1000 sets the character (hereinafter referred to as 'player 3 character' or 'avatar') controlled by the player 3 to a virtual position corresponding to the position on the playground 1 in the virtual space. , or when the player 3 moves on the playground 1, the avatar can also be moved in the virtual space.

As such, the positioning module 1400 may position the player 3 or the game controller 1200 as basic information for the virtual reality system 1000 to process the avatar in the virtual space.

The positioning module 1400 may be, for example, a camera that tracks a marker installed in the player 3 in the playground 1 , the HMD 1100 , or the game controller 1200 . Here, the camera is a concept including all infrared cameras and thermal cameras, including RGB cameras, and the positioning module 1400 may be implemented in various forms other than the camera.

The positioning module 1400 may be installed in the structure 2 around which the playground 1 is disposed so as to have an angle suitable for imaging the player 3 in the playground 1 .

The auxiliary computing device 1300 and the server 1600 may perform various calculations and information processing for realizing virtual reality. For example, they process the various information detected by the positioning module 1400, the HMD 1100, and the game controller 1200 to determine the position, posture, motion, and motion of the player 3 or the game controller 1200, the player 3 The visual/auditory information that forms the virtual reality is generated by calculating the viewing angle of the .

1 and 2 , the auxiliary computing device 1300 and the server 1600 are illustrated as separate components, but in the virtual reality system 1000 , the auxiliary computing device 1300 is omitted and the auxiliary computing device 1300 is Functions may be integrated into the server 1600 or HMD 1100 .

However, in the VR game service, real-time audiovisual feedback may be important to improve immersion. When using wireless communication between the server 1600 and the HMD 1100, a delay time may occur, whereas the player 3 ) carried by the HMD 1100 and the auxiliary computing device 1300 capable of being connected by wire to generate a VR image or voice and transmit it to the HMD 1100 by wire, there may be an advantage that low-delay audiovisual feedback is possible.

Here, the auxiliary computing device 1300 , the server 1600 , or the HMD 1100 having an arithmetic function may include a controller, and in this specification, the controller is a chip or processor that executes a computer program, various arithmetic and information processing. It can be interpreted as encompassing not only a hardware form such as an electrical circuit capable of performing the above, but also a software form or a form in which hardware and software are combined.

Meanwhile, it should be noted that operations performed by the virtual reality system 1000 in the methods according to embodiments of the present specification to be described below may be understood to be performed under the control of the above-described controller unless otherwise specified.

The display module 1500 may output various information related to the VR game. The following are some representative examples of images that may be output by the display module 1500 .

For example, the display module 1500 may output a relay image for a VR game.

Here, the relay image may be an image provided for the audience 4 in the vicinity of the VR platform to enjoy the VR game.

For example, the relay image may be the same image as the image provided through the HMD 1100 of the player 3 . If there are a plurality of players 3, the relay image is an image provided to the HMD 1100 of any one player 3 among a plurality of players 3, or a video image provided to a plurality of players 3 It may be in a combined form.

As another example, the relay image may be an in-game image in a VR game different from the image provided to the player 3 . That is, an image captured by a virtual camera having a different position or angle from the virtual camera allocated to the player 3 in the VR space, that is, an image having a different FOV. Specifically, while the first-person FOV image is basically provided to the player 3 , the relay image may be an image captured in VR space from different positions and angles, such as a top view or a far view.

As another example, the relay image may be an image displaying meta information in a VR game. For example, the relay image includes a map containing the location or behavior of the player 3 or the players 3 , the player 3's score, stamina, display of various states including ranking, or the progress or remaining time of the game etc. may be displayed. In this case, it is also possible to provide a real image together. For example, a picture of the player 3 may be displayed together.

As another example, the relay image may include an image related to a seat in which the audience 3 is present or a relay crew relaying a VR game.

In addition, the relay image may be provided in the form of a combination of the above examples, and an additional advertisement or promotional image may be included in the relay image.

As another example, the display module 1500 may display information necessary for a manager to operate a VR game.

Here, the manager may mean a person in charge of operation of a VR service in a place-based VR platform such as a theme park. In general, when operating a place-based VR platform, there may be beginners who are unfamiliar with VR among the players (3). Ancillary services such as

In particular, in the case of children, the elderly who are unfamiliar with the game, or users with phobia of heights or claustrophobia, they cannot enjoy the VR service due to the immersion of VR or, in severe cases, feel anxiety or fear, and cause motion sickness or vomiting. It can be seen as one of the most important factors in VR service for the company to quickly identify the status of users of these VR services and respond accordingly.

The display module 1500 may provide the manager with information or instructions on the status of the player 3 currently using the VR service or the action required for the player 3 . Illustratively, the video for the manager includes visual information that reflects the start of the game, the progress of the game, the end of the game, etc., visual information that reflects whether the player 3 is requesting help, and the time or end of the game. The remaining time until , the number of players 3 currently playing, the type of game currently being played, etc. may be included.

The above-described display module 1500 may be installed as an electric billboard for the audience 4 to view the relay image. For example, the display module 1500 may be installed in the structure 2 around the playground 1 . Here, the structure may be provided in the form of a column surrounding the play ground 1 of a typical square shape. The display module 1500 may be mainly disposed toward the outside of the playground 1 in a form suitable for an audience around the playground 1 to view it. In addition, there may be a plurality of display modules 1500 , and the plurality of display modules 1500 are arranged at different positions in different directions with respect to the center of the playground 1 , and the audience 4 around the playground 1 . ) may be preferably arranged so that the display module 1500 can be viewed from as many different viewpoints as possible. Accordingly, when the playground 1 is mainly provided in a quadrangle, the display module 1500 may be installed in a structure positioned above the sides of each quadrangle to face the outside of the playground 1 .

When the display module 1500 outputs an image in the VR game as a relay image, the relay image may be selected in consideration of the installation location of the display module 1500 .

For example, a location of a virtual camera that captures an image in a VR game may be linked with a location of the display module 1500 . More specifically, the imaging direction of the virtual camera that captures the relay image displayed on the display module 1500 may correspond to the direction from the location where the display module 1500 is installed to the playground 1 in real space. . In addition, the imaging position of the virtual camera that captures the relay image displayed on the display module 1500 is the location where the display module 1500 is installed with respect to the playground 1 in real space and the virtual camera is located in the playground 1 in the virtual space. ) may correspond to an imaging position of the virtual camera with respect to a region in the virtual space corresponding to the . Here, it should be noted that the meaning of 'corresponding' does not necessarily mean the same thing. For example, the positional relationship between the center of the playground 1 and the display module 1500 may not be the same as the positional relationship between the center of the playground 1 and the virtual camera in the virtual space. However, the direction in which the display module 1500 is located from the center of the playground 1 and the direction in which the virtual camera is located from a point corresponding to the center of the playground 1 in the virtual space may be the same as or within a predetermined error range. there will be Accordingly, referring to FIG. 2 , the relay image output to the display module 1500 close to the audience 4 is directed toward the center of the playground 1 from the side closest to the audience 4 among the sides of the playground 1 . A virtual camera having the same/similar direction from the imaging position of the virtual camera to a point in the virtual space corresponding to the center of the playground 1 determines the point in the virtual space corresponding to the center of the playground 1. It is an image taken in the direction it faces, and the relay image output to the display module 1500 far from the audience 4 in FIG. 2 is one of the sides of the playground 1 that is far from the audience 4 A virtual camera in which the direction toward the center and the direction from the imaging position of the virtual camera to a point in the virtual space corresponding to the center of the playground 1 are identical/similar is the virtual space corresponding to the center of the playground 1 It may be an image captured in a direction toward a point within.

As such, when the display module 1500 outputs a relay image corresponding to the installation position of the display module 1500, the audience can watch the VR game with a more immersive feeling.

Alternatively, when there are a plurality of players 3 and a plurality of display modules 1500 , the display module 1500 may output a relay image corresponding to each player 3 . For example, it may be possible for each display module 1500 to output an image of the HMD 1100 of each player 3 . Alternatively, it may be an image captured by a virtual camera looking at each player 3 .

It should be noted that the relay images described above may be generated by the server 1600 and transmitted to the display module 1500 .

The marker 1700 may be provided as a means for recognizing the relative position of the flyground 1 to a smart device, a camera, or a sensor located outside the playground 1 .

In the present application, the audience 4 around the playground 1 can view the relayed image through the smart device 2000 . Here, as a representative example of the smart device 2000, a smart phone, a tablet, a laptop computer, etc. may be mentioned. In the present application, the smart device 2000 receives an image directly or indirectly from the server 1600, and outputs it to allow the audience 4 to visually watch the playground 1 or to install it around the playground 1 In addition to viewing the in-game image representing the VR space according to the display module 1500 , a separate relay image may be provided to the audience. Such an image may also be obtained using information transmitted from the server 1600 .

More specifically, when describing an image output by the smart device 2000 , as an example, the smart device 2000 may output examples of relay images described in relation to the display module 1500 as a relay image.

Alternatively, the smart device 2000 may output a relay image in the form of an augmented image in which a VR in-game image and a real image containing the playground 1 and the player 3 are combined. Specifically, the smart device 2000 shoots an image including the playground 1 and the player 3 using the camera of the smart device 2000, and receives the image in the VR space from the server 1600, An image obtained by combining the captured image on the real space and the received image on the virtual space may be generated, and the image may be output. The combined image may be, for example, an AR image. For example, the combined image may be an augmented image in which a region corresponding to the player 3 in the real image is replaced with an avatar in the virtual reality.

In order for the smart device 2000 to output the augmented image in the virtual space as a relay image, it is necessary to match the image captured by the smart device 2000 and the image captured by the virtual camera in the virtual space, so the virtual camera The location of the smart device 2000 needs to be determined in consideration of the location of the playground 1 . In addition, when the smart device 2000 outputs a VR image rather than an AR image, the position and FOV of the virtual camera are also A highly immersive image can be provided to the audience 4 only when it corresponds to the shooting point and the imaging FOV of the smart device 2000 in the real space.

As described above, the marker 1700 shows the shooting position/angle of the smart device 2000 and the relay image to be provided to the smart device 2000 when viewing the relay image through the smart device 2000 outside the playground 1 as described above. It can function as a component for matching the position/angle of the virtual camera that captures the .

Specifically, the marker 1700 may be installed on the structure 2 in a shape or pattern having a feature point that is easy to recognize from the outside. In FIG. 2 , the marker 1700 is illustrated as having a linear pattern extending along the pillars of the structure, but it is not necessarily limited thereto, and any shape or pattern having an externally recognizable image characteristic may be possible. .

The smart device 2000 determines the imaging position and posture relative to the playground 1 based on the orientation, size, and position of the marker 1700 included in the image obtained when imaging toward the playground 1. can For example, according to the direction of the pattern or shape of the marker 1700 included in the image captured by the smart device 2000, the smart device 2000 directly or the server 1600 determines the imaging angle for the playground 1 can receive the video and judge it in a similar way. For another example, the distance to the playground 1 may be known through the size of the markers 1700 or the distance between the markers 1700 .

On the other hand, as in FIG. 2 , if the playground 1 is provided as a polygon having multiple sides, the marker 1700 installed in each side direction includes a marker ( 1700 ) located on any side. 1700) may include visual indications reflecting cognition. Here, the visual indication may be a color of the marker 1700 as well as a specific pattern or feature point. Accordingly, the server 1600 or the smart device 2000 can determine the current imaging position and direction from the playground 1 according to the characteristics of the marker 1700 in the captured image.

Hereinafter, a method for generating a relay screen for a virtual reality game according to an embodiment of the present specification will be described. Although this method can be mainly applied to a virtual reality game, it should be noted in advance that it is not necessarily for a game.

Meanwhile, the operations performed in the following description should be understood as being performed by the virtual reality system 1000, particularly the server 1600, unless otherwise noted as being performed by other components or otherwise clear from the context. will be.

3 is a flowchart of an example of a method for generating a relay screen according to an embodiment of the present specification.

Referring to FIG. 3 , the method of generating a relay screen according to an embodiment of the present specification includes the steps of detecting the position of the audience 4 in the real space (S1100), and detecting the viewing angle of the audience 4 in the real space (S1150). , determining the camera position variable in the virtual space according to the position of the audience 4 in the real space (S1200), determining the camera posture variable in the virtual space according to the viewing angle of the audience 4 in the real space ( S1250), generating a virtual space image based on camera variables (S1300), and transmitting the virtual space image as a relay image (S1400) may include.

Hereinafter, each step of an example of the above-described method for generating a relay screen will be described with reference to FIGS. 4 to 8 .

4 is a diagram of an example of a real space in which a VR game is performed according to an embodiment of the present specification, FIG. 5 is a diagram of an example of a virtual space in which a VR game is performed according to an embodiment of the present specification, and FIG. 6 is an exemplary view of a player screen according to an embodiment of the present specification, and FIGS. 7 and 8 are diagrams related to examples of a relay screen according to an embodiment of the present specification.

First, the virtual reality system 1000 may detect the position of the audience 4 in the real space (S1100). Here, the audience 4 may mean a person who watches a VR game in the vicinity of the playground 1, and in this specification, the audience 4 is a player ( 3) may refer to a person who may watch a relay image through the actions or display module 1500, but who possesses the smart device 2000 and can view a relay image related to a VR game through the action.

In addition, the position of the audience 4 in the real space may be understood as a relative position with respect to the playground 1 . Exemplarily, the location of the audience 4 in the real space may mean a location from a point (eg, a center) of the playground 1 to a point where the audience 4 is. The position to the point where the audience 4 is located may be the center of the body or the eyes of the audience 4 , but may also be approximated and interpreted as the location of the smart device 2000 possessed by the audience 4 . .

A method of detecting the position of the audience 4 may be performed in various ways, and the following is a representative example thereof.

First, the camera of the smart device 2000 possessed by the audience 4 may photograph the playground 1 . The marker 1700 displayed on the structure 2 installed in the playground 1 may be photographed in the photographed image. By analyzing the size or direction of the marker 1700 , the location of the audience 4 from the playground 1 , and more specifically, the location of the smart device 2000 carried by the audience 4 may be calculated. After recognizing the marker 1700 in the captured image, calculating the position of the audience 4 through the properties (position, size, direction) of the recognized marker 1700 may be performed in the smart device 2000 Alternatively, the smart device 2000 transmits the image to the server 1600 so that the server 1600 may calculate the audience location.

On the other hand, the detection of the audience position with respect to the playground 1 does not necessarily have to be performed according to the above-described example. For example, it is also possible that the audience position detection is performed through the HMD 1100 , the game controller 1200 , or various markers attached to the body of the player 3 . As another example, the audience position detection may be performed through image recognition in a markerless method. Illustratively, a separate marker installed in the structure 2 using a deep learning algorithm that performs identification, detection, localization, or segmentation of an object from an image Instead of recognizing 1700 , it is also possible for the audience position detection to be performed through their detection through feature points of the structures 2 or playground 1 . Specifically, if the structure is recognized through an algorithm such as Yolo, the distance of the audience 4 to the playground 1 can be recognized through the size of the bounding box. In addition, the characteristic part (for example, vertex or corner, etc.) of the structure 2 is recognized through the transformation of the joint recognition artificial neural network, and the audience 4 for the playground 1 is based on the positional relationships of the corresponding features. ), it is also possible to analyze the relative position of Of course, it learns an end-to-end artificial neural network that receives an image and outputs the relative position of the audience 4 with respect to the playground 1 and uses it to learn the relative position of the audience directly from the image. It is also possible to calculate These techniques do not necessarily have to be applied only to image recognition of a markerless type, and may also be used to detect the position of an audience using the above-described marker 1700 . Meanwhile, the various operations described above may be performed by the server 1600 or the smart device 2000 .

Similar to detecting the position of the audience 4 , the virtual reality system 1000 may detect the viewing angle of the audience 4 in the virtual reality space ( S1150 ).

Here, the viewing angle of the audience 4 means the direction in which the audience 4 looks at the playground 1, and is roughly understood as the posture value of the smart device 2000 possessed by the audience 4 can be For example, when the audience 4 views the relay image through the smart device 2000, the smart device 2000 may provide an image of the virtual space corresponding to the view of the real space that the audience 4 actually sees with the naked eye. At this time, in order to ensure that the screen viewed by the audience 4 through the smart device 2000 matches the actual viewing angle of the playground 1 with the naked eye, the screen of the smart device 2000 is located in the area occupied by the audience. Displaying a virtual space corresponding to the real space covered by the screen of the real smart device 2000 may improve viewing immersion. Accordingly, the viewing angle of the audience 4 may be the viewing angle at which the audience 4 views the smart device 2000 , and in a typical relay scenario through the smart device 2000 , the viewer 4 views the smart device 2000 as the viewing angle. It may be placed between and the playground 1, and the audience 4 may view the smart device 2000, and accordingly, the viewing angle of the audience 4 may be in the display direction of the smart device 2000, that is, the smart device. Since it can be determined by the posture of 2000 , as a result, the viewing angle of the spectator 4 can be approximated to the posture of the smart device 2000 carried by the spectator 4 .

Accordingly, the smart device 2000 may obtain a posture value through an accelerometer or a gyro sensor mounted on the smart device 2000 and detect the viewing angle (or viewing range) of the audience 4 based on this.

Upon detecting the position and viewing angle of the audience 4 with respect to the playground 1 (here, it has been shown that the viewing angle can be interpreted as a viewing range, FOV, etc.), the virtual reality system 1000 provides the audience with this Various parameters related to a virtual camera in a virtual space for capturing a VR image to be performed may be calculated.

The virtual reality system 1000 may determine a camera position variable in the virtual space according to the position of the audience 4 in the real space ( S1200 ).

Specifically, when the server 1600 detects the relative position of the audience 4 from a point (mainly the center) of the playground 1 , it is calculated from a point on the virtual space corresponding to the one point of the playground 1 . A location located in a relative position may be set as an installation location (ie, an imaging location) of the virtual camera.

Next, the virtual reality system 1000 may determine the camera posture variable in the virtual space according to the viewing angle (viewing direction) of the audience 4 in the real space ( S1200 ).

Specifically, the server 1600 sets the posture parameter of the virtual camera so that the direction in which the audience 4 looks at the playground 1 is the direction in which the virtual camera looks at the area in the virtual space corresponding to the playground 1 . can be set.

When various parameters related to the virtual camera are determined, the virtual reality system 1000 may acquire a virtual space image to be used for relaying by imaging the virtual space through the virtual camera in consideration of the determination ( S1300 ). Here, the virtual space image does not necessarily have to be used as the relay image, and the relay image may be generated using the virtual space image according to various examples of using the virtual space image as the relay image.

When the relay image is generated, finally, the virtual reality system 1000 directly or indirectly transmits the relay image to the smart device 2000 ( S1400 ), and accordingly, the audience 4 relays it through the smart device 2000 . can be seen

Referring to FIG. 4 , the first audience 4a and the second audience 4b are watching the VR game relayed through the smart device 2000 around the playground 1 . At this time, since the first audience 4a and the second audience 4b are looking at the playground 1 from different points, even when relaying the virtual space image, considering the location of the audience 4, It is possible to improve audience immersion by providing a virtual space image in a form consistent with seeing reality as a relay image to the audience 4 .

Therefore, through the above-described method, as shown in FIG. 5 , the virtual camera for generating a relay image of the first audience 4a and the second audience 4b corresponds to the virtual camera corresponding to the playground 1 in the virtual space. The positional relationship from the playing area and the relative positional relationship that each audience 4 has with respect to the playground 1? They may be positioned so as to correspond to each other.

Meanwhile, FIG. 5 illustrates that a virtual camera corresponding to the display module 1500 is also disposed in a virtual space.

The virtual cameras arranged in this way may generate images as shown in FIGS. 7 and 8 , respectively.

The images of FIGS. 7 and 8 have the advantage of providing an effect as if the audience 4 enters the virtual space and actually watches a VR game in the virtual space. Accordingly, there is an advantage of providing a much higher level of immersion in viewing compared to providing an image viewed by the player 3 as a relay image as shown in FIG. 6 .

In addition, a specific audience 4 can move around the playground 1 or change the posture of the smart device 2000 to view the in-game video in the VR game at an angle and position that they want to see, allowing for more free viewing. may make it possible

At this time, various information necessary for viewing the game may be displayed on the electric sign board. For example, a screen as shown in FIG. 6 that is the screen of the player 3 is displayed by the display module 1500 or corresponding to the display module 1500 . An image captured by the virtual camera may be output.

In addition, in the smart device 2000, a mode conversion interface for switching each screen (eg, the screen of the player 3 and the imaging screen of the virtual camera generated in response to the smart device 2000) is implemented, and the audience 4 ), it is also possible to change the desired screen from time to time to watch. On the other hand, the audience 4 can watch the smart device 2000 while viewing the playground 1 with the naked eye while also referring to the actions of the players 3 in the real space, so that the interest in viewing the game can be improved. have.

The methods according to the embodiments of the present invention described above may be used alone or in combination with each other. Since each step described in the method according to the embodiment of the present invention is not essential, each method may be performed including all of the steps as well as only some of the steps. In addition, since the order in which each step is described is only for convenience of description, each step in the method described in the present invention does not necessarily have to be performed in the described order.

The above description is merely illustrative of the technical spirit of the present invention, and various modifications and variations will be possible without departing from the essential characteristics of the present invention by those skilled in the art to which the present invention pertains. Accordingly, the embodiments of the present invention described above may be implemented separately or in combination with each other.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

1: Playground 2: Structures
3: Player 4: Audience
1000: virtual reality system 1100: HMD
1200: game controller 1300: secondary computing device
1400: positioning module 1500: display module
1600: server 1700: marker
2000: smart device

Claims (7)

detecting a position of the audience in a real space with respect to the playground with respect to the audience around the playground where the VR game is performed;
setting a Kemera location variable in a virtual space in which the VR game is performed based on the location of the Kwak-Gak;
generating a virtual camera in the virtual space according to the camera position variable;
acquiring the virtual space image captured by the virtual camera; and
Transmitting a video relaying the virtual space image to a smart device possessed by the audience; including
A relay method for virtual reality games.
According to claim 1,
The setting of the position variable of the camera may include setting the camera position variable so that the positional relation of the audience with respect to the playground corresponds to the installation position relation of the virtual camera with respect to the area on the virtual space corresponding to the playground. to set
A relay method for virtual reality games.
According to claim 1,
Receiving the image captured by the smart device to include the playground; further comprising,
In the step of detecting the position of the audience, detecting the position of the audience based on the image
A relay method for virtual reality games.
4. The method of claim 3,
According to claim 3,
Detecting the position of the audience based on the shape of a structure installed around the playground or a marker provided on the structure included in the image; further comprising
A relay method for virtual reality games.
According to claim 1,
detecting visual field information of the audience in the real space;
Setting a camera posture variable in a virtual space in which the VR game is performed based on the visual field information of the audience; further comprising
A relay method for virtual reality games.
6. The method of claim 5,
The setting of the camera posture variable may include setting the camera posture variable so that the viewer's view of the playground and the virtual camera's view of the virtual space corresponding to the playground correspond to each other.
A relay method for virtual reality games.
6. The method of claim 5,
Receiving the posture information of the smart device that provides the relay image to the audience; further comprising,
In the step of detecting the visual field information of the audience, detecting the visual field information of the audience based on the posture information of the smart device
A relay method for virtual reality games.

Images