KR20200089872A - Method and apparatus for enhancing user experience space utilization which experiences virtual reality contents - Google Patents

Abstract

Provided are a method and device for enhancing utilization of experience space of a user experiencing virtual reality content. The method for enhancing utilization of experience space of the present invention comprises the steps of: obtaining information on experience space of a user for experiencing virtual reality content obtaining information on a motion of the user; determining a second direction alternative to a first direction of the user based on the information on the motion of the user and the information on the experience space; and providing the information on the determined second direction to the user. The first direction is a predetermined direction that the user has to move from a current location of the user.

Description

METHOD AND APPARATUS FOR ENHANCING USER EXPERIENCE SPACE UTILIZATION WHICH EXPERIENCES VIRTUAL REALITY CONTENTS}

The present invention relates to a method and apparatus for improving indoor space utilization of a user experiencing virtual reality content. More specifically, it relates to an apparatus and method using virtually expanding an actual space or adjusting the size of movement of an object on virtual reality content.

As the virtual reality content industry using HMD (Head Mounted Display) develops, interest in virtual reality content is increasing. For example, the demand for the virtual reality game itself is steadily increasing, and research on peripheral devices for playing the virtual reality game is continuing.

The output device of the virtual reality game is the most popular screen of the HMD. In addition, the input device includes a sensor mounted on the HMD, a joystick held by a user, and a treadmill.

For HMD screens, LCD or OLED are popular. There are cases where a projector or a large monitor is used, but it is generally not expensive for general users to build it because it is generally expensive, and is not popular, and security is weak.

In the case of commercial products, gyroscopes are generally installed. The user's viewpoint and movement information can be input through the built-in gyroscope. If it is not a commercial product, various sensors can be additionally installed.

Joysticks are input devices used to interact with objects in a virtual reality game. In addition, when there is no input device for movement of the user, such as a treadmill, it is also used as an input device for movement of the user. When the joystick is used as an input device for movement, the object in the virtual reality game can be used as a point to which the joystick points, which is instantaneously moved.

Treadmills are generally omnidirectional treadmills, but they are expensive and are limited in application to commercial games. Therefore, the treadmill may be applied to a specific purpose simulator or experience software.

For a virtual reality game, a separate device capable of providing infinite movement is required, but the reality is that most virtual reality game users are difficult to own. Therefore, virtual reality?? In order to build an environment for games, the majority of users need to target virtual reality games, mainly indoor spaces. In this case, there is a limit to infinitely providing virtual reality games in a narrow indoor space.

An object of the present invention is to provide a method and apparatus for improving indoor space utilization of a user experiencing virtual reality content.

In addition, an object of the present invention is to provide a method and apparatus for experiencing various operations of an object in a virtual reality content space at a user's actual space scale.

In addition, an object of the present invention is to provide a method and apparatus compatible with various games and capable of experiencing a virtual reality game similar to reality without advanced/expensive equipment.

According to the present invention, obtaining information about a user's experience space for experiencing virtual reality content; Obtaining information about the user's operation; Determining a second direction that replaces the first direction of the user based on information about the user's motion and information on an experience space; And providing information regarding the determined second direction to the user, wherein the first direction improves utilization of a user's experience space to experience virtual reality content, which is a predetermined direction to be moved from the current location of the user. Methods can be provided.

In the method for improving the utilization of the experience space according to the present invention, the information on the experience space of the user may include information on the boundary of the experience space to which the user can move.

In the method for improving the utilization of the experience space according to the present invention, the information on the user's motion may include at least one of the user's current position, direction of movement, speed, and action radius information of the motion performed by the user. .

In the method for improving the utilization of the experience space according to the present invention, the step of determining the second direction alternate to the first direction may include: determining whether the current location of the user is within a predetermined range at a boundary of the experience space; And determining a second direction that replaces the first direction according to the determination, and the second direction may be a direction toward a central location of the experience space.

In the method for improving the utilization of the experience space according to the present invention, the information regarding the second direction may include at least one of a switching angle and a switching direction of the second direction.

In the method for improving the utilization of the experience space according to the present invention, the information on the second direction may further include a corrected switching angle in the second direction based on a previously learned reaction angle of the user.

In addition, according to the present invention, obtaining information about a user's experience space for experiencing virtual reality content; Obtaining information about the user's operation; Distorting a virtual reality content screen displayed to the user based on information on the user's motion and information on an experience space; And providing the user with the distorted virtual reality content screen to the user.

In the method for improving the utilization of experience space according to the present invention, the step of distorting the virtual reality content screen may distort the virtual reality content screen regardless of whether the user currently performs a predetermined operation on the virtual reality content. It may include steps.

In addition, according to the present invention, obtaining information about a user's experience space for experiencing virtual reality content; Obtaining information about the user's operation; And adjusting the size of the operation performed by the object on the virtual reality content based on the information on the user's motion and the information on the experience space, and the object experiences corresponding to the user on the virtual reality content. A method for improving space utilization may be provided.

In the method for improving the utilization of the experience space according to the present invention, adjusting the size of an operation performed by an object on the virtual reality content may include: dividing the operation into a fixed operation and a moving operation; Determining a size magnification based on whether the divided fixed movement and movement movement occur; And adjusting the size of an operation performed by the object on the virtual reality content by applying the determined size magnification.

In addition, according to the present invention, in the apparatus for improving the experience space utilization of the user experiencing the virtual reality content, the device acquires information about the user's experience space for experiencing the virtual reality content, and the user's operation Acquiring information about the user, determining a second direction that replaces the first direction of the user based on information about the user's motion and information on an experience space, and providing the user with information about the determined second direction Characterized in that provided, the first direction may be provided with a user experience space utilization enhancement device for experiencing a virtual reality content that is a predetermined direction to be moved from the user's current location.

In the apparatus for improving the utilization of experience space according to the present invention, the information on the user's experience space may include information on the boundary of the experience space to which the user can move.

In the apparatus for improving the experience space utilization according to the present invention, the information on the user's motion may include at least one of the user's current position, direction of movement, speed, and action radius information of the motion performed by the user. .

In the experience space utilization enhancement apparatus according to the present invention, it is determined whether the current location of the user is within a predetermined range on the boundary of the experience space, and determines a second direction that replaces the first direction according to the determination, , The second direction may be a direction toward a central location of the experience space.

In the apparatus for improving the utilization of experience space according to the present invention, the information about the second direction may include at least one of a switching angle and a switching direction of the second direction.

In the experience space utilization improvement apparatus according to the present invention, the information on the second direction may further include a corrected switching angle in the second direction based on the user's previously learned reaction angle.

In addition, according to the present invention, in the apparatus for improving the experience space utilization of the user experiencing the virtual reality content, the device acquires information about the user's experience space for experiencing the virtual reality content, and the user's operation Obtaining information about the user, distorting the virtual reality content screen displayed to the user based on the user's motion information and experience space information, and providing the distorted virtual reality content screen to the user A device for improving the utilization of the experience space can be provided.

In the experience space utilization improvement apparatus according to the present invention, the virtual reality content screen may be distorted regardless of whether the user currently performs a predetermined operation on the virtual reality content.

In addition, according to the present invention, in the apparatus for improving the experience space utilization of the user experiencing the virtual reality content, the device acquires information about the user's experience space for experiencing the virtual reality content, and the user's operation Obtaining information, and adjusting the size of the operation performed by the object on the virtual reality content on the basis of the information about the user's motion and information on the experience space, the object on the virtual reality content An apparatus for improving the utilization of the experience space corresponding to the user may be provided.

In the experience space utilization improvement apparatus according to the present invention, the motion is divided into a fixed motion and a motion motion, and a size magnification is determined based on whether the divided fixed motion and the motion are generated, and the determined size magnification is applied. In this way, the size of the operation performed by the object on the virtual reality content may be controlled.

The features briefly summarized above with respect to the present disclosure are merely illustrative aspects of the detailed description of the present disclosure described below, and do not limit the scope of the present disclosure.

According to the present invention, a method and apparatus for improving indoor space utilization of a user experiencing virtual reality content may be provided.

In addition, according to the present invention, a method and apparatus capable of experiencing various operations of an object in a virtual reality content space at a user's actual space scale may be provided.

In addition, according to the present invention, a method and apparatus that can be compatible with various games and can experience a virtual reality game similar to reality without advanced/expensive equipment can be provided.

1 is a view showing an interface environment for experiencing virtual reality content according to an embodiment of the present invention.
2 is a view showing a user's spatial recognition process in an environment for providing virtual reality content according to an embodiment of the present invention.
3 is a diagram illustrating a process of recognizing a user's radius of action in an environment in which virtual reality content is provided according to an embodiment of the present invention.
4 is a diagram illustrating a process of virtually expanding a real space using rotation of a space scale according to an embodiment of the present invention.
5 is a view showing the operation of the spatial scale rotation method according to an embodiment of the present invention.
6 is a diagram illustrating an operation of a method for distorting a user's movement direction according to an embodiment of the present invention.
7 is a diagram illustrating a system for improving the utilization of indoor space by a user experiencing virtual reality content according to an embodiment of the present invention.
8 is a diagram illustrating the movement of an object on a virtual reality content space according to an embodiment of the present invention.
9 is a flowchart illustrating a process of setting an action scaling method according to an embodiment of the present invention.
10 is a flowchart illustrating an operation process of an action scaling method according to an embodiment of the present invention.
11 is a diagram illustrating an operation of an apparatus for improving indoor space utilization in an extended form including deep learning according to an embodiment of the present invention.
12 is a flowchart illustrating a method for improving the utilization of the experience space of a user who experiences virtual reality content according to an embodiment of the present invention.

The present invention can be applied to various changes and can have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In the drawings, similar reference numerals refer to the same or similar functions across various aspects. The shape and size of elements in the drawings may be exaggerated for a clearer explanation. For detailed description of exemplary embodiments described below, reference is made to the accompanying drawings that illustrate specific embodiments as examples. These embodiments are described in detail enough to enable those skilled in the art to practice the embodiments. It should be understood that the various embodiments are different, but need not be mutually exclusive. For example, the specific shapes, structures, and properties described herein can be implemented in other embodiments without departing from the spirit and scope of the invention in relation to one embodiment. In addition, it should be understood that the location or placement of individual components within each disclosed embodiment can be changed without departing from the spirit and scope of the embodiment. Therefore, the following detailed description is not intended to be taken in a limiting sense, and the scope of exemplary embodiments, if appropriately described, is limited only by the appended claims, along with all ranges equivalent to those claimed.

In the present invention, terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from other components. For example, the first component may be referred to as a second component without departing from the scope of the present invention, and similarly, the second component may be referred to as a first component. The term and/or includes a combination of a plurality of related described items or any one of a plurality of related described items.

When a component of the present invention is said to be “connected” or “connected” to another component, it may be directly connected to or connected to the other component, but other components may exist in the middle. It should be understood that it may. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

The components shown in the embodiments of the present invention are shown independently to indicate different characteristic functions, and do not mean that each component is composed of separate hardware or one software component. That is, for convenience of description, each component is listed and included as each component, and at least two components of each component are combined to form one component, or one component is divided into a plurality of components to perform a function. The integrated and separated embodiments of the components are also included in the scope of the present invention without departing from the essence of the present invention.

The terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present invention, terms such as “include” or “have” are intended to indicate that there are features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, and one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance. That is, in the present invention, description of “including” a specific configuration does not exclude a configuration other than the corresponding configuration, and means that an additional configuration may be included in the scope of the present invention or the technical spirit of the present invention.

Some of the components of the present invention are not essential components for performing essential functions in the present invention, but may be optional components for improving performance. The present invention can be implemented by including only components necessary for realizing the essence of the present invention, except components used for performance improvement, and structures including only essential components excluding optional components used for performance improvement. Also included in the scope of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In describing the embodiments of the present specification, when it is determined that detailed descriptions of related well-known configurations or functions may obscure the subject matter of the present specification, detailed descriptions thereof will be omitted, and the same reference numerals will be used for the same components in the drawings. Used and duplicate description of the same components is omitted.

1 is a view showing an interface environment for experiencing virtual reality content according to an embodiment of the present invention.

Referring to FIG. 1, in the case of a treadmill-based virtual reality game environment as shown in FIG. 1 (a), a user may infinitely move an object in a virtual reality game while changing directions in all directions. On the other hand, in the case of a general virtual reality game environment as shown in FIG. 1 (b), since there is no treadmill, the user can move an object in the virtual reality game using a joystick. In this case, the object in the virtual reality game may move to the point where the joystick points.

According to an embodiment of the present invention, it is possible to control the movement of objects in the virtual reality targeting the game environment of FIG. 1 (b), which is more popular and has high user accessibility. At this time, a method and apparatus in which a user's actual movement is reflected in a game as well as a method in which an object in a virtual reality game moves instantaneously may be provided.

2 is a view showing a user's spatial recognition process in an environment for providing virtual reality content according to an embodiment of the present invention.

The user 200 may hold the joystick 202 while wearing the HMD and recognize the outer or boundary of a space that the user can move. For example, the virtual line 210 displayed on the space in FIG. 2 may indicate a boundary in space perceived by the user. Meanwhile, if the space for a user to experience virtual reality content is an indoor space, the virtual line 210 may be in the form of a closed curve 212 on a plan view.

3 is a diagram illustrating a process of recognizing a user's radius of action in an environment in which virtual reality content is provided according to an embodiment of the present invention.

The user 300 may recognize the radius of action of the user. Specifically, the user 300 may recognize the radius of the user's action using a virtual reality controller such as a joystick 302 on the user's current location. For example, the virtual line 310 displayed around the user 300 in FIG. 3 may indicate the perceived radius of action by the user moving the joystick 302 in place. On the other hand, in the above-described plan view in Figure 2, the radius of action of the user may be displayed in the form of a circular closed curve 312. The closed curve 314 surrounding the circular closed curve 312 may represent a spatial boundary perceived by the user described in FIG. 2.

The user may perform the above-described process in FIG. 3 after performing the above-described process in FIG. 2. In addition, the user may first perform the above-described process in FIG. 3 and then perform the above-described process in FIG. 2.

In order to play a virtual reality game, a separate device capable of providing infinite movement, such as a treadmill device, is required, and it is a reality that most virtual reality game users have difficulty in providing the separate device. Therefore, it is necessary to build an environment for a virtual reality game targeting the space itself where users experience the virtual reality game. In this case, since most of the experience space is limited in space, it is difficult to provide a seamless virtual reality game environment to the user.

The above-described processes of FIGS. 2 and 3 are spatial recognition and user behavior radius recognition processes basically supported in the virtual reality system. On the other hand, if the experience space has been determined using the virtual reality software supporting the above process, the user will be able to move only within the designated virtual space.

Therefore, recently, a method of increasing space utilization has emerged by giving a distortion that a user cannot perceive between a user's actual movement and an object movement in a virtual reality game. However, the method also has a limitation that requires a considerable amount of space for distortion that the user cannot sense.

According to an embodiment of the present invention, a method and apparatus for adaptively distorting a virtual reality game environment according to a user's experience space may be provided. The method and apparatus may reflect motion/motion and motion/movement of the user in a very narrow room to motion/motion and motion of an object in a virtual reality game. The adaptive distortion method may include a distortion method that expands space utilization as much as possible even if the user experiences some distortion, or a method of expanding space utilization while reducing distortion experienced by the user.

According to an embodiment of the present invention, when using virtual reality content in limited space, a method and apparatus for virtually expanding a real space using space-scale rotation and/or user movement direction distortion suitable for the content can be provided. have.

In addition, when an event is activated near the boundary of the real space and the user is performing a detailed motion, an object on the virtual reality content so that the user is not disturbed by'rotation' or'distortion' until the event ends. You can adjust the scale of the movement. By making the adjustment, it is possible to prevent the user from colliding with the boundary on the actual space.

4 is a diagram illustrating a process of virtually expanding a real space using rotation of a space scale according to an embodiment of the present invention.

According to an embodiment of the present invention, the space scale rotation method moves the user in the moving direction when the user reaches the boundary in the real space while the user moves in the real space to move the object on the virtual reality content in a specific direction. It may mean a method of inducing to move or rotate in a predetermined direction different from. At this time, even if the user moves in the predetermined direction, the object on the virtual reality content may be continuously moved in the specific direction. For example, the predetermined direction may mean a vertical direction of a boundary surface in real space, a direction opposite to a direction in which the user moved when reaching the boundary in real space, or a direction toward a predetermined position in real space. have. The predefined position may be a position located in the center of the actual space.

The object may refer to a target object displayed by reflecting a user's motion on a virtual reality content space. For example, in the case of a virtual reality game, the object may mean a game player, a user avatar, or the like. The virtual reality content space may refer to a space in which an object exists on the virtual reality content. In addition, the real space may mean an experience space where a user using virtual reality content can actually be located.

Referring to FIG. 4, it is assumed that the size of the virtual reality content space 400 is twice the size of the real space 410, and the object 402 on the virtual reality content space 400 is in the first' direction 404. Suppose that the user 412 moves in the first direction 414 to move to. Since the real space 410 is mostly limited in size, before the object 402 reaches a specific location on the virtual reality content space 400 that the user 412 wants, the user 412 can access the real space ( 410) The boundary of the phase can be reached. At this time, the user 412 may be induced to move in the second direction 416, which is opposite to the first direction 414, on the actual space 410, and the user 412 moves in the second direction 416. Even if it moves, the object 402 on the virtual reality content space 400 continues to move in the first' direction 406. As a result, the object 402 may be moved to a specific location on the virtual reality content space 400 desired by the user 412.

The space-scale rotation can infinitely expand a real space with a limited size. On the other hand, the rotation of the spatial scale may momentarily disconnect the flow of the virtual reality content run by the user. The spatial scale rotation may be called'discrete reversal inducement'. The spatial scale rotation will be described in more detail later with reference to FIG. 5.

5 is a view showing the operation of the spatial scale rotation method according to an embodiment of the present invention.

To move an object in the virtual reality content space to a specific location, a user in the real space 500 is ordered from location 0 510 to location 1 512, location 2 514, location 3 516 Let's say you are moving. As the user moves from the 0th position 510 to the 3rd position 516, the boundary on the real space 500 is reached, so that the user is no longer able to move in the first direction 520. Accordingly, according to the present invention, by using the above-described spatial scale rotation, the user can move in the second direction 522 by replacing the first direction. At this time, the object on the virtual reality content space may continue to move to the specific location.

According to an embodiment of the present invention, rotation and direction change of the user may be induced by providing a navigating turn signal through the HMD to the user. The direction change signal may include a direction change angle.

In addition, the direction change signal may be provided in consideration of when the user is not performing a predetermined action (action in an event), that is, when the user has room.

In addition, when the direction change signal is provided to the user, the switching angle may be determined so that the user can move while securing a larger space. For example, referring to FIG. 5, when the user needs to continuously move from the 3rd position 516, a direction change signal can be provided to move to the 0th position 510.

In addition, a user's reaction angle according to an angle to be switched can be learned, and a corrected value can be provided according to the learning. For example, if the switching angle provided to the user is 45 degrees, there may be a user turning 30 degrees and a user turning 60 degrees. In this case, it is possible to provide an appropriate corrected switching angle to each user.

As a result, according to an embodiment of the present invention, even if the user experiences distortion of the path, active distortion may be attempted by providing a redirection signal to experience virtual reality content in a narrow space. In addition, the actual response angle for each user according to each angle may be learned and a corrected value may be provided accordingly. The present invention may include a motion prediction system based on user behavior pattern learning, such as discrete reversal rotation, to provide the above-described learning function.

6 is a diagram illustrating an operation of a method for distorting a user's movement direction according to an embodiment of the present invention.

According to an embodiment of the present invention, the user movement direction distortion method may mean a method of inducing the user's movement by distorting the virtual reality content screen displayed to the user. The user movement direction distortion may be referred to as'Continuous distortion inducement'. The user movement direction distortion may induce the user's movement while maintaining the flow of virtual reality content.

The user movement direction distortion method may continuously distort the movement direction so that the user does not feel a heterogeneity such as a disconnection of the progress flow while experiencing the virtual reality content.

In addition, while the spatial scale rotation method provides a switching signal to the user, the user movement direction distortion method can distort the environment on the virtual reality content.

Further, the environment on the virtual reality content can be continuously distorted regardless of whether the user is performing a predetermined operation. For example, the distortion method of the user's movement direction distorts the virtual reality content projected through the HMD little by little, so that a discrete rotation may interfere with the performance of the virtual reality game. Can be increased.

Referring to FIG. 6, in order to move an object on a virtual reality content space to a specific location, a user on the physical space 600 is positioned at position 0 610, position 1 612, position 2 614, and position 3 Suppose that we move to position 616 in order. As the user moves from position 0 610 to position 3 616, the boundary on the actual space 600 is reached. Therefore, by distorting the virtual reality content screen displayed to the user, the user alternates with the movement to the 1st position 612, the 2nd position 614, the 3rd position 616, and the 1st position 612, 2' It can move to the position 614, the 3'position 616.

As described above with reference to FIGS. 4 to 6, the actual space may be virtually expanded using spatial scale rotation and/or distortion of a user's movement direction.

On the other hand, in the case of the space scale rotation method, it may be necessary to inform the user of the rotation direction and angle through the interface on the virtual reality content, and to change the direction after the user recognizes it. Therefore, when an urgent situation such as an event is activated on the virtual reality content, the spatial rotation should not occur. In addition, a time margin may be required for an event in the virtual reality content when the end of the boundary in real space is reached. In addition, a user's motion may be difficult to recognize in the vicinity of the boundary in the real space.

Therefore, according to an embodiment of the present invention, a predetermined device for analyzing characteristics of virtual reality content may be included. For example, it may include a predetermined device for analyzing a game flow for each virtual reality game or for each genre. In addition, it may include a learning model that predicts and corresponds to the occurrence of detailed special situations for each game. The learning model may be linked to a motion prediction system based on the user behavior pattern learning described above in FIG. 5, and it is possible to prevent a case in which an event in virtual reality content occurs when a user reaches a boundary in a real space. If an event in the virtual reality content occurs near the boundary in the real space, action scaling may be applied.

According to an embodiment of the present invention, the scale of object motion on virtual reality content may be adjusted (action scaling). For example, when a predetermined event is activated near the boundary in the real space and the user is performing a detailed operation, the virtual is so that the user is not disturbed by'rotation' or'distortion' until the event is completed. The size of object movement on the real content can be adjusted. Therefore, by making the adjustment, it is possible to prevent the user from colliding with the boundary on the actual space.

The target of the application of action scaling may include a user's movement and a user's movement in a stationary state (for example, movement of a hand and/or foot, etc.).

On the other hand, in the case of an open world game, the avatar can move the virtual reality game space in a massive in-game space using a “instantaneous move” method, a “vehicle or other means of transportation” or a “walk”. At this time, the action scaling of the present invention is applied to an open world game capable of long distance movement and the like, and can be utilized to reduce user fatigue. Table 1 shows the scale of a typical open world game environment.

Open world games Square measure GTA5 256 km2 World of Warcraft 604 km2 Just Cause 2 923 km2 Final fantasy 15 5,000 km2

In addition, action scaling may be operated while the user is experiencing virtual reality content. For example, action scaling can always work while the user is playing a virtual reality game.

7 is a diagram illustrating a system for improving the utilization of indoor space by a user experiencing virtual reality content according to an embodiment of the present invention.

The apparatus 700 for improving indoor space utilization may include a user behavior control unit 710, a user behavior prediction unit 720, and/or a content flow prediction unit 730. The indoor space utilization enhancement apparatus 700 may function as a scalable VR user behavior controller. In addition, the user behavior control unit 710 may function as a user behavior scale manager. In addition, the content flow predictor may function as a game flow predictor. Also, the user action control unit 710 may include a user action manager (712) and/or a user movement/direction manager (714). Also, the user movement and direction manager 714 may perform a spatial scale rotation method and/or a user movement direction distortion method. Meanwhile, the apparatus 700 for improving indoor space utilization may include at least one output device (eg, HMD) and/or at least one input device (eg, joystick).

Meanwhile, the apparatus 700 for improving indoor space utilization may further include an additional apparatus for extracting specific information from virtual reality content. The specific information may be information necessary for the indoor space utilization improving apparatus 700 to operate. For example, the specific information includes map information in the virtual reality content (instance map information), the geographic location of the object (avatar) on the virtual reality content, the current direction/velocity of the object, and the validity of the event being performed by the object It may include a radius, an action radius of an action being performed by the object, and the like.

The additional device may acquire the information from the virtual reality content or, if it is impossible to extract, through learning while experiencing the virtual reality content. The apparatus 700 for improving indoor space utilization of the present invention may use the above information as an input parameter.

8 is a diagram illustrating the movement of an object on a virtual reality content space according to an embodiment of the present invention.

Referring to FIG. 8, a plurality of virtual spaces (indicated by dotted lines) having the same size as the experience space 800 based on the actual experience space 800 of the user experiencing the virtual reality content is displayed in the experience space 800 ) Around. In addition, a map 806 on virtual reality content may be displayed on the experience space 800 and the surrounding virtual space. For example, a boundary portion of the virtual game map 806 may be displayed in a curved form on the experience space 800 and the surrounding virtual space.

In addition, for an object on virtual reality content, a range of action radius (812) of the object may be displayed on the experience space 800 and the surrounding virtual space. For example, the fixed action may include actions such as swinging a fist, kicking, and jumping in place.

The radius range of the fixed action may be set based on the fixed action having the largest motion radius among the fixed actions. For example, if the kick of the fixed action is the action having the largest operating radius, the radius 812 of the fixed action in FIG. 8 may mean an operating radius for the kick.

In order to change the object on the virtual reality content to a predetermined position, the user 810 experiencing the virtual reality content must move from the current first location 820 (geographical location) to the second location 822 (actual direction & speed). Let's say. In order to move from the first location 820 to the second location 822, the user 810 must move away from the experience space 800 to a predetermined virtual space 802, but due to the limitations of the actual space, the experience space 800 ).

According to one embodiment of the present invention, when the user 810 approaches the boundary 804 near the boundary of the experience space 800 while moving from the first location 820 to the second location 822, the spatial scale rotation Can be induced. Referring to FIG. 8, the user 810 may be induced to change or rotate the direction from the vicinity 804 of the experience space 800 to the inside of the experience space 800. At this time, the object on the virtual reality content may continue to advance to the predetermined position without changing the direction. Referring to FIG. 8, the above-described operation is expressed as the user moving from the experience space 800 to the virtual space 802.

According to another embodiment of the present invention, when a user moves a relatively long distance without performing a separate event, scaling of the movement action may be performed. By performing the scaling, it is possible to minimize the number of rotations or rotations that occur near the boundary of the experience space. For example, moving action scaling may mean scaling for the moving action itself. Referring to FIG. 8, movement action scaling may be performed while the user 810 moves from the first location 820 to the second location 822. For example, the user can adjust the scaling factor by moving 10 cm in order for the object on the virtual reality content to move 1 m.

According to another embodiment of the present invention, while the user 810 is moving from the first location 820 to the second location 822, distortion of the moving direction may be induced. Referring to FIG. 8, when a user 810 moves from a first location 820 to a second location 822, a predetermined event occurs in the vicinity of the second location 822 by game flow prediction When it is predicted that will occur, the user 810 may be induced to move to a wide space (for example, a scaled-distortion performed direction & speed) 824 of the experience space before the predetermined event occurs. Can. At this time, the object on the virtual reality content may continue to advance to the predetermined position without changing the direction. Referring to FIG. 8, the above-described operation is expressed as the user moving from the experience space 800 to the virtual space 802.

On the other hand, when the prediction that a certain event will occur to the user is incorrect or when it is difficult to predict the occurrence of a certain event, an arbitrary event may occur near the boundary of the experience space before the method of distortion of the moving direction is induced. In this case, according to an embodiment of the present invention, fixed action scaling may be performed. For example, by applying scaling to the user's fixed action behavior, a user's collision or fall may be prevented. At this time, the actual action detection interval of the user may be shortened or the sensitivity of the sensor may be increased. For example, the sensor may determine that the user's fist has moved 1 cm. The sensor may determine that the user's fist has moved 10 cm. Therefore, even with less movement of the user, the user can recognize the fixed action of swinging the fist and reflect it in the movement of the object on the virtual reality content.

Referring to FIG. 8, by using a method of rotating the space scale, distorting a moving direction, scaling a fixed/moving action, and the like, the user 810 experiences the experience space 800 in order to change an object on the virtual reality content to a predetermined position. ), instead of moving on the two virtual spaces 802 and 806, it can move on the experience space 800 and one virtual space 802. In addition, it is possible to reduce the number of executions, such as rotation, that prevents the user 810 from playing.

9 is a flowchart illustrating a process of setting an action scaling method according to an embodiment of the present invention.

The fixed action may mean operations that can be performed without changing the user's position, such as an action of swinging a fist, kicking, or jumping in place. In addition, the movement action may mean the act of the user moving itself.

When the VR game software starts (S901), fixed motions used in the game are detected (S902). In addition, the VR device is connected (S903), and user space information is loaded from the VR device (S904).

In addition, it may be determined whether fixed action scaling is necessary (S905).

If it is determined that the fixed action scaling is necessary, the fixed action magnification may be set (S906).

In addition, it may be determined whether or not movement action scaling is necessary (S907).

If it is determined that movement action scaling is necessary or if it is determined that fixed action scaling is not required, the movement action magnification may be set (S908).

If the movement action magnification is set or it is determined that the movement action scaling is not necessary, the action scaling is ended (S909).

The operations of steps S905 to S909 may be repeated. For example, the operations of steps S905 to S909 may be repeated every predetermined period. Therefore, the fixed motion magnification and/or the moving motion magnification may be changed for each of the predetermined periods.

10 is a flowchart illustrating an operation process of an action scaling method according to an embodiment of the present invention.

Action scaling is performed during the game (S1001).

The maximum fixed action radius in consideration of the maximum fixed action (for example, kick motion) distance at which the magnification is set may be set (S1002).

It is determined whether the set maximum fixed action radius is outside the user's actual space range (S1003).

If it is determined that the set maximum fixed action radius is outside the user's actual space range, it is determined whether there is a large movement of the user within a predetermined time (S1004).

If it is determined that there is a large movement of the user within a predetermined time or if the event object is nearby, a high magnification action may be applied (S1005). Also, a caution message may be overlaid on the display screen.

If it is determined that there is no large movement of the user within a predetermined time, it is determined whether the event object is nearby (S1006).

If it is determined that the event object is not nearby, a process of deriving the user's location from the real space to the center may be performed (S1007). In addition, a navigator leading to the center can be displayed on the display screen.

11 is a diagram illustrating an operation of an apparatus for improving indoor space utilization in an extended form including deep learning according to an embodiment of the present invention. At this time, the indoor space utilization improvement device may function as a game type-driven scalable user behavior controller.

The device for improving indoor space utilization may include a PPO algorithm for game flow prediction (eg, game flow predictor), a PPO algorithm for user movement prediction (eg, user movement predictor), or user action prediction (eg, user action) and an action classification algorithm for predictors.

The PPO algorithm is a reinforcement learning algorithm developed for the purpose of increasing the stability of the algorithm, and can perform policy optimization while limiting excessive changes. In addition, the PPO algorithm may not add excessive changes to the existing policy through interaction with environmental factors. Therefore, it can be used to predict the near future behavior of the object or user avatar that changes in response to the interaction in the virtual reality content environment. Moreover, in the case of games, since the interaction variables between objects are often fixed or the maximum number is determined, the PPO algorithm may be suitable as a method for predicting movement and action of objects in the game. The PPO algorithm can be used to optimize the behavior policy of objects in the game. In addition, the PPO algorithm is applied to predict the movement of the user avatar to measure the location on the game map where the game will proceed immediately. Therefore, it can serve to support the operation of the space utilization method and apparatus of the present invention.

In addition, the action classification algorithm is a deep learning-based algorithm that determines which action the user is currently performing among motions (not related to movement) of the avatar supported by the game. The action classification algorithm may be utilized to secure a safe distance from an actual space boundary in consideration of the radius of the user's fixed movement at a distance traveled by the user. Compared to the PPO algorithm, the action classification algorithm can perform action-oriented real-time motion prediction provided by the game at a relatively fast computation speed using a lighter deep learning based network. For example, in the process of the user operating the 360-degree rotation by raising the arm by 90 degrees, the action classification algorithm may detect that the 360-degree rotation is started in preparation for the user to raise the arm by 90 degrees. At this time, if there is not enough space for the user to act, the user may be prompted with a warning message and forcibly apply urgent action scaling. At this time, the action scaling may apply a method of guiding the space remaining to the actual boundary, or a system in which the motion is auto-casted after being linked by simply raising the arm.

Meanwhile, according to an embodiment of the present invention, various types of input information may be processed or reproduced. For example, it is possible to receive input from HMD, joystick, as well as more accurate input from an improved sensor, eye tracking information, and the like. The game flow prediction unit or the user behavior prediction unit may improve the accuracy of the user movement prediction using the high-level input information.

When an HMD capable of providing eye tracking information as input information is used, the present invention can improve the accuracy of distinguishing the user's intended sudden rotation motion from the motion caused by spatial scale rotation. For example, if the HMD display overlays the rotation by the spatial scale rotation method, until the user completes the direction change, the user may be able to rotate while the gaze is maintained at the center. . On the other hand, when the pupil of the user faces with the rotation of the HMD in the direction to be rotated, it can be determined as the intended movement of the user.

According to an embodiment of the present invention, the indoor space utilization enhancement system may include at least one output device (eg, HMD) and/or at least one input device (eg, joystick).

The input device may include a sensor that can provide more accurate information, a device that provides eye tracking information, and the like. The game flow prediction unit or the user behavior prediction unit may improve the accuracy of the user movement prediction using the high-level input information.

The apparatus 700 for improving indoor space utilization may receive information about the current actual direction/speed of the user and the action radius of a predetermined motion from the input device.

The space scale rotation method can be optimized to operate when there are no adjacent game events.

The game flow prediction unit may operate as a game analyzer when it is possible to extract predetermined information from a running game. The game flow predicting unit may classify or extract the information of the game map in which the user avatar in the game is located and the geographic location of the user avatar based on deep learning.

The apparatus 700 for improving indoor space utilization may synchronize the location and/or movement of an avatar in a virtual reality space based on the received information.

Based on the received information, the game flow predicting unit may predict a change in a situation of a game event that the avatar is progressing or will perform soon using a PPO algorithm.

The user behavior predicting unit may recognize the action of the avatar that matches the actual action of the current user through the motion information of the user received from the input device and the user action classification based on deep learning.

In addition, the user behavior prediction unit may predict a change in a user's movement and direction using the recognized information.

In addition, the user behavior prediction unit may recognize the action radius of the currently in progress action or the action class expected as the next action based on the PPO algorithm.

The apparatus 700 for improving indoor space utilization may periodically track information such as a user's current direction, speed, and action action radius in order to prevent collisions, falls, and major game events from occurring in the vicinity of an actual space boundary. In addition, the apparatus 700 for improving indoor space utilization may derive the user's location into a free space in the actual space based on information on a change in the situation of a game event, user's motion and avatar's motion information, and user's motion information. .

In addition, the indoor space utilization enhancement apparatus 700 may relatively minimize motion of an object by applying action scaling at a high magnification when a game event occurs in the vicinity of the boundary in the real space. In addition, the minimized movement can be maintained until the event ends. Here, the higher the magnification applied to the action scaling, the relatively small the motion of the object may be.

The game flow predicting unit may apply action scaling to user movement when a user's movement amount is continuously very large or when an adjacent event is not detected.

The PPO algorithm for game flow prediction, user movement prediction, or user action prediction after user action classification may collect input information by sampling the game output screen while the user is playing.

The PPO algorithm for user behavior prediction (movement/action prediction) or game flow prediction can be learned using sampled game output screens when the user ends play.

Referring to FIG. 11, a user behavior predictor (move/action prediction) may independently predict user behavior or predict user behavior together with a game flow predictor.

In addition, referring to FIG. 11, the game flow predictor may predict an independent game event or a game event together with a user behavior predictor (movement/action prediction).

The game flow predictor may include a specific game-oriented prediction when receiving in-game event information. In addition, the game flow predictor may include a predictor (for example, a PPO algorithm) based on deep learning for each game type or genre when the in-game event information is not provided.

The operation interval of the object in the virtual reality game may be game-oriented or adaptive for each object (eg, in response to a change in a game event or user action). The apparatus 700 for improving indoor space utilization may receive operation information of the object.

12 is a flowchart illustrating a method for improving the utilization of the experience space of a user experiencing virtual reality content according to an embodiment of the present invention.

Referring to FIG. 12, information on a user's experience space for experiencing virtual reality content may be obtained (S1201 ).

Meanwhile, the information on the user's experience space may include information on the boundary of the experience space to which the user can move.

In addition, it is possible to obtain information about the user's operation (S1202).

Meanwhile, the information about the user's motion may include at least one of the user's current position, direction of movement, speed, and action radius information of the motion performed by the user.

In addition, the second direction alternates with the first direction of the user may be determined based on the information on the user's motion and the information on the experience space (S1203).

For example, it is possible to determine whether the current location of the user is within a predetermined range at the boundary of the experience space, and determine a second direction to replace the first direction according to the determination.

In addition, information on the determined second direction may be provided to the user (S1204).

Meanwhile, the first direction may be a predetermined direction to be moved from the current location of the user.

Meanwhile, the second direction may be a direction toward a central location of the experience space. Further, the information on the second direction may include at least one of a switching angle and a switching direction of the second direction. Further, the information regarding the second direction may include a corrected switching angle in the second direction based on the user's previously learned reaction angle.

According to an embodiment of the present invention, obtaining information about a user's experience space for experiencing virtual reality content, obtaining information about the user's motion, and information about the user's motion and experience The method may include distorting a virtual reality content screen displayed to the user based on information on space and providing the distorted virtual reality content screen to the user.

Meanwhile, the step of distorting the virtual reality content screen may include distorting the virtual reality content screen regardless of whether the user currently performs a predetermined operation on the virtual reality content.

In addition, according to an embodiment of the present invention, obtaining information about a user's experience space for experiencing virtual reality content, obtaining information about the user's motion, and information about the user's motion And adjusting the size of an operation performed by the object on the virtual reality content based on the information on the experience space, and the object may correspond to the user on the virtual reality content.

On the other hand, the step of adjusting the size of the operation performed by the object on the virtual reality content, the step of dividing the operation into a fixed operation and a moving operation, the size magnification based on whether the divided fixed operation and whether the movement occurs And determining the size of an operation performed by the object on the virtual reality content by applying the determined size magnification.

According to the present invention, a method and apparatus for improving indoor space utilization of a user experiencing virtual reality content may be provided.

In addition, according to the present invention, a method and apparatus capable of experiencing various operations of an object in a virtual reality content space at a user's actual space scale may be provided.

In addition, according to the present invention, a method and apparatus that can be compatible with various games and can experience a virtual reality game similar to reality without advanced/expensive equipment can be provided.

In addition, according to the present invention, not only a virtual reality game that can be experienced in a limited space using an existing teleportation method or a movement point selection method, but also a number of real movements without limitation in a vast virtual space such as a virtual reality open world game can be performed. A method and apparatus for experiencing a game or the like in a real space scale of a user may be provided.

Also, according to the present invention, it can be applied to a general game that is not dedicated to virtual reality.

Further, according to the present invention, a method and apparatus capable of playing an open world game in a limited indoor space without collision and falling, while minimizing interference in performing a main event may be provided.

In the above-described embodiments, the methods are described based on a flow chart as a series of steps or units, but the present invention is not limited to the order of steps, and some steps may occur in a different order or simultaneously with other steps as described above. Can be. In addition, those of ordinary skill in the art may recognize that the steps shown in the flowcharts are not exclusive, other steps may be included, or one or more steps in the flowchart may be deleted without affecting the scope of the present invention. You will understand.

The above-described embodiment includes examples of various aspects. It is not possible to describe all possible combinations for representing various aspects, but those skilled in the art will recognize that other combinations are possible. Accordingly, the present invention will be said to include all other replacements, modifications and changes that fall within the scope of the following claims.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and can be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, or the like alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention or may be known and available to those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs, DVDs, and magneto-optical media such as floptical disks. media), and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

In the above, the present invention has been described by specific embodiments, such as specific components, and limited embodiments and drawings, which are provided to help the overall understanding of the present invention, but the present invention is not limited to the above embodiments , Those skilled in the art to which the present invention pertains can make various modifications and variations from these descriptions.

Accordingly, the spirit of the present invention is not limited to the above-described embodiment, and should not be determined, and all claims that are equally or equivalently modified as well as the claims below will fall within the scope of the spirit of the present invention. Would say

Claims (20)

Obtaining information about a user's experience space for experiencing virtual reality content;
Obtaining information about the user's operation;
Determining a second direction that replaces the first direction of the user based on information about the user's motion and information on an experience space; And
And providing the user with the determined second direction information,
The first direction is a method for improving a user's experience space utilization to experience virtual reality content, which is a predetermined direction to be moved from the user's current location. According to claim 1,
Information about the user's experience space,
A method for improving utilization of an experience space including information on a boundary of an experience space to which the user can move. According to claim 1,
Information about the user's operation,
A method for improving the utilization of an experience space, comprising at least one of the current position of the user, a moving direction, a speed, and action radius information of a motion performed by the user. According to claim 1,
Determining a second direction to replace the first direction,
Determining whether the current location of the user is within a predetermined range at a boundary of the experience space; And
And determining a second direction that replaces the first direction according to the determination,
The second direction is a method for improving the utilization of the experience space, which is a direction toward a central position of the experience space. According to claim 1,
The information about the second direction,
A method for improving the utilization of an experience space including at least one of a switching angle and a switching direction in the second direction. The method of claim 5,
The information about the second direction,
Method for improving the utilization of the experience space further comprising a corrected switching angle in the second direction based on the user's previously learned reaction angle. Obtaining information about a user's experience space for experiencing virtual reality content;
Obtaining information about the user's operation;
Distorting a virtual reality content screen displayed to the user based on information on the user's motion and information on an experience space; And
And providing the distorted virtual reality content screen to the user. The method of claim 7,
Distorting the virtual reality content screen,
And distorting the screen of the virtual reality content regardless of whether the user currently performs a predetermined operation on the virtual reality content. Obtaining information about a user's experience space for experiencing virtual reality content;
Obtaining information about the user's operation; And
And adjusting the size of the operation performed by the object on the virtual reality content based on the information on the user's motion and the information on the experience space,
The object is a method for improving utilization of an experience space corresponding to the user on the virtual reality content. The method of claim 9,
Adjusting the size of the operation performed by the object on the virtual reality content,
Dividing the operation into a fixed operation and a moving operation;
Determining a size magnification based on whether the divided fixed movement and movement movement occur; And
And adjusting the size of an operation performed by the object on the virtual reality content by applying the determined size magnification. In the device for improving the utilization of the experience space of users who experience virtual reality content,
The device,
Acquiring information about a user's experience space to experience virtual reality content, obtaining information about the user's motion, and based on information about the user's motion and information on the experience space, the user's first And determining a second direction to replace the direction, and providing the user with information on the determined second direction,
The first direction is a user experience space utilization enhancement device for experiencing virtual reality content, which is a predetermined direction to be moved from the current location of the user. The method of claim 11,
Information about the user's experience space,
An apparatus for improving the utilization of an experience space including information on a boundary of an experience space to which the user can move. The method of claim 11,
Information about the user's operation,
An apparatus for improving the experience space utilization, comprising at least one of the current position of the user, a moving direction, a speed, and action radius information of an operation performed by the user. The method of claim 11,
It is determined whether the current location of the user is within a predetermined range at the boundary of the experience space, and a second direction is replaced with the first direction according to the determination,
The second direction is a device for improving the utilization of the experience space, which is a direction toward a central position of the experience space. The method of claim 11,
The information about the second direction,
A device for improving an experience space utilization, comprising at least one of a switching angle and a switching direction in the second direction. The method of claim 15,
The information about the second direction,
The experience space utilization enhancement apparatus further comprising a corrected switching angle in the second direction based on the user's previously learned reaction angle. In the device for improving the utilization of the experience space of users who experience virtual reality content,
The device,
Acquiring information about a user's experience space for experiencing virtual reality content, obtaining information about the user's motion, and being displayed to the user based on information about the user's motion and information on the experience space An apparatus for improving the utilization of an experience space, characterized in that the virtual reality content screen is distorted and the distorted virtual reality content screen is provided to the user. The method of claim 17,
An apparatus for improving an experience space utilization that distorts the virtual reality content screen regardless of whether the user currently performs a predetermined operation on the virtual reality content. In the device for improving the utilization of the experience space of users who experience virtual reality content,
The device,
Obtain information about a user's experience space for experiencing virtual reality content, obtain information about the user's motion, and object on the virtual reality content based on information about the user's motion and information about the experience space It characterized in that to adjust the size of the operation performed,
The object is an experience space utilization enhancement device corresponding to the user on the virtual reality content. The method of claim 19,
The operation is divided into a fixed operation and a movement operation, a size magnification is determined based on whether the divided fixed operation and the movement operation occur, and the determined size magnification is applied to perform an operation performed by the object on the virtual reality content. A device that improves the utilization of the experience space to resize.

Images