JP2017142816A - Synchronization server and synchronization method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable synchronization of user states suitable for a virtual reality space.SOLUTION: A synchronization server comprises: a user state acquisition unit that acquires first user state information including a position and visual line direction of a first user in a virtual reality space from a first terminal corresponding to the first user, and acquires second user state information including a position of a second user in the virtual reality space from a second terminal corresponding to the second user; a distance calculation unit that calculates a distance between the first user and the second user in the virtual reality space using the position of the first user included in the first user state information and the position of the second user included in the second user state information; a synchronization frequency determination unit that determines a synchronization frequency with respect to a user state of the second user on the basis of the calculated distance between the first user and the second user and of the visual line direction of the first user included in the first user state information; and a user state delivery unit that delivers the second user state information to the first terminal at the determined synchronization frequency.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a synchronization server and a synchronization method. In particular, the present invention relates to a synchronization server and synchronization method for synchronizing user states in a virtual reality space.

  For example, Patent Document 1 discloses a technique for synchronizing a user's state in an online game.

Japanese Patent Laying-Open No. 2015-205203

  Conventionally, as shown in FIG. 10, synchronization of a user state is performed based on a distance between a certain user (player character) and another user to be synchronized. For example, in FIG. 10, the synchronization with the user in the first area where the distance from the player character is close is performed with the highest frequency, and the synchronization with the user in the second area where the distance from the player character is medium. The synchronization with the user in the third area far from the player character is performed at the lowest frequency.

  What is needed is a more suitable method for synchronizing user states in virtual reality space.

  The present invention has been made in view of the above points, and one of its purposes is to enable synchronization of user states suitable for a virtual reality space.

  In order to solve the above-described problem, one aspect of the present invention is a synchronization server for synchronizing user states in a virtual reality space including a first user and a second user, the first server corresponding to the first user. The first user state information including the position and the line-of-sight direction of the first user in the virtual reality space is acquired from one terminal, and the second user in the virtual reality space is acquired from the second terminal corresponding to the second user. A user status acquisition unit that acquires second user status information including a user location, a location of the first user included in the first user status information, and a location of the second user included in the second user status information A distance calculating unit that calculates a distance between the first user and the second user in the virtual reality space, and the calculated distance between the first user and the second user, A synchronization frequency determining unit that determines a synchronization frequency related to the user status of the second user based on the line-of-sight direction of the first user included in the first user status information; and the second frequency with the determined synchronization frequency. A user status distribution unit that distributes user status information to the first terminal.

  Another aspect of the present invention is a synchronization method executed by a synchronization server to synchronize a user state in a virtual reality space including a first user and a second user, and corresponds to the first user. Acquiring from the first terminal first user state information including the position and line-of-sight direction of the first user in the virtual reality space; and from the second terminal corresponding to the second user in the virtual reality space. Obtaining second user status information including the location of the second user; location of the first user included in the first user status information; and location of the second user included in the second user status information. And calculating a distance between the first user and the second user in the virtual reality space, and between the calculated first user and the second user And a step of determining a synchronization frequency related to the user state of the second user based on the separation direction and the line-of-sight direction of the first user included in the first user state information, and the second synchronization frequency with the determined synchronization frequency Delivering user state information to the first terminal.

  According to the present invention, it is possible to synchronize user states suitable for a virtual reality space.

1 is a diagram showing a schematic configuration of an online game system 10 according to an embodiment of the present invention. It is a hardware block diagram of the game terminal 100 which concerns on one Embodiment of this invention. It is a block diagram which shows the functional structure of the image generation apparatus 200 which concerns on one Embodiment of this invention. A movement of a user's head is typically shown. It is a hardware block diagram of the synchronous server 300 which concerns on one Embodiment of this invention. It is a block diagram which shows the functional structure of the synchronous server 300 which concerns on one Embodiment of this invention. The delivery frequency of the user status information from the synchronization server 300 is shown conceptually. It is a flowchart which shows operation | movement of the synchronous server 300 which concerns on one Embodiment of this invention. It is a modification of the delivery frequency of user status information. The delivery frequency of the user status information in the past is conceptually shown.

[Description of Embodiment of the Present Invention]
First, the contents of the embodiment of the present invention will be listed and described. One embodiment of the present invention has the following configuration.

  (Item 1) A synchronization server for synchronizing user states in a virtual reality space including a first user and a second user, from a first terminal corresponding to the first user, the first in the virtual reality space First user state information including a user position and a line-of-sight direction is acquired, and second user state information including a position of the second user in the virtual reality space is acquired from a second terminal corresponding to the second user. The first state in the virtual reality space using a user state acquisition unit that performs, a position of the first user included in the first user state information, and a position of the second user included in the second user state information. A distance calculating unit that calculates a distance between the user and the second user, the calculated distance between the first user and the second user, and the first user status information including the first A synchronization frequency determination unit that determines a synchronization frequency related to the user status of the second user based on a user's line-of-sight direction, and a user that distributes the second user status information to the first terminal at the determined synchronization frequency A synchronization server comprising a state distribution unit.

  (Item 2) When the second user exists in a predetermined angle range including the line-of-sight direction of the first user in the virtual reality space, the synchronization frequency determination unit sets the synchronization frequency high, and The synchronization server according to item 1, wherein the synchronization frequency is set low when the second user exists outside the predetermined angle range in the real space.

  (Item 3) The synchronization frequency determination unit exists in the virtual reality space within a predetermined angle range in which the second user includes the line-of-sight direction of the first user and closer than a predetermined distance from the first user. The synchronization frequency is set high, and the synchronization frequency is set low when the second user is within the predetermined angle range and far from the predetermined distance in the virtual reality space. 1. The synchronization server according to 1.

  (Item 4) The synchronization frequency determination unit exists in the virtual reality space within a predetermined angle range in which the second user includes the line-of-sight direction of the first user and closer than a predetermined distance from the first user. The synchronization frequency is set to a first frequency, and when the second user exists in the virtual reality space within the predetermined angle range and further than the predetermined distance, the synchronization frequency is set to the first frequency. A second frequency lower than one frequency is set, and when the second user exists outside the predetermined angle range in the virtual reality space, the synchronization frequency is set to a third frequency lower than the first frequency. The synchronization server according to Item 1.

  (Item 5) The predetermined angle range including the line-of-sight direction of the first user is a range wider than the field of view of the first user in the virtual reality space, according to any one of items 2 to 4. Sync server.

  (Item 6) The synchronization server according to any one of items 2 to 5, wherein the predetermined angle range in the horizontal direction of the virtual reality space is wider than the predetermined angle range in the vertical direction of the virtual reality space. .

  (Item 7) A synchronization method executed by a synchronization server to synchronize a user state in a virtual reality space including a first user and a second user, from the first terminal corresponding to the first user, to the virtual Obtaining the first user state information including the position and line-of-sight direction of the first user in the real space; and the position of the second user in the virtual reality space from the second terminal corresponding to the second user. The virtual reality using the step of acquiring the second user state information including the position of the first user included in the first user state information and the position of the second user included in the second user state information Calculating a distance between the first user and the second user in space, the calculated distance between the first user and the second user, and the first user. Determining a synchronization frequency related to the user status of the second user based on the line-of-sight direction of the first user included in the status information; and the second user status information with the determined synchronization frequency. Delivering to one terminal.

[Details of the embodiment of the present invention]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing a schematic configuration of an online game system 10 according to an embodiment of the present invention. The online game system 10 includes a first game terminal 100a and a second game terminal 100b respectively used by a first user 101a and a second user 101b who play an online game, and a synchronization server that controls synchronization of user states in the online game 300. The first game terminal 100a, the second game terminal 100b, and the synchronization server 300 are connected via the network 105 so that they can communicate with each other. The network 105 may be any type of network such as the Internet or a LAN (Local Area Network). Although only two users 101a and 101b playing an online game are shown in FIG. 1, an arbitrary number of users greater than two can participate in the online game, in which case the online game system 10 may include any number of similar gaming terminals each used by any number of these users.

  The online game provided by the online game system 10 is a type of game that is played by each user wearing a head mounted display (hereinafter referred to as HMD) on the head. The first game terminal 100a includes an HMD 120a and an image generation device 200a. The image generation device 200a generates an online game image to be presented to the first user 101a and causes the generated online game image to be displayed on the HMD 120a. Similarly, the second game terminal 100b includes an HMD 120b and an image generation device 200b. The image generation device 200b generates an online game image to be presented to the second user 101b, and the generated online game image is displayed. It is displayed on the HMD 120b.

  The online game image presented to each user is an image expressed in virtual reality space. As an example, assume a role-playing game in which a player (user) captures various quests on a field constructed as a virtual reality space. In such an online game, users advance the game while cooperating with each other or hostile. For example, the first user 101a and the second user 101b are positioned facing each other on the field in the virtual reality space, and see the scene of the field including the appearance of the other party. In this case, a virtual reality online game image including the appearance of the second user 101b is presented to the first user 101a, and a virtual reality online game including the appearance of the first user 101a is presented to the second user 101b. An image is presented. Thereby, each user (101a, 101b) who has seen the online game image displayed on the HMD (120a, 120b) can experience the online game in the virtual reality space.

  FIG. 2 is a hardware configuration diagram of the game terminal 100 according to an embodiment of the present invention. The game terminal 100 corresponds to each of the first game terminal 100a and the second game terminal 100b shown in FIG. As described above, the game terminal 100 includes the HMD 120 and the image generation device 200. For example, the HMD 120 and the image generation apparatus 200 are electrically connected by a wired cable 150 and can communicate with each other. Instead of the wired cable 150, a wireless connection may be used.

  The HMD 120 is a display device that is used by being worn on the head of the user 101. The HMD 120 includes a display 122 and a sensor 126. The HMD 120 may further include a speaker (headphone) (not shown).

  The display 122 is configured to present an online game image to the field of view of the user 101 wearing the HMD 120. For example, the display 122 can be configured as a non-transmissive display. In this case, the external scene of the HMD 120 is blocked from the view of the user 101, and only the online game image displayed on the display 122 is delivered to the user 101. As described above, the online game image is a virtual reality space image obtained by imaging a virtual reality space (a world created by a computer game). For example, online game images can be generated using computer graphics.

  The sensor 126 is a sensor for detecting in which direction the head of the user 101 wearing the HMD 120 is facing. As the sensor 126, for example, any one of a magnetic sensor, an angular velocity sensor, an acceleration sensor, or a combination thereof may be used. When the sensor 126 is a magnetic sensor, an angular velocity sensor, or an acceleration sensor, the sensor 126 is built in the HMD 120 and outputs a value (magnetism, angular velocity, or acceleration value) corresponding to the direction or movement of the HMD 120. By processing the output value from the sensor 126 by an appropriate method, the head orientation of the user 101 wearing the HMD 120 is calculated. The orientation of the head of the user 101 may be used to change the display image of the display 122 so as to follow the movement when the user 101 moves the head. For example, when the user 101 turns his head to the right (or left, up, down), the display 122 displays a virtual scene in the right (or left, up, down) direction of the user in the virtual reality space. It may be.

  Note that a sensor provided outside the HMD 120 may be applied as the sensor 126. For example, the sensor 126 may be an infrared sensor installed at a fixed position in the room that is separate from the HMD 120. By detecting an infrared light emitter or infrared reflection marker provided on the surface of the HMD 120 using this infrared sensor, the head direction of the user 101 wearing the HMD 120 can be specified. This type of sensor 126 is sometimes referred to as a position tracking sensor.

  The image generation device 200 is a device for generating an image displayed on the HMD 120. The image generation apparatus 200 includes at least a processor 202, a memory 204, a user input interface 206, and a communication interface 208. The image generation device 200 can be realized as, for example, a personal computer, a game console, a smartphone, a tablet terminal, or the like.

  The memory 204 stores at least an operating system and an image generation program. The operating system is a computer program for controlling the overall operation of the image generation apparatus 200. The image generation program is a computer program for the image generation apparatus 200 to realize each function of image generation processing described later. The memory 204 can also store data generated by the operation of the image generating apparatus 200 temporarily or permanently. Specific examples of the memory 204 include a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, a flash memory, and an optical disk.

  The processor 202 is configured to read a program stored in the memory 204 and execute processing according to the program. When the processor 202 executes an image generation program stored in the memory 204, each function of image generation processing described later is realized. The processor 202 includes a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit).

  The user input interface 206 is configured to receive an input for operating the image generation device 200 from a user of the game terminal 100. Specific examples of the user input interface 206 are a game controller, a touch pad, a mouse, a keyboard, and the like.

  The communication interface 208 is a network interface for communicating with other devices via a network. For example, the image generation device 200a of the first game terminal 100a and the image generation device 200b of the second game terminal 100b shown in FIG. 1 communicate with the synchronization server 300 via the network 105 using the respective communication interfaces 208. .

  FIG. 3 is a block diagram showing a functional configuration of the image generation apparatus 200 according to an embodiment of the present invention. The image generation device 200 includes a storage unit 220 and a processing unit 230. The processing unit 230 further includes an image generation unit 231, a user status transmission unit 232, a user status reception unit 233, and an image output unit 234. The storage unit 220 corresponds to the memory 204 shown in FIG. The processing unit 230 and the units 231 to 234 included in the processing unit 230 represent functions of image generation processing realized by the processor 202 illustrated in FIG. 1 reading out and executing the image generation program in the memory 204.

  The image generation unit 231 generates an online game image to be displayed on the HMD 120. For example, the image generation unit 231 acquires predetermined data from the storage unit 220 and generates an online game image by computer graphics processing based on the acquired data. As an example, the image generation unit 231 generates an online game image that allows the user 101 wearing the HMD 120 to recognize a virtual reality space based on a computer game. An online game image based on virtual reality represents a scene that a user can see in an online game field constructed as a virtual reality space. For example, the online game image generated by the image generation unit 231 includes an object (avatar) representing another user with whom the user 101 is playing an online game together. Online game images are also game characters such as NPC (non-player character) that appear in online games, landscapes such as buildings and trees, interior furniture and wall interiors, items falling on the ground, and user operations A variety of other objects may be included, such as a body part (hand or foot) of an avatar (self), or an object (gun or sword) that the avatar has in hand. Data necessary for generating an online game image, such as the arrangement position, shape, and color of each object constituting the virtual reality space, is stored in the storage unit 220 as virtual reality space configuration information 221. The image generation unit 231 generates an online game image expressed by such a virtual reality space based on the virtual reality space configuration information 221 acquired from the storage unit 220.

  The image generation unit 231 may change the image based on the output value from the sensor 126. For example, the online game image generated by the image generation unit 231 is an image that shows how the user's field of view in the virtual reality space changes following the movement of the head of the user 101 indicated by the output value from the sensor 126. It may be. As an example, FIG. 4 schematically illustrates the movement of the user's head. As shown in the figure, the axis connecting the center of the head of the user 101 and the center of the HMD 120 (the center of the screen of the display 122) is the Z axis, the axis connecting the center of the head of the user 101 and the top is the Y axis, and the user 101 An axis that passes through the center of the head and is orthogonal to the Y axis and the Z axis is taken as the X axis. When the sensor 126 is, for example, an angular velocity sensor, the sensor 126 outputs angular velocity values of the pitch angle around the X axis, the yaw angle around the Y axis, and the roll angle around the Z axis. The image generation unit 231 changes the online game image based on the output values of these angular velocities, that is, the direction of the head of the user 101. For example, when the user 101 turns his head to the right, the yaw angle around the Y axis changes. The image generation unit 231 changes the online game image so that a scene in the right direction of the user is projected in the virtual reality space in accordance with the change in the angular velocity value of the Y axis.

  The image generation unit 231 may change the image based on the position of the user. For example, when the user walks around in the virtual reality space of the online game, the online game image generated by the image generation unit 231 may be an image representing a sight seen from a position where the user is currently standing in the virtual reality space. As an example, the user's temporal position information in the virtual reality space is stored in the storage unit 220. The image generation unit 231 acquires position information immediately before the user in the virtual reality space from the storage unit 220. Also, from the user input interface 206 such as a game controller, an instruction of the user's moving direction and moving speed is input as an operation input for the user to walk around in the virtual reality space. Based on the position information immediately before the user acquired from the storage unit 220 and the information on the moving direction and moving speed of the user input from the user input interface 206, the image generating unit 231 displays the current user's position in the virtual reality space. Calculate the position. Based on the calculated current position of the user, the image generation unit 231 changes the online game image so that the user's field of view changes as the user walks in the virtual reality space.

  In this way, the image generation unit 231 generates an online game image corresponding to the user's position and head orientation in the virtual reality space. The generated online game image is output to the HMD 120 via the image output unit 239 and displayed on the display 122. As a result, the user 101 can see a virtual scene that exists in the direction in which the head is directed from the place where the user is currently standing in the virtual reality space of the online game.

  The user status transmission unit 232 transmits user status information regarding the user of the game terminal 100 to the synchronization server 300 via the network 105. The user status information is information indicating where and where the user is looking in the virtual reality space of the online game. As an example, the user state information includes the current position and the head direction of the user 101 in the virtual reality space. For example, the user state transmission unit 232 acquires the user position and head orientation in the virtual reality space used by the image generation unit 231 to generate the online game image from the image generation unit 231 and uses them as user state information. It may be sent. The orientation of the user's head in the virtual reality space includes at least the user's line-of-sight direction. The user's line-of-sight direction is the direction along the Z axis shown in FIG. 4 and corresponds to the direction of the screen center of the online game image displayed on the display 122 of the HMD 120.

  The user status receiving unit 233 receives user status information regarding other users who are playing the online game together from the synchronization server 300 via the network 105. For example, as shown in FIG. 1, when two users 101a and 101b are participating in an online game, the user state receiving unit 233 of the first game terminal 100a uses the second game terminal 100b. User status information regarding the two users 101b, that is, information on the current position and line-of-sight direction of the second user 101b in the virtual reality space of the online game is received from the synchronization server 300. Similarly, the user status receiving unit 233 of the second game terminal 100b displays the user status information regarding the first user 101a using the first game terminal 100a, that is, the current position of the first user 101a in the virtual reality space of the online game. And information on the line-of-sight direction are received from the synchronization server 300.

  The user status information of another user received by the user status receiving unit 233 is used to determine how to arrange the other user's avatar in the online game image in the image generation processing by the image generation unit 231. Used. For example, the image generation unit 231 of the first game terminal 100a has an avatar representing the second user 101b in the virtual reality space of the online game based on the user position and the line-of-sight direction included in the user state information of the second user 101b. An online game image arranged in the position and orientation is generated. Similarly, the image generation unit 231 of the second game terminal 100b is an online game in which the avatar of the first user 101a is arranged in the position and orientation specified by the user state information of the first user 101a in the virtual reality space of the online game. Generate an image.

  As will be described later, user status information is distributed from the synchronization server 300 at a frequency corresponding to the positional relationship of the users in the virtual reality space. For the user who acquired the user state information from the synchronization server 300, the image generation unit 231 arranges the user's avatar in the online game image based on the user state information as described above. On the other hand, for a user whose user status information has not been provided from the synchronization server 300 at a certain point in time, the image generation unit 231 generates an online game image using the user status information acquired in the past of the user. In other words, the position and orientation of the avatar included in the online game image are updated only for the avatar for which the user status information is distributed from the synchronization server 300, and the avatar for which the user status information is not distributed is not updated.

  FIG. 5 is a hardware configuration diagram of the synchronization server 300 according to an embodiment of the present invention. The synchronization server 300 includes at least a processor 302, a memory 304, and a communication interface 308. The memory 304 stores at least an operating system and a synchronization processing program. The operating system is a computer program for controlling the overall operation of the synchronization server 300. The synchronization processing program is a computer program for the synchronization server 300 to realize each function of synchronization processing described later. The processor 302 is configured to read a program stored in the memory 304 and execute processing according to the program. When the processor 302 executes the synchronization processing program stored in the memory 304, each function of synchronization processing described later is realized. The communication interface 308 is a network interface for communicating with other devices via a network.

  FIG. 6 is a block diagram showing a functional configuration of the synchronization server 300 according to an embodiment of the present invention. The synchronization server 300 includes a storage unit 320 and a processing unit 330. The processing unit 330 further includes a user state acquisition unit 331, a synchronization frequency determination unit 332, and a user state distribution unit 333. The storage unit 320 corresponds to the memory 304 shown in FIG. The processing unit 330 and the respective units 331 to 333 included in the processing unit 330 are realized by the processor 302 shown in FIG. 5 by reading out and executing the synchronization processing program in the memory 304. Represents a function.

  The user state acquisition unit 331 acquires user state information from each game terminal (first game terminal 100 a and second game terminal 100 b) of the online game system 10 via the network 105. For example, the user status information is transmitted from each game terminal (user status transmission unit 232) at a predetermined periodic timing. The user status information is acquired by the user status acquisition unit 331 and stored in the storage unit 320. Thus, the latest user status information of each user participating in the online game is constantly updated and held in the synchronization server 300.

  The synchronization frequency determination unit 332 uses the user state information collected in the storage unit 320 to determine the frequency with which the user state information related to users of other game terminals is distributed to the game terminal. For example, the synchronization frequency determination unit 332 determines the frequency of distributing the user state information regarding the second user 101b to the first game terminal 100a, the distance between the first user 101a and the second user 101b in the virtual reality space, and the virtual reality space. Is determined based on the line-of-sight direction of the first user 101a. In addition, the synchronization frequency determination unit 332 determines the frequency of distributing the user state information regarding the first user 101a to the second game terminal 100b, the distance between the first user 101a and the second user 101b in the virtual reality space, and the virtual reality space. It determines based on the gaze direction of the 2nd user 101b. When the online game system 10 includes N (> 2) game terminals, the synchronization frequency determination unit 332 similarly determines the distribution frequency of the user state information between any two parties. A specific example of a method for determining the frequency of distributing the user state information based on the user distance and the line-of-sight direction in the virtual reality space will be described later.

  The user state distribution unit 333 distributes the user state information to the game terminal with the distribution frequency determined by the synchronization frequency determination unit 332. The distributed user status information is received by each game terminal (user status receiving unit 233) and used in the online game image generation process as described above.

  FIG. 7 conceptually shows the distribution frequency of the user status information from the synchronization server 300. In FIG. 7, the user U 1 exists in the virtual reality space 510 of the online game, and the user U j (where j = 2, 3, 4,...) Exists around the user U 1 in the virtual reality space 510. doing. The user U 1 corresponds to the first user 101a described above, and the user U j corresponds to the second user 101b. A partial area 520 in the virtual reality space 510 represents the field of view of the user U 1. The field of view 520 of the user U 1 is a region in an angular range centered on the Z axis (see FIG. 4) that is the direction of the line of sight of the user U 1 in the virtual reality space 510. On the HMD 120a of the first game terminal 100a corresponding to the user U 1 (first user 101a), an online game image representing a scene in which the range of the field of view 520 is viewed from the position of the user U 1 in the virtual reality space 510 is displayed. The

  In FIG. 7, there are users U 2, U 3, U 4, U 5, U 6, U 7, U 8, and U 9 in the field of view 520 of the user U 1. Among these users, the users U 2 and U 3 are located in the near-field-of-view area 520a, the users U 4 and U 5 are located in the mid-field-of-view area 520b, and the users U 6 to U 9 are It is located in the far field 520c within the visual field. The near-field-of-view area 520a is an area in the field of view 520 of the user U 1 in the virtual reality space 510, and is an area where the distance from the user U 1 is closer than the first threshold distance D 1. The intra-field intermediate distance area 520b is an area in the visual field 520 of the user U 1 in the virtual reality space 510, and the distance from the user U 1 is between the first threshold distance D 1 and the second threshold distance D 2. It is a certain area. The far-field-in-view region 520c is a region in the field of view 520 of the user U 1 in the virtual reality space 510 and is a region farther from the user U 1 than the second threshold distance D 2. Further, in FIG. 7, another user U j (j ≧ 10) is located in the out-of-view area 530. The out-of-view area 530 is an area outside the view 520 of the user U 1 in the virtual reality space 510.

  For the user arrangement in the virtual reality space 510 as shown in FIG. 7, the synchronization frequency determination unit 332 of the synchronization server 300 sets the distribution frequency of the user state information for each area of the virtual reality space 510. That is, the synchronization frequency determination unit 332 sets the first distribution frequency f 1 for the users U 2 and U 3 existing in the visual field short distance area 520a and exists in the visual field middle distance area 520b. The second distribution frequency f 2 is set for the users U 4 and U 5 who are currently in operation, and the third distribution frequency f 3 is set for the users U 6 to U 9 existing in the far field within the visual field 520c. The fourth distribution frequency f 4 is set for the user U j (j ≧ 10) existing in the out-of-view area 530.

As an example, each distribution frequency may be set as follows.
f 1 = f 2 = f 3> f 4 (Formula 1)
In this case, the user state information of the users U 2 to U 9 in the visual field 520 of the user U 1 in the virtual reality space 510 of the online game is the first game terminal 100a of the user U 1 from the synchronization server 300 with high frequency f 1. The user state information of the user U j (j ≧ 10) outside the field of view 520 of the user U 1 is transmitted from the synchronization server 300 to the first game terminal 100a of the user U 1 with a low frequency f 4 (<f 1). be delivered. As a result, the online game image displayed on the HMD 120a of the first game terminal 100a is updated frequently with the state (position and orientation) of each of the users U 2 to U 9 included in the image (that is, in the field of view 520). Therefore, the user U 1 (first user 101a) can see that each user U 2 to U 9 moves smoothly in the online game image. On the other hand, for the user U j (j ≧ 10) outside the field of view 520 of the user U 1, the user state information is updated only with a low frequency, but these users are users who are not included in the online game image. U1's visual experience is not affected. In addition, the amount of data communication from the synchronization server 300 to the first game terminal 100a can be reduced due to the low distribution frequency of the user state information for users outside the field of view 520.

As another example, each distribution frequency may be set as follows.
f 1> f 2> f 3> f 4 (Formula 2)
According to this (Formula 2), in addition to the case of the above (Formula 1), each of the users U 2 to U 9 can be further changed according to the positions of the users U 2 to U 9 in the field of view 520 of the user U 1 Distribution frequency of user status information is different. That is, in the virtual reality space 510 of the online game, the user status information of the users U 2 and U 3 in the near-field-of-view area 520a is the highest frequency f 1 from the synchronization server 300 to the first game terminal 100a of the user U 1. And the user status information of the users U 4 and U 5 in the mid-range area 520b within the field of view is distributed from the synchronization server 300 to the first game terminal 100a of the user U 1 with the second highest frequency f 2. The user status information of the users U 6 to U 9 in the inner / far distance area 520c is distributed from the synchronization server 300 to the first game terminal 100a of the user U 1 at the third highest frequency f 3. As described above, the closer the distance from the user U 1 within the field of view 520 of the user U 1, the more frequently the user state information is distributed from the synchronization server 300, and therefore, the online state image presented to the user U 1 is included in the online game image. Each of the users U 2 to U 9 to be displayed is displayed more smoothly as the user U 1 is closer to the user U 1. In addition, even in the user U 1 field of view 520, users (U 6 to U 9) who are far from the user U 1 interact with the user U 1 (for example, have a conversation or attack) in the online game. Etc.), it is assumed that there is little problem in terms of substantial visual effects even if the smoothness of movement is somewhat lost. In addition, the amount of data communication from the synchronization server 300 to the first game terminal 100a can be reduced due to the low distribution frequency of the user status information for such low-interaction users.

The same effect can be obtained when any of the following equations is applied instead of the above (Equation 2).
f 1 = f 2> f 3> f 4 (Formula 3)
f 1> f 2 = f 3> f 4 (Formula 4)
f 1> f 2> f 3 = f 4 (Formula 5)
f 1> f 2 = f 3 = f 4 (Expression 6)
f 1 = f 2> f 3 = f 4 (Expression 7)

  FIG. 8 is a flowchart showing the operation of the synchronization server 300 according to an embodiment of the present invention. The processing from step S101 to step S109 in the flowchart of FIG. 8 corresponds to, for example, one frame of an online game image generated on the game terminal 100 of the online game system 10, and the game terminal 100 synchronizes user state information for each frame. Assume that the message is transmitted to the server 300. Hereinafter, description will be made with reference to the conceptual diagram of the distribution frequency of the user status information shown in FIG.

  First, in step S <b> 101, the user status acquisition unit 331 of the synchronization server 300 acquires user status information from all game terminals of the online game system 10, and stores the acquired user status information in the storage unit 320.

  Next, in step S102, the synchronization frequency determination unit 332 of the synchronization server 300 stores the user status information of the user U i (i = 1, 2,...) And the user U j (j = 1, 2,...) From the storage unit 320. However, the user state information of j ≠ i) is extracted, and the distance between the user U i and the user U j in the virtual reality space is calculated using the position of each user included in the user state information.

  Next, in step S103, the synchronization frequency determination unit 332 of the synchronization server 300 determines that the user U j is a virtual reality based on the line-of-sight direction of the user U i included in the user state information of the user U i extracted from the storage unit 320. It is determined whether or not the user U i is in the space. When the user U j is located in the field of view of the user U i, the process proceeds to step S104, and when the user U j is located outside the field of view (that is, outside the field of view 530), the process proceeds to step S105.

  In step S <b> 104, the synchronization frequency determination unit 332 of the synchronization server 300 determines that the user U j is in the near field region 520 a within the visual field in the virtual reality space, based on the distance between the user U i and the user U j calculated in step S <b> 102. It is determined whether it is located in the inner / middle distance region 520b or the far field in the visual field 520c.

  In step S105, the synchronization frequency determination unit 332 of the synchronization server 300 determines the frequency of distributing the user state information of the user U j to the user U i according to the determination results of the steps S103 and S104. For example, when the user U j is located in the near-field-of-view area 520a, the first delivery frequency f 1 is selected, and when the user U j is located in the mid-field-of-view area 520b, the second delivery frequency. If f 2 is selected and the user U j is located in the far field within the field of view 520c, the third distribution frequency f 3 is selected, and if the user U j is located in the outside field of view 530, the fourth Distribution frequency f 4 is selected. The size of each of the distribution frequencies f 1, f 2, f 3, and f 4 is any one of (Expression 1) to (Expression 7) described above.

  Next, in step S106, the synchronization frequency determination unit 332 of the synchronization server 300 determines whether or not the processing from step S102 to step S105 has been completed for all users U i and users U j (where j ≠ i). . If not completed, the process from step S102 is repeated for another set of i and j. If completed, the process proceeds to step S107.

  Next, in step S107, the user status distribution unit 333 of the synchronization server 300 determines in step S105 a user who should distribute the user status information to the user U i (i = 1, 2,...) At the current timing. Based on the distribution frequency, the user U j (j = 1, 2,..., Where j ≠ i) is selected. For example, in the user arrangement illustrated in FIG. 7, if the current timing is a timing corresponding to the first distribution frequency f 1, the user U 2 and the user U are users who should distribute user status information to the user U 1. 3 is selected. Further, if the current timing is a timing corresponding to the second distribution frequency f 2, the users U 2, U 3, U 4, and U are users who should distribute the user status information to the user U 1. 5 is selected.

  Next, in step S108, the user status distribution unit 333 of the synchronization server 300 distributes the user status information of the user selected in step S107 to the user U i.

  Next, in step S109, the user status distribution unit 333 of the synchronization server 300 determines whether or not the processing of step S107 and step S108 has been completed for all users U i. If not completed, the processes in steps S107 and S108 are repeated for another user U i, and if completed, the process returns to step S101 and the same processes are sequentially repeated.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to this, A various change is possible within the range which does not deviate from the summary.

  As a first modification, the region 520 illustrated in FIG. 7 may have an angle range wider than the field of view of the user U 1. As described above, when the user wearing the HMD 120 moves his / her head, the range of the online game image changes accordingly. However, the user located outside the field of view of the user U 1 is also a user within the field of view. The user status information is distributed at a high frequency in the same manner as described above, so that when the user wearing the HMD 120 moves his / her head, the user located outside the field of view of the user U 1 can be smoothed. Can be displayed.

  As a second modification, the distribution frequency is set for each region (in-view short-range region 520a, in-view intermediate-range region 520b, in-view far-range region 520c, and out-of-view region 530) as in the above-described embodiment. Instead of this, the distribution frequency may be set as a function of position as shown in FIG. 9A shows the relationship between the distance in the Z-axis direction and the distribution frequency, FIG. 9B shows the relationship between the distance in the X-axis direction and the distribution frequency, and FIG. 9C shows the distance in the Y-axis direction. The relationship of distribution frequency is shown. In FIG. 9A, the distribution frequency takes a constant value up to the distance L Z, and decreases nonlinearly (for example, exponential function) beyond the distance L Z. Similarly, in FIGS. 9B and 9C, the distribution frequency takes a constant value up to the distance L X or L Y, and then decreases nonlinearly (for example, exponential) when the distance L X or L Y is exceeded. . However, L Y <L X <L Z. In this way, the frequency in the Z-axis direction, that is, the line-of-sight direction is increased to a certain extent, while the X-axis direction, that is, the horizontal direction, and the Y-axis direction, that is, the vertical direction are at the end of the field of view that is difficult for the user to pay attention to It is possible to reduce the distribution frequency of the user status information regarding the existing users. Furthermore, since the portions where the distances are close to zero on the X axis, the Y axis, and the Z axis are portions that are difficult for the user to see, the distribution frequency may be reduced.

10 Online Game System 100a First Game Terminal 100b Second Game Terminal 101a First User 101b Second User 105 Network 120a, 120b Head Mount Display (HMD)
200a, 200b Image generation device 100 Game terminal 150 Wired cable 122 Display 126 Sensor 202 Processor 204 Memory 206 User input interface 208 Communication interface 220 Storage unit 230 Processing unit 231 Image generation unit 232 User status transmission unit 233 User status reception unit 234 Image output Unit 300 synchronization server 302 processor 304 memory 308 communication interface 320 storage unit 330 processing unit 331 user state acquisition unit 332 synchronization frequency determination unit 333 user state distribution unit

Claims (7)

A synchronization server for synchronizing user states in a virtual reality space including a first user and a second user,
From the first terminal corresponding to the first user, first user state information including the position and line-of-sight direction of the first user in the virtual reality space is acquired, and from the second terminal corresponding to the second user, A user state acquisition unit for acquiring second user state information including the position of the second user in the virtual reality space;
Between the first user and the second user in the virtual reality space using the position of the first user included in the first user state information and the position of the second user included in the second user state information A distance calculation unit for calculating the distance of
Based on the calculated distance between the first user and the second user and the line-of-sight direction of the first user included in the first user state information, a synchronization frequency related to the user state of the second user is calculated. A synchronization frequency determination unit to determine;
A user status distribution unit that distributes the second user status information to the first terminal at the determined synchronization frequency;
A synchronization server comprising:   The synchronization frequency determination unit sets the synchronization frequency high when the second user exists in a predetermined angle range including the visual line direction of the first user in the virtual reality space. The synchronization server according to claim 1, wherein when the second user exists outside the predetermined angle range, the synchronization frequency is set low.   When the second user is within a predetermined angle range including the first user's line-of-sight direction in the virtual reality space and is closer than a predetermined distance from the first user, The synchronization frequency is set to be high, and the synchronization frequency is set to be low when the second user is within the predetermined angle range and farther than the predetermined distance in the virtual reality space. Synchronization server.   When the second user is within a predetermined angle range including the first user's line-of-sight direction in the virtual reality space and is closer than a predetermined distance from the first user, When the synchronization frequency is set to the first frequency, and the second user is present within the predetermined angle range and further than the predetermined distance in the virtual reality space, the synchronization frequency is set to be higher than the first frequency. The low second frequency is set, and when the second user is outside the predetermined angle range in the virtual reality space, the synchronization frequency is set to a third frequency lower than the first frequency. The synchronization server described in.   5. The synchronization server according to claim 2, wherein the predetermined angle range including the visual line direction of the first user is a range wider than the visual field of the first user in the virtual reality space. 6. The synchronization server according to claim 2, wherein the predetermined angle range in the horizontal direction of the virtual reality space is wider than the predetermined angle range in the vertical direction of the virtual reality space. A synchronization method executed by a synchronization server to synchronize user states in a virtual reality space including a first user and a second user,
Obtaining from the first terminal corresponding to the first user first user state information including the position and line-of-sight direction of the first user in the virtual reality space;
Obtaining second user state information including a position of the second user in the virtual reality space from a second terminal corresponding to the second user;
Between the first user and the second user in the virtual reality space using the position of the first user included in the first user state information and the position of the second user included in the second user state information Calculating the distance of
Based on the calculated distance between the first user and the second user and the line-of-sight direction of the first user included in the first user state information, a synchronization frequency related to the user state of the second user is calculated. A step to determine;
Delivering the second user status information to the first terminal at the determined synchronization frequency;
Including synchronization method.