JP6810818B1 - Program, user terminal and object update method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To harmonize the consistency of a virtual space presented to a plurality of users with the sensation of each user. A program is based on a receiver 151, which receives a second user information based on an operation of a second user who uses a computer different from the computer and uses a computer used by the first user. Therefore, it functions as a calculation unit 153 that calculates change information of the change object that changes according to the operation of the second user, and a display control unit 154 that displays the change object on the display unit 13 based on the change information, and receives the information. The unit 151 receives the update information for updating the change information, and the display control unit 154 updates the change object displayed based on the change information calculated by the calculation unit 153 based on the update information. [Selection diagram] Fig. 4

Description

The present invention relates to a program, a user terminal, and an object updating method for presenting a virtual space to a user.

Conventionally, a technique of presenting a virtual space to a user is known. Patent Document 1 discloses a VR terminal capable of displaying VR (Virtual Reality).

JP-A-2019-185762

By the way, in the case of presenting the virtual space to a plurality of users who use the VR terminals, if each VR terminal independently generates the virtual space to be presented to each user, the operation of each user is each virtual space. The issue is the harmony between the user's sensation obtained according to the speed of the response until it is reflected in the above and the consistency of the virtual space indicating that the virtual space in the same state is presented to each user. For example, in a plurality of VR terminals, if the degree of time lag in changing objects becomes large, the user's sensation is lowered. Further, if there is a difference in the change of the object existing in the virtual space in the plurality of VR terminals, the consistency of the virtual space presented to each user cannot be maintained. Therefore, in the virtual space presented to a plurality of users, it is required to harmonize the user's experience with the consistency of the virtual space.

Therefore, the present invention has been made in view of these points, and is a program, a user terminal, and an object updating method capable of harmonizing the consistency of the virtual space presented to a plurality of users with the sensation of each user. The purpose is to provide.

The program according to the first aspect of the present invention is a receiving unit that receives a second user information based on an operation of a second user who uses the computer different from the computer and uses the computer used by the first user. A calculation unit that calculates change information of a change object that changes with the operation of the second user based on the second user information, and a display control that displays the change object on the display unit based on the change information. The receiving unit receives the update information for updating the change information, and the display control unit displays the change object displayed based on the change information calculated by the calculation unit. , Update based on the update information.

The update information may be information for indicating the shape of the change object, and the display control unit displays the shape of the change object displayed based on the change information calculated by the calculation unit. It may be updated based on the update information.

The change object may be a drawing object drawn based on the operation of the second user in the virtual space, and the second user information is the position coordinates of the operation object based on the operation of the second user. May be included, or the calculation unit may calculate the change information including the drawing position coordinates for drawing the drawing object in the virtual space based on the position coordinates of the operation object. The display control unit may display the drawing object based on each drawing position coordinate calculated by the calculation unit, or the reception unit may receive the update information including the plurality of the drawing position coordinates. Alternatively, the display control unit may update the shape of the drawing object displayed based on the drawing position coordinates calculated by the calculation unit based on the plurality of drawing position coordinates received by the reception unit. ..

The receiving unit may receive the second user information at the first interval, and the calculating unit calculates the drawing position coordinates each time the receiving unit receives the second user information. Alternatively, the display control unit draws the drawing object that connects the drawing position coordinates calculated by the calculation unit and the drawing position coordinates calculated immediately before the drawing position coordinates are calculated. The receiving unit may display the plurality of drawing positions calculated based on the operation of the second user received by the other computer at the second interval, which is shorter than the first interval. The update information including the coordinates may be received, and the display control unit is the drawing object corresponding to the second user information when the receiving unit receives the plurality of drawing position coordinates. The shape of the 1 drawing object may be updated to the shape of the drawing object corresponding to the update information and having a shorter interval between the drawing position coordinates than the first drawing object.

The computer is further functioned as a reception unit that receives the operation of the first user and a transmission unit that transmits the first user information based on the operation of the first user received by the reception unit to the other computer. Alternatively, the calculation unit may be an operation of the first user received by the reception unit, and the calculation unit may be based on an operation in which the first user object indicating the first user changes the shape of the change object. The change information may be calculated, or the transmission unit may transmit the update information corresponding to the change information calculated by the calculation unit to the other computer.

The update information may be information for indicating the position of the change object, and the display control unit displays the position of the change object displayed based on the change information calculated by the calculation unit. It may be updated based on the update information.

The change object may be a dynamic object that can move in accordance with the operation of the second user in the virtual space, and the calculation unit may perform the movement of the dynamic object based on the second user information. The change information for showing may be calculated, the display control unit may display the dynamic object based on the change information calculated by the calculation unit, and the reception unit may display the dynamic object. The update information including the position coordinates of the dynamic object based on the specific operation of the second user may be received, and the display control unit may be based on the movement of the dynamic object calculated by the calculation unit. The position of the dynamic object displayed in the above may be updated based on the position coordinates of the dynamic object received by the receiving unit.

When the position coordinates of the dynamic object displayed based on the change information calculated by the calculation unit and the position coordinates of the dynamic object received by the reception unit are different from each other, the display control unit may use the display control unit. You may update the position of the dynamic object.

The reception unit that receives an operation for moving the first user object indicating the first user of the computer, and the first user object that moves in response to the operation of the first user received by the reception unit are changed. When it comes into contact with an object, it may further function as a transmitter that transmits the position coordinates of the changed object to the other computer.

The user terminal according to the second aspect of the present invention is a user terminal used by a first user, and second user information based on an operation of a second user who uses another user terminal different from the user terminal. The receiving unit that receives the above, the calculation unit that calculates the change information of the change object that changes according to the operation of the second user based on the second user information, and the change object based on the change information. It has a display control unit to be displayed on the display unit, the receiving unit receives update information for updating the change information, and the display control unit is based on the change information calculated by the calculation unit. The change object displayed in the above is updated based on the update information.

The object update method according to the third aspect of the present invention receives second user information based on an operation of a second user using the computer other than the computer executed by the computer used by the first user. Steps to calculate the change information of the change object that changes with the operation of the second user based on the second user information, and the change object is displayed on the display unit based on the change information. It has a step of causing the change information to be updated, a step of receiving update information for updating the change information, and a step of updating the change object displayed based on the calculated change information based on the update information.

According to the present invention, there is an effect that the consistency of the virtual space presented to a plurality of users can be harmonized with the sensation of each user.

It is a figure for demonstrating the outline of the space sharing system which is premised in this specification. It is a figure for demonstrating the outline of the space sharing system which is premised in this specification. It is a figure for demonstrating the outline of the space sharing system in 1st Embodiment. It is a figure which shows the structure of the user terminal 1. It is a figure which represented the drawing object schematically. It is a sequence diagram which shows the process flow of the space sharing system in 1st Embodiment. It is a figure for demonstrating the outline of the space sharing system in 2nd Embodiment. It is a figure for demonstrating the outline of the space sharing system in 2nd Embodiment. It is a sequence diagram which shows the process flow of the space sharing system in 2nd Embodiment.

[Configuration of space sharing system S]
First, the outline of the space sharing system S which is a premise in this specification will be described. 1 and 2 are diagrams for explaining the outline of the space sharing system S which is a premise in the present specification. The space sharing system S is a system used to present the virtual space V to a plurality of users U. The space presented by the space sharing system to the plurality of users U is, for example, VR, but is not limited to this, and may be AR (Augmented Reality), MR (Mixed Reality), or the like (xR). The space sharing system S has a user terminal 1 and a management device 2.

The user terminal 1 is a computer used by the user U, and is, for example, an HMD (Head Mounted Display) type device capable of displaying a VR for presenting the virtual space V to the user U. A dedicated application program (hereinafter, referred to as "dedicated application") for presenting the virtual space V to the user U is installed in the user terminal 1.

A controller C used by the user U to operate the user object A existing in the virtual space V is wirelessly or wiredly connected to the user terminal 1, and when the user U operates the controller C, the user U responds to the operation. User object A operates. The user object A may be, for example, the avatar of the user U.

The management device 2 is a device that relays information transmitted and received between a plurality of user terminals 1, and is, for example, a server. The plurality of user terminals 1 may transmit and receive information by P2P (Peer to Peer) without going through the management device 2.

The management device 2 manages the setting information for the user terminal 1 to start presenting the virtual space V to the user U. For the setting information, for example, for each object existing in the virtual space V, the position coordinates in the virtual space V and the type of the object (for example, a user object, a change object, etc.) are associated with each other. The change object is an object that changes according to the operation of the user U. Objects other than user objects existing in the virtual space V (for example, desks, chairs, pens, balls, vases, etc.) can be change objects. For example, the user terminal 1 receives setting information from the management device 2 in response to the operation of starting the dedicated application by the user U, and starts presenting the virtual space V based on the received setting information.

In the space sharing system S, each user terminal 1 calculates information for presenting the virtual space V based on the setting information received from the management device 2, and displays an image based on the calculated information. The virtual space V is presented to each of the users U. The virtual space V shown in FIG. 1 includes at least a first user object A1 indicating a first user U1 using the first user terminal 1a and a second user indicating a second user U2 using the second user terminal 1b. Object A2 exists. There may be more change objects in the virtual space V.

In the space sharing system S, since each user terminal 1 independently presents the virtual space V, it is necessary to share information for presenting the virtual space V among a plurality of user terminals 1. When each user terminal 1 presents the virtual space V independently, the harmony between the experience of the user U and the consistency of the virtual space V presented to each user U becomes an issue.

The experience of the user U (for example, the first user U1) in the present specification is obtained according to the speed of the response until the operation of the first user U1 is reflected in the virtual space V presented to the first user U1. Until the experience of being performed and the operation of another user U (for example, the second user U2) who can operate in cooperation with the operation of the first user U1 are reflected in the virtual space V presented to the first user U1. Includes the sensation obtained according to the speed of response. Further, the consistency of the virtual space V in the present specification indicates that each of the plurality of user terminals 1 (for example, the first user terminal 1a and the second user terminal 1b) presents the virtual space V in the same state.

As the frequency of transmission of information shared between the plurality of user terminals 1 increases, the consistency of the virtual space V improves, but the perceived feeling of the user U may decrease. For example, if the transmission frequency of the above information is high, the load on the network may be high. When the reception of the above information is delayed due to the increased load on the network, the difference in the timing at which the changing object changes among the plurality of user terminals 1 becomes large according to the delay. In this case, for example, the response until the operation of the second user U2 is reflected in the virtual space V presented to the first user U1 is delayed, and the sensation of the first user U1 is lowered.

On the other hand, as the frequency of transmission of information shared between the plurality of user terminals 1 decreases, the sensation of the user U improves, but the consistency of the virtual space V may decrease. For example, if the transmission frequency of the second user terminal 1b transmitting the above information to the first user terminal 1a is low, the second user object A2 operating in the virtual space V presented to the first user U1 by the first user terminal 1a The operation interval of is longer than the operation interval of the second user object A2 operating in the virtual space V presented to the second user U2 by the second user terminal 1b.

Specifically, the second user object A2 in the virtual space V presented to the second user U2 by the second user terminal 1b operates every time the operation of the second user U2 is received at a predetermined reception interval. , Works smoothly. The reception interval is, for example, an interval similar to the refresh rate of the screen displayed on the user terminal 1. On the other hand, the second user object A2 in the virtual space V presented to the first user U1 by the first user terminal 1a operates every time the above information is received at a predetermined interval longer than the reception interval, and is therefore intermittent. Works like this. The predetermined interval is, for example, a 1-second interval, a 0.5-second interval, or the like. The predetermined timing is the time when one period elapses at a predetermined interval.

In this case, although the details will be described later, the change of the change object may be different in the virtual space V presented by each of the first user terminal 1a and the second user terminal 1b, and is presented to the first user U1 and the second user U2. The consistency of the virtual space V to be used cannot be maintained. In this way, since the user U's experience and the consistency of the virtual space V presented to each user U are in a trade-off relationship, the user U's experience and the consistency of the virtual space V are harmonized. It is required to plan. Therefore, the space sharing system S synchronizes the state of the virtual space V presented to each user U at a predetermined timing while maintaining the sensation of the user U.

In the example shown in FIG. 2, an example in which the changing object changes with the operation of the second user U2 will be described. In this case, first, the second user terminal 1b accepts the operation of the second user U2 ((1) in FIG. 2). Specifically, the second user terminal 1b receives the operation of the second user U2 at a predetermined reception interval.

The second user terminal 1b transmits the second user information based on the operation of the second user U2 to the first user terminal 1a via the management device 2 ((2) in FIG. 2). Specifically, the second user terminal 1b receives the second user information based on the operation of the second user U2 received at a predetermined timing based on the predetermined interval at a predetermined interval longer than the reception interval. 1 Send to user terminal 1a.

The second user terminal 1b calculates change information of the change object that changes with the operation of the second user U2 based on the received operation of the second user U2 ((3) in FIG. 2). Each time the second user terminal 1b receives the operation of the second user U2, the second user terminal 1b calculates the change information corresponding to the operation of the second user U2.

When the first user terminal 1a receives the second user information from the second user terminal 1b, the first user terminal 1a calculates the change information based on the second user information ((4) in FIG. 2). Each time the first user terminal 1a receives the second user information from the second user terminal 1b, the first user terminal 1a calculates the change information corresponding to the second user information. The first user terminal 1a and the second user terminal 1b present the virtual space V to the first user U1 and the second user U2 by displaying the change object based on the change information calculated by each (FIG. 2). (5), (6)).

As described above, in the space sharing system S, the second user terminal 1b transmits the second user information to the first user terminal 1a at a predetermined interval longer than the reception interval, so that the transmission frequency of the second user information is high. It is possible to reduce the load on the network by transmitting the second user information. As a result, the space sharing system S can display the change object that changes with the operation of the second user on the first user terminal 1a at an early stage. As a result, the space sharing system S can reduce the deterioration of the perceived feeling of the first user U1.

Subsequently, the second user terminal 1b transmits the update information for updating the change information calculated by the first user terminal 1a to the first user terminal 1a after transmitting the second user information ((FIG. 2 (FIG. 2)). 7)). Then, when the first user terminal 1a receives the update information from the second user terminal 1b, the first user terminal 1a updates the change object displayed by the first user terminal 1a based on the change information based on the update information ((FIG. 2). 8)).

By doing so, the space sharing system S can eliminate the difference between the changing objects that can occur in the virtual space V presented to the first user U1 and the second user U2. As a result, the space sharing system S can maintain the consistency of the virtual space V presented to the first user U1 and the second user U2. As a result, the space sharing system S can harmonize the consistency of the virtual space V presented to the plurality of users U with the sensation of each user U.
Hereinafter, the space sharing system S according to the first embodiment will be described.

<First Embodiment>
[Overview of the space sharing system S in the first embodiment]
FIG. 3 is a diagram for explaining an outline of the space sharing system S according to the first embodiment. In the space sharing system S according to the first embodiment, first, in the virtual space V presented by the first user terminal 1a to the first user U1, a change object changed by the operation of the second user U2 is displayed. Display based on change information. Then, the first user terminal 1a updates the shape of the change object displayed based on the change information based on the update information.

The change object in the first embodiment is a drawing object drawn based on the operation of the second user in the virtual space V, for example, a line drawn with a pen. Further, the change information and the update information in the first embodiment are information for indicating the shape of the change object (drawing object). Details of change information and update information will be described later.

FIG. 3A is a diagram schematically showing the second virtual space V2 presented by the second user terminal 1b to the second user U2, and the second virtual space V2 viewed from the viewpoint of the second user U2. It is a figure shown. The line K shown in FIG. 3A is a drawing object displayed by the second user terminal 1b based on the operation of the second user. As shown in FIG. 3A, in the second virtual space V2, the line K is displayed as a wavy line in order to display the drawing object based on the operation of the second user received by the second user terminal 1b at the reception interval. Will be done.

3 (b) and 3 (c) are diagrams schematically showing the first virtual space V1 presented by the first user terminal 1a to the first user U1, and is a first view from the viewpoint of the first user U1. It is a figure which showed the virtual space V1. The line L shown in FIG. 3B is a drawing object drawn by the second user object A2, and is a drawing object displayed by the first user terminal 1a based on the second user information. As shown in FIG. 3B, in the first virtual space V1, the operation of the second user U2 received by the first user terminal 1a at a predetermined timing based on a predetermined interval longer than the reception interval. Since the drawing object is displayed based on the above, the line L is displayed as a polygonal line. As described above, in the space sharing system S, if the transmission frequency of the second user information is reduced, the shape of the drawing object may differ in each virtual space V.

Therefore, the space sharing system S updates the shape of the change object displayed based on the change information based on the update information. The line M shown in FIG. 3C is a drawing object in which the first user terminal 1a updates the line L based on the update information. As shown in FIGS. 3A and 3C, the line M is represented by a wavy line like the line K.

In this way, in the space sharing system S, by lowering the transmission frequency of the second user information, the second user performs an operation of changing the change object, and then the change changes according to the operation of the second user. The period until the object is displayed on the first user terminal 1a can be shortened. As a result, in the space sharing system S, since the change object that changes with the operation of the second user is displayed on the first user terminal 1a at an early stage, it is possible to reduce the deterioration of the perceived feeling of the first user U1. ..

Further, the space sharing system S eliminates the difference in the shape of the changing object that may occur in the virtual space V presented to the first user U1 and the second user U2 by updating the shape of the changing object based on the update information. be able to. As a result, the space sharing system S can maintain the consistency of the virtual space V presented to each user U. As a result, the space sharing system S can harmonize the experience of the user U with the consistency of the virtual space V provided to each user U.
Hereinafter, the configuration of the user terminal 1 will be described.

[Configuration of user terminal 1]
FIG. 4 is a diagram showing the configuration of the user terminal 1. The user terminal 1 has a first communication unit 11, a second communication unit 12, a display unit 13, a storage unit 14, and a control unit 15.

The first communication unit 11 is an interface for connecting to a network, and is configured to include, for example, a wireless LAN (Local Area Network) controller. The second communication unit 12 is an interface for connecting to the controller C, and is, for example, a communication module for short-range wireless communication.

The display unit 13 is a display for presenting an image to both eyes of the user U. The storage unit 14 is a storage medium such as a ROM (Read Only Memory), a RAM (Random Access Memory), and a hard disk. The storage unit 14 stores a program executed by the control unit 15.

The control unit 15 is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like. The control unit 15 functions as a reception unit 151, an operation reception unit 152, a calculation unit 153, a display control unit 154, and a transmission unit 155 by executing the program stored in the storage unit 14. Hereinafter, the function of displaying the change object that changes according to the operation of the first user U1 in which the first user terminal 1a uses the first user terminal 1a and the function that the first user terminal 1a uses the second user terminal 1b. The function of displaying the change object that changes according to the operation of the second user U2 will be described separately.

(Displays a change object that changes with the operation of the first user U1)
The operation receiving unit 152 receives the operation of the first user U1 from the controller C1 via the second communication unit 12. The operation of the first user U1 is an operation for moving the first user object A1 indicating the first user U1, an operation for the first user object A1 to change the shape of the changing object, and the like. Specifically, the operation reception unit 152 receives the operation of the first user U1 at a predetermined reception interval.

The calculation unit 153 calculates change information of the change object that changes with the operation of the first user U1 based on the operation of the first user U1. The change information includes, for example, drawing position coordinates and drawing position identification information. The drawing position coordinates are the position coordinates for drawing the drawing object in the virtual space V. The drawing position identification information is information for identifying the drawing position coordinates, and is, for example, a character string including a serial number.

Specifically, the calculation unit 153 calculates change information including drawing position coordinates for drawing the drawing object in the virtual space V based on the position coordinates of the operation object. The operation object is, for example, a hand object included in the first user object A1.

For example, when the position coordinates of the hand object is the center of the palm and the drawing object is drawn from the pen tip of the pen object held by the hand object, the operation reception unit 152 performs the operation of the first user U1 in the calculation unit 153. The drawing position coordinates are calculated based on the position coordinates of the hand object at the time of acceptance and the distance / angle from the center of the palm corresponding to the position coordinates to the pen tip, and the drawing position identification information is added to the drawing position coordinates. Is associated and given.

The calculation unit 153 calculates, for example, change information corresponding to the operation of the first user U1 each time the operation reception unit 152 receives the operation of the first user U1. Further, the calculation unit 153 calculates the change information corresponding to the change object when, for example, the operation of the first user U1 received by the operation reception unit 152 is an operation of changing the change object.

The display control unit 154 causes the display unit 13 to display the change object based on the change information calculated by the calculation unit 153 based on the operation of the first user U1. The display control unit 154 causes the display unit 13 to display an image including the line K shown in FIG. 3A, for example.

Specifically, the display control unit 154 displays the drawing object based on the drawing position coordinates calculated by the calculation unit 153. More specifically, the display control unit 154 draws and displays a drawing object that connects the drawing position coordinates calculated by the calculation unit 153 and the drawing position coordinates calculated immediately before the drawing position coordinates are calculated. Let me.

FIG. 5 is a diagram schematically showing a drawing object. The line K shown in FIG. 5A corresponds to the line K shown in FIG. 3A. The position coordinate Kn is a drawing position coordinate calculated by the calculation unit 153, and the position coordinate Kn-1 is a drawing position coordinate calculated immediately before the position coordinate Kn is calculated. In this case, the display control unit 154 draws a drawing object in which the position coordinates Kn and the position coordinates Kn-1 are connected by a line and displays them on the display unit 13.

Returning to FIG. 4, the transmission unit 155 transmits the first user information based on the operation of the first user U1 received by the operation reception unit 152 to the second user terminal 1b via the first communication unit 11. Specifically, the transmission unit 155 draws the position coordinates of the operation object based on the operation of the first user U1 received by the operation reception unit 152 at a predetermined timing and the drawing object via the first communication unit 11. The first user information including the drawing information for indicating that is transmitted to the second user terminal 1b.

More specifically, first, the transmission unit 155 transmits the first user information to the management device 2 via the first communication unit 11. Then, the management device 2 uses the first user information received from the first user terminal 1a as the second user U2, which is a user U other than the first user U1 among the plurality of users U participating in the virtual space V. Is transmitted to the second user terminal 1b corresponding to. The transmission unit 155 transmits the first user information to the management device 2 at a first interval, which is a predetermined interval, for example.

After transmitting the first user information, the transmission unit 155 updates the update information for updating the change information calculated by the second user terminal 1b based on the first user information via the first communication unit 11. It is transmitted to the user terminal 1b. The update information is, for example, a plurality of change information calculated by the calculation unit 153 in one period based on the second interval different from the first interval. The second interval is longer than the first interval, for example, a 5-second interval, a 10-second interval, or the like. Specifically, the transmission unit 155 transmits the update information to the second user terminal 1b at the second interval.

(Displays a change object that changes with the operation of the second user U2)
The receiving unit 151 receives the second user information or the updated information from the second user terminal 1b via the first communication unit 11. The second user information is information corresponding to the first user information. For example, the position coordinates of the operation object based on the operation of the second user U2 received by the second user terminal 1b at a predetermined timing and the drawing object are drawn. It is information including drawing information for showing that it does.

Specifically, the receiving unit 151 receives the second user information or the updated information transmitted by the second user terminal 1b from the management device 2 via the first communication unit 11. The receiving unit 151 receives the second user information at the first interval, for example. Further, the receiving unit 151 receives, for example, update information including a plurality of change information calculated based on the operation of the second user received by the second user terminal 1b at the reception interval which is shorter than the first interval. .. The change information includes drawing position coordinates and drawing position identification information corresponding to the drawing position coordinates.

The calculation unit 153 calculates the change information of the change object that changes with the operation of the second user U2, based on the second user information received by the reception unit 151. Specifically, the calculation unit 153 calculates change information including the drawing position coordinates of the drawing object and the drawing position identification information corresponding to the drawing position coordinates, based on the second user information. The calculation unit 153 calculates change information every time the reception unit 151 receives the second user information at the first interval, for example.

The display control unit 154 causes the display unit 13 to display the change object based on the change information calculated by the calculation unit 153 based on the second user information. The display control unit 154 causes the display unit 13 to display an image including the line L shown in FIG. 3B, for example.

When the receiving unit 151 receives the update information, the display control unit 154 updates the shape of the change object displayed based on the change information calculated by the calculation unit 153 based on the second user information based on the update information. To do. The display control unit 154 causes the display unit 13 to display, for example, a drawing object in which the line L shown in FIG. 3B is updated to the line M shown in FIG. 3C. Specifically, the display control unit 154 updates the drawing object displayed based on the drawing position coordinates calculated by the calculation unit 153 based on the plurality of drawing position coordinates received by the reception unit 151.

More specifically, the display control unit 154 updates the shape of the first drawing object to the shape of the second drawing object when the receiving unit 151 receives the update information including the plurality of drawing position coordinates. The first drawing object is a drawing object corresponding to the second user information. The second drawing object is a drawing object corresponding to the update information, and the interval between the drawing position coordinates is shorter than that of the first drawing object.

The display control unit 154 can be divided into, for example, the first drawing position identification information which is the drawing position identification information given by the calculation unit 153 and the second drawing position identification information which is the drawing position identification information given by the second user terminal 1b. Based on this, the shape of the first drawing object is updated to the shape of the second drawing object.

The line L shown in FIG. 5B is the first drawing object, and the line M shown in FIG. 5C is the second drawing object. The first drawing position identification information associated with each of the coordinates L1, L2, L3, and L4 used for drawing the line L is in the coordinates M1, M2, M3, and M4 used for drawing the line M, respectively. It matches each of the associated second drawing position identification information.

In this case, the display control unit 154 sets the position coordinates of the coordinates L1, L2, L3, and L4 to the coordinates M1, M2, M3, which are associated with the second drawing position identification information that matches the first drawing position identification information. The shape of the first drawing object is updated to the shape of the second drawing object by changing to the position coordinates of M4 and adding the position coordinates from the coordinates M5 to the coordinates Mn.

[Processing of space sharing system S]
Subsequently, the processing flow of the space sharing system S in the first embodiment will be described. FIG. 6 is a sequence diagram showing a processing flow of the space sharing system S according to the first embodiment. This process is started as a process of the second user terminal 1b when the operation reception unit 152 receives the operation of the second user U2 from the controller C2 via the second communication unit 12 (S1).

As a process of the second user terminal 1b, the transmission unit 155 determines whether or not the period based on the first interval has elapsed (S2). When the transmission unit 155 determines that the period based on the first interval has elapsed (YES in S2), the transmission unit 155 transmits the second user information to the first user terminal 1a via the first communication unit 11 (S3). ). On the other hand, when the transmission unit 155 determines that the period based on the first interval has not elapsed (NO in S2), the transmission unit 155 proceeds to the process in S4.

As a process of the second user terminal 1b, the calculation unit 153 calculates change information based on the operation of the second user U2 received by the operation reception unit 152 (S4). As a process of the second user terminal 1b, the display control unit 154 causes the display unit 13 to display the change object based on the change information calculated by the calculation unit 153 based on the operation of the second user U2 (S5).

When the receiving unit 151 receives the second user information from the second user terminal 1b via the first communication unit 11 as the process of the first user terminal 1a, the calculation unit 153 changes based on the second user information. Calculate the information (S6). As a process of the first user terminal 1a, the display control unit 154 causes the display unit 13 to display the change object based on the change information calculated by the calculation unit 153 based on the second user information (S7).

As a process of the second user terminal 1b, the transmission unit 155 determines whether or not the period based on the second period has elapsed (S8). When the transmission unit 155 determines that the period based on the second period has elapsed (YES in S8), the calculation unit 153 calculates based on the operation of the second user U2 via the first communication unit 11. Update information including change information is transmitted to the first user terminal 1a (S9). On the other hand, when the transmission unit 155 determines that the period based on the second period has not elapsed (NO in S8), the transmission unit 155 returns the process to S1.

When the receiving unit 151 receives the update information from the second user terminal 1b via the first communication unit 11 as the process of the first user terminal 1a, the display control unit 154 has the calculation unit 153 based on the second user information. The shape of the change object displayed based on the calculated change information is updated based on the update information (S10).

[Effect in the first embodiment]
As described above, the user terminal 1 calculates the change information based on the second user information, and displays the change object based on the calculated change information. After that, when the user terminal 1 receives the update information, the user terminal 1 updates the shape of the change object displayed based on the change information based on the update information.

In this way, in the space sharing system S, by lowering the transmission frequency of the second user information, the second user performs an operation of changing the change object, and then the change changes according to the operation of the second user. The period until the object is displayed on the first user terminal 1a can be shortened. As a result, in the space sharing system S, since the change object that changes with the operation of the second user is displayed on the first user terminal 1a at an early stage, it is possible to reduce the deterioration of the perceived feeling of the first user U1. ..

Further, the space sharing system S eliminates the difference in the shape of the changing object that may occur in the virtual space V presented to the first user U1 and the second user U2 by updating the shape of the changing object based on the update information. be able to. As a result, the space sharing system S can maintain the consistency of the virtual space V presented to each user U. As a result, the space sharing system S can harmonize the experience of the user U with the consistency of the virtual space V provided to each user U.

<Second Embodiment>
[Update the position of the change object]
Subsequently, the space sharing system S in the second embodiment will be described. In the space sharing system S according to the first embodiment, the user terminal 1 updates the shape of the change object displayed based on the change information based on the update information. On the other hand, in the space sharing system S in the second embodiment, the user terminal 1 updates the position of the change object displayed based on the change information based on the update information. The parts different from the first embodiment will be described below. The same parts as those of the first embodiment will be omitted as appropriate.

7 and 8 are diagrams for explaining the outline of the space sharing system S in the second embodiment. The change object in the second embodiment is a dynamic object that can move with the operation of the user U in the virtual space V, for example, a ball. Further, the change information in the second embodiment is information for indicating the movement of the change object (dynamic object). Further, the update information in the second embodiment is information for indicating the position of the change object (dynamic object). FIG. 7 schematically shows a change in the position of the dynamic object thrown by the second user object A2.

FIG. 7A is a diagram schematically showing the second virtual space V2 presented by the second user terminal 1b to the second user U2. In the second virtual space V2 shown in FIG. 7A, a dynamic object separated from the hand object of the second user object A2 at the position P1 stays at the position P2. As shown in FIG. 7A, in the second virtual space V2, the dynamic object is positioned because the second user terminal 1b operates the dynamic object based on the operation of the second user received at the reception interval. It moves from P1 to position P2.

FIG. 7B is a diagram schematically showing the first virtual space V1 presented by the first user terminal 1a to the first user U1. In the first virtual space V1 shown in FIG. 7B, the dynamic object thrown from the position Q1 by the second user object A2 stays at the position Q2. As shown in FIG. 7B, in the first virtual space V1, the operation of the second user U2 received by the first user terminal 1a at a predetermined timing based on a predetermined interval longer than the reception interval. The dynamic object moves from position Q1 to position Q2 in order to operate the dynamic object based on.

As described above, in the space sharing system S, if the transmission frequency of the second user information is reduced, the position of the dynamic object may be different in each virtual space V. Further, since the behavior of the dynamic object is different in each virtual space V, the dynamic object hits another dynamic object in one virtual space V, and the dynamic object is another in the other virtual space V. There may be differences in the positions of various dynamic objects in each virtual space V, such as when the dynamic object is not hit.

Therefore, the space sharing system S updates the position of the change object displayed based on the change information based on the update information. FIG. 8A is a diagram schematically showing the second virtual space V2 presented by the second user terminal 1b to the second user U2. FIG. 8B is a diagram schematically showing the state of the change object displayed by the first user terminal 1a in the first virtual space V1 presented to the first user U1 based on the change information. .. FIG. 8C is a diagram schematically showing the state of the change object that is the first virtual space V1 presented by the first user terminal 1a to the first user U1 and is updated based on the update information.

In the example shown in FIG. 8A, it is assumed that the second user object A2 operates with a dynamic object stopped at the position P2. In this case, the space sharing system S shows the position of the dynamic object in the first virtual space V1 which is stopped at the position Q2 shown in FIG. 8B before the second user object A2 touches the dynamic object. Update to position Q3 shown in 8 (c). The trigger for updating the position of the dynamic object is not limited to the action of holding or touching the dynamic object, but may be an arbitrary action or a predetermined condition.

On the contrary, although not shown, it is assumed that the first user object A1 operates with a dynamic object stopped at the position Q2. In this case, the space sharing system S updates the position of the dynamic object stopped at the position P2 when viewed from the second user U2 to the position Q2 when the first user object A1 touches the dynamic object. ..

In this way, the space sharing system S updates the position of the change object based on the update information to obtain a difference in the position of the change object that may occur in the virtual space V presented to the first user U1 and the second user U2. It can be resolved. As a result, the space sharing system S can harmonize the consistency of the virtual space V presented to the plurality of users U with the sensation of each user U.

[Configuration of user terminal 1]
(Displays a change object that changes with the operation of the first user U1)
Subsequently, the configuration of the user terminal 1 will be described with reference to FIG. The operation receiving unit 152 receives the operation of the first user U1 from the controller C1 via the second communication unit 12. The operation of the first user U1 is an operation for moving the first user object A1 indicating the first user U1, an operation for the first user object A1 to move a dynamic object, and the like. The operation of "the first user object A1 moving the dynamic object" is, for example, the operation of the first user object A1 throwing (releasing) the dynamic object.

The calculation unit 153 calculates change information for indicating the movement of the dynamic object based on the operation of the first user U1. For example, a physical model for applying a physical law equivalent to that in the real world to the virtual space V is preset in the dedicated application, and the calculation unit 153 calculates change information using the physical model.

For example, when the operation reception unit 152 accepts an operation for throwing a dynamic object, the calculation unit 153 first receives the first operation based on the launch angle of the dynamic object, the acceleration of the dynamic object, the gravity of the virtual space V, and the like. The change information for showing the movement from the time when the dynamic object is separated from the hand object included in the user object A1 until the dynamic object stops is calculated.

The firing angle of the dynamic object is calculated based on, for example, the movement of the hand object until the dynamic object separates from the hand object included in the first user object A1. The acceleration of the dynamic object is calculated, for example, based on the speed of movement of the hand object until the dynamic object separates from the hand object included in the first user object A1.

The display control unit 154 causes the display unit 13 to display the dynamic object based on the change information calculated based on the operation of the first user U1. The display control unit 154 causes the display unit 13 to display, for example, an image showing the movement of the dynamic object shown in FIG. 7A from the position P1 to the position P2.

When the first user object A1 that moves in response to the operation of the first user U1 received by the operation reception unit 152 moves the dynamic object, the transmission unit 155 includes the position coordinates of the operation object and the operation information. The user information is transmitted to the second user terminal 1b. The motion information is information for indicating that a dynamic object is moved, and is, for example, information for grabbing and releasing.

The transmission unit 155 transmits the update information to the second user terminal 1b based on the specific operation of the first user U1. Specifically, when the first user object A1 that moves in response to the operation of the first user U1 received by the operation reception unit 152 comes into contact with the dynamic object, the transmission unit 155 updates the update information to the second user terminal. Send to 1b.

The update information includes, for example, object identification information for identifying a dynamic object and position coordinates of the dynamic object. The transmission unit 155 may transmit the update information to the second user terminal 1b when the first user object A1 comes into contact with the dynamic object, or may send the update information together with the first user information to be transmitted at the first interval. 2 It may be transmitted to the user terminal 1b.

(Displays a change object that changes with the operation of the second user U2)
The calculation unit 153 calculates change information for indicating the movement of the dynamic object based on the second user information based on the second user U2 received from the second user terminal 1b by the reception unit 151. The second user information is information corresponding to the first user information. The calculation unit 153 calculates the change information for indicating the movement of the dynamic object, for example, when the change information includes the operation information indicating that the dynamic object is released. The calculation unit 153 determines that the dynamic object is separated from the hand object included in the second user object A2 based on, for example, the launch angle of the dynamic object, the acceleration of the dynamic object, the gravity of the virtual space V, and the like. Calculate change information to show the movement of the dynamic object until it stops.

The firing angle of the dynamic object is, for example, the movement of the hand object included in the second user object A2 indicated by the plurality of second user information received by the receiving unit 151 at the first interval, and the dynamic object is the hand. It is calculated based on the movement of the hand object until it leaves the object. The acceleration of the dynamic object is, for example, the speed of movement of the hand object included in the second user object A2 indicated by a plurality of second user information, and is the speed of the hand object until the dynamic object separates from the hand object. Calculated based on the speed of movement.

The display control unit 154 displays the dynamic object based on the movement of the dynamic object calculated by the calculation unit 153. The display control unit 154 causes the display unit 13 to display, for example, an image showing the movement of the dynamic object shown in FIG. 7B from the position Q1 to the position Q2.

When the receiving unit 151 receives the update information including the position coordinates of the dynamic object based on the specific operation of the second user U2, the display control unit 154 displays the change object based on the change information calculated by the calculation unit 153. The position of is updated based on the update information. For example, the display control unit 154 causes the display unit 13 to display the dynamic object updated from the position Q2 shown in FIG. 8B to the position Q3 shown in FIG. 8C.

Specifically, the display control unit 154 updates the position of the dynamic object displayed based on the movement of the dynamic object calculated by the calculation unit 153 based on the position coordinates of the dynamic object received by the reception unit 151. To do. More specifically, the display control unit 154 updates the position of the dynamic object corresponding to the object identification information included in the update information to the position coordinates included in the update information.

The display control unit 154 has the position coordinates of the dynamic object in the first virtual space V1 presented by the first user terminal 1a and the position coordinates of the dynamic object in the second virtual space V2 presented by the second user terminal 1b. If they are different, the position of the dynamic object that the second user object A2 touches may be updated based on the update information. Specifically, when the display control unit 154 is different from the position coordinates of the dynamic object displayed based on the change information calculated by the calculation unit 153 and the position coordinates of the dynamic object received by the reception unit 151. , Update the position of dynamic objects. By doing so, even if there is no difference in the position of the dynamic object in each virtual space V, the user terminal 1 executes the update process every time the user object A comes into contact with the dynamic object. The situation can be deterred.

[Processing of space sharing system S]
Subsequently, the processing flow of the space sharing system S in the second embodiment will be described. FIG. 9 is a sequence diagram showing a processing flow of the space sharing system S according to the second embodiment. This process is started as a process of the second user terminal 1b when the operation reception unit 152 receives an operation by the second user U2 from the controller C2 via the second communication unit 12 (S11). The operation by the second user U2 is, for example, an operation in which the second user object A2 throws a dynamic object.

As a process of the second user terminal 1b, the transmission unit 155 determines whether or not the second user object A2 that has moved in response to the operation of the second user U2 received by the operation reception unit 152 has come into contact with the dynamic object. (S12). When the transmission unit 155 determines that the second user object A2 is not in contact with the dynamic object (NO in S12), the transmission unit 155 uses the second user information including the position coordinates of the operation object and the operation information as the first user. It is transmitted to the terminal 1a (S13).

On the other hand, when the transmission unit 155 determines that the second user object A2 has touched the dynamic object (YES in S12), the position coordinates of the dynamic object that the second user object A2 has contacted and the dynamic Update information including the object identification information corresponding to the object is transmitted to the first user terminal 1a (S14).

As a process of the second user terminal 1b, the calculation unit 153 calculates change information for indicating the movement of the dynamic object based on the operation of the second user U2 (S15). The display control unit 154 causes the display unit 13 to display the dynamic object based on the change information calculated based on the operation of the first user U1 (S16).

When the receiving unit 151 receives the second user information from the second user terminal 1b via the first communication unit 11 as the process of the first user terminal 1a, the calculation unit 153 determines based on the second user information. Change information for showing the movement of the dynamic object is calculated (S17). As a process of the first user terminal 1a, the display control unit 154 causes the display unit 13 to display a dynamic object based on the change information calculated by the calculation unit 153 based on the second user information (S18).

When the receiving unit 151 receives the updated information from the second user terminal 1b via the first communication unit 11 as the process of the first user terminal 1a, the display control unit 154 is based on the change information calculated by the calculation unit 153. The position of the displayed dynamic object is updated based on the update information (S19).

[Effect in the second embodiment]
As described above, the user terminal 1 calculates the change information based on the second user information, and displays the change object based on the calculated change information. After that, the user terminal 1 updates the position of the change object displayed based on the change information based on the update information. In this way, the space sharing system S updates the position of the change object based on the update information to obtain a difference in the position of the change object that may occur in the virtual space V presented to the first user U1 and the second user U2. It can be resolved. As a result, the space sharing system S can harmonize the consistency of the virtual space V presented to the plurality of users U with the sensation of each user U.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist. is there. For example, all or a part of the device can be functionally or physically distributed / integrated in any unit. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination has the effect of the original embodiment.

1 User terminal 11 1st communication unit 12 2nd communication unit 13 Display unit 14 Storage unit 15 Control unit 151 Reception unit 152 Operation reception unit 153 Calculation unit 154 Display control unit 155 Transmission unit 2 Management device C Controller S Space sharing system U User V virtual space

Claims (11)

The computer used by the first user,
The second user uses, in said different other computers said second predetermined distance interval from reception interval is longer to receive an operation of the user from the computer, the other computer is predetermined based on the predetermined interval timing A receiver that receives the second user information based on the operation of the second user received in
Each time the receiving unit receives the second user information, a calculation unit that calculates change information of a change object that changes with the operation of the second user based on the second user information, and the change information. A display control unit that displays the change object on the display unit based on
To function as
The receiving unit receives the update information for updating the change information, and receives the update information.
The display control unit updates the change object displayed based on the change information calculated by the calculation unit based on the update information.
program. The second user information includes the position coordinates of the operation object based on the operation of the second user.
The update information is information for indicating the shape of the change object, and is
The calculation unit calculates the change information based on the position coordinates of the operation object.
The display control unit updates the shape of the change object displayed based on the change information calculated by the calculation unit based on the update information.
The program according to claim 1. The change object is a drawing object drawn based on the operation of the second user in the virtual space .
The calculation unit calculates the change information including the drawing position coordinates for drawing the drawing object in the virtual space based on the position coordinates of the operation object.
The display control unit displays the drawing object based on each drawing position coordinate calculated by the calculation unit.
The receiving unit receives the update information including the plurality of the drawing position coordinates, and receives the update information.
The display control unit updates the shape of the drawing object displayed based on the drawing position coordinates calculated by the calculation unit based on the plurality of drawing position coordinates received by the receiving unit.
The program according to claim 2. The receiving unit receives the second user information at the first interval, and receives the second user information.
The calculation unit calculates the drawing position coordinates each time the receiving unit receives the second user information.
The display control unit draws and displays the drawing object that connects the drawing position coordinates calculated by the calculation unit and the drawing position coordinates calculated immediately before the drawing position coordinates are calculated.
The receiving unit receives the update information including the plurality of drawing position coordinates calculated based on the operation of the second user received by the other computer at the second interval, which is shorter than the first interval. And
When the receiving unit receives the plurality of drawing position coordinates, the display control unit changes the shape of the first drawing object, which is the drawing object corresponding to the second user information, to the update information. The shape of the second drawing object, which is a drawing object and has a shorter interval between the drawing position coordinates than the first drawing object, is updated.
The program according to claim 3. The computer
A reception unit that accepts the operation of the first user, and a transmission unit that transmits the first user information based on the operation of the first user received by the reception unit to the other computer.
To function further as
The calculation unit calculates the change information based on the operation of the first user received by the reception unit and the operation of the first user object indicating the first user to change the shape of the change object. And
The transmission unit transmits the update information corresponding to the change information calculated by the calculation unit to the other computer.
The program according to any one of claims 2 to 4. The change object is a dynamic object that can move in the virtual space in accordance with the operation of the second user.
The update information is information for indicating the position of the dynamic object, and is
The display control unit updates the position of the dynamic object displayed based on the change information calculated by the calculation unit based on the update information.
The program according to claim 1. Before SL calculation unit, based on the second user information, to calculate the change information for indicating the movement of the dynamic object,
The display control unit displays the dynamic object based on the change information calculated by the calculation unit.
The receiving unit receives the updated information including the position coordinates of the dynamic object based on the specific operation of the second user.
The display control unit updates the position of the dynamic object displayed based on the movement of the dynamic object calculated by the calculation unit based on the position coordinates of the dynamic object received by the reception unit.
The program according to claim 6. When the position coordinates of the dynamic object displayed based on the change information calculated by the calculation unit and the position coordinates of the dynamic object received by the reception unit are different from each other, the display control unit may use the display control unit. Update the position of dynamic objects,
The program according to claim 7. The computer
The reception unit that accepts the operation for moving the first user object indicating the first user, and the first user object that moves in response to the operation of the first user accepted by the reception unit come into contact with the change object. In the case of a transmitter, which transmits the position coordinates of the change object to the other computer.
To function further,
The program according to any one of claims 6 to 8. A user terminal used by the first user
The second user uses the user terminal different from Yu chromatography The terminal said second predetermined distance interval from reception interval is longer to receive an operation of the user and the other computer is based on the predetermined distance A receiving unit that receives the second user information based on the operation of the second user received at a predetermined timing, and a receiving unit.
Each time the receiving unit receives the second user information, a calculation unit that calculates change information of a change object that changes with the operation of the second user based on the second user information.
A display control unit that displays the change object on the display unit based on the change information,
Have,
The receiving unit receives the update information for updating the change information, and receives the update information.
The display control unit updates the change object displayed based on the change information calculated by the calculation unit based on the update information.
User terminal. Executed by the computer used by the first user,
The second user uses, in the computer second predetermined distance interval from reception interval is longer accept a user operation using different other computers and the other computer is predetermined based on the predetermined distance A step of receiving the second user information based on the operation of the second user received at the timing, and
Each time the second user information is received , a step of calculating change information of a change object that changes with the operation of the second user based on the second user information, and
A step of displaying the change object on the display unit based on the change information,
In the step of receiving the update information for updating the change information,
A step of updating the change object displayed based on the calculated change information based on the update information, and
How to update an object with.

Images