JP2018097847A - Information processing method, and program for causing computer to execute the information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing method for improving virtual experience of a user in social VR, and a program for causing a computer to implement the information processing method.SOLUTION: An information processing method includes the steps of: generating virtual space data which specifies a virtual space 200A including an avatar 4A associated with a user terminal 1A and a virtual room 7A with the avatar 4A arranged therein; receiving a visit request signal indicating that an avatar 4C associated with a user terminal wants to visit the virtual room 7A, from the user terminal; determining whether to update the virtual room 7A, in accordance with the total number of the avatars 4A, 4B and 4C currently arranged in the virtual room 7A; and updating the virtual room 7A to update the size of the virtual room 7A when the virtual room 7A is determined to be updated.SELECTED DRAWING: Figure 13

Description

  The present disclosure relates to an information processing method and a program for causing a computer to execute the information processing method.

  A virtual space such as a VR (Virtual Reality) space, an AR (Augmented Reality) space, or an MR (Mixed Reality) space is connected between a plurality of users wearing a head mounted device (hereinafter simply referred to as HMD). The technology (social VR) to share via is known. For example, in Patent Document 1, after specifying the positional relationship between a plurality of users in the real space, based on the positional relationship between the specified plurality of users, a plurality of user characters (avatars) in the virtual space. A technique for determining the positional relationship is disclosed.

  On the other hand, Patent Document 2 discloses a technique for providing a virtual movie theater in a virtual space. In particular, in Patent Document 2, a virtual screen, a virtual video projector, and a specific element (virtual seat or the like) constituting a virtual movie theater are arranged in a virtual space, so that a user wearing an HMD can have a movie theater. A technique for providing a movie viewing experience is disclosed.

JP 2014-017776 A US Pat. No. 9,396,588

  By the way, in patent document 1, while the positional relationship between the several users with which HMD was mounted | worn in the social VR technique is paying attention, on which virtual room (a kind of object) where several user characters (avatar) are arrange | positioned There is no mention of how to control. Moreover, in patent document 2, it is not mentioned at all about how to control the virtual room where a social VR technique and a plurality of user characters are arranged.

  An object of the present disclosure is to provide an information processing method capable of improving a user's virtual experience in a social VR and a program for causing a computer to realize the information processing method.

According to one aspect of the present disclosure, there is provided an information processing method that is executed by a computer in a virtual space distribution system that includes a plurality of user terminals each having a head-mounted device mounted on a user's head and a server. Provided.
The information processing method includes:
(A) A first virtual space that defines a first virtual space including a first avatar associated with a first user terminal among the plurality of user terminals and a first virtual room in which the first avatar is arranged. Generating data; and
(B) receiving a visit request signal requesting that a second avatar associated with the second user terminal visits the first virtual room from a second user terminal of the plurality of user terminals; ,
(C) After the step (b), a step of determining whether or not the first virtual room should be updated according to the total number of avatars currently arranged in the first virtual room and the second avatar. When,
(D) updating the first virtual room to update the size of the first virtual room when it is determined that the first virtual room should be updated.

  According to the present disclosure, it is possible to provide an information processing method capable of improving a user's virtual experience in a social VR and a program for causing a computer to realize the information processing method.

It is the schematic which shows the virtual space delivery system which concerns on embodiment (henceforth this embodiment only) of this invention. It is the schematic which shows a user terminal. It is a figure which shows the head of the user with which HMD was mounted | worn. It is a figure which shows the hardware constitutions of a control apparatus. It is a flowchart which shows the process which displays a visual field image on HMD. It is xyz space figure which shows an example of virtual space. (A) is yx top view of the virtual space shown in FIG. FIG. 7B is a zx plan view of the virtual space illustrated in FIG. 6. It is a figure which shows an example of the visual field image displayed on HMD. It is a figure which shows the hardware constitutions of the server shown in FIG. (A) is a figure which shows the virtual space provided to the user A. FIG. (B) is a figure which shows the virtual space provided to the user B. FIG. It is a sequence figure for explaining an example of processing which synchronizes movement of each avatar between user terminals. It is a sequence diagram (the 1) for explaining an example of the information processing method concerning this embodiment. It is a sequence diagram (the 2) for demonstrating an example of the information processing method which concerns on this embodiment. (A) is a figure which shows the virtual space provided to the user A. FIG. (B) is a figure which shows the virtual space provided to the user C. FIG. (A) is a figure which shows a mode that the virtual room of the user's A avatar was expanded because the avatar of the user C visited the virtual room of the user's A avatar. (B) It is a figure which shows a mode that the virtual space of the avatar of the user C was updated when the avatar of the user C visited the virtual room of the user A's avatar. It is a sequence diagram for demonstrating an example of the process which views video content. (A) is a figure which shows an example of a video content charge table. (B) is a figure which shows an example of an accounting table. It is a sequence diagram for demonstrating an example of the process which expands a virtual screen. (A) is a figure which shows the virtual space provided to the user A before a virtual screen expands. (B) is a figure which shows the virtual space provided to the user A after a virtual screen is expanded.

[Description of Embodiments Presented by the Present Disclosure]
An overview of an embodiment indicated by the present disclosure will be described.
(1) An information processing method executed by a computer in a virtual space distribution system including a plurality of user terminals each having a head-mounted device mounted on a user's head and a server,
The information processing method includes:
(A) A first virtual space that defines a first virtual space including a first avatar associated with a first user terminal among the plurality of user terminals and a first virtual room in which the first avatar is arranged. Generating data; and
(B) receiving a visit request signal requesting that a second avatar associated with the second user terminal visits the first virtual room from a second user terminal of the plurality of user terminals; ,
(C) After the step (b), a step of determining whether or not the first virtual room should be updated according to the total number of avatars currently arranged in the first virtual room and the second avatar. When,
And (d) updating the first virtual room so as to update the size of the first virtual room when it is determined that the first virtual room should be updated.

  According to the above method, it is determined whether or not the first virtual room should be updated according to the total number of the avatars currently arranged in the first virtual room and the second avatar, and the first virtual room should be updated. Is determined, the size of the first virtual room is updated. Thus, since the size of the virtual room is updated according to the number of avatars existing in the virtual room, it is possible to provide a virtual experience according to the number of avatars. Therefore, it is possible to provide an information processing method that can improve the virtual experience of the user in the social VR.

  (2) Item (1), wherein the first avatar is placed in the updated first virtual room so that a relative positional relationship between the first avatar and the first virtual room is maintained. Information processing method described in 1.

  According to the above method, the first avatar is placed in the updated first virtual room so that the relative positional relationship between the first avatar and the first virtual room is maintained. As described above, since the first user's viewpoint (the position of the first avatar) is prevented from being largely changed before and after the first virtual room is updated, the VR sickness of the first user is preferably prevented. It becomes possible.

(3) The first virtual room includes a first virtual screen on which a moving image is displayed,
The step (d) includes the step of updating the first virtual room so that the size of the first virtual screen is enlarged in accordance with the enlargement of the size of the first virtual room. The information processing method described in).

  According to the above method, the size of the first virtual screen is increased in accordance with the increase in the size of the first virtual room. In this way, the size of the first virtual screen is increased according to the number of avatars present in the first virtual room, so that many users enjoy watching the same video (video content, etc.) in the same virtual room. Can be encouraged. Therefore, it is possible to promote a virtual room visit (social VR) between users.

(4) The first virtual room includes a first virtual screen on which a moving image is displayed,
(E) receiving, from the first user terminal, a screen enlargement request signal requesting to enlarge the size of the first virtual screen to a predetermined size;
(F) updating the first virtual screen so as to enlarge the size of the first virtual screen to the predetermined size in response to the screen enlargement request signal. The information processing method according to any one of 3).

  According to the above method, the size of the first virtual screen is enlarged to a predetermined size in response to the screen enlargement request signal. In this way, even if there is no avatar that visits the first virtual room, the first user can enjoy watching moving images such as video content on a large virtual screen.

(5) (g) further including a step of determining a charge amount charged to the first user by viewing the moving image by the first user wearing the head mounted device of the first user terminal,
The information processing method according to item (4), wherein the step (g) includes a step of updating a charge amount charged to the first user in response to the screen enlargement request signal.

  According to the above method, the charge amount charged to the first user is updated in response to the screen enlargement request signal. Thus, for example, even if there is no avatar to visit in the first virtual room, the first user can enjoy watching a video such as video content on a large virtual screen by paying a predetermined amount. .

(6) The step (d) includes a step of updating the first virtual room so that the size of the first virtual screen is enlarged in accordance with the enlargement of the size of the first virtual room,
The first billing amount charged to the first user when the size of the first virtual screen is enlarged to a predetermined size in accordance with the enlargement of the size of the first virtual room depends on the screen enlargement request signal The information processing method according to item (5), wherein the information is cheaper than a second charge amount charged to the first user when the size of the first virtual screen is enlarged to the predetermined size.

  According to the above method, the first charge amount charged to the first user when the size of the first virtual screen is enlarged to a predetermined size (for example, M size) in accordance with the enlargement of the size of the first virtual room. Is cheaper than the second charge amount charged to the first user when the size of the first virtual screen is enlarged to the predetermined size (for example, M size) in response to the screen enlargement request signal. Therefore, it is possible to encourage a large number of users to enjoy viewing the same moving image (video content or the like) in the same virtual room. Therefore, it is possible to promote a virtual room visit (social VR) between users.

  (7) A program for causing a computer to execute the information processing method according to any one of items (1) to (6).

  According to the above, it is possible to provide a program that can improve the virtual experience of the user in the social VR.

[Details of Embodiments Presented by the Present Disclosure]
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In addition, about the member which has the same reference number as the member already demonstrated in description of this embodiment, the description is not repeated for convenience of explanation.

  First, an outline of the configuration of the virtual space distribution system 100 (or social VR system) will be described with reference to FIG. FIG. 1 is a schematic diagram of a virtual space distribution system 100 (hereinafter simply referred to as distribution system 100). As shown in FIG. 1, the distribution system 100 includes a user terminal 1A operated by a user A, a user terminal 1B operated by a user B, a user terminal C operated by a user C, and a server 2. . User terminals 1A to 1C are communicably connected to a server 2 via a communication network 3 such as the Internet. In the present embodiment, the virtual space includes a VR (Virtual Reality) space, an AR (Argumented Reality) space, and an MR (Mixed Reality) space. In addition, hereinafter, for convenience of explanation, the user terminals 1A to 1C may be simply referred to as the user terminal 1 in some cases. Furthermore, the users A to C may be collectively referred to simply as a user U. In the present embodiment, the user terminals 1A to 1C are assumed to have the same configuration.

  Next, the configuration of the user terminal 1 will be described with reference to FIG. FIG. 2 is a schematic diagram showing the user terminal 1. As shown in FIG. 2, the user terminal 1 includes a head mounted device (HMD) 110, a headphone 116, a microphone 118, a position sensor 130, an external controller 320, and a control device mounted on the user U's head. 120.

  The HMD 110 includes a display unit 112, an HMD sensor 114, and a gaze sensor 140. The display unit 112 includes a non-transmissive display device configured to completely cover the field of view (field of view) of the user U wearing the HMD 110. Thereby, the user U can immerse in the virtual space by viewing only the visual field image displayed on the display unit 112. The display unit 112 may include a left-eye display unit configured to provide an image for the left eye of the user U and a right-eye display unit configured to provide an image for the right eye of the user U. . Further, the HMD 110 may include a transmissive display device. In this case, the transmissive display device may be temporarily configured as a non-transmissive display device by adjusting the transmittance.

  The HMD sensor 114 is mounted in the vicinity of the display unit 112 of the HMD 110. The HMD sensor 114 includes at least one of a geomagnetic sensor, an acceleration sensor, and a tilt sensor (such as an angular velocity sensor and a gyro sensor), and can detect various movements of the HMD 110 mounted on the head of the user U.

  The gaze sensor 140 has an eye tracking function that detects the direction of the line of sight of the user U. The gaze sensor 140 may include, for example, a right eye gaze sensor and a left eye gaze sensor. The right eye gaze sensor irradiates, for example, infrared light to the right eye of the user U, and detects reflected light reflected from the right eye (particularly the cornea and iris), thereby acquiring information related to the rotation angle of the right eye's eyeball. May be. On the other hand, the left eye gaze sensor irradiates the left eye of the user U with, for example, infrared light, and detects reflected light reflected from the left eye (particularly the cornea and iris), thereby providing information on the rotation angle of the left eye's eyeball. May be obtained.

  The headphones 116 are respectively attached to the left ear and the right ear of the user U. The headphones 116 are configured to receive audio data (electrical signals) from the control device 120 and output audio based on the received audio data. The microphone 118 is configured to collect the voice uttered by the user U and generate voice data (electrical signal) based on the collected voice. Furthermore, the microphone 118 is configured to transmit audio data to the control device 120.

  The position sensor 130 is configured by, for example, a position tracking camera, and is configured to detect the positions of the HMD 110 and the external controller 320. The position sensor 130 is communicably connected to the control device 120 by wireless or wired communication, and is configured to detect information on the position, inclination, or light emission intensity of a plurality of detection points (not shown) provided in the HMD 110. . Further, the position sensor 130 is configured to detect information on the position, inclination and / or light emission intensity of a plurality of detection points (not shown) provided in the external controller 320. The detection point is, for example, a light emitting unit that emits infrared light or visible light. The position sensor 130 may include an infrared sensor and a plurality of optical cameras.

  The external controller 320 is used, for example, to control the movement of the finger object displayed in the virtual space. The external controller 320 may include a right-handed external controller used by the user U with the right hand and a left-handed external controller used by the user U with the left hand.

  The control device 120 acquires the position information of the HMD 110 based on the information acquired from the position sensor 130, and based on the acquired position information, a virtual camera (or an avatar related to the user U) in the virtual space. And the position of the user U wearing the HMD 110 in the real space can be accurately associated with each other. Further, the control device 120 acquires the operation information of the external controller 320 based on the information acquired from the position sensor 130, and based on the acquired operation information, the finger object (user) displayed in the virtual space. The motion of the avatar's fingers related to U) and the motion of the external controller 320 in the real space can be accurately associated.

  Further, the control device 120 specifies the gaze of the right eye and the gaze of the left eye of the user U based on the information transmitted from the gaze sensor 140, and determines the gaze point that is the intersection of the gaze of the right eye and the gaze of the left eye. Can be identified. Furthermore, the control device 120 can specify the line-of-sight direction of the user U based on the specified gaze point. Here, the line-of-sight direction of the user U is the line-of-sight direction of both eyes of the user U and coincides with the direction of a straight line passing through the middle point of the line segment connecting the right eye and the left eye of the user U and the gazing point. The control device 120 can specify the direction of the black eye of the avatar related to the user U based on the line-of-sight direction of the user U.

  Next, with reference to FIG. 3, a method for acquiring information related to the position and inclination of the HMD 110 will be described. FIG. 3 is a diagram illustrating the head of the user U wearing the HMD 110. Information on the position and inclination of the HMD 110 that is linked to the movement of the head of the user U wearing the HMD 110 can be detected by the position sensor 130 and / or the HMD sensor 114 mounted on the HMD 110. As shown in FIG. 2, three-dimensional coordinates (uvw coordinates) are defined centering on the head of the user U wearing the HMD 110. The vertical direction in which the user U stands up is defined as the v-axis, the direction orthogonal to the v-axis and passing through the center of the HMD 110 is defined as the w-axis, and the direction orthogonal to the v-axis and the w-axis is defined as the u-axis. The position sensor 130 and / or the HMD sensor 114 is an angle around each uvw axis (that is, a yaw angle indicating rotation around the v axis, a pitch angle indicating rotation around the u axis, and a center around the w axis). The inclination determined by the roll angle indicating rotation) is detected. The control device 120 determines angle information for controlling the visual axis of the virtual camera based on the detected angle change around each uvw axis.

  Next, the hardware configuration of the control device 120 will be described with reference to FIG. FIG. 4 is a diagram illustrating a hardware configuration of the control device 120. As illustrated in FIG. 4, the control device 120 includes a control unit 121, a storage unit 123, an I / O (input / output) interface 124, a communication interface 125, and a bus 126. The control unit 121, the storage unit 123, the I / O interface 124, and the communication interface 125 are connected to each other via a bus 126 so as to communicate with each other.

  The control device 120 may be configured as a personal computer, a tablet, or a wearable device separately from the HMD 110, or may be built in the HMD 110. In addition, some functions of the control device 120 may be mounted on the HMD 110, and the remaining functions of the control device 120 may be mounted on another device separate from the HMD 110.

  The control unit 121 includes a memory and a processor. The memory includes, for example, a ROM (Read Only Memory) in which various programs are stored, a RAM (Random Access Memory) having a plurality of work areas in which various programs executed by the processor are stored, and the like. The processor is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and / or a GPU (Graphics Processing Unit), and a program specified from various programs embedded in the ROM is expanded on the RAM. It is comprised so that various processes may be performed in cooperation with.

  In particular, the control unit 121 may control various operations of the control device 120 by a processor developing a control program on a RAM and executing the control program in cooperation with the RAM. The control unit 121 displays a field image on the display unit 112 of the HMD 110 based on the field image data. Thereby, the user U can be immersed in the virtual space.

  The storage unit (storage) 123 is a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a USB flash memory, and is configured to store programs and various data. The storage unit 123 may store a control program for causing a computer to execute at least a part of the information processing method according to the present embodiment, or a control program for realizing social VR. Further, the storage unit 123 may store data related to the user U authentication program, various images, and objects (for example, a virtual room and an avatar). Furthermore, a database including tables for managing various data may be constructed in the storage unit 123.

  The I / O interface 124 is configured to connect the position sensor 130, the HMD 110, the external controller 320, the headphones 116, and the microphone 118 to the control device 120 so that they can communicate with each other, for example, a USB (Universal) The terminal includes a serial bus (D) terminal, a digital visual interface (DVI) terminal, a high-definition multimedia interface (HDMI) (registered trademark) terminal, and the like. The control device 120 may be wirelessly connected to each of the position sensor 130, the HMD 110, the external controller 320, the headphones 116, and the microphone 118.

  The communication interface 125 is configured to connect the control device 120 to a communication network 3 such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. The communication interface 125 includes various wired connection terminals for communicating with an external device such as the server 2 via the communication network 3 and various processing circuits for wireless connection, and communicates via the communication network 3. It is configured to conform to the communication standard.

  Next, processing for displaying a field-of-view image on the HMD 110 will be described with reference to FIGS. FIG. 5 is a flowchart showing a process for displaying the visual field image on the HMD 110. FIG. 6 is an xyz space diagram showing an example of the virtual space 200. The state (a) in FIG. 7 is a yx plan view of the virtual space 200 shown in FIG. The state (b) in FIG. 7 is a zx plan view of the virtual space 200 shown in FIG. FIG. 8 is a diagram illustrating an example of the visual field image V displayed on the HMD 110.

  As illustrated in FIG. 5, in step S <b> 1, the control unit 121 (see FIG. 4) generates virtual space data indicating the virtual space 200 including the virtual camera 300 and various objects. As shown in FIG. 6, the virtual space 200 is defined as an omnidirectional sphere centered on the center position 210 (in FIG. 6, only the upper half celestial sphere is shown). In the virtual space 200, an xyz coordinate system with the center position 210 as the origin is set. The virtual camera 300 defines a visual axis L for specifying the visual field image V (see FIG. 8) displayed on the HMD 110. The uvw coordinate system that defines the visual field of the virtual camera 300 is determined so as to be linked to the uvw coordinate system that is defined around the head of the user U in the real space. Further, the control unit 121 may move the virtual camera 300 in the virtual space 200 in conjunction with the movement of the user U wearing the HMD 110 in the real space.

  Next, in step S <b> 2, the control unit 121 specifies the field of view CV (see FIG. 7) of the virtual camera 300. Specifically, the control unit 121 acquires information on the position and inclination of the HMD 110 based on data indicating the state of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114. Next, the control unit 121 identifies the position and orientation of the virtual camera 300 in the virtual space 200 based on information regarding the position and tilt of the HMD 110. Next, the control unit 121 determines the visual axis L of the virtual camera 300 from the position and orientation of the virtual camera 300 and specifies the visual field CV of the virtual camera 300 from the determined visual axis L. Here, the visual field CV of the virtual camera 300 corresponds to a part of the virtual space 200 visible to the user U wearing the HMD 110 (in other words, a part of the virtual space 200 displayed on the HMD 110). Equivalent to Further, the visual field CV includes a first region CVa set as an angular range of the polar angle α around the visual axis L in the xy plane shown in the state (a) of FIG. 7, and the state (b) of FIG. 7. The xz plane shown has a second region CVb set as an angle range of the azimuth angle β with the visual axis L as the center. The control unit 121 identifies the line of sight of the user U based on the data indicating the line of sight of the user U transmitted from the gaze sensor 140, and determines the direction of the virtual camera 300 based on the line of sight of the user U. May be.

  As described above, the control unit 121 can specify the visual field CV of the virtual camera 300 based on the data from the position sensor 130 and / or the HMD sensor 114. Here, when the user U wearing the HMD 110 moves, the control unit 121 changes the visual field CV of the virtual camera 300 based on the data indicating the movement of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114. be able to. That is, the control unit 121 can change the visual field CV according to the movement of the HMD 110. Similarly, when the line-of-sight direction of the user U changes, the control unit 121 may move the visual field CV of the virtual camera 300 based on data indicating the line-of-sight direction of the user U transmitted from the gaze sensor 140. That is, the control unit 121 may change the visual field CV in accordance with the change in the user U's line-of-sight direction.

  Next, in step S <b> 3, the control unit 121 generates visual field image data indicating the visual field image V displayed on the display unit 112 of the HMD 110. Specifically, the control unit 121 generates visual field image data based on virtual space data defining the virtual space 200 and the visual field CV of the virtual camera 300.

  Next, in step S4, the control unit 121 displays the field image V on the display unit 112 of the HMD 110 based on the field image data (see FIG. 7). As described above, the visual field CV of the virtual camera 300 is changed according to the movement of the user U wearing the HMD 110, and the visual field image V displayed on the display unit 112 of the HMD 110 is changed. I can immerse myself in 200.

  Note that the virtual camera 300 may include a left-eye virtual camera and a right-eye virtual camera. In this case, the control unit 121 generates left-eye view image data indicating the left-eye view image based on the virtual space data and the view of the left-eye virtual camera. Further, the control unit 121 generates right-eye view image data indicating a right-eye view image based on the virtual space data and the view of the right-eye virtual camera. Thereafter, the control unit 121 displays the left-eye field image on the left-eye display unit based on the left-eye field image data, and also displays the right-eye field image on the right-eye display unit based on the right-eye field image data. Is displayed. In this way, the user U can visually recognize the visual field image three-dimensionally due to the parallax between the left-eye visual field image and the right-eye visual field image. As will be described later, the virtual camera may be arranged at the position of the avatar eye operated by the user. For example, the left-eye virtual camera may be placed in the left eye of the avatar, while the right-eye virtual camera may be placed in the right eye of the avatar.

  Next, the hardware configuration of the server 2 shown in FIG. 1 will be described with reference to FIG. FIG. 9 is a diagram illustrating a hardware configuration of the server 2. As shown in FIG. 9, the server 2 includes a control unit 23, a storage unit 22, a communication interface 21, and a bus 24. The control unit 23, the storage unit 22, and the communication interface 21 are communicably connected to each other via a bus 24. The control unit 23 includes a memory and a processor. The memory is composed of, for example, a ROM and a RAM, and the processor is composed of, for example, a CPU, an MPU, and / or a GPU.

  The storage unit (storage) 22 is, for example, a large-capacity HDD. The storage unit 22 may store a control program for causing a computer to execute at least a part of the information processing method according to the present embodiment, or a control program for realizing a social VR. Moreover, the memory | storage part 22 may store the data regarding the user management information for managing each user, various images, and objects (for example, a virtual room, an avatar, etc.). Further, the storage unit 22 may store the video content fee table and the billing table shown in FIG. 16 as a database. The communication interface 21 is configured to connect the server 2 to the communication network 3.

  Next, an example of processing for synchronizing the movements of the avatars 4A and 4B between the user terminal 1A and the user terminal 1B will be described with reference to FIGS. The state (a) in FIG. 10 is a diagram showing the virtual space 200A provided to the user A. The state (b) in FIG. 10 is a diagram showing the virtual space 200B provided to the user B. FIG. 11 is a sequence diagram for explaining an example of processing for synchronizing the movements of the avatars 4A and 4B between the user terminal 1A and the user terminal 1B. In this description, as a precondition, as shown in FIG. 10, an avatar 4A associated with the user terminal 1A (user A) and an avatar 4B associated with the user terminal 1B (user B) are added to the virtual room 7A of the avatar 4A. It is assumed that it is arranged. That is, it is assumed that the user A and the user B share one virtual room 7A via the network 3 when the user B visits the virtual room 7A of the user A.

  As shown in the state (a) of FIG. 10, the virtual space 200A of the user A includes an avatar 4A, an avatar 4B, and a virtual room 7A in which the avatars 4A and 4B are arranged. The avatar 4A is operated by the user A and interlocked with the operation of the user A. The avatar 4B is operated by the user B and interlocked with the operation of the user B. For example, the position of the avatar 4A (4B) may be specified according to the position of the HMD 110 of the user A (user B). Similarly, the face orientation of the avatar 4A (4B) may be specified according to the inclination of the HMD 110 of the user A (user B). Furthermore, the movement of the hand of the avatar 4A (4B) may be specified according to the movement of the external controller. The line of sight (for example, the position of the black eye) of the avatar 4A (4B) may be specified according to the line of sight of the user A (user B) detected by the gaze sensor 140. Moreover, the virtual camera 300 (FIG. 6) may be arrange | positioned at the eyes of avatar 4A (4B). Specifically, a left-eye virtual camera may be disposed on the left eye of the avatar 4A (4B), and a right-eye virtual camera may be disposed on the right eye of the avatar 4A (4B). In the following description, it is assumed that the virtual camera 300 is placed in the eyes of the avatar 4A (4B).

  The virtual room 7A includes a virtual table 5A and a virtual screen 6A configured to display video content (moving images). The user A (B) can enjoy the video content displayed on the virtual screen 6 </ b> A through the visual field image displayed on the HMD 110. User A may have various types of virtual rooms arranged in the virtual space 200A. The plurality of virtual rooms held by the user A may be stored, for example, in the storage unit 123 of the user terminal A or the storage unit 22 of the server 2. For example, the user A can change a predetermined virtual room arranged in the virtual space to another virtual room.

  As shown in the state (b) of FIG. 10, the virtual space 200B of the user B includes an avatar 4A, an avatar 4B, and a virtual room 7A in which the avatars 4A and 4B are arranged. Before the avatar 4B visits the virtual room 7A of the avatar 4A, the virtual room of the avatar 4B is arranged in the virtual space 200B.

  Next, referring to FIG. 11, in step S <b> 10, the control unit 121 of the user terminal 1 </ b> A generates control information of the avatar 4 </ b> A and transmits the generated control information of the avatar 4 </ b> A to the server 2. Thereafter, the control unit 23 of the server 2 receives the control information of the avatar 4A from the user terminal 1A (step S11). Here, the control information of the avatar 4A is information necessary for controlling the operation of the avatar 4A. For example, the information related to the position of the avatar 4A, the information related to the face direction of the avatar 4A, and the hand of the avatar 4A. And information regarding the movement of the avatar 4A.

  Next, in step S <b> 12, the control unit 121 of the user terminal 1 </ b> B generates control information for the avatar 4 </ b> B and transmits the generated control information for the avatar 4 </ b> B to the server 2. Thereafter, the control unit 23 of the server 2 receives the control information of the avatar 4B from the user terminal 1B (step S13). Here, the control information of the avatar 4B is information necessary for controlling the operation of the avatar 4B. For example, the information related to the position of the avatar 4B, the information related to the face direction of the avatar 4B, and the hand of the avatar 4B. And information regarding the movement of the avatar 4B.

  Next, the server 2 transmits the control information of the avatar 4B to the user terminal 1A (step S14), and transmits the control information of the avatar 4A to the user terminal 1B (step S18). Then, after receiving the control information of the avatar 4B in step S15, the control unit 121 of the user terminal 1A indicates the virtual space 200A (see the state (a) in FIG. 10) based on the control information of the avatars 4A and 4B. The virtual space data is updated (step S16). For example, when the avatars 4A and 4B move, virtual space data indicating a virtual space including the moved avatars 4A and 4B and the virtual room 7A is generated. Thereafter, the control unit 121 of the user terminal 1A specifies the visual field CV (see FIG. 7) of the virtual camera 300 according to the position and inclination of the HMD 110, and then updates the virtual space data and the visual field CV of the virtual camera 300. Based on the above, the visual field image displayed on the HMD 110 is updated (step S17).

  On the other hand, after receiving the control information of the avatar 4A in step S19, the control unit 121 of the user terminal 1B shows the virtual space 200B (see the state (b) in FIG. 10) based on the control information of the avatars 4A and 4B. The virtual space data is updated (step S20). Thereafter, the control unit 121 of the user terminal 1B specifies the visual field CV of the virtual camera 300 according to the position and inclination of the HMD 110, and then, based on the updated virtual space data and the visual field CV of the virtual camera 300, The visual field image displayed on the HMD 110 is updated (step S21).

  In the present embodiment, after the user terminals 1A and 1B transmit the control information of the avatar 4A and the control information of the avatar 4B to the server 2, the server 2 transmits the control information of the avatar 4A to the user terminal 1B, while the avatar 4B. Is transmitted to the user terminal 1A. In this way, it is possible to synchronize the movements of the avatars 4A and 4B between the user terminal 1A and the user terminal 1B. Each process shown in FIG. 11 may be executed for each frame.

  Moreover, when synchronizing the motion of each avatar 4A-4C between user terminal 1A-1C, the user terminal 1A transmits the control information of the avatar 4A to the server 2, and the user terminal 1B transmits the control information of the avatar 4B to the server. 2, the user terminal 1 </ b> C transmits the control information of the avatar 4 </ b> C to the server 2. Thereafter, the server 2 transmits control information of the avatars 4A and 4C to the user terminal 1B, transmits control information of the avatars 4B and 4C to the user terminal 1A, and transmits control information of the avatars 4A and 4B to the user terminal 1C. .

  Next, the information processing method according to the present embodiment will be described with reference to FIGS. 12A to 14. FIG. 12A is a sequence diagram (part 1) for explaining an example of the information processing method according to the present embodiment. FIG. 12B is a sequence diagram (part 2) for explaining an example of the information processing method according to the present embodiment. The state (a) in FIG. 13 is a diagram showing the virtual space 200A provided to the user A (before the visit of the avatar 4C). The state (b) of FIG. 13 is a diagram showing the virtual space 200C provided to the user C (before the visit of the avatar 4C). The state (a) of FIG. 14 is a diagram illustrating a state in which the virtual room of the avatar 4A is expanded by the avatar 4C visiting the virtual room of the avatar 4A. The state (b) of FIG. 14 is a diagram illustrating a state in which the virtual space of the avatar 4C is updated when the avatar 4C visits the virtual room of the avatar 4A.

  In this description, as an initial condition, it is assumed that the avatar 4A and the avatar 4B are arranged in the virtual room 7A of the avatar 4A as shown in the state (a) of FIG. That is, it is assumed that the avatar 4B is visiting the virtual room 7A of the avatar 4A. On the other hand, as shown in the state (b) of FIG. 13, it is assumed that the avatar 4C associated with the user terminal 1C (user C) is arranged in the virtual room 7C of the avatar 4C. Thereafter, it is assumed that the avatar 4C visits the virtual room 7A of the user A.

  As shown in the state (a) of FIG. 13, the virtual space 200A (first virtual space) of the user A includes an avatar 4A (first avatar) associated with the user terminal 1A (first user terminal) and the user terminal. It includes an avatar 4B associated with 1B and a virtual room 7A (first virtual room). As already described, the avatar 4A is operated by the user A (first user) and interlocked with the operation of the user A. The avatar 4B is operated by the user B and interlocked with the operation of the user B. The virtual room 7A includes a virtual table 5A and a virtual screen 6A (first virtual screen). The size of the virtual room 7A is S (small) size. Virtual space data (first virtual space data) indicating the virtual space 200A is generated by the control unit 121 of the user terminal 1A.

  Moreover, as shown in the state (b) of FIG. 13, in the virtual space 200C of the user C, an avatar 4C (second avatar) associated with the user terminal 1C (second user terminal) and an avatar 4C are arranged. Virtual room 7C. The avatar 4C is operated by the user C (second user) and interlocked with the operation of the user C. Virtual space data indicating the virtual space 200C is generated by the control unit 121 of the user terminal 1C.

  Next, referring to FIG. 12A, in step S30, the user C performs a predetermined operation input for visiting the virtual room 7A of the avatar A. For example, the user C selects an item such as “Visit a virtual room of avatar A” in a menu screen displayed on the HMD 110. Thereafter, the control unit 121 of the user terminal 1C generates a visit request signal that requests that the avatar 4C visit the virtual room 7A of the avatar 4A according to the operation input from the user C, and then transmits the visit request signal to the server 2 to send.

Next, in step S31, the control unit 23 of the server 2 receives a visit request signal from the user terminal 1C. Thereafter, the control unit 23 should update the virtual room 7A according to the total number N of the avatars currently arranged in the virtual room 7A and the avatars that will visit the virtual room 7A, that is, expand the virtual room 7A. It is determined whether or not to be performed (step S32). The relationship between the total number N of avatars currently arranged in the virtual room and avatars that will visit the virtual room and the size of the virtual room is, for example, as follows.

  A table indicating the relationship between the total number N of avatars and the size of the virtual room shown in Table 1 may be stored in the storage unit 22 of the server 2. In this example, the number of avatars currently arranged in the virtual room 7A is two (avatars 4A and 4B), and the number of avatars that will visit the virtual room 7A from now on is one (avatar 4C). Therefore, the control unit 23 specifies the total number N of avatars as 3. Thereafter, the control unit 23 should change the size of the virtual room of the avatar 4A from the S size to the M size based on the table indicating the relationship between the total number of avatars N = 3 and the size of the virtual room. That is, it is determined that the size of the virtual room of the avatar 4A should be enlarged (YES in step S32).

  Thereafter, the control unit 23 acquires the M-size virtual room 70A (see FIG. 14) from the storage unit 22, and then the M-size virtual room 70A (the enlarged first virtual room) and the avatars 4A and 4B. The control information of the avatars 4A and 4B is transmitted to the user terminal 1C (step S33). In addition, although not described in FIG. 12, the server 2 shall acquire the control information of avatar 4A-4C for every frame. The virtual room 7A is an S size virtual room of the avatar 4A, and the virtual room 70A is an M size virtual room of the avatar 4A.

  In Step S34, control part 121 of user terminal 1C receives control information of virtual room 70A, avatars 4A and 4B, and avatars 4A and 4B. Thereafter, the control unit 121 updates the virtual space data indicating the virtual space 200C (see the state (b) in FIG. 13) based on the control information of the virtual room 70A, the avatars 4A to 4C, and the avatars 4A to 4C. (Step S35). Specifically, the control unit 121 generates virtual space data indicating the virtual space 220C shown in the state (b) of FIG. As shown in the state (b) of FIG. 14, the virtual space 220C includes avatars 4A, 4B, 4C and a virtual room 70A. The virtual room 70A includes a virtual table 5A and a virtual screen 60A (enlarged first virtual screen).

  Thereafter, the control unit 121 of the user terminal 1C specifies the visual field CV (see FIG. 7) of the virtual camera 300 according to the position and inclination of the HMD 110, and then the updated virtual space data and the visual field CV of the virtual camera 300. Based on the above, the visual field image displayed on the HMD 110 is updated (step S36). As described above, when the user C performs a predetermined operation input for visiting the virtual room 7A of the avatar A, the virtual space presented to the user C includes the virtual space 200C including the virtual room 7C (the state in FIG. 13 ( b)) to the virtual space 220C including the virtual room 70A of the avatar 4A (see the state (b) of FIG. 14), the avatar 4C can visit the virtual room of the avatar 4A.

  On the other hand, in step S37, the control unit 23 transmits the control information of the M size virtual room 70A (the enlarged first virtual room), the avatar 4C, and the avatars 4C and 4B to the user terminal 1A. Next, in step S38, the control unit 121 of the user terminal 1A receives the control information of the virtual room 70A, the avatar 4C, and the avatars 4C and 4B. Thereafter, the control unit 121 updates the virtual space data indicating the virtual space 200A (see the state (a) in FIG. 13) based on the control information of the virtual room 70A, the avatars 4A to 4C, and the avatars 4A to 4C. (Step S39). Specifically, the control unit 121 generates virtual space data indicating the virtual space 220A shown in the state (a) of FIG. As shown in the state (a) of FIG. 14, the virtual space 220A includes avatars 4A, 4B, 4C and a virtual room 70A. The virtual room 70A includes a table 5A and a virtual screen 60A (enlarged first virtual screen).

  As shown in the state (a) of FIG. 13 and the state (a) of FIG. 14, the virtual room of the avatar 4A is updated from the virtual room 7A to the virtual room 70A so that the size of the virtual room of the avatar 4A is enlarged. Then, the virtual screen for displaying the video content is also updated from the virtual screen 6A (S size) to the virtual screen 60A (M size). That is, as the size of the virtual room increases, the size of the virtual screen arranged in the virtual room also increases. Thus, as the total number N of avatars increases, the size of the virtual room is increased and the size of the virtual screen is also increased, so that a large number of users (avatars) are displayed on the virtual screen in the same virtual room. To enjoy viewing the same video content. Therefore, it is possible to promote a virtual room visit (social VR) between users. Note that the size of furniture (for example, a table) arranged in the virtual room may be increased in accordance with the increase in the size of the virtual room.

  Further, as shown in the state (a) of FIG. 13 and the state (a) of FIG. 14, the avatars 4A and 4B are maintained so that the relative positional relationship between the avatars 4A and 4B and the virtual room 7A is maintained. Arranged in the virtual room 70A. Specifically, the relative positions of the avatars 4A and 4B with respect to the center point of the virtual room 70A (or the coordinate space set for the virtual room 70A) are set to the center point of the virtual room 7A (or the virtual room 7A). It substantially matches the relative position of the avatars 4A and 4B with respect to the coordinate space. As described above, the viewpoint of the user A (the position of the avatar 4A where the virtual camera is arranged) is prevented from being largely changed before and after the virtual room of the avatar 4A is updated from the virtual room 7A to the virtual room 70A. Therefore, it is possible to suitably prevent user A's VR sickness. The avatar 4C visiting the virtual room of the avatar 4A may be arranged at a predetermined position (in this example, a predetermined position between the avatar 4A and the avatar 4B) of the virtual room 70A.

  Returning to FIG. 12A, after that, the control unit 121 of the user terminal 1 </ b> A specifies the visual field CV (see FIG. 7) of the virtual camera 300 according to the position and inclination of the HMD 110, and the updated virtual space data, Based on the visual field CV of the virtual camera 300, the visual field image displayed on the HMD 110 is updated (step S40).

  In FIG. 12A, only the operation process of the server 2 and the user terminals 1A and 1C is described for convenience of explanation, but the server 2 also includes the virtual room 70A, the avatar C, and the avatar C for the user terminal 1B. , A control information is transmitted. That is, the virtual space provided to the user B is also updated. The updated virtual space includes a virtual room 70A having a table 5A and a virtual screen 60A, and avatars 4A to 4C.

  Next, with reference to FIG. 12B, the process in the case where it is determined that the size of the virtual room of the avatar 4A should not be increased (NO in step S32) will be described. For example, as a precondition, when there is no avatar 4B in the virtual room 7A of the user A, the control unit 23 of the server 2 specifies the total number N of avatars as 2. And the control part 23 expands the size of the virtual room of avatar 4A based on the table (refer Table 1) which shows the relationship between the total number N = 2 of avatars, and the total number N of avatars, and the size of a virtual room. It is determined that it should not be performed (NO in step S32). Thereafter, the control unit 23 transmits control information of the S size virtual room 7A (first virtual room), the avatar 4A, and the avatar 4A to the user terminal 1C (step S41).

  Next, after receiving the control information of the virtual room 7A, the avatar 4A, and the avatar 4A, the control unit 121 of the user terminal 1C uses the control information of the virtual room 7A, the avatars 4A and 4C, and the avatars 4A and 4C. Based on this, the virtual space data is updated (step S43). Specifically, the control unit 121 generates virtual space data indicating a virtual space including the avatars 4A and 4C and the virtual room 7A. Thereafter, the control unit 121 updates the visual field image displayed on the HMD 110 based on the updated virtual space data and the visual field CV of the virtual camera 300 (step S44).

  On the other hand, in step S45, the control unit 23 transmits the avatar 4C and the control information of the avatar 4C to the user terminal 1A. In step S46, the control unit 121 of the user terminal 1A receives the avatar 4C and the control information of the avatar 4C. Thereafter, the control unit 121 updates the virtual space data based on the control information of the virtual room 7A, the avatars 4A and 4C, and the avatars 4A and 4C (step S47). Specifically, the control unit 121 generates virtual space data indicating a virtual space including the avatars 4A and 4C and the virtual room 7A. Thereafter, the control unit 121 updates the visual field image displayed on the HMD 110 based on the updated virtual space data and the visual field CV of the virtual camera 300 (step S48). In this way, a series of processing according to the present embodiment is executed.

  According to the present embodiment, whether or not the virtual room of the avatar 4A should be updated is determined according to the total number N of the avatars currently arranged in the virtual room 7A of the avatar 4A and the avatars that visit the virtual room 7A. When it is determined that the virtual room of the avatar 4A should be updated, the virtual room of the avatar 4A is updated from the virtual room 7A (S size) to the virtual room 70A (M size). As described above, since the size of the virtual room is expanded according to the total number N of avatars, it is possible to prevent an unpleasant situation for each of the users A to C such that a large number of avatars are arranged in the S-size virtual room 7A. It becomes. Therefore, it is possible to provide an information processing method that can improve the virtual experience of the user in the social VR.

  When the avatar 4C leaves the virtual room 70A in a state where the avatars 4A, 4B, and 4C are arranged in the virtual room 70A, the virtual room of the avatar 4A is changed from the M size virtual room 70A to the S size virtual room 7A. It may be updated. That is, the size of the virtual room of the avatar 4A may be reduced according to the total number N of avatars.

  In addition, the relationship between the total number N of avatars and the size of the virtual room shown in Table 1 is merely an example, and the size of the virtual room may be gradually increased as the total number N of avatars increases by one. Good.

  Moreover, in this embodiment, although virtual space data and visual field image data are produced | generated by the user terminals 1A-1C side, these data may be produced | generated by the server 2 side. In this case, each user terminal 1 </ b> A to 1 </ b> C displays a field image on the HMD 110 based on the field image data transmitted from the server 2.

  Next, processing for viewing video content displayed on the virtual screen 6A between the users A and B will be described with reference to FIGS. 10, 15 and 16. FIG. FIG. 15 is a sequence diagram for explaining an example of processing for viewing video content. The state (a) in FIG. 16 is a diagram showing an example of a video content fee table. The state (b) in FIG. 16 is a diagram illustrating an example of a billing table. In this description, as a precondition, it is assumed that an avatar 4A and an avatar 4B are arranged in a virtual room 7A of the avatar 4A as shown in FIG. That is, it is assumed that the user A and the user B share one virtual room 7A via the communication network 3.

  As shown in FIG. 15, in step S50, the user A executes a predetermined operation input for viewing the video content V1. For example, the user A selects an item such as “view video content V1” in the menu screen displayed on the HMD 110. Thereafter, the control unit 121 of the user terminal 1 </ b> A generates a viewing request signal for requesting viewing of the video content V <b> 1 in accordance with an operation input from the user A, and transmits the viewing request signal to the server 2.

  Next, the control unit 23 of the server 2 receives the viewing request signal from the user terminal 1A (step S51). Thereafter, the control unit 23 acquires the video content V1 from the storage unit 22 (or a server that stores the video content arranged on the communication network 3), and then transmits the acquired video content V1 to the user terminals 1A and 1B. (Step S52). Note that the server 2 may transmit the time-divided video content V1. That is, the server 2 may stream the video content V1.

  Next, the control unit 121 of the user terminal 1A receives the video content V1 from the server 2 (step S53). Thereafter, the control unit 121 updates the virtual space data based on the video content V1, the virtual room 7A, and the avatars 4A and 4B (step S54). Specifically, the control unit 121 displays the video content V1 on the virtual screen 6A by texture mapping. Thus, the control unit 121 generates virtual space data indicating the virtual space 200A including the virtual screen 6A on which the video content V1 is displayed. Thereafter, the control unit 121 updates the visual field image displayed on the HMD 110 based on the updated virtual space data and the visual field CV of the virtual camera 300 (see FIG. 7) (step S55).

  On the other hand, the control unit 121 of the user terminal 1B receives the video content V1 from the server 2 (step S56). Thereafter, the control unit 121 updates the virtual space data based on the video content V1, the virtual room 7A, and the avatars 4A and 4B (step S57). Specifically, the control unit 121 generates virtual space data indicating the virtual space 200B including the virtual screen 6A on which the video content V1 is displayed. Thereafter, the control unit 121 updates the visual field image displayed on the HMD 110 based on the updated virtual space data and the visual field CV (see FIG. 7) of the virtual camera 300 (step S58).

  Next, the control unit 23 of the server 2 updates the accounting table (see state (b) in FIG. 16) stored in the storage unit 22 (step S59). Specifically, first, the control unit 23 specifies the viewing unit price of the video content V1 by referring to the video content fee table stored in the storage unit 22 (see the state (a) in FIG. 16) ( In this example, the viewing unit price of the video content V1 is 300 yen). Next, the control unit 23 updates the billing data of the users A and B in the billing table based on the viewing unit price of the video content V1. As shown in FIG. 16, the viewing unit price may be different for each type of video content (in this example, the viewing unit price of video content V2 is 500 yen). Furthermore, when viewing video content between a plurality of avatars through one virtual room, a group discount may be applied to the viewing price of the video content. For example, when the video content V1 is viewed among a predetermined number of avatars through one virtual room (for example, the virtual room 7A), the viewing price of the video content V1 may be set from 300 yen to 200 yen. Similarly, when the video content V2 is viewed between a predetermined number or more of avatars through one virtual room (for example, the virtual room 7A), the viewing price of the video content V2 may be 500 to 300 yen.

  Next, a process for enlarging the virtual screen 6A (first virtual screen) without updating the size of the virtual room will be described with reference to FIGS. FIG. 17 shows an example of a process for enlarging the virtual screen 6A (specifically, a process for updating the S size virtual screen 6A to the M size virtual screen 60A (the enlarged first virtual screen)). It is a sequence diagram for demonstrating. The state (a) in FIG. 18 is a diagram illustrating the virtual space 200A provided to the user A before the virtual screen 6A is enlarged. The state (b) of FIG. 18 is a diagram showing the virtual space 200A provided to the user A after the virtual screen 6A is enlarged. In this description, as a precondition, it is assumed that the avatar 4A and the avatar 4B are arranged in the virtual room 7A of the avatar 4A as shown in the state (a) of FIG. That is, it is assumed that the user A and the user B share one virtual room 7A via the communication network 3.

  As shown in FIG. 17, in step S60, the user A executes a predetermined operation input for enlarging the virtual screen 6A. For example, the user A selects an item such as “enlarge the size of the virtual screen to M size” in the menu screen displayed on the HMD 110. Thereafter, the control unit 121 of the user terminal 1 </ b> A transmits to the server 2 a screen enlargement request signal requesting that the size of the virtual screen 6 </ b> A be enlarged to M size in accordance with an operation input from the user A.

  Next, the control unit 23 of the server 2 receives a screen enlargement request signal from the user terminal 1A (step S61). Thereafter, the control unit 23 acquires the M-size virtual screen 60A from the storage unit 22, and then transmits the virtual screen 60A (enlarged virtual screen) to the user terminals 1A and 1B (step S62).

  Next, the control unit 121 of the user terminal 1A receives the virtual screen 60A from the server 2 (step S63). Thereafter, the control unit 121 updates the virtual space data based on the virtual screen 60A, the virtual room 7A, and the avatars 4A and 4B (step S64). Specifically, the control unit 121 updates the virtual screen from the S-size virtual screen 6A to the M-size virtual screen 60A, and then includes a virtual room 7A having the virtual screen 60A and the avatars 4A and 4B. Virtual space data indicating the space 200A is generated. Thereafter, the control unit 121 updates the visual field image displayed on the HMD 110 based on the updated virtual space data and the visual field CV (see FIG. 7) of the virtual camera 300 (step S65).

  On the other hand, in step S66, the control unit 121 of the user terminal 1B receives the virtual screen 60A from the server 2. Thereafter, the control unit 121 updates the virtual space data based on the virtual screen 60A, the virtual room 7A, and the avatars 4A and 4B (step S67). Specifically, the control unit 121 updates the virtual screen from the S-size virtual screen 6A to the M-size virtual screen 60A, and then includes a virtual room 7A having the virtual screen 60A and the avatars 4A and 4B. Virtual space data indicating a space is generated. Thereafter, the control unit 121 updates the visual field image displayed on the HMD 110 based on the updated virtual space data and the visual field CV (see FIG. 7) of the virtual camera 300 (step S68).

  Next, in step S69, the server 2 updates the accounting table (see state (b) in FIG. 16) stored in the storage unit 22. Specifically, first, the control unit 23 needs to increase the size of the virtual screen to the M size according to the screen expansion request by referring to the video content fee table (see the state (a) in FIG. 16). Specific additional charges (virtual screen enlargement charges). For example, when the video content currently being viewed is the video content V1, the control unit 23 specifies the virtual screen enlargement charge necessary to enlarge the virtual screen size to M size as 500 yen. Next, the control unit 23 updates the billing data of the user A in the billing table based on the specified virtual screen enlargement fee (for example, 500 yen). As shown in the state (b) of FIG. 16, when the users A and B are viewing the video content V1 through the S size virtual screen 6A, the user A changes the size of the virtual screen to the M size through a predetermined operation. In the case of enlargement, the amount charged to the user A for viewing the video content V1 is 300 yen (viewing unit price of the video content V1) +500 yen (virtual screen enlargement fee) = 800 yen. Note that the virtual screen enlargement fee may be borne only by the user A who requests enlargement of the virtual screen, or the users A and B may halve the virtual screen enlargement fee.

  According to the present embodiment, in response to the screen enlargement request signal, the virtual screen is updated so that the size of the virtual screen of the avatar 4A is enlarged to M size, and the charge amount charged to the user A is updated. The As described above, even when there is no avatar to visit in the virtual room 7A of the avatar 4A, the avatar 4A can enjoy watching a moving image such as video content on a large virtual screen by paying a predetermined amount.

  Further, according to the present embodiment, the size of the virtual screen is increased to M size (virtual screen 6A → virtual screen 60A) in accordance with the increase in the size of the virtual room of the avatar 4A (virtual room 7A → virtual room 70A). The charge amount sometimes charged to the user A is preferably lower than the charge amount charged to the user A when the size of the virtual screen is increased to the M size in response to the screen enlargement request signal. For example, the former billing amount is, for example, 0 yen, while the latter billing amount is 500 yen as shown in the state (a) of FIG. In this way, the former billing amount is lower than the latter billing amount, so that a large number of users can be encouraged to enjoy viewing the same video content in the same virtual room. Therefore, it is possible to promote a virtual room visit (social VR) between users.

  In addition, a control program for causing a computer (processor) to execute various types of processing in order to implement various types of processing executed by the control unit 23 of the server 2 (or the control unit 121 of the user terminal 1) with software is a storage unit 22. (Or storage unit 123) or may be incorporated in advance in the memory. Alternatively, the control program can be a magnetic disk (HDD, floppy disk), optical disk (CD-ROM, DVD-ROM, Blu-ray disk, etc.), magneto-optical disk (MO, etc.), flash memory (SD card, USB memory, SSD). Etc.) may be stored in a computer-readable storage medium. In this case, when the storage medium is connected to the server 2 (or the control device 120), the control program stored in the storage medium is incorporated into the storage unit 22 (or the storage unit 123). Then, the control program incorporated in the storage unit 22 (or the storage unit 123) is loaded onto the RAM, and the processor executes the loaded program, whereby the control unit 23 (or the control unit 121) performs various processes. Execute.

  The control program may be downloaded from a computer on the communication network 3 via a communication interface. In this case as well, the downloaded control program is incorporated into the storage unit 22 (or the storage unit 123).

  As mentioned above, although embodiment of this indication was described, the technical scope of this invention should not be limitedly interpreted by description of this embodiment. This embodiment is an example, and it is understood by those skilled in the art that various modifications can be made within the scope of the invention described in the claims. The technical scope of the present invention should be determined based on the scope of the invention described in the claims and the equivalents thereof.

U, A, B, C: Users 1, 1A, 1B, 1C: User terminal 2: Server 3: Communication networks 4A, 4B, 4C: Avatar 5A: Virtual table 6A: Virtual screen 7A: Virtual room 7C: Virtual room 21 : Communication interface 22: Storage unit (storage)
23: Control unit 24: Bus 60A: Virtual screen 70A: Virtual room 100: Virtual space distribution system (distribution system)
112: Display unit 114: Sensor 116: Headphone 118: Microphone 120: Control device 121: Control unit 123: Storage unit (storage)
124: I / O interface 125: Communication interface 126: Bus 130: Position sensor 140: Gaze sensor 200, 200A, 200B, 200C, 220A, 220C: Virtual space 210: Center position 300: Virtual camera 320: External controller

Claims (7)

An information processing method executed by a computer in a virtual space distribution system including a plurality of user terminals each having a head mounted device mounted on a user's head and a server,
The information processing method includes:
(A) A first virtual space that defines a first virtual space including a first avatar associated with a first user terminal among the plurality of user terminals and a first virtual room in which the first avatar is arranged. Generating data; and
(B) receiving a visit request signal requesting that a second avatar associated with the second user terminal visits the first virtual room from a second user terminal of the plurality of user terminals; ,
(C) After the step (b), a step of determining whether or not the first virtual room should be updated according to the total number of avatars currently arranged in the first virtual room and the second avatar. When,
And (d) updating the first virtual room so as to update the size of the first virtual room when it is determined that the first virtual room should be updated.   The information according to claim 1, wherein the first avatar is arranged in the updated first virtual room so that a relative positional relationship between the first avatar and the first virtual room is maintained. Processing method. The first virtual room includes a first virtual screen on which a moving image is displayed;
The step (d) includes a step of updating the first virtual room so that a size of the first virtual screen is enlarged in accordance with an enlargement of the size of the first virtual room. Information processing method. The first virtual room includes a first virtual screen on which a moving image is displayed;
(E) receiving, from the first user terminal, a screen enlargement request signal requesting to enlarge the size of the first virtual screen to a predetermined size;
(F) updating the first virtual screen so as to enlarge the size of the first virtual screen to the predetermined size in response to the screen enlargement request signal. The information processing method as described in any one of them. (G) further including the step of determining a charge amount charged to the first user by viewing the moving image by the first user wearing the head mounted device of the first user terminal;
The information processing method according to claim 4, wherein the step (g) includes a step of updating a charge amount charged to the first user in response to the screen enlargement request signal. The step (d) includes the step of updating the first virtual room so that the size of the first virtual screen is enlarged in accordance with the enlargement of the size of the first virtual room,
The first charge amount charged to the first user when the size of the first virtual screen is enlarged to a predetermined size in accordance with the enlargement of the size of the first virtual room is in accordance with the screen enlargement request signal. 6. The information processing method according to claim 5, wherein the first virtual screen is cheaper than a second charge amount charged to the first user when the size of the first virtual screen is enlarged to the predetermined size. The program for making a computer perform the information processing method as described in any one of Claims 1-6.