JP6952730B2 - Programs, methods, information processing equipment, and systems - Google Patents

Description

The present disclosure relates to programs, methods, information processing devices, and systems.

Non-Patent Document 1 discloses a technique for involving a viewer in live distribution by a character.

G.F., "What is the secret of the cuteness of the attention-grabbing virtual beautiful girl" Megu Shinonome "? ", [Online], March 6, 2018, MoguLive, [Search February 19, 2019], Internet <https://www.moguravr.com/shinonome-megu/>

Conventional technology has room to encourage viewers to continue to participate in the content.

One aspect of the disclosure is intended to encourage users to continue to be involved in the content.

The program according to the present disclosure is a program for causing a first computer used by the first user to execute a game in which a plurality of users including the first user participate. The program causes the first computer to perform a step of operating a character appearing in the game based on the first data received from the outside. The first data is data for causing a character to utter at least voice, and is transmitted from the outside to one or more arbitrary computers including the first computer among a plurality of computers used by a plurality of users. , The content of the utterance is different for each destination computer.

Further, the program according to the present disclosure is a program executed by a computer used by a character performer who appears in a game in which a plurality of users participate. The program has steps to display a list of users who have participated in the game on a computer display, to select one or more users from the list, and to have the character speak at least a voice based on the voice spoken by the performer. The step of generating the first data, which is data and the content of the utterance is different for each selected user, and the first data generated for each selected user are used by the corresponding user, respectively. Have the computer perform the steps to send to the computer.

According to one aspect of the present disclosure, it is possible to encourage the user to be continuously involved in the content.

It is a figure which shows an example of the outline of the system which follows a certain embodiment. It is a block diagram which shows an example of the hardware composition of the user terminal which follows a certain embodiment. It is a block diagram which shows an example of the hardware configuration of the server according to a certain embodiment. It is a block diagram which shows an example of the hardware composition of the game play terminal which follows a certain embodiment. It is a block diagram which shows an example of the hardware configuration of the distribution terminal which follows a certain embodiment. It is a block diagram which shows an example of the functional configuration of the user terminal, the server, and the HMD set according to a certain embodiment. It is a block diagram which shows an example of the functional structure of the distribution terminal which follows a certain embodiment. It is a flowchart which shows a part of the processing executed in the user terminal and the game play terminal which follow a certain embodiment. It is a figure which shows an example of the virtual space provided to a player, and the visual field image which a player visually recognizes according to a certain embodiment. It is a figure which shows an example of the virtual space provided to the user of a user terminal, and the visual field image which the user visually recognizes according to a certain embodiment. It is a figure which shows another example of the visual field image which the user of a user terminal visually recognizes. It is a figure which shows still another example of the field of view image which the user of a user terminal sees. It is a flowchart which shows a part of the processing executed in the game play terminal which follows a certain embodiment. It is a flowchart which shows a part of the process executed in the user terminal which follows a certain embodiment. It is a flowchart which shows a part of the processing executed in the server according to a certain embodiment. It is a figure which shows a specific example of the list of the user who participated in a game according to a certain embodiment. It is a flowchart which shows a part of the processing executed in the distribution terminal which follows a certain embodiment. It is a figure which shows a specific example of the screen displayed on the distribution terminal which follows a certain embodiment. It is a figure which shows the other specific example of the screen which is displayed on the distribution terminal which follows a certain embodiment. It is a figure which shows a specific example of the voice input by a player according to a certain embodiment. It is a figure which shows still another specific example of the screen displayed on the distribution terminal according to a certain embodiment, and the outline of distribution of operation instruction data. It is a figure which shows the other specific example of the voice input by a player according to a certain embodiment. It is a figure which shows still another specific example of the screen displayed on the distribution terminal according to a certain embodiment, and the outline of distribution of operation instruction data. It is a figure which shows the outline of transmission of the game progress information from a game play terminal to a user terminal according to a certain embodiment. It is a flowchart which shows a part of the process executed in the user terminal which follows a certain embodiment. It is a figure which shows a specific example of moving image play. It is a figure which shows the other specific example of moving image play. It is a flowchart which shows a part of the process executed in the user terminal which follows a certain embodiment. It is a figure which shows still another specific example of the screen which is displayed on the distribution terminal which follows a certain embodiment. It is a figure which shows still another specific example of the screen which is displayed on the distribution terminal which follows a certain embodiment.

The system according to the present disclosure is a system for providing a game to a plurality of users. Hereinafter, the system will be described with reference to the drawings. It should be noted that the present invention is not limited to these examples, and is indicated by the scope of claims, and it is intended that all modifications within the meaning and scope equivalent to the scope of claims are included in the present invention. NS. In the following description, the same elements are designated by the same reference numerals in the description of the drawings, and duplicate description will not be repeated.

<Overview of system 1 operation>
FIG. 1 is a diagram showing an outline of the system 1 according to the present embodiment. The system 1 includes a plurality of user terminals 100 (computers), a server 200, a game play terminal 300 (external device, second external device), and a distribution terminal 400 (external, first external device). In FIG. 1, user terminals 100A to 100C, in other words, three user terminals 100 are shown as an example of a plurality of user terminals 100, but the number of user terminals 100 is not limited to the illustrated example. .. Further, in the present embodiment, when it is not necessary to distinguish the user terminals 100A to C, it is described as "user terminal 100". The user terminal 100, the game play terminal 300, and the distribution terminal 400 are connected to the server 200 via the network 2. The network 2 is composed of various mobile communication systems constructed by the Internet and a wireless base station (not shown). Examples of this mobile communication system include so-called 3G and 4G mobile communication systems, LTE (Long Term Evolution), and wireless networks (for example, Wi-Fi (registered trademark)) that can be connected to the Internet by a predetermined access point. Be done.

(Outline of the game)
In the present embodiment, as an example of the game provided by the system 1 (hereinafter, this game), a game mainly played by the user of the game play terminal 300 will be described. Hereinafter, the user of the game play terminal 300 is referred to as a "player". As an example, the player (performer) advances the game by operating the characters appearing in the game. Further, in this game, the user of the user terminal 100 plays a role of supporting the progress of the game by the player. Details of this game will be described later. The game provided by the system 1 may be a game in which a plurality of users participate, and is not limited to this example.

(Gameplay terminal 300)
The game play terminal 300 advances the game in response to an input operation by the player. In addition, the game play terminal 300 sequentially delivers information generated by the player's game play (hereinafter, game progress information) to the server 200 in real time.

(Server 200)
The server 200 transmits the game progress information (second data) received in real time from the game play terminal 300 to the user terminal 100. In addition, the server 200 mediates the transmission and reception of various information between the user terminal 100, the game play terminal 300, and the distribution terminal 400.

(Distribution terminal 400)
The distribution terminal 400 generates operation instruction data (first data) in response to an input operation by the user of the distribution terminal 400, and distributes the operation instruction data to the user terminal 100 via the server 200. The operation instruction data is data for playing back a moving image on the user terminal 100, and specifically, is data for operating a character appearing in the moving image.

In the present embodiment, as an example, the user of the distribution terminal 400 is a player of this game. Further, as an example, the moving image played on the user terminal 100 based on the operation instruction data is a moving image in which the character operated by the player in the game operates. "Movement" is to move at least a part of the character's body, including utterances. Therefore, the motion instruction data according to the present embodiment includes, for example, voice data for causing the character to speak and motion data for moving the character's body.

As an example, the operation instruction data is transmitted to the user terminal 100 after the end of this game. The details of the operation instruction data and the moving image played based on the operation instruction data will be described later.

(User terminal 100)
The user terminal 100 receives the game progress information in real time, and generates and displays the game screen using the information. In other words, the user terminal 100 reproduces the game screen of the game being played by the player by real-time rendering. As a result, the user of the user terminal 100 can visually recognize the same game screen as the game screen that the player is viewing while playing the game at substantially the same timing as the player.

Further, the user terminal 100 generates information for supporting the progress of the game by the player in response to the input operation by the user, and transmits the information to the game play terminal 300 via the server 200. Details of the information will be described later.

Further, the user terminal 100 receives the operation instruction data from the distribution terminal 400, and generates and reproduces a moving image (video) using the operation instruction data. In other words, the user terminal 100 renders and reproduces the operation instruction data.

<Hardware configuration of system 1>
FIG. 2 is a diagram showing a hardware configuration of the user terminal 100. FIG. 3 is a diagram showing a hardware configuration of the server 200. FIG. 4 is a diagram showing a hardware configuration of the game play terminal 300. FIG. 5 is a diagram showing a hardware configuration of the distribution terminal 400.

(User terminal 100)
In the present embodiment, as an example, an example in which the user terminal 100 is realized as a smartphone will be described, but the user terminal 100 is not limited to the smartphone. For example, the user terminal 100 may be realized as a feature phone, a tablet computer, a laptop computer (so-called laptop computer), a desktop computer, or the like. Further, the user terminal 100 may be a game device suitable for game play.

As shown in FIG. 2, the user terminal 100 measures the processor 10, the memory 11, the storage 12, the communication interface (IF) 13, the input / output IF 14, the touch screen 15 (display unit), the camera 17, and the like. It includes a distance sensor 18. These configurations included in the user terminal 100 are electrically connected to each other by a communication bus. The user terminal 100 may be provided with an input / output IF 14 to which a display (display unit) configured separately from the user terminal 100 main body can be connected instead of or in addition to the touch screen 15.

Further, as shown in FIG. 2, the user terminal 100 may be configured to be communicable with one or more controllers 1020. The controller 1020 establishes communication with the user terminal 100 according to a communication standard such as Bluetooth (registered trademark). The controller 1020 may have one or more buttons or the like, and transmits an output value based on a user's input operation to the buttons or the like to the user terminal 100. Further, the controller 1020 may have various sensors such as an acceleration sensor and an angular velocity sensor, and transmits the output values of the various sensors to the user terminal 100.

In addition, instead of or in addition to the user terminal 100 including the camera 17 and the distance measuring sensor 18, the controller 1020 may have the camera 17 and the distance measuring sensor 18.

It is desirable that the user terminal 100, for example, at the start of a game, have a user who uses the controller 1020 input user identification information such as the user's name or login ID via the controller 1020. As a result, the user terminal 100 can associate the controller 1020 with the user, and identifies which user the output value belongs to based on the source of the received output value (controller 1020). be able to.

When the user terminal 100 communicates with a plurality of controllers 1020, each user holds each controller 1020, so that the one user terminal 100 does not communicate with other devices such as the server 200 via the network 2. Multiplayer can be realized with. In addition, each user terminal 100 communicates with each other according to a wireless standard such as a wireless LAN (Local Area Network) standard (communication connection is made without going through a server 200), thereby realizing local multiplayer with a plurality of user terminals 100. You can also do it. When the above-mentioned multiplayer is realized locally by one user terminal 100, the user terminal 100 may further include at least a part of various functions described later described in the server 200. Further, when the above-mentioned multi-play is realized locally by a plurality of user terminals 100, the plurality of user terminals 100 may be provided with various functions described later described in the server 200 in a distributed manner.

Even when the above-mentioned multiplayer is realized locally, the user terminal 100 may communicate with the server 200. For example, information indicating a play result such as a result or victory or defeat in a certain game may be associated with user identification information and transmitted to the server 200.

Further, the controller 1020 may be configured to be detachable from the user terminal 100. In this case, a coupling portion with the controller 1020 may be provided on at least one surface of the housing of the user terminal 100. When the user terminal 100 and the controller 1020 are connected by wire via the coupling portion, the user terminal 100 and the controller 1020 transmit and receive signals via wire.

As shown in FIG. 2, the user terminal 100 may accept the attachment of a storage medium 1030 such as an external memory card via the input / output IF14. As a result, the user terminal 100 can read the programs and data recorded on the storage medium 1030. The program recorded on the storage medium 1030 is, for example, a game program.

The user terminal 100 may store the game program acquired by communicating with an external device such as the server 200 in the memory 11 of the user terminal 100, or may store the game program acquired by reading from the storage medium 1030 in the memory 11. You may memorize it in.

As described above, the user terminal 100 includes a communication IF 13, an input / output IF 14, a touch screen 15, a camera 17, and a distance measuring sensor 18 as an example of a mechanism for inputting information to the user terminal 100. Each of the above-mentioned parts as an input mechanism can be regarded as an operation part configured to accept a user's input operation.

For example, when the operation unit is configured by at least one of the camera 17 and the distance measuring sensor 18, the operation unit detects an object 1010 in the vicinity of the user terminal 100 and performs an input operation from the detection result of the object. Identify. As an example, a user's hand as an object 1010, a marker having a predetermined shape, or the like is detected, and an input operation is specified based on the color, shape, movement, or type of the object 1010 obtained as a detection result. NS. More specifically, when the user's hand is detected from the captured image of the camera 17, the user terminal 100 inputs a gesture (a series of movements of the user's hand) detected based on the captured image. Identify and accept as. The captured image may be a still image or a moving image.

Alternatively, when the operation unit is composed of the touch screen 15, the user terminal 100 identifies and accepts the user's operation performed on the input unit 151 of the touch screen 15 as the user's input operation. Alternatively, when the operation unit is composed of the communication IF 13, the user terminal 100 identifies and accepts a signal (for example, an output value) transmitted from the controller 1020 as an input operation of the user. Alternatively, when the operation unit is composed of the input / output IF14, a signal output from an input device (not shown) different from the controller 1020 connected to the input / output IF14 is specified and accepted as a user input operation.

(Server 200)
As an example, the server 200 may be a general-purpose computer such as a workstation or a personal computer. The server 200 includes a processor 20, a memory 21, a storage 22, a communication IF 23, and an input / output IF 24. These configurations included in the server 200 are electrically connected to each other by a communication bus.

(Gameplay terminal 300)
As an example, the game play terminal 300 may be a general-purpose computer such as a personal computer. The game play terminal 300 includes a processor 30, a memory 31, a storage 32, a communication IF 33, and an input / output IF 34. These configurations included in the gameplay terminal 300 are electrically connected to each other by a communication bus.

As shown in FIG. 4, the game play terminal 300 according to the present embodiment is included in the HMD (Head Mounted Display) set 1000 as an example. That is, it can be expressed that the HMD set 1000 is included in the system 1, and the player can also express that he / she plays a game using the HMD set 1000. The device for the player to play the game is not limited to the HMD set 1000. As an example, the device may be any device that allows the player to experience the game virtually. In addition, the device may be realized as a smartphone, a feature phone, a tablet computer, a laptop computer (so-called laptop computer), a desktop computer, or the like. Further, the device may be a game device suitable for game play.

The HMD set 1000 includes a game play terminal 300, an HMD 500, an HMD sensor 510, a motion sensor 520, a display 530, and a controller 540. The HMD 500 includes a monitor 51, a gaze sensor 52, a first camera 53, a second camera 54, a microphone 55, and a speaker 56. The controller 540 may include a motion sensor 520.

The HMD 500 may be mounted on the player's head and provide the player with virtual space during operation. More specifically, the HMD 500 displays an image for the right eye and an image for the left eye on the monitor 51, respectively. When each eye of the player visually recognizes the respective image, the player can recognize the image as a three-dimensional image based on the parallax of both eyes. The HMD 500 may include both a so-called head-mounted display including a monitor and a head-mounted device capable of mounting a smartphone or other terminal having a monitor.

The monitor 51 is realized as, for example, a non-transparent display device. In a certain aspect, the monitor 51 is arranged in the main body of the HMD 500 so as to be located in front of both eyes of the player. Therefore, the player can immerse himself in the virtual space when he / she visually recognizes the three-dimensional image displayed on the monitor 51. In some aspects, the virtual space includes, for example, a background, player-operable objects, and player-selectable menu images. In a certain aspect, the monitor 51 can be realized as a liquid crystal monitor or an organic EL (Electro Luminescence) monitor included in a so-called smartphone or other information display terminal.

In another aspect, the monitor 51 can be realized as a transmissive display device. In this case, the HMD 500 may be an open type such as a glasses type, not a closed type that covers the player's eyes as shown in FIG. The transmissive monitor 51 may be temporarily configured as a non-transparent display device by adjusting its transmittance. The monitor 51 may include a configuration in which a part of the image constituting the virtual space and the real space are displayed at the same time. For example, the monitor 51 may display an image of the real space taken by the camera mounted on the HMD 500, or may make the real space visible by setting a part of the transmittance to be high.

In some aspects, the monitor 51 may include a sub-monitor for displaying an image for the right eye and a sub-monitor for displaying an image for the left eye. In another aspect, the monitor 51 may be configured to display the image for the right eye and the image for the left eye as a unit. In this case, the monitor 51 includes a high speed shutter. The high-speed shutter operates so that the image for the right eye and the image for the left eye can be alternately displayed so that the image is recognized by only one of the eyes.

In one aspect, the HMD 500 includes a plurality of light sources (not shown). Each light source is realized by, for example, an LED (Light Emitting Diode) that emits infrared rays. The HMD sensor 510 has a position tracking function for detecting the movement of the HMD 500. More specifically, the HMD sensor 510 reads a plurality of infrared rays emitted by the HMD 500 and detects the position and inclination of the HMD 500 in the real space.

In another aspect, the HMD sensor 510 may be implemented by a camera. In this case, the HMD sensor 510 can detect the position and tilt of the HMD 500 by executing the image analysis process using the image information of the HMD 500 output from the camera.

In another aspect, the HMD 500 may include a sensor (not shown) as a position detector in place of the HMD sensor 510 or in addition to the HMD sensor 510. The HMD500 can use the sensor to detect the position and tilt of the HMD500 itself. For example, if the sensor is an angular velocity sensor, a geomagnetic sensor, or an acceleration sensor, the HMD 500 may use any of these sensors instead of the HMD sensor 510 to detect its position and tilt. As an example, when the sensor provided in the HMD 500 is an angular velocity sensor, the angular velocity sensor detects the angular velocity around the three axes of the HMD 500 in real space over time. The HMD500 calculates the temporal change of the angle around the three axes of the HMD500 based on each angular velocity, and further calculates the inclination of the HMD500 based on the temporal change of the angle.

The gaze sensor 52 detects the direction in which the line of sight of the player's right eye and left eye is directed. That is, the gaze sensor 52 detects the line of sight of the player. The detection of the direction of the line of sight is realized by, for example, a known eye tracking function. The gaze sensor 52 is realized by a sensor having the eye tracking function. In certain aspects, the gaze sensor 52 preferably includes a sensor for the right eye and a sensor for the left eye. The gaze sensor 52 may be, for example, a sensor that irradiates infrared light to the player's right eye and left eye and detects the angle of rotation of each eyeball by receiving reflected light from the cornea and the iris with respect to the irradiation light. The gaze sensor 52 can detect the line of sight of the player based on each of the detected rotation angles.

The first camera 53 photographs the lower part of the player's face. More specifically, the first camera 53 photographs the nose, mouth, and the like of the player. The second camera 54 photographs the eyes and eyebrows of the player. The housing on the player side of the HMD500 is defined as the inside of the HMD500, and the housing on the side opposite to the player of the HMD500 is defined as the outside of the HMD500. In some aspects, the first camera 53 may be located outside the HMD 500 and the second camera 54 may be located inside the HMD 500. The images generated by the first camera 53 and the second camera 54 are input to the game play terminal 300. In another aspect, the first camera 53 and the second camera 54 may be realized as one camera, and the player's face may be photographed by the one camera.

The microphone 55 converts the player's utterance into an audio signal (electric signal) and outputs it to the game play terminal 300. The speaker 56 converts the voice signal into voice and outputs it to the player. In another aspect, the HMD 500 may include earphones instead of the speaker 56.

The controller 540 is connected to the gameplay terminal 300 by wire or wirelessly. The controller 540 receives an input of a command from the player to the game play terminal 300. In certain aspects, the controller 540 is configured to be grippable by the player. In another aspect, the controller 540 is configured to be wearable on a player's body or part of clothing. In yet another aspect, the controller 540 may be configured to output at least one of vibration, sound, and light based on a signal transmitted from the gameplay terminal 300. In yet another aspect, the controller 540 receives from the player an operation for controlling the position and movement of an object arranged in the virtual space.

In one aspect, the controller 540 includes a plurality of light sources. Each light source is realized, for example, by an LED that emits infrared rays. The HMD sensor 510 has a position tracking function. In this case, the HMD sensor 510 reads a plurality of infrared rays emitted by the controller 540 and detects the position and tilt of the controller 540 in the real space. In another aspect, the HMD sensor 510 may be implemented by a camera. In this case, the HMD sensor 510 can detect the position and tilt of the controller 540 by executing the image analysis process using the image information of the controller 540 output from the camera.

The motion sensor 520 is attached to the player's hand in a certain aspect to detect the movement of the player's hand. For example, the motion sensor 520 detects the rotation speed, the number of rotations, and the like of the hand. The detected signal is sent to the game play terminal 300. The motion sensor 520 is provided in the controller 540, for example. In one aspect, the motion sensor 520 is provided, for example, in a controller 540 configured to be grippable by the player. In another aspect, for safety in real space, the controller 540 is attached to something that does not easily fly by being attached to the player's hand, such as a glove type. In yet another aspect, a sensor not attached to the player may detect the movement of the player's hand. For example, the signal of the camera that shoots the player may be input to the game play terminal 300 as a signal indicating the operation of the player. As an example, the motion sensor 520 and the game play terminal 300 are wirelessly connected to each other. In the case of wireless communication, the communication mode is not particularly limited, and for example, Bluetooth or other known communication method is used.

The display 530 displays an image similar to the image displayed on the monitor 51. As a result, users other than the player wearing the HMD 500 can view the same image as the player. The image displayed on the display 530 does not have to be a three-dimensional image, and may be an image for the right eye or an image for the left eye. Examples of the display 530 include a liquid crystal display and an organic EL monitor.

The game play terminal 300 operates a character to be operated by the player based on various information acquired from each part of the HMD 500, the controller 540, and the motion sensor 520, and advances the game. The "movements" here include moving parts of the body, changing postures, changing facial expressions, moving, uttering, touching and moving objects placed in virtual space, and characters. This includes using weapons, tools, etc. to grasp. That is, in this game, when the player moves each part of the body, the character also moves each part of the body in the same manner as the player. Further, in this game, the character utters the content uttered by the player. In other words, in this game, the character is an avatar object that behaves as a player's alter ego. As an example, at least part of the character's movements may be performed by input to the controller 540 by the player.

In the present embodiment, the motion sensor 520 is attached to, for example, both hands of the player, both feet of the player, the waist of the player, and the head of the player. The motion sensors 520 attached to both hands of the player may be provided in the controller 540 as described above. Further, the motion sensor 520 attached to the player's head may be provided in the HMD 500. The motion sensor 520 may also be attached to the user's elbows and knees. By increasing the number of motion sensors 520 attached to the player, the movement of the player can be more accurately reflected in the character. Further, the player may wear a suit to which one or more motion sensors 520 are attached instead of attaching the motion sensor 520 to each part of the body. That is, the method of motion capture is not limited to the example of using the motion sensor 520.

(Distribution terminal 400)
The distribution terminal 400 may be a mobile terminal such as a smartphone, a PDA (Personal Digital Assistant), or a tablet computer. Further, the distribution terminal 400 may be a so-called stationary terminal such as a desktop personal computer.

As shown in FIG. 5, the distribution terminal 400 includes a processor 40, a memory 41, a storage 42, a communication IF 43, an input / output IF 44, and a touch screen 45. The distribution terminal 400 may include an input / output IF 44 to which a display (display unit) configured separately from the distribution terminal 400 main body can be connected instead of or in addition to the touch screen 45.

Controller 1021 may have one or more physical input mechanisms such as buttons, levers, sticks, wheels and the like. The controller 1021 transmits an output value based on an input operation input to the input mechanism by the operator of the distribution terminal 400 (player in the present embodiment) to the distribution terminal 400. Further, the controller 1021 may have various sensors such as an acceleration sensor and an angular velocity sensor, and may transmit the output values of the various sensors to the distribution terminal 400. The above output value is accepted by the distribution terminal 400 via the communication IF43.

The distribution terminal 400 may include a camera and a distance measuring sensor (both not shown). Alternatively or in addition to the distribution terminal 400, the controller 1021 may have a camera and a distance measuring sensor.

As described above, the distribution terminal 400 includes a communication IF43, an input / output IF44, and a touch screen 45 as an example of a mechanism for inputting information to the distribution terminal 400. Each of the above-mentioned parts as an input mechanism can be regarded as an operation part configured to accept a user's input operation.

When the operation unit is composed of the touch screen 45, the distribution terminal 400 identifies and accepts the user's operation performed on the input unit 451 of the touch screen 45 as the user's input operation. Alternatively, when the operation unit is composed of the communication IF 43, the distribution terminal 400 identifies and accepts a signal (for example, an output value) transmitted from the controller 1021 as an input operation of the user. Alternatively, when the operation unit is composed of the input / output IF44, the distribution terminal 400 identifies and accepts a signal output from an input device (not shown) connected to the input / output IF44 as a user's input operation.

<Hardware components of each device>
The processors 10, 20, 30, and 40 control the overall operation of the user terminal 100, the server 200, the game play terminal 300, and the distribution terminal 400, respectively. Processors 10, 20, 30, and 40 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit). Processors 10, 20, 30, and 40 read programs from storages 12, 22, 32, and 42, which will be described later, respectively. Then, the processors 10, 20, 30, and 40 expand the read programs into the memories 11, 21, 31, and 41, which will be described later, respectively. Processors 10, 20, and 30 execute the expanded program.

The memories 11, 21, 31, and 41 are the main storage devices. The memories 11, 21, 31, and 41 are composed of storage devices such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory 11 provides a work area to the processor 10 by temporarily storing a program and various data read from the storage 12 described later by the processor 10. The memory 11 also temporarily stores various data generated while the processor 10 is operating according to the program. The memory 21 provides a work area to the processor 20 by temporarily storing various programs and data read from the storage 22 described later by the processor 20. The memory 21 also temporarily stores various data generated while the processor 20 is operating according to the program. The memory 31 provides a work area to the processor 30 by temporarily storing various programs and data read from the storage 32 described later by the processor 30. The memory 31 also temporarily stores various data generated while the processor 30 is operating according to the program. The memory 41 provides a work area to the processor 40 by temporarily storing the program and various data read from the storage 42 described later by the processor 40. The memory 41 also temporarily stores various data generated while the processor 40 is operating according to the program.

In the present embodiment, the programs executed by the processors 10 and 30 may be the game programs of the present game. In the present embodiment, the program executed by the processor 40 may be a distribution program for realizing distribution of operation instruction data. Further, the processor 10 may further execute a viewing program for realizing the reproduction of the moving image.

In the present embodiment, the program executed by the processor 20 may be at least one of the above-mentioned game program, distribution program, and viewing program. The processor 20 executes at least one of a game program, a distribution program, and a viewing program in response to a request from at least one of the user terminal 100, the game play terminal 300, and the distribution terminal 400. The distribution program and the viewing program may be executed in parallel.

That is, the game program may be a program that realizes the game by the cooperation of the user terminal 100, the server 200, and the game play terminal 300. The distribution program may be a program that realizes distribution of operation instruction data in collaboration with the server 200 and the distribution terminal 400. The viewing program may be a program that realizes the reproduction of a moving image in collaboration with the user terminal 100 and the server 200.

The storages 12, 22, 32, and 42 are auxiliary storage devices. The storages 12, 22, 32, and 42 are composed of a storage device such as a flash memory or an HDD (Hard Disk Drive). For example, various data related to the game are stored in the storages 12 and 32. Various data related to the distribution of the operation instruction data are stored in the storage 42. In addition, various data related to the reproduction of the moving image are stored in the storage 12. The storage 22 may store at least a part of various data related to each of the game, the distribution of the operation instruction data, and the reproduction of the moving image.

The communication IFs 13, 23, 33, and 43 control the transmission and reception of various data in the user terminal 100, the server 200, the game play terminal 300, and the distribution terminal 400, respectively. The communication IFs 13, 23, 33, and 43 include, for example, communication via a wireless LAN (Local Area Network), Internet communication via a wired LAN, a wireless LAN, or a mobile phone network, and communication using a short-range wireless communication or the like. Control.

The input / output IFs 14, 24, 34, and 44 are interfaces for the user terminal 100, the server 200, the game play terminal 300, and the distribution terminal 400 to receive data input and to output data, respectively. The input / output IFs 14, 24, 34, 44 may input / output data via USB (Universal Serial Bus) or the like. Input / output IFs 14, 24, 34, 44 may include physical buttons, cameras, microphones, speakers, mice, keyboards, displays, sticks, levers and the like. Further, the input / output IFs 14, 24, 34, 44 may include a connection portion for transmitting / receiving data to / from a peripheral device.

The touch screen 15 is an electronic component that combines an input unit 151 and a display unit 152 (display). The touch screen 45 is an electronic component that combines an input unit 451 and a display unit 452. The input units 151 and 451 are, for example, touch-sensitive devices, and are configured by, for example, a touch pad. The display units 152 and 452 are composed of, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, or the like.

The input units 151 and 451 detect the position where the user's operation (mainly a physical contact operation such as a touch operation, a slide operation, a swipe operation, and a tap operation) is input to the input surface, and information indicating the position. Has a function of transmitting as an input signal. The input units 151 and 451 may include touch sensing units (not shown). The touch sensing unit may adopt any method such as a capacitance method or a resistance film method.

Although not shown, the user terminal 100 and the distribution terminal 400 may each include one or more sensors for specifying the holding posture of the user terminal 100 and the distribution terminal 400, respectively. This sensor may be, for example, an acceleration sensor, an angular velocity sensor, or the like.

When the user terminal 100 and the distribution terminal 400 include a sensor, the processors 10 and 40 each specify the holding postures of the user terminal 100 and the distribution terminal 400 from the output of the sensor, and perform processing according to the holding posture. It also becomes possible. For example, the processors 10 and 40 may be a vertical screen display in which vertically long images are displayed on the display units 152 and 452 when the user terminal 100 and the distribution terminal 400 are held vertically, respectively. On the other hand, when the user terminal 100 and the distribution terminal 400 are held horizontally, a horizontally long image may be displayed on the display unit as a horizontal screen display. In this way, the processors 10 and 40 may be able to switch between the vertical screen display and the horizontal screen display according to the holding postures of the user terminal 100 and the distribution terminal 400, respectively.

<Functional configuration of system 1>
FIG. 6 is a block diagram showing a functional configuration of a user terminal 100, a server 200, and an HMD set 1000 included in the system 1. FIG. 7 is a block diagram showing a functional configuration of the distribution terminal 400 shown in FIG.

The user terminal 100 has a function as an input device that accepts a user's input operation and a function as an output device that outputs a game image or sound. The user terminal 100 functions as a control unit 110 and a storage unit 120 in cooperation with a processor 10, a memory 11, a storage 12, a communication IF 13, an input / output IF 14, a touch screen 15, and the like.

The server 200 has a function of mediating the transmission / reception of various information between the user terminal 100, the HMD set 1000, and the distribution terminal 400. The server 200 functions as a control unit 210 and a storage unit 220 in cooperation with the processor 20, the memory 21, the storage 22, the communication IF23, the input / output IF24, and the like.

The HMD set 1000 (game play terminal 300) provides a function as an input device for receiving an input operation of a player, a function as an output device for outputting game images and sounds, and game progress information to a user via a server 200. It has a function of transmitting to the terminal 100 in real time. The HMD set 1000 is a control unit 310 in cooperation with the processor 30, the memory 31, the storage 32, the communication IF33, the input / output IF34, and the HMD500, the HMD sensor 510, the motion sensor 520, the controller 540, and the like of the game play terminal 300. And functions as a storage unit 320.

The distribution terminal 400 has a function of generating operation instruction data and transmitting the operation instruction data to the user terminal 100 via the server 200. The distribution terminal 400 functions as a control unit 410 and a storage unit 420 in cooperation with a processor 40, a memory 41, a storage 42, a communication IF 43, an input / output IF 44, a touch screen 45, and the like.

(Data stored in the storage unit of each device)
The storage unit 120 stores the game program 131 (program), the game information 132, and the user information 133. The storage unit 220 stores the game program 231 and the game information 232, the user information 233, and the user list 234. The storage unit 320 stores the game program 331, the game information 332, and the user information 333. The storage unit 420 stores the user list 421, the motion list 422, and the distribution program 423 (program, second program).

The game programs 131, 231 and 331 are game programs executed by the user terminal 100, the server 200, and the HMD set 1000, respectively. This game is realized by the cooperative operation of each device based on the game programs 131, 231 and 331. The game programs 131 and 331 may be stored in the storage unit 220 and downloaded to the user terminal 100 and the HMD set 1000, respectively. In the present embodiment, the user terminal 100 renders the data received from the distribution terminal 400 based on the game program 131, and reproduces the moving image. In other words, the game program 131 is also a program for playing back a moving image using the moving image instruction data distributed from the distribution terminal 400. The program for playing the moving image may be different from the game program 131. In this case, the storage unit 120 stores a program for playing the moving image separately from the game program 131.

The game information 132, 232, and 332 are data that the user terminal 100, the server 200, and the HMD set 1000 refer to when executing the game program, respectively. The user information 133, 233, and 333 are data related to the user account of the user terminal 100. The game information 232 is the game information 132 of each user terminal 100 and the game information 332 of the HMD set 1000. The user information 233 is the user information of the player included in the user information 133 of each user terminal 100 and the user information 333. The user information 333 is the user information 133 of each user terminal 100 and the user information of the player.

The user list 234 and the user list 421 are a list of users who have participated in the game. The user list 234 and the user list 421 may include a list of users who participated in the most recent gameplay by the player, as well as a list of users who participated in each gameplay before the gameplay. The motion list 422 is a list of a plurality of motion data created in advance. The motion list 422 is, for example, a list in which motion data is associated with each of the information (for example, a motion name) that identifies each motion. The distribution program 423 is a program for realizing distribution of operation instruction data for playing a moving image on the user terminal 100 to the user terminal 100.

(Functional configuration of server 200)
The control unit 210 comprehensively controls the server 200 by executing the game program 231 stored in the storage unit 220. For example, the control unit 210 mediates the transmission and reception of various information between the user terminal 100, the HMD set 1000, and the distribution terminal 400.

The control unit 210 functions as a communication mediation unit 211, a log generation unit 212, and a list generation unit 213 according to the description of the game program 231. The control unit 210 can also function as other functional blocks (not shown) for mediating the transmission and reception of various information related to game play and distribution of operation instruction data, and for supporting the progress of the game.

The communication mediation unit 211 mediates the transmission and reception of various information between the user terminal 100, the HMD set 1000, and the distribution terminal 400. For example, the communication mediation unit 211 transmits the game progress information received from the HMD set 1000 to the user terminal 100. The game progress information includes data indicating the movement of the character operated by the player, the parameters of the character, information on items and weapons possessed by the character, enemy characters, and the like. The server 200 transmits the game progress information to the user terminals 100 of all the users participating in the game. In other words, the server 200 transmits common game progress information to the user terminals 100 of all the users participating in the game. As a result, the game progresses in the same manner as the HMD set 1000 on each of the user terminals 100 of all the users participating in the game.

Further, for example, the communication mediation unit 211 transmits the information received from any one of the user terminals 100 to support the progress of the game by the player to the other user terminals 100 and the HMD set 1000. As an example, the information may be an item for the player to advance the game advantageously, and may be item information indicating an item provided to the player (character). The item information includes information (user name, user ID, etc.) indicating the user who provided the item. Further, the communication mediation unit 211 may mediate the distribution of the operation instruction data from the distribution terminal 400 to the user terminal 100.

The log generation unit 212 generates a game progress log based on the game progress information received from the HMD set 1000. The list generation unit 213 generates the user list 234 after the end of the game play. Although the details will be described later, each user in the user list 234 is associated with a tag indicating the content of the support provided to the player by the user. The list generation unit 213 generates a tag based on the game progress log generated by the log generation unit 212, and associates it with the corresponding user. The list generation unit 213 may associate the content of the support provided by each user to the player, which is input by the game operator or the like using a terminal device such as a personal computer, with the corresponding user as a tag. .. As a result, the content of the support provided by each user becomes more detailed. When the user participates in the game, the user terminal 100 transmits information indicating the user to the server 200 based on the user's operation. For example, the user terminal 100 transmits the user ID entered by the user to the server 200. That is, the server 200 holds information indicating each user for all the users participating in the game. The list generation unit 213 may generate the user list 234 using the information.

(Functional configuration of HMD set 1000)
The control unit 310 comprehensively controls the HMD set 1000 by executing the game program 331 stored in the storage unit 320. For example, the control unit 310 advances the game according to the game program 331 and the operation of the player. In addition, the control unit 310 communicates with the server 200 to send and receive information as needed while the game is in progress. The control unit 310 may directly send and receive information to and from the user terminal 100 without going through the server 200.

The control unit 310 has an operation reception unit 311, a display control unit 312, a UI control unit 313, an animation generation unit 314, a game progress unit 315, a virtual space control unit 316, and a reaction processing unit 317 according to the description of the game program 331. Functions as. The control unit 310 can also function as other functional blocks (not shown) for controlling characters appearing in the game, depending on the nature of the game to be executed.

The operation reception unit 311 detects and accepts the input operation of the player. The operation reception unit 311 receives signals input from the HMD 500, the motion sensor 520, the controller 540, etc., determines what kind of input operation has been performed, and outputs the result to each element of the control unit 310.

The UI control unit 313 controls a user interface (hereinafter, UI) image to be displayed on the monitor 51, the display 530, and the like. The UI image is a tool for the player to make an input necessary for the progress of the game to the HMD set 1000, or a tool for obtaining information output during the progress of the game from the HMD set 1000. UI images are, but are not limited to, icons, buttons, lists, menu screens, and the like.

The animation generation unit 314 generates animations showing the motions of various objects based on the control modes of the various objects. For example, the animation generation unit 314 may generate an animation or the like that expresses how an object (for example, a player's avatar object) moves as if it were there, moves its mouth, or changes its facial expression. ..

The game progress unit 315 advances the game based on the game program 331, the input operation by the player, the operation of the avatar object in response to the input operation, and the like. For example, the game progress unit 315 performs a predetermined game process when the avatar object performs a predetermined operation. Further, for example, the game progress unit 315 may receive information representing a user's operation on the user terminal 100 and perform game processing based on the user's operation. Further, the game progress unit 315 generates game progress information according to the progress of the game and transmits it to the server 200. The game progress information is transmitted to the user terminal 100 via the server 200. As a result, the progress of the game in the HMD set 1000 is shared by the user terminal 100. In other words, the progress of the game in the HMD set 1000 and the progress of the game in the user terminal 100 are synchronized.

The virtual space control unit 316 performs various controls related to the virtual space provided to the player according to the progress of the game. As an example, the virtual space control unit 316 creates various objects and arranges them in the virtual space. Further, the virtual space control unit 316 arranges the virtual camera in the virtual space. Further, the virtual space control unit 316 operates various objects arranged in the virtual space according to the progress of the game. Further, the virtual space control unit 316 controls the position and inclination of the virtual camera arranged in the virtual space according to the progress of the game.

The display control unit 312 outputs a game screen reflecting the processing results executed by each of the above-mentioned elements to the monitor 51 and the display 530. The display control unit 312 may display an image based on the field of view from the virtual camera arranged in the virtual space on the monitor 51 and the display 530 as a game screen. Further, the display control unit 312 may include the animation generated by the animation generation unit 314 in the game screen. Further, the display control unit 312 may superimpose and draw the above-mentioned UI image controlled by the UI control unit 313 on the game screen.

The reaction processing unit 317 receives feedback on the reaction of the user of the user terminal 100 to the game play of the player, and outputs this to the player. In the present embodiment, for example, the user terminal 100 can create a comment (message) addressed to the avatar object based on the input operation of the user. The reaction processing unit 317 receives the comment data of the comment and outputs it. The reaction processing unit 317 may display the text data corresponding to the user's comment on the monitor 51 and the display 530, or may output the voice data corresponding to the user's comment from a speaker (not shown). In the former case, the reaction processing unit 317 may superimpose and draw an image corresponding to the text data (that is, an image including the content of the comment) on the game screen.

(Functional configuration of user terminal 100)
The control unit 110 comprehensively controls the user terminal 100 by executing the game program 131 stored in the storage unit 120. For example, the control unit 110 advances the game according to the game program 131 and the user's operation. In addition, the control unit 110 communicates with the server 200 to send and receive information as needed while the game is in progress. The control unit 110 may send and receive information directly to and from the HMD set 1000 without going through the server 200.

The control unit 110 has an operation reception unit 111, a display control unit 112, a UI control unit 113, an animation generation unit 114, a game progress unit 115, a virtual space control unit 116, and a video playback unit 117 according to the description of the game program 131. Functions as. The control unit 110 can also function as other functional blocks (not shown) for the progress of the game, depending on the nature of the game being executed.

The operation reception unit 111 detects and accepts a user's input operation with respect to the input unit 151. The operation reception unit 111 determines what kind of input operation has been performed from the action exerted by the user on the console via the touch screen 15 and other input / output IF 14, and outputs the result to each element of the control unit 110. do.

For example, the operation receiving unit 111 receives an input operation for the input unit 151, detects the coordinates of the input position of the input operation, and specifies the type of the input operation. The operation reception unit 111 specifies, for example, a touch operation, a slide operation, a swipe operation, a tap operation, and the like as the types of input operations. Further, the operation reception unit 111 detects that the contact input is released from the touch screen 15 when the continuously detected input is interrupted.

The UI control unit 113 controls a UI image to be displayed on the display unit 152 in order to construct a UI according to at least one of a user's input operation and received game progress information. The UI image is a tool for the user to input necessary input for the progress of the game to the user terminal 100, or a tool for obtaining information output during the progress of the game from the user terminal 100. UI images are, but are not limited to, icons, buttons, lists, menu screens, and the like.

The animation generation unit 114 generates animations showing the motions of various objects based on the control modes of the various objects.

The game progress unit 115 advances the game based on the game program 131, the received game progress information, the input operation by the user, and the like. When a predetermined game process is performed by an input operation by the user, the game progress unit 115 transmits information about the game process to the HMD set 1000 via the server 200. As a result, the predetermined game processing is shared in the HMD set 1000. In other words, the progress of the game in the HMD set 1000 and the progress of the game in the user terminal 100 are synchronized. The predetermined game process is, for example, a process of providing an item to the avatar object, and in this example, the information related to the game process is the item information described above.

The virtual space control unit 116 performs various controls related to the virtual space provided to the user according to the progress of the game. As an example, the virtual space control unit 116 creates various objects and arranges them in the virtual space. Further, the virtual space control unit 116 arranges the virtual camera in the virtual space. Further, the virtual space control unit 116 operates various objects arranged in the virtual space according to the progress of the game, specifically, the received game progress information. Further, the virtual space control unit 316 controls the position and inclination of the virtual camera arranged in the virtual space according to the progress of the game, specifically, the received game progress information.

The display control unit 112 outputs to the display unit 152 a game screen in which the processing results executed by each of the above elements are reflected. The display control unit 112 may display an image based on the field of view from the virtual camera arranged in the virtual space provided to the user on the display unit 152 as a game screen. Further, the display control unit 112 may include the animation generated by the animation generation unit 114 in the game screen. Further, the display control unit 112 may superimpose and draw the above-mentioned UI image controlled by the UI control unit 113 on the game screen. In any case, the game screen displayed on the display unit 152 is the same game screen as the game screen displayed on the other user terminal 100 and the HMD set 1000.

The moving image reproduction unit 117 analyzes (renders) the operation instruction data received from the distribution terminal 400, and reproduces the moving image.

(Functional configuration of distribution terminal 400)
The control unit 410 comprehensively controls the distribution terminal 400 by executing a program (not shown) stored in the storage unit 420. For example, the control unit 410 generates operation instruction data and distributes it to the user terminal 100 according to the operation of the program and the user (player in this embodiment) of the distribution terminal 400. In addition, the control unit 410 communicates with the server 200 to send and receive information as needed. The control unit 410 may send and receive information directly to and from the user terminal 100 without going through the server 200.

The control unit 410 functions as a communication control unit 411, a display control unit 412, an operation reception unit 413, a voice reception unit 414, a motion identification unit 415, and an operation instruction data generation unit 416 according to the description of the program. The control unit 410 can also function as another functional block (not shown) for generating and distributing the operation instruction data.

The communication control unit 411 controls transmission / reception of information to / from the server 200 or the user terminal 100 via the server 200. The communication control unit 411 receives the user list 421 from the server 200 as an example. Further, the communication control unit 411 transmits the operation instruction data to the user terminal 100 as an example.

The display control unit 412 outputs various screens reflecting the processing results executed by each element to the display unit 452. The display control unit 412 displays a screen including the received user list 234 as an example. Further, as an example, the display control unit 412 displays a screen including a motion list 422 for causing the player to select motion data for operating the avatar object included in the motion instruction data to be distributed.

The operation reception unit 413 detects and accepts a player's input operation with respect to the input unit 151. The operation reception unit 111 determines what kind of input operation has been performed from the action exerted by the player on the console via the touch screen 45 and other input / output IF44s, and outputs the result to each element of the control unit 410. do.

For example, the operation reception unit 413 receives an input operation for the input unit 451, detects the coordinates of the input position of the input operation, and specifies the type of the input operation. The operation reception unit 413 specifies, for example, a touch operation, a slide operation, a swipe operation, a tap operation, and the like as the types of input operations. Further, the operation reception unit 413 detects that the contact input is released from the touch screen 45 when the continuously detected input is interrupted.

The voice reception unit 414 receives the voice generated around the distribution terminal 400 and generates voice data of the voice. As an example, the voice reception unit 414 receives the voice spoken by the player and generates voice data of the voice.

The motion specifying unit 415 specifies the motion data selected by the player from the motion list 422 according to the input operation of the player.

The operation instruction data generation unit 416 generates the operation instruction data. As an example, the operation instruction data generation unit 416 generates operation instruction data including the generated voice data and the specified motion data.

The functions of the HMD set 1000, the server 200, and the user terminal 100 shown in FIG. 6 and the functions of the distribution terminal 400 shown in FIG. 7 are merely examples. Each device of the HMD set 1000, the server 200, the user terminal 100, and the distribution terminal 400 may include at least a part of the functions provided by the other devices. Further, another device other than the HMD set 1000, the server 200, the user terminal 100, and the distribution terminal 400 may be a component of the system 1, and the other device may be made to execute a part of the processing in the system 1. That is, the computer that executes the game program in the present embodiment may be any of the HMD set 1000, the server 200, the user terminal 100, the distribution terminal 400, and other devices, or a plurality of these. It may be realized by the combination of the devices of.

<Control processing of virtual space>
FIG. 8 is a flowchart showing an example of a flow of control processing of the virtual space provided to the player and the virtual space provided to the user of the user terminal 100. FIG. 9 is a diagram showing a virtual space 600A provided to the player and a field of view image visually recognized by the player according to an embodiment. FIG. 10 is a diagram showing a virtual space 600B provided to a user of a user terminal 100 and a field of view image visually recognized by the user according to a certain embodiment. Hereinafter, when it is not necessary to distinguish between the virtual spaces 600A and 600B, it is described as "virtual space 600".

In step S1, the processor 30 defines the virtual space 600A shown in FIG. 9 as the virtual space control unit 316. The processor 30 defines the virtual space 600A by using the virtual space data (not shown). The virtual space data may be stored in the game play terminal 300, may be generated by the processor 30 based on the game program 331, or may be acquired by the processor 30 from an external device such as the server 200. May be good.

As an example, the virtual space 600 has an all-sky spherical structure that covers the entire 360-degree direction of a point defined as a center. In FIGS. 9 and 10, the celestial sphere in the upper half of the virtual space 600 is illustrated so as not to complicate the explanation.

In step S2, the processor 30 arranges the avatar object 610 (character) in the virtual space 600A as the virtual space control unit 316. The avatar object 610 is an avatar object associated with the player, and operates according to the input operation of the player.

In step S3, the processor 30 arranges other objects in the virtual space 600A as the virtual space control unit 316. In the example of FIG. 9, processor 30 arranges objects 631-634. Other objects imitate, for example, character objects (so-called non-player characters, NPCs) that operate according to the game program 331, operation objects such as virtual hands, animals, plants, man-made objects, and natural objects that are arranged as the game progresses. Can include objects and the like.

In step S4, the processor 30 arranges the virtual camera 620A in the virtual space 600A as the virtual space control unit 316. As an example, the processor 30 arranges the virtual camera 620A at the position of the head of the avatar object 610.

In step S5, the processor 30 displays the field of view image 650 on the monitor 51 and the display 530. The processor 30 defines a field of view 640A, which is the field of view from the virtual camera 620A in the virtual space 600A, according to the initial position and tilt of the virtual camera 620A. Then, the processor 30 defines the field of view image 650 corresponding to the field of view area 640A. The processor 30 outputs the field of view image 650 to the monitor 51 and the display 530 to display the field of view image 650 on the HMD 500 and the display 530.

In the example of FIG. 9, as shown in FIG. 9A, a part of the object 634 is included in the field of view area 640A, so that the field of view image 650 is one of the objects 634 as shown in FIG. 9B. Includes part.

In step S6, the processor 30 transmits the initial arrangement information to the user terminal 100 via the server 200. The initial placement information is information indicating the initial placement positions of various objects in the virtual space 600A. In the example of FIG. 9, the initial placement information includes the avatar object 610 and the information of the initial placement positions of the objects 631 to 634. The initial placement information can also be expressed as one of the game progress information.

In step S7, the processor 30 controls the virtual camera 620A according to the movement of the HMD 500 as the virtual space control unit 316. Specifically, the processor 30 controls the orientation and tilt of the virtual camera 620A according to the movement of the HMD 500, that is, the posture of the player's head. As will be described later, when the player moves the head (changes the posture of the head), the processor 30 moves the head of the avatar object 610 in accordance with this movement. The processor 30 controls the orientation and tilt of the virtual camera 620A so that, for example, the direction of the line of sight of the avatar object 610 coincides with the direction of the line of sight of the virtual camera 620A. In step S8, the processor 30 updates the field of view image 650 in response to changes in the orientation and tilt of the virtual camera 620A.

In step S9, the processor 30 moves the avatar object 610 as the virtual space control unit 316 according to the movement of the player. As an example, the processor 30 moves the avatar object 610 in the virtual space 600A in response to the player moving in the real space. Further, the processor 30 moves the head of the avatar object 610 in the virtual space 600A in response to the player moving the head in the real space.

In step S10, the processor 30 moves the virtual camera 620A as the virtual space control unit 316 so as to follow the avatar object 610. That is, the virtual camera 620A is always at the position of the head of the avatar object 610 even if the avatar object 610 moves.

The processor 30 updates the field of view image 650 in response to the movement of the virtual camera 620A. That is, the processor 30 updates the view area 640A according to the posture of the player's head and the position of the virtual camera 620A in the virtual space 600A. As a result, the field of view image 650 is updated.

In step S11, the processor 30 transmits the operation instruction data of the avatar object 610 to the user terminal 100 via the server 200. The operation instruction data here is motion data that captures the player's motion, voice data of the voice spoken by the player, and operation data indicating the content of the input operation to the controller 540 during the virtual experience (for example, during game play). Includes at least one. When the player is playing the game, the operation instruction data is transmitted to the user terminal 100 as, for example, game progress information.

The processes of steps S7 to S11 are continuously and repeatedly executed while the player is playing the game.

In step S21, the processor 10 of the user terminal 100 of the user 3 defines the virtual space 600B shown in FIG. 10 as the virtual space control unit 116. The processor 10 defines the virtual space 600B by using the virtual space data (not shown). The virtual space data may be stored in the user terminal 100, may be generated by the processor 10 based on the game program 131, or may be acquired by the processor 10 from an external device such as the server 200. good.

In step S22, the processor 10 receives the initial placement information. In step S23, the processor 10 arranges various objects in the virtual space 600B as the virtual space control unit 116 according to the initial arrangement information. In the case of the example of FIG. 10, the various objects are the avatar object 610 and the objects 631 to 634.

In step S24, the processor 10 arranges the virtual camera 620B in the virtual space 600B as the virtual space control unit 116. As an example, the processor 10 arranges the virtual camera 620B at the position shown in FIG. 10 (A).

In step S25, the processor 10 displays the field of view image 660 on the display unit 152. The processor 10 defines a field of view 640B, which is the field of view from the virtual camera 620B in the virtual space 600B, according to the initial position and tilt of the virtual camera 620B. Then, the processor 10 defines the field of view image 660 corresponding to the field of view area 640B. The processor 10 outputs the field of view image 660 to the display unit 152 to display the field of view image 660 on the display unit 152.

In the example of FIG. 10, as shown in FIG. 10 (A), the avatar object 610 and the object 631 are included in the field of view area 640B, so that the field of view image 660 is the avatar object 610 as shown in FIG. 10 (B). And object 631.

In step S26, the processor 10 receives the operation instruction data. In step S27, the processor 10 moves the avatar object 610 in the virtual space 600B as the virtual space control unit 116 according to the operation instruction data. In other words, the processor 10 reproduces the video in which the avatar object 610 is operating by real-time rendering.

In step S28, the processor 10 controls the virtual camera 620B as the virtual space control unit 116 according to the operation of the user received as the operation reception unit 111. In step S29, the processor 10 updates the field of view image 660 in response to changes in the position of the virtual camera 620B in the virtual space 600B, the orientation and tilt of the virtual camera 620B. In step S28, the processor 10 may automatically control the virtual camera 620B according to the movement of the avatar object 610, for example, the movement of the avatar object 610 or the change of the orientation. For example, the processor 10 may automatically move the virtual camera 620B or change its orientation and tilt so that the avatar object 610 is always photographed from the front. Further, as an example, the processor 10 may automatically move the virtual camera 620B or change the orientation and tilt so as to always shoot the avatar object 610 from the rear according to the movement of the avatar object 610. good.

As described above, in the virtual space 600A, the avatar object 610 operates according to the movement of the player. The operation instruction data indicating this operation is transmitted to the user terminal 100. In the virtual space 600B, the avatar object 610 operates according to the received operation instruction data. As a result, the avatar object 610 performs the same operation in the virtual space 600A and the virtual space 600B. In other words, the user 3 can visually recognize the movement of the avatar object 610 according to the movement of the player by using the user terminal 100.

<Game overview>
FIG. 11 is a diagram showing another example of the field of view image displayed on the user terminal 100. Specifically, it is a figure which shows an example of the game screen of the game (this game) executed by the system 1 played by a player.

In this game, as an example, an avatar object 610 that operates weapons such as guns and knives and a plurality of enemy objects 671 that are NPCs appear in the virtual space 600, and the avatar object 610 fights against the enemy object 671. It is a game to let you. Various game parameters such as the physical strength of the avatar object 610, the number of magazines that can be used, the number of remaining bullets of the gun, and the remaining number of the enemy object 671 are updated as the game progresses.

A plurality of stages are prepared in this game, and the player can clear the stage by satisfying a predetermined achievement condition associated with each stage. Predetermined achievement conditions are established by, for example, defeating all appearing enemy objects 671, defeating boss objects among the appearing enemy objects 671, acquiring predetermined items, reaching a predetermined position, and the like. It may include the condition to be used. The achievement conditions are defined in the game program 131. In this game, the player clears the stage when the achievement condition is satisfied according to the content of the game, in other words, the avatar object 610 wins the enemy object 671 (avatar object 610 and enemy object 671). The victory or defeat between) is decided. On the other hand, for example, when the game executed by the system 1 is a racing game or the like, the ranking of the avatar object 610 is determined when the condition of reaching the goal is satisfied.

In this game, in order to share the virtual space between the HMD set 1000 and the plurality of user terminals 100, the game progress information is live-distributed to the plurality of user terminals 100 at predetermined time intervals. As a result, on the touch screen 15 of the user terminal 100 while watching the game, a field of view image of the field of view region defined by the virtual camera 620B corresponding to the user terminal 100 is displayed. Further, in the upper right and upper left of the visibility image, parameter images showing the physical strength of the avatar object 610, the number of magazines that can be used, the number of remaining bullets of the gun, the remaining number of the enemy object 671 and the like are superimposed and displayed. .. This field of view image can also be expressed as a game screen.

As described above, the game progress information includes motion data that captures the player's actions, voice data of the voice spoken by the player, and operation data that indicates the content of the input operation to the controller 540. These data are, that is, information for specifying the position, posture, orientation, etc. of the avatar object 610, information for specifying the position, posture, orientation, etc. of the enemy object 671, and other objects (for example, obstacle objects 672 and 673). This is information that identifies the position of the object. The processor 10 identifies the position, posture, orientation, and the like of each object by analyzing (rendering) the game progress information.

The game information 132 includes data of various objects such as an avatar object 610, an enemy object 671, and obstacle objects 672 and 673. The processor 10 uses the data and the analysis result of the game progress information to update the position, posture, orientation, and the like of each object. As a result, the game progresses, and each object in the virtual space 600B moves in the same manner as each object in the virtual space 600A. Specifically, in the virtual space 600B, each object including the avatar object 610 operates based on the game progress information regardless of whether or not the user operates the user terminal 100.

On the touch screen 15 of the user terminal 100, as an example, UI images 701 and 702 are displayed superimposed on the visual field image. The UI image 701 is a UI image that accepts an operation for displaying the UI image 711 for displaying the item input operation for supporting the avatar object 610 from the user 3 on the touch screen 15. The UI image 702 accepts an operation for displaying a UI image (described later) on the touch screen 15 for receiving an operation for inputting and transmitting a comment for the avatar object 610 (in other words, the player 4) from the user 3. It is a UI image. The operation accepted by the UI images 701 and 702 may be, for example, an operation of tapping the UI images 701 and 702.

When the UI image 701 is tapped, the UI image 711 is displayed superimposed on the field of view image. The UI image 711 is, for example, a UI image 711A on which a magazine icon is drawn, a UI image 711B on which an first aid box icon is drawn, a UI image 711C on which a triangular cone icon is drawn, and a UI on which a barricade icon is drawn. Includes image 711D. The item insertion operation corresponds to, for example, an operation of tapping any UI image.

As an example, when the UI image 711A is tapped, the number of remaining bullets of the gun used by the avatar object 610 increases. When the UI image 711B is tapped, the physical strength of the avatar object 610 is restored. When the UI images 711C and 711D are tapped, obstacle objects 672 and 673 that obstruct the movement of the enemy object 671 are placed in the virtual space. One of the obstacle objects 672 and 673 may obstruct the movement of the enemy object 671 more than the other.

The processor 10 transmits the item input information indicating that the item input operation has been performed to the server 200. The item input information includes at least information for specifying the type of the item specified by the item input operation. The item input information may include other information about the item, such as information indicating where the item is placed. The item input information is transmitted to the other user terminal 100 and the HMD set 1000 via the server 200.

FIG. 12 is a diagram showing another example of the field of view image displayed on the user terminal 100. Specifically, it is a figure which shows an example of the game screen of this game, and is the figure for demonstrating the communication between a player and a user terminal 100 during game play.

In the example of FIG. 12A, the user terminal 100 causes the avatar object 610 to execute the utterance 691. Specifically, the user terminal 100 causes the avatar object 610 to execute the utterance 691 according to the voice data included in the game progress information. The content of the utterance 691 is "There is no bullet!" Spoken by the player 4. That is, the content of the utterance 691 is to inform each user that the magazine is 0 and the ammunition loaded in the gun is 1, so that the means for attacking the enemy object 671 is likely to be lost.

In FIG. 12A, a balloon is used to visually indicate the utterance of the avatar object 610, but in reality, the voice is output from the speaker of the user terminal 100. In addition to the audio output, the balloon shown in FIG. 12A (that is, the balloon including the text of the audio content) may be displayed in the visual field image. This also applies to the utterance 692 described later.

Upon receiving the tap operation on the UI image 702, the user terminal 100 superimposes and displays the UI images 705 and 706 (message UI) on the field of view image as shown in FIG. 12 (B). The UI image 705 is a UI image that displays a comment on the avatar object 610 (in other words, the player). The UI image 706 is a UI image that accepts a comment transmission operation from the user 3 in order to transmit the input comment.

As an example, when the user terminal 100 receives a tap operation on the UI image 705, the user terminal 100 displays a UI image (not shown, hereinafter simply referred to as "keyboard") imitating a keyboard on the touch screen 15. The user terminal 100 causes the UI image 705 to display text corresponding to the user's input operation on the keyboard. In the example of FIG. 12B, the text "Magazine is sent" is displayed on the UI image 705.

When the user terminal 100 receives a tap operation on the UI image 706 as an example after inputting the text, the user terminal 100 transmits the comment information including the input content (text content) and the information indicating the user to the server 200. do. The comment information is transmitted to the other user terminal 100 and the HMD set 1000 via the server 200.

The UI image 703A is a UI image showing the user name of the user who sent the comment, and the UI image 704A is a UI image showing the content of the comment sent by the user. In the example of FIG. 12B, the user whose user name is "BBBBBB" uses his / her own user terminal 100 to transmit comment information having the content "dangerous!", That is, the UI image 703A and the UI image 704A. Is displayed. The UI image 703A and the UI image 704A are displayed on the touch screen 15 of all the user terminals 100 participating in this game and the monitor 51 of the HMD 500. The UI images 703A and 704A may be one UI image. That is, one UI image may include the user name and the content of the comment.

In the example of FIG. 12C, a user with the user name "AAAAA", which is the user of the user terminal 100 shown in FIG. 12, inputs and transmits a comment as described above, so that the UI image is displayed on the touch screen 15. 703B and 704B are displayed. The UI image 703B includes the user name "AAAAAA", and the UI image 704B contains the comment "Magazine send!" Input in the example of FIG. 12B.

Further, in the example of FIG. 12C, the user "AAAAA" further inputs a tap operation to the UI image 701, displays the UI image 711 on the touch screen 15, and inputs a tap operation to the UI image 711A. It is a later view image 611. That is, as a result of the item input information indicating the magazine being transmitted from the user terminal 100 of the user "AAAAA" to the other user terminal 100 and the HMD set 1000, the user terminal 100 and the HMD set 1000 have the effect object 674 (described later). Is arranged in the virtual space 600. As an example, the user terminal 100 and the HMD set 1000 execute the effect related to the effect object 674 after the elapsed time indicated in the item input information has elapsed, and execute the process of invoking the effect of the item object.

In the example of FIG. 12D, the number of magazines is increased from 0 to 1 by executing the process of invoking the effect of the item object. As a result, the player utters "Thank you!" To the user "AAAAA", and the voice data of the utterance is transmitted to each user terminal 100. As a result, each user terminal 100 outputs the voice "Thank you!" As the utterance 692 of the avatar object 610.

As described above, in this game, communication between the user and the avatar object 610 is realized by outputting the utterance voice of the avatar object 610 based on the utterance of the player and inputting a comment by each user.

(Game progress processing in the game play terminal 300)
FIG. 13 is a flowchart showing an example of the flow of the game progress process executed by the game play terminal 300.

In step S31, the processor 30 advances the game as the game progress unit 315 based on the game program 331 and the movement of the player. In step S32, the processor 30 generates game progress information and distributes it to the user terminal 100. Specifically, the processor 30 transmits the generated game progress information to each user terminal 100 via the server 200.

When the processor 30 receives the item input information in step S33 (YES in S33), the processor 30 arranges the item object in the virtual space 600A based on the item input information in step S34. As an example, the processor 30 arranges the effect object 674 in the virtual space 600A before arranging the item object (see FIG. 11C). The effect object 674 may be, for example, an object imitating a present box. As an example, the processor 30 may execute the effect related to the effect object 674 after the elapsed time indicated in the item input information has elapsed. The effect may be, for example, an animation in which the lid of the present box is opened. After executing the animation, the processor 30 executes a process of invoking the effect of the item object. For example, in the example of FIG. 11D, the obstacle object 673 is arranged.

After executing the animation, the processor 30 may arrange the item object corresponding to the tapped UI image in the virtual space 600A. For example, when a tap operation is performed on the UI image 711A, the processor 30 arranges a magazine object indicating a magazine in the virtual space 600A after executing the animation. Further, when the tap operation is performed on the UI image 711B, the processor 30 arranges the first aid kit object indicating the first aid kit in the virtual space 600A after executing the animation. The processor 30 may execute a process of activating the effect of the magazine object or the first aid kit object when the avatar object 610 moves to the position of the magazine object or the first aid kit object, for example.

The processor 30 continues and repeats the processes of steps S31 to S34 until the game is finished. When the game ends, for example, when the player inputs a predetermined input operation for ending the game (YES in step S35), the process shown in FIG. 13 ends.

(Game progress processing in user terminal 100)
FIG. 14 is a flowchart showing an example of the flow of the game progress process executed by the user terminal 100.

In step S41, the processor 10 receives the game progress information. In step S42, the processor 10 advances the game as the game progress unit 115 based on the game progress information.

In step S43, when the processor 10 accepts the item input operation by the user 3 (YES in step S43), in step S44, the processor 10 consumes the virtual currency and arranges the effect object 674 in the virtual space 600B. Here, the virtual currency is purchased (charged for the game) by the user 3 performing a predetermined operation on the processor 10 before or during the participation in the game. It may be present, or it may be given to the user 3 when a predetermined condition is satisfied. The predetermined conditions may be those that require participation in this game, such as clearing a quest in this game, or those that do not require participation in this game, such as answering a questionnaire. The amount of virtual currency (the amount of virtual currency owned) is stored in the user terminal 100 as game information 132 as an example.

In step S45, the processor 10 transmits the item input information to the server 200. The item input information is transmitted to the game play terminal 300 via the server 200.

The processor 10 arranges the item object in the virtual space 600A when a predetermined time elapses after the arrangement of the effect object 674. In the example of FIG. 11, the obstacle object 673 is arranged. That is, when the user 3 inputs a tap operation to the UI image 711C, a predetermined amount of virtual currency is consumed and the obstacle object 673 is arranged.

The processor 10 continues and repeats the processes of steps S41 to S45 until the game is finished. When the game is finished, for example, when the player performs a predetermined input operation for ending the game, or when the user 3 performs a predetermined input operation for leaving the game halfway (YES in step S46). ), The process shown in FIG. 14 is completed.

(Game progress processing on server 200)
FIG. 15 is a flowchart showing an example of the flow of game progress processing executed on the server 200.

In step S51, the processor 20 receives the game progress information from the game play terminal 300. In step S52, the processor 20 updates the game progress log (hereinafter, play log) as the log generation unit 212. As an example, the play log is generated by the processor 20 when the initial arrangement information is received from the game play terminal 300.

In step S53, the processor 20 transmits the received game progress information to each user terminal 100.

When the item input information is received from any user terminal 100 in step S54 (YES in step S54), the processor 20 updates the play log as the log generation unit 212 in step S55. In step S56, the processor 20 transmits the received item input information to the game play terminal 300.

The processor 20 continues and repeats the processes of steps S51 to S56 until the game is finished. When the game is finished, for example, when information indicating that the game is finished is received from the game play terminal 300 (YES in step S57), in step S58, the processor 20 acts as a list generator 213 from the play log. Generate a list of users who participated in the game (user list 234). The processor 20 stores the generated user list 234 in the server 200.

FIG. 16 is a diagram showing a specific example of the user list 234. In the "user" column, information (for example, a user name) indicating each user who has participated in the game is stored. The "tag" column stores information (tags) generated based on the support provided by each user to the player. In the example of FIG. 16, among the tags stored in the "tag" column, those without the key brackets are the information automatically generated by the processor 20, and those with the key brackets are those stored by the game operator. This is manually entered information.

In the example of FIG. 16, the user "AAAAA" is associated with information such as a magazine, 10F, a boss, and "winning the boss by presenting the magazine". This indicates that, for example, in the boss battle on the stage of 10F, the user "AAAAA" inserts a magazine, and the avatar object 610 wins the boss with the ammunition of the inserted magazine.

In addition, the user "BBBBBB" is associated with information such as a first aid kit, 3rd floor, Zako, and "recovery on the verge of game over". For example, in a battle with a Zako enemy on the 3rd floor, the user "BBBB" "BBBBBB" throws in the first aid kit, and as a result, it shows that the physical strength of the avatar object 610 has recovered just before it becomes 0 (the game is over).

In addition, the user "CCCCC" is associated with information such as barricade, 5th floor, Zako, and "stopping two zombies at the barricade". This means that, for example, in a battle with a Zako enemy on the 5th floor, the user "CCCCC" throws in a barricade (obstacle object 672 in FIG. 11), and as a result, succeeds in stopping the two Zako enemies. Shown.

In the example of FIG. 16, one support provided is associated with the user name of each user 3, but the user name of the user 3 who has performed the support a plurality of times has a tag for each of the multiple times of support. Associated. In the user list 234, it is preferable that each tag is distinguished. As a result, after the game is completed, the player who refers to the user list 421 using the distribution terminal 400 can accurately grasp the content of each support.

<Distribution of operation instruction data>
(Distribution processing in the distribution terminal 400)
FIG. 17 is a flowchart showing an example of the flow of the distribution process executed by the distribution terminal 400. FIG. 18 is a diagram showing a specific example of a screen displayed on the distribution terminal 400. FIG. 19 is a diagram showing another specific example of the screen displayed on the distribution terminal.

In step S61, the processor 40 receives the first operation for displaying the list of users who participated in the game (user list 234) as the operation reception unit 413. The download screen 721 shown in FIG. 18A is a screen for downloading the user list 234 from the server 200 and displaying it on the display unit 452. As an example, the download screen 721 is a screen displayed immediately after inputting the start operation of the application for executing the distribution process shown in FIG. 17 into the distribution terminal 400.

The download screen 721 includes UI images 722 and 723 as an example. The UI image 722 accepts an operation for downloading the user list 234, that is, the first operation. The first operation may be, for example, an operation of tapping the UI image 722. The UI image 723 accepts an operation for terminating the application. The operation may be, for example, an operation of tapping the UI image 723.

Upon receiving the tap operation for the UI image 722, in step S62, the processor 40 acquires (receives) the user list 234 from the server 200 as the communication control unit 411. In step S63, the processor 40 causes the display unit 452 to display the user list 234 as the display control unit 412. Specifically, the processor 40 causes the display unit 452 to display the user list screen generated based on the user list 234. As an example, the user list screen may be the user list screen 731 shown in FIG. 18 (B). The user list screen 731 is composed of a record image corresponding to each record in the user list 234. In the example of FIG. 18B, record images 732A to 732C are shown as record images, but the number of record images is not limited to three. In the example of FIG. 18B, if the number of records in the user list 234 is greater than 3 (ie, the number of users participating in the game is greater than 3), the player may perform, for example, scroll the screen (eg,). By inputting a drag operation or a flick operation) to the touch screen 45, another record image can be displayed on the display unit 452.

As an example, the record images 732A to 732C include user names 733A to 733C, tag information 734A to 734C, and icons 735A to 735C, respectively. Hereinafter, when it is not necessary to distinguish the record images 732A to 732C, the user names 733A to 733C, the tag information 734A to 734C, and the icons 735A to 735C, "record image 732", "user name 733", and "user name 733", respectively. It is described as "tag information 734" and "icon 735".

The user name 733 is information indicating each user who has participated in the game, which is stored in the "user" column in the user list 234. The tag information 734 is information indicating a tag associated with each of the information indicating each user who participated in the game in the user list 234. For example, the record image 732A includes "AAAAAA" as the user name 733A. Therefore, the record image 732A includes "magazine, 10F, boss," win the boss by presenting the magazine "" as tag information 734A, which is associated with "AAAAA" in the user list 234. The icon 735 is, for example, an image preset by the user.

The processor 40 may store the received user list in the distribution terminal 400 (user list 421 in FIG. 7). The download screen 721 may include a UI image (not shown) for displaying the user list 421 on the display unit 452. In this example, when the UI image is tapped, the processor 40 does not download the user list 234, reads the user list 421, generates a user list screen from the user list 421, and displays the user list screen on the display unit 452. ..

In step S64, the processor 40 receives a second operation for selecting any of the users included in the user list screen 731 as the operation reception unit 413. As an example, the second operation may be an operation of tapping any of the record images 732 on the user list screen 731. In the example of FIG. 18B, the player inputs a tap operation to the record image 732A. That is, the player has selected the user "AAAAAA" as the user who distributes the operation instruction data.

Upon receiving the tap operation for the record image 732, in step S65, the processor 40 causes the display unit 452 to display the motion list 422 as the display control unit 412. Specifically, the processor 40 causes the display unit 452 to display the motion list screen generated based on the motion list 422. As an example, the motion list screen may be the motion list screen 741 shown in FIG. The motion list screen 741 is composed of a record image corresponding to each record in the motion list 422. In the example of FIG. 19, record images 742A to 742C are described as record images, but the number of record images is not limited to three. In the example of FIG. 19, when the number of records in the motion list 422 is more than 4, the player inputs another record, for example, an operation of scrolling the screen (for example, a drag operation or a flick operation) to the touch screen 45. The image can be displayed on the display unit 452.

As an example, the record images 742A-742C include motion names 743A-743C, motion images 744A-744C, and UI images 745A-745C, respectively. Hereinafter, when it is not necessary to distinguish the record images 742A to 742C, the motion names 743A to 743C, the motion images 744A to 744C, and the UI images 745A to 745C, "record image 7432" and "motion name 743", respectively. It is described as "motion image 744" and "UI image 745".

The motion name 743 is information for identifying the motion stored in the motion list 422. The motion image 744 is an image generated from the motion data associated with each motion name in the motion list 422. As an example, the processor 40 includes an image of the avatar object 610 that takes the first posture in each motion data in the record image 742 as the motion image 744. The motion image 744 may be a UI image that accepts a predetermined operation (for example, a tap operation on the motion image 744) by the player. When the processor 40 accepts the predetermined operation, the processor 40 may reproduce the motion moving image in which the avatar object 610 operates based on the motion data. The processor 40 may automatically redisplay the motion list screen 741 when the motion moving image is finished.

The record image 742 may include, for example, a UI image including the text "motion reproduction" instead of the motion image 744.

In step S66, the processor 40 receives the third operation of selecting the motion as the operation receiving unit 413. As an example, the third operation may be a tap operation on the UI image 745. That is, the UI image 745 accepts an operation of selecting motion data corresponding to each record image 742. By accepting the third operation, the processor 40 specifies the motion data selected by the player as the motion specifying unit 415.

In step S67, the processor 40 receives the voice input of the player as the display control unit 412 and the voice reception unit 414 while the avatar object 610 reproduces the motion moving image that operates based on the selected motion data.

FIG. 20 is a diagram showing a specific example of voice input by the player 4. As shown in FIG. 20, the player 4 is inputting the utterance voice 820A while playing the motion moving image 810A. The utterance voice 820A is a utterance voice addressed to the user 3 (hereinafter, user 3A) whose user name is "AAAAAA". That is, in the example of FIG. 20, the player 4 selects the user 3A (first user) in step S64 and creates the operation instruction data addressed to the user 3A. It is assumed that the user terminal 100 used by the user 3A is the user terminal 100A.

Since the utterance voice 820A is a utterance voice addressed to the user 3A, the utterance voice is based on the content of the support provided by the user 3A to the avatar object 610 (in other words, the player 4). Specifically, the user 3A inserts a magazine in the boss battle on the stage of 10F, and the avatar object 610 wins the boss with the ammunition of the inserted magazine. For this reason, the utterance voice 820A says, "Thank you for giving me the magazine in the boss battle! The timing was perfect! Thanks to Mr. AAAAA, I was able to clear it!" As described above, it is preferable that the uttered voice includes the content of the support provided by the user 3 in the game and the gratitude to the user 3.

In a certain aspect, the player 4 creates an utterance content addressed to the user 3 before starting the voice input, that is, before inputting the third operation to the distribution terminal 400. In another aspect, the utterance content addressed to the user 3 may be automatically generated by the processor 40. Further, the processor 40 may superimpose and display the tag associated with the user 3 selected by the second operation on the motion moving image 810A.

The processor 40 converts the received voice into voice data. In step S68, the processor 40 generates the operation instruction data including the voice data and the motion data of the selected motion as the operation instruction data generation unit 416.

In step S69, the processor 40 distributes the generated operation instruction data to the user terminal 100 (first computer) of the selected user 3 (user 3A in the example of FIG. 20) as the communication control unit 411. FIG. 21 is a diagram showing still another specific example of the screen displayed on the distribution terminal 400. After the execution of step S68, the processor 40 causes the display unit 452 to display the distribution screen as the display control unit 412. As an example, the distribution screen may be the distribution screen 751 shown in FIG. 21 (A). The distribution screen 751 includes a UI image 752 and a motion image 753A. Further, as shown in FIG. 21A, the distribution screen 751 may include information indicating a user to whom the operation instruction data is distributed.

The UI image 752 accepts an operation for delivering the operation instruction data to the selected user 3. The operation may be, for example, a tap operation on the UI image 752. The motion image 753A is a UI image that accepts an operation for playing a moving image based on the generated motion instruction data, that is, a moving image based on the motion instruction data generated for the user 3A. The operation may be, for example, a tap operation on the motion image 753A. The UI image that accepts the operation for playing the generated moving image is not limited to the motion image 753A. For example, it may be a UI image including the text "video playback". The processor 40 may automatically redisplay the distribution screen 751 when the moving image is finished.

It is preferable that the distribution screen 751 further includes a UI image that accepts an operation for returning to the acceptance of the voice input. The operation may be, for example, a tap operation on the UI image. By including the UI image in the distribution screen 751, the player 4 can perform voice input again when the voice input fails, for example, when the content to be spoken is mistaken. The UI image may be a UI image that accepts an operation for returning to the selection of motion data.

Upon receiving the tap operation for the UI image 752, the processor 40 transmits the operation instruction data to the server 200 together with the information indicating the user 3A. The server 200 identifies the user terminal 100 to which the operation instruction data is transmitted based on the information indicating the user 3A, and transmits the operation instruction data to the specified user terminal 100 (that is, the user terminal 100A).

When the transmission of the operation instruction data is completed, the processor 40 may display the distribution completion screen 761 shown in FIG. 21B on the display unit 452 as an example. The delivery completion screen 761 includes UI images 762 and 763 as an example. Further, the distribution completion screen 761 may include a text indicating that the transmission of the operation instruction data has been completed, as shown in FIG. 21 (B).

The UI image 762 accepts an operation for starting the creation of operation instruction data addressed to another user 3. The operation may be, for example, an operation of tapping the UI image 762. When the processor 40 receives the tap operation, the processor 40 causes the display unit 452 to display the user list screen again. That is, when the tap operation is accepted, the distribution process returns to step S63. At this time, the processor 40 may generate a user list screen based on the user list 421 stored in the distribution terminal 400 and display it on the display unit 452. The UI image 763 accepts an operation for terminating the application. The operation may be, for example, an operation of tapping the UI image 763. When the operation is accepted, the distribution process ends.

In the example described with reference to FIGS. 20 and 21, as shown in FIG. 21 (C), the distribution terminal 400 transmits the operation instruction data of the moving image addressed to the user 3A (the user 3 whose user name is "AAAAAA"). , Transmit only to the user terminal 100A.

FIG. 22 is a diagram showing another specific example of voice input by the player 4. As shown in FIG. 22, the player 4 is inputting the utterance voice 820B while playing the motion moving image 810B. The utterance voice 820B is a utterance voice addressed to the user 3 (hereinafter, user 3B) whose user name is "BBBBBB". That is, in the example of FIG. 22, in step S64, the player 4 inputs a tap operation to the record image 732B corresponding to the user 3B, and creates the operation instruction data addressed to the user 3B. It is assumed that the user terminal 100 used by the user 3B is the user terminal 100B.

Since the utterance voice 820B is a utterance voice addressed to the user 3B, the utterance voice is based on the content of the support provided by the user 3B to the avatar object 610 (in other words, the player 4). Specifically, in the battle with the Zako enemy on the 3rd floor, the user "BBBBBB" throws in the first aid kit, and as a result, the physical strength of the avatar object 610 becomes 0 (the game is over). I am recovering my physical strength. For this reason, the utterance voice 820B has the content of "Thanks to the first aid kit given by Mr. BBBBB, the game did not end on the 3rd floor. Thank you very much!"

FIG. 23 is a diagram showing still another specific example of the screen displayed on the distribution terminal 400. The distribution screen 751 shown in FIG. 23A includes a UI image 752 and a motion image 753B. When the motion image 753B receives the tap operation, the motion image 753B reproduces a moving image based on the operation instruction data generated for the user 3B.

Upon receiving the tap operation for the UI image 752, the processor 40 transmits the operation instruction data to the server 200 together with the information indicating the user 3B. The server 200 identifies the user terminal 100 to which the operation instruction data is transmitted based on the information indicating the user 3B, and transmits the operation instruction data to the specified user terminal 100 (that is, the user terminal 100B).

In the example described with reference to FIGS. 22 and 23, as shown in FIG. 23 (C), the distribution terminal 400 transmits the operation instruction data of the moving image addressed to the user 3B (the user 3 whose user name is "BBBBBB"). , Transmit only to the user terminal 100B.

As described above, the content of the voice based on the voice data included in the operation instruction data is based on the content of the support provided to the player 4 by the user 3 in participating in the latest game. Since the content of the support is different for each user 3, the content of the voice is different for each user 3. That is, after the end of the game, operation instruction data including voices having different contents is transmitted to at least a part of the user terminals 100 of the users 3 who participated in the game.

Further, the motion of the avatar object 610 in the example of FIG. 22 is different from the motion of the example of FIG. 20. That is, the player 4 selects motion data different from that at the time of generating the operation instruction data addressed to the user 3A in the operation instruction data generation addressed to the user 3B. Specifically, in step S66, the player 4 inputs a tap operation to the UI image 745B that selects the motion data corresponding to the record image 742B. In this way, the player 4 can make the motion data included in the operation instruction data different for each user 3.

Then, the operation instruction data for each user 3, including the voice data having different contents for each user 3 and the motion data selected for each user 3, is transmitted only to the user terminal 100 of each user 3. In other words, unique operation instruction data for each user terminal 100 is transmitted to each of the user terminals 100 of the selected user 3.

FIG. 24 is a diagram showing an outline of transmission of game progress information from the game play terminal 300 to the user terminal 100. While the operation instruction data for video reproduction on the user terminal 100 is unique for each user terminal 100, as shown in FIG. 24, the user terminals 100 of all the users 3 participating in the game during the game execution. The game progress information transmitted to is common among each user terminal 100. That is, the operation instruction data included in the game progress information is also common among the user terminals 100. As described above, it can be said that the operation instruction data for playing the moving image and the operation instruction data for advancing the game are different data from the viewpoints of the same difference between the user terminals 100 and the transmission destination.

(Video playback processing on user terminal 100)
FIG. 25 is a flowchart showing an example of the flow of the moving image reproduction process executed by the user terminal 100.

In step S71, the processor 10 receives the operation instruction data as the moving image reproduction unit 117. In step S72, the processor 10 notifies the user 3 of the reception of the operation instruction data as the moving image reproduction unit 117. As an example, the processor 10 displays a notification image on the display unit 152, reproduces a notification voice from a speaker (not shown), lights a lighting unit (not shown) composed of an LED (light-emitting diode), or the like. The user 3 is notified of the reception of the operation instruction data by at least one of the blinking.

In step S73, the processor 10 receives the first reproduction operation for reproducing the moving image as the operation reception unit 111. As an example, the first reproduction operation may be an operation of tapping the notification image. In step S74, the processor 10 renders the operation instruction data as the moving image reproduction unit 117 and reproduces the moving image. As an example, the processor 10 may start an application for playing this game and play a video, or may start an application for playing a video different from the application and play a video. good. Hereinafter, the video will be referred to as a "thank you video".

FIG. 26 is a diagram showing a specific example of playing a thank-you video. Specifically, it is a figure which shows an example of the reproduction of the thank-you moving image in the user terminal 100 of the user 3A. In the thank-you video 910A played on the user terminal 100, the avatar object 610 is uttering the voice 920A while executing a certain motion. In other words, the processor 10 outputs the audio 920A from the speaker (not shown) while playing the thank-you video 910A including the avatar object 610 that executes a certain motion.

The motion in the thank-you video 910A is based on the motion data selected by the player 4 in the generation of the motion instruction data addressed to the user 3A, and the voice 920A is the utterance voice input by the player 4 in the generation of the motion instruction data. It is based on the voice data generated from the 820A. That is, the voice 920A is a voice including the content of the support provided by the user 3A in the game and the gratitude for the support. In this way, the user 3A can watch the thank-you video in which the avatar object 610 utters the content of the support provided in the game and the gratitude for the support by inputting the first playback operation.

As an example, the user terminal 100 may display at least one UI image on the touch screen 15 after the reproduction of the thank-you video 910A is completed. The UI image may be, for example, a UI image that accepts an operation for playing the thank-you video 910A again, a UI image that accepts an operation for transitioning to another screen, or an application. It may be a UI image that accepts an operation for terminating.

Further, as an example, the user terminal 100 may display at least one UI image on the touch screen 15 during playback of the thank-you video 910A. The UI image may be, for example, a plurality of UI images that accept operations such as temporarily stopping, ending, or changing the playback scene of the thank-you video 910A being played.

Note that these UI images displayed during the playback of the thank-you video 910A and after the playback of the thank-you video 910A is hunted do not include a UI image for making a response to the avatar object 610. That is, the thank-you video 910A according to the present embodiment does not provide a means for responding to the avatar object 610.

FIG. 27 is a diagram showing another specific example of playback of the thank-you video. Specifically, it is a figure which shows the example of the reproduction of the thank-you moving image in the user terminal 100 of the user 3B. In the thank-you video 910B played on the user terminal 100, the avatar object 610 is uttering the voice 920B while executing a certain motion. In other words, the processor 10 outputs the audio 920B from the speaker (not shown) while playing the thank-you video 910B including the avatar object 610 that executes a certain motion.

The motion in the thank-you video 910B is based on the motion data selected by the player 4 in the generation of the motion instruction data addressed to the user 3B, and the voice 920B is the utterance voice input by the player 4 in the generation of the motion instruction data. It is based on the voice data generated from the 820B. Therefore, in the example of FIG. 27, the motion performed by the avatar object 610 is different from the motion of the example of FIG. 26. Further, the voice 920B is a voice including the content of the support provided by the user 3B in the game and the gratitude for the support. Therefore, in the example of FIG. 27, the content of the voice 920B is different from the content of the voice 920A in the example of FIG. 26.

As described above, the thank-you video received by at least a part of the user terminals 100 of the users 3 who participated in the game after the end of the game is a video in which the utterance content of the avatar object 610 is different for each user 3.

The processor 10 may superimpose the UI image 930 including the content for encouraging participation in the next game on the moving image 910 and display it. The UI image 930 may be distributed together with the operation instruction data, or may be stored in the user terminal 100 as the game information 132.

<Summary>
As described above, the user terminal 100 according to the present embodiment executes a game in which a plurality of users 3 participate based on the game program 131. The user terminal 100 operates the avatar object 610 based on the game program 131 and the operation instruction data received from the distribution terminal 400. The action instruction data is data for causing the avatar object 610 to speak at least voice. Further, the operation instruction data is transmitted from the distribution terminal 400 to one or more arbitrary user terminals 100 among the plurality of user terminals 100. Further, the operation instruction data is data in which the content of the utterance is different for each user terminal 100 of the transmission destination.

Further, the user terminal 100 operates the avatar object 610 based on the game program 131 and the game progress information received from the game play terminal 300 during the execution of the game. The game progress information is data for at least moving the body of the avatar object 610. Further, the game progress information is data commonly used among a plurality of user terminals 100. Further, when the user terminal 100 does not operate the avatar object 610 based on the game progress information, the user terminal 100 operates the avatar object 610 based on the operation instruction data.

Further, when the game progress information is acquired, the user terminal 100 causes the avatar object 610 to move at least the body based on the game progress information regardless of whether or not there is an operation from the user 3. Further, when the operation instruction data is received from the distribution terminal 400, the user terminal 100 performs an operation on the operation instruction data from the user 3, and the user terminal 100 at least voices the avatar object 610 based on the operation instruction data. To speak.

Further, the game progress information is data for causing the avatar object 610 to further utter a voice. That is, the game progress information is transmitted from the game play terminal 300 to the plurality of user terminals 100 during the execution of the game, and the contents of body movements and voice utterances are transmitted regardless of the destination user terminals 100. This is common data.

Further, the game play terminal 300 and the distribution terminal 400 are devices used by the player 4 who plays the avatar object 610. Based on the game program 131, the user terminal 100 causes the display unit 152 of the user terminal 100 to display UI images 705 and 706 for transmitting a message to the avatar object 610 during execution of the game, and the UI image by the user 3. A message is transmitted to the game play terminal 300 based on the operation input for 706.

On the other hand, there is no means for responding to the avatar object 610 in response to the voice utterance by the avatar object 610 based on the action instruction data, which is performed during the non-execution of the game. As an example, the user terminal 100 displays a UI image at an arbitrary timing after the start of speech by the avatar object 610 based on the operation instruction data based on the game program 131, and the UI image displays the avatar. The UI image for making a reply to the object 610 is not included. The UI image may include a UI image 930 that encourages participation in a game that will be played from the next time onward.

Further, the game executed by the user terminal 100 based on the game program 131 (that is, executed by the system 1) is automatically won or lost when the conditions defined in the game program 131 are satisfied in the game. Or it is a game in which the ranking is determined.

Further, the content of the utterance in the action instruction data generated for each user 3 is the user name of the user 3 who uses the destination user terminal 100, the content of the user 3 supporting the avatar object 610 in the game, and the support. Includes content that expresses gratitude for.

Further, the motion instruction data is data for causing the avatar object 610 to utter a voice and move the body.

Further, as described above, the distribution terminal 400 according to the present embodiment is used by the player 4 of the avatar object 610 appearing in the game in which a plurality of users 3 participate. Based on the distribution program 423, the distribution terminal 400 displays the user list screen 731 on the display unit 452 as a list of users who participated in the game, selects one or more users from the list, and the utterance voice spoken by the player 4. Based on the 820A and 820B, data for causing the avatar object 610 to utter the voices 920A and 920B, and the operation instruction data whose utterance content is different for each selected user 3 is generated and selected. The operation instruction data generated for each user is transmitted to the user terminal 100 used by the corresponding user 3, respectively.

Further, the distribution terminal 400 further acquires tag information 734 indicating the content in which each user is involved in the game based on the distribution program 423, and further displays the tag information 734 on the display unit 452. As an example, the distribution terminal 400 displays the tag information on the display unit 452 by displaying the user list screen 731. In other words, on the user list screen 731, tag information 734 is associated with each user.

Further, when the distribution terminal 400 generates the operation instruction data, the distribution terminal 400 generates the operation instruction data based on the input from the player 4.

Further, the distribution terminal 400 displays a motion list screen 741 for determining the body movement of the avatar object 610 on the display unit 452, and the motion list screen for each selected user based on the input from the player 4. Select 1 motion data from 741. When the distribution terminal 400 generates the operation instruction data, the distribution terminal 400 generates the operation instruction data based on the motion data determined for each selected user 3.

The motion of the avatar object 610 in the action instruction data generated for each selected user 3 is a motion determined for the corresponding user 3, respectively.

The body movement of the avatar object 610 during the game is controlled in real time based on the motion data generated in real time according to the movement of the player 4. On the other hand, the operation determined by the distribution terminal 400 is not an operation based on motion data generated in real time according to the operation of the player 4, but an operation based on motion data created in advance.

Further, the distribution terminal 400 receives the voice uttered by the player 4 for each selected user 3 while reproducing the operation determined for the user on the display unit 452. Generate action instruction data.

<Effect>
In the technology of Non-Patent Document 1, the character thanked the viewer who gave the present (so-called "throwing money"). However, in the technique of Non-Patent Document 1, the performer who plays the character is intended for a large number of viewers, and who is the viewer who gave the present is not known until the moment when the present is given. Also, there is no information about the viewer who gave the present. Therefore, the content of the utterance by the performer (that is, the utterance of the character) for the present is similar to any viewer (for example, thank you for the present). In addition, since we will thank you during the distribution, the number of people who can thank you is limited.

On the other hand, the voice utterance of the avatar object 610 based on the action instruction data, that is, the utterance content of the avatar object 610 in the thank-you video 910 is different for each user 3, so that the user 3 is compared with the technique of Non-Patent Document 1. The joy of is greater. Therefore, the user 3 wants to participate in the game again next time and watch the thank-you video 910. As a result, it is possible to encourage the user 3 to continuously participate in the game.

Further, since the utterance content of the avatar object 610 in the thank-you video 910 includes the user name of the user 3, the content of the user 3 supporting the avatar object 610 in the game, and the gratitude for this support, the user 3 is asked. I feel that the utterance is addressed only to me, and I feel great joy. Further, the support for the avatar object 610 is an act that the user 3 wants to receive gratitude from the avatar object 610, and the content of such an act is reflected in the utterance content in the thank-you video 910 to the user 3. You can feel great joy. As a result, it is possible to encourage the user 3 to continuously participate in the game.

Further, since the processor 10 displays the UI image 930 including the content prompting the user to participate in the next game when playing the thank-you video 910, the user 3 can be more strongly encouraged to participate in the next game.

In addition, since the thank-you video 910 does not have a means for responding to the avatar object 610, the user 3 can play the game again next time in order to watch the utterance of the avatar object 610 addressed only to himself / herself. Try to participate. As a result, the user 3 can be more strongly encouraged to participate in the continuous game.

Further, the thank-you video 910 is based on the action instruction data created after the end of the game, for example, when the avatar object 610 is not operated based on the action instruction data included in the game progress information. In other words, the viewing of the thank-you video 910 is not the viewing of the live distribution, but the viewing of the pre-recorded one. By generating the thank-you video 910 by pre-recording, the number of people who can express gratitude can be increased as compared with the technique of Non-Patent Document 1.

Further, the processor 40 causes the player 4 to select the motion (movement) of the avatar object 610 in the thank-you video 910 from a plurality of motions created in advance. In other words, the motion in the thank you video 910 does not require motion capture like the motion of the avatar object 610 in the game. As a result, the player 4 can easily generate the operation instruction data of the thank-you moving image 910 in a short time.

Further, if the distribution terminal 400 is a mobile terminal of the player 4, operation instruction data can be generated regardless of the location. For example, operation instruction data can be generated even on the go. As a result, the operation instruction data can be distributed to more users 3.

The player 4 may create operation instruction data for all users 3 included in the user list 234, or may create operation instruction data for only some users 3. When creating operation instruction data for only some users 3, the player 4 may select the user 3 who has contributed to the progress of the game. As a result, a special feeling is created in the thank-you video 910, and each user 3 actively participates in the game in an attempt to have the operation instruction data transmitted to himself / herself. As a result, it is possible to encourage the user 3 to continuously participate in the game. In addition, it is possible to encourage each user 3 to improve the degree of contribution to the player 4 (avatar object 610) during the game.

<Modification example>
FIG. 28 is a flowchart showing another example of the flow of the moving image reproduction process executed by the user terminal 100. Note that, in FIG. 28, the processes executed in steps S71 to S74 are the same processes as in steps S71 to S74 of FIG. 25, and therefore the description will not be repeated here.

In step S75, the processor 10 stores the received operation instruction data in the user terminal 100. In step S76, the processor 10 receives the second reproduction operation for reproducing the thank-you moving image as the operation reception unit 111. In step S77, the processor 10 reproduces the thank-you moving image as the moving image reproduction unit 117 based on the stored operation instruction data.

In this way, the user terminal 100 stores the operation instruction data received from the distribution terminal 400 in the memory 11 of the user terminal 100. Then, when the operation instruction data is stored in the memory 11, the user terminal 100 causes the avatar object 610 to re-speak at least the voice based on the operation instruction data when the user 3 performs an operation on the operation instruction data. Be done. As a result, the user 3 can watch the thank-you video delivered in the past at any time. The timing of the above operation by the user 3 may be any timing. Further, the timing of the recurrence of the voice based on the operation instruction data after the operation (that is, the reproduction of the thank-you moving image) may be any timing as long as it is after the operation.

When the processor 10 plays the thank-you video based on the stored operation instruction data, the processor 10 may play the thank-you video after changing the appearance of the avatar object 610 in the thank-you video based on a predetermined operation of the user 3. .. The processor 10 may consume the virtual currency or points associated with the user 3 when changing the appearance of the avatar object 610. The points may be given to the user 3 by participating in the game, or may be given to the user 3 by supporting the avatar object 610 in the game. In addition, the points awarded may differ depending on the degree of support. For example, more points may be awarded by introducing an item that consumes a larger amount of virtual currency.

Further, the processor 10 may change the appearance of the avatar object 610 when receiving the processing related to billing.

The processor 10 may consume the virtual currency or points associated with the user 3 when storing the operation instruction data. Alternatively, the processor 10 may store the operation instruction data when the process related to the charge is accepted. Alternatively, the processor 10 may execute the reproduction of the thank-you video based on the stored operation instruction data when the virtual currency or points are consumed or when the processing related to the billing is accepted.

The processor 10 may accept an operation for responding to the avatar object 610 by the user 3 who has watched the thank-you video when the virtual currency or points are consumed or the processing related to the billing is accepted. In other words, when the virtual currency or points are consumed, or when the processing related to billing is accepted, the user 3 after viewing the thank-you video may be able to communicate with the avatar object 610 (player 4).

The distribution terminal 400 may be configured to distribute only voice data to the user terminal 100. Further, although the ease of generating the motion instruction data is reduced, the motion data may be generated by motion capture.

After the motion data is selected, the processor 40 displays a guide regarding acceptance of the audio input on the display unit 452 before accepting the audio input, that is, before playing the motion moving image corresponding to the selected motion data. May be good. For example, the processor 40 displays the text "When you tap the start button, the selected motion is displayed after the countdown. Please input the voice according to the motion" and the UI image as the start button. It may be displayed on the display unit 452. When the tap operation to the start button is accepted, the processor 40 may play the motion moving image after displaying the countdown for a predetermined time and start accepting the voice input. With such a configuration, it is possible to give a margin to the player 4 before performing the voice input, and it is possible to improve the possibility that the voice input is successful.

The screen displayed on the display unit 452 of the distribution terminal 400 during the distribution process in the distribution terminal 400 is not limited to the above example. 29 and 30 are views showing still another specific example of the screen displayed on the distribution terminal 400.

When the processor 40 receives a user selection operation for an application icon for generating and distributing operation instruction data, the processor 40 displays a login screen (not shown) on the display unit 452. As an example, the selection operation may be a tap operation for the above icon. The processor 40 accepts input of necessary information on the login screen. The information may be, for example, a user ID and a password. The processor 40 transmits the information to the server 200, and causes the server 200 to perform an authentication process. Upon receiving the notification from the server 200 that the authentication was successful, the processor 40 causes the display unit 452 to display the home screen 2010 shown in FIG. 29 (A). Various information for displaying the home screen 2010 may be stored in advance in the distribution terminal 400, or may be acquired from the server 200 together with the above notification.

The home screen 2010 includes, as an example, an avatar object 610 and a UI image 2011. The UI image 2011 accepts an operation for displaying a list of users 3 who have participated in the game. The operation may be, for example, a tap operation on the UI image 2011. In this modification, the list is displayed as a ranking screen in which each user 3 who participated in the game is ranked according to the billing amount. The ranking screen may include only users 3 having a predetermined rank or higher (for example, 50th rank or higher) among the users 3. As an example, the ranking screen may be the ranking screen 2020 shown in FIG. 29 (B). The processor 40 generates the ranking screen 2020 based on the user list 234 acquired from the server 200. Alternatively, the server 200 may generate a ranking screen 2020 based on the user list 234 and transmit the ranking screen 2020 to the processor 40. The "message waiting ○ person" included in the UI image 2011 indicates the number of users 3 included in the ranking screen 2020 for which the operation instruction data has not been transmitted to the user terminal 100. In the example of FIG. 29 (A), the operation instruction data is not transmitted to two of the users 3 included in the ranking screen 2020.

The ranking screen 2020 includes a title image 2021, user information 2023A, and user information 2023B. The title image 2021 includes the text "ranking" and notifies the player 4 that the screen is a ranking screen. The title image 2021 includes a UI image 2022. The UI image 2022 accepts an operation for redisplaying the previous screen (returning to the previous screen). The operation may be, for example, a tap operation on the UI image 2022. Upon receiving the tap operation on the UI image 2022, the processor 40 causes the display unit 452 to display the home screen 2010 again.

User information 2023A, 2023B, 2023C are images showing information of the user 3 who participated in the game. The user information 2023A and 2023B include icons 2024A and 2024B, user names 2025A and 2025B, ranks 2026A and 2026B, billing amounts 2027A and 2027B, and transmission times 2028A and 2028B, respectively. If it is not necessary to distinguish between them, the alphabet at the end of the code is omitted. In addition, the user information 2023A further includes a transmitted notification 2029 and a previous transmission date 2030. Further, the user information 2023C includes at least the icon 2024, the user name 2025, the rank 2026, the billing amount 2027, and the number of transmissions 2028, but since most of the user information 2023C is outside the display area of the display unit 452. In the example of FIG. 29B, it is not displayed on the display unit 452. As an example, when the processor 40 receives an operation (flick operation, drag operation, etc.) for moving an indicator such as a finger that has come into contact with the touch screen 45, the processor 40 displays it in the display area of the display unit 452. The area may be changed. In other words, the processor 40 may scroll the ranking screen 2020. Hereinafter, the operation for scrolling will be referred to as "scrolling operation".

In this modification, it is assumed that the user information 2023A is the user information of the user 3A and the user information 2023B is the user information of the user 3B.

The icon 2024 is, for example, an image preset by each user 3. The user name 2025 is information indicating each user 3 who participated in the game, which is stored in the "user" column in the user list 234. The rank 2026 indicates the rank of each user 3. The billing amount 2027 indicates the amount charged by each user 3 for the game executed in the system 1. In this modification, the higher the amount indicated by the billing amount 2027, the higher the ranking indicated by the rank 2026. Further, in this modification, the higher the rank indicated by the rank 2026, the higher the user information 2023 is arranged on the ranking screen 2020. In other words, the ranking screen 2020 is a screen in which the user information 2023 is arranged in the order of the ranking indicated by the ranking 2026.

The number of transmissions 2028 indicates the number of times that the operation instruction data has been transmitted to the user 3 in the past. For example, the number of transmissions 2028A indicates that the player 4 has transmitted the operation instruction data for playing the thank-you video twice in the past to the user terminal 100A of the user 3A because the number of transmissions is "2". .. On the other hand, since the number of transmissions 2028B is "0", it indicates that the player 4 has never transmitted the operation instruction data to the user terminal 100B of the user 3B in the past.

The transmitted notification 2029 is displayed when the video instruction data has already been transmitted to the user terminal 100 of the user 3 after the current game play. In the example of FIG. 29 (B), since the transmitted notification 2029 is included in the user information 2023A, it is determined that the player 4 has transmitted the operation instruction data to the user terminal 100A of the user 3A after the current game play. Shown. On the other hand, since the operation instruction data has never been transmitted to the user terminal 100B of the user 3B, the transmitted notification 2029 is not included in the user information 2023B.

The previous transmission date 2030 indicates the latest transmission date for the transmission of the operation instruction data. Since the operation instruction data has never been transmitted to the user terminal 100B of the user 3B, the user information 2023B does not include the previous transmission date 2030.

The user information 2023 also functions as a UI image that accepts the operation of the player 4. The operation may be, for example, a tap operation for the user information 2023. As an example, when the processor 40 receives a tap operation for the user information 2023, the display unit 452 displays a detailed screen showing the details of the user information 2023 that has received the tap operation. As an example, the detail screen may be the detail screen 2040 shown in FIG. 29 (C).

The detail screen 2040 includes the above-mentioned title image 2021 and user information 2041 as an example. When the tap operation to the UI image 2022 on the detail screen 2040 is accepted, the processor 40 may display the home screen 2010 again on the display unit 452, or may display the ranking screen 2020 again on the display unit 452. ..

The user information 2041 shown in FIG. 29 (C) is an image showing the user information of the user 3A. That is, as a result of accepting the tap operation for the user information 2023A on the ranking screen 2020, the processor 40 displays the user information 2041 shown in FIG. 29 (C) on the display unit 452.

As an example, the user information 2041 includes the above-mentioned icon 2024A, user name 2025A, rank 2026A, billing amount 2027A, number of transmissions 2028A, and previous transmission date 2030. Since these have already been explained, the explanation will not be repeated. Further, the user information 2041 includes, for example, UI images 2031-2034, 2037, 2038, a detailed display area 2035, and a scroll bar 2036.

The UI image 2031 accepts an operation for displaying a history screen (not shown) showing a history of operation instruction data transmitted in the past to the user terminal 100A of the user 3A. The operation may be, for example, a tap operation on the UI image 2031. As an example, the history screen may be a screen in which UI images showing each of the operation instruction data transmitted in the past are arranged in order from the present. When the processor 40 receives a tap operation on the UI image, the processor 40 may play a moving image (thank you moving image) using the operation instruction data corresponding to the UI image.

The UI images 2032 to 2034 accept operations for displaying various information in the detailed display area 2035. The operation may be, for example, a tap operation for each of the UI images 2032 to 2034. The detailed display area 2035 is an area for displaying detailed information about the user 3A's participation in the game.

In the example of FIG. 29C, the display mode of the UI image 2034 is different from that of the UI image 2032 and the UI image 2033. That is, the example of FIG. 29C shows the detail screen 2040 after accepting the tap operation on the UI image 2034. The UI image 2034 accepts a tap operation for displaying the tag associated with the user 3A in the user list 234 in the detailed display area 2035. Therefore, in the example of FIG. 29C, the tag associated with the user 3A in the user list 234 is displayed in the detailed display area 2035.

The UI image 2032 accepts a tap operation for displaying the comment sent by the user 3A to the avatar object 610 in the latest game in the detailed display area 2035. The UI image 2033 accepts a tap operation for displaying the item given to the avatar object 610 by the user 3A in the latest game in the detailed display area 2035. That is, when the processor 40 receives the tap operation for the UI image 2032, the processor 40 causes the detailed display area 2035 to display a list of comments sent by the user 3A to the avatar object 610 in the latest game. When the processor 40 receives a tap operation on the UI image 2033, the processor 40 causes the detailed display area 2035 to display a list of items that the user 3A has given to the avatar object 610 in the latest game.

When displaying the detail screen 2040 on the display unit 452, the processor 40 may consider that any one of the UI images 2032 to 2034 is selected, and display the corresponding information in the detail display area 2035. That is, the detail screen 2040 may be a screen in which the information corresponding to any of the UI images 2032 to 2034 is displayed by default in the detail display area 2035.

The scroll bar 2036 is a UI image that accepts a scroll operation. When the processor 40 receives the scroll operation, the processor 40 scrolls in the detailed display area 2035 and displays the information that was hidden before the scroll. The scroll operation may be input at a position different from the position where the scroll bar 2036 is displayed.

The UI image 2037 accepts an operation for generating moving image instruction data. The UI image 2038 hides the detail screen 2040 and accepts an operation for redisplaying the home screen 2010 or the ranking screen 2020. These operations may be, for example, tap operations for UI images 2037 and 2038.

Upon receiving the tap operation for the UI image 2037, the processor 40 causes the display unit 452 to display the preparation screen 2050 shown in FIG. 30A as an example. The preparation screen 2050 includes, as an example, an avatar object 610, a UI image 2051, a text 2052, and a selected image 2053. The UI image 2051 accepts an operation for stopping the generation of the moving image instruction data. As an example, the operation may be a tap operation on the UI image 2051. The text 2052 is, for example, a destination of the operation instruction data and a text indicating that the current screen is a screen for generating the operation instruction data.

The selected image 2053 is, for example, an image that causes the player 4 to select the playback time of the moving image based on the operation instruction data. The selected image 2053 includes, for example, options 2054A-2054C which are UI images. Upon accepting the operation of selecting option 2054A, the processor 40 determines the playback time of the moving image to be 10 seconds. Upon accepting the operation of selecting option 2054B, the processor 40 determines the playback time of the moving image to be 20 seconds. Upon accepting the operation of selecting option 2054C, the processor 40 determines the playback time of the moving image to be 30 seconds. The selection operation may be, for example, a tap operation for any of the options 2054A to 2054C. In this modification, it is assumed that the operation of selecting option 2054C is accepted. Moreover, the type and number of options are not limited to the example of FIG. 30 (A).

When the tap operation for any of the options 2054A to 2054C is accepted, the processor 40 causes the display unit 452 to display the preparation screen 2060 shown in FIG. 30B as an example. The preparation screen 2060 includes, as an example, an avatar object 610, a UI image 2051, a text 2052, and a selected image 2061.

The selected image 2061 is, for example, an image that causes the player 4 to select motion data included in the operation instruction data. The selected image 2061 includes, for example, options 2062A to 2062F, which are UI images, and UI image 2063. The options 2062A to 2062F are associated with different motion data, respectively, and when the operation of selecting any of the options 2062A to 2062F (for example, the tap operation to any of the options 2062A to 2062F) is accepted, the processor 40 receives the operation. , Identify the motion data corresponding to the selected choice. Each of the options 2062A-2062F includes, by way of example, a text indicating emotion. The text indicates that the motion in the motion data corresponding to each of the options 2062A to 2062F is a motion corresponding to the emotion indicated by the text. For example, the motion in the motion data corresponding to option 2062A is a motion corresponding to the feeling of "happy". In other words, the motion is a motion in which the avatar object 610 expresses the feeling of being happy.

When the processor 40 accepts the tap operation to any of the options 2062A to 2062F, the display mode of the option to which the tap operation is input may be different from the display mode of the other options. In the example of FIG. 30B, the display mode of option 2062A is different from the display mode of other options. That is, the example of FIG. 30B shows the preparation screen 2060 after the tap operation is input to the option 2062.

The UI image 2063 accepts an operation for determining the motion data to be included in the moving image instruction data as the selected motion data. The operation may be a tap operation on the UI image 2063. Upon receiving the tap operation on the UI image 2063, the processor 40 determines the motion data to be included in the moving image instruction data as the selected motion data. In the example of FIG. 30B, when the tap operation for the UI image 2063 is received, the processor 40 determines the motion data to be included in the moving image instruction data as the motion data corresponding to the option 2062A.

The number and types of motion data, that is, the number and types of choices in the selected image 2061, are not limited to the example of FIG. 30 (B). If the number of choices is large and some of the choices cannot be displayed in the selection image 2061, the selection image 2061 may include a scroll bar. When the processor 40 accepts the scroll operation, it scrolls in the selected image 2061 and displays the options that were hidden before the scroll. The scroll operation may be input at a position different from the position where the scroll bar is displayed.

Upon receiving the tap operation for the UI image 2063, the processor 40 causes the display unit 452 to display the voice input screen 2070 shown in FIG. 30C as an example. The voice input screen 2070 includes, as an example, an avatar object 610, a UI image 2051, a text 2052, a time bar 2071, and UI images 2072, 2073.

The time bar 2071 is a UI image showing the remaining time of the operation instruction data. The time bar 2071 is entirely colored in the first color (white in the example of FIG. 30C), and includes the text "0:00" at the left end and "0:30" at the right end. That is, the longitudinal length of the time bar 2071 indicates the passage of time for 30 seconds.

The UI image 2072 is a UI image that accepts an operation for starting voice input. The operation may be, for example, a tap operation on the UI image 2072. The player 4 starts speaking after inputting a tap operation on the UI image 2072. Upon receiving the tap operation on the UI image 2072, the processor 40 receives the voice spoken by the player 4 and generates voice data from the voice. In addition, the processor 40 changes the mode of the time bar 2071 with the passage of time. As an example, the processor 40 changes the color of the time bar 2071 from the first color to the second color from the left end portion to the right end portion of the time bar 2071 with the passage of time. In the case of this example, the time bar 2071 is entirely colored in the second color 30 seconds after receiving the tap operation on the UI image 2072.

Further, when the tap operation on the UI image 2072 is accepted, the processor 40 may change the UI image 2072 to a UI image (not shown) that accepts an operation for terminating the input of the voice, as an example. The operation may be, for example, a tap operation on the UI image. When the tap operation for the UI image is accepted or the time selected on the preparation screen 2050 elapses, the processor 40 ends the acceptance of the voice and completes the generation of the voice data. Then, the processor 40 generates operation instruction data from the selected motion data and the voice data.

Subsequently, the processor 40 receives a UI image that accepts an operation for terminating the input of the voice, and a UI image and an operation instruction that accept an operation for playing a moving image based on the operation instruction data instead of the UI image 2073. Even if the display unit 452 displays a UI image that accepts an operation for transmitting the data to the selected user 3 (user 3A in this modification) and a UI image that accepts an operation for retaking the audio data. good. These operations may be tap operations for each UI image.

Accepting the operation for transmitting the operation instruction data to the selected user 3 When the tap operation for the UI image is received, the processor 40 transmits the operation instruction data to the server 200 and the operation instruction is sent to the user terminal 100 of the selected user 3. Have the data sent. When the tap operation is accepted, the processor 40 may display a confirmation screen for the user to confirm again whether or not to transmit the operation instruction data. The confirmation screen includes, for example, a UI image that accepts an operation for transmitting operation instruction data and a UI image that accepts an operation for canceling transmission.

When the operation instruction data is transmitted to the server 200, the processor 40 displays, for example, a notification screen notifying the user that the transmission is completed. The notification screen includes, for example, a UI image that accepts an operation for redisplaying the ranking screen 2020. The processor 40 updates the transmission number 2028 and the previous transmission date 2030 in the user information 2023 of the corresponding user 3 in accordance with the transmission of the latest operation instruction data. If the operation instruction data has not been transmitted to the corresponding user 3 in the past, the transmitted notification 2029 is added to the user information 2023.

The UI image 2073 is a UI image that accepts an operation for displaying the tag on the voice input screen 2070. The operation may be, for example, a tap operation on the UI image 2073. Upon receiving the tap operation on the UI image 2073, the processor 40 superimposes the tag image 2074 on the voice input screen 2070 and displays it as shown in FIG. 30 (D).

The tag image 2074 includes a tag associated with the corresponding user 3 (user 3A in this modification) in the user list 234. By displaying the tag image 2074, the player 4 can input the voice while confirming the tag, that is, the content of the support provided by the user 3A in the game. As a result, the player 4 can generate appropriate voice data according to the content of the support provided by the user 3A.

The tag image 2074 may include information other than the tag, for example, the user's billing amount, the previous transmission date of the operation instruction data, a list of posted comments, a column of the input item, and the like. Alternatively, when the operation on the UI image (not shown) included in the tag image 2074 is accepted, the processor 40 may display the above information other than the tag on the display unit 452 (for example, in the tag image 2074). ..

Upon receiving the tap operation on the UI image 2073, the processor 40 may change the UI image 2073 to the UI image 2075 as shown in FIG. 30 (D). The UI image 2075 is a UI image that accepts an operation for hiding the tag image 2074. The operation may be, for example, a tap operation on the UI image 2075. Upon accepting the tap operation on the UI image 2075, the processor 40 hides the tag image 2074. That is, the voice input screen 2070 returns to the voice input screen 2070 shown in FIG. 30 (C).

The home screen 2010 may include a plurality of UI images that accept operations for displaying different ranking screens. The different ranking screens are, for example, a weekly ranking ranking screen that is a ranking according to the billing amount for the last week, a monthly ranking ranking screen that is a ranking according to the billing amount for the last month, and a ranking screen from the start of the service to the present. The ranking screen of the cumulative ranking, which is the ranking according to the cumulative billing amount, is mentioned, but is not limited to this.

Further, the ranking is not limited to the one in which the ranking is determined only by the size of the billing amount. For example, the ranking may be determined based on the size of the billing amount and the value of points earned in the game. In this example, the ranking may be in descending order of the total value of the total value of the charge amount value and the point value, or each of the charge amount value and the point value is weighted and then totaled. You may.

Further, the motion data may not include a change in facial expression. In the case of this example, the facial expression of the avatar object 610 in the moving image may be changed by using the facial expression data generated by capturing the change in the facial expression of the player 4. In other words, the processor 40 captures changes in the facial expressions of the player 4 and generates facial expression data. Then, the operation instruction data including the voice data, the motion data, and the facial expression data is generated and transmitted to the user terminal 100. The processor 40 may capture the facial expression of the player 4 inputting the voice and generate the facial expression data, or capture the facial expression of the player 4 at a timing different from the input of the voice and generate the facial expression data. You may.

Further, the game executed in the system 1 is not limited to a game in which the player 4 plays the game and each user 3 supports the player 4 (avatar object 610). For example, the game may be a game in which the player 4 participates as a game master or a moderator, and each user 3 participates as a player, or a plurality of users 3 to one or several users 3 may participate. The game may be in the form of playing against the player 4. As described above, the form of participation of the user 3 in the game executed in the system 1 differs depending on the form of the game. Therefore, the utterance content of the avatar object 610 in the thank-you video is not limited to the content in which the user 3 supports the avatar object 610 in the game and the content of gratitude for this support. As an example, the utterance content may include content in which the user 3 is involved in the game and gratitude to the user 3. This gratitude may be, for example, a gratitude for the user 3 participating in the game. Further, the utterance content may include at least the content in which the user 3 is involved in the game.

There may be a plurality of players 4 playing the game executed in the system 1. In this case, a plurality of avatar objects (characters) associated with each of the players 4 may appear in the game.

Further, the game executed in the system 1 is not limited to the above-mentioned game (live game) in which a plurality of users 3 participate in the game distributed from the terminal of the player 4 in real time. The game executed in the system 1 may be, for example, a multiplayer game in which only a plurality of users 3 participate and the player 4 does not participate.

When the game executed in the system 1 is a multiplayer game, as an example, the game proceeds as follows. Each user terminal 100 transmits information based on an operation input by the user 3, for example, motion data for operating a character operated by each user 3, to another user terminal 100 via the server 200. As a result, in each user terminal 100, the player character performs the same operation at substantially the same timing.

Further, any one of the user terminals 100 plays a role as a host terminal. The user terminal 100 as a host terminal transmits operation instruction data of a character (that is, an NPC) controlled by the game program 131 to another user terminal 100 via the server 200. As a result, in each user terminal 100, the NPC performs the same operation at substantially the same timing. The "motion" here refers to the movement of at least a part of the body by the character (player character and NPC), and does not include the character uttering (speaking) a voice.

Further, each user terminal 100 outputs a voice as an utterance of the character based on the game program 131 and the information for operating the character (player character or NPC). For example, when a certain player character operates according to the motion data, each user terminal 100 outputs a voice using the voice data specified in the description of the game program 131. Each user terminal 100 uses the voice data stored in its own terminal as game information 132 when outputting the voice. That is, each user terminal 100 does not communicate with other user terminals 100 or the server 200 when outputting the voice as the utterance of the character.

The thank-you video delivered to at least a part of the user 3 after playing the multiplayer game is the same as the example of the live game. That is, the user terminal 100 receives the operation instruction data including the voice data and the motion data, renders the operation instruction data, and reproduces the thank-you moving image. The thank-you video may be, for example, one in which the character operated by the user 3 speaks and operates according to the voice data and the motion data. In this example, the source of the operation instruction data, that is, the terminal that generates the operation instruction data may be, for example, a mobile terminal (smartphone, etc.) of the voice actor of the character operated by the user 3, and operates the game. It may be an operator's terminal (PC, etc.). Regardless of the terminal, the voice data in the thank-you video is generated by the voice actor of the character inputting the voice corresponding to the play content of the user 3 into the terminal.

Further, the game executed in the system 1, that is, the game in which a plurality of users participate, is a game (single play game) in which each user 3 plays independently, and the play result of playing the game is the server 200. Also included is a game that is transmitted to and the play results of each user 3 are aggregated on the server 200. Examples of play results include wins and losses in the game, rankings, and records in the competition (time, score, etc.).

Further, in the above-described embodiment, the distribution terminal 400 transmits the motion data and the voice data of the avatar object 610 to the user terminal 100 in order to reproduce the thank-you video on the user terminal 100. Then, the user terminal 100 generated and played a thank-you moving image by rendering the motion data calling voice data. On the other hand, the distribution terminal 400 may generate a thank-you moving image based on the motion data and the voice data, and transmit the moving image to the user terminal 100.

The timing at which the user terminal 100 displays the UI image on the touch screen 15 (display unit 152) after the start of playback of the thank-you video 910 may be any timing after the start of playback of the thank-you video.

Further, the timing of playing the thank-you video 910 is not limited to after the end of the game executed by the system 1, and may be during the game. As described above, the timing may be when the avatar object 610 is not operated based on the operation instruction data included in the game progress information. For example, even during the execution of the game, the thank-you moving image 910 may be playable at the timing when the avatar object 610 is not operated based on the operation instruction data.

Further, in the system 1, the data transmitted from the game play terminal 300 to the user terminal 100 is not limited to the game progress information. For example, the game play terminal 300 may be a terminal that distributes video content to the user terminal 100. That is, the system 1 according to the present disclosure can be expressed as a system that distributes content to the user terminal 100 from an external terminal, and the content is, for example, game progress information generated by playing a game. be.

[Example of realization by software]
The user terminal 100, the server 200, the game play terminal 300 (HMD set 1000), and the control blocks (particularly the control units 110, 210, 310, 410) of the distribution terminal 400 are logics formed in an integrated circuit (IC chip) or the like. It may be realized by a circuit (hardware) or by software.

In the latter case, the user terminal 100, the server 200, the game play terminal 300 (HMD set 1000), and the distribution terminal 400 include a computer that executes instructions of a program that is software that realizes each function. The computer includes, for example, one or more processors and a computer-readable recording medium that stores the program. Then, in the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of the present invention. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, a "non-temporary tangible medium", for example, a ROM (Read Only Memory) or the like, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, a RAM (Random Access Memory) for expanding the above program may be further provided. Further, the program may be supplied to the computer via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. It should be noted that one aspect of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present invention.

[Additional notes]
The contents relating to one aspect of the present invention are listed below.

(Item 1) The program was explained. According to a certain aspect of the present disclosure, the program (game program 131) executes a game in which a plurality of users including the first user (user 3A) participate in the first computer (user terminal 100A) used by the first user. It is a program to make you. The program causes the first computer to execute a step (step S74) of operating a character (avatar object 610) appearing in the game based on the first data received from the outside (distribution terminal 400). The first data is data for causing a character to speak at least voice (voice 920A), and is one or more arbitrary including the first computer among a plurality of computers (user terminals 100A to 100C) used by a plurality of users. The data is transmitted from the outside to the computer of the above, and the content of the utterance differs depending on the destination computer.

(Item 2) In (Item 1), the program causes the first computer to further perform the step (step S42) of operating the character based on the second data during the execution of the game. The second data is data for causing the character to move at least the body, and is data commonly used among a plurality of computers. In the step of operating the character based on the first data, the character is operated when the character is not operated based on the second data.

(Item 3) In (Item 2), in the step of operating the character based on the second data, when the second data is acquired, it is based on the second data regardless of whether or not there is an operation from the first user. Make the character at least move the body. In the step of operating the character based on the first data, when the first data is received from the outside, the character is at least based on the first data because the operation on the first data is performed by the first user. Make the voice speak.

(Item 4) In (Item 2) or (Item 3), the second data is data for causing the character to further speak a voice, and is a plurality of data from the second external device (game play terminal 300) during the execution of the game. This data is transmitted to the computer of the above-mentioned computer, and the contents of body movements and voice utterances are common regardless of the destination computer. The first data is transmitted from a first external device (distribution terminal 400) different from the second external device to one or more arbitrary computers during non-execution of the game.

(Item 5) In (Item 4), the first external device and the second external device are devices used by the performer (player 4) who plays the character. The program includes a step of displaying a message UI (User Interface) (UI image 706) for transmitting a message to the character on the display (display unit 152) of the first computer during execution of the game, and a step by the first user. The first computer is further executed with the step of transmitting a message to the second external device based on the operation input to the message UI. There is no means for responding to the character in response to the voice utterance by the character based on the first data, which is performed during the non-execution of the game.

(Item 6) In any one of (Item 1) to (Item 3), the first data is distributed from the first external device (distribution terminal 400) used by the performer (player 4) who plays the character. There is no means for responding to the character in response to the voice utterance by the character based on the first data.

(Item 7) In (Item 6), the program causes the first computer to further execute the step of displaying the UI at an arbitrary timing after the start of the voice utterance by the character based on the first data. The UI does not include a UI for replying to the character.

(Item 8) In (Item 6) or (Item 7), the program causes the first computer to further perform a step of displaying the UI at an arbitrary timing after the start of voice utterance by the character based on the first data. .. The UI includes a UI (UI image 930) that encourages participation in a game to be performed from the next time onward.

(Item 9) In any one of (Item 1) to (Item 8), the game is a game in which victory or defeat or ranking is automatically determined when the conditions defined in the program are satisfied in the game. Is.

(Item 10) In any one of (Item 1) to (Item 9), the content of the utterance of the first data includes the user name of the user who uses the destination computer.

(Item 11) In any one of (Item 1) to (Item 10), the content of the utterance of the first data includes the content in which the user using the destination computer is involved in the game.

(Item 12) In any one of (Item 1) to (Item 11), the content of the utterance of the first data includes a content indicating gratitude for the user who uses the destination computer for his / her involvement in the game.

(Item 13) In any one of (Item 1) to (Item 12), the program performs a step (step S75) of storing the first data received from the outside in the memory of the first computer in the first computer. Let it run further. In the step of operating the character based on the first data, when the first data is stored in the memory, the character is operated based on the first data at an arbitrary timing when the operation on the first data is performed by the first user. At least the voice can be re-spoken.

(Item 14) In any one of the items (item 1) to (item 13), the first data is data for causing the character to speak a voice and move the body.

(Item 15) The program has been described. According to a certain aspect of the present disclosure, the program (distribution program 423) is a computer (distribution terminal 400) used by a performer (player 4) of a character (avatar object 610) appearing in a game in which a plurality of users (users 3) participate. ) Is a program executed by. The performer has a step of displaying a list of users who participated in the game (user list screen 731) on a computer display (display unit 452) (step S63), a step of selecting one or more users from the list (step S64), and a step of selecting one or more users from the list. First, the data for causing the character to speak at least the voice (voice 920A, 920B) based on the spoken voice (spoken voice 820A, 820B), and the content of the utterance is different for each selected user. A step of generating data (step S68) and a step of transmitting the first data generated for each selected user to the computer (user terminal 100) used by the corresponding user (step S69). Let the computer do it.

(Item 16) In (Item 15), the program has a step (step S62) of acquiring the first information indicating the content in which each user is involved in the game, and a step (step S63) of further displaying the first information on the display. ) And, let the computer do more.

(Item 17) In (Item 16), the step of displaying the list further includes the step of displaying the first information, and the list is associated with the first information for each user.

(Item 18) In (Item 15), the first data is data for causing the character to speak a voice and move the body, and in the step of generating the first data, further based on the input from the performer. Generate the first data.

(Item 19) In (Item 18), the program is based on a step (step S65) of displaying a plurality of options (motion list screen 741) for determining the movement of the character's body on the display, and input from the performer. Then, for each selected user, the computer is further subjected to the step (step S66) of selecting one option from the plurality of options and determining the operation corresponding to the selected option. In the step of generating the first data, the first data is generated based on the operation determined for each selected user. The movement of the character's body in the first data generated for each selected user is a movement determined for the corresponding user, respectively.

(Item 20) In (Item 19), the movement of the character's body during the game is controlled in real time based on the motion data generated in real time according to the movement of the performer. The motion determined in the determination step is not a motion based on motion data generated in real time according to the motion of the performer, but an motion based on motion data created in advance.

(Item 21) In (Item 19) or (Item 20), in the step of generating the first data, the performer utters each selected user while reproducing the operation determined for the user on the display. By accepting the voice, the first data is generated for each selected user.

(Item 22) In any one of (Item 15) to (Item 21), the game is in-game under the conditions defined in the game program (game program 131, 231 and 331) for executing the game. This is a game in which the outcome or ranking is automatically determined when the game is established in.

(Item 23) In any one of (Item 15) to (Item 22), the content of the character's utterance in the first data generated for each selected user includes the user name of the corresponding user. ..

(Item 24) In any one of (Item 15) to (Item 23), the content of the character's utterance in the first data generated for each selected user is involved in the game by the corresponding user. Includes the contents.

(Item 25) In any one of (Item 15) to (Item 24), the content of the character's utterance in the first data generated for each selected user is the involvement of the corresponding user in the game. Includes content that expresses gratitude for.

(Item 26) In any one of (Item 15) to (Item 25), the computer is a mobile terminal used by the performer.

(Item 27) The method for executing the program has been described. According to one aspect of the present disclosure, the method is a first computer (game program 131) in which the first user uses a program (game program 131) for executing a game in which a plurality of users including the first user (user 3A) participate. This is a method executed by the user terminal 100A). The method includes a step (step S74) of operating a character (avatar object 610) appearing in the game based on the first data received from the outside (distribution terminal 400). The first data is data for causing a character to speak at least voice (voice 920A), and is one or more arbitrary including the first computer among a plurality of computers (user terminals 100A to 100C) used by a plurality of users. The data is transmitted from the outside to the computer of the above, and the content of the utterance differs depending on the destination computer.

(Item 28) The information processing device has been described. According to a certain aspect of the present disclosure, the information processing device (user terminal 100A) is an information processing device used by a first user who executes a game in which a plurality of users including the first user (user 3A) participate. The information processing device includes a storage unit (storage unit 120) that stores a program (game program 131) for causing the information processing device to execute a game, and a control unit that controls the operation of the information processing device by executing the program. (Control unit 110). By executing the program, the control unit operates the character (avatar object 610) appearing in the game based on the first data received from the outside (distribution terminal 400), and the first data is at least voiced by the character (the first data). Data for uttering voice 920A), which is transmitted from the outside to one or more arbitrary information processing devices including its own device among a plurality of information processing devices (user terminals 100A to 100C) used by a plurality of users. This is data in which the content of the utterance differs depending on the information processing device of the transmission destination.

(Item 29) The method for executing the program has been described. According to one aspect of the present disclosure, the method is a program (distribution terminal 400) used by a performer (player 4) of a character (avatar object 610) appearing in a game in which a plurality of users (user 3) participate. This is a method of executing the distribution program 423). The method includes a step of displaying a list of users who participated in the game (user list screen 731) on a computer display (display unit 452) (step S63), and a step of selecting one or more users from the list (step S64). , Data for causing the character to utter a voice (voice 920A, 920B) based on the voice uttered by the performer (spoken voice 820A, 820B), and the content of the utterance is different for each selected user. A step of generating the first data (step S68) and a step of transmitting the first data generated for each selected user to the computer (user terminal 100) used by the corresponding user (step S69). ,including.

(Item 30) The information processing device has been described. According to a certain aspect of the present disclosure, the information processing device (distribution terminal 400) is an information processing device used by a performer (player 4) of a character (avatar object 610) appearing in a game in which a plurality of users (users 3) participate. Is. The information processing device includes a storage unit (storage unit 420) that stores a program (delivery program 423) and a control unit (control unit 410) that controls the operation of the information processing device by executing the program. By executing the program, the control unit displays a list of users who participated in the game (user list screen 731) on the display (display unit 452) of the information processing device, selects one or more users from the list, and performs. First, the data for causing the character to utter a voice (voice 920A, 920B) based on the voice (spoken voice 820A, 820B) uttered by the user, and the content of the utterance is different for each selected user. Data is generated, and the first data generated for each selected user is transmitted to the computer (user terminal 100) used by the corresponding user.

(Item 31) The system has been described. According to an aspect of the present disclosure, the system (system 1) causes a first computer (user terminal 100A) used by the first user to execute a game in which a plurality of users including the first user (user 3A) participate. The first program (game program 131) for the purpose and the second program (distribution program 423) executed by the second computer (distribution terminal 400) used by the performer (player 4) of the character (avatar object 610) appearing in the game. ) And is a system including. The second program includes a step (step S63) of displaying a list of users including the first user who participated in the game (user list screen 731) on the display (display unit 452) of the second computer, and a first step from the list. A step of selecting one or more users including a user (step S64), a step of generating first data based on the voices spoken by the performer (spoken voices 820A, 820B) (step S68), and each selected user. The second computer is made to execute the step (step S69) of transmitting the first data generated in the above to the computer (user terminal 100) used by the corresponding user, respectively. The first program causes the first computer to perform a step of operating the character based on the first data received from the second computer, and the first data is for causing the character to speak at least voice (voice 920A, 920B). The data is transmitted from the second computer to one or more arbitrary computers including the first computer among a plurality of computers (user terminal 100) used by a plurality of users, and is transmitted from the second computer to each destination computer. The data is different in the content of the utterance.

(Item 32) The system has been described. According to a certain aspect of the present disclosure, the system (system 1) is a first information processing device (user terminal 100A) used by the first user, which executes a game in which a plurality of users including the first user (user 3A) participate. ) And a second information processing device (distribution terminal 400) used by the performer (player 4) of the character (avatar object 610) appearing in the game. The first information processing device executes a first storage unit (storage unit 120) that stores a first program (game program 131) for causing the first information processing device to execute a game, and the first program. It includes a first control unit (control unit 110) that controls the operation of the first information processing device. The second information processing device controls the operation of the second information processing device by executing the second storage unit (storage unit 420) that stores the second program (delivery program 423) and the second program. It includes a control unit (control unit 410). By executing the second program, the second control unit displays a list of users including the first user who participated in the game (user list screen 731) on the display (display unit 452) of the second information processing device. Then, one or more users including the first user are selected from the list, the first data is generated based on the voices spoken by the performer (spoken voices 820A, 820B), and the first data generated for each selected user is generated. Each of the data is transmitted to the information processing device used by the corresponding user, and the first control unit operates the character based on the first data received from the second information processing device by executing the first program. The first data is data for causing the character to speak at least voice (voice 920A, 920B), and is one or more data processing devices including the first information processing device among a plurality of information processing devices used by a plurality of users. The data is transmitted from the second information processing device to an arbitrary information processing device, and the content of the utterance is different for each information processing device at the transmission destination.

1 system, 2 networks, 3, 3A, 3B users (first user), 4 players (performers), 10, 20, 30, 40 processors, 11,21,31,41 memory, 12,22,32,42 storage , 13, 23, 33, 43 Communication IF, 14, 24, 34, 44 I / O IF, 15, 45 Touch screen, 17 camera, 18 ranging sensor, 51 monitor, 52 gaze sensor, 53 1st camera, 54th 2 cameras, 55 microphones, 56 speakers, 100, 100A, 100B, 100C User terminals (computer, first computer, first information processing device), 110, 210, 310, 410 Control units (first control unit, second control) Unit), 111,311,413 Operation reception unit, 112,312,412 Display control unit, 113,313 UI control unit, 114,314 animation generation unit, 115,315 game progress unit, 116,316 virtual space control unit, 117 Video playback unit, 120, 220, 320, 420 Storage unit (1st storage unit, 2nd storage unit), 131,231,331 Game program (program, 1st program), 132,232,332 Game information 133 , 233,333 User information, 151,451 input unit, 152,452 display unit (display), 200 server, 211 communication mediation unit, 212 log generation unit, 213 list generation unit, 234,421 user list, 300 gameplay terminal (External device, 2nd external device), 317 reaction processing unit, 400 distribution terminal (external, 1st external device, computer, 2nd information processing device), 411 communication control unit, 414 voice reception unit, 415 motion identification unit, 416 Action instruction data generator, 422 motion list, 423 distribution program (program, second program), 540, 1020, 1021 controller, 500 HMD, 510 HMD sensor, 520 motion sensor, 530 display, 600A, 600B virtual space, 610 Avatar object (character), 620A, 620B virtual camera, 631,632,633,634 object, 640A, 640B visibility area, 650,660 visibility image, 671 enemy object, 672 , 673 Obstacle Object, 674 Directing Object, 691,692 Speaking, 701, 702, 703A, 70B, 704A, 704B, 705,706,711,711A, 711B, 711C, 711D, 722,723,745A, 745B , 745C, 752,762,763,930,2011,2022,2031,2032, 2033,2034,2037,2038,2051,2063,2072,2073,2075 UI image (message UI, UI), 721 download screen, 731 User list screen (list), 732,732A, 732B, 732C, 742,742A, 742B, 742C record image, 733,733A, 733B, 733C user name, 734,734A, 734B, 734C tag information, 735,735A, 735B , 735C icon, 741 motion list screen (choices), 743, 743A, 743B, 743C motion name, 744,744A, 744B, 744C, 753 motion image, 751 distribution screen, 761 distribution completion screen, 810A, 810B motion video, 820A , 820B spoken voice, 910A, 910B video, 920A, 920B voice, 1000 HMD set, 1010 object, 1030, 1031 storage medium, 2010 home screen, 2020 ranking screen, 2021 title image, 2026, 2026A, 2026B ranking, 2027, 2027A , 2027B Billing amount, 2028, 2028A, 2028B Number of transmissions, 2029 Sent notification, 2030 Last transmission date, 2035 detail display area, 2036 scroll bar, 2040 detail screen, 2050, 2060 preparation screen, 2052 text, 2053, 2061 Selected image , 2054A, 2054B, 2054C, 2062A, 2062B, 2062C, 2062D, 2062E, 2062F Choices, 2070 Audio Input Screen, 2074 Tag Image

Claims (14)

A program executed by a computer used by a character performer who appears in a game in which multiple users participate.
The step of acquiring the first information indicating the content that each user was involved in in the game, and
A step of causing a user who participates in the game to display a list associated with the first information on the display of the computer.
Steps to select one or more users from the list,
Based on the voice uttered by the performer, a step of generating first data which is data for causing the character to utter at least a voice and the content of the utterance is different for each selected user.
A step of transmitting the first data generated for each selected user to a computer used by the corresponding user, and a step of transmitting the first data to the computer used by the corresponding user.
A program that causes the computer to execute a step of accepting an operation for displaying a history of first data that has already been transmitted on the display. The first data is data for causing the character to speak a voice and move the body.
In the first step of generating data, and based on input from the performers, to generate the first data, a program according to claim 1. The program
A step of displaying a plurality of options for determining the movement of the character's body on the display, and
For each selected user based on the input from the performer, the computer is further subjected to a step of selecting one option from the plurality of options and determining an action corresponding to the selected option. ,
In the step of generating the first data, the first data is generated based on the operation determined for each selected user.
The program according to claim 2 , wherein the movements of the character's body in the first data generated for each selected user are movements determined for the corresponding user, respectively. The movement of the character's body during the game is controlled in real time based on the motion data generated in real time according to the movement of the performer.
The program according to claim 3 , wherein the motion determined in the determination step is not a motion based on motion data generated in real time according to the motion of the performer, but an motion based on motion data created in advance. .. In the step of generating the first data, for each selected user, the operation determined for the user is reproduced on the display, and the voice spoken by the performer is received for each selected user. The program according to claim 3 or 4 , which generates the first data. The game is any of claims 1 to 5 , wherein the game is a game in which victory or defeat or ranking is automatically determined when the conditions defined in the game program for executing the game are satisfied in the game. The program described in item 1. The program according to any one of claims 1 to 6 , wherein the content of the utterance of the character in the first data generated for each selected user includes the user name of the corresponding user, respectively. The content of the utterance of the character in the first data generated for each selected user is in any one of claims 1 to 7, including the content in which the corresponding user is involved in the game. Described program. Any of claims 1 to 8 , wherein the content of the utterance of the character in the first data generated for each selected user includes content indicating appreciation for the user's involvement in the game, respectively. The program described in item 1. The program according to any one of claims 1 to 9 , wherein the computer is a mobile terminal used by the performer. A computer used by a character performer who appears in a game in which multiple users participate is a method of executing a program.
The step of acquiring the first information indicating the content that each user was involved in in the game, and
A step of causing a user who participates in the game to display a list associated with the first information on the display of the computer.
Steps to select one or more users from the list,
A step of generating first data, which is data for causing the character to utter a voice based on the voice uttered by the performer, and the content of the utterance is different for each selected user.
A step of transmitting the first data generated for each selected user to a computer used by the corresponding user, and a step of transmitting the first data to the computer used by the corresponding user.
A method comprising a step of accepting an operation for displaying a history of first data already transmitted on the display. An information processing device used by character performers who appear in games in which multiple users participate.
The information processing device
A memory unit that stores programs and
A control unit that controls the operation of the information processing apparatus by executing the program is provided.
The control unit executes the program to execute the program.
The step of acquiring the first information indicating the content that each user was involved in in the game, and
A list associated with the first information is displayed on the display of the information processing device by the user who participated in the game.
Select one or more users from the list
Based on the voice uttered by the performer, first data is generated, which is data for causing the character to utter a voice and the content of the utterance is different for each selected user.
The first data generated for each selected user is transmitted to the computer used by the corresponding user, respectively.
The first data of history have already been transmitted accepting an operation for displaying on the display, the information processing apparatus. A game in which a plurality of users including the first user participate is executed by a first program for causing the first computer used by the first user to execute a game and a second computer used by a performer of a character appearing in the game. It is a system including a second program to be executed.
The second program is
The step of acquiring the first information indicating the content that each user was involved in in the game, and
A step of displaying a list in which the first information is associated with a user including the first user who participated in the game is displayed on the display of the second computer.
A step of selecting one or more users including the first user from the list, and
The step of generating the first data based on the voice spoken by the performer, and
A step of transmitting the first data generated for each selected user to a computer used by the corresponding user, and a step of transmitting the first data to the computer used by the corresponding user.
A second computer is made to execute a step of accepting an operation for displaying the history of the first data already transmitted on the display.
The first program causes the first computer to execute a step of operating the character based on the first data received from the second computer.
The first data is data for causing the character to utter at least voice, and the second computer is used by one or more arbitrary computers including the first computer among a plurality of computers used by the plurality of users. A system in which the content of the utterance is different for each computer of the transmission destination. A system including a first information processing device used by the first user and a second information processing device used by a character performer appearing in the game, which executes a game in which a plurality of users including the first user participate. And
The first information processing device is
A first storage unit that stores a first program for causing the first information processing device to execute the game, and a first storage unit.
A first control unit that controls the operation of the first information processing apparatus by executing the first program is provided.
The second information processing device is
A second storage unit that stores the second program,
A second control unit that controls the operation of the second information processing apparatus by executing the second program is provided.
The second control unit executes the second program to execute the second program.
The step of acquiring the first information indicating the content that each user was involved in in the game, and
A list in which the first information is associated with the users including the first user who participated in the game is displayed on the display of the second information processing apparatus.
Select one or more users including the first user from the list and select
The first data is generated based on the voice spoken by the performer,
The first data generated for each selected user is transmitted to the information processing device used by the corresponding user, respectively.
Accepting the operation to display the history of the first data already transmitted on the display,
By executing the first program, the first control unit operates the character based on the first data received from the second information processing apparatus.
The first data is data for causing the character to speak at least voice, and is one or more arbitrary information processing including the first information processing device among a plurality of information processing devices used by the plurality of users. A system in which data is transmitted from the second information processing device to the device, and the content of the utterance is different for each information processing device at the transmission destination.

Images