WO2022137376A1

WO2022137376A1 - Method, computer-readable medium, and information processing device

Info

Publication number: WO2022137376A1
Application number: PCT/JP2020/048107
Authority: WO
Inventors: 功淳馬場
Original assignee: 株式会社コロプラ
Priority date: 2020-12-23
Filing date: 2020-12-23
Publication date: 2022-06-30
Also published as: JPWO2022137376A1

Abstract

The present invention enhances the amusement of a game.　Provided is a method executed by a computer serving as a user terminal comprising a processor, a memory, a display unit, and an operation unit. The user terminal can communicate with an external device that is present in a space physically separated from the space in which the user terminal is present, and that controls a character in accordance with input from a performer who is different from the user and who portrays the character during the game. The method comprises: a step in which the game is advanced, by means of the processor, according to user input; a step in which progress information of the ongoing game is sequentially transmitted to the external device; a step in which audio data, which is acquired by the external device that displays a game screen in real time to the performer on the basis of the progress information, is received, the audio data being audio spoken by the performer to the game screen at an arbitrary timing; a step in which, when the audio data is received, content of the audio data is caused to be spoken by the character in the game so as to operate the character; and a step in which, after completion of the game, the character is operated again on the basis of audio data that is received again from the outside in accordance with a request for viewing the advanced game.

Description

Methods, computer-readable media, and information processing equipment

This disclosure relates to methods, computer-readable media, and information processing devices.

Conventionally, a game in which a story progresses so that the ending differs depending on the option selected by the user is widely known. For example, Non-Patent Document 1 discloses a romance simulation game whose main purpose is to virtually deepen friendship with a girl character. The user selects the most suitable action for the character from the presented options, and the story progresses by repeating the reaction of the character to the action.

In the game disclosed in Non-Patent Document 1, a character response pattern is prepared in advance. Then, according to the input operation of the user, the response of the character is determined from the response pattern and output, and the game progresses. Therefore, the variation of the character's movement does not extend beyond the contents of the data prepared in advance. Therefore, there is a problem that the user cannot feel the reality as if the character is in the real world with respect to the relationship with the character, and eventually gets tired of it. Generally, in a game developed with the intention of letting the user play for a long time, it is important how to deal with the problem that the user gets tired of the game. Games are always required to provide compelling content that motivates users to play. For example, if a character appearing in a game has a high sense of reality, the user can easily immerse himself in the world of the game and find interest in the relationship with the character.

One aspect of the present disclosure is intended to enhance the immersive feeling of the game in the world and to improve the interest of the game.

One aspect of the present disclosure is a method performed by a computer as a user terminal including a processor, memory, display unit and operation unit, wherein the user terminal is physically separated from the space in which the user terminal exists. An external device that exists in space and is different from the user of the user terminal and controls the character in response to input from a performer who plays at least one character appearing in the game in a space invisible to the user. It is configured to be able to communicate via the network, and the method is to advance the game according to the user's input operation input to the computer via the operation unit by the processor, and to the external device, the progress of the game. As information to be shown, a step of sequentially transmitting progress information for making it possible to display a game screen of a game in progress, which is a screen displayed on a display unit or a simulated screen obtained by simplifying the screen. And, it is audio data acquired by an external device that displays the game screen of the game in progress in real time so that the performer can see it based on the progress information transmitted sequentially, and is displayed in real time by the performer. The game is in progress with the step of receiving the voice data of the voice that is emitted from the game screen at an arbitrary timing and cannot be heard directly by the user from the external device and the reception of the voice data as a trigger. By causing the character appearing in the computer to speak at least the content of the voice data, the step of operating the character and after the end of the game, the character is received again from the outside in response to the request to watch the progressed game. It is a method including a step of re-moving a character based on voice data.

Another aspect of the present disclosure is a computer-readable medium containing computer-executable instructions, which, upon execution of the computer-executable instruction, causes the processor to perform the steps included in the above method. Is.

Another aspect of the present disclosure is performed by a first user terminal of a first user other than at least one second user who comprises a first processor and a first memory and has viewed real-time distribution of a game performed by a performer in real time. After the real-time distribution of the game is completed by the first processor, the recorded voice data related to the game and the voice data for controlling at least one character appearing in the game are received from the outside. The delivered game includes a second processor, a second memory, a display unit, and a step of executing the reproduction of the delivered game by operating the character based on the voice data. It is a process executed by a computer as a second user terminal of a second user including an operation unit, and the second user terminal exists in a space physically separated from the space in which the second user terminal exists. Communication via a network with an external device that is different from the second user of the second user terminal and controls the character in response to input from a performer who plays the character in a space invisible to the second user. It is possible to advance the game according to the input operation of the second user input to the computer through the operation unit by the second processor, and to the external device as information indicating the progress of the game. Sequential transmission of progress information for making it possible to display a game screen of a game in progress, including a screen displayed on the display unit or a simulated screen simplified from the screen, and the sequential transmission of the progress information. Audio data acquired by an external device that displays the game screen of the game in progress in real time so that the performer can see it based on the progress information transmitted, and is the audio data that is displayed in real time by the performer. Appearing during the progress of the game, triggered by the reception of voice data from the external device and the reception of voice data, which is voice that is emitted at an arbitrary timing and cannot be heard directly by the second user. It is a method, which is a game generated by operating a character by causing the character to speak at least the content of the voice data, and by executing the character.

Another aspect of the present disclosure is a computer-readable medium containing computer-executable instructions, wherein upon execution of the computer-executable instructions, the first processor causes the first processor to perform the steps included in the method. It is a readable medium.

Another aspect of the present disclosure is an information processing apparatus as a user terminal including a processor, a memory, a display unit, and an operation unit, and the user terminal is a space physically separated from the space in which the user terminal exists. An external device that is different from the user of the user terminal and controls the character in response to an input from a performer who plays at least one character appearing in the game in a space invisible to the user. It is configured to be communicable via the network, and the processor reads the program stored in the memory to advance the game according to the user's input operation input to the computer via the operation unit, and externally. To enable the device to display a game screen of a game in progress, which is a screen displayed on a display unit or a simulated screen obtained by simplifying the screen, as information indicating the progress of the game. It is audio data acquired by an external device that sequentially transmits progress information and displays the game screen of the game in progress in real time so that the performer can see it based on the sequentially transmitted progress information. Triggered to receive voice data from the external device and voice data that is emitted from the performer to the game screen displayed in real time at an arbitrary timing and cannot be heard directly by the user. Then, in response to requesting the character appearing during the progress of the game to operate the character by at least speaking the content of the voice data, and requesting the viewing of the progressed game after the end of the game. It is an information processing apparatus configured to operate the character again based on the voice data received again from the outside.

Another aspect of the present disclosure is information as a first user terminal of a first user other than at least one second user who has a first processor and a first memory and has viewed real-time distribution of a game performed by a performer in real time. By reading the program stored in the first memory, the first processor, which is a processing device, appears in the game as recorded voice data related to the game from the outside after the real-time distribution of the game is completed. It is configured to receive voice data for controlling at least one character and to execute the reproduction of the delivered game by operating the character based on the voice data. The distributed game is a process executed by a computer as a second user terminal of a second user including a second processor, a second memory, a display unit, and an operation unit, and the second user terminal is the process. The space in which the second user terminal exists is an external device that exists in a space physically separated from the second user of the second user terminal, and the character is played in a space that cannot be visually recognized by the second user. It is configured to be able to communicate with an external device that controls the character in response to input from the performer via the network, and the second processor reads the program stored in the second memory to the computer via the operation unit. The game is progressed according to the input operation of the second user input to, and the game screen of the game in progress is displayed on the display unit as information indicating the progress of the game on the external device. The performer visually recognizes the progress information for sequentially transmitting the screen or the game screen including the simulated screen that simplifies the screen, and the game screen of the game in progress based on the sequentially transmitted progress information. It is audio data acquired by an external device that is displayed in real time so that it is possible, and it is audio that is emitted from the performer at an arbitrary timing to the game screen displayed in real time, and cannot be heard directly by the second user. By receiving the voice data of the voice from the external device and triggering the reception of the voice data, the character appearing during the progress of the game is made to speak at least the content of the voice data. Is an information processing device, which is a game generated by operating and executing.

Another aspect of the present disclosure is a method for controlling a character appearing in a game, wherein the method comprises a processor, a memory and a display, and is input from a performer who plays at least one character appearing in the game. A computer that controls the character according to the situation, and is physically separated from the space where the user terminal of the user different from the performer exists, and exists in the space where the user cannot see the performer, and can communicate with the user terminal via the network. It is a method performed by a computer, and the method is in progress based on progress information by a processor, which is sequentially transmitted from a user terminal for advancing the game, so as to be able to display a game screen of the in-progress game. The game screen of the game, which is the screen displayed on the display unit of the user terminal or the game screen including the simulated screen simplified from the screen, is displayed in real time on the display unit of the computer so that the performer can see it. Steps to be performed, a step to accept a voice that is emitted from the performer at an arbitrary timing to the game screen and cannot be heard directly by the user, and a step to send the voice data of the received voice to the user terminal. After the step and the end of the game, in response to a request from the user terminal, the voice data is transmitted to the user terminal on the user terminal in order to make the character speak the content of the voice data as in the end of the game. , In response to a request from a terminal other than the user terminal, the voice data is transmitted to the terminal other than the user terminal in order to make the character speak the content of the voice data in the terminal other than the user terminal as in the end of the game. , Steps, and methods.

Another aspect of the present disclosure is a computer-readable medium containing computer-executable instructions, which, upon execution of the computer-executable instruction, causes the processor to perform the steps included in the above method. be.

Another aspect of the present disclosure is an information processing device for controlling a character appearing in a game, wherein the information processing device includes a processor, a memory, and a display unit, and is a performer who plays at least one character appearing in the game. A computer that controls the character in response to input from, and is physically separated from the space where the user terminal of a user different from the performer exists, and exists in a space where the user cannot see the performer, and the user terminal and the network. It is configured to be communicable via, and the processor can display the game screen of the game in progress, which is sequentially transmitted from the user terminal that advances the game by reading the program stored in the memory. Based on the progress information, the performer can visually recognize the game screen of the game in progress, including the screen displayed on the display unit of the user terminal or the simulated screen simplified from the screen. It is displayed in real time on the display unit of the computer, it accepts the voice that is emitted from the performer at any timing to the game screen displayed in real time and cannot be heard directly by the user, and the received voice. Voice data is transmitted to the user terminal, and after the game is finished, in response to a request from the user terminal, the character is made to speak the content of the voice data on the user terminal as in the case of the finished game. To the user terminal, or in response to a request from a terminal other than the user terminal, in order to make the character speak the content of the voice data on the terminal other than the user terminal as in the end of the game. It is an information processing device configured to transmit and execute data to a terminal other than the user terminal.

According to one aspect of the present disclosure, it has the effect of improving the interest of the game.

It is a figure which shows the hardware configuration of a game system. It is a block diagram which shows the functional configuration of a user terminal, a server, and an operation instruction device. It is a figure which shows an example of the data structure of the screen transition information. It is a figure which shows an example of the data structure of progress information. It is a figure which shows an example of the data structure of the operation instruction data. It is a figure which shows an example of the progress screen displayed on the display part of the operation instruction apparatus. It is a figure which shows an example of the game screen displayed on the display part of a user terminal. It is a flowchart which shows the flow of the process executed by each device which constitutes a game system. It is a figure which shows the other example of the progress screen displayed on the display part of the operation instruction apparatus. It is a figure which shows an example of the game screen displayed on the display part of a user terminal. An example of the data structure of the user behavior history information according to the embodiment is shown. An example of the data structure of the game information according to one embodiment is shown. It is a flowchart which shows an example of the basic game progress of the game which concerns on one Embodiment. An example of a transition of a screen displayed on a display unit of a user terminal according to an embodiment is shown.

[Embodiment 1]
The game system according to the present disclosure is a system for providing a game to a plurality of users. Hereinafter, the game system will be described with reference to the drawings. It should be noted that the present invention is not limited to these examples, and is indicated by the scope of claims, and it is intended that all modifications within the meaning and scope equivalent to the scope of claims are included in the present invention. To. In the following description, the same elements are designated by the same reference numerals in the description of the drawings, and duplicate description is not repeated.

<Hardware configuration of game system 1>
FIG. 1 is a diagram showing a hardware configuration of the game system 1. As shown in the figure, the game system 1 includes a plurality of user terminals 100 and a server 200. Each user terminal 100 connects to the server 200 via the network 2. The network 2 is composed of various mobile communication systems constructed by the Internet and a radio base station (not shown). Examples of this mobile communication system include so-called 3G and 4G mobile communication systems, LTE (Long Term Evolution), and wireless networks (for example, Wi-Fi (registered trademark)) that can be connected to the Internet by a predetermined access point. Will be.

The server 200 (computer, information processing device) may be a general-purpose computer such as a workstation or a personal computer. The server 200 includes a processor 20, a memory 21, a storage 22, a communication IF 23, and an input / output IF 24. These configurations of the server 200 are electrically connected to each other by a communication bus.

The user terminal 100 (computer, information processing device) may be a mobile terminal such as a smartphone, a feature phone, a PDA (Personal Digital Assistant), or a tablet computer. The user terminal 100 may be a game device suitable for game play. As shown in the figure, the user terminal 100 includes a processor 10, a memory 11, a storage 12, a communication interface (IF) 13, an input / output IF 14, a touch screen 15 (display unit), a camera 17, and a distance measuring sensor 18. And prepare. These configurations included in the user terminal 100 are electrically connected to each other by a communication bus. The user terminal 100 may be provided with an input / output IF 14 to which a display (display unit) configured separately from the user terminal 100 main body can be connected in place of or in addition to the touch screen 15.

Further, as shown in FIG. 1, the user terminal 100 may be configured to be communicable with one or more controllers 1020. The controller 1020 establishes communication with the user terminal 100 according to a communication standard such as Bluetooth (registered trademark). The controller 1020 may have one or more buttons or the like, and transmits an output value based on a user's input operation to the buttons or the like to the user terminal 100. Further, the controller 1020 may have various sensors such as an acceleration sensor and an angular velocity sensor, and transmits the output values of the various sensors to the user terminal 100.

Note that, instead of or in addition to the user terminal 100 including the camera 17 and the distance measuring sensor 18, the controller 1020 may have the camera 17 and the distance measuring sensor 18.

It is desirable that the user terminal 100 causes a user who uses the controller 1020 to input user identification information such as the user's name or login ID via the controller 1020, for example, at the start of a game. As a result, the user terminal 100 can associate the controller 1020 with the user, and identifies which user the output value belongs to based on the source of the received output value (controller 1020). be able to.

When the user terminal 100 communicates with a plurality of controllers 1020, each user grips each controller 1020 so that the user terminal 100 does not communicate with other devices such as the server 200 via the network 2. Multiplayer can be realized with. In addition, each user terminal 100 communicates with each other according to a wireless standard such as a wireless LAN (Local Area Network) standard (communication connection is made without going through the server 200), thereby realizing local multiplayer with a plurality of user terminals 100. You can also do it. When the above-mentioned multiplayer is realized locally by one user terminal 100, the user terminal 100 may further include at least a part of various functions described later described in the server 200. Further, when the above-mentioned multiplayer is realized locally by a plurality of user terminals 100, the plurality of user terminals 100 may be provided with various functions described later described in the server 200 in a distributed manner.

Even when the above-mentioned multiplayer is realized locally, the user terminal 100 may communicate with the server 200. For example, information indicating a play result such as a result or a win or loss in a certain game may be associated with user identification information and transmitted to the server 200.

Further, the controller 1020 may be configured to be detachable from the user terminal 100. In this case, a coupling portion with the controller 1020 may be provided on at least one surface of the housing of the user terminal 100. When the user terminal 100 and the controller 1020 are connected by wire via the coupling portion, the user terminal 100 and the controller 1020 transmit and receive signals via the wire.

As shown in FIG. 1, the user terminal 100 may accept the attachment of a storage medium 1030 such as an external memory card via the input / output IF14. As a result, the user terminal 100 can read the program and data recorded on the storage medium 1030. The program recorded on the storage medium 1030 is, for example, a game program.

The user terminal 100 may store the game program acquired by communicating with an external device such as the server 200 in the memory 11 of the user terminal 100, or may store the game program acquired by reading from the storage medium 1030 in the memory 11. You may memorize it in.

As described above, the user terminal 100 includes a communication IF 13, an input / output IF 14, a touch screen 15, a camera 17, and a distance measuring sensor 18 as an example of a mechanism for inputting information to the user terminal 100. Each of the above-mentioned parts as an input mechanism can be regarded as an operation part configured to accept a user's input operation.

For example, when the operation unit is configured by at least one of the camera 17 and the distance measuring sensor 18, the operation unit detects an object 1010 in the vicinity of the user terminal 100 and performs an input operation from the detection result of the object. Identify. As an example, a user's hand as an object 1010, a marker having a predetermined shape, or the like is detected, and an input operation is specified based on the color, shape, movement, or type of the object 1010 obtained as a detection result. To. More specifically, when the user's hand is detected from the captured image of the camera 17, the user terminal 100 inputs a gesture (a series of movements of the user's hand) detected based on the captured image. Specify and accept as. The captured image may be a still image or a moving image.

Alternatively, when the operation unit is composed of the touch screen 15, the user terminal 100 identifies and accepts the user's operation performed on the input unit 151 of the touch screen 15 as the user's input operation. Alternatively, when the operation unit is configured by the communication IF 13, the user terminal 100 identifies and accepts a signal (for example, an output value) transmitted from the controller 1020 as an input operation of the user. Alternatively, when the operation unit is composed of the input / output IF14, a signal output from an input device (not shown) different from the controller 1020 connected to the input / output IF14 is specified as an input operation of the user and received.

In the present embodiment, the game system 1 further includes an operation instruction device 300. The operation instruction device 300 connects to each of the server 200 and the user terminal 100 via the network 2. At least one operation instruction device 300 is provided in the game system 1. A plurality of operation instruction devices 300 may be provided depending on the number of user terminals 100 that use the service provided by the server 200. One operation instruction device 300 may be provided for one user terminal 100. One operation instruction device 300 may be provided for a plurality of user terminals 100.

The operation instruction device 300 (NPC control device, character control device) may be a computer such as a server, a desktop personal computer, a laptop computer, or a tablet, and a computer group in which these are combined. As shown in the figure, the operation instruction device 300 includes a processor 30, a memory 31, a storage 32, a communication IF 33, an input / output IF 34, and a touch screen 35 (display unit). These configurations included in the operation instruction device 300 are electrically connected to each other by a communication bus. The operation instruction device 300 may include an input / output IF 34 to which a display (display unit) configured separately from the operation instruction device 300 main body can be connected in place of or in addition to the touch screen 35.

Further, as shown in FIG. 1, the operation instruction device 300 is connected to peripheral devices such as one or more microphones 3010, one or more motion capture devices 3020, and one or more controllers 3030 via wireless or wired. It may be configured to be communicable. The wirelessly connected peripheral device establishes communication with the operation instruction device 300 according to a communication standard such as Bluetooth (registered trademark).

The microphone 3010 acquires the voice generated in the surroundings and converts it into an electric signal. The voice converted into an electric signal is transmitted to the operation instruction device 300 as voice data, and is received by the operation instruction device 300 via the communication IF 33.

The motion capture device 3020 tracks the motion (including facial expressions, mouth movements, etc.) of the tracking target (for example, a person), and transmits the output value as the tracking result to the operation instruction device 300. The motion data, which is an output value, is received by the operation instruction device 300 via the communication IF 33. The motion capture method of the motion capture device 3020 is not particularly limited. The motion capture device 3020 selectively includes all mechanisms for capturing motion, such as a camera, various sensors, markers, a suit worn by a model (person), a signal transmitter, etc., depending on the method adopted. ..

The controller 3030 may have one or more physical input mechanisms such as buttons, levers, sticks, and wheels. The controller 3030 transmits an output value based on an input operation input to the input mechanism by the operator of the operation instruction device 300 to the operation instruction device 300. Further, the controller 3030 may have various sensors such as an acceleration sensor and an angular velocity sensor, and may transmit the output values of the various sensors to the operation instruction device 300. The above output value is received by the operation instruction device 300 via the communication IF 33. In the following, a person who performs some input operation on the operation instruction device 300 by using the operation unit provided in the operation instruction device 300 or various input mechanisms communicably connected to the operation instruction device 300. Called an operator. The operator includes a person who operates the operation instruction device 300 by using the input unit 351 and the controller 3030, a voice actor who inputs voice through the microphone 3010, and moves via the motion capture device 3020. A model for inputting is also included.

The operation instruction device 300 may include a camera and a distance measuring sensor (not shown). Alternatively or in addition to the motion instruction device 300, the motion capture device 3020 and the controller 3030 may have a camera and a distance measuring sensor.

As described above, the operation instruction device 300 includes a communication IF 33, an input / output IF 34, and a touch screen 35 as an example of a mechanism for inputting information to the operation instruction device 300. If necessary, a camera and a distance measuring sensor may be further provided. Each of the above-mentioned parts as an input mechanism can be regarded as an operation part configured to accept a user's input operation.

The operation unit may be composed of the touch screen 35. In this case, the operation instruction device 300 identifies and accepts the user's operation performed on the input unit 351 of the touch screen 35 as the user's input operation. Alternatively, when the operation unit is composed of the communication IF 33, the operation instruction device 300 identifies and accepts a signal (for example, an output value) transmitted from the controller 3030 as an input operation of the user. Alternatively, when the operation unit is composed of the input / output IF34, a signal output from an input device (not shown) different from the controller 3030 connected to the input / output IF34 is specified as an input operation of the user and received.

<Game overview>
In the present embodiment, as an example, in the game system 1, the server 200 and the user terminal 100 cooperate to execute the game program 131, and the game played by the user is advanced on the user terminal 100. Further, in the present embodiment, in the game system 1, the operation instruction device 300 (character control device) executes the character control program 134 and controls the operation of at least a part of the characters appearing in the game executed by the user terminal 100. can do.

The game system 1 is not limited to a specific genre, and may be a system for executing a game of any genre. For example, sports-themed games such as tennis, table tennis, dodgeball, baseball, soccer and hockey, puzzle games, quiz games, RPGs, adventure games, shooting games, simulation games, training games, and action games. May be good.

Further, the game system 1 is not limited to a specific play form, and may be a system for executing a game of any play form. For example, a single-player game by a single user, a multi-play game by a plurality of users, a battle game in which a plurality of users play against each other, and a cooperative play game in which a plurality of users cooperate among the multi-play games. You may. For example, as described above, the battle game may include a battle game on the subject of sports such as tennis or baseball. Further, the battle game may include a board game in which two players play against each other, such as shogi, go, chess, and Othello. Further, the battle game may include a race game in which a plurality of users operate vehicles, players, or the like to go around the same course and compete for the time.

<Hardware components of each device>
The processor 10 controls the operation of the entire user terminal 100. The processor 20 controls the operation of the entire server 200. The processor 30 controls the operation of the entire operation instruction device 300.

Processors

10, 20 and 30 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit).

The processor 10 reads a program from the storage 12 described later and expands it into the memory 11 described later. The processor 20 reads a program from the storage 22 described later and expands it into the memory 21 described later. The processor 30 reads a program from the storage 32 described later and expands it into the memory 31 described later. Processor 10, processor 20 and processor 30 execute the expanded program.

The

memories

11, 21 and 31 are the main storage devices. The

memories

11, 21 and 31 are composed of storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory). The memory 11 provides a work area to the processor 10 by temporarily storing a program and various data read from the storage 12 described later by the processor 10. The memory 11 also temporarily stores various data generated while the processor 10 is operating according to the program. The memory 21 provides a work area to the processor 20 by temporarily storing various programs and data read from the storage 22 described later by the processor 20. The memory 21 also temporarily stores various data generated while the processor 20 is operating according to the program. The memory 31 provides a work area to the processor 30 by temporarily storing various programs and data read from the storage 32 described later by the processor 30. The memory 31 also temporarily stores various data generated while the processor 30 is operating according to the program.

In the present embodiment, the program may be a game program for realizing the game by the user terminal 100. Alternatively, the program may be a game program for realizing the game in collaboration with the user terminal 100 and the server 200. Alternatively, the program may be a game program for realizing the game in cooperation with the user terminal 100, the server 200, and the operation instruction device 300. The game realized by the cooperation of the user terminal 100 and the server 200 and the game realized by the cooperation of the user terminal 100, the server 200, and the operation instruction device 300 are started by the user terminal 100 as an example. It may be a game executed on a browser. Alternatively, the program may be a game program for realizing the game by the cooperation of a plurality of user terminals 100. Further, the various data include data related to the game such as user information and game information, and instructions or notifications to be transmitted / received between the devices of the game system 1.

Storages

12, 22 and 32 are auxiliary storage devices. The

storages

12, 22 and 32 are composed of a storage device such as a flash memory or an HDD (Hard Disk Drive). Various data related to the game are stored in the

storages

12, 22 and 32.

The communication IF 13 controls the transmission and reception of various data in the user terminal 100. The communication IF 23 controls the transmission / reception of various data in the server 200. The communication IF 33 controls the transmission / reception of various data in the operation instruction device 300.

Communication IFs

13, 23 and 33 control communication using, for example, communication via a wireless LAN (Local Area Network), Internet communication via a wired LAN, a wireless LAN, or a mobile phone network, and communication using short-range wireless communication. ..

The input / output IF 14 is an interface for the user terminal 100 to accept data input, and an interface for the user terminal 100 to output data. The input / output IF 14 may input / output data via USB (Universal Serial Bus) or the like. The input / output IF 14 may include, for example, a physical button, a camera, a microphone, a speaker, or the like of the user terminal 100. The input / output IF 24 of the server 200 is an interface for the server 200 to receive data input, and an interface for the server 200 to output data. The input / output IF 24 may include, for example, an input unit that is an information input device such as a mouse or a keyboard, and a display unit that is a device that displays and outputs an image. The input / output IF 34 of the operation instruction device 300 is an interface for the operation instruction device 300 to receive data input, and an interface for the operation instruction device 300 to output data. The input / output IF34 includes, for example, information input devices such as a mouse, keyboard, stick, and lever, devices for displaying and outputting images such as a liquid crystal display, and peripheral devices (microphone 3010, motion capture device 3020, and controller 3030). May include connections for sending and receiving data between.

The touch screen 15 of the user terminal 100 is an electronic component that combines an input unit 151 and a display unit 152. The touch screen 35 of the operation instruction device 300 is an electronic component in which an input unit 351 and a display unit 352 are combined. The

input units

151 and 351 are, for example, touch-sensitive devices, and are configured by, for example, a touch pad. The

display units

152 and 352 are configured by, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, or the like.

The

input units

151 and 351 detect the position where the user's operation (mainly a physical contact operation such as a touch operation, a slide operation, a swipe operation, and a tap operation) is input to the input surface, and information indicating the position. It has a function to transmit as an input signal. The

input units

151 and 351 may be provided with a touch sensing unit (not shown). The touch sensing unit may adopt any method such as a capacitance method or a resistance film method.

Although not shown, the user terminal 100 may include one or more sensors for specifying the holding posture of the user terminal 100. This sensor may be, for example, an acceleration sensor, an angular velocity sensor, or the like. When the user terminal 100 includes a sensor, the processor 10 can also specify the holding posture of the user terminal 100 from the output of the sensor and perform processing according to the holding posture. For example, the processor 10 may be a vertical screen display in which a vertically long image is displayed on the display unit 152 when the user terminal 100 is held vertically. On the other hand, when the user terminal 100 is held horizontally, it may be a horizontal screen display in which a horizontally long image is displayed on the display unit. In this way, the processor 10 may be able to switch between the vertical screen display and the horizontal screen display according to the holding posture of the user terminal 100.

The camera 17 includes an image sensor and the like, and generates a captured image by converting the incident light incident from the lens into an electric signal.

The distance measuring sensor 18 is a sensor that measures the distance to the object to be measured. The distance measuring sensor 18 includes, for example, a light source that emits pulse-converted light and a light receiving element that receives the light. The distance measuring sensor 18 measures the distance to the object to be measured by the timing of light emission from the light source and the timing of receiving the reflected light generated by the light emitted from the light source being reflected by the object to be measured. The distance measuring sensor 18 may have a light source that emits light having directivity.

Here, an example in which the user terminal 100 receives the detection result of detecting the object 1010 in the vicinity of the user terminal 100 by using the camera 17 and the distance measuring sensor 18 as an input operation of the user will be further described. The camera 17 and the distance measuring sensor 18 may be provided on the side surface of the housing of the user terminal 100, for example. A ranging sensor 18 may be provided in the vicinity of the camera 17. As the camera 17, for example, an infrared camera can be used. In this case, the camera 17 may be provided with a lighting device that irradiates infrared rays, a filter that blocks visible light, and the like. This makes it possible to further improve the detection accuracy of the object based on the captured image of the camera 17, regardless of whether it is outdoors or indoors.

The processor 10 may perform one or more of the processes shown in the following (1) to (5), for example, on the captured image of the camera 17. (1) The processor 10 performs image recognition processing on the captured image of the camera 17 to specify whether or not the captured image includes a user's hand. The processor 10 may use, for example, a technique such as pattern matching as the analysis technique adopted in the above-mentioned image recognition process. (2) Further, the processor 10 detects the user's gesture from the shape of the user's hand. The processor 10 specifies, for example, the number of fingers of the user (the number of extended fingers) from the shape of the user's hand detected from the captured image. The processor 10 further identifies the gesture performed by the user from the number of identified fingers. For example, the processor 10 determines that the user has made a "par" gesture when the number of fingers is five. Further, when the number of fingers is 0 (the finger is not detected), the processor 10 determines that the user has made a “goo” gesture. Further, when the number of fingers is two, the processor 10 determines that the user has performed the "choki" gesture. (3) The processor 10 performs image recognition processing on the captured image of the camera 17 to detect whether the user's finger is in a state where only the index finger is raised or whether the user's finger is repelled. .. (4) The processor 10 is an object 1010 (user's hand or the like) in the vicinity of the user terminal 100 based on at least one of the image recognition result of the captured image of the camera 17 and the output value of the distance measuring sensor 18. ) And the user terminal 100. For example, the processor 10 may have the user's hand near the user terminal 100 (for example, a distance less than a predetermined value) or far away (for example, a predetermined value) depending on the size of the shape of the user's hand specified from the captured image of the camera 17. Detect if it is at the above distance). When the captured image is a moving image, the processor 10 may detect whether the user's hand is approaching or moving away from the user terminal 100. (5) When it is found that the distance between the user terminal 100 and the user's hand is changing while the user's hand is detected based on the image recognition result of the captured image of the camera 17, the processor. 10 recognizes that the user is waving his hand in the shooting direction of the camera 17. When an object is detected or not detected in the distance measuring sensor 18 having a stronger directivity than the shooting range of the camera 17, the processor 10 determines that the user is waving his hand in a direction orthogonal to the shooting direction of the camera. recognize.

As described above, the processor 10 determines whether or not the user is holding the hand (whether it is a “goo” gesture or another gesture (for example, “par”) by recognizing the image captured by the camera 17. Or) is detected. In addition, the processor 10 detects the shape of the user's hand and how the user is moving the hand. In addition, the processor 10 detects whether the user is approaching or moving this hand toward or away from the user terminal 100. Such an operation can correspond to an operation using a pointing device such as a mouse or a touch panel, for example. For example, the user terminal 100 moves the pointer on the touch screen 15 in response to the movement of the user's hand, and detects the user's gesture “goo”. In this case, the user terminal 100 recognizes that the user is continuing the selection operation. The continuation of the selection operation corresponds to, for example, the state in which the mouse is clicked and pressed, or the state in which the mouse is touched after the touch-down operation is performed on the touch panel. Further, when the user moves his / her hand while the user's gesture "goo" is detected, the user terminal 100 performs such a series of gestures as an operation corresponding to a swipe operation (or a drag operation). You can also recognize it. Further, when the user terminal 100 detects a gesture that the user flips a finger based on the detection result of the user's hand by the image taken by the camera 17, the gesture is clicked by the mouse or tapped on the touch panel. It may be recognized as an operation corresponding to.

<Functional configuration of game system 1>
FIG. 2 is a block diagram showing a functional configuration of a user terminal 100, a server 200, and an operation instruction device 300 included in the game system 1. Each of the user terminal 100, the server 200, and the operation instruction device 300 is not shown, and has a functional configuration necessary for functioning as a general computer and a functional configuration necessary for realizing a known function in a game. May include.

The user terminal 100 has a function as an input device that accepts a user's input operation and a function as an output device that outputs a game image or sound. The user terminal 100 functions as a control unit 110 and a storage unit 120 by the cooperation of the processor 10, the memory 11, the storage 12, the communication IF 13, the input / output IF 14, and the like.

The server 200 has a function of communicating with each user terminal 100 and supporting the user terminal 100 to advance the game. For example, when the user terminal 100 downloads an application related to this game for the first time, the user terminal 100 is provided with data to be stored in the user terminal 100 at the start of the first game. For example, the server 200 transmits the operation instruction data for operating the character to the user terminal 100. The motion instruction data may include motion capture data that captures the movement of an actor such as a model in advance, or may include voice data that records the voice of an actor such as a voice actor, or causes the character to operate. It may include operation history data indicating the history of input operations for the purpose, or may include a motion command group in which commands associated with the above-mentioned series of input operations are arranged in chronological order. When the game is a multiplayer game, the server 200 may have a function of communicating with each user terminal 100 participating in the game and mediating an exchange between the user terminals 100 and a synchronization control function. Further, the server 200 has a function of mediating between the user terminal 100 and the operation instruction device 300. As a result, the operation instruction device 300 can supply the operation instruction data to the user terminal 100 or a group of a plurality of user terminals 100 in a timely manner without making a mistake in the destination. The server 200 functions as a control unit 210 and a storage unit 220 by the cooperation of the processor 20, the memory 21, the storage 22, the communication IF23, the input / output IF24, and the like.

The operation instruction device 300 has a function of generating operation instruction data for instructing the operation of a character in the user terminal 100 and supplying the operation instruction data to the user terminal 100. The operation instruction device 300 functions as a control unit 310 and a storage unit 320 in cooperation with the processor 30, the memory 31, the storage 32, the communication IF 33, the input / output IF 34, and the like.

The

storage units

120, 220 and 320 store the game program 131, the game information 132 and the user information 133. The game program 131 is a game program executed by the user terminal 100, the server 200, and the operation instruction device 300. The game information 132 is data that the

control units

110, 210, and 310 refer to when executing the game program 131. The user information 133 is data related to the user's account. In the

storage units

220 and 320, the game information 132 and the user information 133 are stored for each user terminal 100. The storage unit 320 further stores the character control program 134. The character control program 134 is a program executed by the operation instruction device 300, and is a program for controlling the operation of a character appearing in a game based on the above-mentioned game program 131.

(Functional configuration of server 200)
The control unit 210 comprehensively controls the server 200 by executing the game program 131 stored in the storage unit 220. For example, the control unit 210 transmits various data, programs, and the like to the user terminal 100. The control unit 210 receives a part or all of the game information or the user information from the user terminal 100. When the game is a multiplayer game, the control unit 210 may receive a request for synchronization of multiplayer from the user terminal 100 and transmit data for synchronization to the user terminal 100. Further, the control unit 210 communicates with the user terminal 100 and the operation instruction device 300 as necessary to send and receive information.

The control unit 210 functions as a progress support unit 211 and a shared support unit 212 according to the description of the game program 131. The control unit 210 can also function as another functional block (not shown) in order to support the progress of the game on the user terminal 100, depending on the nature of the game to be executed.

The progress support unit 211 communicates with the user terminal 100 and supports the user terminal 100 to progress various parts included in this game. For example, when the user terminal 100 advances the game, the progress support unit 211 provides the user terminal 100 with information necessary for advancing the game.

The sharing support unit 212 communicates with a plurality of user terminals 100, and supports a plurality of users to share each other's decks on each user terminal 100. Further, the sharing support unit 212 may have a function of matching the online user terminal 100 with the operation instruction device 300. As a result, information can be smoothly transmitted and received between the user terminal 100 and the operation instruction device 300.

(Functional configuration of user terminal 100)
The control unit 110 comprehensively controls the user terminal 100 by executing the game program 131 stored in the storage unit 120. For example, the control unit 110 advances the game according to the game program 131 and the user's operation. Further, the control unit 110 communicates with the server 200 and the operation instruction device 300 as necessary to transmit and receive information while the game is in progress.

The control unit 110 includes an operation reception unit 111, a display control unit 112, a user interface (hereinafter, UI) control unit 113, an animation generation unit 114, a game progress unit 115, an analysis unit 116, and a progress unit according to the description of the game program 131. It functions as an information generation unit 117. The control unit 110 can also function as other functional blocks (not shown) in order to advance the game, depending on the nature of the game to be executed.

The operation reception unit 111 detects and accepts a user's input operation to the input unit 151. The operation reception unit 111 determines what input operation has been performed from the action exerted by the user on the console via the touch screen 15 and other input / output IF 14, and outputs the result to each element of the control unit 110. do.

For example, the operation receiving unit 111 receives an input operation for the input unit 151, detects the coordinates of the input position of the input operation, and specifies the type of the input operation. The operation receiving unit 111 specifies, for example, a touch operation, a slide operation, a swipe operation, a tap operation, and the like as types of input operations. Further, the operation receiving unit 111 detects that the contact input is canceled from the touch screen 15 when the continuously detected input is interrupted.

The UI control unit 113 controls the UI object to be displayed on the display unit 152 in order to construct the UI. The UI object is a tool for the user to make an input necessary for the progress of the game to the user terminal 100, or a tool for obtaining information output during the progress of the game from the user terminal 100. UI objects are, but are not limited to, icons, buttons, lists, menu screens, and the like.

The animation generation unit 114 generates an animation showing the motion of various objects based on the control mode of various objects. For example, the animation generation unit 114 may generate an animation or the like that expresses how the character moves as if it were there, moves the mouth, or changes the facial expression.

The display control unit 112 outputs a game screen reflecting the processing result executed by each of the above elements to the display unit 152 of the touch screen 15. The display control unit 112 may display the game screen including the animation generated by the animation generation unit 114 on the display unit 152. Further, the display control unit 112 may superimpose and draw the above-mentioned UI object controlled by the UI control unit 113 on the game screen.

The game progress unit 115 advances the game. In the present embodiment, the game progress unit 115 advances the game executed in the game system 1 according to the present embodiment (hereinafter, this game) according to the input operation of the user input via the operation reception unit 111. Let me. When the game is divided into a plurality of parts such as the first part, the second part, and so on, the game progress unit 115 advances the game according to the specifications of each part.

As an example, it is assumed that this game is a competitive tennis game and is divided into a tutorial part, a competitive part, and a lottery part. For example, in the tutorial part, the game progress unit 115 provides the knowledge necessary for a novice user to play other parts (competition part and lottery part), or in the battle part which is the main part of the game. It provides a simple practice mode to learn core operations. The game progress unit 115 advances the tutorial part according to the input operation of the user and the game program 131 previously downloaded to the storage unit 120.

The game progress unit 115 causes a tennis player operated by a user to play a tennis player operated by another user in a battle part. The game progress unit 115 shares information with the user terminal 100 operated by another user via the server 200, and advances the tennis match while synchronizing with each other. That is, the game progress unit 115 advances the battle part according to the input operation of the user, the input operation of another user, and the game program 131.

The game progress unit 115 executes a lottery in the lottery part, and causes the user to acquire the winning game medium. The game medium is digital data that can be used in this game, and is, for example, an item that can enhance a tennis player operated by a user in order to make a match advantageous. The game progress unit 115 advances the lottery part according to the input operation of the user, the game program 131 downloaded in advance to the storage unit 120, and the lottery result executed by the server 200. Here, "getting the user to acquire the game medium" may, as an example, change the status of the game medium managed in association with the user from unusable to usable. Alternatively, the game medium may be stored in at least one of the memories (memory 11, memory 21, memory 31) included in the game system 1 in association with the user identification information, the user terminal ID, or the like.

The analysis unit 116 analyzes (renders) the operation instruction data and instructs the game progress unit 115 to operate the character based on the analysis result. In the present embodiment, the analysis unit 116 starts rendering of the operation instruction data triggered by the fact that the operation instruction data supplied by the operation instruction device 300 is received via the communication IF 33. The operation instruction device 300 transmits the analysis result to the game progress unit 115, and immediately instructs the character to operate based on the operation instruction data. That is, the game progress unit 115 uses the reception of the operation instruction data as a trigger to operate the character based on the operation instruction data. This makes it possible to show the user a character that operates in real time.

The progress information generation unit 117 generates progress information indicating the progress of the game being executed by the game progress unit 115, and sends it to the server 200 or the operation instruction device 300 in a timely manner. The progress information may include, for example, information that specifies the currently displayed game screen, or may include a progress log indicating the progress of the game in chronological order by characters, symbols, and the like. In the game system 1, in the embodiment in which the server 200 and the operation instruction device 300 do not require progress information, the progress information generation unit 117 may be omitted.

(Functional configuration of operation instruction device 300)
The control unit 310 comprehensively controls the operation instruction device 300 by executing the character control program 134 stored in the storage unit 320. For example, the control unit 310 generates operation instruction data according to the operation of the character control program 134 and the operator, and supplies the operation instruction data to the user terminal 100. The control unit 310 may further execute the game program 131, if necessary. Further, the control unit 310 communicates with the server 200 and the user terminal 100 running the game to send and receive information.

The control unit 310 functions as an operation reception unit 311, a display control unit 312, a UI control unit 313, an animation generation unit 314, a progress simulation unit 315, and a character control unit 316 according to the description of the character control program 134. The control unit 310 can also function as another functional block (not shown) in order to control a character appearing in the game according to the nature of the game executed in the game system 1.

The operation reception unit 311 detects and accepts the operator's input operation to the input unit 351. The operation reception unit 311 determines what kind of input operation has been performed on the console via the touch screen 35 and other input / output IF 34s from the action exerted by the operator, and outputs the result to each element of the control unit 310. Output. The details of the function of the operation reception unit 311 are almost the same as those of the operation reception unit 111 in the user terminal 100.

The UI control unit 313 controls the UI object to be displayed on the display unit 352.

The animation generation unit 314 generates an animation showing the motion of various objects based on the control mode of various objects. For example, the animation generation unit 314 may generate an animation or the like that reproduces the game screen actually displayed on the user terminal 100 that is the communication partner.

The display control unit 312 outputs a game screen reflecting the processing result executed by each of the above-mentioned elements to the display unit 352 of the touch screen 35. The details of the functions of the display control unit 312 are substantially the same as those of the display control unit 112 in the user terminal 100.

The progress simulation unit 315 grasps the progress of the game on the user terminal 100 based on the progress information indicating the progress of the game received from the user terminal 100. Then, the progress simulation unit 315 presents the progress of the user terminal 100 to the operator by simulating the behavior of the user terminal 100 in the operation instruction device 300.

For example, the progress simulation unit 315 may display a reproduction of the game screen displayed on the user terminal 100 on the display unit 352 of the own device. Further, the progress simulation unit 315 may display the progress of the game on the display unit 352 as the above-mentioned progress log on the user terminal 100.

Further, a part of the functions of the progress simulation unit 315 may be realized by the control unit 310 executing the game program 131. For example, first, the progress simulation unit 315 grasps the progress of the game of the user terminal 100 based on the progress information. Then, the progress simulation unit 315 may completely or simplify the game screen currently displayed on the user terminal 100 based on the game program 131 and reproduce it on the display unit 352 of the own device. Alternatively, the progress simulation unit 315 may grasp the progress of the game at the present time, predict the progress of the game after the present time based on the game program 131, and output the prediction result to the display unit 352.

The character control unit 316 controls the behavior of the character displayed on the user terminal 100. Specifically, the operation instruction data for operating the character is generated and supplied to the user terminal 100. For example, the character control unit 316 generates operation instruction data instructing an operator (voice actor or the like) to speak to the character to be controlled based on the voice data input via the microphone 3010. The operation instruction data generated in this way includes at least the above-mentioned voice data. Further, for example, an operator (model or the like) generates motion instruction data instructing the character to be controlled to perform a motion based on the motion capture data input via the motion capture device 3020. The motion instruction data generated in this way includes at least the above-mentioned motion capture data. Further, for example, it is instructed that the operator operates the character to be controlled based on the history of the input operation input through the input mechanism such as the controller 3030 or the operation unit such as the input unit 351 which is the operation history data. Generate action instruction data to be performed. The operation instruction data generated in this way includes at least the above-mentioned operation history data. The operation history data is, for example, information in which operation logs indicating which button of the controller 3030 is pressed at what timing by the operator when which screen is displayed on the display unit are organized in chronological order. .. The display unit here may be a display unit linked to the controller 3030, may be a display unit 352 of the touch screen 35, or may be another display unit connected via the input / output IF 34. .. Alternatively, the character control unit 316 identifies a command instructing the operation of the character associated with the input operation input by the operator via the above-mentioned input mechanism or operation unit. Then, the character control unit 316 arranges the commands in the order in which they are input to generate a motion command group indicating a series of actions of the character, and generates motion instruction data instructing the character to be operated according to the motion command group. You may. The motion instruction data generated in this way includes at least the above-mentioned motion command group.

The reaction processing unit 317 receives feedback on the user's reaction from the user terminal 100 and outputs this to the operator of the operation instruction device 300. In the present embodiment, for example, the user terminal 100 can create a comment addressed to the character while the character is operated according to the above-mentioned operation instruction data. The reaction processing unit 317 receives the comment data of the comment and outputs it. The reaction processing unit 317 may display the text data corresponding to the user's comment on the display unit 352, or may output the voice data corresponding to the user's comment from a speaker (not shown).

The functions of the user terminal 100, the server 200, and the operation instruction device 300 shown in FIG. 2 are merely examples. Each device of the user terminal 100, the server 200, and the operation instruction device 300 may have at least a part of the functions of the other devices. Further, another device other than the user terminal 100, the server 200, and the operation instruction device 300 may be used as a component of the game system 1, and the other device may be made to execute a part of the processing in the game system 1. That is, the computer that executes the game program in the present embodiment may be any of a user terminal 100, a server 200, an operation instruction device 300, and another device other than the user terminal 100, and is realized by a combination of a plurality of these devices. May be done.

<Processing overview>
In the present embodiment, the user terminal 100 is configured to execute the following steps in order to improve the interest of the game based on the game program 131. Specifically, the user terminal 100 includes a step of advancing the game in response to a user's input operation input to the user terminal 100 via an operation unit (for example, an input unit 151), and at least one appearing in the game. A step of transmitting progress information indicating the progress of the game to the operation instruction device 300 that controls the character, and voice data corresponding to the character's remarks input in the operation instruction device 300 according to the progress of the game are input to the operation instruction device 300. Execution of a step of receiving from the device 300 and a step of operating the character by causing a character appearing during the progress of the game to speak at least the content of the voice data by using the reception of the voice data as a trigger. do.

Further, in the present embodiment, the operation instruction device 300 is configured to execute the following steps in order to improve the interest of the game based on the character control program 134. Specifically, the operation instruction device 300 includes a step of displaying a progress screen indicating the progress of the game on the display unit 352 based on the progress information indicating the progress of the game received from the user terminal 100 for advancing the game. , A step of receiving voice data corresponding to a character's remark input to the operation instruction device 300 according to the progress of the game indicated by the progress screen displayed on the display unit 352, and the received voice data being received by the user terminal 100. And perform the steps to send to.

According to the above configuration, while the user is playing the game, the progress of the game on the user terminal 100 is reported to the operation instruction device 300. Therefore, the operator of the operation instruction device 300 can grasp how far the user has advanced the game. As a result, the operator or the voice actor who receives the instruction from the operator can input the voice data according to the progress of the user's game to the operation instruction device 300. The voice data input from the operator to the operation instruction device 300 based on the progress is supplied to the user terminal 100. The user terminal 100 causes the character to speak the content of the voice data while the game is in progress. As a result, the user can play the game while recognizing the existence of a character who speaks the content according to the progress of the game being played. Since the character can be made to speak according to the progress of the game, the user can feel the reality as if the character is playing the game together. As a result, it has the effect of increasing the immersive feeling of the game and improving the interest of the game.

<Data structure>
(Screen transition information)
FIG. 3 is a diagram showing an example of a data structure of screen transition information. As an example, the screen transition information is configured to include each item of "game part" and "screen information".

The item "game part" stores the identification information of each part constituting this game. As an example, this game is a competitive tennis game, and is composed of three parts: a tutorial part, a competitive part, and a lottery part.

The item "screen information" stores information that defines the screen displayed in each part and its transition. For example, in this game, in the tutorial part, the introduction screen of ID "0001" is displayed on the display unit 152, then the practice screen of ID "0002" is displayed, and finally, the explanation screen of ID "0003" is displayed. It is displayed and the tutorial part ends.

In the present embodiment, the user terminal 100 and the operation instruction device 300 may store and share this screen transition information in their respective storage units. As a result, by simply transmitting and receiving a screen ID between the user terminal 100 and the operation instruction device 300, the operation instruction device 100 can easily determine which game screen of which part the user terminal 100 is currently displaying. It can be transmitted to 300.

(Progress information)
FIG. 4 is a diagram showing an example of a data structure of progress information generated by the progress information generation unit 117 of the user terminal 100. As an example, the progress information is configured to include each item of "screen ID" and "progress log".

The above-mentioned screen ID is stored in the item "screen ID". The progress information generation unit 117 identifies the game screen currently displayed on the display unit 152 by the game progress unit 115, and stores the screen ID in the item.

The item "progress log" stores the progress log of the game being executed by the game progress unit 115. For example, as the battle part progresses, the game progress unit 115 records the progress log in the storage unit 120 periodically or every time an event to be recorded occurs. The progress information generation unit 117 stores the latest progress log recorded by the game progress unit 115 in the item.

The progress log is, for example, a record in which the time when an event occurred and the content of the event are associated with each other are arranged in chronological order. The progress information generation unit 117 may store the entire progress log in the item of "progress log", or may store only the record of the progress log that has not yet been reported to the operation instruction device 300.

The progress information may further include items necessary for grasping the progress of the game, depending on the nature of the game. For example, in a competitive part of a competitive tennis game, in a virtual game space, the positions of the players in the match and the positions of the balls that the players hit each other change according to the input operation of the user. An object whose attribute changes according to a user's input operation, such as the player and the ball described above, is hereinafter referred to as a dynamic object. The attribute of an object refers to, for example, the position, size, or shape of the object in the game space. Therefore, in the present embodiment, the progress information may be further configured to include the item of "dynamic object".

The item "dynamic object" stores attribute-related information necessary for identifying the attributes of the dynamic object. The attribute-related information may be, for example, coordinate information for specifying the position of the dynamic object in the game space. Alternatively, the attribute-related information may be information for specifying the movement path of the ball, for example, when the dynamic object is a ball. For example, the progress information generation unit 117 acquires the velocity vector, rotation axis, rotation amount, etc. of the ball immediately after colliding with the racket from the game progress unit 115, and stores them in the item of "dynamic object" as attribute-related information. May be good.

The progress information generation unit 117 generates progress information including each of the above items periodically or every time a predetermined event occurs during the progress of the game, and transmits the progress information to the operation instruction device 300. As a result, the operation instruction device 300 can grasp the progress of the game on the user terminal 100.

(Operation instruction data)
FIG. 5 is a diagram showing an example of a data structure of operation instruction data processed by the game system 1 according to the present embodiment. As an example, the action instruction data includes each item of "destination" and "creator" which is meta information, and "character ID", "voice", "movement", and "attention point" which are the contents of the data. It is configured to include each item.

The destination designation information is stored in the item "destination". The destination designation information is information indicating to which device the operation instruction data is transmitted. The destination designation information may be, for example, an address unique to the user terminal 100, or may be identification information of the group to which the user terminal 100 belongs. It may be a symbol (for example, "ALL") indicating that the destination is all user terminals 100 satisfying a certain condition.

The creation source information is stored in the item "creation source". The creation source information is information indicating which device created the operation instruction data. The creation source information is information related to a user, such as a user ID, a user terminal ID, and a unique address of the user terminal, which can identify a specific user. The creation source information may be an ID or an address indicating the server 200 or the operation instruction device 300, and if the creation source is the server 200 or the operation instruction device 300, the value of the item is left empty. The item itself may not be provided in the operation instruction data.

The item "character ID" stores a character ID for uniquely identifying a character appearing in this game. The character ID stored here represents which character's action is indicated by the action instruction data.

The item "voice" stores voice data to be expressed in the character. Motion data that specifies the movement of the character is stored in the item "movement". As an example, the motion data may be motion capture data acquired by the motion instruction device 300 via the motion capture device 3020. The motion capture data may be data that tracks the movement of the actor's entire body, may be data that tracks the facial expression and mouth movement of the actor, or may be both. As another example, the motion data may be a motion command group instructing a series of movements of the character specified by an operation input by the operator of the operation instruction device 300 via the controller 3030. For example, when the commands "raise the right hand", "raise the left hand", "walk", and "run" are assigned to the buttons A, B, C, and D of the controller 3030, the operator can use them. , Button A, Button B, Button C, and Button D are pressed in order, and the commands "Raise right hand", "Raise left hand", "Walk", and "Run" are arranged in the above order. The motion commands are stored in the "movement" item as motion data. In this embodiment, the voice data and the motion data are included in the operation instruction data in a synchronized state.

In the item "attention point", attention information for specifying a point to be noticed by the user in the interaction between the character and the user on the game screen displayed on the display unit 152 of the user terminal 100 is stored. To. As an example, the attention information may be identification information that identifies an object that the user wants to pay attention to among the objects arranged on the game screen, for example, an object ID. Alternatively, the attention information may be position coordinates (second position coordinates) indicating a specific position of the display unit 152 for displaying the game screen. In the present embodiment, the progress simulation unit 315 of the operation instruction device 300 may reproduce the game screen displayed on the display unit 152 of the user terminal 100 on the display unit 352. In this case, the operator of the operation instruction device 300 can specify a position to be noticed by the user by an input operation via the input unit 351. The first position coordinates in the display unit 352 on which the input operation is performed are converted into the above-mentioned second position coordinates by the character control unit 316. For example, the character control unit 316 displays the specifications (number of pixels, aspect ratio, etc.) of the touch screen 15 previously acquired from the user terminal 100 and the game screen reproduced on the display unit 352 for the above conversion. Refer to the position where you are. Using these referenced information, the character control unit 316 can obtain the second position coordinates on the touch screen 15 of the user terminal 100 corresponding to the first position coordinates on the display unit 352 of the own device.

For example, the display unit 352 and the input unit 351 may form a touch screen 35. In this case, the first position coordinates of the touch operation (input operation) input by the user with respect to the simulated screen displayed on the display unit 352 are the character control units 316 as the position coordinates on the touch screen 35 via the input unit 151. To be acquired. In another embodiment, the input unit 351 and the display unit 352 may be formed separately. For example, when the input unit 351 is an input device formed separately from the display unit 352 such as a mouse or a keyboard, a user can use a mouse to determine a predetermined screen displayed on the display unit 352. Click the position. The first position coordinates of the click operation (input operation) input by the user on the simulated screen are determined based on the input timing of the click operation and the display position of the cursor displayed on the display unit 352 at that time. It is supplied to the character control unit 316.

When the game progress unit 115 of the user terminal 100 uses the information of the "attention point", the game progress unit 115 displays on the game screen to surely convey to the user a place to be noticed by the user. Is possible. For example, even if a character's utterance contains a demonstrative word such as "this", "here", "over there", or "here", the game progress unit 115 grasps the point pointed to by the demonstrative word. , You can highlight it. Therefore, the user can know exactly where the demonstrative is pointing. As a result, a conversation including a demonstrative word is established between the user and the character. As a result, it is possible to realize immersive, fast-paced and natural communication between the user and the character as if the characters were playing together on the spot.

By receiving such motion instruction data, the game progress unit 115 can operate the character appearing in the game as intended by the creator of the motion instruction data. Specifically, when the motion instruction data includes voice data, the game progress unit 115 causes the character to speak based on the voice data, and when the motion instruction data includes motion data, the game progress unit 115 causes the character to speak. Moves the character based on the motion data, that is, generates an animation of the character so as to move based on the motion data.

<Screen example>
(Progress screen)
FIG. 6 is a diagram showing an example of a progress screen displayed on the display unit 352 of the operation instruction device 300. In the present embodiment, the progress simulation unit 315 displays the progress information acquired from the user terminal 100 on the display unit 352 as, for example, the progress screen 400.

The progress screen 400 includes a simulated screen 401 and a progress log 402 as an example. Further, the progress screen 400 may include a UI component 403 for the operator (or voice actor) to input voice data to the own device via the microphone 3010. The progress screen 400 may include the same screen that is actually displayed on the display unit 152 of the user terminal 100 as a simulated screen 401, or may include a simulated screen 401 that is a simplification of the screen. ..

The progress simulation unit 315 analyzes the progress information acquired from the user terminal 100. The progress simulation unit 315 identifies the game screen displayed on the user terminal 100 based on the screen ID included in the progress information. The progress simulation unit 315 displays the specified game screen on the display unit 352. For example, the progress simulation unit 315 may reproduce the above-mentioned game screen in detail based on the game information 132, the user information 133, and the game program 131 stored in the storage unit 320. However, in order to reduce the processing load, the progress simulation unit 315 preferably generates a simulation screen 401 that simplifies the above-mentioned game screen. The simulated screen 401 includes only the minimum information necessary for the operator of the operation instruction device 300 to determine the progress of the game among the information arranged on the above-mentioned game screen. The simulated screen 401 may include, for example, the layout of each object, the description of the function of each object, and the status of each object, with the drawing of the appearance of the object omitted as the minimum information.

Further, it is preferable that the progress simulation unit 315 reproduces the attributes of the dynamic objects arranged on the game screen on the simulation screen 401 based on the attribute-related information of the dynamic objects included in the progress information. For example, the progress simulation unit 315 may calculate the movement trajectory of the ball 404 based on the attribute-related information of the ball 404, which is a dynamic object, and move the ball 404 accordingly. Alternatively, the progress simulation unit 315 specifies the position of each player in the game space based on the attribute-related information of the player 405 operated by the user and the player 406 operated by the opponent user, which are dynamic objects. Then, the progress simulation unit 315 determines the size of each player based on the positional relationship between each player and the virtual camera, and arranges each player at the specified position. Alternatively, the display size of each player is defined in advance as attribute-related information, and the progress simulation unit 315 may arrange each player according to the defined display size.

The progress simulation unit 315 arranges the progress log included in the progress information on the progress screen 400. For example, as shown in the figure, the progress simulation unit 315 generates a progress log 402 including each record associated with the event occurrence time and the content of the event as text data.

As described above, the operator of the operation instruction device 300 can grasp the progress of the game being executed on the user terminal 100 by checking the progress screen 400.

Further, the progress simulation unit 315 may include the prediction result of predicting the future game development from the current game progress in the progress screen 400 based on the game program 131. The progress simulation unit 315 may display the prediction result superimposed on the simulation screen 401, may display the prediction result so as to be switched with the simulation screen 401, or display the prediction result side by side with the simulation screen 401. You may. Alternatively, the progress simulation unit 315 may additionally display the prediction result in the progress log 402. In this case, it is preferable that the progress simulation unit 315 displays the prediction result in a display mode different from that of the event that has already occurred, for example, in a different character color.

As a result, the operator of the operation instruction device 300 can give advice on the future based on the prediction result, in addition to making the character speak about the current situation according to the progress of the game on the user terminal. become. For example, in a competitive tennis game, suppose a user is playing a part that plays against a computer. In this case, progress information indicating that the ball has been hit back based on the input operation of the user is supplied from the user terminal 100 to the operation instruction device 300. Then, the progress simulation unit 315 can predict what kind of ball the computer will return next based on the game program 131, and can superimpose and display the return ball trajectory on the simulation screen 401. Upon seeing this, the operator can input a voice to advise the character, such as "Move to the right! Come here!", Or specify the position pointed to by "this". Further, for example, in the case of a battle board game such as shogi or Othello, the progress simulation unit 315 detects one move that the user is trying to point to based on the progress information, and if that one move is actually pointed. Predict the subsequent development of. If the progress simulation unit 315 determines that the one move is the one for which the defeat is confirmed, the progress simulation unit 315 may display a pop-up message to that effect on the simulation screen 401 or in another margin area of the progress screen 400. good. The operator who sees this can input a voice to advise the character, "You should stop there!".

It is assumed that the operation reception unit 311 accepts the operator's touch operation on the UI component 403 arranged on the progress screen 400 when the microphone 3010 input is disabled and the microphone is off. In this case, the character control unit 316 enables the input from the microphone 3010, acquires the voice data input via the microphone 3010, and includes it in the operation instruction data. It is assumed that the operation reception unit 311 accepts the operator's touch operation on the UI component 403 arranged on the progress screen 400 when the microphone 3010 input is enabled and the microphone is on. In this case, the character control unit 316 again invalidates the input from the microphone 3010.

As described above, after confirming the progress of the game, the operator determines the content of the utterance on the spot so as to match the progress, and outputs the voice data corresponding to the content of the utterance to the operation instruction device 300. Can be entered.

When the operation reception unit 311 receives a touch operation on the display area of the simulated screen 401 from the operator, the character control unit 316 identifies which object on the simulated screen 401 is designated by the touch operation, and the object is specified. Identification information of may be acquired. The character control unit 316 may store the identification information in the item of "attention point" of the operation instruction data. Alternatively, the character control unit 316 sets the first position coordinates of the above-mentioned touch operation on the touch screen 35 to the second position coordinates on the touch screen 15 of the user terminal 100 according to the specifications of the display unit 152 of the user terminal 100. Convert to. The character control unit 316 may store the second position coordinates for indicating the position of the operator's touch operation in the coordinate system of the display unit 152 in the item of "attention point" of the operation instruction data.

As described above, the operator confirms the progress of the game, inputs the voice data corresponding to the utterance content of the character so as to match the progress, and pays attention to the user at the same time as the utterance. You can specify the location.

(Game screen)
When the game progress unit 115 of the user terminal 100 receives the operation instruction data from the operation instruction device 300 while the game is in progress, the character specified by the operation instruction data is superimposed on the displayed game screen. The character is operated based on the operation instruction data. For example, it is assumed that the game progress unit 115 receives the operation instruction data while displaying the practice screen of the tutorial part. In this case, the game progress unit 115 superimposes the character 801 on the practice screen 800 displayed on the display unit 152. Then, the game progress unit 115 operates the character 801 based on the received operation instruction data.

FIG. 7 is a diagram showing an example of a game screen displayed on the display unit 152 of the user terminal 100. In FIG. 7, as an example of the game screen displayed on the display unit 152, the practice screen 800 displayed second in the tutorial part of this game is illustrated.

As an example, the layout of the practice screen 800 is almost the same as the layout of the battle screen displayed in the battle part. Specifically, the game progress unit 115 draws a court on the game space on the practice screen 800. Then, the game progress unit 115 arranges the player 802 operated by the user in front and the player 803 operated by the opponent (COM in the tutorial part) in the back. By operating the player 802 and playing the tutorial part while looking at the practice screen 800, the user can learn the operation method as if it were the actual performance in the battle part. The progress information generation unit 117 generates progress information in a timely manner while the game progress unit 115 is progressing the tutorial part, and transmits the progress information to the operation instruction device 300. For example, suppose that the rally continues, the skill gauge is accumulated, and the state of the player 802 changes to the state where the skill can be activated. At this time, the progress information generation unit 117 includes the progress log including the event that the skill activation button 804 has changed from the unusable state to the usable state in the progress information, and transmits the operation instruction device 300.

The game progress unit 115 does not have to display the character 801 until the operation instruction data is supplied from the operation instruction device 300. Alternatively, the pre-made operation instruction data supplied in advance when the application of this game is downloaded may be stored in the storage unit 120 together with the game program 131. In this case, the game progress unit 115 may operate the character 801 according to the game program 131 based on the pre-made operation instruction data read from the storage unit 120.

The operation instruction device 300 that has received the progress information from the user terminal 100 displays the progress information on the display unit 352 as the progress screen 400 shown in FIG. 6 described above. The operator who has confirmed the progress screen 400 can determine, for example, that the user should be advised to use the skill activation button 804. The operator or voice actor 701 inputs a voice 700 including advice according to the progress of the game to the operation instruction device 300 via the microphone 3010. Further, the operator or the model (person) 702 may input the movement of the character to the motion instruction device 300 via the motion capture device 3020, if necessary. Further, the operator may operate the simulated screen 401 via the touch screen 35 and specify a portion of the practice screen 800 that the user wants to pay attention to, if necessary. In this way, operation instruction data including at least voice data, motion capture data added as needed, and attention information is generated by the character control unit 316 and transmitted to the user terminal 100.

In the present embodiment, when the analysis unit 116 receives the operation instruction data from the operation instruction device 300, the game progress unit 115 uses the operation instruction data as a trigger to display the character 801 on the practice screen 800 based on the received operation instruction data. Superimpose. Then, the motion indicated by the motion capture data included in the motion instruction data is reflected in the motion of the character 801. As described above, the motion capture data is obtained by acquiring the movement of the model 702 via the motion capture device 3020 at the installation location of the motion instruction device 300. Therefore, the movement of the model 702 is directly reflected in the movement of the character 801 displayed on the display unit 152.

Further, the game progress unit 115 outputs the voice data 805 included in the operation instruction data supplied from the operation instruction device 300 as the voice emitted by the character 801 in synchronization with the movement of the character 801. The voice data is obtained by acquiring the voice 700 of the voice actor 701 through the microphone 3010 at the installation location of the operation instruction device 300. Therefore, the voice data 805 corresponding to the voice 700 emitted by the voice actor 701 is output as it is from the speaker of the user terminal 100.

Further, the game progress unit 115 highlights the part on the practice screen 800 pointed to by the attention information included in the above-mentioned operation instruction data. For example, when the attention information is the identification information pointing to the skill activation button 804 or the position coordinates where the skill activation button 804 is arranged, the game progress unit 115 highlights the skill activation button 804. For example, the game progress unit 115 changes the display mode of the skill activation button 804. As an example, the game progress unit 115 may change the color of the skill activation button 804, or may attach animations such as blinking, edging, and moving in small steps up, down, left, and right to the skill activation button 804.

Alternatively, the game progress unit 115 may superimpose the instruction object 806 that specifies the point of interest on the practice screen 800. Further, the game progress unit 115 may draw the instruction object 806 as an equipment of the character 801 and output an effect in which the character 801 uses the instruction object 806 to point to the skill activation button 804.

According to the above configuration, the voice of the voice actor 701 that actually exists at the installation location of the operation instruction device 300 is emitted according to the progress of the game on the user terminal 100, and it is directly reflected in the voice of the character 801. Similarly, the movement of the existing model 702 may be input to the operation instruction device 300 and supplied to the user terminal 100 together with the voice data. As a result, the character 801 can be moved according to the character 801 that speaks according to the progress of the game. Further, the simulated screen 401 may be operated by the operator via the touch screen 35 at the installation location of the operation instruction device 300. In this case, the part on the practice screen 800 that the user wants to pay attention to in relation to the utterance content of the character 801 can be transmitted from the operation instruction device 300 to the user terminal 100. As a result, the user can be notified of the point of interest on the practice screen 800 as the character 801 speaks according to the progress of the game.

While playing the game, seeing the character 801 behaving in line with the progress of the game, as described above, the user feels to the character 801 as if it were in the real world. be able to. Further, it can be felt as if the game is being played with the character 801 and, as a result, the user can enjoy the game even more.

Further, the game progress unit 115 may display the character 801 to be displayed during the progress of the game on the display unit 152 in a display mode according to the play results so far.

As an example, if the game progressing unit 115 has acquired an item (costume, accessory, or the like) that can be worn by the character 801 in the battle part or the lottery part that has been played so far. , The object of the item may be combined with the character 801. According to the above configuration, the item acquired by the user by playing the game can be reflected in the clothing item of the character 801. In addition, the user can consume valuable data (items, thrown money, etc.) purchased by virtual currency or billing that can be used in the game before, during, or after the game starts. You may.

As a result, the user can feel the attachment to the character 801 and enjoy the game even more. Further, the user's motivation to upgrade the clothing of the character 801 can be cultivated, and as a result, the motivation to play the game can be strengthened.

Further, in the present embodiment, the game progress unit 115 may be able to input a comment addressed to the character 801 in response to the operation of the character 801. As an example, the game progress unit 115 may arrange a comment input button 807 on the practice screen 800. The user touches the comment input button 807 to call a UI for inputting a comment, operates the UI, and inputs a comment addressed to the character 801. The UI may be for the user to select a desired comment from some prepared comments. The UI may be for the user to edit characters and enter comments. The UI may be for the user to input a comment by voice.

Alternatively, in a game such as a competitive tennis game, in which a user's input operation is always required for the progress of the game and the user cannot afford to perform an operation for inputting a comment. Even if the comment input button 807 is not provided, the user may always be configured to input voice.

According to the above configuration, the user can play the game in real time while enjoying interactive interaction with the character 801.

<Processing flow>
FIG. 8 is a flowchart showing a flow of processing executed by each device constituting the game system 1.

In step S101, when the game progress unit 115 of the user terminal 100 receives an input operation for starting a game from the user, it accesses the server 200 and requests login.

In step S102, the progress support unit 211 of the server 200 confirms that the status of the user terminal 100 is online, and responds that the login has been accepted.

In step S103, the game progress unit 115 advances the game according to the input operation of the user while communicating with the server 200 as necessary. For example, the game progress unit 115 advances a tutorial part, a battle part, or a lottery part.

In step S104, the progress support unit 211 supports the progress of the game on the user terminal 100 by providing necessary information to the user terminal 100 as needed.

At the live distribution time when the operation instruction data is live-distributed from the operation instruction device 300 to the user terminal 100 in step S105, the sharing support unit 212 of the server 200 proceeds from YES in step S105 to step S106. The live distribution time is, for example, predetermined by the game master and may be managed by the server 200 and the operation instruction device 300. Further, the live distribution time may be notified to the user terminal 100 in advance, or may be kept secret until the actual live distribution time is reached. In the former case, live distribution can be stably supplied to the user, and in the latter case, live distribution with special added value can be supplied to the user as a surprise distribution.

In step S106, the sharing support unit 212 searches for one or more user terminals 100 having the right to receive live distribution. The conditions for receiving live distribution may be set by the game master as appropriate, but at least the conditions are that the application of this game is installed and that the game is online at the time of live distribution. As an example in the present embodiment, the sharing support unit 212 has a user terminal 100 having the right to receive live distribution from a specific user terminal 100 that has been reserved in advance to receive live distribution at the above-mentioned live distribution time. Search as. Alternatively, the sharing support unit 212 may search for the user terminal 100 that is online at the time of the live distribution, that is, that is running the application of this game, as the user terminal 100 that has the right to receive the live distribution. .. Alternatively, the sharing support unit 212 may further add that the user terminal 100 is owned by the user who has paid the consideration for receiving the live distribution.

In step S107, the sharing support unit 212 notifies the operation instruction device 300 of one or more detected user terminals 100. For example, the sharing support unit 212 may notify the operation instruction device 300 of the terminal ID of the user terminal 100, the user ID of the user who is the owner of the user terminal 100, the address of the user terminal 100, and the like.

In step S108, the sharing support unit 212 notifies the user terminal 100 detected in step S106 of the operation instruction device 300 specified as the execution subject of the live distribution. The sharing support unit 212 may notify the user terminal 100, for example, the address or device ID of the operation instruction device 300.

On the other hand, in step S109, the character control unit 316 of the operation instruction device 300 proceeds from YES in step S108 to the processing after S111 when the live distribution time is reached. Alternatively, when the character control unit 316 receives the request to start the live distribution from the server 200 and the information about the user terminal 100 of the live distribution destination (after step S107), the character control unit 316 performs the processing after S111. You may start.

Note that live distribution may be configured to be started in response to a user's request. In this case, the user terminal 100 sends a request to the server 200 to request live distribution of the operation instruction data according to the input operation of the user. At this time, the server 200 returns a response to the user terminal 100 that the live distribution is possible if there is an operation instruction device 300 that can support the live distribution. In addition, the information of the device of the communication partner is notified to each of the user terminal 100 and the operation instruction device 300 for which matching is established.

In step S110, the progress information generation unit 117 of the user terminal 100 generates progress information and transmits it to the operation instruction device 300. The progress information generation unit 117 updates the progress log periodically or every time an event occurs while the game is progressing by the game progress unit 115 after step S103, and generates and transmits the progress information in a timely manner. ..

In step S111, the progress simulation unit 315 of the operation instruction device 300 simulates the progress of the game on the user terminal 100 on its own device based on the progress information. For example, the progress simulation unit 315 generates a progress screen 400 showing the progress of the game on the user terminal 100 based on the progress information, and displays it on the display unit 352. As an example, the progress simulation unit 315 arranges the progress log 402 included in the progress information on the progress screen 400 as shown in FIG. Further, the progress simulation unit 315 identifies the game screen being displayed on the user terminal 100 based on the screen ID included in the progress information, and arranges the simulation screen 401 of the game screen on the progress screen 400. Further, the progress simulation unit 315 may reproduce the dynamic object on the simulation screen 401 based on the attribute-related information of the dynamic object included in the progress information.

In step S112, the character control unit 316 receives the voice emitted by an actor such as a voice actor as voice data via the microphone 3010.

In step S113, the character control unit 316 acquires the motion input by the actor such as the model via the motion capture device 3020 as motion capture data.

In step S114, the character control unit 316 specifies a location on the game screen that the operator wants the user to pay attention to, based on the touch operation input by the operator via the input unit 351 of the touch screen 35.

Note that steps S112 to S114 may be executed in any order.

In step S115, the character control unit 316 generates operation instruction data. Specifically, the character control unit 316 identifies a character to be superimposed on the game screen of the user terminal 100, and stores the character ID of the character in the item of "character ID" of the operation instruction data. Which character is superimposed may be scheduled in advance by the game master and registered in the operation instruction device 300. Alternatively, the operator of the operation instruction device 300 may specify in advance to the operation instruction device 300 which character the operation instruction data should be created. The character control unit 316 stores at least the voice data acquired in step S112 in the “voice” item of the operation instruction data. If there is motion capture data acquired in step S113, the character control unit 316 stores the motion capture data in the “movement” item of the operation instruction data. It is preferable that the character control unit 316 associates the voice data with the motion capture data so that the voice data and the motion capture data are synchronized with each other. When there is a touch operation received in step S114, the character control unit 316 generates attention information based on the touch operation and stores it in the item of "attention point" of the operation instruction data. The character control unit 316 uses the group identification information of the group of these user terminals 100 so that the destination is one or more user terminals 100 notified by the server 200 in step S107, in the case of one user terminal. The address of 100 is stored in the "destination" item of the operation instruction data as the destination designation information.

In step S116, the character control unit 316 transmits the operation instruction data generated as described above to each user terminal 100 designated as a destination via the communication IF 33. The character control unit 316 acquires voice data and motion capture data obtained by the actor making a voice or moving, and immediately renders them into motion instruction data, and distributes them to each user terminal 100 in real time. Is desirable.

Note that steps S112 to S116 may be executed prior to step S111 after step S107.

In step S117, the analysis unit 116 of the user terminal 100 receives the above-mentioned operation instruction data via the communication IF 13. For example, the analysis unit 116 may receive the operation instruction data at a time previously announced to be live-streamed from the operation instruction device 300 or the server 200.

In step S118, the analysis unit 116 immediately analyzes the received operation instruction data by using the reception as a trigger.

In step S119, the game progress unit 115 superimposes the character specified by the operation instruction data analyzed by the analysis unit 116 on the game screen being displayed on the display unit 152, and superimposes the character on the operation instruction data. Operate based on. Specifically, the game progress unit 115 superimposes the character 801 on the place where the practice screen 800 and the like shown in FIG. 7 are displayed on the display unit 152. The game progress unit 115 practices the voice and movement in real time almost at the same time as the actors such as the voice actor 701 and the model 702 make a voice or move at the place where the operation instruction device 300 is installed. It is reflected in the speech and movement of the character 801 in 800. The analysis unit 116 and the game progress unit 115 continue rendering and reproducing the real-time moving image while continuously receiving the operation instruction data from the operation instruction device 300. Specifically, the game progress unit 115 does not accept any input operation from the user, and while the operation instruction data is received, returns from NO in step S120 to step S103, and repeats the subsequent steps.

If the operation receiving unit 111 receives an input operation from the user while the character is operating based on the operation instruction data in step S120, the game progressing unit 115 proceeds from YES in step S120 to step S121. For example, the operation reception unit 111 accepts an input operation for the comment input button 807 on the practice screen 800.

In step S121, the game progress unit 115 transmits the comment data generated in response to the above-mentioned input operation to the operation instruction device 300. Specifically, the game progress unit 115 may transmit the comment ID of the selected comment as comment data. Alternatively, the game progress unit 115 may transmit the text data of the text input by the user as comment data. Alternatively, the game progress unit 115 may transmit the voice data of the voice input by the user as comment data. Alternatively, the game progress unit 115 may recognize the voice input by the user, convert it into text data, and transmit it as comment data.

In step S122, the reaction processing unit 317 of the operation instruction device 300 receives the comment data transmitted from the user terminal 100 via the communication IF 33.

In step S123, the reaction processing unit 317 outputs the received comment data to the operation instruction device 300. For example, the reaction processing unit 317 displays the text data included in the comment data on the display unit 352. This allows the operator or actor to receive feedback on how the user responded to the character they moved. The operator or actor can then determine further character actions in response to this feedback. That is, the operation instruction device 300 returns to step S112, continues to acquire voice data and motion capture data as needed, and continues to provide operation instruction data to the user terminal 100. The user terminal 100 receives the operation instruction data transmitted from the operation instruction device 300 after the content of the input operation in the own terminal is received by the operation instruction device 300. Specifically, the user terminal 100 receives voice data corresponding to the content of the character's speech, motion capture data corresponding to the movement of the character, and the like, and operation instruction data. Then, the user terminal 100 continuously operates the character based on the operation instruction data. As a result, it is possible for the user to experience real-time interactive interaction with the character. Instead of the motion capture data, the user terminal 100 may receive a motion command group in which one or more commands instructing the operation of the character are arranged in the order instructed by the operator of the operation instruction device 300. The motion command group is also associated with the voice data in synchronization with the motion capture data. As a result, the game progress unit 115 of the user terminal 100 can move the character according to the motion command group in accordance with the utterance of the content of the voice data.

[Embodiment 2]
In the present embodiment, the operation instruction device 300 communicates with a plurality of user terminals 100 participating in the multiplayer game, and grasps the progress of the game in each user terminal 100 based on the progress information of each user terminal 100. Then, the operation instruction device 300 generates operation instruction data for causing the character to behave according to the overall progress, and distributes the operation instruction data to each user terminal 100.

The game executed in the game system 1 according to the present embodiment (hereinafter, this game) is, for example, a car racing game in which a plurality of users operate their respective vehicles to go around the same course and compete for their time. be.

The progress simulation unit 315 of the motion instruction device 300 according to the present embodiment acquires progress information from each of the plurality of user terminals 100 participating in the same race. The progress simulation unit 315 may acquire integrated progress information indicating the progress of the entire race from the server 200 that supports the progress of the race and performs synchronization control. The progress simulation unit 315 may arrange the acquired progress information for each user side by side on the progress screen, or may integrate the progress information and arrange the overall progress obtained by the integration on the progress screen. .. Alternatively, the progress simulation unit 315 may arrange the already integrated progress information received from the server 200 on the progress screen.

The character control unit 316 distributes the operation instruction data generated as described above to a plurality of user terminals 100 participating in the same race.

In the present embodiment, the progress information individually for each user terminal 100 is, for example, "user ID", "user name", "current position", "rank", "lap", and "time (difference from the top)". Each item of may be included. Also, the integrated progress information generated by the server 200 may include items such as "elapsed time", "top lap", "course map" and "current position of each race car".

<Screen example>
(Progress screen)
FIG. 9 is a diagram showing another example of the progress screen displayed on the display unit 352 of the operation instruction device 300. In the present embodiment, the progress simulation unit 315 integrates the progress information acquired from each user terminal 100, and displays the progress screen 500 on the display unit 352.

The progress screen 500 includes, as an example, the integrated progress diagram 501, the individual progress list 502, and the integrated progress information 503. Further, the progress screen 500 may include a UI component 403 for the operator (or voice actor) to input voice data to the own device via the microphone 3010.

The progress simulation unit 315 analyzes the progress information acquired from the user terminal 100 and the server 200. Based on the analysis result, the progress simulation unit 315 specifically generates the integrated progress diagram 501 as follows. The progress simulation unit 315 draws a course map based on the information of the "course map" included in the integrated progress information, and each user operates based on the information of the "current position of each race car". The race car objects are plotted on the above course map.

Further, the progress simulation unit 315 generates an individual progress list 502 as follows. The progress simulation unit 315 extracts each item of "user name", "rank", "lap", and "time" from the individual progress information. Then, the information of each item is arranged so that each extracted item is listed for each user, and the individual progress list 502 is generated.

The progress simulation unit 315 may extract the item of "top lap" from the integrated progress information and reflect this in the integrated progress information 503.

As described above, the operator of the operation instruction device 300 can grasp the whole picture of the progress of the game being executed by the plurality of user terminals 100 by checking the progress screen 500.

Note that the progress screen 500 may be provided with a UI component 403. As a result, the operator confirms the overall progress of the game, determines the content of the utterance on the spot so as to match the progress, and transfers the voice data corresponding to the content of the utterance to the operation instruction device 300. You can enter it.

(Game screen)
FIG. 10 is a diagram showing an example of a game screen displayed on the display unit 152 of the user terminal 100. In FIG. 10, as an example of the game screen displayed on the display unit 152, the race screen 600 displayed during the progress of the race in this game is shown. Further, the race screen 600 shows, as an example, a screen displayed on the user terminal 100 of the user running at the top of the race.

The game progress unit 115 draws a course on the game space on the race screen 600, for example. Then, the game progress unit 115 arranges a race car operated by the user. If the race car operated by another user fits in the angle of view due to the positional relationship with the virtual camera position in the game space, the game progress unit 115 arranges the race car of the other user on the race screen 600. You may.

The progress information generation unit 117 generates progress information in a timely manner while the game progress unit 115 is proceeding with the race, and transmits the progress information to the operation instruction device 300.

The operation instruction device 300, which receives individual progress information from each user terminal 100 participating in the race and receives integrated progress information from the server 200 that synchronizes the race, may use these progress information as it is or The processed product is displayed on the display unit 352 as the progress screen 500 shown in FIG. The operator who confirms the progress screen 500 can grasp the situation of the race and determine the actual situation. The operator or the voice actor 701 inputs a voice including a live commentary suitable for the race development to the operation instruction device 300 via the microphone 3010. Further, the operator or the model 702 may input the movement of the character to the operation instruction device 300 via the motion capture device 3020, if necessary.

In the present embodiment, when the analysis unit 116 receives the operation instruction data from the operation instruction device 300, the game progress unit 115 uses the operation instruction data as a trigger to display the character 601 on the race screen 600 based on the received operation instruction data. Superimpose. For example, it is preferable that the area on which the character 601 can be superimposed is predetermined for each game screen in a place that does not interfere with the user's play. Then, the motion indicated by the motion capture data included in the motion instruction data is reflected in the motion of the character 601. Similar to the first embodiment, the motion capture data is obtained by acquiring the movement of the model 702 via the motion capture device 3020 at the installation location of the motion instruction device 300. Therefore, the movement of the model 702 is directly reflected in the movement of the character 801 displayed on the display unit 152.

Further, the game progress unit 115 outputs the voice data 602 included in the operation instruction data supplied from the operation instruction device 300 as the voice emitted by the character 601 in synchronization with the movement of the character 601. Similar to the first embodiment, the voice data is obtained by acquiring the voice of the voice actor 701 through the microphone 3010 at the installation location of the operation instruction device 300. Therefore, the voice data 602 corresponding to the voice emitted by the voice actor 701 is output as it is from the speaker of the user terminal 100.

The operation instruction device 300 can transmit the above-mentioned operation instruction data to all the user terminals 100 participating in the game. Therefore, the character 601 is superimposed and displayed together with the race screen 600 on each of the display units 152 of the participating user terminals 100.

According to the above configuration, the present invention can be applied even in a multiplayer game in which a plurality of user terminals 100 participate.

[Embodiment 3]
In the present embodiment, in particular, even after the real-time live distribution is once completed, the user requests the progress of the completed live distribution part, and the live distribution part is re-progressed based on the received operation instruction data. Can be made to. As a result, the user can look back at the live stream again, and even if he / she misses it, he / she can watch the live stream again. In the following, the scene after the end of the live distribution time is assumed. Further, the character here is assumed to be a character (including an avatar object) that is not a target of direct operation by the user. The "live distribution part" mainly includes the above-mentioned battle part, but may further include a lottery part and a tutorial part (the same applies hereinafter).

<Processing overview>
In the present embodiment, the user terminal 100 is configured to execute the following steps in order to improve the interest of the game based on the game program 131. Specifically, the user terminal 100 (computer) has been completed from the step of requesting the progress of the completed live distribution part and the operation instruction device 300 from the server 200 or the operation instruction device 300, for example, via an operation unit such as an input unit 151. The step of receiving the recorded operation instruction data related to the live distribution part of the above, and the step of advancing the completed live distribution part by operating the character based on the recorded operation instruction data are executed. Here, the recorded action instruction data includes motion data and voice data input by the operator associated with the character. The operator includes not only the model and the voice actor but also the operator who performs some operation on the operation instruction device 300, but does not include the user. The recorded operation instruction data is often stored in the storage unit 220 of the server 200 or the storage unit 320 of the operation instruction device 300, and is delivered to the user terminal 110 again in response to a request from the user terminal 100. It is good to do it.

In the present embodiment, it is preferable that the progress of the completed live distribution part based on the recorded operation instruction data is different depending on the result of whether or not the user has progressed the live distribution part in real time. Specifically, when it is determined that the user has a track record of advancing the live distribution part in real time, the same live distribution part as the user has advanced the live distribution part in real time is advanced again. Is good (return delivery). In return delivery, it is better to perform a selective progression of the live delivery part. On the other hand, when it is determined that the user has no record of progressing the live distribution part in real time, it is preferable to proceed with the live distribution part having a progress mode different from that progressed in real time (missed distribution). Here, if it is determined that there is no track record in the overlooked distribution, for example, the user has the right to receive the live distribution, and if the user has the live distribution time, the real-time live distribution part can proceed. Nevertheless, this includes cases where this was not actually done. For missed deliveries, it's a good idea to perform a limited progression of the live stream part.

<Functional configuration of system 1>
When it is determined that the user has a track record of advancing the live distribution part in real time in the user terminal 100 according to the present embodiment, the game progress unit 115 further receives the user action history information in the live distribution part. To analyze. The user action history information is a data set of user actions recorded by an input operation during the progress of the live distribution part, in addition to the contents of the recorded action instruction data. The user action history information is often associated with the recorded operation instruction data, and is preferably stored in the storage unit 220 of the server 200 or the storage unit 320 of the operation instruction device 300. In addition to or instead of this, the user behavior history information may be stored in the storage unit 120 of the user terminal 100.

FIG. 11 is a diagram showing an example of a data structure of user behavior history information. The user action history information includes, for example, items such as action time, action type, and action details in which the user has acted in the live distribution part, and is associated with a user ID that identifies the user. The item "behavior time" is the time information in which the user performed an action in the live distribution part, the item "behavior type" is a type indicating the user's action, and the item "behavior details" is the specific action of the user. Content. For example, for an action specified by the items "behavior type" and "behavior details", consumption of valuable data by a user's input operation (for example, input of a thrown item and billing by purchasing an item, etc.), comment input, In addition, actions such as changing items (so-called dress-up) such as clothing of the character may be included. Such actions may also include time selection for later playback of a particular progress portion of the livestreaming part. In addition to this, such actions may include the acquisition of rewards, points, etc. during the live distribution part. The user action history information is preferably associated with each other between the data structure of the action instruction data and the data structure of the game information described later in FIG. It should be understood by those skilled in the art that these data structures are merely examples and are not limited thereto.

FIG. 12 is a diagram showing an example of the data structure of the game information 132 processed by the system 1 according to the present embodiment. The items provided in the game information 132 are appropriately determined according to the genre, nature, content, etc. of the game, and the exemplary items do not limit the scope of the present invention. As an example, the game information 132 may be configured to include each item of "play history", "item", "delivery history", and "game object". Each of these items may be appropriately referred to when the game progress unit 115 advances the game.

The user's play history is stored in the item "play history". The play history is information indicating whether or not the user's play is completed for each scenario stored in the storage unit 120. Here, the scenario is, for example, a unit of distribution of a video (for example, a tutorial, a game, a lottery, etc. in each game part), or a part or all of a video to be played in a retrospective distribution or a missed distribution described later (for example, execution of playback). (Each unit) may be used as the unit. Further, for example, the play history may include a list of fixed scenarios downloaded at the first time of play and a list of acquired scenarios acquired later. In each list, statuses such as "played", "unplayed", "playable", and "unplayable" are associated with each scenario.

The item "item" stores a list of items owned by the user as a game medium. In this game, the item is, for example, a clothing item worn by a character. The user can make the character wear the clothing items obtained by playing the scenario and customize the appearance of the character.

The item "Distribution history" stores a list of videos, so-called back numbers, that were live-distributed by the operator in the past in the live distribution part. In the live distribution part, the video that is PUSH-distributed in real time can be viewed only at that time. On the other hand, the moving images for past distribution are recorded by the server 200 or the operation instruction device 300, and can be PULL distributed in response to a request from the user terminal 100. In the present embodiment, as an example, the back number may be made available for download by the user for a fee.

The item "game object" stores data of various objects that appear in the live distribution part such as character 801 and enemy objects and obstacle objects in the battle game.

<Processing flow>
FIG. 13 is a flowchart showing an example of a basic game progress of a game executed based on the game program according to the present embodiment. The processing flow is applied to the scenes after the end of the live distribution time when the real-time live distribution part has already been completed.

In step S301, the operation unit of the user terminal 100 newly requests the progress of the completed live distribution part. In step S302, in response to the request in step S301, the user terminal 100 receives the recorded operation instruction data related to the completed live distribution part from the server 200 or the operation instruction device 300.

The recorded action instruction data includes motion data and voice data input by the operator associated with the character. In addition to the recorded operation instruction data, the user terminal 100 may receive various progress record data acquired and recorded along with the movement of the character during the progress of the real-time live distribution part. Specifically, the progress record data may include viewer behavior data in which the user who participated in the real-time live distribution part behaves in accordance with the movement of the character. The viewer behavior data is data including a record of the behavior during the live of all the users (that is, the viewers who participated in the live) who have advanced the real-time live distribution part in real time. In particular, the viewer behavior data should include messaging content such as text messages and icons sent by the viewer to the character in real time during the live performance. In this way, by advancing the completed live distribution part using the progress record data, it is possible to faithfully reproduce the reaction of the viewer in the live distribution part that has progressed in real time, and it is possible to faithfully reproduce the reaction of the viewer in the live space in real time. The sense of presence can be further improved. The viewer behavior data may be, for example, the user behavior history information shown in FIG.

Note that the recorded operation instruction data and progress record data may be received by the user terminal 100 as separate data, and each may be analyzed (rendered). Alternatively, in the server 200 or the operation instruction device 300, the previously recorded operation instruction data and the viewer behavior data may be combined, and the combined data set may be received by the user terminal 100 at one time. By receiving the combined data set, it is possible to reduce the load of subsequent data analysis (rendering) by the user terminal 100. In the following description, it is assumed that the progress record data is combined with the recorded action instruction data (that is, the recorded action order data includes the progress record data).

Next, in step S303, the game progress unit 115 determines whether or not the user has a track record of progressing the live distribution part in real time. The determination may be performed, for example, based on whether there is a record in which the action instruction data has been sent to the user terminal 100. Alternatively, even if the live distribution part is executed based on whether the status is "played" by referring to the item "play history" shown in FIG. 12, the item "distribution history" is also referred to. It may be executed based on whether or not there is a record of live distribution from the character in the past. In addition to this, when the operation instruction data already recorded is stored in the storage unit 120 of the user terminal 100, it may be determined that the live distribution part has already been advanced in real time. In addition, the determination may be performed by combining them, or by any other method.

If it is determined in step S303 that the user has a track record of advancing the live distribution part in real time (YES), the progress of the completed live distribution part is "return distribution". On the other hand, when it is determined in step S303 that the user has no record of advancing the live distribution part in real time (NO), the progress of the completed live distribution part is "missed distribution". As mentioned above, the user experience is different between "return delivery" and "missed delivery".

If it is determined in step S303 that the user has a track record of advancing the live distribution part in real time, the processing flow proceeds from YES in step S303 to step S304. In step S304, the game progress unit 115 acquires the user action history information of the live distribution part shown in FIG. 11 and analyzes it. The user action history information may be acquired from the server 200 or the operation instruction device 300, or may be used directly when it is already stored in the storage unit 120 of the user terminal 100.

(Endpaper delivery)
Subsequently, in step S305, the game progress unit 115 re-progresses the completed live distribution part (that is, the above-mentioned “return distribution”). Specifically, the recorded operation instruction data and the user action history information analyzed in step S304 are used to re-progress the live distribution part.

In the endpaper distribution, it is better to give the user the choice of costumes to be worn by the character, as in the live distribution part. For example, the user may be able to select from one of the costumes assigned below the ranking band associated with the user. As a result, in the return delivery, it is possible to provide a large number of costume options to high-ranked users.

Furthermore, in the return distribution, the throwing item input in the real-time live distribution part may be reflected in the movement mode of the character. For example, if the user has acquired it as a clothing item (here, a "necklace"), the character is operated based on the item (that is, wearing a necklace). As a result, the live distribution part may be re-progressed. That is, the re-progress of the real-time live distribution part reflects the user behavior history information and the reward information, is similar to the live distribution part that has progressed in real time, and is unique to the user. ..

Also, in the return distribution, the live distribution part will be re-progressed. At this time, it is preferable to selectively execute the live distribution part according to the time information specified by the user's input operation via the operation unit recorded at the time of the first progress. Specifically, by using the data of "action time" included in the user action history information described with reference to FIG. 11, the user specifies a specific action time, and the live distribution part is selectively advanced from there. Can be made to. For example, if the user inputs a comment 2 minutes and 45 seconds after the start of the live distribution part, the user can advance the live distribution part again by specifying the timing after 2 minutes and 45 seconds. .. In addition to the above-mentioned record of comment input, such re-progress is "action time" corresponding to the consumption of valuable data by the user's input operation and the record of actions such as change of items such as character's clothing. It is better to make it feasible based on.

Further, in the return distribution, if the user has selected a specific progress part by an input operation during the execution of the live distribution part that has progressed in real time, only the selected specific progress part is selected in the re-progress of the live distribution part. Can be selectively advanced. As a result, the user can efficiently play back only the specific progress part of the live distribution part later. Specifically, when the user selects a specific progress part and a record of such an action is registered in the user action history information, the live distribution part is selectively progressed by using the data of the action time. Can be made to. For example, if the user has selected a period of 2 minutes 45 seconds to 5 minutes 10 seconds from the start of the live distribution part, the user can re-progress the live distribution part over that period.

(Missed delivery)
Returning to FIG. 13, if it is determined in step S303 that the user has no record of advancing the live distribution part in real time, the processing flow proceeds from NO in step S303 to step S306. In step S306, the game progress unit 115 executes a limited progress (that is, the above-mentioned "missed distribution") of the completed live distribution part. The reason why the missed delivery is restricted is that the user has the right to receive the live stream, but it can be considered that he has waived this right, so not all of the live stream is necessarily limited. Based on the idea that it is not necessary to reproduce and present it to the user.

Specifically, in the overlooked distribution, the progress of the live distribution part is executed using the recorded operation instruction data. As mentioned above, if the user had acquired a clothing item (eg, a "necklace"), the live distribution part progressed in real time would image-synthesize the item so that it would be worn and acted upon by the character (ie,). The character is wearing a necklace or other clothing item). That is, in the real-time live distribution part, the movement mode of the character was associated with clothing items. However, in the overlooked distribution, unlike the live distribution part that progresses in real time, clothing items and the like are not associated with the movement mode of the character. That is, the image composition process is not performed so that the character wears the item and operates. The progress of the completed live distribution part is limited in that it does not reflect information such as clothing items and is not unique to the user.

According to the above-mentioned configuration and method, in the return distribution, the thrown money item input in the real-time live distribution part can be reflected in the movement mode of the character. On the other hand, in the missed delivery, the thrown item thrown in the real-time live delivery part is not reflected in the operation mode of the character (however, the thrown item thrown by another viewer user who was watching the live stream in real time is missed. It may be reflected in the movement mode of the character in the distribution). In other words, in the retrospective distribution (viewing real-time live distribution in the past), it is possible to distribute an image that is more interesting than the overlooked distribution. Therefore, it is possible to give the user an incentive to watch the retrospective distribution rather than the overlooked distribution, and as a result, guide the user to the real-time live distribution.

Also, in the overlooked distribution, unlike the live distribution part that progressed in real time, it is better to limit the actions of the users that can be accepted. Specifically, in the live distribution part that progressed in real time, it was possible to accept the consumption of valuable data by the user's input operation (in one example, throwing money, charging by purchasing items, etc.). On the other hand, in the progress of the completed live distribution part, the consumption of such valuable data may be restricted so as not to be accepted. More specifically, in a live delivery part progressed in real time, a user interface (UI) including buttons and screens for executing the consumption of valuable data is displayed on the display unit 352, and the user can use such a UI. It is assumed that the consumption of valuable data can be executed through the input operation of. On the other hand, in the overlooked delivery, such a UI should be hidden so that the user cannot explicitly perform an input operation. As a result, in the return delivery and the overlooked delivery, the user 3 cannot throw in a tossed item or the like for supporting the character.

Furthermore, in the return distribution and the overlooked distribution, the user can participate in the live distribution part, etc. in a pseudo manner, as in the live distribution part, etc., which progresses in real time. The live distribution part and the like include, but are not limited to, user-participatory events as described in

embodiments

1 and 2, and the user is provided with an interactive experience with the character. Examples of user-participatory events include games such as

embodiments

1 and 2, questionnaires provided by characters, quizzes given by characters, battles with characters (eg, rock-paper-scissors games, bingo games), and the like. sell. Then, as in the case of live distribution in real time, the participation result of such a user participation type event is fed back to the user in the overlooked distribution. For example, in the return delivery, when the user participates in and answers the event of the four-choice quiz given by the character, the result of the correctness determination is fed back to the user. (However, if a user who did not participate in the live in real time answered a questionnaire or quiz in the missed delivery, or if a feedback delivery that participated in the live in real time gave a different answer than during the live participation, these users Although the content of the answer is not reflected, the program may automatically make only a simple judgment (correctness judgment, etc.) and give feedback.) Also, in the return delivery, the user is different from the one during live participation. When an answer is given, a display such as "The answer is different from that during the live" may be displayed and output to the user terminal by comparing with the answer of the user who is participating in the live.

Further, in the overlooked distribution, unlike the live distribution part that progresses in real time, the user may be restricted from earning a predetermined game point for the above feedback. Specifically, in a live distribution part that progresses in real time, as a result of the user playing a specific scenario, predetermined game points may be associated with the user and added to the points owned by the user. On the other hand, in the progress of the completed live distribution part, such points may not be associated with the user. As a result of not adding the points owned by the user, for example, in the case of a game in which a plurality of users who are game players are ranked based on the points, when the user advances the completed live distribution part, this is the case. It will not affect the ranking.

After the end of the return distribution (step S305) or the overlooked distribution (step S306), the user terminal 100 may request the progress of the completed live distribution part again. That is, it is preferable that the return delivery or the missed delivery can be repeatedly executed a plurality of times. In this case, the processing flow returns to step S301.

According to the above configuration and method, in the user terminal 100, even after the live distribution part has progressed in real time, the user can proceed with the live distribution part again in various modes. As a result, the user feels more attached to the character through the experience of interacting with the character in a rich sense of reality, so that another part that operates the character can be played with even more interest. .. As a result, it has the effect of increasing the immersive feeling of the game and improving the interest of the game.

<Modification 1>
In the third embodiment, whether the progress of the completed live distribution part is a return distribution or a missed distribution is determined based on whether or not the user has a track record of advancing the live distribution part in real time. (Step S303 in FIG. 13). On the other hand, in the first modification of the present embodiment, the user may be configured to select the return delivery or the overlooked delivery. Alternatively, regardless of the presence or absence of the above-mentioned achievements, only the overlooked distribution may be provided to the user.

<Modification 2>
In the third embodiment, after the end of the return distribution (step S305 in FIG. 13) or the missed distribution (step S306 in FIG. 13), the progress of the completed live distribution part may be requested again. That is, the return delivery or the missed delivery could be repeatedly executed a plurality of times. In the second modification, it is preferable that the second and subsequent return delivery or missed delivery correspond to the record of the previous return delivery or missed delivery.

When the first return distribution or the overlooked distribution is performed, the first distribution history data may be stored in the storage unit 220 of the server 200 or the storage unit 320 of the operation instruction device 300. After that, when the recorded operation instruction data related to the completed live distribution part is requested again from the user terminal 100, the first distribution history data from the server 200 or the operation instruction device 300 is the recorded operation instruction data. Delivered with. In the user terminal 100, the received first delivery history data is referred to, and if the first return delivery or the missed delivery is performed halfway, the user terminal 100 will perform the second return delivery or the second return delivery from the continuation. Resume the progress of overlooked delivery. As a result, the user can efficiently perform return delivery or missed delivery.

If the first delivery is a return delivery, the return delivery should be executed from the second time onward, and if the first delivery is a missed delivery, the missed delivery should be executed from the second time onward. Further, when the recorded operation instruction data already exists in the user terminal 100, the user terminal 100 may not receive the recorded operation instruction data again. As a result, the amount of data received by the user terminal 100 can be saved.

<Modification 3>
In the third embodiment, whether the progress of the completed live distribution part is a return distribution or a missed distribution is determined according to the actual result of the user advancing the live distribution part in real time (). Step S303 in FIG. 13). In the third modification, when it is determined that the user has progressed the live distribution part halfway in real time, it is preferable to restart the progress of the completed live distribution part from the continuation. The record of how far the user has advanced the live distribution part in real time can be determined from the user behavior history information described above in FIG. That is, the user behavior history information may record how long the user has progressed with respect to a specific live distribution part. Although not limited to this, the resumption of the completed live distribution part should be a missed distribution, which is a limited progress. As a result, the user can efficiently execute the overlooked delivery.

<Example of display screen of user terminal 100>
FIG. 14 shows an example of a screen displayed on the display unit 152 of the user terminal 100 based on the game program according to the present embodiment, and an example of a transition between these screens. Examples of screens include a home screen 800A, a live selection screen 800B for live distribution, and a missed selection screen 800C for missed distribution. In the transition example, the transition from the home screen 800A to the live selection screen 800B is possible. Further, the live selection screen 800B can be transitioned to the home screen 800A and the overlooked selection screen 800C. Similarly, it is possible to transition from the overlooked selection screen 800C to the live selection screen 800B. The actual distribution screen (not shown) is transitioned from the live selection screen 800B and the overlooked selection screen 800C.

(Home Screen)
The home screen 800A displays various menus for advancing the live distribution part on the display unit 152 of the user terminal 100. When the game progress unit 115 receives an input operation for starting the game, the game progress unit 115 first displays the home screen 800A. Specifically, the home screen 800A includes a "live" icon 802 for transitioning to the live selection screen 800B. Upon receiving an input operation for the "live" icon 802 on the home screen 800A, the game progress unit 115 causes the display unit 152 to display the live selection screen 800B.

(Live selection screen)
The live selection screen 800B presents live information that can be distributed to the user. In particular, a list of one or more live notification information for notifying the user of the live distribution time and the like in advance is displayed. The live announcement information includes at least the live delivery date and time. Further, the live announcement information may include free / paid live information, an advertisement image including an image of a character appearing in the live, and the like. Further, the live selection screen 800B may display the notification information regarding the live distribution to be distributed in the near future on the live selection screen on the pop-up screen 806.

At the live distribution time, the server 200 searches for one or more user terminals 100 having the right to receive the live distribution. The right to receive livestreaming is conditioned on the fact that the consideration for receiving livestreaming has been paid (for example, holding a ticket). The corresponding live notification information will be displayed on the user terminal 100 having the right to receive the live distribution.

The user terminal 100 accepts a live playback operation, for example, a selection operation for a live at the live distribution time on the live selection screen 800B (more specifically, a touch operation for a live image). Accordingly, the game progress unit 115 shifts the display unit 152 to the actual distribution screen (not shown). As a result, the user terminal 100 can advance the live distribution part and advance the live viewing process in real time. When the live viewing process is executed, the game progress unit 115 operates the character in the live distribution part based on the received operation instruction data. The game progress unit 115 generates a moving image reproduction screen including a character that operates based on the operation instruction data in the live distribution part, and displays it on the display unit 152.

Further, the live selection screen 800B has a "return (x)" icon 808 for transitioning to the screen displayed immediately before and a "missing delivery" icon 810 for transitioning to the missed selection screen 800C on the display unit 152. It may be displayed. Here, the game progress unit 115 shifts the screen 800B to the home screen 800A in response to an input operation for the “return (x)” icon 808 on the live selection screen 800B. On the other hand, for the input operation for the missed distribution icon 810 on the live selection screen 800B, the game progress unit 115 shifts to the missed selection screen 800C on the screen 800B.

(Missing selection screen)
The overlook selection screen 800C displays the delivered information related to one or more live delivered in the past, in particular, the delivered information that the user has not actually advanced the live delivery part in real time. When the operation unit of the user terminal 100 receives an input operation for the live distribution information displayed on the overlook selection screen 800C, for example, the image 830 including the character appearing in the live, the game progress unit 115 receives the input operation for the image 830, and the game progress unit 115 finishes the live distribution part. You can proceed with the livestreaming part that has already been completed.

As shown in the example of the overlook selection screen 800C, the delivered information about the live is further delivered with the playback time 812 of each delivered live, the period until the end of delivery (days, etc.) 814, and how many days before the present. It may include information 816 indicating whether or not it has been done, a past delivery date and time, and the like. Further, the overlooked selection screen 800C includes a “back (<)” icon 818 for transitioning to the live selection screen 800B. In response to the input operation for the "return (<)" icon 818, the game progress unit 115 transitions to the live selection screen 800B.

In the present embodiment, the overlooked selection screen 800C is not limited to this, but it is preferable that the transition is made only from the live selection screen 800B and not directly from the home screen 800A. The missed distribution is performed for the user who missed the live distribution, and is only a function accompanying the live distribution function. In addition, one of the purposes of this game is to enhance the fun of the game by allowing the user to watch the live stream in real time, support the character in real time, and deepen the interaction with the character. Therefore, in order to guide the user to watch the live distribution in real time rather than the overlooked distribution in which real-time interaction with the character (operator) is not possible, here, the overlooked selection screen 800C cannot be directly transitioned from the home screen 800A. It is better to do so.

In addition, on the overlooked selection screen 800C, the delivered information that the user has not made the live delivery part in real time is displayed. Instead of this, the delivered information about all the live delivered in the past may be displayed in a list for each live. In this case, it is preferable that either the return distribution or the overlooked distribution is executed depending on whether or not the user has progressed the live distribution part in real time. Specifically, when it is determined that the user has a track record of advancing the live distribution part in real time, the above-mentioned return distribution is performed. On the other hand, if it is determined that the user has no record of advancing the live distribution part in real time, the distribution will be overlooked. As described above with respect to FIG. 13, different user experiences can be provided between the look-back delivery and the missed delivery.

[Example of implementation by software]
Control of the control block of the control unit 110 (particularly, the operation reception unit 111, the display control unit 112, the UI control unit 113, the animation generation unit 114, the game progress unit 115, the analysis unit 116 and the progress information generation unit 117), and the control unit 210. Blocks (particularly progress support unit 211 and shared support unit 212), and control blocks of control unit 310 (particularly, operation reception unit 311, display control unit 312, UI control unit 313, animation generation unit 314, progress simulation unit 315). , Character control unit 316 and reaction processing unit 317) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or by software using a CPU (Central Processing Unit). You may.

In the latter case, the control unit 110, the control unit 210 or the control unit 310, or an information processing device including a plurality of these units is a CPU that executes instructions of a program that is software that realizes each function, the above program, and various types. It is equipped with a ROM (Read Only Memory) or storage device (these are referred to as "recording media") in which data is readablely recorded by a computer (or CPU), a RAM (Random Access Memory) for expanding the above program, and the like. .. Then, the object of the present invention is achieved by the computer (or CPU) reading the program from the recording medium and executing the program. As the recording medium, a "non-temporary tangible medium", for example, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, the program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. It should be noted that one aspect of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present invention.

[Additional notes]
The contents relating to one aspect of the present invention are listed below.

(Item 1) The method was explained. According to certain aspects of the present disclosure, a method is a method performed by a computer as a user terminal comprising a processor, memory, display and operation unit, wherein the user terminal is physical with respect to the space in which the user terminal resides. An external device that exists in a distant space and is different from the user of the user terminal, and plays the character at least one character appearing in the game in a space invisible to the user. It is configured to be able to communicate with the external device to be controlled via the network, and the method is to proceed with the game according to the user's input operation input to the computer via the operation unit by the processor, and to the external device. As information indicating the progress of the game, progress information for making it possible to display a game screen of the game in progress, including a screen displayed on the display unit or a simulated screen that simplifies the screen. It is audio data acquired by an external device that displays the game screen of the game in progress in real time so that the performer can see it based on the step of sequentially transmitting and the progress information transmitted sequentially, and is real-time from the performer. The step of receiving the voice data of the voice that is emitted at an arbitrary timing with respect to the game screen displayed on the computer and cannot be heard directly by the user from the external device and the reception of the voice data as a trigger are used as a trigger. A step of operating the character by having a character appearing during the progress of the game speak at least the content of the voice data, and an external request for viewing the progressed game after the end of the game. It includes a step of reactivating the character based on the voice data received again.

(Item 2) In (Item 1), the receiving step is to receive the motion data input by the performer who plays the character in the external device together with the voice data from the external device, and the step to operate the character is the content of the voice data. The step of moving the character according to the motion data and re-moving the character in accordance with the speech data causes the character to re-operate based on the motion data in addition to the voice data.

(Item 3) In (Item 1) or (Item 2), the step of reactivating the character is executed based on the record of the action by the user's input operation.

(Item 4) In (Item 3), the action record includes the time information, and the step of operating the character again follows the designation of the time information by the user's input operation via the operation unit while the game is in progress.

(Item 5) In (Item 3) or (Item 4), in a step in which the action includes selection of a specific progress part by a user's input operation via an operation unit while the game is in progress, and causes the character to operate again. Only the selected specific progress part is progressed.

(Item 6) In any one of (Item 3) to (Item 5), the recording of the action includes the consumption of valuable data by the input operation of the user, and during the execution of the step of reactivating the character, the character's The mode of operation is determined based on the consumption of valuable data.

(Item 7) The method was explained. According to certain aspects of the disclosure, the method comprises a first user terminal of a first user other than at least one second user who has a first processor and a first memory and has viewed real-time distribution of a game performed by a performer in real time. This is a method executed by the first processor, and after the real-time distribution of the game is completed, the recorded voice data related to the game and the voice for controlling at least one character appearing in the game from the outside. The distributed game includes a step of receiving data and a step of executing playback of the distributed game by operating a character based on the voice data, and the distributed game includes a second processor, a second memory, and the like. A process executed by a computer as a second user terminal of a second user including a display unit and an operation unit, wherein the second user terminal is a space physically separated from the space in which the second user terminal exists. An external device and network that controls the character in response to input from a performer who is different from the second user of the second user terminal and plays the character in a space invisible to the second user. It is configured to be communicable via, and the second processor advances the game according to the input operation of the second user input to the computer via the operation unit, and indicates the progress of the game to the external device. As information, progress information for making it possible to display a game screen of a game in progress, including a screen displayed on the display unit or a simulated screen simplified from the screen, is sequentially transmitted. , A game that is audio data acquired by an external device that displays the game screen of the game in progress in real time so that the performer can see it based on the progress information transmitted sequentially, and is displayed in real time by the performer. The progress of the game is triggered by receiving the voice data of the voice that is emitted from the screen at an arbitrary timing and cannot be directly heard by the second user from the external device and receiving the voice data. It is a game generated by operating the character by causing the character appearing in the character to speak at least the content of the voice data, and by executing.

(Item 8) In (Item 7), the step of receiving the voice data executed by the computer receives the motion data input by the performer who plays the character in the external device together with the voice data from the external device, and is executed by the computer. The step of operating the character to be performed is to move the character according to the motion data in accordance with the speech of the content of the voice data, and the step to execute the reproduction of the delivered game executed by the first user terminal is the voice. By operating the character based on the motion data in addition to the data, the delivered game is played back.

(Item 9) In (Item 7) or (Item 8), the delivered game is played with restrictions as compared with the case where the first user advances the game in real time.

(Item 10) In any one of (Item 7) to (Item 9), the first user terminal further includes a display unit, and the display unit has a first screen and a first screen for displaying a menu related to real-time distribution. It is configured to be able to display a second screen for displaying real-time distribution that can be viewed and a third screen for displaying information about the delivered game, and the third screen is from the second screen. It is configured so that it is transitioned and not transitioned from the first screen.

(Item 11) (Item 10) further includes a step of transitioning from the second screen to the third screen when an input operation by the first user for the second screen is accepted.

(Item 12) A computer-readable medium was explained. According to an aspect of the present disclosure, a computer-readable medium is a computer-readable medium that stores computer-executable instructions, and when a computer-executable instruction is executed, the processor is informed of (item 1) to (item 6). Execute the step included in the method of any one item.

(Item 13) A computer-readable medium was explained. According to an aspect of the present disclosure, a computer-readable medium is a computer-readable medium that stores a computer-executable instruction, and when the computer-executable instruction is executed, the first processor is notified from (item 7) to (item 11). ) To execute the step included in the method of any one item.

(Item 14) The information processing device was explained. According to a certain aspect of the present disclosure, the information processing apparatus is an information processing apparatus as a user terminal including a processor, a memory, a display unit, and an operation unit, and the user terminal is a physical space in which the user terminal exists. An external device that exists in a distant space and is different from the user of the user terminal, and plays the character at least one character appearing in the game in a space invisible to the user. It is configured to be able to communicate with the external device to be controlled via the network, and the processor reads the program stored in the memory and advances the game according to the input operation of the user input to the computer via the operation unit. As information indicating the progress of the game, the external device displays a game screen of the game in progress, including a screen displayed on the display unit or a simulated screen that simplifies the screen. Voice acquired by an external device that sequentially transmits progress information to enable it and displays the game screen of the game in progress in real time so that the performer can see it based on the sequentially transmitted progress information. Receiving the voice data of the voice, which is the data and is the voice emitted from the performer to the game screen displayed in real time at an arbitrary timing and cannot be heard directly by the user, from the external device and the voice data. Using the reception as a trigger, the character appearing during the progress of the game is made to speak at least the content of the voice data to operate the character, and after the end of the game, the progressed game is viewed. It is configured to re-operate and execute the character based on the audio data received again from the outside in response to the request.

(Item 15) The information processing device was explained. According to one aspect of the present disclosure, the information processing apparatus comprises a first processor and a first memory, and is a first user other than at least one second user who has viewed real-time distribution of a game performed by a performer in real time. An information processing device as a user terminal, the first processor reads a program stored in the first memory, and after the real-time distribution of the game is completed, the first processor is recorded voice data related to the game from the outside. To receive voice data for controlling at least one character appearing in the game, and to execute the delivered game by operating the character based on the voice data. The game configured to be executed and distributed is a process executed by a computer as a second user terminal of a second user including a second processor, a second memory, a display unit, and an operation unit, and is a second process. The user terminal is an external device that exists in a space physically separated from the space in which the second user terminal exists, and is different from the second user of the second user terminal, and the character is used by the second user. It is configured to be able to communicate via a network with an external device that controls the character in response to input from a performer who plays in an invisible space, and is operated by the second processor reading a program stored in the second memory. The display unit is a game screen of the game in progress as information indicating the progress of the game to the external device and to advance the game according to the input operation of the second user input to the computer through the unit. The progress information for making it possible to display the screen displayed on the screen or the game screen including the simulated screen which is a simplification of the screen is sequentially transmitted, and the game of the game in progress based on the sequentially transmitted progress information. Second, it is voice data acquired by an external device that displays the screen in real time so that the performer can see it, and is voice emitted from the performer at an arbitrary timing to the game screen displayed in real time. Receiving the voice data of the voice that the user cannot directly hear from the external device and triggering the reception of the voice data, the character appearing during the progress of the game is made to speak at least the content of the voice data. Thereby, it is a game generated by operating the character and executing.

(Item 16) The method was explained. According to certain aspects of the disclosure, a method is a method for controlling a character appearing in a game, wherein the method comprises a processor, a memory and a display, from a performer who plays at least one character appearing in the game. A computer that controls the character in response to the input of It is a method performed by a computer capable of communicating with the computer, and the method is based on progress information by the processor to enable the display of the game screen of the game in progress, which is sequentially transmitted from the user terminal in which the game is progressed. On the display unit of the computer so that the performer can visually recognize the game screen of the game in progress, which is displayed on the display unit of the user terminal or includes a simulated screen obtained by simplifying the screen. A step of displaying in real time, a step of accepting a voice that is emitted from the performer at an arbitrary timing to the game screen and cannot be heard directly by the user, and a step of accepting the voice data of the received voice on the user terminal. And after the end of the game, in response to a request from the user terminal, the voice data is transmitted to the user terminal on the user terminal in order to make the character speak the content of the voice data as in the end of the game. Or, in response to a request from a terminal other than the user terminal, in order to make the character speak the content of the voice data on the terminal other than the user terminal as in the end of the game, the voice data is transmitted to the terminal other than the user terminal. Send to, including steps and.

(Item 17) A computer-readable medium was explained. According to certain aspects of the disclosure, a computer-readable medium is a computer-readable medium containing computer-executable instructions that, upon execution of the computer-executable instruction, causes the processor to perform the steps included in the above method. ..

(Item 18) The information processing device was explained. According to an aspect of the present disclosure, the information processing device is an information processing device for controlling a character appearing in a game, and the information processing device includes a processor, a memory, and a display unit, and at least one appearing in the game. A computer that controls a character in response to input from a performer who plays one character, and exists in a space where the user cannot see the performer because it is physically separated from the space where the user terminal of a user different from the performer exists. It is configured to be able to communicate with the user terminal via the network, and the processor reads the program stored in the memory to display the game screen of the game in progress, which is sequentially transmitted from the user terminal that advances the game. Based on the progress information to enable, the performer visually recognizes the game screen of the game in progress, including the screen displayed on the display unit of the user terminal or the simulated screen simplified from the screen. It is possible to display in real time on the display of the computer so that it is possible, and to accept the voice that is emitted from the performer at any timing to the game screen displayed in real time and that the user cannot hear directly. The voice data of the received voice is transmitted to the user terminal, and after the game is finished, the character is made to speak the content of the voice data on the user terminal in the same manner as during the finished game in response to the request from the user terminal. Therefore, in order to send the voice data to the user terminal, or to make the character speak the content of the voice data on the terminal other than the user terminal in response to the request from the terminal other than the user terminal, as in the end of the game. It is configured to send voice data to a terminal other than the user terminal.

1 game system, 2 network, 10, 20, 30 processor, 11,21,31 memory, 12, 22, 32 storage, 13, 23, 33 communication IF (operation unit), 14, 24, 34 input / output IF (operation) Unit, display unit), 15, 35 touch screen (display unit, operation unit), 17 camera (operation unit), 18 distance measurement sensor (operation unit), 100 user terminal (computer, information processing device), 110, 113, 210, 310 control unit, 111,311 operation reception unit, 112,312 display control unit, 113,313 UI control unit, 114,314 animation generation unit, 115 game progress unit, 116 analysis unit, 117 progress information generation unit, 120 , 220, 320 storage unit, 131 game program, 132 game information, 133 user information, 134 character control program, 151,351 input unit (operation unit), 152,352 display unit, 200 server (computer), 211 progress support unit , 212 shared support unit, 300 operation instruction device (computer, NPC control device, character control device, information processing device), 315 progress simulation unit, 316 character control unit, 317 reaction processing unit, 1010 object, 1020, 3030 controller, 1030 Storage medium, 3010 microphone, 3020 motion capture device

Claims

A method performed by a computer as a user terminal having a processor, memory, display and operation.
The user terminal is an external device that exists in a space physically separated from the space in which the user terminal exists, and is different from the user of the user terminal, and at least one character appearing in the game is the user. It is configured to be able to communicate via a network with an external device that controls the character in response to input from the performer who plays in an invisible space.
The method is based on the processor.
A step of advancing the game according to a user's input operation input to the computer via the operation unit, and
As information indicating the progress of the game, the external device displays a game screen which is a game screen of the game in progress and includes a screen displayed on the display unit or a simulated screen simplified from the screen. Steps to sequentially send progress information to enable,
Audio data acquired by the external device that displays the game screen of the game in progress in real time so that the performer can see it based on the progress information transmitted sequentially, and is the audio data acquired from the performer in real time. A step of receiving voice data from the external device, which is voice emitted from the displayed game screen at an arbitrary timing and cannot be heard directly by the user.
A step of operating the character by causing the character appearing during the progress of the game to speak at least the content of the voice data by using the reception of the voice data as a trigger.
A method comprising the step of reactivating the character based on the audio data received again from the outside in response to a request for viewing of the advanced game after the end of the game.
In the receiving step, the motion data input by the performer who plays the character in the external device is received from the external device together with the voice data.
In the step of operating the character, the character is moved according to the motion data in accordance with the utterance of the content of the voice data.
The method according to claim 1, wherein the step of operating the character again is to operate the character again based on the motion data in addition to the voice data.
The method according to claim 1 or 2, wherein the step of operating the character again is executed based on a record of actions by the input operation of the user.
The record of the action contains time information
The method according to claim 3, wherein the step of operating the character again follows the designation of time information by the user's input operation via the operation unit while the game is in progress.
The action includes selection of a specific progress portion by an input operation of the user via the operation unit while the game is in progress.
The method according to claim 3 or 4, wherein in the step of reactivating the character, the progress of only the selected specific progress portion is executed.
The record of the action includes the consumption of valuable data by the input operation of the user.
The method according to any one of claims 3 to 5, wherein the operation mode of the character is determined based on the consumption of the valuable data during the execution of the step of operating the character again.
A method executed by a first user terminal of a first user other than at least one second user who has a first processor and a first memory and has viewed real-time distribution of a game performed by a performer in real time. With one processor
After the end of the real-time distribution of the game, a step of receiving voice data for controlling at least one character appearing in the game, which is recorded voice data related to the game, from the outside.
Including a step of executing the reproduction of the delivered game by operating the character based on the voice data.
The delivered game is
A process executed by a computer as a second user terminal of the second user including a second processor, a second memory, a display unit, and an operation unit.
The second user terminal is an external device that exists in a space physically separated from the space in which the second user terminal exists, and is different from the second user of the second user terminal, and the character is used. It is configured to be able to communicate with an external device that controls the character in response to an input from the performer who plays in a space invisible to the second user via a network.
By the second processor
To advance the game in response to the input operation of the second user input to the computer via the operation unit.
As information indicating the progress of the game, the external device displays a game screen which is a game screen of the game in progress and includes a screen displayed on the display unit or a simulated screen simplified from the screen. Sequentially sending progress information to make it possible,
Audio data acquired by the external device that displays the game screen of the game in progress in real time so that the performer can see it based on the progress information transmitted sequentially, and is the audio data acquired from the performer in real time. Receiving the voice data of the voice that is emitted from the displayed game screen at an arbitrary timing and cannot be heard directly by the second user from the external device.
By triggering the reception of the voice data, the character appearing during the progress of the game is made to speak at least the content of the voice data to operate the character. The method, which is the generated game.
The step of receiving the voice data executed by the computer receives the motion data input by the performer who plays the character in the external device together with the voice data from the external device.
The step of operating the character, which is executed by the computer, moves the character according to the motion data in accordance with the utterance of the content of the voice data.
The step of executing the reproduction of the distributed game executed by the first user terminal is to reproduce the distributed game by operating the character based on the motion data in addition to the voice data. 7. The method of claim 7.
The method according to claim 7 or 8, wherein the delivered game is played with restrictions as compared with the case where the first user advances the game in real time.
The first user terminal further includes a display unit, and the display unit is
A first screen for displaying a menu related to real-time distribution, a second screen for displaying real-time distribution which is transitioned from the first screen and can be viewed, and a third screen for displaying information about the distributed game. It is configured to be displayable and
The method according to any one of claims 7 to 9, wherein the third screen is configured to be transitioned from the second screen and not to be transitioned from the first screen.
The method according to claim 10, further comprising a step of transitioning from the second screen to the third screen when an input operation by the first user for the second screen is accepted.
A computer-readable medium containing computer-executable instructions that, upon execution of the computer-executable instruction, causes the processor to perform the steps included in any one of claims 1-6. , Computer readable medium.
A computer-readable medium in which a computer-executable instruction is stored, and when the computer-executable instruction is executed, the first processor is provided with a step included in the method according to any one of claims 7 to 11. A computer-readable medium to run.
An information processing device as a user terminal including a processor, a memory, a display unit, and an operation unit.
The user terminal is an external device that exists in a space physically separated from the space in which the user terminal exists, and is different from the user of the user terminal, and at least one character appearing in the game is the user. It is configured to be able to communicate via a network with an external device that controls the character in response to input from the performer who plays in an invisible space.
The processor reads a program stored in the memory, thereby
To advance the game in response to a user's input operation input to the computer via the operation unit.
As information indicating the progress of the game, the external device displays a game screen which is a game screen of the game in progress and includes a screen displayed on the display unit or a simulated screen simplified from the screen. Sequentially sending progress information to make it possible,
Audio data acquired by the external device that displays the game screen of the game in progress in real time so that the performer can see it based on the progress information transmitted sequentially, and is the audio data acquired from the performer in real time. Receiving voice data from the external device, which is voice emitted from the displayed game screen at an arbitrary timing and cannot be heard directly by the user,
Using the reception of the voice data as a trigger, the character appearing during the progress of the game is made to speak at least the content of the voice data to operate the character.
After the end of the game, the character is re-operated based on the voice data received again from the outside in response to the request for viewing the progressed game.
An information processing device configured to run.
An information processing device as a first user terminal of a first user other than at least one second user who has a first processor and a first memory and has viewed real-time distribution of a game performed by a performer in real time.
The first processor reads a program stored in the first memory.
After the real-time distribution of the game is completed, the voice data recorded for the game and for controlling at least one character appearing in the game is received from the outside.
By operating the character based on the voice data, it is configured to execute the reproduction of the delivered game and to execute.
The delivered game is
A process executed by a computer as a second user terminal of the second user including a second processor, a second memory, a display unit, and an operation unit.
The second user terminal is an external device that exists in a space physically separated from the space in which the second user terminal exists, and is different from the second user of the second user terminal, and the character is used. It is configured to be able to communicate with an external device that controls the character in response to an input from the performer who plays in a space invisible to the second user via a network.
The second processor reads the program stored in the second memory.
To advance the game in response to the input operation of the second user input to the computer via the operation unit.
As information indicating the progress of the game, the external device displays a game screen which is a game screen of the game in progress and includes a screen displayed on the display unit or a simulated screen simplified from the screen. Sequentially sending progress information to make it possible,
Audio data acquired by the external device that displays the game screen of the game in progress in real time so that the performer can see it based on the progress information transmitted sequentially, and is the audio data acquired from the performer in real time. Receiving the voice data of the voice that is emitted from the displayed game screen at an arbitrary timing and cannot be heard directly by the second user from the external device.
By triggering the reception of the voice data, the character appearing during the progress of the game is made to speak at least the content of the voice data to operate the character. An information processing device that is a generated game.
It ’s a way to control the characters that appear in the game.
The method is a computer including a processor, a memory, and a display unit, which controls the character in response to an input from a performer who plays at least one character appearing in the game, and is a user terminal of a user different from the performer. It is a method executed by a computer that is physically separated from the space in which the user exists and is in a space where the user cannot see the performer and can communicate with the user terminal via a network.
The method is based on the processor.
A game screen of the game in progress, which is a game screen of the user terminal, based on progress information for making it possible to display the game screen of the game in progress, which is sequentially transmitted from the user terminal for advancing the game. A step of displaying a game screen including a screen displayed on the display unit or a simulated screen simplified from the screen in real time on the display unit of the computer so that the performer can see it.
A step of accepting a voice emitted from the performer to the game screen displayed in real time at an arbitrary timing and which the user cannot directly hear.
The step of transmitting the voice data of the received voice to the user terminal, and
After the end of the game, in response to a request from the user terminal, the voice data is transmitted to the user terminal in order to cause the character to speak the content of the voice data in the user terminal as in the case of the completed game. The voice data is transmitted or, in response to a request from a terminal other than the user terminal, the character is made to speak the content of the voice data on a terminal other than the user terminal as in the case of the completed game. To a terminal other than the user terminal.
Including, how.
A computer-readable medium in which a computer-executable instruction is stored, and when the computer-executable instruction is executed, the computer-readable medium causes the processor to execute the step included in the method according to claim 16.
An information processing device for controlling characters appearing in games.
The information processing device is a computer including a processor, a memory, and a display unit, and controls the character in response to an input from a performer who plays at least one character appearing in the game, and is a computer different from the performer. It is configured to be physically separated from the space where the user terminal exists, to exist in a space where the user cannot see the performer, and to be able to communicate with the user terminal via a network.
The processor reads a program stored in the memory, thereby
A game screen of the game in progress, which is a game screen of the user terminal, based on progress information for making it possible to display the game screen of the game in progress, which is sequentially transmitted from the user terminal for advancing the game. Displaying a game screen including a screen displayed on the display unit or a simulated screen simplified from the screen in real time on the display unit of the computer so that the performer can see it.
Accepting voices emitted from the performer to the game screen displayed in real time at arbitrary timings that the user cannot directly hear.
Sending the voice data of the received voice to the user terminal and
After the end of the game, in response to a request from the user terminal, the voice data is transmitted to the user terminal in order to cause the character to speak the content of the voice data in the user terminal as in the case of the completed game. The voice data is transmitted or, in response to a request from a terminal other than the user terminal, the character is made to speak the content of the voice data on a terminal other than the user terminal as in the case of the completed game. To a terminal other than the user terminal
An information processing device configured to run.