JP2019205645A - Game program, character control program, method, and information processing device - Google Patents

Abstract

To improve amusement properties of a game.SOLUTION: A game program (131) causes a processor (10) to execute a step (S103) for causing a game to progress in response to an input operation of a user input in a computer (100) through an operation part, a step (S110) for transmitting progress information indicating the progress of the game to a character control device (300) for controlling at least one character (801) that appears in the game, a step (S117) for receiving voice data corresponding to an utterance of the character input according to the progress of the game in the character control device from the character control device, and a step (S119) for operating the character by causing the character appearing while the game is progressing to utter at least a content of the voice data with receipt of the voice data as a trigger.SELECTED DRAWING: Figure 8

Description

  The present disclosure relates to a game program, a method and information processing apparatus for executing the game program, and a character control program, a method of executing the character control program, and an information processing apparatus.

  Conventionally, a game in which a story progresses so that the ending is different depending on the option selected by the user is widely known. For example, Non-Patent Document 1 discloses a love simulation game whose main purpose is to deepen a friendship with a girl character virtually. The user selects what he / she thinks is the most appropriate action for the character from the presented options, and the story progresses by repeating that the character reacts to the action.

“Dengeki Online-Game / App / Manga / Anime Information Site”, [online], KADOKAWA CORPORATION, [Search May 8, 2018], Internet (URL: http://dengekionline.com/elem/000/000/ 279/279193 / index-2.html)

  In the game disclosed in Non-Patent Document 1, character response patterns are prepared in advance. Then, according to the input operation of the user, the response of the character is determined and output from the response pattern, and the game proceeds. Therefore, the variation of the character's movement does not extend beyond the contents of the data prepared in advance. Therefore, there is a problem that the user cannot feel a sense of reality as if the character is in the real world, and eventually gets bored with the relationship with the character. In general, in a game developed with the intention of allowing the user to play for a long time, it is important how to deal with the problem that the user gets bored with the game. Games are always required to provide attractive content that motivates users to play. For example, if a character appearing in a game has a high sense of reality, the user is likely to be immersed in the game world, and may find interesting by engaging with the character.

  An object of one embodiment of the present disclosure is to improve a sense of immersion in the world of a game and improve the fun of the game.

  A game program according to the present disclosure is executed by a computer as a user terminal including a processor, a memory, and an operation unit. The game program causes the processor to advance the game in response to a user input operation input to the computer via the operation unit, and to the character control device that controls at least one character appearing in the game. A step of transmitting progress information indicating the character, a step of receiving voice data corresponding to the utterance of the character input in accordance with the progress of the game in the character control device, and receiving the voice data And causing the character appearing during the game to speak at least the contents of the audio data, thereby causing the character to move.

  A character control program according to the present disclosure is a character control program for controlling a character appearing in a game, and the character control program is executed by a computer as a character control device including a processor, a memory, and a display unit. The The character control program displays a progress screen indicating the progress of the game on the display unit on the display unit based on progress information indicating the progress of the game received from the user terminal that advances the game. The step of receiving voice data corresponding to the character's utterance input to the computer in accordance with the progress of the game indicated by the progress screen displayed and the step of transmitting the received voice data to the user terminal are executed.

  According to one aspect of the present disclosure, there is an effect of improving the interest of the game.

It is a figure which shows the hardware constitutions of a game system. It is a block diagram which shows the functional structure of a user terminal, a server, and an operation instruction apparatus. It is a figure which shows an example of the data structure of screen transition information. It is a figure which shows an example of the data structure of progress information. It is a figure which shows an example of the data structure of action instruction data. It is a figure which shows an example of the progress screen displayed on the display part of an operation | movement instruction device. It is a figure which shows an example of the game screen displayed on the display part of a user terminal. It is a flowchart which shows the flow of the process which each apparatus which comprises a game system performs. It is a figure which shows the other example of the progress screen displayed on the display part of an operation | movement instruction device. It is a figure which shows an example of the game screen displayed on the display part of a user terminal.

Embodiment 1
A game system according to the present disclosure is a system for providing a game to a plurality of users. Hereinafter, the game system will be described with reference to the drawings. The present invention is not limited to these exemplifications, but is defined by the scope of the claims, and is intended to include all modifications within the meaning and scope equivalent to the scope of the claims. The In the following description, the same reference numerals are given to the same elements in the description of the drawings, and repeated description is not repeated.

<Hardware configuration of game system 1>
FIG. 1 is a diagram illustrating a hardware configuration of the game system 1. The game system 1 includes a plurality of user terminals 100 and a server 200 as illustrated. Each user terminal 100 is connected to the server 200 via the network 2. The network 2 includes various mobile communication systems constructed by the Internet and a radio base station (not shown). Examples of the mobile communication system include a so-called 3G and 4G mobile communication system, LTE (Long Term Evolution), and a wireless network (for example, Wi-Fi (registered trademark)) that can be connected to the Internet through a predetermined access point. It is done.

  The server 200 (computer, information processing apparatus) may be a general-purpose computer such as a workstation or a personal computer. The server 200 includes a processor 20, a memory 21, a storage 22, a communication IF 23, and an input / output IF 24. These components included in the server 200 are electrically connected to each other via a communication bus.

  The user terminal 100 (computer, information processing apparatus) may be a mobile terminal such as a smartphone, a feature phone, a PDA (Personal Digital Assistant), or a tablet computer. The user terminal 100 may be a game device suitable for game play. As illustrated, the user terminal 100 includes a processor 10, a memory 11, a storage 12, a communication interface (IF) 13, an input / output IF 14, a touch screen 15 (display unit), a camera 17, and a distance measuring sensor 18. With. These components included in the user terminal 100 are electrically connected to each other via a communication bus. Note that the user terminal 100 may include an input / output IF 14 capable of connecting a display (display unit) configured separately from the user terminal 100 main body instead of or in addition to the touch screen 15.

  Further, as shown in FIG. 1, the user terminal 100 may be configured to be able to communicate with one or more controllers 1020. For example, the controller 1020 establishes communication with the user terminal 100 in accordance with a communication standard such as Bluetooth (registered trademark). The controller 1020 may have one or more buttons and the like, and transmits an output value based on a user input operation to the buttons and the like to the user terminal 100. The controller 1020 may have various sensors such as an acceleration sensor and an angular velocity sensor, and transmits output values of the various sensors to the user terminal 100.

  Note that the controller 1020 may include the camera 17 and the distance measuring sensor 18 instead of or in addition to the user terminal 100 including the camera 17 and the distance measuring sensor 18.

  For example, at the start of a game, the user terminal 100 desirably allows a user who uses the controller 1020 to input user identification information such as the user's name or login ID via the controller 1020. As a result, the user terminal 100 can associate the controller 1020 with the user, and identifies which user the output value belongs to based on the transmission source (controller 1020) of the received output value. be able to.

  When the user terminal 100 communicates with a plurality of controllers 1020, each user grasps each controller 1020, so that the one user terminal 100 does not communicate with other devices such as the server 200 via the network 2. Multi-play can be realized. Further, each user terminal 100 is connected to each other by a wireless standard such as a wireless local area network (LAN) standard (communication connection is not performed via the server 200), so that a plurality of user terminals 100 can realize multi-play locally. You can also When the above-described multiplay is realized locally by one user terminal 100, the user terminal 100 may further include at least a part of various functions described later included in the server 200. Further, when the above-described multi-play is realized locally by a plurality of user terminals 100, the plurality of user terminals 100 may be provided with various functions described later included in the server 200 in a distributed manner.

  Note that the user terminal 100 may communicate with the server 200 even when the above-described multiplayer is realized locally. For example, information indicating a play result such as a result or win / loss in a certain game may be associated with the user identification information and transmitted to the server 200.

  The controller 1020 may be configured to be detachable from the user terminal 100. In this case, a coupling portion with the controller 1020 may be provided on at least one surface of the housing of the user terminal 100. When the user terminal 100 and the controller 1020 are coupled by wire through the coupling unit, the user terminal 100 and the controller 1020 transmit and receive signals via the wire.

  As shown in FIG. 1, the user terminal 100 may accept the mounting of a storage medium 1030 such as an external memory card via the input / output IF 14. Accordingly, the user terminal 100 can read the program and data recorded in the storage medium 1030. The program recorded in the storage medium 1030 is a game program, for example.

  The user terminal 100 may store the game program acquired by communicating with an external device such as the server 200 in the memory 11 of the user terminal 100, or store the game program acquired by reading from the storage medium 1030 in the memory 11. May be stored.

  As described above, the user terminal 100 includes the communication IF 13, the input / output IF 14, the touch screen 15, the camera 17, and the distance measuring sensor 18 as an example of a mechanism for inputting information to the user terminal 100. Each of the above-described units serving as an input mechanism can be regarded as an operation unit configured to accept a user input operation.

  For example, when the operation unit is configured with at least one of the camera 17 and the distance measuring sensor 18, the operation unit detects an object 1010 in the vicinity of the user terminal 100, and performs an input operation from the detection result of the object. Identify. As an example, a user's hand as an object 1010, a marker having a predetermined shape, or the like is detected, and an input operation is specified based on the color, shape, movement, or type of the object 1010 obtained as a detection result. The More specifically, when a user's hand is detected from a captured image of the camera 17, the user terminal 100 performs a user input operation on a gesture (a series of movements of the user's hand) detected based on the captured image. Identify and accept as Note that the captured image may be a still image or a moving image.

  Alternatively, when the operation unit includes the touch screen 15, the user terminal 100 identifies and accepts a user operation performed on the input unit 151 of the touch screen 15 as a user input operation. Or when an operation part is comprised by communication IF13, the user terminal 100 specifies and receives the signal (for example, output value) transmitted from the controller 1020 as a user's input operation. Alternatively, when the operation unit includes the input / output IF 14, a signal output from an input device (not shown) different from the controller 1020 connected to the input / output IF 14 is specified and accepted as a user input operation.

  In the present embodiment, the game system 1 further includes an operation instruction device 300. The operation instruction device 300 is connected to each of the server 200 and the user terminal 100 via the network 2. At least one motion instruction device 300 is provided in the game system 1. A plurality of operation instruction devices 300 may be provided according to the number of user terminals 100 that use the service provided by the server 200. One operation instruction device 300 may be provided for one user terminal 100. One operation instruction device 300 may be provided for a plurality of user terminals 100.

  The motion instruction device 300 (NPC control device, character control device) may be a server, a desktop personal computer, a notebook computer, a computer such as a tablet, or a computer group combining these. As shown in the figure, the motion instruction apparatus 300 includes a processor 30, a memory 31, a storage 32, a communication IF 33, an input / output IF 34, and a touch screen 35 (display unit). These components included in the motion instruction device 300 are electrically connected to each other via a communication bus. The motion instruction device 300 may include an input / output IF 34 that can connect to a display (display unit) configured separately from the motion instruction device 300 main body instead of or in addition to the touch screen 35.

  Also, as shown in FIG. 1, the motion instruction device 300 includes one or more microphones 3010, one or more motion capture devices 3020, and one or more peripheral devices such as a controller 3030, via wireless or wired connection. Thus, communication may be configured. A peripheral device connected wirelessly establishes communication with the operation instruction device 300 in accordance with a communication standard such as Bluetooth (registered trademark), for example.

  The microphone 3010 acquires sound generated in the surroundings and converts it into an electric signal. The voice converted into the electrical signal is transmitted as voice data to the movement instruction apparatus 300 and received by the movement instruction apparatus 300 via the communication IF 33.

  The motion capture device 3020 tracks the motion of the tracking target (for example, a person) (including facial expressions, mouth movements, and the like), and transmits an output value as a tracking result to the motion instruction device 300. The motion data that is the output value is received by the operation instruction device 300 via the communication IF 33. The motion capture method of the motion capture device 3020 is not particularly limited. The motion capture device 3020 selectively includes various mechanisms for capturing motion, such as a camera, various sensors, markers, a suit worn by a model (person), a signal transmitter, and the like, depending on the method employed. .

  The controller 3030 may have a physical input mechanism such as one or more buttons, levers, sticks, wheels, and the like. The controller 3030 transmits an output value based on an input operation input to the input mechanism by the operator of the operation instruction device 300 to the operation instruction device 300. The controller 3030 may include various sensors such as an acceleration sensor and an angular velocity sensor, and may transmit output values of the various sensors to the operation instruction apparatus 300. The above output value is received by the operation instruction device 300 via the communication IF 33. In the following, a person who performs some input operation on the motion instruction apparatus 300 using the operation unit provided in the motion instruction apparatus 300 or various input mechanisms connected to be communicable with the motion instruction apparatus 300 will be described. It is called an operator. The operator includes a person who operates the operation instruction device 300 using the input unit 351, the controller 3030, and the like, and also includes a voice actor who inputs voice through the microphone 3010, and moves through the motion capture device 3020. The model which inputs is included.

  The motion instruction device 300 may include a camera and a distance measuring sensor (not shown). Instead of or in addition to the motion instruction device 300, the motion capture device 3020 and the controller 3030 may have a camera and a distance measuring sensor.

  As described above, the motion instruction device 300 includes the communication IF 33, the input / output IF 34, and the touch screen 35 as an example of a mechanism for inputting information to the motion instruction device 300. A camera and a distance measuring sensor may be further provided as necessary. Each of the above-described units serving as an input mechanism can be regarded as an operation unit configured to accept a user input operation.

  The operation unit may be configured with a touch screen 35. In this case, the motion instruction device 300 identifies and accepts a user operation performed on the input unit 351 of the touch screen 35 as a user input operation. Alternatively, when the operation unit is configured by the communication IF 33, the operation instruction device 300 specifies and accepts a signal (for example, an output value) transmitted from the controller 3030 as a user input operation. Alternatively, when the operation unit includes the input / output IF 34, a signal output from an input device (not shown) different from the controller 3030 connected to the input / output IF 34 is specified and accepted as a user input operation.

<Game overview>
In the present embodiment, as an example, in the game system 1, the server 200 and the user terminal 100 cooperate to execute the game program 131 and cause the user terminal 100 to advance a game played by the user. In the present embodiment, in the game system 1, the action instruction device 300 (character control device) executes the character control program 134 and controls the actions of at least some characters that appear in the game executed by the user terminal 100. can do.

  The game system 1 is not limited to a specific genre, and may be a system for executing games of any genre. For example, games such as tennis, table tennis, dodgeball, baseball, soccer and hockey, sports games, puzzle games, quiz games, RPG, adventure games, shooting games, simulation games, training games, action games, etc. Also good.

  The game system 1 is not limited to a specific play form, and may be a system for executing a game of any play form. For example, a single player game by a single user, a multiplayer game by a plurality of users, a multiplayer game, a battle game in which a plurality of users battle, a cooperative play game in which a plurality of users cooperate, and the like. May be. For example, the battle game may include a battle game such as tennis or baseball as described above. Further, the battle game may include a board game in which two players battle each other, such as shogi, go, chess, and othello. Further, the battle game may include a race game in which a plurality of users respectively operate vehicles or players to go around the same course and compete for the time.

<Hardware components of each device>
The processor 10 controls the operation of the entire user terminal 100. The processor 20 controls the operation of the entire server 200. The processor 30 controls the operation of the entire operation instruction device 300. The processors 10, 20 and 30 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit).

  The processor 10 reads a program from a storage 12 described later and develops it in a memory 11 described later. The processor 20 reads a program from a storage 22 described later and develops it in a memory 21 described later. The processor 30 reads a program from a storage 32, which will be described later, and expands it in a memory 31, which will be described later. The processor 10, the processor 20, and the processor 30 execute the developed program.

  The memories 11, 21, and 31 are main storage devices. The memories 11, 21 and 31 are configured by a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory 11 provides a work area to the processor 10 by temporarily storing a program and various data read from the storage 12 described later by the processor 10. The memory 11 also temporarily stores various data generated while the processor 10 is operating according to the program. The memory 21 provides the work area to the processor 20 by temporarily storing various programs and data read from the storage 22 described later by the processor 20. The memory 21 temporarily stores various data generated while the processor 20 is operating according to the program. The memory 31 provides a work area to the processor 30 by temporarily storing various programs and data read from the storage 32 described later by the processor 30. The memory 31 also temporarily stores various data generated while the processor 30 is operating according to the program.

In the present embodiment, the program may be a game program for realizing the game by the user terminal 100. Alternatively, the program may be a game program for realizing the game by cooperation between the user terminal 100 and the server 200.
Alternatively, the program may be a game program for realizing the game by cooperation of the user terminal 100, the server 200, and the operation instruction device 300. Note that the game realized by the cooperation of the user terminal 100 and the server 200 and the game realized by the cooperation of the user terminal 100, the server 200, and the operation instruction device 300 are activated in the user terminal 100 as an example. It may be a game executed on a browser. Alternatively, the program may be a game program for realizing the game by cooperation of a plurality of user terminals 100. The various data includes data related to the game such as user information and game information, and instructions or notifications transmitted / received between the devices of the game system 1.

  The storages 12, 22 and 32 are auxiliary storage devices. The storages 12, 22, and 32 are configured by a storage device such as a flash memory or an HDD (Hard Disk Drive). The storages 12, 22 and 32 store various data related to the game.

  The communication IF 13 controls transmission / reception of various data in the user terminal 100. The communication IF 23 controls transmission / reception of various data in the server 200. The communication IF 33 controls transmission / reception of various data in the operation instruction device 300. The communication IFs 13, 23, and 33 control communication using, for example, communication via a wireless local area network (LAN), Internet communication via a wired LAN, a wireless LAN, or a mobile phone network, and short-range wireless communication. .

  The input / output IF 14 is an interface for the user terminal 100 to accept data input, and is an interface for the user terminal 100 to output data. The input / output IF 14 may input / output data via a USB (Universal Serial Bus) or the like. The input / output IF 14 may include, for example, a physical button of the user terminal 100, a camera, a microphone, a speaker, or the like. The input / output IF 24 of the server 200 is an interface for the server 200 to accept data input, and is an interface for the server 200 to output data. The input / output IF 24 may include, for example, an input unit that is an information input device such as a mouse or a keyboard, and a display unit that is a device that displays and outputs an image. The input / output IF 34 of the movement instruction device 300 is an interface for the movement instruction device 300 to accept data input, and is an interface for the movement instruction device 300 to output data. The input / output IF 34 includes, for example, an information input device such as a mouse, a keyboard, a stick, and a lever, a device that displays and outputs an image such as a liquid crystal display, and peripheral devices (a microphone 3010, a motion capture device 3020, and a controller 3030). May include a connection for transmitting and receiving data between them.

  The touch screen 15 of the user terminal 100 is an electronic component that combines an input unit 151 and a display unit 152. The touch screen 35 of the operation instruction device 300 is an electronic component that combines an input unit 351 and a display unit 352. The input units 151 and 351 are, for example, touch-sensitive devices, and are configured by touch pads, for example. The display units 152 and 352 are configured by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display.

  The input units 151 and 351 detect the position where a user operation (mainly a physical contact operation such as a touch operation, a slide operation, a swipe operation, and a tap operation) is input to the input surface, and indicate the position. As an input signal. The input units 151 and 351 may include a touch sensing unit (not shown). The touch sensing unit may adopt any method such as a capacitance method or a resistance film method.

  Although not shown, the user terminal 100 may include one or more sensors for specifying the holding posture of the user terminal 100. This sensor may be, for example, an acceleration sensor or an angular velocity sensor. When the user terminal 100 includes a sensor, the processor 10 can specify the holding posture of the user terminal 100 from the output of the sensor and perform processing according to the holding posture. For example, when the user terminal 100 is held in the portrait orientation, the processor 10 may perform a portrait screen display in which a portrait image is displayed on the display unit 152. On the other hand, when the user terminal 100 is held sideways, a horizontal screen display in which a horizontally long image is displayed on the display unit may be used. As described above, the processor 10 may be able to switch between the vertical screen display and the horizontal screen display according to the holding posture of the user terminal 100.

  The camera 17 includes an image sensor and the like, and generates a captured image by converting incident light incident from a lens into an electric signal.

  The distance measuring sensor 18 is a sensor that measures the distance to the measurement object. The distance measuring sensor 18 includes, for example, a light source that emits pulse-converted light and a light receiving element that receives the light. The distance measuring sensor 18 measures the distance to the measurement object based on the light emission timing from the light source and the light reception timing of the reflected light generated when the light emitted from the light source is reflected by the measurement object. The distance measuring sensor 18 may include a light source that emits light having directivity.

  Here, an example in which the user terminal 100 receives a detection result of detecting an object 1010 in the vicinity of the user terminal 100 using the camera 17 and the distance measuring sensor 18 as an input operation of the user will be further described. The camera 17 and the distance measuring sensor 18 may be provided on the side surface of the housing of the user terminal 100, for example. A distance measuring sensor 18 may be provided in the vicinity of the camera 17. As the camera 17, for example, an infrared camera can be used. In this case, the camera 17 may be provided with an illumination device that emits infrared light, a filter that blocks visible light, and the like. Thereby, it is possible to further improve the detection accuracy of the object based on the captured image of the camera 17 regardless of whether it is outdoors or indoors.

  The processor 10 may perform one or more processes on the captured image of the camera 17, for example, among the processes shown in the following (1) to (5). (1) The processor 10 performs image recognition processing on the captured image of the camera 17 to identify whether the captured image includes a user's hand. The processor 10 may use a technique such as pattern matching as an analysis technique employed in the above-described image recognition processing. (2) Moreover, the processor 10 detects a user's gesture from the shape of a user's hand. For example, the processor 10 specifies the number of the user's fingers (the number of fingers extending) from the shape of the user's hand detected from the captured image. The processor 10 further identifies a gesture performed by the user from the number of identified fingers. For example, when the number of fingers is five, the processor 10 determines that the user has performed a “par” gesture. Further, when the number of fingers is 0 (no finger is detected), the processor 10 determines that the user has made a “goo” gesture. On the other hand, when the number of fingers is two, the processor 10 determines that the user has performed a “choke” gesture. (3) The processor 10 performs image recognition processing on the image captured by the camera 17 to detect whether the user's finger is in the state where only the index finger is raised or whether the user's finger has moved. . (4) The processor 10 determines an object 1010 (such as a user's hand) in the vicinity of the user terminal 100 based on at least one of the image recognition result of the image captured by the camera 17 and the output value of the distance measuring sensor 18. ) And the user terminal 100 are detected. For example, the processor 10 determines whether the user's hand is near (for example, a distance less than a predetermined value) or far (for example, a predetermined value) depending on the size of the shape of the user's hand specified from the captured image of the camera 17. It is detected whether the distance is above. When the captured image is a moving image, the processor 10 may detect whether the user's hand is approaching or moving away from the user terminal 100. (5) If it is determined that the distance between the user terminal 100 and the user's hand has changed while the user's hand is detected based on the image recognition result of the captured image of the camera 17, the processor 10 recognizes that the user is shaking his / her hand in the shooting direction of the camera 17. When an object is not detected in the distance measuring sensor 18 having higher directivity than the shooting range of the camera 17, the processor 10 indicates that the user is shaking his / her hand in a direction perpendicular to the shooting direction of the camera. recognize.

  In this manner, the processor 10 determines whether or not the user is grasping his / her hand by image recognition on the captured image of the camera 17 (“Goo” gesture or other gesture (eg “Par”)). ) Is detected. The processor 10 also detects how the user is moving the hand along with the shape of the user's hand. In addition, the processor 10 detects whether the user is approaching or moving away from the user terminal 100. Such an operation can correspond to an operation using a pointing device such as a mouse or a touch panel. For example, the user terminal 100 moves the pointer on the touch screen 15 according to the movement of the user's hand, and detects the user's gesture “goo”. In this case, the user terminal 100 recognizes that the user is continuing the selection operation. Continuation of the selection operation corresponds to, for example, maintaining a state where the mouse is clicked and pressed, or maintaining a touched state after a touchdown operation is performed on the touch panel. Further, when the user further moves his / her hand while the user's gesture “go” is detected, the user terminal 100 performs such a series of gestures as an operation corresponding to the swipe operation (or drag operation). It can also be recognized. Further, when the user terminal 100 detects a gesture that the user repels a finger based on the detection result of the user's hand based on the image captured by the camera 17, the user terminal 100 performs a mouse click or a tap operation on the touch panel. You may recognize as operation corresponding to.

<Functional configuration of game system 1>
FIG. 2 is a block diagram illustrating functional configurations of the user terminal 100, the server 200, and the motion instruction device 300 included in the game system 1. Each of the user terminal 100, the server 200, and the operation instruction device 300 is not shown, but has a functional configuration necessary for functioning as a general computer, and a functional configuration necessary for realizing known functions in the game. Can be included.

  The user terminal 100 has a function as an input device that receives a user input operation and a function as an output device that outputs a game image and sound. The user terminal 100 functions as the control unit 110 and the storage unit 120 through cooperation of the processor 10, the memory 11, the storage 12, the communication IF 13, the input / output IF 14, and the like.

  The server 200 communicates with each user terminal 100 and has a function of supporting the user terminal 100 to advance the game. For example, when the user terminal 100 downloads an application related to the game for the first time, the user terminal 100 is provided with data that should be stored in the user terminal 100 when the first game is started. For example, the server 200 transmits movement instruction data for moving the character to the user terminal 100. The action instruction data may include motion capture data in which the movement of an actor such as a model is captured in advance, or may include voice data in which the voice of an actor such as a voice actor is recorded, or the character is moved. Operation history data indicating a history of input operations for the user may be included, or a motion command group in which commands associated with the above-described series of input operations are arranged in time series may be included. When this game is a multi-play game, the server 200 may have a function of communicating with each user terminal 100 participating in the game and mediating exchanges between the user terminals 100 and a synchronization control function. The server 200 also has a function of mediating between the user terminal 100 and the operation instruction device 300. As a result, the operation instruction device 300 can supply the operation instruction data to the user terminal 100 or a group of the plurality of user terminals 100 in a timely manner without mistaking the destination. The server 200 functions as the control unit 210 and the storage unit 220 through the cooperation of the processor 20, the memory 21, the storage 22, the communication IF 23, the input / output IF 24, and the like.

  The action instruction device 300 has a function of generating action instruction data for instructing the action of the character in the user terminal 100 and supplying the action instruction data to the user terminal 100. The operation instruction device 300 functions as the control unit 310 and the storage unit 320 by cooperation of the processor 30, the memory 31, the storage 32, the communication IF 33, the input / output IF 34, and the like.

  Storage units 120, 220, and 320 store game program 131, game information 132, and user information 133. The game program 131 is a game program executed by the user terminal 100, the server 200, and the operation instruction device 300. The game information 132 is data referred to when the control units 110, 210, and 310 execute the game program 131. The user information 133 is data relating to the user account. In the storage units 220 and 320, the game information 132 and the user information 133 are stored for each user terminal 100. The storage unit 320 further stores a character control program 134. The character control program 134 is a program executed by the action instruction device 300, and is a program for controlling the action of the character to appear in the game based on the game program 131 described above.

(Functional configuration of server 200)
The control unit 210 performs overall control of the server 200 by executing the game program 131 stored in the storage unit 220. For example, the control unit 210 transmits various data and programs to the user terminal 100. The control unit 210 receives part or all of the game information or user information from the user terminal 100. When the game is a multiplayer game, the control unit 210 may receive a multiplayer synchronization request from the user terminal 100 and transmit data for synchronization to the user terminal 100. Moreover, the control part 210 communicates with the user terminal 100 and the operation | movement instruction apparatus 300 as needed, and transmits / receives information.

  The control unit 210 functions as a progress support unit 211 and a sharing support unit 212 according to the description of the game program 131. The control unit 210 can also function as other functional blocks (not shown) in order to support the progress of the game on the user terminal 100 according to the nature of the game to be executed.

  The progress support unit 211 communicates with the user terminal 100 to support the user terminal 100 for progressing various parts included in the game. For example, when the user terminal 100 advances the game, the progress support unit 211 provides the user terminal 100 with information necessary to advance the game.

  The sharing support unit 212 communicates with a plurality of user terminals 100, and supports a plurality of users to share each other's decks with each user terminal 100. Further, the sharing support unit 212 may have a function of matching the online user terminal 100 and the operation instruction device 300. Thereby, transmission / reception of information between the user terminal 100 and the operation instruction device 300 is smoothly performed.

(Functional configuration of user terminal 100)
The control unit 110 performs overall control of the user terminal 100 by executing the game program 131 stored in the storage unit 120. For example, the control unit 110 advances the game according to the game program 131 and the user's operation. Further, the control unit 110 communicates with the server 200 and the operation instruction device 300 as necessary to transmit and receive information while the game is progressing.

  The control unit 110 includes an operation receiving unit 111, a display control unit 112, a user interface (hereinafter referred to as UI) control unit 113, an animation generation unit 114, a game progression unit 115, an analysis unit 116, and a progress according to the description of the game program 131. It functions as the information generation unit 117. The control unit 110 can also function as other functional blocks (not shown) in order to advance the game according to the nature of the game to be executed.

  The operation receiving unit 111 detects and receives a user input operation on the input unit 151. The operation reception unit 111 determines what input operation has been performed based on the user's action on the console via the touch screen 15 and other input / output IF 14, and outputs the result to each element of the control unit 110. To do.

  For example, the operation receiving unit 111 receives an input operation on the input unit 151, detects the coordinates of the input position of the input operation, and identifies the type of the input operation. The operation reception unit 111 specifies, for example, a touch operation, a slide operation, a swipe operation, a tap operation, and the like as the types of input operations. Further, the operation receiving unit 111 detects that the contact input is canceled from the touch screen 15 when the input that has been continuously detected is interrupted.

  The UI control unit 113 controls a UI object displayed on the display unit 152 in order to construct a UI. The UI object is a tool for the user to make an input necessary for the progress of the game to the user terminal 100 or a tool for obtaining information output during the progress of the game from the user terminal 100. The UI object is not limited to this, but is, for example, an icon, a button, a list, a menu screen, or the like.

  The animation generation unit 114 generates animations indicating the motions of the various objects based on the control modes of the various objects. For example, the animation generation unit 114 may generate an animation or the like that expresses how the character moves as if it is there, moves its mouth, or changes its facial expression.

  The display control unit 112 outputs a game screen in which the processing results executed by the above-described elements are reflected on the display unit 152 of the touch screen 15. The display control unit 112 may display a game screen including the animation generated by the animation generation unit 114 on the display unit 152. In addition, the display control unit 112 may draw the above-described UI object controlled by the UI control unit 113 so as to be superimposed on the game screen.

  The game progression unit 115 advances the game. In the present embodiment, the game progression unit 115 progresses a game (hereinafter referred to as the present game) executed in the game system 1 according to the present embodiment in accordance with a user input operation input via the operation reception unit 111. Let When this game is divided into a plurality of parts such as a first part, a second part,..., The game progression unit 115 advances the game according to the specifications for each part.

  As an example, it is assumed that this game is a competitive tennis game and is divided into a tutorial part, a competitive part, and a lottery part. For example, the game progression unit 115 provides knowledge necessary for a novice user to play other parts (competition part and lottery part) in the tutorial part, or in the competition part that is the main part of the game. Provides a simple practice mode to learn core operations. The game progression unit 115 advances the tutorial part according to the user's input operation and the game program 131 downloaded in advance to the storage unit 120.

  The game progression unit 115 causes a tennis player operated by the user to compete with a tennis player operated by another user in the battle part. The game progression unit 115 shares information with the user terminal 100 operated by another user via the server 200, and advances the tennis match while synchronizing. In other words, the game progression unit 115 advances the battle part according to the user input operation, the other user input operation, and the game program 131.

  In the lottery part, the game progression unit 115 executes the lottery and causes the user to acquire the winning game media. The game medium is digital data that can be used in this game, and is, for example, an item that can enhance the tennis player operated by the user in order to make the battle advantageous. The game progression unit 115 advances the lottery part according to the user's input operation, the game program 131 downloaded in advance to the storage unit 120, and the lottery result executed by the server 200. Here, “to cause the user to acquire a game medium” may be, for example, to change the status of the game medium managed in association with the user from unusable to usable. Alternatively, the game medium may be stored in at least one of the memories (memory 11, memory 21, memory 31) included in the game system 1 in association with the user identification information or the user terminal ID.

  The analysis unit 116 analyzes (renders) the action instruction data and instructs the game progression unit 115 to move the character based on the analysis result. In the present embodiment, the analysis unit 116 starts rendering the motion instruction data triggered by the motion instruction data supplied by the motion instruction device 300 being received via the communication IF 33. The action instruction device 300 transmits the analysis result to the game progression unit 115 and immediately instructs the character to move based on the action instruction data. That is, the game progression unit 115 uses the movement instruction data received as a trigger to move the character based on the movement instruction data. Thereby, it becomes possible to show the user the character that operates in real time.

  The progress information generating unit 117 generates progress information indicating the progress of the game being executed by the game progressing unit 115 and transmits it to the server 200 or the operation instruction device 300 as appropriate. The progress information may include, for example, information for designating a currently displayed game screen, or may include a progress log indicating the progress of the game by characters and symbols in time series. In the game system 1, the progress information generation unit 117 may be omitted in an embodiment in which the server 200 and the operation instruction device 300 do not require progress information.

(Functional configuration of motion instruction device 300)
The control unit 310 comprehensively controls the motion instruction device 300 by executing the character control program 134 stored in the storage unit 320. For example, the control unit 310 generates action instruction data according to the character control program 134 and the operation of the operator, and supplies the action instruction data to the user terminal 100. The control unit 310 may further execute the game program 131 as necessary. In addition, the control unit 310 communicates with the server 200 and the user terminal 100 that is executing the game to transmit and receive information.

  The control unit 310 functions as an operation reception unit 311, a display control unit 312, a UI control unit 313, an animation generation unit 314, a progress simulation unit 315, and a character control unit 316 according to the description of the character control program 134. The control unit 310 can also function as other functional blocks (not shown) in order to control characters appearing in the game according to the nature of the game executed in the game system 1.

  The operation receiving unit 311 detects and receives an operator input operation on the input unit 351. The operation reception unit 311 determines what input operation has been performed from the action exerted by the operator on the console via the touch screen 35 and other input / output IF 34, and the result is sent to each element of the control unit 310. Output. The details of the function of the operation reception unit 311 are almost the same as those of the operation reception unit 111 in the user terminal 100.

  The UI control unit 313 controls UI objects to be displayed on the display unit 352.

  The animation generation unit 314 generates animations indicating the motions of the various objects based on the control modes of the various objects. For example, the animation generation unit 314 may generate an animation or the like that reproduces a game screen that is actually displayed on the user terminal 100 that is a communication partner.

  The display control unit 312 outputs a game screen reflecting the processing results executed by the above-described elements to the display unit 352 of the touch screen 35. Details of functions of the display control unit 312 are substantially the same as those of the display control unit 112 in the user terminal 100.

  The progress simulation unit 315 grasps the progress of the game on the user terminal 100 based on the progress information indicating the progress of the game received from the user terminal 100. Then, the progress simulation unit 315 presents the progress of the user terminal 100 to the operator by reproducing the behavior of the user terminal 100 in the motion instruction device 300 in a simulated manner.

  For example, the progress simulation unit 315 may display a reproduction of the game screen displayed on the user terminal 100 on the display unit 352 of the own device. Further, the progress simulation unit 315 may display the progress of the game on the display unit 352 as the above-described progress log in the user terminal 100.

  Also, part of the function of the progress simulation unit 315 may be realized by the control unit 310 executing the game program 131. For example, the progress simulation unit 315 first grasps the progress of the game of the user terminal 100 based on the progress information. Then, the progress simulation unit 315 may reproduce the game screen currently displayed on the user terminal 100 based on the game program 131 on the display unit 352 of the own device completely or in a simplified manner. Alternatively, the progress simulation unit 315 may grasp the progress of the current game, predict game progress after the current time based on the game program 131, and output the prediction result to the display unit 352.

  The character control unit 316 controls the behavior of the character displayed on the user terminal 100. Specifically, action instruction data for moving the character is generated and supplied to the user terminal 100. For example, the character control unit 316 generates action instruction data for instructing the control target character to speak based on voice data input by an operator (voice actor, etc.) via the microphone 3010. The action instruction data generated in this way includes at least the above-described voice data. Further, for example, an operation instruction data that instructs a character to be controlled to perform a motion based on the motion capture data input by the operator (model or the like) via the motion capture device 3020 is generated. The motion instruction data generated in this way includes at least the above-described motion capture data. In addition, for example, an instruction is given to move the character to be controlled based on the input operation history input through the input mechanism such as the controller 3030 or the operation unit such as the input unit 351, that is, operation history data. To generate action instruction data. The operation instruction data generated in this way includes at least the operation history data described above. For example, the operation history data is information in which operation logs indicating which buttons of the controller 3030 are pressed by the operator at which timing when which screen is displayed on the display unit are arranged in time series. . The display unit here is a display unit that is linked to the controller 3030, and may be the display unit 352 of the touch screen 35 or another display unit connected via the input / output IF 34. . Alternatively, the character control unit 316 specifies a command for instructing the character's action associated with the input operation input by the operator via the input mechanism or the operation unit. Then, the character control unit 316 generates a motion command group indicating a series of actions of the character by arranging the commands in the input order, and generates action instruction data instructing to move the character according to the motion command group. May be. The motion instruction data generated in this way includes at least the motion command group described above.

  The reaction processing unit 317 receives feedback on the user's reaction from the user terminal 100 and outputs it to the operator of the operation instruction device 300. In the present embodiment, for example, while the user terminal 100 moves a character according to the above-described action instruction data, the user can create a comment addressed to the character. The reaction processing unit 317 receives the comment data of the comment and outputs it. The reaction processing unit 317 may display text data corresponding to the user's comment on the display unit 352, or may output audio data corresponding to the user's comment from a speaker (not shown).

  Note that the functions of the user terminal 100, the server 200, and the operation instruction device 300 shown in FIG. 2 are merely examples. Each of the user terminal 100, the server 200, and the operation instruction device 300 may include at least a part of the functions of other devices. Furthermore, another device other than the user terminal 100, the server 200, and the operation instruction device 300 may be used as a component of the game system 1, and the other device may execute part of the processing in the game system 1. That is, the computer that executes the game program in the present embodiment may be any of the user terminal 100, the server 200, the operation instruction device 300, and another device other than that, and is realized by a combination of these devices. May be.

<Process overview>
In the present embodiment, the user terminal 100 is configured to execute the following steps based on the game program 131 in order to improve the fun of the game. Specifically, the user terminal 100 proceeds with the game in accordance with a user input operation input to the user terminal 100 via the operation unit (for example, the input unit 151), and at least one of the games appearing in the game. The step of transmitting progress information indicating the progress of the game to the action instruction device 300 that controls the character, and the voice data corresponding to the remarks of the character input in accordance with the progress of the game in the action instruction device 300 A step of receiving from the device 300, and a step of operating the character by causing the character appearing during the game to speak at least the content of the sound data, triggered by the reception of the sound data To do.

  In the present embodiment, the motion instruction device 300 is configured to execute the following steps based on the character control program 134 in order to improve the interest of the game. Specifically, the action instruction device 300 displays a progress screen indicating the progress of the game on the display unit 352 based on the progress information indicating the progress of the game received from the user terminal 100 that advances the game; Receiving voice data corresponding to the character's utterance input to the motion instruction device 300 in accordance with the progress of the game indicated by the progress screen displayed on the display unit 352, and receiving the received voice data. Transmitting to the user terminal 100.

  According to the above-described configuration, the progress of the game on the user terminal 100 is reported to the operation instruction device 300 while the user is playing the game. Therefore, the operator of the operation instruction device 300 can grasp how far the user has advanced the game. Thereby, the voice actor who receives the instruction from the operator or the operator can input voice data suitable for the progress of the user's game to the operation instruction device 300. Based on the progress, the voice data input from the operator to the operation instruction device 300 is supplied to the user terminal 100. The user terminal 100 causes the character to speak the contents of the audio data while the game is in progress. Thus, the user can play the game while recognizing the presence of a character that speaks the content that matches the progress of the game being played. Since the character can speak in accordance with the progress of the game, the user can feel a sense of reality as if the user is playing the game together. As a result, there is an effect of enhancing the sense of immersion in the game world and improving the fun of the game.

<Data structure>
(Screen transition information)
FIG. 3 is a diagram illustrating an example of the data structure of the screen transition information. As an example, the screen transition information includes items of “game part” and “screen information”.

  In the item “game part”, identification information of each part constituting the game is stored. As an example, this game is a competitive tennis game, and is composed of three parts: a tutorial part, a competitive part, and a lottery part.

  The item “screen information” stores information defining the screen displayed in each part and its transition. For example, in this game, in the tutorial part, an introduction screen of ID “0001” is displayed on the display unit 152, then a practice screen of ID “0002” is displayed, and finally an explanation screen of ID “0003” is displayed. The tutorial part is displayed.

  In the present embodiment, the user terminal 100 and the operation instruction device 300 may store and share this screen transition information in each storage unit. Thus, by simply transmitting and receiving a screen ID between the user terminal 100 and the operation instruction device 300, it is possible to easily determine which part of which game screen the user terminal 100 is currently displaying from the user terminal 100. 300 can be transmitted.

(Progress information)
FIG. 4 is a diagram illustrating an example of a data structure of progress information generated by the progress information generation unit 117 of the user terminal 100. As an example, the progress information includes items of “screen ID” and “progress log”.

  The item “screen ID” stores the above-described screen ID. The progress information generation unit 117 identifies the game screen currently displayed on the display unit 152 by the game progress unit 115 and stores the screen ID in the item.

  The item “progress log” stores a progress log of a game being executed by the game progress unit 115. For example, as the battle part progresses, the game progress unit 115 records the progress log in the storage unit 120 regularly or whenever an event to be recorded in the log occurs. The progress information generation unit 117 stores the latest progress log recorded by the game progress unit 115 in the item.

  The progress log is, for example, a record in which the time when an event occurs and the content of the event are linked in time series. The progress information generation unit 117 may store the entire progress log in the “progress log” item, or may store only a record of the progress log that has not yet been reported to the operation instruction apparatus 300.

  The progress information may further include items necessary for grasping the progress of the game according to the nature of the game. For example, in the competitive part of the competitive tennis game, the position of the player in the battle and the position of the ball that the players strike in the virtual game space change according to the user's input operation. Objects such as the above-described players and balls whose object attributes change in response to a user's input operation are hereinafter referred to as dynamic objects. The attribute of the object refers to, for example, the position, size, or shape of the object in the game space. Therefore, in the present embodiment, the progress information may further include an item “dynamic object”.

  The item “dynamic object” stores attribute-related information necessary for specifying the attribute of the dynamic object. The attribute related information may be, for example, coordinate information for specifying the position of the dynamic object in the game space. Alternatively, the attribute-related information may be information for specifying a moving path of the ball when the dynamic object is a ball, for example. For example, the progress information generation unit 117 acquires the velocity vector, the rotation axis, the rotation amount, and the like of the ball immediately after colliding with the racket from the game progression unit 115 and stores it in the item “dynamic object” as attribute related information. Also good.

  The progress information generation unit 117 generates progress information including the above-described items periodically or every time a predetermined event occurs while the game is in progress, and transmits it to the operation instruction device 300. Thereby, the operation instruction device 300 can grasp the progress of the game on the user terminal 100.

(Operation instruction data)
FIG. 5 is a diagram illustrating an example of a data structure of motion instruction data processed in the game system 1 according to the present embodiment. As an example, the operation instruction data includes meta information items “destination” and “creation source”, and data contents “character ID”, “speech”, “movement”, and “target location”. Each item is composed.

  The item “destination” stores destination designation information. The destination designation information is information indicating to which device the operation instruction data is transmitted. The destination designation information may be, for example, an address unique to the user terminal 100 or identification information of a group to which the user terminal 100 belongs. It may be a symbol (for example, “ALL” or the like) indicating that all user terminals 100 satisfying a certain condition are addressed.

  The item “creation source” stores creation source information. The creation source information is information indicating which device the motion instruction data is created by. The creation source information is information related to a user that can identify a specific user, such as a user ID, a user terminal ID, and a unique address of the user terminal. The creation source information may be an ID or an address indicating the server 200 or the operation instruction device 300. When the creation source is the server 200 or the operation instruction device 300, the value of the item is left empty. Alternatively, the item itself may not be provided in the operation instruction data.

  In the item “character ID”, a character ID for uniquely identifying a character appearing in the game is stored. The character ID stored here indicates which character's action the movement instruction data indicates.

  In the item “voice”, voice data to be expressed by the character is stored. The item “movement” stores motion data for designating the movement of the character. As an example, the motion data may be motion capture data acquired by the motion instruction device 300 via the motion capture device 3020. The motion capture data may be data that tracks the movement of the actor's entire body, data that tracks the facial expression of the actor and the movement of the mouth, or both. As another example, the motion data may be a group of motion commands that specify a series of movements of the character specified by an operation input by the operator of the motion instruction device 300 via the controller 3030. For example, when the commands “raise right hand”, “raise left hand”, “walk” and “run” are assigned to the buttons A, B, C and D of the controller 3030, respectively, When button A, button B, button C, and button D are successively pressed, the commands “raise right hand”, “raise left hand”, “walk”, and “run” are arranged in the above order. The motion command group is stored in the “movement” item as motion data. In the present embodiment, the audio data and the motion data are included in the operation instruction data in a synchronized state.

  In the item “attention spot”, attention information for specifying a spot to be noticed by the user in the exchange between the character and the user on the game screen displayed on the display unit 152 of the user terminal 100 is stored. The As an example, the attention information may be identification information that identifies an object that the user wants to focus attention on among the objects arranged on the game screen, for example, an object ID. Alternatively, the attention information may be position coordinates (second position coordinates) indicating a specific position of the display unit 152 that displays the game screen. In the present embodiment, the progress simulation unit 315 of the motion instruction device 300 may reproduce the game screen displayed on the display unit 152 of the user terminal 100 on the display unit 352. In this case, the operator of the operation instruction device 300 can specify a location to be noticed by the user via the input unit 351 by an input operation. The first position coordinate on the display unit 352 where the input operation has been performed is converted into the above-described second position coordinate by the character control unit 316. For example, the character control unit 316 displays the specifications (such as the number of pixels and the aspect ratio) of the touch screen 15 acquired in advance from the user terminal 100 and the reproduced game screen on the display unit 352 for the above-described conversion. Refer to the current position. Using these referenced information, the character control unit 316 can obtain the second position coordinate on the touch screen 15 of the user terminal 100 corresponding to the first position coordinate on the display unit 352 of the own device.

  For example, the display unit 352 and the input unit 351 may constitute the touch screen 35. In this case, the first position coordinate of the touch operation (input operation) input by the user on the simulated screen displayed on the display unit 352 is the character control unit 316 as the position coordinate on the touch screen 35 via the input unit 151. To be acquired. In another embodiment, the input unit 351 and the display unit 352 may be formed separately. For example, when the input unit 351 is an input device formed separately from the display unit 352, such as a mouse or a keyboard, the user uses a mouse to perform a predetermined operation on the simulated screen displayed on the display unit 352. Click a position. The first position coordinate of the click operation (input operation) input by the user on the simulated screen is determined based on the input timing of the click operation and the display position of the cursor displayed on the display unit 352 at that time. And supplied to the character control unit 316.

  When the game progression unit 115 of the user terminal 100 uses the information of “attention spot”, the game progression unit 115 performs display for surely telling the user the location on the game screen that the user wants to focus on. Is possible. For example, even if an instruction word such as “this”, “here”, “over there”, or “here” is included in the utterance of the character, the game progression unit 115 grasps the location indicated by the instruction word. You can highlight it. Therefore, the user can know exactly where the instruction word is pointing. As a result, a conversation including the instruction word is established between the user and the character. As a result, it is possible to realize natural communication between the user and the character with a realistic tempo as if the characters are playing together on the spot.

  By receiving such action instruction data, the game progression unit 115 can move the character appearing in the game as intended by the creator of the action instruction data. Specifically, when the motion instruction data includes voice data, the game progression unit 115 causes the character to speak based on the voice data, and when the motion instruction data includes motion data. Moves the character based on the motion data, that is, generates an animation of the character so as to move based on the motion data.

<Screen example>
(Progress screen)
FIG. 6 is a diagram illustrating an example of a progress screen displayed on the display unit 352 of the motion instruction device 300. In the present embodiment, the progress simulation unit 315 causes the display unit 352 to display the progress information acquired from the user terminal 100 as the progress screen 400, for example.

  The progress screen 400 includes a simulation screen 401 and a progress log 402 as an example. Furthermore, the progress screen 400 may include a UI component 403 for an operator (or a voice actor) to input voice data to the own apparatus via the microphone 3010. The progress screen 400 may include the same screen that is actually displayed on the display unit 152 of the user terminal 100 as the simulated screen 401, or may include a simulated screen 401 that is a simplified version of the screen. .

  The progress simulation unit 315 analyzes the progress information acquired from the user terminal 100. The progress simulation unit 315 identifies the game screen displayed on the user terminal 100 based on the screen ID included in the progress information. The progress simulation unit 315 displays the identified game screen on the display unit 352. For example, the progress simulation unit 315 may reproduce the above-described game screen in detail based on the game information 132, the user information 133, and the game program 131 stored in the storage unit 320. However, it is preferable that the progress simulation unit 315 generates a simulation screen 401 in which the above-described game screen is simplified in order to reduce the processing load. The simulated screen 401 includes only the minimum information necessary for the operator of the motion instruction device 300 to determine the progress of the game among the information arranged on the above-described game screen. The simulated screen 401 may include, for example, the drawing of the appearance of the object as the minimum information, and the layout of each object, the description of the function of each object, and the status of each object.

  Furthermore, it is preferable that the progress simulation unit 315 reproduces the attributes of the dynamic object arranged on the game screen on the simulation screen 401 based on the attribute related information of the dynamic object included in the progress information. For example, the progress simulation unit 315 may calculate the movement trajectory of the ball 404 based on the attribute-related information of the ball 404 that is a dynamic object, and move the ball 404 accordingly. Alternatively, the progress simulation unit 315 specifies the position of each player in the game space based on the attribute-related information of the player 405 operated by the user and the player 406 operated by the opponent user, which are dynamic objects. And the progress simulation part 315 determines the magnitude | size of each player based on the positional relationship of each player and a virtual camera, and arrange | positions each player to the specified position. Alternatively, the display size of each player is previously defined as attribute-related information, and the progress simulation unit 315 may arrange each player according to the defined display size.

  The progress simulation unit 315 arranges the progress log included in the progress information on the progress screen 400. For example, as illustrated, the progress simulation unit 315 generates a progress log 402 that includes, as text data, each record in which an event occurrence time and the event content are associated.

  As described above, the operator of the operation instruction apparatus 300 can grasp the progress of the game being executed on the user terminal 100 by checking the progress screen 400.

  Furthermore, the progress simulation unit 315 may include a prediction result obtained by predicting future game development from the current game progress on the progress screen 400 based on the game program 131. The progress simulation unit 315 may display the prediction result superimposed on the simulation screen 401, may display the prediction result so as to be switched to the simulation screen 401, or displays the prediction result side by side with the simulation screen 401. May be. Alternatively, the progress simulation unit 315 may additionally display the prediction result in the progress log 402. In this case, it is preferable that the progress simulation unit 315 displays the prediction result in a display mode different from the event that has already occurred, for example, a different character color.

  As a result, the operator of the motion instruction device 300 can advise the future based on the prediction result in addition to causing the character to speak about the current situation in accordance with the progress of the game on the user terminal. become. For example, in a competitive tennis game, it is assumed that a user is playing a part that plays against a computer. In this case, progress information indicating that the ball has been hit back based on the user's input operation is supplied from the user terminal 100 to the motion instruction device 300. Then, the progress simulation unit 315 can predict what ball the computer will return next based on the game program 131, and can superimpose and display the return ball trajectory on the simulation screen 401. The operator who sees this can input a voice so as to make the character advise, such as “Move right immediately! Come over here!”, Or specify the position pointed to by “here”. Also, for example, in the case of a battle board game such as shogi or othello, the progress simulation unit 315 detects one hand that the user is trying to point based on the progress information, and the one hand is actually pointed Predict the subsequent development of. If the progress simulating unit 315 determines that the one hand is a one hand that will determine the defeat, the progress simulating unit 315 may display a pop-up message to that effect on the simulation screen 401 or other blank area of the progress screen 400. Good. The operator who sees this can input a voice for advising the character, “You should stop there!”.

  It is assumed that the operation accepting unit 311 accepts an operator's touch operation on the UI component 403 arranged on the progress screen 400 when the microphone 3010 is in an invalid microphone input state. In this case, the character control unit 316 validates the input from the microphone 3010, acquires the voice data input via the microphone 3010, and includes it in the motion instruction data. It is assumed that the operation accepting unit 311 accepts an operator's touch operation on the UI component 403 arranged on the progress screen 400 when the microphone 3010 is enabled and the microphone is on. In this case, the character control unit 316 invalidates the input from the microphone 3010 again.

  As described above, after confirming the progress of the game, the operator determines the content of the utterance on the spot so as to match the progress, and sends the voice data corresponding to the content of the utterance to the operation instruction device 300. Can be entered.

  When the operation receiving unit 311 receives a touch operation on the display area of the simulated screen 401 from the operator, the character control unit 316 identifies which object on the simulated screen 401 is specified by the touch operation, and the object The identification information may be acquired. The character control unit 316 may store the identification information in the “attention spot” item of the motion instruction data. Alternatively, the character control unit 316 uses the first position coordinate of the touch operation on the touch screen 35 as the second position coordinate on the touch screen 15 of the user terminal 100 according to the specification of the display unit 152 of the user terminal 100. Convert to The character control unit 316 may store the second position coordinate for indicating the position of the touch operation of the operator in the coordinate system of the display unit 152 in the item “attention spot” of the motion instruction data.

  As described above, the operator confirms the progress of the game, and inputs voice data corresponding to the utterance content of the character so as to match the progress, while at the same time paying attention to the user at the same time as the utterance You can specify the location.

(Game screen)
When the game progression unit 115 of the user terminal 100 receives the movement instruction data from the movement instruction device 300 while the game is in progress, the game progression unit 115 superimposes the character specified by the movement instruction data on the currently displayed game screen, The character is moved based on the movement instruction data. For example, it is assumed that the game progression unit 115 receives the motion instruction data while displaying the practice screen of the tutorial part. In this case, the game progression unit 115 superimposes the character 801 on the practice screen 800 being displayed on the display unit 152. Then, the game progression unit 115 causes the character 801 to move based on the received movement instruction data.

  FIG. 7 is a diagram illustrating an example of a game screen displayed on the display unit 152 of the user terminal 100. In FIG. 7, as an example of the game screen displayed on the display unit 152, a practice screen 800 that is displayed second in the tutorial part of this game is illustrated.

  For example, the layout of the practice screen 800 is substantially the same as the layout of the battle screen displayed in the battle part. Specifically, the game progression unit 115 draws a court on the game space on the practice screen 800. And the game progress part 115 arrange | positions the player 803 which an opponent (COM in a tutorial part) operates in the back in front of the player 802 which a user operates. By viewing the practice screen 800 and operating the player 802 to play the tutorial part, the user can learn the operation method while performing the actual performance in the battle part. The progress information generating unit 117 generates progress information in a timely manner while the game progressing unit 115 advances the tutorial part, and transmits the progress information to the motion instruction device 300. For example, it is assumed that, following the rally, the skill gauge is accumulated, and the state of the player 802 is changed to a state where the skill can be activated. At this time, the progress information generation unit 117 transmits a progress log including an event that the skill activation button 804 has changed from being unavailable to being usable to the operation instruction apparatus 300 including the progress information.

  The game progression unit 115 may not display the character 801 as long as the action instruction data is not supplied from the action instruction device 300. Alternatively, the pre-made operation instruction data supplied in advance when the application of this game is downloaded may be stored in the storage unit 120 together with the game program 131. In this case, the game progression unit 115 may cause the character 801 to move based on the prepared action instruction data read from the storage unit 120 according to the game program 131.

  The operation instruction apparatus 300 that has received the progress information from the user terminal 100 displays the progress information on the display unit 352 as the progress screen 400 illustrated in FIG. 6 described above. The operator who has confirmed the progress screen 400 can determine that the user should be advised to use the skill activation button 804, for example. The operator or the voice actor 701 inputs the voice 700 including the advice that matches the progress of the game to the movement instruction device 300 via the microphone 3010. Further, the operator or model (person) 702 may input the movement of the character to the motion instruction device 300 via the motion capture device 3020 as necessary. In addition, the operator may operate the simulation screen 401 via the touch screen 35 as necessary, and specify a location that the user wants to pay attention to on the practice screen 800. In this way, motion instruction data including at least audio data, motion capture data added as necessary, and attention information is generated by the character control unit 316 and transmitted to the user terminal 100.

  In the present embodiment, when the analysis unit 116 receives movement instruction data from the movement instruction device 300, using this as a trigger, the game progression unit 115 places the character 801 on the practice screen 800 based on the received movement instruction data. Superimpose. Then, the motion indicated by the motion capture data included in the motion instruction data is reflected in the motion of the character 801. As described above, the motion capture data is obtained by acquiring the motion of the model 702 via the motion capture device 3020 at the installation location of the motion instruction device 300. Therefore, the movement of the model 702 is reflected on the movement of the character 801 displayed on the display unit 152 as it is.

  In addition, the game progression unit 115 outputs the audio data 805 included in the action instruction data supplied from the action instruction device 300 as the sound emitted by the character 801 in synchronization with the movement of the character 801. The voice data is obtained by acquiring the voice 700 of the voice actor 701 through the microphone 3010 at the installation location of the operation instruction device 300. Therefore, audio data 805 corresponding to the audio 700 uttered by the voice actor 701 is output as it is from the speaker of the user terminal 100.

  In addition, the game progression unit 115 highlights a place on the practice screen 800 pointed to by the attention information included in the above-described action instruction data. For example, when the attention information is identification information indicating the skill activation button 804 or the position coordinates where the skill activation button 804 is arranged, the game progression unit 115 highlights the skill activation button 804. For example, the game progression unit 115 changes the display mode of the skill activation button 804. As an example, the game progression unit 115 may change the color of the skill activation button 804, or may add animation such as blinking, edging, and moving up and down, left and right in small increments to the skill activation button 804.

  Alternatively, the game progression unit 115 may superimpose an instruction object 806 for designating a point of interest on the practice screen 800. Further, the game progression unit 115 may draw an instruction object 806 as an equipment of the character 801 and output an effect in which the character 801 points to the skill activation button 804 using the instruction object 806.

  According to the above-described configuration, the voice of the voice actor 701 that actually exists at the place where the motion instruction apparatus 300 is installed is emitted according to the progress of the game on the user terminal 100, and is directly reflected in the voice of the character 801. Similarly, the movement of the actual model 702 may be input to the motion instruction device 300 and supplied to the user terminal 100 together with the voice data. Thereby, according to the progress of the game, the character 801 can be moved according to the character 801 speaking. Further, the simulation screen 401 may be operated by the operator via the touch screen 35 at the installation location of the operation instruction device 300. In this case, in relation to the utterance content of the character 801, the location on the practice screen 800 that the user wants to pay attention to can be transmitted from the motion instruction device 300 to the user terminal 100. Thereby, as the character 801 speaks according to the progress of the game, it is possible to notify the user of a point of interest on the practice screen 800.

  While playing the game, as described above, the user sees the character 801 that behaves in accordance with the progress of the game, and the user feels the reality as if it exists in the real world. be able to. Furthermore, it can be felt as if the game is being played with the character 801, and as a result, the user can enjoy the game even more.

  Furthermore, the game progression unit 115 may cause the display unit 152 to display the character 801 to be displayed while the game is in progress in a display mode according to the play results so far.

  As an example, if an item that can be worn by the character 801 is acquired in the battle part or the lottery part that has been played so far, the game progression unit 115 combines the object of the item with the character 801. May be. According to the above-described configuration, the item acquired by the user playing this game can be reflected in the clothing item of the character 801.

  Thereby, the user can feel the attachment with the character 801 and further enjoy the game. Furthermore, the user's willingness to upgrade the clothes of the character 801 can be nurtured, and as a result, the motivation to play the game can be enhanced.

  Furthermore, in this embodiment, the game progression unit 115 may be able to input a comment addressed to the character 801 in response to the action of the character 801. As an example, the game progression unit 115 may arrange a comment input button 807 on the practice screen 800. The user touches the comment input button 807 to call a UI for inputting a comment, and operates the UI to input a comment addressed to the character 801. The UI may be for the user to select a desired comment from among several comments prepared in advance. The UI may be for a user to edit a character and input a comment. The UI may be for a user to input a comment by voice.

  Or, in a game where a user's input operation is always necessary for the game progress, such as a competitive tennis game, and the user has no time to perform an operation for inputting a comment, Even if the comment input button 807 is not provided, the user may always be configured to input voice.

  According to the above-described configuration, the user can play a game while enjoying interactive interaction with the character 801 in real time.

<Processing flow>
FIG. 8 is a flowchart showing the flow of processing executed by each device constituting the game system 1.

  In step S101, when the game progression unit 115 of the user terminal 100 receives an input operation for starting a game from the user, the game progression unit 115 accesses the server 200 and makes a login request.

  In step S102, the progress support unit 211 of the server 200 confirms that the status of the user terminal 100 is online, and responds that login has been accepted.

  In step S <b> 103, the game progression unit 115 advances the game according to a user input operation while communicating with the server 200 as necessary. For example, the game progression unit 115 advances a tutorial part, a battle part, or a lottery part.

  In step S <b> 104, the progress support unit 211 supports the game progress on the user terminal 100 by providing necessary information to the user terminal 100 as necessary.

  In step S <b> 105, when the live instruction time when the operation instruction data is distributed live from the operation instruction apparatus 300 to the user terminal 100, the sharing support unit 212 of the server 200 proceeds from YES in step S <b> 105 to step S <b> 106. The live distribution time is determined in advance by the game master, for example, and may be managed in the server 200 and the operation instruction device 300. In addition, the live distribution time may be notified to the user terminal 100 in advance, or may be kept secret until the live distribution time is actually reached. In the former case, live distribution can be stably supplied to the user, and in the latter case, live distribution with a special added value can be supplied to the user as a surprise distribution.

  In step S106, the sharing support unit 212 searches for one or more user terminals 100 that have the right to receive live distribution. The conditions for receiving live distribution may be set as appropriate by the game master, but at least the application of the game is installed, and online at the time of live distribution. In this embodiment, as an example, the sharing support unit 212 has a right to receive a specific user terminal 100 that has made a reservation to receive live distribution in advance at the above-described live distribution time. Explore as. Alternatively, the sharing support unit 212 may search for the user terminal 100 that is online at the time of the live distribution time, that is, that activates the application of this game, as the user terminal 100 that has the right to receive the live distribution. . Alternatively, the sharing support unit 212 may further add a condition that the user terminal 100 is owned by a user who has already paid the price for receiving live distribution.

  In step S107, the sharing support unit 212 notifies the operation instruction device 300 of the detected one or more user terminals 100. For example, the sharing support unit 212 may notify the operation instruction device 300 of the terminal ID of the user terminal 100, the user ID of the user who is the owner of the user terminal 100, the address of the user terminal 100, and the like.

  In step S <b> 108, the sharing support unit 212 notifies the user terminal 100 detected in step S <b> 106 of the operation instruction device 300 identified as a live distribution execution subject. For example, the sharing support unit 212 may notify the user terminal 100 of the address or device ID of the operation instruction device 300.

  On the other hand, in step S109, the character control unit 316 of the motion instruction device 300 proceeds from the YES in step S108 to the processing after S111 when the live distribution time comes. Alternatively, when the character control unit 316 receives a request for starting live distribution and information about the user terminal 100 that is a live distribution destination from the server 200 (after step S107), the character control unit 316 performs the processing after S111. You may start.

  The live distribution may be configured to start in response to a user request. In this case, the user terminal 100 transmits a request to the server 200 to request live distribution of the operation instruction data in accordance with a user input operation. At this time, if there is an operation instruction device 300 that can support live distribution, the server 200 returns a response indicating that live distribution is possible to the user terminal 100. In addition, information on the communication partner device is notified to each of the user terminal 100 and the operation instruction device 300 that have been matched.

  In step S <b> 110, the progress information generation unit 117 of the user terminal 100 generates progress information and transmits it to the operation instruction device 300. The progress information generation unit 117 updates the progress log periodically or whenever an event occurs while the game progresses by the game progress unit 115 from step S103 onward, and generates and transmits progress information in a timely manner. .

  In step S111, the progress simulation unit 315 of the motion instruction device 300 simulates the progress of the game on the user terminal 100 in its own device based on the progress information. For example, the progress simulation unit 315 generates a progress screen 400 indicating the progress of the game on the user terminal 100 based on the progress information, and displays the progress screen 400 on the display unit 352. As an example, the progress simulation unit 315 places a progress log 402 included in the progress information on the progress screen 400 as shown in FIG. Further, the progress simulation unit 315 identifies the game screen being displayed on the user terminal 100 based on the screen ID included in the progress information, and arranges the simulation screen 401 of the game screen on the progress screen 400. Further, the progress simulation unit 315 may reproduce the dynamic object on the simulation screen 401 based on the attribute related information of the dynamic object included in the progress information.

  In step S <b> 112, the character control unit 316 receives a voice uttered by an actor such as a voice actor as voice data via the microphone 3010.

  In step S113, the character control unit 316 acquires the motion input by an actor such as a model via the motion capture device 3020 as motion capture data.

  In step S <b> 114, the character control unit 316 specifies a location on the game screen that the user wants to pay attention to based on the touch operation input by the operator via the input unit 351 of the touch screen 35.

  Note that steps S112 to S114 may be executed in any order.

  In step S115, character control unit 316 generates action instruction data. Specifically, the character control unit 316 specifies a character to be superimposed on the game screen of the user terminal 100 and stores the character ID of the character in the item “character ID” of the motion instruction data. Which character is to be superimposed may be scheduled in advance by the game master and registered in the motion instruction device 300. Alternatively, the operator of the action instruction device 300 may specify in advance for the action instruction device 300 which character's action instruction data is to be created. The character control unit 316 stores at least the voice data acquired in step S112 in the “voice” item of the motion instruction data. If there is the motion capture data acquired in step S113, the character control unit 316 stores this in the item “movement” of the motion instruction data. The character control unit 316 preferably associates the audio data and the motion capture data so that the audio data and the motion capture data are synchronized. If there is a touch operation accepted in step S114, the character control unit 316 generates attention information based on the touch operation and stores it in the item “attention location” of the motion instruction data. The character control unit 316 sets the group identification information of the groups of these user terminals 100 so that one or more user terminals 100 notified from the server 200 in step S107 are the destinations. 100 addresses are stored in the “destination” item of the operation instruction data as destination designation information.

  In step S116, the character control unit 316 transmits the action instruction data generated as described above to each user terminal 100 designated as the destination via the communication IF 33. The character control unit 316 obtains voice data and motion capture data obtained by the actor's voice or movement, and immediately renders the voice data and motion capture data into action instruction data, and distributes them to each user terminal 100 in real time. It is desirable.

  Note that steps S112 to S116 may be executed after step S107 and prior to step S111.

  In step S117, the analysis unit 116 of the user terminal 100 receives the above-described operation instruction data via the communication IF 13. For example, the analysis unit 116 may receive the operation instruction data at a time when it is predicted in advance from the operation instruction device 300 or the server 200 that live distribution is performed.

  In step S118, the analysis unit 116 immediately analyzes the received operation instruction data using the reception as a trigger.

  In step S119, the game progression unit 115 superimposes the character specified by the moving image instruction data analyzed by the analysis unit 116 on the game screen being displayed on the display unit 152, and adds the character to the action instruction data. Operate based on. Specifically, the game progression unit 115 superimposes the character 801 on the display unit 152 where the practice screen 800 shown in FIG. The game progression unit 115 displays the voice and movement in real time in real time at the same time that actors such as the voice actor 701 and the model 702 are uttering or moving at the installation location of the movement instruction device 300. This is reflected in the utterance and movement of the character 801 at 800. The analysis unit 116 and the game progression unit 115 continue to render and play a real-time moving image while the operation instruction data is continuously received from the operation instruction device 300. Specifically, the game progression unit 115 does not accept any input operation from the user, and returns to step S103 from NO in step S120 and repeats the subsequent steps while the operation instruction data is received.

  In step S120, when the operation receiving unit 111 receives an input operation from the user while the character is moving based on the action instruction data, the game progressing unit 115 proceeds from YES in step S120 to step S121. For example, the operation reception unit 111 receives an input operation on the comment input button 807 on the practice screen 800.

  In step S <b> 121, game progression unit 115 transmits comment data generated in response to the input operation described above to action instruction device 300. Specifically, the game progression unit 115 may transmit the comment ID of the selected comment as comment data. Or the game progress part 115 may transmit the text data of the text input by the user as comment data. Or the game progress part 115 may transmit the audio | voice audio | voice data input by the user as comment data. Or the game progress part 115 may recognize the audio | voice input by the user, and may transmit what was converted into text data as comment data.

  In step S122, the reaction processing unit 317 of the motion instruction device 300 receives the comment data transmitted from the user terminal 100 via the communication IF 33.

  In step S123, reaction processing unit 317 outputs the received comment data to operation instruction device 300. For example, the reaction processing unit 317 displays text data included in the comment data on the display unit 352. As a result, the operator or the actor can receive feedback indicating what kind of reaction the user has shown to the character that they have moved. Then, the operator or the actor can determine the action of the further character in accordance with this feedback. In other words, the motion instruction device 300 returns to step S112, continues to acquire voice data and motion capture data as necessary, and continues to provide the motion instruction data to the user terminal 100. The user terminal 100 receives the operation instruction data transmitted from the operation instruction device 300 after the content of the input operation at the own terminal is received by the operation instruction device 300. Specifically, the user terminal 100 receives voice instruction data corresponding to the content of the character's utterance and motion instruction data including motion capture data corresponding to the character's movement. Then, the user terminal 100 continuously moves the character based on the movement instruction data. As a result, the user can experience interactive interaction with the character in real time. Instead of the motion capture data, the user terminal 100 may receive a motion command group in which one or more commands instructing the character's motion are arranged in the order instructed by the operator of the motion instruction device 300. The motion command group is also linked in synchronism with the audio data in the same manner as the motion capture data. As a result, the game progression unit 115 of the user terminal 100 can move the character according to the motion command group as the content of the audio data is uttered.

[Embodiment 2]
In the present embodiment, the motion instruction device 300 communicates with a plurality of user terminals 100 participating in the multiplayer game, and grasps the progress of the game on each user terminal 100 based on the progress information for each user terminal 100. Then, the action instruction device 300 generates action instruction data for causing the character to perform behavior that matches the overall progress, and distributes it to each user terminal 100.

  The game executed in the game system 1 according to the present embodiment (hereinafter, this game) is a car racing game in which, as an example, a plurality of users operate each vehicle to go around the same course and compete for the time. is there.

  The progress simulation unit 315 of the motion instruction device 300 according to the present embodiment acquires progress information from each of the plurality of user terminals 100 participating in the same race. The progress simulation unit 315 may acquire integrated progress information indicating the progress of the entire race from the server 200 that supports the progress of the race and performs synchronous control. The progress simulation unit 315 may arrange the acquired progress information for each user side by side on the progress screen, or may integrate the respective progress information and arrange the overall progress obtained thereby on the progress screen. . Alternatively, the progress simulation unit 315 may arrange the already integrated progress information received from the server 200 on the progress screen.

  The character control unit 316 distributes the motion instruction data generated as described above to a plurality of user terminals 100 participating in the same race.

  In the present embodiment, the individual progress information for each user terminal 100 includes, for example, “user ID”, “user name”, “current position”, “rank”, “lap”, and “time (difference from the top)”. Each item may be included. The integrated progress information generated by the server 200 may include items of “elapsed time”, “top lap”, “course map”, and “current position of each race car”.

<Screen example>
(Progress screen)
FIG. 9 is a diagram illustrating another example of the progress screen displayed on the display unit 352 of the motion instruction device 300. In the present embodiment, the progress simulation unit 315 integrates the progress information acquired from each user terminal 100 and displays the progress screen 500 on the display unit 352.

  The progress screen 500 includes, as an example, an integrated progress chart 501, an individual progress list 502, and integrated progress information 503. Furthermore, the progress screen 500 may include a UI component 403 for an operator (or a voice actor) to input voice data to the own apparatus via the microphone 3010.

  The progress simulation unit 315 analyzes the progress information acquired from the user terminal 100 and the server 200. Based on the analysis result, the progress simulation unit 315 specifically generates the integrated progress diagram 501 as follows. The progress simulation unit 315 draws a course map based on the “course map” information included in the integrated progress information, and is operated by each user based on the “current position of each race car” information. The race car object is plotted on the course map described above.

  Further, the progress simulation unit 315 generates the individual progress list 502 as follows. The progress simulation unit 315 extracts items of “user name”, “rank”, “lap”, and “time” from the individual progress information. Then, information on each item is arranged so that each extracted item is listed for each user, and an individual progress list 502 is generated.

  The progress simulation unit 315 may extract an item “top lap” from the integrated progress information and reflect this in the integrated progress information 503.

  As described above, the operator of the operation instruction apparatus 300 can grasp the entire progress of the game being executed on the plurality of user terminals 100 by checking the progress screen 500.

  The progress screen 500 may be provided with a UI component 403. Thereby, after confirming the overall progress of the game, the operator determines the content of the utterance on the spot so as to match the progress, and sends the voice data corresponding to the content of the utterance to the operation instruction device 300. Can be entered.

(Game screen)
FIG. 10 is a diagram illustrating an example of a game screen displayed on the display unit 152 of the user terminal 100. In FIG. 10, as an example of the game screen displayed on the display unit 152, a race screen 600 displayed while the race is in progress in this game is illustrated. Moreover, the race screen 600 shows the screen displayed on the user terminal 100 of the user who is running the top of the race as an example.

  For example, the game progression unit 115 draws a course in the game space on the race screen 600. And the game progress part 115 arrange | positions the race car which a user operates. When the race car operated by another user falls within the angle of view due to the positional relationship with the virtual camera position in the game space, the game progression unit 115 places the other user's race car on the race screen 600. May be.

  The progress information generation unit 117 generates the progress information in a timely manner while the game progression unit 115 advances the race, and transmits the progress information to the motion instruction device 300.

  The operation instruction device 300 that receives the individual progress information from each user terminal 100 participating in the race and receives the integrated progress information from the server 200 that synchronizes the race, The processed image is displayed on the display unit 352 as a progress screen 500 shown in FIG. The operator who confirms the progress screen 500 can grasp the situation of the race and determine the actual contents. The operator or voice actor 701 inputs the voice including the actual situation suitable for the race development to the operation instruction device 300 via the microphone 3010. In addition, the operator or model 702 may input the movement of the character to the motion instruction device 300 via the motion capture device 3020 as necessary.

  In the present embodiment, when the analysis unit 116 receives movement instruction data from the movement instruction device 300, using this as a trigger, the game progression unit 115 causes the character 601 to appear on the race screen 600 based on the received movement instruction data. Superimpose. For example, it is preferable that the area where the character 601 can be superimposed is determined in advance for each game screen at a place where the user's play is not hindered. Then, the motion indicated by the motion capture data included in the motion instruction data is reflected in the motion of the character 601. Similar to the first embodiment, the motion capture data is obtained by acquiring the motion of the model 702 via the motion capture device 3020 at the installation location of the motion instruction device 300. Therefore, the movement of the model 702 is reflected on the movement of the character 801 displayed on the display unit 152 as it is.

  In addition, the game progression unit 115 outputs the audio data 602 included in the action instruction data supplied from the action instruction device 300 as the sound emitted by the character 601 in synchronization with the movement of the character 601. As in the first embodiment, the voice data is obtained by acquiring the voice of the voice actor 701 through the microphone 3010 at the installation location of the motion instruction apparatus 300. Therefore, the audio data 602 corresponding to the voice uttered by the voice actor 701 is output from the speaker of the user terminal 100 as it is.

  The action instruction device 300 can transmit the action instruction data described above to all the user terminals 100 participating in the game. Therefore, the character 601 is superimposed and displayed together with the race screen 600 on each display unit 152 of the participating user terminal 100.

  According to the above-described configuration, the present invention can be applied to a multiplayer game in which a plurality of user terminals 100 participate.

[Example of software implementation]
Control blocks of the control unit 110 (particularly, the operation reception unit 111, the display control unit 112, the UI control unit 113, the animation generation unit 114, the game progress unit 115, the analysis unit 116, and the progress information generation unit 117), and the control of the control unit 210 Blocks (particularly, the progress support unit 211 and the sharing support unit 212), and control blocks of the control unit 310 (particularly, the operation reception unit 311, the display control unit 312, the UI control unit 313, the animation generation unit 314, and the progress simulation unit 315) The character control unit 316 and the reaction processing unit 317) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or by software using a CPU (Central Processing Unit). May be.

  In the latter case, the control unit 110, the control unit 210, the control unit 310, or an information processing apparatus including a plurality of them includes a CPU that executes instructions of a program that is software that implements each function, A ROM (Read Only Memory) or a storage device (these are referred to as “recording media”) in which data is recorded so as to be readable by a computer (or CPU), a RAM (Random Access Memory) for expanding the program, and the like are provided. . And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

[Additional Notes]
The contents according to one aspect of the present invention are listed as follows.

  (Item 1) The game program (131) has been described. According to an aspect of the present disclosure, a game program includes a processor (10), a memory (11), and an operation unit (communication IF 13, input / output IF 14, touch screen 15, camera 17, distance sensor 18, input unit 151, and the like). It is executed by a computer (user terminal 100) provided. The game program causes the processor to advance the game in response to a user input operation input to the computer via the operation unit (S103), and character control to control at least one character (801) appearing in the game A step (S110) of transmitting progress information indicating the progress of the game to the device (motion instruction device 300), and voice data corresponding to the utterance of the character input in accordance with the progress of the game in the character control device, The step of receiving from the character control device (S117) and the reception of the voice data as a trigger, causing the character appearing during the game to speak at least the contents of the voice data to move the character. Step (S119) is executed. Thereby, there is an effect of enhancing the sense of immersion in the game world and improving the fun of the game.

  (Item 2) In (Item 1), the receiving step receives motion capture data corresponding to the movement of the character, which is input in accordance with the progress of the game in the character control device, together with voice data from the character control device. The step of operating may move the character in accordance with the motion capture data as the content of the audio data is uttered.

  According to the above configuration, motion capture data in addition to audio data is also supplied from the character control device to the user terminal. In accordance with the progress of the game on the user terminal, the voice and movement input in the character control device can be reflected in the voice and movement of the character displayed on the user terminal. Therefore, during the game play, the user can enjoy the interaction with the character as if the character were participating in the game together with the interaction with the real person. The sense of reality that the user can remember can be further enhanced.

  (Item 3) In (Item 1), the receiving step includes a motion command group including one or more commands for instructing a character's action specified by an input operation input to the character control device in accordance with the progress of the game. The step of receiving and operating together with the voice data from the character control device may move the character according to the motion command group as the contents of the voice data are uttered. For example, if an operator inputs a series of movements of a character by performing an operation input via an input unit other than a motion capture device, such as a button, keyboard, mouse, joystick, or touch screen, the character determined by the operation input is determined. Motion command groups corresponding to a series of movements are supplied to the user terminal. The user terminal moves the character according to the motion command group. Therefore, based on the progress of the game on the user terminal, the movement instructed by the operator in the character control device can be reflected in the movement of the character displayed on the user terminal. Therefore, during the game play, the user can enjoy the interaction with the character as if the character were participating in the game together with the interaction with the real person. The sense of reality that the user can remember can be further enhanced.

  (Item 4) In any one item from (Item 1) to (Item 3), the character control device displays the screen displayed on the display unit (152) of the user terminal or the screen based on the progress information. A simplified simulation screen (401) is displayed on the display unit (352) of the character control device, and the receiving step is designated by an input operation input to the character control device in accordance with the progress of the game. The step of receiving and operating the identification information (attention information) for identifying the object on the screen together with the voice data from the character control device is the screen specified by the identification information as the content of the voice data is uttered. The upper object (skill activation button 804) may be highlighted.

  (Item 5) In any one item from (Item 1) to (Item 3), the character control device simplifies the screen displayed on the display unit of the user terminal or the screen based on the progress information. The simulated screen is displayed on the display unit of the character control device in accordance with the specifications of the display unit of the user terminal, and the receiving step is performed on the screen or simulated screen displayed on the display unit of the character control device. Receiving the second position coordinates on the display unit of the user terminal corresponding to the first position coordinates of the input operation input in accordance with the progress of the game together with the voice data from the character control device, and operating the second position coordinates. The location indicated by the second position coordinates may be highlighted as the content of the audio data is uttered.

  (Item 6) The character control program (134) has been described. The character control program is a program for controlling the character (801) appearing in the game. According to an aspect of the present disclosure, a character control program includes a processor (30), a memory (31), and a display unit (communication IF 33, input / output IF 34, touch screen 35, display unit 352, etc.) as a character control device. It is executed by a computer (operation instruction apparatus 300). The character control program causes the processor to display a progress screen (400) indicating the progress of the game on the display unit (352) based on the progress information indicating the progress of the game received from the user terminal (100) that advances the game. A step of displaying (S111) and a step of receiving voice data corresponding to the character's utterance input to the computer (motion instruction apparatus 300) in accordance with the progress of the game indicated by the progress screen displayed on the display unit (S112) And the step of transmitting the received audio data to the user terminal (S116). Thereby, there is an effect of enhancing the sense of immersion in the game world and improving the fun of the game.

  (Item 7) In (Item 6), the step of displaying displays a progress screen including a screen displayed on the display unit of the user terminal or a simulated screen obtained by simplifying the screen based on the progress information. You may display on a display part. According to the configuration described above, the operator can determine the utterance content of the character while confirming the game screen displayed on the user terminal. Thereby, it is possible to cause the character to perform utterance full of realism.

  (Item 8) In (Item 6) or (Item 7), the displaying step displays a progress screen including a prediction result related to the progress of the game predicted based on the progress information on the display unit of the character control device. Also good. Accordingly, the operator can cause the character to give advice according to the predicted future game development in addition to causing the character to speak about the current situation in accordance with the progress of the game on the user terminal.

  (Item 9) In any one item from (Item 6) to (Item 8), the step of displaying includes receiving each of the plurality of user terminals that advance the game synchronously between the plurality of user terminals. The step of displaying and transmitting the progress information on the display unit of the character control device may transmit voice data to each of the plurality of user terminals.

  (Item 10) The method for executing the game program (131) has been described. According to an aspect of the present disclosure, a game program includes a processor (10), a memory (11), and an operation unit (communication IF 13, input / output IF 14, touch screen 15, camera 17, distance sensor 18, input unit 151, and the like). It is executed by a computer as a user terminal (100). The method is a method in which the processor executes each step described in (Item 1). The method according to (Item 10) has the same effects as the game program according to (Item 1).

  (Item 11) The information processing apparatus has been described. According to an aspect of the present disclosure, the information processing apparatus includes a storage unit (120) that stores a game program according to (Item 1), an operation unit (communication IF 13, input / output IF 14, touch screen 15, camera 17, measurement unit). A distance sensor 18, an input unit 151, and the like) and a control unit (110) that controls the operation of the information processing apparatus (user terminal 100) by executing the game program. The information processing apparatus according to (Item 11) has the same effects as the game program according to (Item 1).

  (Item 12) The method of executing the character control program (134) has been described. According to an aspect of the present disclosure, a character control program includes a processor (30), a memory (31), and a display unit (communication IF 33, input / output IF 34, touch screen 35, display unit 352, and the like). It is executed by a computer as the instruction device 300). The method is a method in which the processor executes each step described in (Item 6). The method according to (Item 12) has the same effects as the character control program according to (Item 6).

  (Item 13) The information processing apparatus has been described. According to an aspect of the present disclosure, the information processing apparatus includes a storage unit (320) that stores a character control program according to (Item 6), a display unit (communication IF 33, input / output IF 34, touch screen 35, display unit 352). And a control unit (310) for controlling the operation of the information processing apparatus by executing the character control program. The information processing apparatus according to (Item 13) has the same effects as the character control program according to (Item 6).

1 game system, 2 network, 10, 20, 30 processor, 11, 21, 31 memory, 12, 22, 32 storage, 13, 23, 33 communication IF (operation unit), 14, 24, 34 input / output IF (operation Part, display part), 15, 35 Touch screen (display part, operation part), 17 Camera (operation part), 18 Distance sensor (operation part), 100 User terminal (computer, information processing apparatus), 110, 113, 210, 310 control unit, 111, 311 operation reception unit, 112, 312 display control unit, 113, 313 UI control unit, 114, 314 animation generation unit, 115 game progress unit, 116 analysis unit, 117 progress information generation unit, 120 , 220, 320 storage unit, 131 game program, 132 game information, 133 user information, 134 character control program, 151, 351 input unit (operation unit), 152, 352 display unit, 200 server (computer), 211 progress support unit, 212 sharing support unit, 300 motion instruction device (computer, NPC control device, character control) Device, information processing device), 315 progress simulation unit, 316 character control unit, 317 reaction processing unit, 1010 object, 1020, 3030 controller, 1030 storage medium, 3010 microphone, 3020 motion capture device

Claims (13)

A game program,
The game program is executed by a computer as a user terminal including a processor, a memory, and an operation unit,
The game program is stored in the processor.
Advancing a game in response to a user input operation input to the computer via the operation unit;
Transmitting progress information indicating progress of the game to a character control device that controls at least one character appearing in the game;
Receiving, from the character control device, voice data corresponding to the utterance of the character input in accordance with the progress of the game in the character control device;
A game program that, when triggered by receiving the voice data, causes the character appearing during the game to execute at least the content of the voice data to operate the character. The receiving step receives motion capture data corresponding to the movement of the character, which is input in accordance with the progress of the game in the character control device, together with the audio data from the character control device,
2. The game program according to claim 1, wherein in the operating step, the character is moved according to the motion capture data as the content of the audio data is uttered. 3. The step of receiving includes, from the character control device, a motion command group including one or more commands that specify the action of the character specified by an input operation input to the character control device in accordance with the progress of the game. Received with the audio data,
The game program according to claim 1, wherein, in the step of operating, the character is moved according to the motion command group as the content of the voice data is uttered. The character control device displays, on the display unit of the character control device, a screen displayed on the display unit of the user terminal or a simulated screen obtained by simplifying the screen based on the progress information.
In the receiving step, identification information for identifying an object on the screen designated by an input operation input to the character control device in accordance with the progress of the game is received from the character control device together with the audio data. ,
The game according to any one of claims 1 to 3, wherein in the operating step, the object on the screen specified by the identification information is highlighted as the content of the audio data is uttered. program. The character control device controls, based on the progress information, a screen displayed on the display unit of the user terminal or a simulated screen obtained by simplifying the screen according to the specifications of the display unit of the user terminal. Displayed on the display of the device,
The receiving step corresponds to a first position coordinate of an input operation input in accordance with the progress of the game on the screen or the simulated screen displayed on the display unit of the character control device, Receiving the second position coordinate on the display unit of the user terminal together with the voice data from the character control device;
The game program according to any one of claims 1 to 3, wherein in the operating step, a portion indicated by the second position coordinate is highlighted as the content of the audio data is uttered. A character control program for controlling a character appearing in a game,
The character control program is executed by a computer as a character control device including a processor, a memory, and a display unit,
The character control program is stored in the processor.
Displaying a progress screen indicating the progress of the game on the display unit based on progress information indicating the progress of the game received from the user terminal that progresses the game;
Receiving voice data corresponding to the utterance of the character input to the computer in accordance with the progress of the game indicated by the progress screen displayed on the display unit;
And a step of transmitting the received voice data to the user terminal.   In the displaying step, the progress screen including a screen displayed on the display unit of the user terminal or a simulated screen obtained by simplifying the screen is displayed on the display unit of the character control device based on the progress information. The character control program according to claim 6.   The character control according to claim 6 or 7, wherein the displaying step displays the progress screen including a prediction result related to the progress of the game predicted based on the progress information on a display unit of the character control device. program. In the displaying step, the progress information received from each of the plurality of user terminals that causes the game to proceed in synchronization between the plurality of user terminals is displayed on the display unit of the character control device,
The character control program according to any one of claims 6 to 8, wherein the transmitting step transmits the audio data to each of the plurality of user terminals. A method for a computer to execute a game program,
The computer includes a processor, a memory, and an operation unit.
The method by which the processor performs the steps of claim 1. An information processing apparatus,
The information processing apparatus includes:
A storage unit for storing the game program according to claim 1;
An operation unit;
An information processing apparatus comprising: a control unit that controls the operation of the information processing apparatus by executing the game program. A method for a computer to execute a character control program comprising:
The computer includes a processor, a memory, and a display unit.
A method for the processor to perform the steps of claim 6. An information processing apparatus,
The information processing apparatus includes:
A storage unit for storing the character control program according to claim 6;
A display unit;
An information processing apparatus comprising: a control unit that controls the operation of the information processing apparatus by executing the character control program.

Images