JP7170077B2 - program - Google Patents

Description

The present invention relates to a game program, a game method, and an information processing device.

There is a positional information game in which a game operator is notified of the position of his/her own mobile terminal to calculate the distance traveled and the current position, and the game is advanced based on the calculated data. As such a location information game, there is a game in which a monster is obtained by searching for monsters (hereafter referred to as monsters) located all over the country and displaying the image of the monster on the screen of the terminal owned by the user. There was (for example, non-patent document 1).

“Yokai Watch World”, [online], [Searched on September 11, 2018], Internet <https://youkaiww.gungho.jp/>

However, in the game of Non-Patent Document 1, in order to display the image of the monster on the screen of the terminal, it is necessary to match the orientation of the terminal with the position of the monster. At this time, a movement occurs in which the terminal is shaken up, down, left, or right. For this reason, the user may be suspicious of a third party around the user.

The present invention has been devised in view of such circumstances, and an object of the present invention is to provide a game program, a game method, and an information processing method that enable a user to concentrate on a game without being suspicious by a third party in the surroundings. to provide the equipment.

According to an aspect of one embodiment shown in the present disclosure, there is provided a game program executed in an information terminal device including a processor, a memory, an input section, and a display section. The game program causes the processor to generate virtual space data for identifying a virtual space associated with a predetermined image, place an object in the virtual space, and place a virtual camera in the virtual space. a third step of controlling the field of view area from the virtual camera according to the user's operation on the information terminal device; and a fourth step of displaying an image corresponding to the field of view area on the display unit; The first step is to update the virtual space data so as to move the object in the direction in which it is placed within the viewing area when the object is not placed within the viewing area.

According to one aspect of one embodiment, there is provided a game method executed by an information terminal device comprising a processor, a memory, an input section, and a display section. The game method includes a first step in which a computer generates virtual space data for enabling identification of a virtual space associated with a predetermined image, arranges an object in the virtual space, and arranges a virtual camera in the virtual space. a second step of controlling the visual field area from the virtual camera according to the user's operation on the information terminal device; a fourth step of displaying an image corresponding to the visual field area on the display unit; In step 1, when the object is not placed within the viewing area, the virtual space data is updated so as to move the object in the direction of placing it within the viewing area.

According to an aspect of one embodiment, an information processing device is provided that includes a storage section that stores a game program, and a control section that controls the operation of the information processing device by executing the game program. The control unit generates virtual space data for enabling identification of a virtual space associated with a predetermined image, arranges an object in the virtual space, and arranges a virtual camera in the virtual space. a third step of controlling a field-of-view area from a virtual camera according to a user's operation on the information terminal device; a fourth step of displaying an image corresponding to the field-of-view area on a display; updates the virtual space data so as to move the object in the direction in which it is placed within the viewing area if the object is not placed within the viewing area.

According to the present invention, it is possible to concentrate on the game without being seen as a suspicious person by a third party in the vicinity.

It is a figure which shows the hardware constitutions of a game system. 3 is a block diagram showing functional configurations of a user terminal, a server, and a motion instruction device; FIG. 4 is a flowchart showing an example of basic game progress of a game executed based on the game program according to the embodiment; It is a figure which shows an example of the data structure of action instruction data. It is a figure which shows an example of the data structure of game information. It is a figure which shows an example of the quest presentation screen displayed on the display part of a user terminal. It is a figure which shows an example of the quest solution screen displayed on the display part of a user terminal. It is a figure which shows an example of the reward screen displayed on the display part of a user terminal. FIG. 10 is a diagram showing an example of a video playback screen displayed on the display unit of the user terminal; 4 is a flow chart showing the flow of processing executed in the game system; (A) is a diagram showing an example of a map including icons, and (B) is a diagram showing an example of a map including icons. FIG. 2 is a diagram conceptually representing one aspect of representing a virtual space; (A) is a diagram showing an example of a state in which an aiming image and a monster are superimposed on a panoramic image, and (B) is a diagram showing an example of a state in which the aiming image and a monster are superimposed on the panoramic image. (A) is a diagram showing an example of a state in which an avatar is superimposed on a panorama image, and (B) is a diagram showing a state in which the field of view of the virtual camera is panned to the left from the state of (A). 4 is a flowchart showing part of the flow of processing executed in the game system; FIG. 11 is a flowchart showing another part of the flow of processing executed in the game system; FIG. 4 is a flowchart showing part of the flow of processing executed in a user terminal;

[Embodiment 1]
A game system according to the present disclosure is a system for providing a game to multiple users. The game system will be described below with reference to the drawings. The present invention is not limited to these examples, but is indicated by the scope of the claims, and is intended to include all modifications within the meaning and scope of equivalents to the scope of the claims. be. In the following description, the same reference numerals are given to the same elements in the description of the drawings, and redundant description will not be repeated.

<Hardware Configuration of Game System 1>
FIG. 1 is a diagram showing the hardware configuration of the game system 1. As shown in FIG. The game system 1 includes a plurality of user terminals 100 and a server 200 as shown. Each user terminal 100 is connected to the server 200 via the network 2 . The network 2 includes the Internet and various mobile communication systems constructed by wireless base stations (not shown). Examples of mobile communication systems include so-called 3G, 4G mobile communication systems, LTE (Long Term Evolution), and wireless networks (eg, Wi-Fi (registered trademark)) that can be connected to the Internet through a predetermined access point. be done.

The server 200 (computer, information processing device) may be a workstation or a general-purpose computer such as a personal computer. The server 200 includes a processor 20, a memory 21, a storage 22, a communication IF 23, and an input/output IF 24. These components included in the server 200 are electrically connected to each other by a communication bus.

The user terminal 100 (computer, information processing device) may be a mobile terminal such as a smart phone, a feature phone, a PDA (Personal Digital Assistant), or a tablet computer. The user terminal 100 may be a game device suitable for playing games. As illustrated, the user terminal 100 includes a processor 10, a memory 11, a storage 12, a communication interface (IF) 13, an input/output IF 14, a touch screen 15 (display unit), a camera (imaging unit) 17, and a ranging sensor 18 . These components provided in the user terminal 100 are electrically connected to each other by a communication bus. Note that the user terminal 100 may include an input/output IF 14 to which a display (display unit) configured separately from the user terminal 100 main body can be connected instead of or in addition to the touch screen 15 .

Also, as shown in FIG. 1, user terminal 100 may be configured to communicate with one or more controllers 1020 . The controller 1020 establishes communication with the user terminal 100 according to communication standards such as Bluetooth (registered trademark), for example. The controller 1020 may have one or more buttons or the like, and transmits to the user terminal 100 an output value based on the user's input operation on the buttons or the like. Also, the controller 1020 may have various sensors such as an acceleration sensor and an angular velocity sensor, and transmits output values of the various sensors to the user terminal 100 .

Note that the controller 1020 may have the camera 17 and the ranging sensor 18 instead of or in addition to the user terminal 100 having the camera 17 and the ranging sensor 18 .

The user terminal 100 preferably allows the user using the controller 1020 to input user identification information such as the user's name or login ID via the controller 1020, for example, at the start of the game. As a result, the user terminal 100 can associate the controller 1020 with the user, and identifies which user the output value belongs to based on the transmission source (controller 1020) of the received output value. be able to.

When the user terminal 100 communicates with a plurality of controllers 1020 , each user can hold each controller 1020 to communicate with the one user terminal 100 without communicating with other devices such as the server 200 via the network 2 . You can play multiplayer with. In addition, by connecting each user terminal 100 to each other for communication according to a wireless standard such as a wireless LAN (Local Area Network) standard (connecting for communication without going through the server 200), a plurality of user terminals 100 can realize local multiplay. You can also When the above-described multiplay is locally realized by one user terminal 100, the user terminal 100 may further include at least a part of various functions of the server 200, which will be described later. Also, in the case where multiple user terminals 100 locally implement the above-described multiplay, the multiple user terminals 100 may be provided with various functions of the server 200, which will be described later, in a distributed manner.

Note that the user terminal 100 may communicate with the server 200 even when the multiplay described above is implemented locally. For example, information indicating a play result such as score or win/loss in a certain game may be associated with user identification information and transmitted to the server 200 .

Also, the controller 1020 may be detachable from the user terminal 100 . In this case, at least one surface of the housing of the user terminal 100 may be provided with a coupling portion for the controller 1020 . When the user terminal 100 and the controller 1020 are connected by wire through the connecting unit, the user terminal 100 and the controller 1020 transmit and receive signals via the wire.

As shown in FIG. 1 , the user terminal 100 may receive the attachment of an external storage medium 1030 such as a memory card via the input/output IF 14 . This allows the user terminal 100 to read programs and data recorded on the storage medium 1030 . A program recorded in the storage medium 1030 is, for example, a game program.

User terminal 100 may store a game program acquired by communicating with an external device such as server 200 in memory 11 of user terminal 100, or may store a game program acquired by reading from storage medium 1030 in memory 11. may be stored in

As described above, the user terminal 100 includes the communication IF 13, the input/output IF 14, the touch screen 15, the camera 17, and the ranging sensor 18 as an example of a mechanism for inputting information to the user terminal 100. FIG. Each unit described above as an input mechanism can be regarded as an operation unit configured to receive a user's input operation.

For example, when the operation unit is composed of at least one of the camera 17 and the ranging sensor 18, the operation unit detects an object 1010 near the user terminal 100, and performs an input operation based on the detection result of the object. Identify. As an example, a user's hand as object 1010, a marker of a predetermined shape, or the like is detected, and an input operation is specified based on the color, shape, movement, type, or the like of object 1010 obtained as a detection result. be. More specifically, when the user's hand is detected from the image captured by the camera 17, the user terminal 100 detects a gesture (a series of movements of the user's hand) detected based on the captured image as an input operation of the user. identified and accepted as Note that the captured image may be a still image or a moving image.

Alternatively, when the operation unit is configured by the touch screen 15, the user terminal 100 identifies and accepts the user's operation performed on the input unit 151 of the touch screen 15 as the user's input operation. Alternatively, when the operation unit is configured by the communication IF 13, the user terminal 100 identifies and accepts a signal (for example, an output value) transmitted from the controller 1020 as the user's input operation. Alternatively, when the operation unit is configured by the input/output IF 14, a signal output from an input device (not shown) different from the controller 1020 connected to the input/output IF 14 is specified as the user's input operation and accepted.

In this embodiment, the game system 1 further includes an action instruction device 300 . Action instruction device 300 connects to server 200 and user terminal 100 via network 2 . At least one motion instruction device 300 is provided in the game system 1 . A plurality of motion instruction devices 300 may be provided according to the number of user terminals 100 that use the service provided by the server 200 . One motion instruction device 300 may be provided for one user terminal 100 . One motion instruction device 300 may be provided for a plurality of user terminals 100 .

The action instruction device 300 (NPC control device, character control device) may be a computer such as a server, a desktop computer, a notebook computer, or a tablet, or a group of computers combining these. The motion instruction device 300 includes a processor 30, a memory 31, a storage 32, a communication IF 33, an input/output IF 34, and a touch screen 35 (display unit), as shown. These components provided in the operation instruction device 300 are electrically connected to each other by a communication bus. Note that the action instruction device 300 may include an input/output IF 34 to which a display (display unit) configured separately from the action instruction device 300 main body can be connected instead of or in addition to the touch screen 35 .

Also, as shown in FIG. 1 , the motion instruction device 300 can communicate with peripheral devices, such as one or more microphones 3010, one or more motion capture devices 3020, and one or more controllers 3030, wirelessly or via wires. may be configured to be communicable with each other. A wirelessly connected peripheral device establishes communication with the motion instruction device 300 according to a communication standard such as Bluetooth (registered trademark), for example.

A microphone 3010 acquires sounds generated in the surroundings and converts them into electric signals. The voice converted into the electrical signal is transmitted as voice data to action instruction device 300 and received by action instruction device 300 via communication IF 33 .

Motion capture device 3020 tracks the motion (including facial expression, mouth movement, etc.) of a tracked object (for example, a person), and transmits an output value as a tracking result to motion instruction device 300 . Motion data, which is an output value, is received by the motion instruction device 300 via the communication IF 33 . The motion capture method of motion capture device 3020 is not particularly limited. The motion capture device 3020 selectively includes any mechanism for capturing motion, such as a camera, various sensors, markers, a suit worn by a model (person), a signal transmitter, etc., depending on the adopted method. .

Controller 3030 may have physical input mechanisms such as one or more buttons, levers, sticks, wheels, or the like. Controller 3030 transmits to action instruction device 300 an output value based on an input operation input to the input mechanism by the operator of action instruction device 300 . Further, the controller 3030 may have various sensors such as an acceleration sensor and an angular velocity sensor, and may transmit the output values of the various sensors to the motion instruction device 300 . The output values described above are received by the motion instruction device 300 via the communication IF 33 . It should be noted that hereinafter, a person who performs some input operation on the action instruction device 300 using an operation unit provided in the action instruction device 300 or various input mechanisms communicably connected to the action instruction device 300 will be described. called an operator. The operator includes a person who operates the motion instruction device 300 using the input unit 351, the controller 3030, etc., a voice actor who inputs voice via the microphone 3010, and a motion capture device 3020. It also includes a model that inputs .

The motion instruction device 300 may include a camera and a range sensor (not shown). The motion capture device 3020 and the controller 3030 may have a camera and a range sensor instead of or in addition to the motion instruction device 300 .

As described above, the action instruction device 300 includes the communication IF 33 , the input/output IF 34 and the touch screen 35 as an example of a mechanism for inputting information to the action instruction device 300 . A camera and a distance measuring sensor may be further provided as necessary. Each unit described above as an input mechanism can be regarded as an operation unit configured to receive a user's input operation.

The operation unit may be composed of the touch screen 35 . In this case, the action instruction device 300 identifies and accepts the user's operation performed on the input unit 351 of the touch screen 35 as the user's input operation. Alternatively, when the operation unit is configured by the communication IF 33, the action instruction device 300 identifies and accepts a signal (for example, an output value) transmitted from the controller 3030 as the user's input operation. Alternatively, when the operation unit is configured by the input/output IF 34, a signal output from an input device (not shown) different from the controller 3030 connected to the input/output IF 34 is specified as the user's input operation and accepted.

<Game Overview>
A game executed by the game system 1 according to the present embodiment (hereinafter referred to as "this game") is, for example, a game in which one or more characters appear and at least one of the characters moves based on action instruction data. . A character appearing in the game may be a player character (hereinafter referred to as PC) or a non-player character (hereinafter referred to as NPC). PC is a character that can be directly operated by the user. NPCs are characters that act according to game programs and action instruction data, that is, characters that cannot be directly operated by the user. Hereinafter, when there is no particular need to distinguish between the two, the generic term "character" is used.

As an example, this game is a breeding simulation game. Specifically, in the breeding simulation game, the main character, who is the user, interacts with and works with the character to make the character a famous video distributor and realize the dream of the character. It is an object. Furthermore, the breeding simulation game may include elements of a romance simulation game in which the main character aims to increase intimacy with the character through interaction.

Furthermore, the game preferably includes at least a live distribution part, as an example. In the game system 1, action instruction data is supplied at arbitrary timing from a device other than the user terminal 100 to the user terminal 100 that is executing the game. The user terminal 100 analyzes (renders) the action instruction data triggered by the reception of the action instruction data. The live distribution part is a part in which the user terminal 100 presents to the user in real time a character that moves according to the above-described analyzed action instruction data. As a result, the user can have a realistic feeling as if the character really exists, and can enjoy the game while being more immersed in the game world.

In this embodiment, the game may consist of a plurality of play parts. In this case, one character may be a PC in one part and an NPC in another part.

The game genre is not limited to a specific genre. The game system 1 can execute games of all genres. For example, sports-themed games such as tennis, table tennis, dodgeball, baseball, soccer and hockey, puzzle games, quiz games, RPGs (Role-Playing Games), adventure games, shooting games, simulation games, training games, and It may be an action game or the like.

Also, the play pattern of the game executed in the game system 1 is not limited to a specific play pattern. The game system 1 can execute games of all play types. For example, a single-player game played by a single user, a multi-play game played by a plurality of users, and among multi-play games, a competitive game in which a plurality of users compete against each other, and a cooperative play game in which a plurality of users work together. may

<Hardware components of each device>
Processor 10 controls the overall operation of user terminal 100 . The processor 20 controls the operation of the server 200 as a whole. The processor 30 controls the operation of the entire motion instruction device 300 . Processors 10, 20 and 30 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit).

The processor 10 reads a program from a storage 12, which will be described later, and develops it in a memory 11, which will be described later. The processor 20 reads a program from a storage 22, which will be described later, and develops it in a memory 21, which will be described later. The processor 30 reads a program from a storage 32, which will be described later, and develops it in a memory 31, which will be described later. Processor 10, processor 20 and processor 30 execute the expanded program.

Memories 11, 21 and 31 are main storage devices. The memories 11, 21 and 31 are composed of storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory). The memory 11 provides a work area for the processor 10 by temporarily storing programs and various data read by the processor 10 from a storage 12 described later. The memory 11 also temporarily stores various data generated while the processor 10 is operating according to the program. The memory 21 provides a work area for the processor 20 by temporarily storing various programs and data read by the processor 20 from a storage 22 described later. The memory 21 also temporarily stores various data generated while the processor 20 is operating according to the program. The memory 31 provides a work area for the processor 30 by temporarily storing various programs and data read by the processor 30 from a storage 32 described later. The memory 31 also temporarily stores various data generated while the processor 30 is operating according to the program.

The program in this embodiment may be a game program for realizing a game by the user terminal 100 . Alternatively, the program may be a game program for realizing the game through cooperation between user terminal 100 and server 200 . Alternatively, the program may be a game program for realizing the game by cooperation of the user terminal 100, the server 200, and the action instruction device 300. FIG. Note that, as an example, the game realized by the cooperation of the user terminal 100 and the server 200 and the game realized by the cooperation of the user terminal 100, the server 200, and the motion instruction device 300 are started in the user terminal 100. It may be a game that runs on a browser. Alternatively, the program may be a game program for realizing the game by cooperation of a plurality of user terminals 100 . Further, the various data includes game-related data such as user information and game information, and instructions or notifications transmitted and received between the devices of the game system 1 .

Storages 12, 22 and 32 are auxiliary storage devices. The storages 12, 22 and 32 are composed of storage devices such as flash memories or HDDs (Hard Disk Drives). The storages 12, 22 and 32 store various data related to the game.

The communication IF 13 controls transmission and reception of various data in the user terminal 100 . The communication IF 23 controls transmission and reception of various data in the server 200 . The communication IF 33 controls transmission and reception of various data in the motion instruction device 300 . Communication IFs 13, 23 and 33 control, for example, communication via a wireless LAN (Local Area Network), Internet communication via a wired LAN, wireless LAN, or mobile phone network, and communication using short-range wireless communication. .

The input/output IF 14 is an interface for the user terminal 100 to receive data input, and an interface for the user terminal 100 to output data. The input/output IF 14 may input/output data via a USB (Universal Serial Bus) or the like. The input/output IF 14 may include physical buttons, a camera, a microphone, or a speaker of the user terminal 100, for example. The input/output IF 24 of the server 200 is an interface for the server 200 to receive data input and an interface for the server 200 to output data. The input/output IF 24 may include, for example, an input section that is an information input device such as a mouse or a keyboard, and a display section that is a device for displaying and outputting images. The input/output IF 34 of the action instruction device 300 is an interface for the action instruction device 300 to receive data input and an interface for the action instruction device 300 to output data. The input/output IF 34 includes, for example, information input devices such as a mouse, keyboard, stick, and lever, devices for displaying images such as a liquid crystal display, and peripheral devices (microphone 3010, motion capture device 3020, and controller 3030). may include a connection for sending and receiving data between.

The touch screen 15 of the user terminal 100 is an electronic component in which an input section 151 and a display section 152 are combined. The touch screen 35 of the motion instruction device 300 is an electronic component in which an input section 351 and a display section 352 are combined. The input units 151 and 351 are, for example, touch-sensitive devices, and are configured by, for example, touch pads. The display units 152 and 352 are configured by, for example, liquid crystal displays or organic EL (Electro-Luminescence) displays.

The input units 151 and 351 detect the position at which the user's operation (mainly physical contact operation such as touch operation, slide operation, swipe operation, and tap operation) is input on the input surface, and provide information indicating the position. as an input signal. The input units 151 and 351 may include a touch sensing unit (not shown). The touch sensing unit may employ any type of system, such as a capacitive system or a resistive film system.

Although not shown, the user terminal 100 may include one or more sensors for identifying the holding posture of the user terminal 100 . This sensor may be, for example, an acceleration sensor or an angular velocity sensor. If the user terminal 100 is equipped with a sensor, the processor 10 can identify the holding posture of the user terminal 100 from the output of the sensor and perform processing according to the holding posture. For example, when the user terminal 100 is held vertically, the processor 10 may display a vertically long image on the display unit 152 for vertical screen display. On the other hand, when the user terminal 100 is held horizontally, a horizontal screen display may be used in which a horizontally long image is displayed on the display unit. Thus, the processor 10 may be able to switch between vertical screen display and horizontal screen display according to the holding posture of the user terminal 100 .

The camera 17 includes an image sensor or the like, and generates a captured image by converting incident light from a lens into an electrical signal.

The distance sensor 18 is a sensor that measures the distance to the object to be measured. The ranging sensor 18 includes, for example, a light source that emits pulse-converted light and a light receiving element that receives the light. The distance measuring sensor 18 measures the distance to the measurement object based on the light emission timing from the light source and the light reception timing of the reflected light generated when the light emitted from the light source hits the measurement object and is reflected. The ranging sensor 18 may have a light source that emits directional light.

Here, an example in which the user terminal 100 uses the camera 17 and the ranging sensor 18 to detect the object 1010 near the user terminal 100 and accepts the detection result as the user's input operation will be further described. The camera 17 and the ranging sensor 18 may be provided on the side of the housing of the user terminal 100, for example. A ranging sensor 18 may be provided near the camera 17 . As the camera 17, for example, an infrared camera can be used. In this case, the camera 17 may be provided with an illumination device that emits infrared light, a filter that blocks visible light, and the like. This makes it possible to further improve the object detection accuracy based on the image captured by the camera 17, regardless of whether it is outdoors or indoors.

The processor 10 may perform one or more of the following processes (1) to (5) on the image captured by the camera 17, for example. (1) The processor 10 performs image recognition processing on the captured image of the camera 17 to identify whether or not the captured image includes the user's hand. The processor 10 may use a technique such as pattern matching, for example, as the analysis technique employed in the image recognition processing described above. (2) The processor 10 also detects a user's gesture from the shape of the user's hand. For example, the processor 10 identifies the number of fingers of the user (the number of extended fingers) from the shape of the user's hand detected from the captured image. Processor 10 further identifies the gesture made by the user from the identified number of fingers. For example, when the number of fingers is five, processor 10 determines that the user has performed the "pa" gesture. In addition, when the number of fingers is 0 (no fingers are detected), the processor 10 determines that the user has performed the "goo" gesture. In addition, when the number of fingers is two, the processor 10 determines that the user has made the "Scissors" gesture. (3) The processor 10 performs image recognition processing on the image captured by the camera 17 to detect whether the user's finger is in a state in which only the index finger is raised or whether the user's finger is flicking. . (4) The processor 10 detects an object 1010 (such as a user's hand) near the user terminal 100 based on at least one of the image recognition result of the captured image of the camera 17 and the output value of the distance measuring sensor 18. ) and the user terminal 100 is detected. For example, the processor 10 determines whether the user's hand is close to the user terminal 100 (for example, a distance less than a predetermined value) or far away from the user terminal 100 (for example, a predetermined value or more distance). Note that when the captured image is a moving image, the processor 10 may detect whether the user's hand is approaching or moving away from the user terminal 100 . (5) When it is found that the distance between the user terminal 100 and the user's hand has changed while the user's hand is detected based on the image recognition result of the captured image of the camera 17, the processor 10 recognizes that the user is waving his hand in the photographing direction of the camera 17 . When an object is detected or not detected by the ranging sensor 18, which has a stronger directivity than the imaging range of the camera 17, the processor 10 detects that the user is waving his hand in a direction orthogonal to the imaging direction of the camera. recognize.

In this way, the processor 10 determines whether or not the user is clenching his/her hand (a "goo" gesture or another gesture (for example, "pa") by image recognition of the captured image of the camera 17. or) is detected. The processor 10 also detects how the user is moving the hand together with the shape of the user's hand. The processor 10 also detects whether the user is moving his/her hand closer to or away from the user terminal 100 . Such operations can correspond to operations using a pointing device such as a mouse or a touch panel, for example. For example, the user terminal 100 moves the pointer on the touch screen 15 according to the movement of the user's hand, and detects the user's gesture "goo". In this case, the user terminal 100 recognizes that the user is continuing the selection operation. The continuation of the selection operation corresponds to, for example, maintaining the state in which the mouse is clicked and pushed in, or maintaining the state of being touched after performing a touchdown operation on the touch panel. Further, when the user moves his/her hand while the user's gesture "goo" is detected, the user terminal 100 performs such a series of gestures as an operation corresponding to the swipe operation (or drag operation). can also recognize. Further, when the user terminal 100 detects a gesture such as flicking a finger based on the detection result of the user's hand from the captured image of the camera 17, the user terminal 100 detects the gesture by clicking the mouse or tapping the touch panel. may be recognized as an operation corresponding to

<Functional Configuration of Game System 1>
FIG. 2 is a block diagram showing functional configurations of the user terminal 100, the server 200, and the action instruction device 300 included in the game system 1. As shown in FIG. Each of the user terminal 100, the server 200, and the action instruction device 300 has a functional configuration (not shown) required to function as a general computer and a functional configuration required to realize known functions in the game. can include

The user terminal 100 has a function as an input device that receives user input operations and a function as an output device that outputs game images and sounds. The user terminal 100 functions as a control unit 110 and a storage unit 120 through cooperation of the processor 10, memory 11, storage 12, communication IF 13, input/output IF 14, and the like.

The server 200 has a function of communicating with each user terminal 100 and assisting the user terminal 100 in progressing the game. For example, when the user terminal 100 downloads an application related to this game for the first time, the user terminal 100 is provided with data to be stored in the user terminal 100 when the game is started for the first time. For example, the server 200 transmits action instruction data for causing a character to act to the user terminal 100 . The action instruction data may contain motion capture data in which the movements of an actor such as a model are captured in advance, may contain audio data in which the voice of an actor such as a voice actor is recorded, or may be used to move a character. It may include operation history data indicating a history of input operations for , or may include a motion command group in which commands associated with the series of input operations described above are arranged in chronological order. If the game is a multiplayer game, the server 200 may have a function of communicating with each user terminal 100 participating in the game to mediate communication between the user terminals 100 and a synchronization control function. The server 200 also has a function of intermediating between the user terminal 100 and the motion instruction device 300 . As a result, the action instruction device 300 can timely supply the action instruction data to the user terminal 100 or a group of a plurality of user terminals 100 without making a mistake in the destination. The server 200 functions as a control unit 210 and a storage unit 220 through cooperation of the processor 20, memory 21, storage 22, communication IF 23, input/output IF 24, and the like.

The action instruction device 300 has a function of generating action instruction data for instructing the action of the character on the user terminal 100 and supplying it to the user terminal 100 . Operation instruction device 300 functions as control unit 310 and storage unit 320 through cooperation of processor 30, memory 31, storage 32, communication IF 33, input/output IF 34, and the like.

Storage units 120 , 220 and 320 store game program 131 , game information 132 and user information 133 . The game program 131 is a game program executed by the user terminal 100 , the server 200 and the motion instruction device 300 . Game information 132 is data referred to when control units 110 , 210 and 310 execute game program 131 . User information 133 is data relating to a user's account. Game information 132 and user information 133 are stored in storage units 220 and 320 for each user terminal 100 . Storage unit 320 further stores character control program 134 . The character control program 134 is a program executed by the action instruction device 300, and is a program for controlling the action of the character appearing in the game based on the game program 131 described above.

(Functional Configuration of Server 200)
The control unit 210 performs overall control of the server 200 by executing the game program 131 stored in the storage unit 220 . For example, the control unit 210 transmits various data, programs, etc. to the user terminal 100 . The control unit 210 receives part or all of the game information or user information from the user terminal 100 . If the game is a multi-play game, the control unit 210 may receive a multi-play synchronization request from the user terminal 100 and transmit data for synchronization to the user terminal 100 . In addition, the control unit 210 communicates with the user terminal 100 and the motion instruction device 300 as necessary to transmit and receive information.

Control unit 210 functions as progress support unit 211 and sharing support unit 212 according to the description of game program 131 . The control unit 210 can also function as other functional blocks (not shown) in order to support the progress of the game on the user terminal 100 according to the nature of the game to be executed.

The progress support unit 211 communicates with the user terminal 100 and supports the user terminal 100 to progress various parts included in the game. For example, when the user terminal 100 progresses the game, the progress support unit 211 provides the user terminal 100 with information necessary for progressing the game.

The sharing support unit 212 communicates with a plurality of user terminals 100 and supports a plurality of users to share each other's decks in their respective user terminals 100 . Further, the sharing support unit 212 may have a function of matching the online user terminal 100 and the action instruction device 300 . As a result, information can be smoothly transmitted and received between the user terminal 100 and the motion instruction device 300 .

(Functional Configuration of User Terminal 100)
The control unit 110 comprehensively controls the user terminal 100 by executing the game program 131 stored in the storage unit 120 . For example, the control unit 110 progresses the game according to the game program 131 and user's operation. Further, while the game is progressing, the control unit 110 communicates with the server 200 and the action instruction device 300 as necessary to transmit and receive information.

Control unit 110 controls operation receiving unit 111, display control unit 112, user interface (hereinafter referred to as UI) control unit 113, animation generation unit 114, game progression unit 115, analysis unit 116, and progress It functions as an information generator 117 . The control unit 110 can also function as other functional blocks (not shown) in order to advance the game according to the nature of the game to be executed.

The operation accepting unit 111 detects and accepts a user's input operation on the input unit 151 . The operation reception unit 111 determines what kind of input operation has been performed from the user's action on the console via the touch screen 15 and other input/output IF 14, and outputs the result to each element of the control unit 110. do.

For example, the operation accepting unit 111 accepts an input operation on the input unit 151, detects the coordinates of the input position of the input operation, and identifies the type of the input operation. The operation reception unit 111 identifies, for example, a touch operation, a slide operation, a swipe operation, a tap operation, and the like, as types of input operations. Further, when the continuously detected input is interrupted, the operation reception unit 111 detects that the contact input from the touch screen 15 has been cancelled.

The UI control unit 113 controls UI objects to be displayed on the display unit 152 to construct the UI. The UI object is a tool for the user to make inputs necessary for the progress of the game to the user terminal 100, or a tool for obtaining information output from the user terminal 100 during the progress of the game. UI objects include, but are not limited to, icons, buttons, lists, menu screens, and the like.

The animation generation unit 114 generates animations showing motions of various objects based on control modes of the various objects. For example, the animation generation unit 114 may generate an animation or the like that expresses how a character moves, moves its mouth, or changes its facial expression as if it were there.

The display control unit 112 outputs to the display unit 152 of the touch screen 15 a game screen on which the processing results executed by the elements described above are reflected. The display control section 112 may display the game screen including the animation generated by the animation generation section 114 on the display section 152 . Further, the display control unit 112 may draw the above-described UI objects controlled by the UI control unit 113 so as to be superimposed on the game screen.

The game progression unit 115 advances the game. In this embodiment, the game progression unit 115 advances the game in accordance with the user's input operation input via the operation reception unit 111 . During the progress of the game, the game progress section 115 makes one or more characters appear and causes the characters to act. The game progression unit 115 may cause the character to act according to the game program 131 downloaded in advance, may cause the character to act according to the user's input operation, or may act according to the action instruction data supplied from the action instruction device 300 . may be operated according to

When the game is divided into a plurality of parts such as a first part, a second part, and so on, the game progression section 115 progresses the game according to the specifications of each part.

To give a concrete example, let us say that the first part is a story part in which the story in the game progresses through interaction with the character. In this case, the game progression unit 115 progresses the story part as follows. Specifically, the game progression unit 115 causes the character to move according to the pre-downloaded game program 131 or pre-downloaded action instruction data (first action instruction data). The game progression unit 115 identifies an option selected by the user based on the user's input operation received by the operation reception unit 111, and causes the character to perform an action associated with the option. Assume that the second part is a live distribution part in which a character moves based on the action instruction data supplied from the action instruction device 300 . In this case, based on the action instruction data from the action instruction device 300, the game progression unit 115 moves the character to progress the live distribution part.

The analysis unit 116 analyzes (renders) the action instruction data and instructs the game progression unit 115 to move the character based on the analysis result. In this embodiment, the analysis unit 116 is triggered by the action instruction data supplied by the action instruction device 300 being received via the communication IF 33, and starts rendering the action instruction data. The action instruction device 300 transmits the analysis result to the game progression unit 115 and immediately instructs the character to move based on the action instruction data. That is, the game progression unit 115 is triggered by the reception of the action instruction data, and moves the character based on the action instruction data. This makes it possible to show the user a character that moves in real time.

The progress information generation unit 117 generates progress information indicating the progress of the game being executed by the game progression unit 115, and transmits the progress information to the server 200 or the action instruction device 300 as appropriate. The progress information may include, for example, information specifying the currently displayed game screen, or may include a progress log indicating the progress of the game in chronological order using characters, symbols, and the like. In an embodiment in which the server 200 and the action instruction device 300 do not require progress information in the game system 1, the progress information generation section 117 may be omitted.

(Functional configuration of motion instruction device 300)
Control unit 310 executes character control program 134 stored in storage unit 320 to comprehensively control action instruction device 300 . For example, the control unit 310 generates action instruction data according to the character control program 134 and operator's operation, and supplies the data to the user terminal 100 . Control unit 310 may further execute game program 131 as necessary. In addition, the control unit 310 communicates with the server 200 and the user terminal 100 executing the game to transmit and receive information.

The control unit 310 functions as an operation reception unit 311 , a display control unit 312 , a UI control unit 313 , an animation generation unit 314 , a progress simulation unit 315 and a character control unit 316 according to the description of the character control program 134 . Control unit 310 can also function as other functional blocks (not shown) in order to control characters appearing in the game according to the nature of the game executed in game system 1 .

The operation reception unit 311 detects and receives an operator's input operation to the input unit 351 . The operation reception unit 311 determines what kind of input operation has been performed from the operator's action on the console via the touch screen 35 and other input/output IFs 34, and sends the result to each element of the control unit 310. Output. The details of the functions of the operation reception unit 311 are substantially the same as those of the operation reception unit 111 in the user terminal 100 .

The UI control unit 313 controls UI objects displayed on the display unit 352 .

The animation generation unit 314 generates animations showing motions of various objects based on control modes of the various objects. For example, the animation generation unit 314 may generate an animation or the like that reproduces the game screen actually displayed on the user terminal 100 that is the communication partner.

The display control unit 312 outputs a game screen on which the processing results executed by the above-described elements are reflected to the display unit 352 of the touch screen 35 . The details of the functions of the display control unit 312 are substantially the same as those of the display control unit 112 in the user terminal 100 .

The progress simulating unit 315 grasps the progress of the game in the user terminal 100 based on the progress information indicating the progress of the game received from the user terminal 100 . Then, the progress simulating unit 315 presents the progress of the user terminal 100 to the operator by simulatively reproducing the behavior of the user terminal 100 in the action instruction device 300 .

For example, the progress simulating unit 315 may display a reproduction of the game screen displayed on the user terminal 100 on the display unit 352 of its own device. Further, the progress simulating unit 315 may display the progress of the game on the display unit 352 in the user terminal 100 as the progress log described above.

Also, part of the functions of the progress simulating unit 315 may be realized by the control unit 310 executing the game program 131 . For example, first, the progress simulating unit 315 grasps the progress of the game of the user terminal 100 based on the progress information. Then, the progress simulating unit 315 may reproduce the game screen currently displayed on the user terminal 100 based on the game program 131 completely or in a simplified manner on the display unit 352 of its own device. Alternatively, the progress simulating unit 315 may grasp the current game progress, predict the game progress after the current time based on the game program 131 , and output the prediction result to the display unit 352 .

The character control unit 316 controls behavior of characters displayed on the user terminal 100 . Specifically, action instruction data for causing the character to act is generated and supplied to the user terminal 100 . For example, the character control unit 316 generates action instruction data for instructing the character to be controlled to speak, based on voice data input by an operator (voice actor, etc.) via the microphone 3010 . The action instruction data generated in this manner includes at least the voice data described above. Also, for example, an operator (model or the like) generates action instruction data for instructing a character to be controlled to move based on motion capture data input via the motion capture device 3020 . The motion instruction data generated in this manner includes at least the motion capture data described above. Also, for example, the operator instructs to move the character to be controlled based on the history of input operations input via the input mechanism such as the controller 3030 or the operation unit such as the input unit 351, that is, based on the operation history data. Generate operation instruction data to The action instruction data generated in this manner includes at least the operation history data described above. The operation history data is, for example, information in which an operation log indicating which button of the controller 3030 was pressed by the operator at what timing when which screen was displayed on the display unit is arranged in chronological order. . The display unit here is a display unit linked with the controller 3030, and may be the display unit 352 of the touch screen 35, or may be another display unit connected via the input/output IF 34. . Alternatively, the character control unit 316 identifies a command that instructs the action of the character associated with the input operation input by the operator via the above-described input mechanism or operation unit. Then, the character control unit 316 arranges the commands in the order in which they were input to generate a motion command group indicating a series of actions of the character, and generates action instruction data instructing the character to move according to the motion command group. may The action instruction data generated in this manner includes at least the motion command group described above.

The reaction processing unit 317 receives feedback on the user's reaction from the user terminal 100 and outputs it to the operator of the action instruction device 300 . In this embodiment, for example, the user terminal 100 allows the user to create a comment addressed to the character while the character is moving according to the action instruction data described above. The reaction processing unit 317 receives the comment data of the comment and outputs it. The reaction processing unit 317 may display text data corresponding to the user's comment on the display unit 352, or may output voice data corresponding to the user's comment from a speaker (not shown).

Note that the functions of the user terminal 100, the server 200, and the motion instruction device 300 shown in FIG. 2 are merely examples. Each of user terminal 100, server 200, and action instruction device 300 may have at least part of the functions of other devices. Further, a device other than the user terminal 100, the server 200, and the action instruction device 300 may be used as a component of the game system 1, and the other device may be caused to execute part of the processing in the game system 1. FIG.
That is, the computer that executes the game program in this embodiment may be any of the user terminal 100, the server 200, the motion instruction device 300, and other devices, or may be realized by combining a plurality of these devices. may be

Note that the progress simulating unit 315 may be omitted in the present embodiment. Also, in this embodiment, the control unit 310 can function as a reaction processing unit 317 according to the description of the character control program 134 .

<Game structure>
FIG. 3 is a flow chart showing an example of basic game progress of this game. The game is, for example, divided into two gameplay parts. As an example, the first part is the story part and the second part is the live distribution part. The game may also include an acquisition part in which the user acquires game media, which are digital data that can be used in the game, in exchange for valuable data owned by the user. In this embodiment, the play order of each part is not particularly limited. FIG. 3 shows a case where the user terminal 100 executes the game in order of story part, acquisition part, and live distribution part.

In step S1, the game progression unit 115 executes the story part. The story part includes, for example, scenes in which the main character operated by the user interacts with the character. In this embodiment, as an example, a “scenario” collected as digital data corresponds to one episode of a story about a character, is supplied from the server 200 and is temporarily stored in the storage unit 120 . In the story part, the game progression unit 115 reads out one scenario stored in the storage unit 120 and advances the scenario according to the user's input operation until the end of the scenario is reached. A scenario includes options to be selected by the user, response patterns of characters corresponding to the options, etc. Depending on which option the user selects, different endings may be obtained even in one scenario. . Specifically, the game progression unit 115 presents a plurality of options corresponding to the actions of the protagonist to the character so that the user can select them, and progresses the scenario according to the options selected by the user.

In step S2, when the user plays the scenario to the end, the game progression unit 115 may cause the user to obtain a reward according to the ending. The reward is provided to the user, for example, as game media, which is digital data that can be used in the game. Game media may be, for example, items such as accessories that can be worn by characters. Here, "allowing the user to obtain a reward" may mean, for example, transitioning the status of the game content as a reward managed in association with the user from unusable to usable. Alternatively, game media may be stored in at least one of the memories (memory 11, memory 21, memory 31) included in game system 1 in association with user identification information or user terminal ID.

At step S3, the game progression unit 115 executes the acquisition part. In the acquisition part, the game content to be acquired by the user may be a new scenario different from the scenario provided to the user terminal 100 at the time of initial download. Hereinafter, the former scenario will be referred to as a fixed scenario, and the latter scenario will be referred to as an acquisition scenario. When there is no need to distinguish between the two, they are simply referred to as scenarios.

In the acquisition part, for example, the game progression unit 115 allows the user to possess an acquisition scenario different from the fixed scenario already possessed by the user in exchange for consuming the user's valuable data. The scenario to be acquired by the user may be determined by the game progress section 115 or the progress support section 211 of the server 200 according to a predetermined rule. More specifically, the game progress unit 115 or the progress support unit 211 may execute a lottery to randomly determine a scenario to be acquired by the user from a plurality of acquisition scenarios. The acquisition part may be performed at any timing before or after the story part and the live distribution part.

In step S4, the game progression unit 115 determines whether or not action instruction data has been received from an external device via the network. Until the action instruction data is received from the external device, the game progression unit 115 may return from NO in step S4 to, for example, step S1 to execute the story part. Alternatively, the game progression unit 115 may execute the acquisition part of step S3. On the other hand, when the action instruction data is received from the external device, the game progression unit 115 advances from YES in step S4 to step S5.

In step S5, the game progression unit 115 executes the live distribution part (second part). Specifically, the game progression unit 115 advances the live delivery part by causing the character to act according to the action instruction data received in step S4. In step S1, the user simply interacts with a character who shows a fixed response in the scenario via the UI. However, in the live distribution part, the user can freely interact with the character acting in real time based on the action instruction data transmitted from the external device. More specifically, analysis unit 116 receives, from action instruction device 300, action instruction data including voice data and motion data generated according to the details of the user's input operation. Then, the game progression unit 115 causes the character to speak based on the voice data included in the received action instruction data, and moves the character based on the motion data. Thereby, the reaction of the character to the user's input operation can be presented to the user.

<Overview of processing>
In this embodiment, based on the game program 131, the user terminal 100 is configured to perform the following steps in order to improve the interest of the game. Specifically, the user terminal 100 operates on the basis of first action instruction data, which is action instruction data specifying an action of an NPC that neither the user nor another user operates, and which is pre-stored in the memory 11. A step of operating the NPC and advancing the first part according to the user's input operation input via the operation unit (input/output IF 14, touch screen 15, camera 17, distance measuring sensor 18); and advancing the second part by operating the NPC based on the second action instruction data received from the action instruction device 300).

According to the above configuration, in the first part, the user terminal 100 operates the NPC based on the pre-downloaded first action instruction data. In addition, the user terminal 100 receives the second action instruction data from the action instruction device 300, and operates the NPC based on the second action instruction data in the second part. Since the NPC can be operated based on the second action instruction data received from the action instruction device 300, the action of the NPC is unconventional and its expressions are greatly expanded. Therefore, the user can get a sense of reality as if the NPC were in the real world through interaction with the NPC during game play. As a result, it is possible to enhance the sense of immersion in the world of the game and improve the interest of the game.

<Data structure>
(Operation instruction data)
FIG. 4 is a diagram showing an example of the data structure of action instruction data processed by the game system 1 according to this embodiment. As an example, the action instruction data includes items of “destination” and “originator” as meta information, and items of “character ID”, “voice”, and “movement” as contents of the data. consists of

The item "destination" stores destination designation information. The destination specification information is information indicating to which device the action instruction data is sent. The destination designation information may be, for example, an address unique to the user terminal 100 or identification information of a group to which the user terminal 100 belongs. It may be a symbol (for example, "ALL") indicating that all user terminals 100 satisfying a certain condition are addressed.

The item "creator" stores creator information. The creator information is information indicating which device created the action instruction data. The source information is user-related information (hereinafter referred to as user-related information) that can identify a specific user, such as a user ID, a user terminal ID, and a unique address of a user terminal. The creator information may be an ID or an address pointing to the server 200 or the action instruction device 300. When the creator is the server 200 or the action instruction device 300, the value of this item is left blank. Alternatively, the item itself may not be provided in the action instruction data.

The item "character ID" stores character IDs for uniquely identifying characters appearing in the game. The character ID stored here indicates which character's action is to be instructed by the action instruction data.

The item "audio" stores audio data to be expressed by the character. The item "movement" stores motion data specifying the movement of the character. The motion data may be, for example, motion capture data acquired by the motion instruction device 300 via the motion capture device 3020 . The motion capture data may be data that tracks the movement of the actor's entire body, data that tracks the actor's facial expressions and mouth movements, or both. As another example, the motion data may be a group of motion commands specifying a series of movements of the character specified by the operation input by the operator of the action instruction device 300 via the controller 3030 . For example, when the commands "raise right hand", "raise left hand", "walk", and "run" are assigned to button A, button B, button C, and button D of controller 3030, respectively, the operator , button A, button B, button C, and button D are successively pressed. In this case, a group of motion commands in which the commands "raise right hand", "raise left hand", "walk", and "run" are arranged in the above order are stored as motion data in the item "movement". be done. Note that, in this embodiment, the voice data and the motion data are included in the action instruction data in a synchronized state.

By receiving such action instruction data, the game progression unit 115 can cause a character appearing in the game to act as intended by the creator of the action instruction data. Specifically, if the action instruction data includes voice data, the game progression unit 115 causes the character to speak based on the voice data. In addition, when motion data is included in the action instruction data, the game progression unit 115 moves the character based on the motion data, that is, generates an animation of the character so that the character moves based on the motion data. do.

(game information)
FIG. 5 is a diagram showing an example of the data structure of the game information 132 processed by the game system 1 according to this embodiment. The items provided in the game information 132 are appropriately determined according to the genre, nature, contents, etc. of the game, and the illustrated items do not limit the scope of the present invention. As an example, the game information 132 includes items of "play history", "item", "familiarity", "famousness", and "distribution history". Each of these items is appropriately referred to when the game progression unit 115 progresses the game.

The item "play history" stores the user's play history. The play history is information indicating whether or not the user's play has been completed for each scenario stored in the storage unit 120 . For example, the play history includes a list of fixed scenarios downloaded at the first play and a list of acquired scenarios acquired later in the acquisition part. In each list, a status such as "played", "not played", "playable", or "playable" is associated with each scenario.

The item "item" stores a list of items as game media possessed by the user. In this game, the items are, for example, accessories worn by the character. The user can equip the character with items obtained by playing the scenario to customize the appearance of the character.

The item "familiarity" stores intimacy, which is one of the character statuses. The new density is a parameter that indicates how close the user's alter ego, the "main character", is to the character. For example, the game progression unit 115 may advance the game in a more advantageous manner for the user as the degree of intimacy increases. For example, the game progression unit 115 may increase or decrease the degree of intimacy according to the play result of the scenario. As an example, the game progression unit 115 increments the degree of intimacy as the user selects options better and the outcome of the scenario is better. Conversely, the game progression unit 115 may reduce the degree of intimacy when the user reaches the scenario with a bad ending.

The item “famousness” stores the famousness, which is one of the character statuses. The name recognition is a parameter that indicates the degree of popularity and recognition that a character has as a video distributor. One of the purposes of this game is to support the animation distribution activities of the character, raise the name recognition of the character, and realize the dream of the character. As an example, a special scenario may be provided as a reward to a user who has achieved a certain level of popularity.

The item "distribution history" stores a list of moving pictures that have been live-distributed from characters in the past in the live distribution part, so-called back numbers. In the live distribution part, the moving picture being PUSH-distributed in real time can only be viewed at that time. On the other hand, moving images for past distribution are recorded in the server 200 or the action instruction device 300 and can be PULL distributed in response to a request from the user terminal 100 . In this embodiment, as an example, the back number may be downloaded by the user by charging a fee.

<Story part screen example>
FIG. 6 is a diagram showing an example of a quest presentation screen 400 displayed on the display unit 152 of the user terminal 100. As shown in FIG. The game progression unit 115 presents quests to the user according to the game program 131 during the progression of the scenario in the story part. Specifically, the game progression unit 115 causes the character to say a request corresponding to a quest to the hero during the conversation between the hero and the character. At this time, for example, the game progression unit 115 may cause the display unit 152 to display a quest presentation screen 400 shown in FIG.

There is no particular limitation on the method of presenting the character performing a series of actions of "making the character say a requested matter". For example, the game progression unit 115 may display a still image of a character speaking the text data corresponding to the requested item, which is stored in advance in the storage unit 120 . Specifically, the game progression unit 115 displays the quest presentation screen 400 including the character 401, a balloon 402 indicating that the character 401 is speaking, and the text data of the requested item placed in the balloon 402. 152. Alternatively, the game progression unit 115 may display an animation of a character who speaks the requested item based on action instruction data corresponding to a scene in which the request item is spoken, which is stored in advance in the storage unit 120 . Specifically, the game progression unit 115 moves the character 401 according to the motion capture data included in the action instruction data, and outputs the voice data included in the action instruction data as voice from a speaker (not shown) provided in the user terminal 100. Output.

In the present embodiment, as an example, the game progression unit 115 may realize the quest by a positional information game using the positional registration information of the user terminal 100 . The game progression unit 115 acquires current location information (for example, address information, latitude/longitude information, etc.) of the user terminal 100 from a location registration system (not shown) provided in the user terminal 100 . Then, based on the acquired current position information, a map 403 around the location where the user terminal 100 is located is generated and arranged on the quest presentation screen 400 . The map data from which the map 403 is generated is acquired via a network from another service providing device (server) that provides map data. Note that the map data may be stored in the storage unit 120 of the user terminal 100 in advance.

Subsequently, the game progression unit 115 determines a position (address, latitude/longitude, etc.) where an object (hereinafter referred to as a target) that can solve the request can be obtained, and displays a target icon at a position on the map corresponding to the determined position. 404 is superimposed and displayed. Accordingly, the user can understand that by holding the user terminal 100 and moving to the position of the target icon 404 on the map 403, the target can be obtained and the quest cleared. The position of the target may be determined randomly by the game progression unit 115, or may be determined in advance according to the scenario, the quest, and the content of the target.

When the user brings the user terminal 100 to the actual position corresponding to the position of the target icon 404, the game progression unit 115 determines that the hero has reached the target and allows the user to acquire the target. The game progression unit 115 thereby determines that the quest has been cleared.

In this embodiment, the game progression unit 115 may generate a quest solution screen 500 and display it on the display unit 152 when the quest is cleared. FIG. 7 is a diagram showing an example of a quest solution screen 500 displayed on the display unit 152 of the user terminal 100. As shown in FIG. As an example, the quest resolution screen 500 includes a character 401 . For example, the game progression unit 115 causes the character 401 to perform an action of "thank the hero for solving the request". The game progression unit 115 may cause the character 401 to perform this action based on pre-stored action instruction data. Alternatively, the game progression unit 115 may reproduce a scene in which the character 401 is thanking by arranging the still image of the character 401 and the text data 501 corresponding to the statement content on the quest resolution screen 500 .

In this embodiment, the game progression unit 115 may release one new fixed scenario related to the character 401 who is the requester as a reward for clearing the quest, and transition the scenario to a playable state for the user. Specifically, the game progression unit 115 reads out the play history shown in FIG. 5 and updates the status of the predetermined fixed scenario from "unplayable" to "playable".

Furthermore, the game progression unit 115 may increase the degree of intimacy between the hero and the character based on the clearing of the quest. The game progression unit 115 may be configured to increase intimacy as the play content of the quest (required time, movement distance, number of acquisitions, degree of joy of the character, rarity of the acquired target, etc.) is better. .

As the user clears one or more quests or selects an option, dialogue with the character progresses and the scenario progresses. When the scenario reaches one ending, the user has completed playing the scenario.

The game progression unit 115 may allow the user to acquire items as a reward for playing the scenario. The items are, for example, accessories worn by the character 401 . The game progression unit 115 determines items to be acquired by the user based on a predetermined rule. For example, the game progression unit 115 may give the user an item that is pre-associated with the scenario being played, or the play content of the scenario (required time to clear the quest, acquired intimacy, good choices, etc.). selected, etc.). Alternatively, the item to be given to the user may be randomly determined from among multiple candidates.

In the present embodiment, the game progression unit 115 may generate a reward screen 600 for notifying the user of the items acquired, and cause the display unit 152 to display the reward screen 600 . FIG. 8 is a diagram showing an example of a reward screen 600 displayed on the display unit 152 of the user terminal 100. As shown in FIG. As an example, the reward screen 600 may include an icon 601 of the acquired item and the name 602 of the item. This allows the user to check the items that he/she has acquired. In addition, the game progression unit 115 adds the acquired item to the item list stored in the item "item" shown in FIG.

<Screen example of the live distribution part>
When the game progression unit 115 receives action instruction data from an external device such as the action instruction apparatus 300, the game progress unit 115 causes the character to act based on the action instruction data in the live distribution part. For example, a moving image reproduction screen 800 including a character that moves based on the action instruction data is generated in the live distribution part and displayed on the display unit 152 .

FIG. 9 is a diagram showing an example of a video playback screen 800 displayed on the display unit 152 of the user terminal 100. As shown in FIG. As an example, the video playback screen 800 includes at least a character (character 802 in the illustrated example) who was a dialogue partner in the story part.

In this embodiment, the game progression unit 115 reflects the movement indicated by the motion capture data included in the action instruction data supplied from an external device (hereinafter referred to as the action instruction device 300) in the movement of the character 802. . The motion capture data is the motion of the model 702 acquired via the motion capture device 3020 at the installation location of the motion instruction device 300 . Therefore, the motion of the model 702 is directly reflected in the motion of the character 802 displayed on the display unit 152 .

In this embodiment, the game progression unit 115 outputs the sound data 801 included in the action instruction data supplied from the action instruction device 300 as the sound uttered by the character 802 in synchronization with the movement of the character 802. . The voice data is obtained by acquiring the voice 700 of the voice actor 701 through the microphone 3010 at the installation location of the action instruction device 300 . Therefore, the voice data 801 corresponding to the voice 700 uttered by the voice actor 701 is output from the speaker of the user terminal 100 as it is.

According to the above configuration, the voice and motion of the voice actor 701 and the model 702 that actually exist at the installation location of the action instruction device 300 are directly reflected in the voice and motion of the character 802 . Seeing the character 802 performing such actions, the user can feel the reality of the character 802 as if it exists in the real world, and can be immersed in the game world. .

Furthermore, in the present embodiment, the game progression unit 115 may determine the play result of the story part based on the user's input operation in the story part (first part). Then, in the live distribution part (second part), the game progression unit 115 may cause the display unit 152 to display the character to be moved based on the action instruction data in a display mode according to the play result.

As an example, the game progress unit 115 synthesizes the object of the item with the object of the character 802 if an item that can be worn by the above character has been obtained in the story parts that have been played so far. preferably. According to the above configuration, the items acquired by the user by playing the story part can be reflected in the accessories of the character 802 acting in the live distribution part. For example, as shown in FIG. 8, an item (for example, a rabbit ear band) is obtained as a furnishing item by playing the scenario in the story part. In this case, the game progression unit 115 reads the information on the furnishings from the game information 132 shown in FIG.

This allows the user to feel more attached to the character 802 and enjoy the live distribution part even more. Furthermore, it is possible to nurture the desire of the user to upgrade the furnishings of the character 802, and as a result, it is possible to strengthen the motivation to play the story part.

Furthermore, in the present embodiment, the game progression unit 115 may be able to input comments addressed to the character 802 in response to actions of the character 802 . As an example, the game progression unit 115 arranges a comment input button 804 on the video playback screen 800 . The user touches the comment input button 804 to call up a UI for inputting a comment, operates the UI, and inputs a comment addressed to the character 802 . The UI may be for the user to select a desired comment from several comments prepared in advance. The UI may be for the user to edit characters and enter comments. The UI may be for the user to input comments by voice.

<Processing flow>
FIG. 10 is a flow chart showing the flow of processing executed by each device constituting the game system 1. FIG.

In step S<b>101 , the game progression unit 115 of the user terminal 100 accesses the server 200 and requests a login upon receiving an input operation to start the game from the user.

In step S102, the progress support unit 211 of the server 200 confirms that the status of the user terminal 100 is online, and responds that the login has been accepted.

In step S103, the game progression unit 115 progresses the game according to the user's input operation while communicating with the server 200 as necessary. The game progression unit 115 may progress the story part, or progress the acquisition part for acquiring a new scenario.

In step S104, the progress support unit 211 supports the progress of the game on the user terminal 100 by, for example, providing necessary information to the user terminal 100 as necessary.

In step S105, when the live distribution time comes, the sharing support unit 212 of the server 200 proceeds from YES in step S105 to step S106. The live distribution time is determined in advance by the game master, for example, and managed by the server 200 and the action instruction device 300 . Further, the user terminal 100 may be notified of the live distribution time in advance, or may be kept secret until the actual live distribution time. In the former case, it is possible to stably supply live distribution to users, and in the latter case, it is possible to supply live distribution with special added value to users as a surprise distribution.

In step S106, the sharing support unit 212 searches for one or more user terminals 100 that have the right to receive live distribution. The conditions for receiving the live distribution may be appropriately set by the game master, but at least the conditions include having the application for this game installed and being online at the time of the live distribution. In this embodiment, as an example, user terminals 100 that are online at the time of the live distribution, that is, that are running the application of the game, are searched for as user terminals 100 that have the right to receive the live distribution. Alternatively, the sharing support unit 212 may add a condition that the user terminal 100 is owned by a user who has already paid for live distribution. Alternatively, the sharing support unit 212 may search in advance for a specific user terminal 100 that has made a reservation to receive the live distribution at the above-described live distribution time as the user terminal 100 that has the right to receive the live distribution. good.

In step S<b>107 , sharing support unit 212 notifies motion instruction device 300 of one or more detected user terminals 100 . For example, the sharing support unit 212 may notify the action instruction device 300 of the terminal ID of the user terminal 100, the user ID of the user who is the owner of the user terminal 100, the address of the user terminal 100, and the like.

On the other hand, in step S108, when the live distribution time comes, the character control unit 316 of the action instruction device 300 advances from YES in step S108 to steps S109 to S110. It does not matter which of steps S109 to S110 is executed first.

In step S109, the character control unit 316 acquires the voice input by the actor such as the voice actor through the microphone 3010 as voice data.

In step S110, the character control unit 316 acquires motion captured by an actor such as a model via the motion capture device 3020 as motion capture data.

In step S111, the character control unit 316 generates action instruction data (second action instruction data). Specifically, the character control unit 316 identifies a character whose moving image is to be distributed at the above-described live distribution start time, and stores the character ID of the character in the "character ID" item of the action instruction data. The game master may pre-schedule and register in the action instruction device 300 which character's animation is to be distributed at what time. Alternatively, the operator of the action instruction device 300 may specify to the action instruction device 300 in advance which character's action instruction data is to be created. The character control unit 316 stores the voice data acquired in step S109 in the "voice" item of the action instruction data. The character control unit 316 stores the motion capture data acquired in step S110 in the "movement" item of the action instruction data. The character control unit 316 links the audio data and the motion capture data so that the audio data and the motion capture data are synchronized. The character control unit 316 receives the group identification information of the group of these user terminals 100, or the group identification information of one user terminal 100 so that one or more user terminals 100 notified by the server 200 in step S107 become the destination. The address is stored in the "destination" item of the operation instruction data as destination designation information.

In step S<b>112 , the character control unit 316 transmits the action instruction data generated as described above to each user terminal 100 designated as a destination via the communication IF 33 . The character control unit 316 acquires voice data and motion capture data obtained by an actor speaking or moving, immediately renders them into action instruction data, and distributes them to each user terminal 100 in real time. is desirable.

At step S<b>113 , analysis unit 116 of user terminal 100 receives the above-described action instruction data via communication IF 13 . For example, the analysis unit 116 may receive the action instruction data at the time when the action instruction device 300 or the server 200 has notified in advance that the live distribution will be performed.

At step S114, analysis unit 116 analyzes the received action instruction data, triggered by the reception.

In step S115, if the game progression unit 115 has not executed the live distribution part when the above-described action instruction data is received, the live distribution part is started. At this time, if another part is being executed, the game progression unit 115 interrupts the progress of that part and then starts the live distribution part. Here, the game progress unit 115 outputs a message to the display unit 152 to the effect that the part being executed is temporarily interrupted due to the start of the live distribution, and saves the progress of the part in the storage unit 120. desirable. Note that if the live distribution part has already been executed at the time of receiving the above-described action instruction data, the game progression unit 115 may omit step S115. In this case, the game progression unit 115 may output to the display unit 152 a message to the effect that the distribution of the action instruction data (that is, the moving image of the character's body distributed live) has started.

In step S<b>116 , the game progression unit 115 causes the character to act based on the animation instruction data analyzed by the analysis unit 116 , thereby advancing the live distribution part. Specifically, the game progression unit 115 causes the display unit 152 to display the video playback screen 800 shown in FIG. 9 or the like. The game progression unit 115 reproduces the voices and movements of the actors such as the voice actor 701 and the model 702 in real time almost at the same time when the actors such as the voice actor 701 and the model 702 are speaking and moving at the installation location of the action instruction device 300, and reproduces the animation. This is reflected in the utterances and movements of the character 802 on the screen 800 . The analysis unit 116 and the game progression unit 115 continue rendering and playing the moving image in real time while continuously receiving action instruction data from the action instruction device 300 . Specifically, the game progression unit 115 does not receive any input operation from the user, returns from NO in step S117 to step S113, and repeats the subsequent steps while action instruction data is being received.

In step S117, when the operation reception unit 111 receives an input operation from the user while the character is moving based on the action instruction data, the game progression unit 115 advances from YES in step S117 to step S118. For example, the operation reception unit 111 receives an input operation on the comment input button 804 on the video playback screen 800 .

In step S<b>118 , game progression unit 115 transmits the comment data generated according to the input operation described above to action instruction device 300 . Specifically, the game progression unit 115 may transmit the comment ID of the selected comment as comment data. Alternatively, the game progression unit 115 may transmit text data of sentences input by the user as comment data. Alternatively, the game progression unit 115 may transmit voice data of voice input by the user as comment data. Alternatively, the game progression unit 115 may recognize the voice input by the user, convert it into text data, and transmit it as comment data.

In step S<b>119 , reaction processing unit 317 of action instruction device 300 receives the comment data transmitted from user terminal 100 via communication IF 33 .

In step S<b>120 , reaction processing unit 317 outputs the received comment data to action instruction device 300 . For example, the reaction processing section 317 displays text data included in the comment data on the display section 352 . This allows the operator to receive feedback indicating how the user reacted to the characters they moved. The operator can then determine further character actions in accordance with this feedback. That is, the action instruction device 300 returns to step S<b>109 , continues acquiring voice data and motion capture data, and continues to provide the user terminal 100 with action instruction data. The user terminal 100 receives the action instruction data transmitted from the action instruction device 300 after the action instruction device 300 receives the content of the input operation in the user terminal 100 . Specifically, the user terminal 100 receives action instruction data including voice data corresponding to the character's utterance content, motion capture data corresponding to the character's movement, and the like. Then, the user terminal 100 continuously moves the character based on the action instruction data. As a result, it is possible for the user to experience real-time interactive interaction with the character. Instead of the motion capture data, the user terminal 100 may receive a motion command group in which one or more commands for instructing the motion of the character are arranged in the order instructed by the operator of the motion instruction device 300.

[Embodiment 2]
<Game Overview>
A game executed by the game system 1 according to the second embodiment (hereinafter referred to as the game) includes, for example, elements of a location information game in which characters are placed all over the country and elements of a love simulation game. Here, the characters are assumed to be, for example, a cursed and captive monster and an avatar that speaks and moves in response to the vocalizations and actions of the actor.

Note that the avatar is synonymous with the character in the first embodiment, and control of speech and actions of the avatar is the same as control of speech and actions of the character in the first embodiment. A character may also be called an object.

When the game is started, the user terminal 100 uses the location registration system to specify the current location information (for example, address information, latitude and longitude information, etc.) of the user terminal 100, and based on the current location information, the user A map around the location where the terminal 100 is located is generated. When generating a map, by transmitting current position information to the server 200, transfer of map data around the current position is requested. The server 200 acquires map data around the user terminal 100 via a network from another service providing device (server) that provides map data, and also acquires positional information of characters placed around the user terminal 100 . Character ID is acquired, and the position information and the character ID are transmitted to the user terminal 100 together with the map data of the surroundings of the user terminal 100 .

The user terminal 100 displays a map based on the map data on the touch screen 15, and superimposes an icon corresponding to the character on the map based on the character ID received together with the map data. FIG. 11A shows a map within a predetermined range from the position of the user terminal 100, icons corresponding to characters placed on the map, and an index indicating the position of the user terminal 100. FIG. FIG. 10 is a diagram for explaining an example in which As the map, a map within a predetermined area centered on the current position where the user terminal 100 is located is displayed. The icon corresponding to the character is identified from the character ID and displayed at the position corresponding to the character's position information. The index is displayed at the center position of the map.

FIG. 11A illustrates, for example, a case where the user terminal 100 is located in a specific park, a map 1001 showing walking paths in the park is displayed, and icons IC1 to IC3 are displayed on the map 1001. , and the index US1 is superimposed and displayed at the center position of the map 1001 (display area of the touch screen 15). Here, since each of the icons IC1 and IC2 is an image imitating a monster, it indicates that the monster is arranged at the position of the icon. Also, the icon IC3 is an image representing a woman, and thus indicates that the avatar is arranged at the position of the icon.

When the user terminal 100 actually moves a predetermined amount (for example, 5 m), the user terminal 100 transmits the current position information to the server 200 again, and the position information and character IDs of the characters around the user terminal 100 and the user terminal 100 Acquire map data of the surrounding area. A map based on the map data is displayed on the touch screen 15, and an icon based on the position information of the character and the character ID is displayed superimposed on the map. That is, the map and icons on the touch screen 15 are scrolled as the user terminal 100 moves.

If a character is placed within a predetermined range around the position of the user terminal 100 (for example, within a range of 3 m centered on the user terminal 100), the user terminal 100 highlights the icon corresponding to the character. . That is, the icon corresponding to the character within the predetermined range is displayed in a manner different from the icon corresponding to the character outside the predetermined range, thereby being displayed in a distinguishable manner from the icon corresponding to the character outside the predetermined range. .

FIG. 11B illustrates, for example, the case where the user terminal 100 approaches within 3 m from the character corresponding to the icon IC1, where the icon IC1 is highlighted.

When a highlighted icon among the icons on the map is tapped, the user terminal 100 requests the server 200 to transfer a panorama image (predetermined image) of the position where the icon is displayed. . The server 200 acquires a 360° panoramic image (omnidirectional photographic image) at the position where the user terminal 100 exists from another service providing device (server) that provides panoramic images taken at various locations, The acquired panorama image is transmitted to the user terminal 100 . Note that the panoramic image is not limited to a 360° omnidirectional photographic image, and may be a non-omnidirectional photographic image such as a 180° photographic image. In addition, the image is not limited to a photographic image, and may be a moving image.

Therefore, when the map 1001 is displayed and the user terminal 100 is in the vicinity of the position of the icon IC1 (state shown in FIG. 11B), when the tap operation is performed on the icon IC1, the user A 360° panorama image at the position of the terminal 100 is transferred from the server 200 to the user terminal 100 .

When user terminal 100 receives the panoramic image, user terminal 100 generates a celestial sphere-shaped (spherical) virtual space CS1 shown in FIG. Paste the image (360° image). Thereby, virtual space data is generated. An avatar or monster moves against a 360° panoramic image. A virtual camera CM1 is placed in the center of the virtual space CS1, and the field of view of the virtual camera CM1 is initialized based on the output of the acceleration sensor of the controller 1020 at the start of the game.

Specifically, the field-of-view area of the virtual camera CM1 is set so that the touch screen 15 displays a panoramic image corresponding to the actual scenery facing the camera 17 of the user terminal 100 . Thereby, the viewing area of the virtual camera CM1 is associated with the orientation of the display area of the touch screen 15 . A partial panorama image corresponding to the field of view of the virtual camera CM1 is displayed on the touch screen 15 .

Further, no matter which direction the display area of the touch screen 15 is directed, the panoramic image corresponding to the visual field area among the panoramic images pasted in the virtual space CS1 is displayed on the touch screen 15, and furthermore, avatars and monsters can be displayed. Since it can be visually recognized, the sense of immersion in the game can be improved, and the interest in the game can be improved.

When the attitude or orientation of the user terminal 100 changes, the change is specified based on the output of the acceleration sensor. The viewing area of the virtual camera CM1 and thus the panoramic image displayed on the touch screen 15 are updated based on the change. As a result, when the camera 17 included in the user terminal 100 is attached to the back side of the display area of the touch screen 15, the impression is that an image captured by the camera 17 is displayed in the display area of the touch screen 15. can be held by the user.

If the character corresponding to the tapped icon is a monster, the user terminal 100 displays the aiming image (reference image) at the central position (predetermined position) of the display area of the touch screen 15, and then displays the aiming image (reference image) at any point in the virtual space CS1. Place the monster in question (somewhere). At this time, the virtual space data is defined by the panoramic image and the monster.

The monster is initially positioned outside the field of view of the virtual camera CM1 in the virtual space CS1, and is controlled to move toward the inside of the field of view.

As a result, by changing the attitude and orientation of the user terminal 100, it is possible to provide the fun of searching for monsters, and to display the monsters on the touch screen 15 without actively changing the attitude and orientation of the user terminal 100.例文帳に追加can be done. FIGS. 13A and 13B show display examples when the monster MST1 is moved into the field of view after the icon IC1 is tapped. 13A and 13B, a monster MST1 is superimposed on a panorama image 1101, and an aiming image AM1 is displayed at the center of the display area of the touch screen 15. In FIG.

The release condition for releasing the monster from the curse is established by displaying the monster image in the aiming image AM1 continuously for a predetermined period of time. At this time, the user terminal 100 requests the server 200 to release the monster. In response to the request, server 200 makes the position information and character ID of the monster unobtainable to any user. Alternatively, the monster image may be displayed as a character possessed by the user by continuously displaying the monster image in the aiming image AM1 for a predetermined period of time.

If the character corresponding to the icon tapped on the touch screen 15 is an avatar, the user terminal 100 arranges the avatar near the center of the virtual space CS1. At this time, the virtual space data is defined by the panorama image and the avatar. As a result, when the icon IC3 is tapped, an image as shown in FIG. 14A or 14B is displayed on the touch screen 15 according to the field of view of the virtual camera CM1. According to FIG. 14A, the avatar AVT1 is superimposed on the panorama image 1201 . For example, when the field of view of the virtual camera CM1 is panned to the left from this state, the field of view of the virtual space CS1 moves to the left, so that the image displayed on the touch screen 15 is generated in the virtual space CS1. Among the existing images, the image shown in FIG. 14A is updated to the left image (for example, FIG. 14B).

Note that the process of superimposing the avatar AVT1 on the panorama image 1201 is substantially the same as the process of generating the video playback screen 800 including the character in the first embodiment (see FIG. 9).

If the character corresponding to the tapped icon is an avatar, server 200 requests action instruction device 300 to perform live distribution. The action instruction device 300 generates action instruction data based on the voice and motion of the actor, and transmits the action instruction data to the user terminal 100 . The user terminal 100 reflects the voice and movement of the actor in the speech and movement of the avatar by analyzing the action instruction data.

The user can support the avatar by performing an operation corresponding to the coin tip, for example, when sympathizing with the remarks or movements of the avatar during live distribution. The user terminal 100 requests the server 200 to update the evaluation parameters when an operation corresponding to the tip is performed. An operation corresponding to a tip means, for example, an operation in which a user consumes an item obtained through game play during live distribution. In this case, on the side of the model 702 and the voice actor 701 that operate the avatar, it is possible to confirm on a monitor or the like which user has performed the operation corresponding to the tip and consumed the item. Thereby, interaction between the model 702 and the voice actor 701 that operate the avatar and the user can be realized. In addition, the operation corresponding to tipping may include an operation in which the user consumes the item obtained by the billing process and selects an icon displayed on the user terminal 100 . In this case, each icon may be an image imitating a bouquet or the like, and the consumption amount of items required to purchase each icon may be different. The icon selected by the user is displayed on the monitor of the equipment near the model 702 and voice actor 701 operating the avatar. The evaluation parameters are updated while such effects are performed. The server 200 manages the evaluation parameters associated with the avatar being live distributed, updates the evaluation parameters in response to a request from the user terminal 100, and sends the updated evaluation parameters to the action instruction device 300. Send.

The action instruction device 300 displays the numerical values corresponding to the evaluation parameters transmitted from the server 200 via the communication IF 33 on the display unit 352 . The operator of the action instruction device 300 can receive feedback indicating how the user reacted to the avatar they moved.

When a user inputs a comment during live distribution, the user terminal 100 transmits comment data corresponding to the comment to the action instruction device 300 . The action instruction device 300 displays the comment corresponding to the comment data transmitted from the user terminal 100 on the display section 352 . This allows the operator to receive feedback indicating how the user reacted to the avatar they moved.

<Processing flow>
15 and 16 are flowcharts showing the flow of processing executed by each device constituting the game system 1, and FIG. 17 shows the flow of display control processing executed by the user terminal 100 in parallel with the processing of the flowchart. It is a flow chart showing.

In step S201 shown in FIG. 15, the game progression unit 115 of the user terminal 100 receives an input operation for starting the position information game from the user, acquires the current position of the user terminal 100 from the position registration system, and A request is made to the server 200 to transfer map data from which a map of the surroundings centered on the position of the terminal 100 is generated. The request includes the address of the user terminal 100 and location information that can identify the current location.

In step S213, the progress support unit 211 of the server 200 acquires map data from which the map is generated based on the location information from another service providing device (server) via the network. Note that when the map data is stored in the storage unit 220 , the progress support unit 211 may acquire the map data from the storage unit 220 .

A plurality of types of characters are arranged in advance all over the country, and the storage unit 220 stores position information for specifying the position of each of the plurality of types of characters and character IDs of the characters. In step S214, progress support unit 211 acquires the position information that can specify the position of a character placed around user terminal 100 and the character ID of the character, and transfers the position information and character ID to the map. It is transmitted together with the data to the user terminal 100 that is the source of the request. The characters arranged around the user terminal 100 are characters that can be displayed on the touch screen 15 of the user terminal 100 because they are arranged in a map of a predetermined area that can be displayed on the touch screen 15 of the user terminal 100.

In step S202, the display control unit 112 displays a schematic map based on the map data on the touch screen 15, and displays an icon on the map based on the position information and character ID transmitted together with the map data. Deploy. Specifically, the display control unit 112 generates an icon on which a character image corresponding to the character ID is drawn, and displays the icon at a position corresponding to the position information. The map displayed on the touch screen 15 represents a predetermined area centered on the position of the user terminal 100, and an index indicating the position of the user terminal 100 is superimposed on the center of the map. As a result, for example, a map 1001 shown in FIG. 11A is displayed on the touch screen 15, and the icons IC1 to IC3 and the indicator US1 are superimposed on the map 1001. FIG.

In step S203, the game progression unit 115 receives in step S202 whether or not a character is placed within a predetermined range around the position of the user terminal 100 (for example, within a range of 3 m centered on the user terminal 100). determined based on the position information obtained. If it is not determined that the character is placed within the predetermined range, the process proceeds to step S206, and it is determined whether or not the user terminal 100 has moved a predetermined amount based on the position registration system. When it is determined that the user terminal 100 has not moved by the predetermined amount, the process returns to step S203, and when it is determined that the user terminal 100 has moved by the predetermined amount, the process returns to step S201. As a result, the map and icons on the touch screen 15 are scrolled as the user terminal 100 moves.

When it is determined in step S203 that the character is placed within the predetermined range around the position of the user terminal 100, the process advances to step S204 to highlight the icon corresponding to the character. Therefore, when the user terminal 100 approaches within 3 m from the character corresponding to the icon IC1, the map 1001 and the icon IC1 are displayed as shown in FIG. 11B.

In step S<b>205 , the game progression unit 115 determines whether or not the icon highlighted in step S<b>204 has been tapped, based on the input operation on the touch screen 15 . When it is determined that the tap operation has not been performed, the process proceeds to step S206, and when it is determined that the tap operation has been performed, the process proceeds to step S207.

In step S207, the game progression unit 115 requests the server 200 to transfer the panorama image. The request includes the address and location information of the user terminal 100 . In step S215, the progress support unit 211 acquires a 360° panorama image from another service providing device (server) via the network based on the position information. In addition, when the panorama image is stored in the storage unit 220 , the progress support unit 211 may acquire it from the storage unit 220 .

In step S216, the progress support unit 211 transmits the panorama image to the user terminal 100 that made the request. In step S208, the display control unit 112 pastes the panoramic image onto the inner circumferential surface of the celestial sphere representing the virtual space CS1 (see FIG. 12). That is, in step S208, a spherical virtual space CS1 is generated in the storage unit 120, and a 360-degree image is pasted inside the sphere. Thereby, virtual space data is generated.

In step S209, the game progress unit 115 determines whether or not the character corresponding to the tapped icon is a monster based on the character ID corresponding to the icon, and determines that the character is a monster. If not, the process proceeds to step S210. In step S210, the game progress unit 115 generates a character, ie, a monster, corresponding to the tapped icon based on the character ID, and places the monster in the field of view of the virtual camera CM1 within the celestial sphere representing the virtual space CS1. to a position outside the

The display control processing shown in FIG. 17 is executed in parallel with the processing shown in FIGS. be done. In step S210, monsters are placed at positions outside the thus defined viewing area.

Note that the initial position of the monster may be determined at random from a position outside the field of view of the virtual camera CM1 as long as it is determined according to the field of view of the virtual camera CM1. It may be a predetermined position outside the viewing area (for example, a central position within the area opposite to the viewing area).

Note that the initial position of the monster may be a position within the field of view of the virtual camera CM1 as long as it is not within the aiming image. Also, the initial position of the monster may be arranged at a predetermined position within the virtual space CS1 regardless of the field of view of the virtual camera CM1. The predetermined position includes, for example, a plurality of positions within the virtual space CS1 (for example, a position corresponding to due north, a position corresponding to due south, a position corresponding to due east, a position corresponding to due west, etc.). , may be a position randomly determined from a plurality of positions regardless of the viewing area.

In step S211, the game progression unit 115 determines whether or not the release condition is satisfied for the monster based on various game parameters. The release condition is satisfied when the aiming image is aligned with the monster for a predetermined period of time. The predetermined time for establishing the release condition may be a fixed time regardless of the type of monster, or may be determined differently depending on the type of monster (rarity level, etc.). When it is determined that the opening condition is not satisfied, the process returns to step S211, and when it is determined that the opening condition is satisfied, the process proceeds to step S212.

At step S212, the game progression unit 115 requests the server 200 to release the monster. The request includes a character ID corresponding to the monster and location information of the monster.

In step S217, the progress support unit 211 determines whether the character placed within the predetermined range around the position of the user terminal 100 is a monster or not. The determination is made based on the character position information and the character ID obtained in . When it is determined that the character at the position where the user terminal 100 exists is a monster, the process proceeds to step S218.

In step S<b>218 , the progress support unit 211 releases the character, that is, the monster, which was determined in step S<b>217 , in response to the request received from the game progress unit 115 . As a result, the positional information and character ID of the monster cannot be acquired in subsequent step S214.

If the character corresponding to the tapped icon is not determined to be a monster in step S209 (that is, if the character is determined to be an avatar), the process proceeds to step S219. In step S219, game progression unit 115 generates the avatar based on the character ID received from server 200, and places the avatar at a predetermined position (for example, near the center) of the celestial sphere representing virtual space CS1. When the process of step S219 is completed, the process proceeds to step S220.

On the other hand, in step S229, the character control unit 316 of the action instruction device 300 determines whether or not the live distribution time has come, and when the live distribution time has come, the process proceeds to step S230. In step S230, the character control unit 316 acquires the voice input by the actor such as the voice actor through the microphone 3010 as voice data. In step S231, the character control unit 316 acquires motion captured by an actor such as a model via the motion capture device 3020 as motion capture data.

In step S217 shown in FIG. 15, when the character at the position where the user terminal 100 exists is not determined to be a monster (that is, when the character is determined to be an avatar), the progression support unit 211 Proceeding to step S227 of 16, a request is made to the action instruction device 300 for live distribution. The request includes the character ID obtained in step S214 and the address of user terminal 100 received in step S215.

In step S232, the character control section 316 generates action instruction data. Specifically, character control unit 316 stores the character ID included in the request received from server 200 in the “character ID” item of the action instruction data. The character control unit 316 stores the voice data acquired in step S230 in the "voice" item of the action instruction data. The character control unit 316 stores the motion capture data acquired in step S231 in the "movement" item of the action instruction data. The character control unit 316 links the audio data and the motion capture data so that the audio data and the motion capture data are synchronized. The character control unit 316 stores the address of the user terminal 100 included in the request received from the server 200 as destination designation information in the "destination" item of the action instruction data.

In step S<b>233 , the character control unit 316 transmits the action instruction data generated as described above to the user terminal 100 designated as the destination via the communication IF 33 . The character control unit 316 acquires voice data and motion capture data obtained by an actor speaking or moving, immediately renders them into action instruction data, and distributes them to each user terminal 100 in real time. is desirable.

In step S<b>220 , analysis unit 116 of user terminal 100 receives the above-described action instruction data via communication IF 13 . For example, the analysis unit 116 may receive the action instruction data at the time when the action instruction device 300 or the server 200 has notified in advance that the live distribution will be performed. In step S221, the analysis unit 116 analyzes the received action instruction data with the reception as a trigger.

In step S222, the game progression unit 115 starts the live distribution part if the live distribution part is not being executed when the above-described action instruction data is received. In step S<b>222 , the game progression unit 115 moves the avatar based on the animation instruction data analyzed by the analysis unit 116 to advance the live distribution part. The game progression unit 115 reproduces the voices and movements of the actors such as the voice actor 701 and the model 702 in real time almost at the same time as the actors such as the voice actor 701 and the model 702 are speaking and moving at the installation location of the motion instruction device 300 . This is reflected in the utterances and movements of the avatar placed in CS1. The analysis unit 116 and the game progression unit 115 continue rendering and playing the moving image in real time while continuously receiving action instruction data from the action instruction device 300 .

The user can support the avatar by performing an operation corresponding to the coin tip when, for example, the user sympathizes with the avatar's remarks or movements. In step S<b>223 , the game progression unit 115 determines based on the input operation on the touch screen 15 whether or not an operation corresponding to the tip has been performed.

When it is determined that the operation corresponding to the coin tip has been performed, the game progression unit 115 requests the server 200 to update the evaluation parameters in step S224. The request includes the character ID corresponding to the avatar being live-streamed. In step S<b>228 , the progress support unit 211 updates the evaluation parameters associated with the character ID and transmits the updated evaluation parameters to the action instruction device 300 .

In step S<b>234 , reaction processing unit 317 of action instruction device 300 receives the evaluation parameters transmitted from server 200 via communication IF 33 . In step S235, the reaction processing unit 317 outputs the received evaluation parameters. For example, the reaction processing unit 317 displays numerical values corresponding to the evaluation parameters on the display unit 352 . As a result, the operator of the action instruction device 300 can receive feedback indicating how the user reacted to the avatar they moved.

When it is not determined in step S223 that the operation corresponding to the coin tip has been performed, or when the process of step S224 is completed, the game progression unit 115 proceeds to step S225. In step S<b>225 , the game progression unit 115 determines based on the input operation on the touch screen 15 whether or not the user has input a comment while the avatar is moving based on the action instruction data. When it is determined that the comment has not been input, the process returns to step S220, and when it is determined that the comment has been input, the process proceeds to step S226. In step S<b>226 , game progression unit 115 transmits comment data corresponding to the input comment to action instruction device 300 .

Specifically, the game progression unit 115 may transmit the comment ID of the selected comment as comment data. Alternatively, the game progression unit 115 may transmit text data of sentences input by the user as comment data. Alternatively, the game progression unit 115 may transmit voice data of voice input by the user as comment data. Alternatively, the game progression unit 115 may recognize the voice input by the user, convert it into text data, and transmit it as comment data.

In step S<b>234 , reaction processing unit 317 of action instruction device 300 receives the comment data transmitted from user terminal 100 via communication IF 33 . In step S235, the reaction processing unit 317 outputs the received comment data. For example, the reaction processing section 317 displays text data included in the comment data on the display section 352 . This allows the operator to receive feedback indicating how the user reacted to the avatar they moved.

The action instruction device 300 returns to step S230, continues to acquire voice data and motion capture data, and continues to provide the user terminal 100 with action instruction data. The user terminal 100 receives the action instruction data transmitted from the action instruction device 300 after the action instruction device 300 receives the content of the input operation in the user terminal 100 .

Specifically, the user terminal 100 receives action instruction data including voice data corresponding to the character's utterance content, motion capture data corresponding to the character's movement, and the like. Then, the user terminal 100 continuously moves the character based on the action instruction data. As a result, it is possible for the user to experience real-time interactive interaction with the character.

Instead of the motion capture data, the user terminal 100 may receive a motion command group in which one or more commands for instructing the motion of the character are arranged in the order instructed by the operator of the motion instruction device 300.

FIG. 17 is a flow chart showing the flow of display control processing executed by the user terminal 100 after the monster or avatar is placed inside the virtual space CS1 in step S208 or S209.

In step S301, the display control unit 112 places the virtual camera CM1 at the center of the virtual space CS1, and initializes the visual field area of the virtual camera CM1 based on the output of the acceleration sensor of the controller 1020. FIG. Specifically, the direction (direction) of the camera 17 provided in the user terminal 100 is specified based on the output of the acceleration sensor, and a panoramic image corresponding to the actual scenery in that direction is displayed on the touch screen 15. Set the field of view of the virtual camera CM1. The viewing area of the virtual camera CM1 is thus associated with the orientation of the camera 17, ie the orientation of the display area of the touch screen 15. FIG.

In step S<b>302 , the display control unit 112 displays the image of the field of view area on the touch screen 15 . If the character placed in the virtual space CS1 is a monster and the monster is positioned outside the field of view, the touch screen 15 displays only a panoramic image. Also, when the monster is positioned inside the field of view, the monster is superimposed on the panoramic image. On the other hand, if the character placed in the virtual space CS1 is an avatar, the avatar is superimposed on the panorama image according to the setting of the field-of-view area of the virtual camera CM1.

In step S303, the display control unit 112 determines whether or not the character placed in the virtual space CS1 is a monster, based on the processing result of step S208 or S209. When the character is determined to be a monster, the process proceeds to step S304, and when the character is not determined to be a monster (that is, when the character is determined to be an avatar), step S306. proceed to

In step S<b>304 , the display control unit 112 superimposes the aiming image on the image of the field of view displayed on the touch screen 15 . In step S305, the character control unit 316 moves the monster placed in the virtual space CS1 by a predetermined distance in the direction of the field of view of the virtual camera CM1. Specifically, in step S305, it is determined whether or not a monster is placed within the field of view, and if the monster is not within the field of view, the monster is placed in the field of view. Update virtual space data to move.

In step S305, the character control unit 316 may move the monster placed in the virtual space CS1 in the direction of the aiming image within the field of view of the virtual camera CM1 by a predetermined distance. When the process of step S305 is completed, the process proceeds to step S306.

In step S<b>306 , the display control unit 112 determines whether or not an update period set to 1/30 seconds, for example, has arrived based on a measurement unit (not shown). If it is determined that the update period has not arrived, the process returns to step S306, and if it is determined that the update period has arrived, the process proceeds to step S307. In step S307, the display control unit 112 identifies changes in the attitude and orientation of the user terminal 100 based on the output of the acceleration sensor, and updates the field of view of the virtual camera CM1 according to the changes. When the process of step S307 is completed, the process returns to step S302. As a result, an updated image of the viewing area is displayed on the touch screen 15 . As a result, the image displayed on the touch screen 15 is updated to an image corresponding to the viewing area corresponding to the posture and orientation of the user terminal 100 .

As a result, when it is determined that the character placed in the virtual space CS1 is a monster, the panoramic image 1101 and the aiming image AM1 are displayed, and the posture and orientation of the user terminal 100 are changed from the state in which the monster MST1 is not displayed. is changed, the monster MST1 is displayed according to the passage of time, or the like. On the other hand, when it is determined that the character placed in the virtual space CS1 is an avatar, for example, a panorama image 1201 shown in FIG. be done.

<Effects of this embodiment>
According to this embodiment, virtual space data is generated for enabling identification of the virtual space associated with the panoramic image at the position where the user terminal 100 exists. Also, when the character placed in the virtual space is determined to be a monster, the monster is placed in the virtual space. A virtual camera is also placed in the virtual space. The field of view from the virtual camera is controlled according to the user's operation on the user terminal 100 , and the touch screen 15 displays an image corresponding to the field of view. If the monster is not placed within the viewing area, the virtual space data is updated to move in the direction in which the monster is placed within the viewing area.

As a result, in a game in which the monster is continuously displayed on the touch screen 15, it is possible to reduce the necessity of greatly changing the orientation of the user terminal 100. FIG. As a result, it is possible to reduce the concern that people around the user will be disturbed or be suspicious of the user. In other words, the user can concentrate on the game without being spotted as a suspicious person by a third party in the vicinity.

Further, according to this embodiment, when a monster is displayed on the touch screen 15 and the release condition is established, the user terminal 100 requests the server 200 to release the monster. As a result, the monster is released by the server 200 . This allows the user to enjoy the game of finding and releasing monsters.

Furthermore, according to the present embodiment, an aiming image is displayed at a predetermined position on the touch screen 15 so as to be superimposed on the image corresponding to the field-of-view area of the virtual camera. The release condition is established by displaying the monster at the predetermined position. This makes it possible to enhance the interest of the game.

Further, according to this embodiment, when the virtual space data is generated, the monster is placed in an area other than the viewing area, or the monster is placed at a predetermined position in the virtual space regardless of the viewing area.

When monsters are placed in areas other than the field of view, the user can be given a sense of anticipation until the monsters appear in the field of view. On the other hand, when placing a monster at a predetermined position in the virtual space regardless of the viewing area, the monster may or may not appear in the viewing area depending on the orientation of the user terminal 100 . This makes it possible to add surprise to the appearance of monsters.

Furthermore, according to this embodiment, the panoramic image at the location where the user terminal 100 exists is acquired by communicating with another service providing device (server) that provides panoramic images shot at various locations.

As a result, the monster is superimposed on the panorama image obtained from another service providing device, not on the image captured by the camera 17 of the user terminal 100 . As a result, the processing load on the user terminal 100 can be reduced. In addition, since the game can be played without photographing the scenery or the like with the camera 17, it is possible to reduce the possibility of suspicion of voyeurism or invasion of privacy.

<Modification>
Modified examples of the embodiment described above are enumerated below.

(1) In the second embodiment (hereinafter also simply referred to as the embodiment), when the character placed in the virtual space is determined to be a monster, the target is continuously aimed at a predetermined position on the touch screen 15. I am trying to display an image. However, the aiming image may not be displayed when the monster is not placed within the viewing area of the virtual camera, and the aiming image may be displayed when the monster is placed within the viewing area. As a result, it is possible to motivate the user to display the monster at a predetermined position while improving the visibility of the panoramic image.

Also, instead of the aiming image, a timer that starts when the monster is captured and is reset when the monster is missed may be displayed. In this case, the user can grasp the remaining time until the opening condition is satisfied by the timer.

Furthermore, when a monster is placed within the field of view, a specific notification (for example, voice guidance, sound effects, etc.) may be made. As a result, it is possible to reduce the concern that the user will be distracted by the touch screen 15 and cause annoyance to the surroundings, such as colliding with others, in a situation where no monster is placed within the field of view.

(2) In the above embodiment, the panorama image at the position where the user terminal 100 exists is obtained from another service providing device (server). However, an image captured by the camera 17 provided in the user terminal 100 may be associated with the virtual space as the panorama image (specifically, pasted inside the celestial sphere). In this case, the pasting position of the camera image is defined based on the orientation of the user terminal 100 . The camera image is displayed on the display area of the touch screen 15, and the aiming image is superimposed on the central position of the display area. When the monster is not placed within the display area, the monster moves in the direction to be placed within the display area. This makes it possible to add reality to the panoramic image.

(3) In the above embodiments, panoramic images associated with the virtual space are limited to images obtained from other service providing devices (servers). However, the panorama image associated with the virtual space may be switched between an image acquired from another service providing device (server) and a camera image according to user's operation. That is, when there are no people in the surroundings and there is no problem of colliding with others or causing troubles to the surroundings, the panorama image associated with the virtual space is switched to the camera image by the user's switching operation. good too.

(4) In the above embodiment, a predetermined position within the virtual space CS1 is specified as the monster's initial position regardless of the position outside the field of view of the virtual camera CM1 or the field of view. At this time, the initial position may be specified according to the type of monster. That is, for certain types of monsters, a position outside the field of view of the virtual camera CM1 is specified as the initial position, and for other types of monsters, regardless of the field of view, a predetermined position within the virtual space CS1 is specified as the initial position. You may make it specify as.

(5) In the above embodiment, an example has been described in which the user terminal 100 requests the server 200 for the panoramic image corresponding to the position of the user terminal 100 among the panoramic images shot and managed in advance. However, the administrator side (server 200) may request a panorama image at a specific position from the user, and the panorama image taken in response to the request may be registered and managed in the server 200, for example. Also, a panorama image at a specific position may be managed by the server 200 rather than by another service providing device. In this case, by registering the panorama image, the user may be given a privilege (for example, a coin that can be used in the game, a special item, an increase in a predetermined parameter, etc.). As the specific position, for example, a position where a panoramic image is managed before a predetermined period (for example, three years ago), a position where a panoramic image is not yet managed, a rooftop position of a building, a specific facility It may be a position or the like. As a result, the user can be motivated to shoot a panorama image of a specific position, and the enjoyment of the game can be enhanced. In addition, the administrator can have a current panorama image at a specific position.

(6) In the above embodiment, it is assumed that when a plurality of panoramic images shot at the location where the user terminal 100 exists exist in other service providing apparatuses, the latest panoramic image is transmitted to the user terminal 100. ing. However, if a plurality of panorama images at the same position exist in the other service providing device, for example, user settings (current mode, retro mode, etc.), game progress (when an event occurs in the past, etc.) Depending on the situation, a panorama image taken several years ago or several decades ago, which is different from the latest one, may be transmitted. As a result, it is possible to increase the variety of panorama images to be displayed.

Also, if there are multiple panorama images at the same position, for example, according to the actual situation (season, date, time zone, etc.) at the time the panorama image is requested, , a different panorama image may be transmitted. Specifically, when it is winter now, a panoramic image taken in winter may be sent, and when it is August now, the image taken in August or near August may be sent. A photographed panorama image may be transmitted. Alternatively, when the current time zone is daytime, a panorama image taken in the daytime may be transmitted, and when it is nighttime, a panorama image taken in the nighttime may be transmitted. As a result, a panorama image corresponding to the current situation is displayed, so that reality can be enhanced.

(7) In the above embodiment, an example has been described in which the acquired panorama image is used as it is, and a character image or the like is superimposed thereon and displayed on the touch screen 15 . However, the panorama image may be processed/edited in a predetermined manner, and displayed on the touch screen 15 with a character image or the like superimposed on the panorama image that has been processed/edited. Predetermined processing/editing processing may include, for example, gradation, sharpness, color correction, special effects, etc., depending on the current situation (eg time, date, time, etc.). Also, the image to be superimposed on the panorama image is not limited to the character image. Alternatively or additionally, for example, a decoration image (Christmas tree, kadomatsu , float, watermelon, etc.).

(8) In the above embodiment, the characters are assumed to be an avatar and a monster, and the character can be displayed on the touch screen 15 when the user visits the place where the character is placed. Of these, the part that displays the avatar can be regarded as the live distribution part. If you create a story that unlocks the monster, it will be possible to regard the part that displays the monster as one of the elements that make up the story part.

(9) In the above embodiments, map data provided by other service providing devices are acquired by the server 200 and provided to the user terminal 100 . However, even if the user terminal 100 obtains the map data directly from the other service providing apparatus, the character position information and the character ID from the server 200, and synthesizes and displays them on the user terminal 100 side. good.

(10) In the above embodiment, the map data is managed by another service providing device, but the server 200 may manage the map data.

(11) In the above embodiment, a 360° panoramic image is pasted on the inner peripheral surface of the omnidirectional virtual space CS1. However, as long as it is possible to display an image over a predetermined range, the virtual space CS1 may be, for example, a hemispherical shape. Also, the panorama image may be a strip-shaped 360-degree panorama image that does not have an image corresponding to the ceiling portion, or a panorama image that spans 180 degrees to the left and right.

(12) In the above embodiment, the touch screen 15 displays a panorama image corresponding to the actual scenery in the orientation of the camera 17 of the user terminal 100 . However, regardless of the orientation of the camera 17, a panorama image corresponding to the actual scenery in a specific orientation (for example, facing north) may be uniformly displayed on the touch screen 15. FIG.

(13) In the above embodiment, a panorama image is acquired based on the position information of the user terminal 100. The panorama image may be an image representing the scenery viewed from the position of the touched icon, An image representing the scenery viewed from the position of the user terminal 100, or the scenery viewed from the touch position on the map (assuming that the map is enlarged and the size of the icon and the size of the finger approximately match). An image representing the

(14) In the above embodiment, the character is arranged inside the celestial sphere, but the character image may be pasted on the inner circumferential surface of the celestial sphere.

(15) In the above embodiment, the index indicating the position of the user terminal 100 is fixedly displayed in the center of the map on the touch screen 15, and the map is updated each time the user terminal 100 moves by a predetermined amount. ing. However, the map may be fixed and the index may be moved according to the movement of the user terminal 100 . In this case, the map on the touch screen 15 is updated to the map in the movement direction of the index by performing a swipe operation or by identifying that the index has approached the edge of the map.

(16) In the above embodiment, a map of a predetermined area centered on the position of the user terminal 100 is displayed on the touch screen 15, and map data is sent from the server 200 each time the user terminal 100 moves a predetermined amount. I'm trying to get However, if map data of an area wider than the predetermined area (for example, an area nine times as large) is acquired and the position of the predetermined area is moved every time the user terminal 100 moves by a predetermined amount, the server 200 can send the map data to the map data. It is possible to reduce the frequency of data acquisition.

(17) In the above embodiment, an icon is exemplified as the first object, and a character or avatar is exemplified as the second object. However, it may be a three-dimensional image (for example, a 3D model) or the like.

(18) In the above embodiment, an example of controlling the viewing area according to the attitude and orientation of the user terminal has been described. good too. For example, when a swipe operation is received on the touch screen 15, control may be performed to move the field of view in the direction of the swipe operation by an amount corresponding to the amount of movement of the swipe operation. When a flick operation is received on the screen 15, control may be performed so that the field of view area is moved in the direction of the flick operation by an amount corresponding to the speed of the flick operation.

<Appendix>
The items described in each of the above embodiments will be added below.

(Appendix 1):
According to an aspect of one embodiment shown in the present disclosure, a game program executed in an information terminal device (user terminal 100 in FIG. 1) comprising a processor, a memory, an input unit, and a display unit, the game program is a first step (S207, S208, S210, S305), a second step (S301) of arranging a virtual camera in the virtual space, and a third step (S307) of controlling a field-of-view area from the virtual camera according to the user's operation on the information terminal device. and a fourth step (S302, S304) of displaying an image corresponding to the field-of-view area on the display unit, and the first step is performed when the object is not placed within the field-of-view area. The virtual space data is updated so as to move the object in the direction in which it is placed within the field of view (S305).

(Appendix 2):
In (Appendix 1), the game program causes the processor to display the object on the display unit and satisfy a predetermined condition (establish an opening condition), thereby performing game processing according to the object. to execute the fifth step (S211, S212).

(Appendix 3):
In (Appendix 2), the fourth step includes displaying a reference image at a predetermined position on the display unit by superimposing it on the video (S304), and the predetermined condition includes displaying the object at the predetermined position. It is established by letting

(Appendix 4):
In (Appendix 3), the fourth step does not display the reference image when the object is not placed within the viewing area, and displays the reference image when the object is placed within the viewing area. Display an image.

(Appendix 5):
In any one of (Appendix 1) to (Appendix 4), the information terminal device includes an imaging section (17), and the predetermined image is an image output from the imaging section.

(Appendix 6):
In any one of (Appendix 1) to (Appendix 5), the first step arranges the object in an area other than the field of view area when generating the virtual space data.

(Appendix 7):
In any one of (Appendix 1) to (Appendix 6), in the first step, when generating the virtual space data, regardless of the field of view area, the object is placed at a predetermined position in the virtual space. Deploy.

(Appendix 8):
In any one of (Appendix 1) to (Appendix 7), the first step performs specific notification when the object is placed within the field of view area.

(Appendix 9):
In any one of (Supplementary Note 1) to (Supplementary Note 8), the first step acquires a scenery image corresponding to a predetermined position as the predetermined image by communicating with a server that manages scenery images of various locations (S207 ).

(Appendix 10):
According to an aspect of one embodiment shown in the present disclosure, a game method executed by an information terminal device (user terminal 100 in FIG. 1) including a processor, a memory, an input unit, and a display unit, the game method is a first step (S207, S208, S210, S305), a second step (S301) of arranging a virtual camera in the virtual space, and a third step (S307) of controlling a field-of-view area from the virtual camera according to the user's operation on the information terminal device. and a fourth step (S302, S304) of displaying an image corresponding to the field-of-view area on the display unit, wherein the first step includes, when the object is not placed within the field-of-view area, the object is moved in the direction of being placed within the field of view area (S305).

(Appendix 11):
According to an aspect of an embodiment shown in the present disclosure, an information processing device (user terminal 100 in FIG. 1), comprising a storage unit (120 in FIG. 2) that stores a game program, and executing the game program A control unit (110 in FIG. 2) for controlling the operation of the information processing apparatus is provided, and the control unit generates virtual space data for specifying a virtual space associated with a predetermined image. , a first step (S207, S208, S210, S305) of arranging an object (monster) in the virtual space; a second step (S301) of arranging a virtual camera in the virtual space; A third step (S307) of controlling the field of view area from the virtual camera according to the user's operation, and a fourth step (S302, S304) of displaying an image corresponding to the field of view area on the display unit are executed. In the first step, when the object is not placed within the viewing area, the virtual space data is updated so as to move the object in a direction to be placed within the viewing area (S305).

[Example of realization by software]
Control blocks of control unit 110 (in particular, operation receiving unit 111, display control unit 112, UI control unit 113, animation generation unit 114, game progression unit 115, analysis unit 116, and progress information generation unit 117), control of control unit 210 blocks (in particular, progress support unit 211 and sharing support unit 212), and control blocks of control unit 310 (in particular, operation reception unit 311, display control unit 312, UI control unit 313, animation generation unit 314, progress simulation unit 315 , character control unit 316 and reaction processing unit 317) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or by software using a CPU (Central Processing Unit). You may

In the latter case, the control unit 110, the control unit 210, or the control unit 310, or an information processing apparatus having a plurality of these, includes a CPU that executes instructions of a program that is software for realizing each function, the above program, and various Equipped with ROM (Read Only Memory) or storage device (these are referred to as “recording media”) in which data is recorded so that it can be read by a computer (or CPU), RAM (Random Access Memory) for developing the above program, etc. . The object of the present invention is achieved by a computer (or CPU) reading and executing the program from the recording medium. As the recording medium, a "non-temporary tangible medium" such as a tape, disk, card, semiconductor memory, programmable logic circuit, or the like can be used. Also, the program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. Note that one aspect of the present invention can also be implemented in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, but can be modified in various ways within the scope of the claims, and can be obtained by appropriately combining technical means disclosed in different embodiments. is also included in the technical scope of the present invention.

1 game system, 2 network, 10, 20, 30 processor, 11, 21, 31 memory, 12, 22, 32 storage, 13, 23, 33 communication IF (operation unit), 14, 24, 34 input/output IF (operation part), 15, 35 touch screen (display part, operation part), 17 camera (operation part), 18 ranging sensor (operation part), 100 user terminal (computer, information processing device), 110, 113, 210, 310 control unit 111,311 operation reception unit 112,312 display control unit 113,313 UI control unit 114,314 animation generation unit 115 game progression unit 116 analysis unit 117 progress information generation unit 120,220, 320 storage unit, 131 game program, 132 game information, 133 user information, 134 character control program, 151, 351 input unit (operation unit), 152, 352 display unit, 200 server (computer), 211 progress support unit, 212 sharing Support unit 300 Action instruction device (NPC control device, character control device) 315 Progress simulation unit 316 Character control unit 317 Reaction processing unit 1010 Object 1020, 3030 Controller 1030 Storage medium 3010 Microphone 3020 Motion capture Device

Claims (9)

A program executed in an information terminal device,
Said program
a first means for generating virtual space data for enabling identification of a virtual space associated with a predetermined image, and arranging an object in the virtual space;
a second means for placing a virtual camera in the virtual space;
a third means for controlling a viewing area of the virtual camera to an area within the virtual space according to the user's operation on the information terminal device;
and executing a fourth means for displaying an image corresponding to the viewing area on the display unit;
The first means updates the virtual space data so as to move the object in a direction in which the object is arranged within the visual field region without user's operation after the virtual space data is generated. When the object is not placed within the viewing area controlled according to the operation, the object is displayed regardless of whether or not the object was once placed within the viewing area and displayed on the display unit . A program for updating virtual space data so as to move in a direction to be placed within the viewing area. Said program
2. The program according to claim 1, causing execution of fifth means for performing game processing according to said object by displaying said object on said display unit and satisfying a predetermined condition. The fourth means displays a reference image at a predetermined position on the display unit by superimposing it on the image,
3. The program according to claim 2, wherein said predetermined condition is satisfied by displaying said object at said predetermined position. wherein said fourth means does not display said reference image when said object is not arranged within said viewing area, and displays said reference image when said object is arranged within said viewing area. 4. The program according to item 3. The information terminal device has an imaging unit,
5. The program according to any one of claims 1 to 4, wherein said predetermined image is an image output from said imaging unit. 6. The program according to any one of claims 1 to 5, wherein said first means arranges said object in an area other than said viewing area when generating said virtual space data. 7. The first means , when generating the virtual space data, arranges the object at a predetermined position in the virtual space regardless of the field of view area. program as described. 8. The program according to any one of claims 1 to 7, wherein said first means performs specific notification when said object is placed within said viewing area. 9. The program according to any one of claims 1 to 8, wherein said first means communicates with a server that manages scenery images of various places and obtains a scenery image corresponding to a predetermined position as said predetermined image. .

Images