JP6843100B2 - Game programs, game methods, and information processing equipment - Google Patents

Description

The present invention relates to a game program, a game method, and an information processing device.

There is a location-based game in which the game management side is informed of the position of its own mobile terminal to calculate the moving distance and the current position, and the game is advanced based on the calculated data. As such a location-based game, a game that acquires a monster by searching for youkai (hereinafter referred to as monsters) located all over the country and displaying an image of the monster on the screen of a terminal owned by the user. There was (for example, Non-Patent Document 1).

"Yo-Kai Watch World", [online], [Searched on September 11, 2018], Internet <https://youkaiww.gungho.jp/>

However, in the game of Non-Patent Document 1, in order to display the image of the monster on the screen of the terminal, it is necessary to align the direction of the terminal with the position of the monster. At this time, the movement of swinging the terminal in any of the up, down, left, and right directions occurs. Therefore, the user may be suspicious by a third party around him.

The present invention has been conceived in view of such circumstances, and an object thereof is a game program, a game method, and information processing capable of concentrating on a game without being suspicious of a third party around. To provide the device.

According to an aspect of one embodiment presented in the present disclosure, a game program executed in an information terminal device including a processor, a memory, an input unit, and a display unit is provided. The game program generates virtual space data for enabling the processor to identify the virtual space associated with a predetermined image, and places the object in the virtual space as the first step, and places the virtual camera in the virtual space. The second step of controlling the field of view from the virtual camera according to the user's operation on the information terminal device, and the fourth step of displaying the image corresponding to the field of view on the display unit are executed. The first step updates the virtual space data so that the object is moved in the direction of being placed in the field of view when the object is not placed in the field of view.

According to certain aspects of one embodiment, there is provided a game method performed by an information terminal device comprising a processor, a memory, an input unit, and a display unit. The game method is the first step in which a computer generates virtual space data for identifying a virtual space associated with a predetermined image and places an object in the virtual space, and a virtual camera is placed in the virtual space. The second step is to control the field of view from the virtual camera according to the user's operation on the information terminal device, and the fourth step to display the image corresponding to the field of view on the display unit. One step updates the virtual space data so as to move the object in the direction of being placed in the field of view when the object is not placed in the field of view.

According to an aspect of one embodiment, an information processing device including a storage unit for storing a game program and a control unit for controlling the operation of the information processing device by executing the game program is provided. The control unit generates virtual space data for identifying the virtual space associated with a predetermined image, and arranges the object in the virtual space in the first step and the virtual camera in the virtual space. The first step is executed by executing the step, the third step of controlling the field of view from the virtual camera according to the user's operation on the information terminal device, and the fourth step of displaying the image corresponding to the field of view on the display unit. Updates the virtual space data to move the object in the direction in which it is placed in the field of view when the object is not placed in the field of view.

According to the present invention, it is possible to concentrate on the game without being suspicious of a third party around.

It is a figure which shows the hardware configuration of a game system. It is a block diagram which shows the functional configuration of a user terminal, a server, and an operation instruction device. It is a flowchart which shows an example about the basic game progress of the game executed based on the game program which concerns on this embodiment. It is a figure which shows an example of the data structure of the operation instruction data. It is a figure which shows an example of the data structure of a game information. It is a figure which shows an example of the quest presentation screen displayed on the display part of a user terminal. It is a figure which shows an example of the quest solution screen displayed on the display part of a user terminal. It is a figure which shows an example of the reward screen displayed on the display part of a user terminal. It is a figure which shows an example of the moving image playback screen displayed on the display part of a user terminal. It is a flowchart which shows the flow of processing executed in a game system. (A) is a diagram showing an example of a map including an icon, and (B) is a diagram showing an example of a map including an icon. It is a figure which conceptually represents one aspect which expresses a virtual space. (A) is a diagram showing an example of a state in which an aiming image and a monster are superimposed on a panoramic image, and (B) is a diagram showing an example of a state in which an aiming image and a monster are superimposed on a panoramic image. (A) is a diagram showing an example of a state in which an avatar is superimposed on a panoramic image, and (B) is a diagram showing a state in which the field of view area of the virtual camera is panned to the left from the state of (A). It is a flowchart which shows a part of the flow of processing executed in a game system. It is a flowchart which shows the other part of the flow of processing executed in a game system. It is a flowchart which shows a part of the flow of processing executed in a user terminal.

[Embodiment 1]
The game system according to the present disclosure is a system for providing a game to a plurality of users. Hereinafter, the game system will be described with reference to the drawings. It should be noted that the present invention is not limited to these examples, and is indicated by the scope of claims, and it is intended that all modifications within the meaning and scope equivalent to the scope of claims are included in the present invention. To. In the following description, the same elements are designated by the same reference numerals in the description of the drawings, and duplicate description will not be repeated.

<Hardware configuration of game system 1>
FIG. 1 is a diagram showing a hardware configuration of the game system 1. As shown in the figure, the game system 1 includes a plurality of user terminals 100 and a server 200. Each user terminal 100 connects to the server 200 via the network 2. The network 2 is composed of various mobile communication systems constructed by the Internet and a wireless base station (not shown). Examples of this mobile communication system include so-called 3G and 4G mobile communication systems, LTE (Long Term Evolution), and wireless networks (for example, Wi-Fi (registered trademark)) that can be connected to the Internet by a predetermined access point. Be done.

The server 200 (computer, information processing device) may be a general-purpose computer such as a workstation or a personal computer. The server 200 includes a processor 20, a memory 21, a storage 22, a communication IF 23, and an input / output IF 24. These configurations included in the server 200 are electrically connected to each other by a communication bus.

The user terminal 100 (computer, information processing device) may be a mobile terminal such as a smartphone, a feature phone, a PDA (Personal Digital Assistant), or a tablet computer. The user terminal 100 may be a game device suitable for game play. As shown in the figure, the user terminal 100 includes a processor 10, a memory 11, a storage 12, a communication interface (IF) 13, an input / output IF 14, a touch screen 15 (display unit), a camera (imaging unit) 17, and the like. A distance measuring sensor 18 is provided. These configurations included in the user terminal 100 are electrically connected to each other by a communication bus. The user terminal 100 may include an input / output IF 14 to which a display (display unit) configured separately from the user terminal 100 main body can be connected instead of or in addition to the touch screen 15.

Further, as shown in FIG. 1, the user terminal 100 may be configured to be communicable with one or more controllers 1020. The controller 1020 establishes communication with the user terminal 100 according to a communication standard such as Bluetooth (registered trademark). The controller 1020 may have one or more buttons or the like, and transmits an output value based on a user's input operation to the buttons or the like to the user terminal 100. Further, the controller 1020 may have various sensors such as an acceleration sensor and an angular velocity sensor, and transmits the output values of the various sensors to the user terminal 100.

In addition, instead of or in addition to the user terminal 100 including the camera 17 and the distance measuring sensor 18, the controller 1020 may have the camera 17 and the distance measuring sensor 18.

It is desirable that the user terminal 100, for example, at the start of a game, have a user who uses the controller 1020 input user identification information such as the user's name or login ID via the controller 1020. As a result, the user terminal 100 can associate the controller 1020 with the user, and identifies which user the output value belongs to based on the source of the received output value (controller 1020). be able to.

When the user terminal 100 communicates with a plurality of controllers 1020, each user holds each controller 1020, so that the one user terminal 100 does not communicate with other devices such as the server 200 via the network 2. Multiplayer can be realized with. In addition, each user terminal 100 communicates with each other according to a wireless standard such as a wireless LAN (Local Area Network) standard (communication connection is made without going through a server 200), thereby realizing local multiplayer with a plurality of user terminals 100. You can also do it. When the above-mentioned multiplayer is realized locally by one user terminal 100, the user terminal 100 may further include at least a part of various functions described later described in the server 200. Further, when the above-mentioned multi-play is realized locally by a plurality of user terminals 100, the plurality of user terminals 100 may be provided with various functions described later described in the server 200 in a distributed manner.

Even when the above-mentioned multiplayer is realized locally, the user terminal 100 may communicate with the server 200. For example, information indicating a play result such as a result or victory or defeat in a certain game may be associated with user identification information and transmitted to the server 200.

Further, the controller 1020 may be configured to be detachable from the user terminal 100. In this case, a coupling portion with the controller 1020 may be provided on at least one surface of the housing of the user terminal 100. When the user terminal 100 and the controller 1020 are connected by wire via the coupling portion, the user terminal 100 and the controller 1020 transmit and receive signals via wire.

As shown in FIG. 1, the user terminal 100 may accept the attachment of a storage medium 1030 such as an external memory card via the input / output IF14. As a result, the user terminal 100 can read the program and data recorded on the storage medium 1030. The program recorded on the storage medium 1030 is, for example, a game program.

The user terminal 100 may store the game program acquired by communicating with an external device such as the server 200 in the memory 11 of the user terminal 100, or may store the game program acquired by reading from the storage medium 1030 in the memory 11. You may memorize it in.

As described above, the user terminal 100 includes a communication IF 13, an input / output IF 14, a touch screen 15, a camera 17, and a distance measuring sensor 18 as an example of a mechanism for inputting information to the user terminal 100. Each of the above-mentioned parts as an input mechanism can be regarded as an operation part configured to accept a user's input operation.

For example, when the operation unit is configured by at least one of the camera 17 and the distance measuring sensor 18, the operation unit detects an object 1010 in the vicinity of the user terminal 100 and performs an input operation from the detection result of the object. Identify. As an example, a user's hand as an object 1010, a marker having a predetermined shape, or the like is detected, and an input operation is specified based on the color, shape, movement, or type of the object 1010 obtained as a detection result. To. More specifically, when the user's hand is detected from the captured image of the camera 17, the user terminal 100 inputs a gesture (a series of movements of the user's hand) detected based on the captured image. Identify and accept as. The captured image may be a still image or a moving image.

Alternatively, when the operation unit is composed of the touch screen 15, the user terminal 100 identifies and accepts the user's operation performed on the input unit 151 of the touch screen 15 as the user's input operation. Alternatively, when the operation unit is composed of the communication IF 13, the user terminal 100 identifies and accepts a signal (for example, an output value) transmitted from the controller 1020 as an input operation of the user. Alternatively, when the operation unit is composed of the input / output IF14, a signal output from an input device (not shown) different from the controller 1020 connected to the input / output IF14 is specified and accepted as a user input operation.

In this embodiment, the game system 1 further includes an operation instruction device 300. The operation instruction device 300 connects to each of the server 200 and the user terminal 100 via the network 2. At least one operation instruction device 300 is provided in the game system 1. A plurality of operation instruction devices 300 may be provided depending on the number of user terminals 100 that use the service provided by the server 200. One operation instruction device 300 may be provided for one user terminal 100. One operation instruction device 300 may be provided for a plurality of user terminals 100.

The operation instruction device 300 (NPC control device, character control device) may be a computer such as a server, a desktop personal computer, a laptop computer, or a tablet, and a computer group in which these are combined. As shown in the figure, the operation instruction device 300 includes a processor 30, a memory 31, a storage 32, a communication IF 33, an input / output IF 34, and a touch screen 35 (display unit). These configurations included in the operation instruction device 300 are electrically connected to each other by a communication bus. The operation instruction device 300 may include an input / output IF 34 to which a display (display unit) configured separately from the operation instruction device 300 main body can be connected instead of or in addition to the touch screen 35.

Further, as shown in FIG. 1, the operation instruction device 300 is connected to peripheral devices such as one or more microphones 3010, one or more motion capture devices 3020, and one or more controllers 3030 via wireless or wired. It may be configured to be communicable. The wirelessly connected peripheral device establishes communication with the operation instruction device 300 according to a communication standard such as Bluetooth (registered trademark).

The microphone 3010 acquires the voice generated in the surroundings and converts it into an electric signal. The voice converted into an electric signal is transmitted to the operation instruction device 300 as voice data, and is received by the operation instruction device 300 via the communication IF 33.

The motion capture device 3020 tracks the motion (including facial expressions, mouth movements, etc.) of the tracking target (for example, a person), and transmits the output value as the tracking result to the motion instruction device 300. The motion data, which is an output value, is received by the operation instruction device 300 via the communication IF 33. The motion capture method of the motion capture device 3020 is not particularly limited. The motion capture device 3020 selectively includes all mechanisms for capturing motion, such as a camera, various sensors, markers, a suit worn by a model (person), and a signal transmitter, depending on the method adopted. ..

The controller 3030 may have one or more physical input mechanisms such as buttons, levers, sticks, wheels and the like. The controller 3030 transmits an output value based on an input operation input to the input mechanism by the operator of the operation instruction device 300 to the operation instruction device 300. Further, the controller 3030 may have various sensors such as an acceleration sensor and an angular velocity sensor, and may transmit output values of the various sensors to the operation instruction device 300. The above output value is received by the operation instruction device 300 via the communication IF 33. In the following, a person who performs some input operation on the operation instruction device 300 by using the operation unit provided in the operation instruction device 300 or various input mechanisms communicably connected to the operation instruction device 300. Called an operator. The operator includes a person who operates the operation instruction device 300 using the input unit 351 and the controller 3030, a voice actor who inputs voice through the microphone 3010, and moves via the motion capture device 3020. A model for inputting is also included.

The operation instruction device 300 may include a camera and a distance measuring sensor (not shown). Alternatively or in addition to the motion instruction device 300, the motion capture device 3020 and the controller 3030 may have a camera and a distance measuring sensor.

As described above, the operation instruction device 300 includes a communication IF 33, an input / output IF 34, and a touch screen 35 as an example of a mechanism for inputting information to the operation instruction device 300. If necessary, a camera and a distance measuring sensor may be further provided. Each of the above-mentioned parts as an input mechanism can be regarded as an operation part configured to accept a user's input operation.

The operation unit may be composed of the touch screen 35. In this case, the operation instruction device 300 identifies and accepts the user's operation performed on the input unit 351 of the touch screen 35 as the user's input operation. Alternatively, when the operation unit is composed of the communication IF 33, the operation instruction device 300 identifies and accepts a signal (for example, an output value) transmitted from the controller 3030 as an input operation of the user. Alternatively, when the operation unit is composed of the input / output IF34, a signal output from an input device (not shown) different from the controller 3030 connected to the input / output IF34 is specified as an input operation of the user and received.

<Game overview>
The game executed by the game system 1 according to the present embodiment (hereinafter, this game) is, for example, a game in which one or more characters appear and at least one of the characters is operated based on the operation instruction data. .. The character appearing in the game may be a player character (hereinafter, PC) or a non-player character (hereinafter, NPC). The PC is a character that can be directly operated by the user. An NPC is a character that operates according to a game program and operation instruction data, that is, a character that cannot be directly operated by the user. In the following, when it is not necessary to distinguish between the two, "character" is used as a generic term.

As an example, this game is a training simulation game. Specifically, in the training simulation game, the main character, who is a user, deepens interaction with the character and works on it to make the character a famous video distributor and realize the dream that the character has. It is an object. Further, the training simulation game may include an element of a romance simulation game in which the main character aims to increase intimacy through interaction with a character.

Further, it is preferable that the game includes at least a live distribution part as an example. In the game system 1, operation instruction data is supplied to the user terminal 100 executing the game from a device other than the user terminal 100 at an arbitrary timing. The user terminal 100 analyzes (renders) the operation instruction data by using the reception of the operation instruction data as a trigger. The live distribution part is a part in which the user terminal 100 presents to the user a character that operates according to the above-mentioned analyzed operation instruction data in real time. As a result, the user can feel the reality as if the character really exists, and can further immerse himself in the game world and enjoy the game.

In this embodiment, the game may be composed of a plurality of play parts. In this case, the character properties may differ from part to part, such as one character being a PC in one part and an NPC in another part.

The genre of the game is not limited to a specific genre. Game system 1 can play games of any genre. For example, sports-themed games such as tennis, table tennis, dodgeball, baseball, soccer and hockey, puzzle games, quiz games, RPG (Role-Playing Game), adventure games, shooting games, simulation games, training games, and It may be an action game or the like.

Further, the play mode of the game executed in the game system 1 is not limited to a specific play mode. The game system 1 can execute a game of any play form. For example, a single-play game by a single user, a multi-play game by a plurality of users, a battle game in which a plurality of users play against each other, and a cooperative play game in which a plurality of users cooperate among the multi-play games. You may.

<Hardware components of each device>
The processor 10 controls the operation of the entire user terminal 100. The processor 20 controls the operation of the entire server 200. The processor 30 controls the operation of the entire operation instruction device 300. Processors 10, 20 and 30 include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit).

The processor 10 reads a program from the storage 12 described later and expands it into the memory 11 described later. The processor 20 reads a program from the storage 22 described later and expands it into the memory 21 described later. The processor 30 reads a program from the storage 32 described later and expands it into the memory 31 described later. Processor 10, processor 20 and processor 30 execute the deployed program.

The memories 11, 21 and 31 are the main storage devices. The memories 11, 21 and 31 are composed of storage devices such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory 11 provides a work area to the processor 10 by temporarily storing a program and various data read from the storage 12 described later by the processor 10. The memory 11 also temporarily stores various data generated while the processor 10 is operating according to the program. The memory 21 provides a work area to the processor 20 by temporarily storing various programs and data read from the storage 22 described later by the processor 20. The memory 21 also temporarily stores various data generated while the processor 20 is operating according to the program. The memory 31 provides a work area to the processor 30 by temporarily storing various programs and data read from the storage 32 described later by the processor 30. The memory 31 also temporarily stores various data generated while the processor 30 is operating according to the program.

In the present embodiment, the program may be a game program for realizing the game by the user terminal 100. Alternatively, the program may be a game program for realizing the game in collaboration with the user terminal 100 and the server 200. Alternatively, the program may be a game program for realizing the game in collaboration with the user terminal 100, the server 200, and the operation instruction device 300. As an example, a game realized by the cooperation of the user terminal 100 and the server 200 and a game realized by the cooperation of the user terminal 100, the server 200, and the operation instruction device 300 are started by the user terminal 100. It may be a game that runs on a browser. Alternatively, the program may be a game program for realizing the game in collaboration with a plurality of user terminals 100. Further, the various data include data related to the game such as user information and game information, and instructions or notifications to be transmitted / received between the devices of the game system 1.

Storages 12, 22 and 32 are auxiliary storage devices. The storages 12, 22 and 32 are composed of a storage device such as a flash memory or an HDD (Hard Disk Drive). Various data related to the game are stored in the storages 12, 22 and 32.

The communication IF 13 controls the transmission / reception of various data in the user terminal 100. The communication IF 23 controls the transmission and reception of various data on the server 200. The communication IF 33 controls the transmission and reception of various data in the operation instruction device 300. The communication IFs 13, 23 and 33 control, for example, communication via a wireless LAN (Local Area Network), Internet communication via a wired LAN, a wireless LAN, or a mobile phone network, and communication using short-range wireless communication and the like. ..

The input / output IF 14 is an interface for the user terminal 100 to accept data input, and an interface for the user terminal 100 to output data. The input / output IF 14 may input / output data via USB (Universal Serial Bus) or the like. The input / output IF 14 may include, for example, a physical button, a camera, a microphone, a speaker, or the like of the user terminal 100. The input / output IF24 of the server 200 is an interface for the server 200 to receive data input, and an interface for the server 200 to output data. The input / output IF 24 may include, for example, an input unit that is an information input device such as a mouse or a keyboard, and a display unit that is a device that displays and outputs an image. The input / output IF 34 of the operation instruction device 300 is an interface for the operation instruction device 300 to receive data input, and an interface for the operation instruction device 300 to output data. The input / output IF34 includes, for example, information input devices such as a mouse, keyboard, stick, and lever, devices for displaying and outputting images such as a liquid crystal display, and peripheral devices (microphone 3010, motion capture device 3020, and controller 3030). It may include a connection for sending and receiving data between.

The touch screen 15 of the user terminal 100 is an electronic component that combines an input unit 151 and a display unit 152. The touch screen 35 of the operation instruction device 300 is an electronic component that combines an input unit 351 and a display unit 352. The input units 151 and 351 are, for example, touch-sensitive devices, and are configured by, for example, a touch pad. The display units 152 and 352 are composed of, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, or the like.

The input units 151 and 351 detect the position where the user's operation (mainly a physical contact operation such as a touch operation, a slide operation, a swipe operation, and a tap operation) is input to the input surface, and information indicating the position. Is provided as an input signal. The input units 151 and 351 may include touch sensing units (not shown). The touch sensing unit may adopt any method such as a capacitance method or a resistance film method.

Although not shown, the user terminal 100 may include one or more sensors for specifying the holding posture of the user terminal 100. This sensor may be, for example, an acceleration sensor, an angular velocity sensor, or the like. When the user terminal 100 includes a sensor, the processor 10 can also specify the holding posture of the user terminal 100 from the output of the sensor and perform processing according to the holding posture. For example, the processor 10 may be a vertical screen display in which a vertically long image is displayed on the display unit 152 when the user terminal 100 is held vertically. On the other hand, when the user terminal 100 is held horizontally, it may be a horizontal screen display in which a horizontally long image is displayed on the display unit. In this way, the processor 10 may be able to switch between the vertical screen display and the horizontal screen display according to the holding posture of the user terminal 100.

The camera 17 includes an image sensor and the like, and generates a captured image by converting the incident light incident from the lens into an electric signal.

The distance measuring sensor 18 is a sensor that measures the distance to the object to be measured. The ranging sensor 18 includes, for example, a light source that emits pulse-converted light and a light receiving element that receives the light. The distance measuring sensor 18 measures the distance to the object to be measured by the timing of light emission from the light source and the timing of receiving the reflected light generated by the light emitted from the light source being reflected by the object to be measured. The ranging sensor 18 may have a light source that emits light having directivity.

Here, an example in which the user terminal 100 receives the detection result of detecting the object 1010 in the vicinity of the user terminal 100 by using the camera 17 and the distance measuring sensor 18 as an input operation of the user will be further described. The camera 17 and the distance measuring sensor 18 may be provided on the side surface of the housing of the user terminal 100, for example. A ranging sensor 18 may be provided in the vicinity of the camera 17. As the camera 17, for example, an infrared camera can be used. In this case, the camera 17 may be provided with a lighting device that irradiates infrared rays, a filter that blocks visible light, and the like. As a result, the accuracy of detecting an object based on the captured image of the camera 17 can be further improved regardless of whether it is outdoors or indoors.

The processor 10 may perform one or more of the processes shown in the following (1) to (5), for example, on the captured image of the camera 17. (1) The processor 10 performs image recognition processing on the captured image of the camera 17 to identify whether or not the captured image includes a user's hand. The processor 10 may use, for example, a technique such as pattern matching as the analysis technique adopted in the above-mentioned image recognition process. (2) Further, the processor 10 detects the user's gesture from the shape of the user's hand. The processor 10 specifies, for example, the number of fingers of the user (the number of extended fingers) from the shape of the user's hand detected from the captured image. The processor 10 further identifies the gesture performed by the user from the number of identified fingers. For example, the processor 10 determines that the user has made a "par" gesture when the number of fingers is five. Further, when the number of fingers is 0 (the fingers are not detected), the processor 10 determines that the user has made a “goo” gesture. Further, when the number of fingers is two, the processor 10 determines that the user has made a "choki" gesture. (3) The processor 10 performs image recognition processing on the captured image of the camera 17 to detect whether the user's finger is in a state where only the index finger is raised or the user's finger is repelled. .. (4) The processor 10 is an object 1010 (user's hand or the like) in the vicinity of the user terminal 100 based on at least one of the image recognition result of the image captured by the camera 17 and the output value of the distance measuring sensor 18. ) And the user terminal 100. For example, the processor 10 determines whether the user's hand is near the user terminal 100 (for example, a distance less than a predetermined value) or far away (for example, a predetermined value) depending on the size of the shape of the user's hand specified from the image captured by the camera 17. Detect whether it is at the above distance). When the captured image is a moving image, the processor 10 may detect whether the user's hand is approaching or moving away from the user terminal 100. (5) When it is found that the distance between the user terminal 100 and the user's hand is changing while the user's hand is detected based on the image recognition result of the image captured by the camera 17, the processor 10 recognizes that the user is waving his hand in the shooting direction of the camera 17. When an object is detected or not detected by the distance measuring sensor 18 having a stronger directivity than the shooting range of the camera 17, the processor 10 determines that the user is waving his hand in a direction orthogonal to the shooting direction of the camera. recognize.

In this way, the processor 10 determines whether or not the user is holding a hand (whether it is a “goo” gesture or another gesture (for example, “par”) by recognizing an image captured by the camera 17. ) Is detected. The processor 10 also detects the shape of the user's hand and how the user is moving the hand. In addition, the processor 10 detects whether the user is approaching or moving this hand toward or away from the user terminal 100. Such an operation can correspond to an operation using a pointing device such as a mouse or a touch panel, for example. For example, the user terminal 100 moves the pointer on the touch screen 15 in response to the movement of the user's hand, and detects the user's gesture “goo”. In this case, the user terminal 100 recognizes that the user is continuing the selection operation. The continuation of the selection operation corresponds to, for example, the state in which the mouse is clicked and pressed is maintained, or the state in which the mouse is touched after the touchdown operation is performed on the touch panel is maintained. Further, when the user moves his / her hand while the user's gesture "goo" is detected, the user terminal 100 performs such a series of gestures as an operation corresponding to a swipe operation (or a drag operation). You can also recognize it. Further, when the user terminal 100 detects a gesture that the user flips a finger based on the detection result of the user's hand by the image captured by the camera 17, the gesture is clicked by a mouse or tapped on the touch panel. It may be recognized as an operation corresponding to.

<Functional configuration of game system 1>
FIG. 2 is a block diagram showing a functional configuration of a user terminal 100, a server 200, and an operation instruction device 300 included in the game system 1. Each of the user terminal 100, the server 200, and the operation instruction device 300 has a functional configuration (not shown) required for functioning as a general computer and a functional configuration required for realizing a known function in a game. Can include.

The user terminal 100 has a function as an input device that accepts a user's input operation and a function as an output device that outputs a game image or sound. The user terminal 100 functions as a control unit 110 and a storage unit 120 in cooperation with the processor 10, the memory 11, the storage 12, the communication IF 13, the input / output IF 14, and the like.

The server 200 has a function of communicating with each user terminal 100 and supporting the user terminal 100 to advance the game. For example, when the user terminal 100 downloads an application related to this game for the first time, the user terminal 100 is provided with data to be stored in the user terminal 100 at the start of the first game. For example, the server 200 transmits the operation instruction data for operating the character to the user terminal 100. The motion instruction data may include motion capture data in which the movement of an actor such as a model is captured in advance, may include voice data obtained by recording the voice of an actor such as a voice actor, or operate the character. It may include operation history data indicating a history of input operations for the purpose, or may include a motion command group in which commands associated with the above-mentioned series of input operations are arranged in chronological order. When the game is a multiplayer game, the server 200 may have a function of communicating with each user terminal 100 participating in the game and mediating an exchange between the user terminals 100 and a synchronization control function. Further, the server 200 has a function of mediating between the user terminal 100 and the operation instruction device 300. As a result, the operation instruction device 300 can supply the operation instruction data to the user terminal 100 or a group of a plurality of user terminals 100 in a timely manner without making a mistake in the destination. The server 200 functions as a control unit 210 and a storage unit 220 in cooperation with the processor 20, the memory 21, the storage 22, the communication IF23, the input / output IF24, and the like.

The operation instruction device 300 has a function of generating operation instruction data for instructing the operation of a character in the user terminal 100 and supplying the operation instruction data to the user terminal 100. The operation instruction device 300 functions as a control unit 310 and a storage unit 320 in cooperation with the processor 30, the memory 31, the storage 32, the communication IF 33, the input / output IF 34, and the like.

The storage units 120, 220, and 320 store the game program 131, the game information 132, and the user information 133. The game program 131 is a game program executed by the user terminal 100, the server 200, and the operation instruction device 300. The game information 132 is data that the control units 110, 210, and 310 refer to when executing the game program 131. The user information 133 is data related to the user's account. In the storage units 220 and 320, the game information 132 and the user information 133 are stored for each user terminal 100. The storage unit 320 further stores the character control program 134. The character control program 134 is a program executed by the motion instruction device 300, and is a program for controlling the motion of a character appearing in a game based on the game program 131 described above.

(Functional configuration of server 200)
The control unit 210 comprehensively controls the server 200 by executing the game program 131 stored in the storage unit 220. For example, the control unit 210 transmits various data, programs, and the like to the user terminal 100. The control unit 210 receives a part or all of the game information or the user information from the user terminal 100. When the game is a multiplayer game, the control unit 210 may receive a request for synchronization of multiplayer from the user terminal 100 and transmit data for synchronization to the user terminal 100. In addition, the control unit 210 communicates with the user terminal 100 and the operation instruction device 300 as necessary to send and receive information.

The control unit 210 functions as a progress support unit 211 and a shared support unit 212 according to the description of the game program 131. The control unit 210 can also function as other functional blocks (not shown) in order to support the progress of the game on the user terminal 100, depending on the nature of the game to be executed.

The progress support unit 211 communicates with the user terminal 100 and supports the user terminal 100 to proceed with various parts included in the game. For example, when the user terminal 100 advances the game, the progress support unit 211 provides the user terminal 100 with information necessary for advancing the game.

The sharing support unit 212 communicates with a plurality of user terminals 100, and supports a plurality of users to share each other's decks on each user terminal 100. Further, the sharing support unit 212 may have a function of matching the online user terminal 100 with the operation instruction device 300. As a result, information can be smoothly transmitted and received between the user terminal 100 and the operation instruction device 300.

(Functional configuration of user terminal 100)
The control unit 110 comprehensively controls the user terminal 100 by executing the game program 131 stored in the storage unit 120. For example, the control unit 110 advances the game according to the operation of the game program 131 and the user. In addition, the control unit 110 communicates with the server 200 and the operation instruction device 300 as necessary to transmit and receive information while the game is in progress.

The control unit 110 includes an operation reception unit 111, a display control unit 112, a user interface (hereinafter, UI) control unit 113, an animation generation unit 114, a game progress unit 115, an analysis unit 116, and a progress unit according to the description of the game program 131. It functions as an information generation unit 117. The control unit 110 can also function as other functional blocks (not shown) in order to advance the game, depending on the nature of the game to be executed.

The operation reception unit 111 detects and accepts a user's input operation with respect to the input unit 151. The operation reception unit 111 determines what kind of input operation has been performed from the action exerted by the user on the console via the touch screen 15 and other input / output IF 14, and outputs the result to each element of the control unit 110. To do.

For example, the operation receiving unit 111 receives an input operation for the input unit 151, detects the coordinates of the input position of the input operation, and specifies the type of the input operation. The operation reception unit 111 specifies, for example, a touch operation, a slide operation, a swipe operation, a tap operation, and the like as the types of input operations. Further, the operation reception unit 111 detects that the contact input is released from the touch screen 15 when the continuously detected input is interrupted.

The UI control unit 113 controls a UI object to be displayed on the display unit 152 in order to construct a UI. The UI object is a tool for the user to make an input necessary for the progress of the game to the user terminal 100, or a tool for obtaining information output from the user terminal 100 during the progress of the game. UI objects are, but are not limited to, icons, buttons, lists, menu screens, and the like.

The animation generation unit 114 generates animations showing the motions of various objects based on the control modes of the various objects. For example, the animation generation unit 114 may generate an animation or the like that expresses how the character moves as if it were there, moves the mouth, or changes the facial expression.

The display control unit 112 outputs a game screen reflecting the processing results executed by each of the above-mentioned elements to the display unit 152 of the touch screen 15. The display control unit 112 may display the game screen including the animation generated by the animation generation unit 114 on the display unit 152. Further, the display control unit 112 may superimpose and draw the above-mentioned UI object controlled by the UI control unit 113 on the game screen.

The game progress unit 115 advances the game. In the present embodiment, the game progress unit 115 advances the game in response to a user's input operation input via the operation reception unit 111. The game progress unit 115 causes one or more characters to appear and operates the characters while the game is in progress. The game progress unit 115 may operate the character according to the game program 131 downloaded in advance, may operate according to the input operation of the user, or may operate the character according to the operation instruction device 300. It may be operated according to.

When the game is divided into a plurality of parts such as the first part, the second part, and so on, the game progress unit 115 advances the game according to the specifications of each part.

To give a concrete example, it is assumed that the first part is a story part in which the story in the game progresses by interacting with the character. In this case, the game progress unit 115 advances the story part as follows. Specifically, the game progress unit 115 operates the character according to the game program 131 downloaded in advance or the operation instruction data (first operation instruction data) also downloaded in advance. The game progress unit 115 identifies the option selected by the user based on the input operation of the user received by the operation reception unit 111, and causes the character to perform the operation associated with the option. It is assumed that the second part is a live distribution part in which the character is operated based on the operation instruction data supplied from the operation instruction device 300. In this case, the game progress unit 115 operates the character from the operation instruction device 300 based on the operation instruction data to advance the live distribution part.

The analysis unit 116 analyzes (renders) the operation instruction data, and instructs the game progress unit 115 to operate the character based on the analysis result. In the present embodiment, the analysis unit 116 starts rendering of the operation instruction data by using the fact that the operation instruction data supplied by the operation instruction device 300 is received via the communication IF 33 as a trigger. The operation instruction device 300 transmits the analysis result to the game progress unit 115, and immediately instructs the character to operate based on the operation instruction data. That is, the game progress unit 115 uses the reception of the operation instruction data as a trigger to operate the character based on the operation instruction data. This makes it possible to show the user a character that operates in real time.

The progress information generation unit 117 generates progress information indicating the progress of the game being executed by the game progress unit 115, and transmits the progress information to the server 200 or the operation instruction device 300 in a timely manner. The progress information may include, for example, information that specifies the currently displayed game screen, or may include a progress log indicating the progress of the game in chronological order by characters, symbols, and the like. In the game system 1, in the embodiment in which the server 200 and the operation instruction device 300 do not require progress information, the progress information generation unit 117 may be omitted.

(Functional configuration of operation instruction device 300)
The control unit 310 comprehensively controls the operation instruction device 300 by executing the character control program 134 stored in the storage unit 320. For example, the control unit 310 generates operation instruction data according to the operation of the character control program 134 and the operator, and supplies the operation instruction data to the user terminal 100. The control unit 310 may further execute the game program 131, if necessary. In addition, the control unit 310 communicates with the server 200 and the user terminal 100 running the game to send and receive information.

The control unit 310 functions as an operation reception unit 311, a display control unit 312, a UI control unit 313, an animation generation unit 314, a progress simulation unit 315, and a character control unit 316 according to the description of the character control program 134. The control unit 310 can also function as other functional blocks (not shown) in order to control the characters appearing in the game according to the nature of the game executed in the game system 1.

The operation reception unit 311 detects and accepts an operator's input operation with respect to the input unit 351. The operation reception unit 311 determines what kind of input operation has been performed on the console via the touch screen 35 and other input / output IF 34s from the action exerted by the operator, and outputs the result to each element of the control unit 310. Output. The details of the function of the operation reception unit 311 are almost the same as those of the operation reception unit 111 in the user terminal 100.

The UI control unit 313 controls the UI object to be displayed on the display unit 352.

The animation generation unit 314 generates animations showing the motions of various objects based on the control modes of the various objects. For example, the animation generation unit 314 may generate an animation or the like that reproduces the game screen actually displayed on the user terminal 100 that is the communication partner.

The display control unit 312 outputs a game screen reflecting the processing results executed by each of the above-mentioned elements to the display unit 352 of the touch screen 35. The details of the function of the display control unit 312 are substantially the same as those of the display control unit 112 in the user terminal 100.

The progress simulation unit 315 grasps the progress of the game on the user terminal 100 based on the progress information indicating the progress of the game received from the user terminal 100. Then, the progress simulation unit 315 presents the progress of the user terminal 100 to the operator by simulating the behavior of the user terminal 100 in the operation instruction device 300.

For example, the progress simulation unit 315 may display a reproduction of the game screen displayed on the user terminal 100 on the display unit 352 of its own device. Further, the progress simulation unit 315 may display the progress of the game on the display unit 352 as the above-mentioned progress log on the user terminal 100.

Further, a part of the functions of the progress simulation unit 315 may be realized by the control unit 310 executing the game program 131. For example, first, the progress simulation unit 315 grasps the progress of the game of the user terminal 100 based on the progress information. Then, the progress simulation unit 315 may completely or simplify the game screen currently displayed on the user terminal 100 based on the game program 131 and reproduce it on the display unit 352 of its own device. Alternatively, the progress simulation unit 315 may grasp the progress of the current game, predict the game progress after the present time based on the game program 131, and output the prediction result to the display unit 352.

The character control unit 316 controls the behavior of the character displayed on the user terminal 100. Specifically, the operation instruction data for operating the character is generated and supplied to the user terminal 100. For example, the character control unit 316 generates operation instruction data instructing an operator (voice actor or the like) to make the character to be controlled speak based on the voice data input via the microphone 3010. The operation instruction data generated in this way includes at least the above-mentioned voice data. Further, for example, an operator (model or the like) generates motion instruction data instructing the character to be controlled to perform a motion based on the motion capture data input via the motion capture device 3020. The motion instruction data generated in this way includes at least the above-mentioned motion capture data. Further, for example, it is instructed that the operator operates the character to be controlled based on the history of the input operation input through the input mechanism such as the controller 3030 or the operation unit such as the input unit 351 which is the operation history data. Generate action instruction data to be performed. The operation instruction data generated in this way includes at least the above-mentioned operation history data. The operation history data is, for example, information in which operation logs indicating which button of the controller 3030 is pressed at what timing by the operator when which screen is displayed on the display unit are organized in chronological order. .. The display unit here may be a display unit linked with the controller 3030, may be a display unit 352 of the touch screen 35, or may be another display unit connected via the input / output IF 34. .. Alternatively, the character control unit 316 identifies a command that instructs the character's operation, which is associated with the input operation input by the operator via the above-mentioned input mechanism or operation unit. Then, the character control unit 316 arranges the commands in the order in which they are input to generate a motion command group indicating a series of actions of the character, and generates motion instruction data instructing the character to move according to the motion command group. You may. The motion instruction data generated in this way includes at least the above-mentioned motion command group.

The reaction processing unit 317 receives feedback on the user's reaction from the user terminal 100 and outputs this to the operator of the operation instruction device 300. In the present embodiment, for example, the user terminal 100 can create a comment addressed to the character while the character is operated according to the above-mentioned operation instruction data. The reaction processing unit 317 receives the comment data of the comment and outputs it. The reaction processing unit 317 may display the text data corresponding to the user's comment on the display unit 352, or may output the voice data corresponding to the user's comment from a speaker (not shown).

The functions of the user terminal 100, the server 200, and the operation instruction device 300 shown in FIG. 2 are merely examples. Each device of the user terminal 100, the server 200, and the operation instruction device 300 may include at least a part of the functions provided by the other devices. Further, another device other than the user terminal 100, the server 200, and the operation instruction device 300 may be used as a component of the game system 1, and the other device may be made to execute a part of the processing in the game system 1.
That is, the computer that executes the game program in the present embodiment may be any of the user terminal 100, the server 200, the operation instruction device 300, and other devices, and is realized by a combination of a plurality of these devices. May be done.

In this embodiment, the progress simulation unit 315 may be omitted. Further, in the present embodiment, the control unit 310 can function as the reaction processing unit 317 according to the description of the character control program 134.

<Game structure>
FIG. 3 is a flowchart showing an example of the basic game progress of this game. The game is divided into, for example, two gameplay parts. As an example, the first part is a story part and the second part is a live distribution part. The game may also include an acquisition part that allows the user to acquire game media, which is digital data that can be used in the game, in exchange for valuable data held by the user. In the present embodiment, the play order of each part is not particularly limited. FIG. 3 shows a case where the user terminal 100 executes the game in the order of the story part, the acquisition part, and the live distribution part.

In step S1, the game progress unit 115 executes the story part. The story part includes, for example, a scene in which the main character operated by the user interacts with the character. In the present embodiment, as an example, the "scenario" collected as digital data corresponds to one story of a story related to a character, is supplied from the server 200, and is temporarily stored in the storage unit 120. In the story part, the game progress unit 115 reads out one scenario stored in the storage unit 120, and advances one scenario according to the input operation of the user until the end is reached. The scenario includes an option to be selected by the user, a response pattern of the character corresponding to the option, and the like, and different outcomes may be obtained in one scenario depending on which option the user selects. .. Specifically, the game progress unit 115 presents a plurality of options corresponding to the action from the main character to the character so that the user can select them, and advances the scenario according to the options selected by the user.

In step S2, when the user plays the scenario to the end, the game progress unit 115 may make the user acquire a reward according to the ending. The reward is provided to the user, for example, as a game medium which is digital data that can be used in the game. The game medium may be, for example, an item such as clothing that can be worn by the character. Here, "to make the user acquire the reward" may, for example, change the status of the game medium as the reward managed in association with the user from unusable to usable. Alternatively, the game medium may be stored in at least one of the memories (memory 11, memory 21, memory 31) included in the game system 1 in association with the user identification information or the user terminal ID.

In step S3, the game progress unit 115 executes the acquisition part. In the acquisition part, the game medium to be acquired by the user may be a new scenario different from the scenario provided to the user terminal 100 at the time of the first download. In the following, the former scenario will be referred to as a fixed scenario, and the latter scenario will be referred to as an acquisition scenario. When it is not necessary to distinguish between the two, it is simply referred to as a scenario.

In the acquisition part, for example, the game progress unit 115 causes the user to have an acquisition scenario different from the fixed scenario that the user already has, in exchange for consuming the user's valuable data. The scenario to be acquired by the user may be determined by the game progress unit 115 or the progress support unit 211 of the server 200 according to a predetermined rule. More specifically, the game progress unit 115 or the progress support unit 211 may execute a lottery and randomly determine a scenario to be acquired by the user from a plurality of acquisition scenarios. The acquisition part may be executed at any time before and after the story part and the live distribution part.

In step S4, the game progress unit 115 determines whether or not the operation instruction data has been received from the external device via the network. As long as the operation instruction data is not received from the external device, the game progress unit 115 may return from NO in step S4 to, for example, step S1 to execute the story part. Alternatively, the game progress unit 115 may execute the acquisition part of step S3. On the other hand, when the operation instruction data is received from the external device, the game progress unit 115 proceeds from YES in step S4 to step S5.

In step S5, the game progress unit 115 executes the live distribution part (second part). Specifically, the game progress unit 115 advances the live distribution part by operating the character according to the operation instruction data received in step S4. In step S1, the user simply interacts with the character showing a definite reaction via the UI in the scenario. However, in the live distribution part, the user can freely and interactively interact with the character that operates in real time based on the operation instruction data transmitted from the external device. More specifically, the analysis unit 116 receives the operation instruction data including the voice data and the motion data generated according to the content of the input operation of the user from the operation instruction device 300. Then, the game progress unit 115 causes the character to speak based on the voice data included in the received motion instruction data, and moves the character based on the above-mentioned motion data. Thereby, the reaction of the character to the above-mentioned user's input operation can be presented to the user.

<Outline of processing>
In the present embodiment, the user terminal 100 is configured to execute the following steps in order to improve the enjoyment of the game based on the game program 131. Specifically, the user terminal 100 is operation instruction data that specifies the operation of the NPC that neither the user nor the other user operates, and is based on the first operation instruction data stored in advance in the memory 11. A step of operating an NPC and advancing the first part according to a user's input operation input via an operation unit (input / output IF14, touch screen 15, camera 17, distance measurement sensor 18), and an NPC control device (NPC control device). The step of advancing the second part by operating the NPC based on the second operation instruction data received from the operation instruction device 300) is executed.

According to the above configuration, the user terminal 100 operates the NPC in the first part based on the first operation instruction data downloaded in advance. In addition to this, the user terminal 100 receives the second operation instruction data from the operation instruction device 300, and in the second part, operates the NPC based on the second operation instruction data. Since the NPC can be operated based on the second operation instruction data received from the operation instruction device 300, the operation of the NPC is unconventional and its expression is greatly expanded. Therefore, the user can feel the reality as if the NPC is in the real world through the interaction with the NPC during the game play. As a result, it has the effect of increasing the immersive feeling of the game and improving the enjoyment of the game.

<Data structure>
(Operation instruction data)
FIG. 4 is a diagram showing an example of a data structure of operation instruction data processed by the game system 1 according to the present embodiment. As an example, the action instruction data includes each item of "destination" and "creator" which is meta information, and each item of "character ID", "voice", and "movement" which is the contents of the data. It is composed of.

The destination designation information is stored in the item "destination". The destination designation information is information indicating to which device the operation instruction data is transmitted. The destination designation information may be, for example, an address unique to the user terminal 100, or identification information of a group to which the user terminal 100 belongs. It may be a symbol (for example, "ALL") indicating that all user terminals 100 satisfying a certain condition are destined for the destination.

The creation source information is stored in the item "creation source". The creation source information is information indicating which device created the operation instruction data. The creation source information is information related to a user (hereinafter, user-related information) that can identify a specific user, such as a user ID, a user terminal ID, and a unique address of the user terminal. The creation source information may be an ID or address indicating the server 200 or the operation instruction device 300, and if the creation source is the server 200 or the operation instruction device 300, the value of the item is left empty. The item itself may not be provided in the operation instruction data.

In the item "character ID", a character ID for uniquely identifying a character appearing in this game is stored. The character ID stored here represents which character's action is indicated by the action instruction data.

In the item "voice", voice data to be expressed in the character is stored. Motion data that specifies the movement of the character is stored in the item "movement". As an example, the motion data may be motion capture data acquired by the motion instruction device 300 via the motion capture device 3020. The motion capture data may be data that tracks the movement of the entire body of the actor, data that tracks the facial expression and mouth movement of the actor, or both. As another example, the motion data may be a motion command group instructing a series of movements of the character specified by an operation input by the operator of the operation instruction device 300 via the controller 3030. For example, when the commands "raise the right hand", "raise the left hand", "walk", and "run" are assigned to the buttons A, B, C, and D of the controller 3030, respectively, the operator , Button A, Button B, Button C, and Button D are pressed in succession. In this case, a group of motion commands in which the "raise right hand", "raise left hand", "walk", and "run" commands are arranged in the above order is stored in the "movement" item as motion data. Will be done. In the present embodiment, the voice data and the motion data are included in the operation instruction data in a synchronized state.

By receiving such motion instruction data, the game progress unit 115 can operate the character appearing in the game as intended by the creator of the motion instruction data. Specifically, when the action instruction data includes voice data, the game progress unit 115 causes the character to speak based on the voice data. Further, when the motion instruction data includes motion data, the game progress unit 115 moves the character based on the motion data, that is, generates an animation of the character so as to move based on the motion data. To do.

(Game information)
FIG. 5 is a diagram showing an example of the data structure of the game information 132 processed by the game system 1 according to the present embodiment. The items provided in the game information 132 are appropriately determined according to the genre, nature, content, etc. of the game, and the illustrated items do not limit the scope of the present invention. As an example, the game information 132 is configured to include each item of "play history", "item", "intimacy", "nameness", and "delivery history". Each of these items is appropriately referred to when the game progress unit 115 advances the game.

The item "play history" stores the user's play history. The play history is information indicating whether or not the user's play is completed for each scenario stored in the storage unit 120. For example, the play history includes a list of fixed scenarios downloaded at the first time of play and a list of acquisition scenarios acquired later in the acquisition part. In each list, statuses such as "played", "unplayed", "playable", and "unplayable" are associated with each scenario.

The item "item" stores a list of items owned by the user as a game medium. In this game, an item is, for example, a clothing item worn by a character. The user can make the character wear the items obtained by playing the scenario and customize the appearance of the character.

The item "intimacy" stores intimacy, which is one of the character's statuses. The new density is a parameter that indicates the friendliness of the user's alter ego, the "hero", with the character. For example, the game progress unit 115 may advance the game in favor of the user as the intimacy is higher. For example, the game progress unit 115 may increase or decrease the intimacy according to the quality of the play result of the scenario. As an example, the game progress unit 115 increases the intimacy more as the user selects the option well and the content received in the scenario is better. On the contrary, the game progress unit 115 may reduce the intimacy when the user reaches the scenario at the bad end.

In the item "Familiarity", the fame level, which is one of the character statuses, is stored. The name recognition is a parameter indicating the popularity and recognition of the character as a video distributor. One of the purposes of this game is to support a character's video distribution activity, raise the name of the character, and realize the character's dream. As an example, a special scenario may be offered as a reward to a user who has achieved a certain level of name recognition.

The item "Distribution history" stores a list of videos, so-called back numbers, that have been live-distributed from characters in the past in the live distribution part. In the live distribution part, the video that is PUSH-distributed in real time can be viewed only at that time. On the other hand, the moving images of the past distribution are recorded by the server 200 or the operation instruction device 300, and can be PULL distributed in response to the request from the user terminal 100. In the present embodiment, as an example, the back number may be made available for download by the user for a fee.

<Screen example of story part>
FIG. 6 is a diagram showing an example of a quest presentation screen 400 displayed on the display unit 152 of the user terminal 100. In the story part, the game progress unit 115 presents a quest to the user according to the game program 131 while the scenario is in progress. Specifically, the game progress unit 115 causes the character to speak a request item corresponding to a quest to the hero in a dialogue between the hero and the character. At this time, for example, the game progress unit 115 may display the quest presentation screen 400 shown in FIG. 6 on the display unit 152.

The method of presenting a character that performs a series of actions of "making the character speak a request" is not particularly limited. For example, the game progress unit 115 may display a character that utters the request as a still image based on the text data corresponding to the request item stored in the storage unit 120 in advance. Specifically, the game progress unit 115 displays a quest presentation screen 400 including a character 401, a balloon 402 indicating that the character 401 is speaking, and text data of a request item arranged in the balloon 402. It is displayed on 152. Alternatively, the game progress unit 115 may display the animation of the character who utters the request item based on the operation instruction data corresponding to the scene in which the request item is uttered, which is stored in the storage unit 120 in advance. Specifically, the game progress unit 115 moves the character 401 according to the motion capture data included in the motion instruction data, and transfers the voice data included in the motion instruction data as voice from a speaker (not shown) included in the user terminal 100. Output.

In the present embodiment, as an example, the game progress unit 115 may realize the quest by a location information game using the location registration information of the user terminal 100. The game progress unit 115 acquires the current position information (for example, address information, latitude / longitude information, etc.) of the user terminal 100 from a position registration system (not shown) provided in the user terminal 100. Then, based on the acquired current position information, a map 403 around the place where the user terminal 100 is located is generated and arranged on the quest presentation screen 400. The map data that is the source of generating the map 403 is acquired from another service providing device (server) that provides the map data via the network. The map data may be stored in the storage unit 120 of the user terminal 100 in advance.

Subsequently, the game progress unit 115 determines a position (address, latitude / longitude, etc.) at which a thing that can solve the request (hereinafter, a target) can be acquired, and a target icon is placed at a position on the map corresponding to the determined position. 404 is superimposed and displayed. As a result, the user can understand that if he / she holds the user terminal 100 and moves to the position of the target icon 404 on the map 403, he / she can acquire the target object and clear the quest. The game progress unit 115 may randomly determine the position of the target object, or may determine the position of the target object in advance according to the contents of the scenario, the quest, and the target object.

When the user brings the user terminal 100 to an actual position corresponding to the position of the target icon 404, the game progress unit 115 determines that the main character has reached the target object, and causes the user to acquire the target object. The game progress unit 115 determines that the quest has been cleared.

In the present embodiment, the game progress unit 115 may generate a quest resolution screen 500 and display it on the display unit 152 when the quest is cleared. FIG. 7 is a diagram showing an example of a quest resolution screen 500 displayed on the display unit 152 of the user terminal 100. As an example, the quest resolution screen 500 includes a character 401. For example, the game progress unit 115 causes the character 401 to perform an operation of "thank the hero for the resolution of the request". The game progress unit 115 may cause the character 401 to perform this operation based on the operation instruction data stored in advance. Alternatively, the game progress unit 115 may reproduce the scene in which the character 401 is thanking by arranging the still image of the character 401 and the text data 501 corresponding to the content of the statement on the quest resolution screen 500.

In the present embodiment, the game progress unit 115 may release one new fixed scenario related to the client character 401 as a reward for clearing the quest, and transition to a state in which the user can play. Specifically, the game progress unit 115 reads the play history shown in FIG. 5 and updates the status of the predetermined fixed scenario from "playable" to "playable".

Further, the game progress unit 115 may increase the intimacy between the main character and the character based on the fact that the quest is cleared. The game progress unit 115 may be configured to increase intimacy as the play content of the quest (time required, distance traveled, number of acquisitions, degree of joy of the character, degree of rarity of the acquired target, etc.) is better. ..

When the user clears one or more quests or selects an option, the dialogue with the character progresses and the scenario progresses. When the scenario has one ending, the user has completed playing the scenario.

The game progress unit 115 may allow the user to acquire an item as a reward for playing the scenario by the user. The item is, for example, a clothing item to be worn by the character 401. The game progress unit 115 determines the items to be acquired by the user based on a predetermined rule. For example, the game progress unit 115 may give the user an item that is previously associated with the scenario played, or may provide the user with the play content of the scenario (time required to clear the quest, acquired intimacy, and good options. Items determined according to the selection, etc.) may be given. Alternatively, the item to be given to the user may be randomly determined from a plurality of candidates.

In the present embodiment, the game progress unit 115 may generate a reward screen 600 for notifying the user of the acquired item and display it on the display unit 152. FIG. 8 is a diagram showing an example of the reward screen 600 displayed on the display unit 152 of the user terminal 100. As an example, the reward screen 600 may include an icon 601 of the acquired item and a name 602 of the item. As a result, the user can confirm the items that he / she has acquired. In addition, the game progress unit 115 adds the above-mentioned acquired item to the item list stored in the item "item" shown in FIG.

<Screen example of live distribution part>
When the game progress unit 115 receives the operation instruction data from an external device such as the operation instruction device 300, the game progress unit 115 operates the character based on the operation instruction data in the live distribution part. For example, in the live distribution part, a moving image reproduction screen 800 including a character that operates based on the operation instruction data is generated and displayed on the display unit 152.

FIG. 9 is a diagram showing an example of a moving image reproduction screen 800 displayed on the display unit 152 of the user terminal 100. As an example, the moving image reproduction screen 800 includes at least a character (character 802 in the illustrated example) that was a dialogue partner in the story part.

In the present embodiment, the game progress unit 115 reflects the movement indicated by the motion capture data included in the movement instruction data supplied from the external device (hereinafter referred to as the movement instruction device 300) in the movement of the character 802. .. The motion capture data is obtained by acquiring the movement of the model 702 at the installation location of the motion instruction device 300 via the motion capture device 3020. Therefore, the movement of the model 702 is directly reflected in the movement of the character 802 displayed on the display unit 152.

In the present embodiment, the game progress unit 115 outputs the voice data 801 included in the movement instruction data supplied from the movement instruction device 300 as the voice emitted by the character 802 in synchronization with the movement of the character 802. .. The voice data is obtained by acquiring the voice 700 of the voice actor 701 through the microphone 3010 at the installation location of the operation instruction device 300. Therefore, the voice data 801 corresponding to the voice 700 emitted by the voice actor 701 is output as it is from the speaker of the user terminal 100.

According to the above configuration, the voices and movements of the existing voice actors 701 and model 702 at the installation location of the operation instruction device 300 are directly reflected in the voices and movements of the character 802. Looking at the character 802 that performs such an operation, the user can feel the reality of the character 802 as if it exists in the real world, and can immerse himself in the game world. ..

Further, in the present embodiment, the game progress unit 115 may determine the play result of the story part based on the input operation of the user in the story part (first part). Then, in the live distribution part (second part), the game progress unit 115 may display the character to be operated based on the operation instruction data on the display unit 152 in a display mode according to the play result.

As an example, if an item that can be worn by the above-mentioned character is acquired in the story part played so far, the game progress unit 115 synthesizes the object of the item into the object of the character 802. It is preferable to do so. According to the above configuration, the item acquired by the user playing the story part can be reflected in the clothing of the character 802 operating in the live distribution part. For example, as shown in FIG. 8, an item as a clothing item (for example, a Usamimi band) is acquired by playing a scenario in the story part. In this case, the game progress unit 115 reads out the information of the clothing item from the game information 132 shown in FIG. 5, and synthesizes the object of the item (in the illustrated example, the clothing item 803) into the character 802.

As a result, the user can feel attachment to the character 802 and enjoy the live distribution part even more. Further, the user's motivation to upgrade the clothing of the character 802 can be cultivated, and as a result, the motivation to play the story part can be strengthened.

Further, in the present embodiment, the game progress unit 115 may be able to input a comment addressed to the character 802 in response to the operation of the character 802. As an example, the game progress unit 115 arranges the comment input button 804 on the moving image playback screen 800. The user touches the comment input button 804 to call a UI for inputting a comment, operates the UI, and inputs a comment addressed to the character 802. The UI may be for the user to select a desired comment from a number of prepared comments. The UI may be for the user to edit characters and enter comments. The UI may be for the user to input a comment by voice.

<Processing flow>
FIG. 10 is a flowchart showing a flow of processing executed by each device constituting the game system 1.

In step S101, when the game progress unit 115 of the user terminal 100 receives an input operation for starting the game from the user, it accesses the server 200 and requests login.

In step S102, the progress support unit 211 of the server 200 confirms that the status of the user terminal 100 is online, and responds that the login has been accepted.

In step S103, the game progress unit 115 advances the game according to the input operation of the user while communicating with the server 200 as necessary. The game progress unit 115 may advance the story part or the acquisition part for acquiring a new scenario.

In step S104, the progress support unit 211 supports the progress of the game on the user terminal 100 by providing necessary information to the user terminal 100 as needed.

At the live distribution time in step S105, the sharing support unit 212 of the server 200 proceeds from YES in step S105 to step S106. The live distribution time is, for example, predetermined by the game master and managed by the server 200 and the operation instruction device 300. Further, the live distribution time may be notified to the user terminal 100 in advance, or may be kept secret until the actual live distribution time is reached. In the former case, live distribution can be stably supplied to the user, and in the latter case, live distribution with a special added value can be supplied to the user as a surprise distribution.

In step S106, the sharing support unit 212 searches for one or more user terminals 100 having the right to receive live distribution. The conditions for receiving live distribution may be set by the game master as appropriate, but at least the conditions include that the application of this game is installed and that the game is online at the time of live distribution. In the present embodiment, as an example, the user terminal 100 that is online at the time of live distribution, that is, that is running the application of this game is searched for as the user terminal 100 that has the right to receive live distribution. Alternatively, the sharing support unit 212 may further add to the condition that the user terminal 100 is owned by the user who has paid the consideration for receiving the live distribution. Alternatively, the sharing support unit 212 may search for a specific user terminal 100 that has made a reservation to receive live distribution in advance at the above-mentioned live distribution time as a user terminal 100 that has the right to receive live distribution. Good.

In step S107, the sharing support unit 212 notifies the operation instruction device 300 of one or more detected user terminals 100. For example, the sharing support unit 212 may notify the operation instruction device 300 of the terminal ID of the user terminal 100, the user ID of the user who is the owner of the user terminal 100, the address of the user terminal 100, and the like.

On the other hand, in step S108, the character control unit 316 of the operation instruction device 300 proceeds from YES in step S108 to steps S109 to S110 at the live distribution time. Which of steps S109 to S110 may be executed first.

In step S109, the character control unit 316 acquires the voice input by an actor such as a voice actor via the microphone 3010 as voice data.

In step S110, the character control unit 316 acquires the motion input by the actor such as the model via the motion capture device 3020 as motion capture data.

In step S111, the character control unit 316 generates operation instruction data (second operation instruction data). Specifically, the character control unit 316 identifies a character to be delivered a moving image at the above-mentioned live distribution start time, and stores the character ID of the character in the item of "character ID" of the operation instruction data. Which character's moving image is to be delivered at what time may be scheduled in advance by the game master and registered in the operation instruction device 300. Alternatively, the operator of the operation instruction device 300 may specify in advance to the operation instruction device 300 which character the operation instruction data should be created. The character control unit 316 stores the voice data acquired in step S109 in the “voice” item of the operation instruction data. The character control unit 316 stores the motion capture data acquired in step S110 in the “movement” item of the operation instruction data. The character control unit 316 associates the voice data with the motion capture data so that the voice data and the motion capture data are synchronized with each other. The character control unit 316 may use group identification information of a group of these user terminals 100 or one user terminal 100 so that one or more user terminals 100 notified by the server 200 in step S107 are the destinations. The address is stored in the "destination" item of the operation instruction data as the destination designation information.

In step S112, the character control unit 316 transmits the operation instruction data generated as described above to each user terminal 100 designated as a destination via the communication IF 33. The character control unit 316 acquires voice data and motion capture data obtained by the actor making a voice or moving, and immediately renders them into motion instruction data, and delivers them to each user terminal 100 in real time. Is desirable.

In step S113, the analysis unit 116 of the user terminal 100 receives the above-mentioned operation instruction data via the communication IF 13. For example, the analysis unit 116 may receive the operation instruction data at a time announced in advance from the operation instruction device 300 or the server 200 to be live-streamed.

In step S114, the analysis unit 116 analyzes the received operation instruction data by using the reception as a trigger.

In step S115, when the game progress unit 115 receives the above-mentioned operation instruction data, if the live distribution part is not executed, the game progress unit 115 starts the live distribution part. At this time, if another part is being executed, the game progress unit 115 interrupts the progress of the part and then starts the live distribution part. Here, the game progress unit 115 may output a message to the display unit 152 to suspend the part being executed because the live distribution has started, and save the progress of the part in the storage unit 120. desirable. If the live distribution part has already been executed when the above-mentioned operation instruction data is received, the game progress unit 115 may omit step S115. In this case, the game progress unit 115 may output a message to the display unit 152 that the distribution of the operation instruction data (that is, the moving image of the body to be live-streamed by the character) has started.

In step S116, the game progress unit 115 advances the live distribution part by operating the character based on the moving image instruction data analyzed by the analysis unit 116. Specifically, the game progress unit 115 causes the display unit 152 to display the moving image reproduction screen 800 and the like shown in FIG. The game progress unit 115 reproduces the voice and movement in real time at almost the same time as the actors such as the voice actor 701 and the model 702 are making a voice or moving at the place where the operation instruction device 300 is installed. It is reflected in the speech and movement of the character 802 on the screen 800. The analysis unit 116 and the game progress unit 115 continue rendering and reproducing the real-time moving image while continuously receiving the operation instruction data from the operation instruction device 300. Specifically, the game progress unit 115 does not accept any input operation from the user, and while the operation instruction data is received, returns from NO in step S117 to step S113, and repeats each subsequent step.

In step S117, when the operation receiving unit 111 receives an input operation from the user while the character is operating based on the operation instruction data, the game progressing unit 115 proceeds from YES in step S117 to step S118. For example, the operation reception unit 111 accepts an input operation for the comment input button 804 on the moving image playback screen 800.

In step S118, the game progress unit 115 transmits the comment data generated in response to the above-mentioned input operation to the operation instruction device 300. Specifically, the game progress unit 115 may transmit the comment ID of the selected comment as comment data. Alternatively, the game progress unit 115 may transmit the text data of the sentence input by the user as comment data. Alternatively, the game progress unit 115 may transmit the voice data of the voice input by the user as comment data. Alternatively, the game progress unit 115 may recognize the voice input by the user, convert it into text data, and transmit it as comment data.

In step S119, the reaction processing unit 317 of the operation instruction device 300 receives the comment data transmitted from the user terminal 100 via the communication IF 33.

In step S120, the reaction processing unit 317 outputs the received comment data to the operation instruction device 300. For example, the reaction processing unit 317 displays the text data included in the comment data on the display unit 352. This allows the operator to receive feedback indicating how the user responded to the character they moved. The operator can then determine further character behavior in response to this feedback. That is, the operation instruction device 300 returns to step S109, continues to acquire the voice data and the motion capture data, and continues to provide the operation instruction data to the user terminal 100. The user terminal 100 receives the operation instruction data transmitted from the operation instruction device 300 after the content of the input operation in the own terminal is received by the operation instruction device 300. Specifically, the user terminal 100 receives voice data corresponding to the content of the character's speech, motion command data including motion capture data corresponding to the movement of the character, and the like. Then, the user terminal 100 continuously operates the character based on the operation instruction data. As a result, the user can experience real-time interactive interaction with the character. Instead of the motion capture data, the user terminal 100 may receive a motion command group in which one or more commands instructing the operation of the character are arranged in the order instructed by the operator of the operation instruction device 300.

[Embodiment 2]
<Game overview>
The game executed by the game system 1 according to the second embodiment (hereinafter, this game) includes, for example, an element of a position information game in which characters are arranged all over the country and an element of a romance simulation game. Here, as a character, for example, a monster that is cursed and trapped, and an avatar that utters or moves in response to the utterance or movement of an actor are assumed.

The avatar is synonymous with the character in the first embodiment, and the control of the utterance and the action of the avatar is the same as the control of the utterance and the action of the character in the first embodiment. The character may be called an object.

When the game is started, the user terminal 100 identifies the current position information (for example, address information, latitude / longitude information, etc.) of the user terminal 100 by using the location registration system, and the user is based on the current position information. Generate a map around the place where the terminal 100 is located. When generating a map, the current position information is transmitted to the server 200 to request the transfer of map data around the current position. The server 200 acquires map data around the user terminal 100 from another service providing device (server) that provides map data via a network, and together with the position information of characters arranged around the user terminal 100. The character ID is acquired, and the position information and the character ID are transmitted to the user terminal 100 together with map data around the user terminal 100.

The user terminal 100 displays a map based on the map data on the touch screen 15, and displays an icon corresponding to the character superimposed on the map based on the received and character ID together with the map data. In FIG. 11A, a map within a predetermined range from the position where the user terminal 100 is located, an icon corresponding to the character arranged on the map, and an index indicating the position of the user terminal 100 are displayed. It is a figure for demonstrating an example. As the map, a map within a predetermined area is displayed centering on the current position where the user terminal 100 is located. The icon corresponding to the character is specified from the character ID and displayed at the position corresponding to the position information of the character. The index is displayed at the center position of the map.

FIG. 11A illustrates, for example, a case where the user terminal 100 is located in a specific park, a map 1001 on which a walking path in the park is drawn is displayed, and icons IC1 to IC3 are the maps 1001. The index US1 is superimposed and displayed on the center position of the map 1001 (display area of the touch screen 15). Here, since each of the icons IC1 and IC2 is an image imitating a monster, it indicates that the monster is arranged at the position of the icon. Further, since the icon IC3 is an image imitating a woman, it indicates that the avatar is arranged at the position of the icon.

When the user terminal 100 actually moves by a predetermined amount (for example, 5 m), the user terminal 100 transmits the current position information to the server 200 again, and the position information and character ID of the characters around the user terminal 100 and the user terminal 100 Get the map data around. A map based on the map data is displayed on the touch screen 15, and icons based on the character's position information and character ID are superimposed and displayed on the map. That is, the map and the icon on the touch screen 15 are scrolled as the user terminal 100 moves.

If the character is arranged within a predetermined range around the position of the user terminal 100 (for example, within a range of 3 m centered on the user terminal 100), the user terminal 100 highlights the icon corresponding to the character. .. That is, the icon corresponding to the character within the predetermined range is displayed in a different manner from the icon corresponding to the character outside the predetermined range, so that the icon corresponding to the character outside the predetermined range can be distinguished from the icon corresponding to the character outside the predetermined range. ..

FIG. 11B illustrates, for example, a case where the user terminal 100 approaches a distance within 3 m from the character corresponding to the icon IC1, and the icon IC1 is highlighted here.

When the highlighted icon among the icons on the map is tapped, the user terminal 100 requests the server 200 to transfer the panoramic image (predetermined image) at the position where the icon is displayed. .. The server 200 acquires a 360 ° panoramic image (omnidirectional photographic image) at the position where the user terminal 100 exists from another service providing device (server) that provides panoramic images taken at various places. The acquired panoramic image is transmitted to the user terminal 100. The panoramic image is not limited to a 360 ° omnidirectional photographic image, and may be a non-omnidirectional photographic image such as 180 °. Further, the image is not limited to a photographic image and may be a moving image.

Therefore, when the map 1001 is displayed and the user terminal 100 is in the vicinity of the position of the icon IC1 (the state shown in FIG. 11B) and the tap operation is performed on the icon IC1, the user A 360 ° panoramic image at the position of the terminal 100 is transferred from the server 200 to the user terminal 100.

When the user terminal 100 receives the panoramic image, the user terminal 100 generates the celestial sphere (spherical) virtual space CS1 shown in FIG. 12 in the storage unit 120, and the panorama acquired from the server 200 inside (inner peripheral surface) of the celestial sphere. Paste the image (360 ° image). As a result, virtual space data is generated. The avatar or monster moves against a 360 ° panoramic image. A virtual camera CM1 is arranged at the center of the virtual space CS1, and the field of view area of the virtual camera CM1 is initially set based on the output of the acceleration sensor of the controller 1020 at the start of the game.

Specifically, the field of view area of the virtual camera CM1 is set so that the panoramic image corresponding to the actual landscape in the orientation of the camera 17 included in the user terminal 100 is displayed on the touch screen 15. As a result, the field of view of the virtual camera CM1 is associated with the orientation of the display area of the touch screen 15. A part of the panoramic image corresponding to the field of view area of the virtual camera CM1 is displayed on the touch screen 15.

Further, regardless of the direction in which the display area of the touch screen 15 is directed, the panoramic image corresponding to the visual field area among the panoramic images pasted in the virtual space CS1 is displayed on the touch screen 15, and further, avatars and monsters are displayed. Since it can be visually recognized, it is possible to improve the immersive feeling of the game and improve the interest of the game.

When the posture or orientation of the user terminal 100 changes, the change is specified based on the output of the acceleration sensor. The panoramic image displayed on the visual field area of the virtual camera CM1 and thus on the touch screen 15 is updated based on the change. As a result, when the camera 17 included in the user terminal 100 is attached to the back surface side of the display area of the touch screen 15, the impression as if the image captured by the camera 17 is displayed in the display area of the touch screen 15. Can be embraced by the user.

If the character corresponding to the tapped icon is a monster, the user terminal 100 displays the aiming image (reference image) at the center position (predetermined position) of the display area of the touch screen 15, and then any of the virtual space CS1. Place the monster somewhere (somewhere). At this time, the virtual space data is defined by the panoramic image and the monster.

Initially, the monster is arranged in the virtual space CS1 at a position outside the field of view area of the virtual camera CM1, and is controlled to move toward the inside of the field of view area.

As a result, it is possible to provide fun such as searching for a monster by changing the posture and orientation of the user terminal 100, and to display the monster in the touch screen 15 without actively changing the posture and orientation of the user terminal 100. Can be done. 13 (A) and 13 (B) show a display example when the icon IC1 is tapped and the monster MST1 is moved into the field of view. In FIGS. 13A and 13B, the monster MST1 is superimposed and displayed on the panoramic image 1101, and the aiming image AM1 is displayed at the center position of the display area of the touch screen 15.

The opening condition for releasing the monster from the curse is established by displaying the monster image continuously in the aiming image AM1 for a predetermined time. At this time, the user terminal 100 requests the server 200 to release the monster. The server 200 makes it impossible for any user to acquire the position information and the character ID of the monster in response to the request. By displaying the monster image continuously in the aiming image AM1 for a predetermined time, the monster may be given as a character owned by the user.

If the character corresponding to the icon tapped on the touch screen 15 is an avatar, the user terminal 100 arranges the avatar near the center of the virtual space CS1. At this time, the virtual space data is defined by the panoramic image and the avatar. As a result, when the icon IC3 is tapped, an image as shown in FIG. 14A or FIG. 14B is displayed on the touch screen 15 according to the field of view area of the virtual camera CM1. According to FIG. 14A, the avatar AVT1 is superimposed on the panoramic image 1201. From this state, for example, when the field of view of the virtual camera CM1 is panned to the left, the field of view of the virtual space CS1 moves to the left, so that the image displayed on the touch screen 15 is generated in the virtual space CS1. The image is updated to the image on the left side of the image shown in FIG. 14 (A) (for example, FIG. 14 (B)).

The process of superimposing the avatar AVT1 on the panoramic image 1201 is substantially the same as the process of generating the moving image reproduction screen 800 including the character in the first embodiment (see FIG. 9).

When the character corresponding to the tapped icon is an avatar, the server 200 requests the operation instruction device 300 for live distribution. The operation instruction device 300 generates operation instruction data based on the voice and movement of the actor, and transmits the operation instruction data to the user terminal 100. The user terminal 100 analyzes the action instruction data to reflect the voice and movement of the actor in the speech and movement of the avatar.

The user can support the avatar by performing an operation corresponding to the throwing money when he / she sympathizes with the avatar's remarks and movements during live distribution. The user terminal 100 requests the server 200 to update the evaluation parameter when the operation corresponding to the thrown money is performed. The operation corresponding to the throwing money means, for example, an operation in which the user consumes an item obtained in game play during live distribution. In this case, on the side of the model 702 and the voice actor 701 that operate the avatar, it is possible to confirm on the monitor or the like which user performs the operation corresponding to the throwing money and consumes the item. Thereby, the interaction between the model 702 and the voice actor 701 that operate the avatar and the user can be realized. In addition to this, the operation corresponding to the throwing money may include an operation in which the user consumes the item obtained by the billing process and selects an icon displayed on the user terminal 100. In this case, each icon is an image imitating a bouquet or the like, and the consumption amount of items required to purchase each icon may be different. The icon selected by the user is displayed on the monitor of the device on the side of the model 702 and the voice actor 701 that operate the avatar. The evaluation parameters are updated while such an effect is performed. The server 200 manages the evaluation parameters associated with the avatar being delivered live, updates the evaluation parameters in response to a request from the user terminal 100, and transfers the updated evaluation parameters to the operation instruction device 300. Send.

The operation instruction device 300 displays a numerical value corresponding to the evaluation parameter transmitted from the server 200 on the display unit 352 via the communication IF 33. The operator of the operation instruction device 300 can receive feedback indicating how the user has reacted to the avatar that he / she has moved.

When a comment is input from the user during the live distribution, the user terminal 100 transmits the comment data corresponding to the comment to the operation instruction device 300. The operation instruction device 300 displays a comment corresponding to the comment data transmitted from the user terminal 100 on the display unit 352. This allows operators to receive feedback on how the user responded to the avatars they moved.

<Processing flow>
15 and 16 are flowcharts showing the flow of processing executed by each device constituting the game system 1, and FIG. 17 is a flow of display control processing executed by the user terminal 100 in parallel with the processing of the flowchart. It is a flowchart which shows.

In step S201 shown in FIG. 15, when the game progress unit 115 of the user terminal 100 receives an input operation for starting the position information game from the user, the game progress unit 115 acquires the current position of the user terminal 100 from the position registration system and the user. The server 200 is requested to transfer the map data that is the basis for generating the map of the surrounding area centered on the position of the terminal 100. The request includes the address of the user terminal 100 and location information that can identify the current position.

In step S213, the progress support unit 211 of the server 200 acquires the map data that is the source of generating the map from another service providing device (server) via the network based on the location information. When the map data is stored in the storage unit 220, the progress support unit 211 may acquire the map data from the storage unit 220.

A plurality of types of characters are arranged in advance in various parts of the country, and the storage unit 220 stores position information capable of specifying the position of each of the plurality of types of characters and the character ID of the character. In step S214, the progress support unit 211 acquires the position information capable of specifying the position of the character arranged around the user terminal 100 and the character ID of the character, and obtains the position information and the character ID on the map. It is transmitted to the requesting user terminal 100 together with the data. The characters arranged around the user terminal 100 are characters that can be displayed on the touch screen 15 because they are arranged in the map of a predetermined area that can be displayed on the touch screen 15 of the user terminal 100.

In step S202, the display control unit 112 displays a schematicized map based on the map data on the touch screen 15, and displays an icon on the map based on the position information and the character ID transmitted together with the map data. Deploy. Specifically, the display control unit 112 generates an icon on which a character image corresponding to the character ID is drawn, and displays the icon at a position corresponding to the position information. Further, the map displayed on the touch screen 15 represents a predetermined area centered on the position of the user terminal 100, and an index indicating the position of the user terminal 100 is superimposed on the center of the map. As a result, for example, the map 1001 shown in FIG. 11A is displayed on the touch screen 15, and the icons IC1 to IC3 and the index US1 are superimposed on the map 1001.

In step S203, the game progress unit 115 receives in step S202 whether or not the character is arranged within a predetermined range around the position of the user terminal 100 (for example, within a range of 3 m centered on the user terminal 100). Judgment is made based on the position information. If it is not determined that the character is arranged within the predetermined range, the process proceeds to step S206, and it is determined based on the location registration system whether or not the user terminal 100 has moved by a predetermined amount. If it is not determined that the user terminal 100 has moved a predetermined amount, the process returns to step S203, and if it is determined that the user terminal 100 has moved a predetermined amount, the process returns to step S201. As a result, the map and icons on the touch screen 15 are scrolled as the user terminal 100 moves.

When it is determined in step S203 that the character is arranged within a predetermined range around the position of the user terminal 100, the process proceeds to step S204, and the icon corresponding to the character is highlighted. Therefore, when the user terminal 100 approaches a distance within 3 m from the character corresponding to the icon IC 1, the map 1001 and the icon IC 1 are displayed as shown in FIG. 11 (B).

In step S205, the game progress unit 115 determines whether or not the tap operation on the icon highlighted in step S204 has been performed based on the input operation on the touch screen 15. If it is not determined that the tap operation has been performed, the process proceeds to step S206, and if it is determined that the tap operation has been performed, the process proceeds to step S207.

In step S207, the game progress unit 115 requests the server 200 to transfer the panoramic image. The request includes the address and location information of the user terminal 100. In step S215, the progress support unit 211 acquires a 360 ° panoramic image from another service providing device (server) via the network based on the position information. When the panoramic image is stored in the storage unit 220, the progress support unit 211 may acquire the panoramic image from the storage unit 220.

In step S216, the progress support unit 211 transmits the panoramic image to the requesting user terminal 100. In step S208, the display control unit 112 attaches the panoramic image to the inner peripheral surface of the celestial sphere representing the virtual space CS1 (see FIG. 12). That is, in step S208, a spherical virtual space CS1 is generated in the storage unit 120, and a 360-degree image is attached to the inside of the sphere. As a result, virtual space data is generated.

In step S209, the game progress unit 115 determines whether or not the character corresponding to the tapped icon is a monster based on the character ID corresponding to the icon, and determines that the character is a monster. When, the process proceeds to step S210. In step S210, the game progress unit 115 generates a character corresponding to the tapped icon, that is, a monster based on the character ID, and generates the monster in the field of view area of the virtual camera CM1 inside the celestial sphere representing the virtual space CS1. Place it on the outside of.

The display control process shown in FIG. 17 is executed in parallel with the processes shown in FIGS. 15 and 16, and the field of view area of the virtual camera CM1 is initially set in step S301 of FIG. 17 and updated by the process of step S307. Will be done. In step S210, the monster is placed at a position outside the field of view defined in this way.

The initial position of the monster may be randomly determined from a position outside the visual field of the virtual camera CM1, as long as it is determined according to the visual field of the virtual camera CM1. It may be a predetermined position outside the field of view (eg, a central position within the area opposite to the field of view).

The initial position of the monster may be a position in the field of view of the virtual camera CM1 as long as it is not in the aiming image. Further, the initial position of the monster may be arranged at a predetermined position in the virtual space CS1 regardless of the field of view area of the virtual camera CM1. The predetermined position includes, for example, a plurality of positions in the virtual space CS1 (for example, a position corresponding to true north as a direction, a position corresponding to true south, a position corresponding to true east, a position corresponding to true west, etc.). , It may be a position randomly determined from a plurality of positions regardless of the field of view.

In step S211 the game progressing unit 115 determines whether or not the opening condition is satisfied for the monster based on various game parameters. The opening condition is satisfied when the time when the aiming image is aligned with the monster continues for a predetermined time. The predetermined time for establishing the opening condition may be a fixed time regardless of the type of the monster, or may be set to be different depending on the type of the monster (rare degree, etc.). If it is not determined that the opening condition is satisfied, the process returns to step S211. If it is determined that the opening condition is satisfied, the process proceeds to step S212.

In step S212, the game progress unit 115 requests the server 200 to release the monster. The request includes a character ID corresponding to the monster and position information of the monster.

In step S217, the progress support unit 211 determines whether or not the character arranged within the predetermined range around the position of the user terminal 100 is a monster, the position information of the user terminal 100 received in step S213, and step S214. Judgment is made based on the character position information and the character ID acquired in. When it is determined that the character at the position where the user terminal 100 exists is a monster, the process proceeds to step S218.

In step S218, the progress support unit 211 releases the character, that is, the monster, which is the determination target in step S217, in response to the request received from the game progress unit 115. As a result, the position information and the character ID of the monster cannot be acquired in the subsequent steps S214.

In step S209, if the character corresponding to the tapped icon is not determined to be a monster (that is, when the character is determined to be an avatar), the process proceeds to step S219. In step S219, the game progress unit 115 generates the avatar based on the character ID received from the server 200, and arranges the avatar at a predetermined position (for example, near the center) of the celestial sphere representing the virtual space CS1. When the process of step S219 is completed, the process proceeds to step S220.

On the other hand, the character control unit 316 of the operation instruction device 300 determines in step S229 whether or not the live distribution time has come, and proceeds to step S230 when the live distribution time comes. In step S230, the character control unit 316 acquires the voice input by an actor such as a voice actor via the microphone 3010 as voice data. In step S231, the character control unit 316 acquires the motion input by the actor such as the model via the motion capture device 3020 as motion capture data.

In step S217 shown in FIG. 15, when the character at the position where the user terminal 100 exists is not determined to be a monster (that is, when the character is determined to be an avatar), the progress support unit 211 is shown in FIG. The process proceeds to step S227 of step 16, and the operation instruction device 300 is requested to perform live distribution. The request includes the character ID acquired in step S214 and the address of the user terminal 100 received in step S215.

In step S232, the character control unit 316 generates operation instruction data. Specifically, the character control unit 316 stores the character ID included in the request received from the server 200 in the item of "character ID" of the operation instruction data. The character control unit 316 stores the voice data acquired in step S230 in the “voice” item of the operation instruction data. The character control unit 316 stores the motion capture data acquired in step S231 in the “movement” item of the operation instruction data. The character control unit 316 associates the voice data with the motion capture data so that the voice data and the motion capture data are synchronized with each other. The character control unit 316 stores the address of the user terminal 100 included in the request received from the server 200 as the destination designation information in the "destination" item of the operation instruction data.

In step S233, the character control unit 316 transmits the operation instruction data generated as described above to the user terminal 100 designated as the destination via the communication IF 33. The character control unit 316 acquires voice data and motion capture data obtained by the actor making a voice or moving, and immediately renders them into motion instruction data, and delivers them to each user terminal 100 in real time. Is desirable.

In step S220, the analysis unit 116 of the user terminal 100 receives the above-mentioned operation instruction data via the communication IF 13. For example, the analysis unit 116 may receive the operation instruction data at a time announced in advance from the operation instruction device 300 or the server 200 to be live-streamed. In step S221, the analysis unit 116 analyzes the received operation instruction data by using the reception as a trigger.

In step S222, when the game progress unit 115 receives the above-mentioned operation instruction data, if the live distribution part is not executed, the game progress unit 115 starts the live distribution part. In step S222, the game progress unit 115 advances the live distribution part by operating the avatar based on the moving image instruction data analyzed by the analysis unit 116. The game progress unit 115 transmits the voice and movement in real time in a virtual space almost at the same time as the actors such as the voice actor 701 and the model 702 are making a voice or moving at the installation location of the operation instruction device 300. It is reflected in the speech and movement of the avatar placed in CS1. The analysis unit 116 and the game progress unit 115 continue rendering and reproducing the real-time moving image while continuously receiving the operation instruction data from the operation instruction device 300.

The user can support the avatar by performing an operation corresponding to the throwing money when he / she sympathizes with the avatar's remarks and movements. In step S223, the game progress unit 115 determines whether or not the operation corresponding to the thrown money has been performed based on the input operation on the touch screen 15.

When it is determined that the operation corresponding to the thrown money has been performed, the game progress unit 115 requests the server 200 to update the evaluation parameter in step S224. The request includes a character ID corresponding to the avatar being live-streamed. In step S228, the progress support unit 211 updates the evaluation parameter associated with the character ID, and transmits the updated evaluation parameter to the operation instruction device 300.

In step S234, the reaction processing unit 317 of the operation instruction device 300 receives the evaluation parameter transmitted from the server 200 via the communication IF 33. In step S235, the reaction processing unit 317 outputs the received evaluation parameter. For example, the reaction processing unit 317 displays a numerical value corresponding to the evaluation parameter on the display unit 352. As a result, the operator of the operation instruction device 300 can receive feedback indicating how the user has reacted to the avatar that he / she has moved.

When it is not determined in step S223 that the operation corresponding to the throwing money has been performed, or when the process of step S224 is completed, the game progress unit 115 proceeds to step S225. In step S225, the game progress unit 115 determines whether or not a comment has been input by the user while the avatar is operating based on the operation instruction data, based on the input operation on the touch screen 15. If it is not determined that the comment has been input, the process returns to step S220, and if it is determined that the comment has been input, the process proceeds to step S226. In step S226, the game progress unit 115 transmits the comment data corresponding to the input comment to the operation instruction device 300.

Specifically, the game progress unit 115 may transmit the comment ID of the selected comment as comment data. Alternatively, the game progress unit 115 may transmit the text data of the sentence input by the user as comment data. Alternatively, the game progress unit 115 may transmit the voice data of the voice input by the user as comment data. Alternatively, the game progress unit 115 may recognize the voice input by the user, convert it into text data, and transmit it as comment data.

In step S234, the reaction processing unit 317 of the operation instruction device 300 receives the comment data transmitted from the user terminal 100 via the communication IF 33. In step S235, the reaction processing unit 317 outputs the received comment data. For example, the reaction processing unit 317 displays the text data included in the comment data on the display unit 352. This allows operators to receive feedback on how the user responded to the avatars they moved.

The operation instruction device 300 returns to step S230, continues to acquire voice data and motion capture data, and continues to provide the operation instruction data to the user terminal 100. The user terminal 100 receives the operation instruction data transmitted from the operation instruction device 300 after the content of the input operation in the own terminal is received by the operation instruction device 300.

Specifically, the user terminal 100 receives voice data corresponding to the content of the character's speech, motion command data including motion capture data corresponding to the movement of the character, and the like. Then, the user terminal 100 continuously operates the character based on the operation instruction data. As a result, the user can experience real-time interactive interaction with the character.

Instead of the motion capture data, the user terminal 100 may receive a motion command group in which one or more commands instructing the operation of the character are arranged in the order instructed by the operator of the operation instruction device 300.

FIG. 17 is a flowchart showing a flow of display control processing executed by the user terminal 100 after the monster or avatar is arranged inside the virtual space CS1 in step S208 or S209.

In step S301, the display control unit 112 arranges the virtual camera CM1 at the center of the virtual space CS1 and initially sets the field of view area of the virtual camera CM1 based on the output of the acceleration sensor of the controller 1020. Specifically, the direction (direction) of the camera 17 included in the user terminal 100 is specified based on the output of the acceleration sensor, and the panoramic image corresponding to the actual scenery in the direction is displayed on the touch screen 15. The field of view area of the virtual camera CM1 is set. The field of view of the virtual camera CM1 is thus associated with the orientation of the camera 17, i.e. the orientation of the display area of the touch screen 15.

In step S302, the display control unit 112 displays an image of the field of view region on the touch screen 15. When the character arranged in the virtual space CS1 is a monster and the monster is located outside the field of view, only the panoramic image is displayed on the touch screen 15. If the monster is located inside the field of view, the monster is superimposed on the panoramic image. On the other hand, if the character arranged in the virtual space CS1 is an avatar, the avatar is superimposed on the panoramic image according to the setting of the field of view area of the virtual camera CM1.

In step S303, the display control unit 112 determines whether or not the character arranged in the virtual space CS1 is a monster based on the processing result of step S208 or S209. When the character is determined to be a monster, the process proceeds to step S304, and when the character is not determined to be a monster (that is, when the character is determined to be an avatar), step S306 is performed. Proceed to.

In step S304, the display control unit 112 superimposes the aiming image on the image of the field of view region displayed on the touch screen 15. In step S305, the character control unit 316 moves the monster arranged in the virtual space CS1 by a predetermined distance in the direction of the field of view region of the virtual camera CM1. Specifically, in step S305, it is determined whether or not the monster is placed in the field of view, and if the monster is not in the field of view, the monster is placed in the field of view. Update virtual space data to move.

In step S305, the character control unit 316 may move the monster arranged in the virtual space CS1 by a predetermined distance in the direction of the aiming image in the field of view area of the virtual camera CM1. When the process of step S305 is completed, the process proceeds to step S306.

In step S306, the display control unit 112 determines whether or not the update cycle set to, for example, 1/30 second has arrived, based on a measurement unit (not shown). If it is not determined that the update cycle has arrived, the process returns to step S306, and if it is determined that the update cycle has arrived, the process proceeds to step S307. In step S307, the display control unit 112 identifies a change in the posture or orientation of the user terminal 100 based on the output of the acceleration sensor, and updates the field of view area of the virtual camera CM1 according to the change. When the process of step S307 is completed, the process returns to step S302. As a result, the updated image of the field of view is displayed on the touch screen 15. As a result, the image displayed on the touch screen 15 is updated to an image corresponding to the visual field area according to the posture and orientation of the user terminal 100.

As a result, when it is determined that the character arranged in the virtual space CS1 is a monster, the panoramic image 1101 and the aiming image AM1 are displayed, and the posture and orientation of the user terminal 100 from the state where the monster MST1 is not displayed. The monster MST1 will be displayed according to changes in and the passage of time. On the other hand, when it is determined that the character arranged in the virtual space CS1 is an avatar, for example, the panoramic image 1201 shown in FIG. 14A is displayed on the touch screen 15, and the avatar AVT1 is superimposed on the panoramic image 1201. Will be done.

<Effect of this embodiment>
According to the present embodiment, virtual space data for making it possible to identify a virtual space associated with a panoramic image at a position where the user terminal 100 exists is generated. When it is determined that the character placed in the virtual space is a monster, the monster is placed in the virtual space. A virtual camera is also arranged in the virtual space. The field of view from the virtual camera is controlled according to the user's operation on the user terminal 100, and the image corresponding to the field of view is displayed on the touch screen 15. If the monster is not placed in the field of view, the virtual space data is updated to move in the direction in which the monster is placed in the field of view.

This makes it possible to reduce the need to significantly change the orientation of the user terminal 100 in a game in which the monster is continuously displayed on the touch screen 15. As a result, it is possible to reduce the concern that the person around the user may be inconvenienced or that the user may be suspicious. That is, the user can concentrate on the game without being suspicious of a third party around him.

Further, according to the present embodiment, when the monster is displayed on the touch screen 15 and the opening condition is satisfied, the user terminal 100 requests the server 200 to release the monster from the server 200. As a result, the monster is released by the server 200. This allows the user to enjoy the game of finding and releasing monsters.

Further, according to the present embodiment, the aiming image is displayed at a predetermined position on the touch screen 15 by superimposing it on the image corresponding to the field of view area of the virtual camera. The opening condition is established by displaying the monster at the predetermined position. This makes it possible to improve the interest of the game.

Further, according to the present embodiment, when the virtual space data is generated, the monster is arranged in an area other than the visual field area, or the monster is arranged at a predetermined position in the virtual space regardless of the visual field area.

When the monster is placed in an area other than the field of view area, the user can have a sense of expectation until the monster appears in the field of view area. On the other hand, when the monster is placed at a predetermined position in the virtual space regardless of the visual field area, the monster may or may not appear in the visual field area depending on the orientation of the user terminal 100. This makes it possible to make the appearance of monsters surprising.

Further, according to the present embodiment, the panoramic image at the position where the user terminal 100 exists is acquired by communicating with another service providing device (server) that provides the panoramic image taken at various places.

As a result, the monster is superimposed on the panoramic image acquired from another service providing device, not the image taken by the camera 17 included in the user terminal 100. Thereby, the processing load of the user terminal 100 can be reduced. Further, since the game can be advanced without taking a picture of a landscape or the like with the camera 17, it is possible to reduce the concern that voyeurism or privacy infringement may be suspected.

<Modification example>
Examples of modifications of the embodiments described above are listed below.

(1) In the above embodiment 2 (hereinafter, also simply referred to as an embodiment), when it is determined that the character arranged in the virtual space is a monster, the character is continuously aimed at a predetermined position on the touch screen 15. The image is displayed. However, the aiming image may not be displayed when the monster is not placed in the field of view of the virtual camera, and the aiming image may be displayed when the monster is placed in the field of view. As a result, the user can be motivated to display the monster in a predetermined position while improving the visibility of the panoramic image.

Also, instead of the aiming image, a timer that starts when a monster is captured and is reset when the monster is missed may be displayed. In this case, the user can grasp the remaining time until the opening condition is satisfied by the timer.

Further, when the monster is arranged in the field of view, the specific notification (for example, voice guidance, sound effect, etc.) may be performed. As a result, it is possible to reduce the concern that the user will be fascinated by the touch screen 15 and cause trouble to the surroundings such as colliding with another person when the monster is not arranged in the field of view.

(2) In the above embodiment, the panoramic image at the position where the user terminal 100 exists is acquired from another service providing device (server). However, the image taken by the camera 17 provided on the user terminal 100 may be associated with the virtual space as the panoramic image (specifically, it may be pasted inside the celestial sphere). In this case, the sticking position of the camera image is defined based on the orientation of the user terminal 100. The camera image is displayed in the display area of the touch screen 15, and the aiming image is superimposed on the center position of the display area. If the monster is not placed in the display area, the monster moves in the direction in which it is placed in the display area. This makes it possible to give reality to the panoramic image.

(3) In the above embodiment, the panoramic image associated with the virtual space is limited to the image acquired from another service providing device (server). However, the panoramic image associated with the virtual space may be switched between the image acquired from another service providing device (server) and the camera image according to the user operation. That is, when there are no people around and there is no possibility of causing trouble to the surroundings such as colliding with another person, the panoramic image associated with the virtual space is switched to the camera image by the user switching operation. May be good.

(4) In the above embodiment, a predetermined position in the virtual space CS1 is specified as an initial position of the monster regardless of the position outside the field of view area of the virtual camera CM1 or the field of view area. At this time, the initial position may be specified according to the type of monster. That is, for a certain type of monster, a position outside the field of view area of the virtual camera CM1 is specified as an initial position, and for other types of monsters, a predetermined position in the virtual space CS1 is set as the initial position regardless of the field of view area. It may be specified as.

(5) In the above embodiment, an example in which the user terminal 100 requests the server 200 for a panoramic image according to the position of the user terminal 100 among the panoramic images captured and managed in advance has been described. However, the administrator (server 200) may request the user for a panoramic image at a specific position, and the panoramic image taken in response to the request may be registered and managed in, for example, the server 200. Further, the panoramic image at a specific position may be managed by the server 200 instead of another service providing device. Further, in this case, by registering the panoramic image, the user may be given a privilege (for example, a coin that can be used in the game, a special item, a predetermined parameter increase, etc.). Specific locations include, for example, a location where panoramic images before a predetermined period (for example, three years ago) are managed, a location where panoramic images are not yet managed, a location on the roof of a building, and a location within a specific facility. It may be a position or the like. As a result, the user can be motivated to take a panoramic image at a specific position, and the interest of the game can be improved. In addition, the administrator can have a panoramic image at a specific position at the present time.

(6) In the above embodiment, when there are a plurality of panoramic images taken at the position where the user terminal 100 exists in another service providing device, it is assumed that the latest panoramic image is transmitted to the user terminal 100. ing. However, if there are multiple panoramic images at the same position in the other service providing device, for example, the user's settings (current mode and retro mode, etc.) and the progress of the game (when an event that goes back to the past occurs, etc.) Depending on the situation, a panoramic image taken several years ago or several decades ago, which is different from the latest one, may be transmitted. As a result, it is possible to increase the variation of the panoramic image to be displayed.

In addition, when there are multiple panoramic images at the same position, for example, according to the actual situation (season, date, time zone, etc.) at the time when the panoramic image is requested, the actual situation should be matched as much as possible. You may want to send different panoramic images. Specifically, when the present is winter, a panoramic image taken in winter may be transmitted, and when the present is August, it may be taken in August or near August. The captured panoramic image may be transmitted. Further, when the current time zone is daytime, the panoramic image taken in the daytime may be transmitted, and when the current time zone is nighttime, the panoramic image taken at night may be transmitted. As a result, a panoramic image according to the current situation is displayed, so that the reality can be enhanced.

(7) In the above embodiment, an example has been described in which the acquired panoramic image is used as it is, and a character image or the like is superimposed on the panoramic image and displayed on the touch screen 15. However, the panoramic image may be subjected to predetermined processing / editing processing, and a character image or the like may be superimposed on the panoramic image to which the processing / editing processing has been performed and displayed on the touch screen 15. In the predetermined processing / editing process, for example, gradation, sharpness, color correction, special effects, etc. may be performed according to the current situation (for example, time, date, time, etc.). The image to be superimposed on the panoramic image is not limited to the character image, but instead of or in addition to the character image, for example, a decoration image (Christmas tree, Kadomatsu, etc.) depending on the current situation (for example, time, date, time, etc.). , Floating ring, watermelon, etc.).

(8) In the above embodiment, it is assumed that the characters are an avatar and a monster, and when the user visits the place where the character is arranged, the character can be displayed on the touch screen 15. Of these, the part that displays the avatar is regarded as the live distribution part, so the avatar is made to say a request equivalent to the quest "release the monster from the curse", and the user searches for the monster and curses according to the request. By tailoring the story of releasing the monster, the part that displays the monster can be regarded as one of the elements that make up the story part.

(9) In the above embodiment, the map data provided by the other service providing device is acquired by the server 200 and provided to the user terminal 100. However, the user terminal 100 may acquire the map data directly from the other service providing device, while the character position information and the character ID may be acquired from the server 200 and compositely displayed on the user terminal 100 side. Good.

(10) In the above embodiment, the map data is managed by another service providing device, but the server 200 may manage the map data.

(11) In the above embodiment, a 360 ° panoramic image is attached to the inner peripheral surface of the all-sky spherical virtual space CS1. However, as long as it is possible to display an image over a predetermined range, for example, the virtual space CS1 may be a hemispherical shape. Further, the panoramic image may be a strip-shaped 360-degree panoramic image that does not have an image corresponding to the ceiling portion, or may be a panoramic image extending 180 degrees to the left and right.

(12) In the above embodiment, a panoramic image corresponding to an actual landscape in the direction of the camera 17 included in the user terminal 100 is displayed on the touch screen 15. However, regardless of the orientation of the camera 17, a panoramic image corresponding to an actual landscape in a specific orientation (for example, northward) may be uniformly displayed on the touch screen 15.

(13) In the above embodiment, the panoramic image is acquired based on the position information of the user terminal 100, but the panoramic image includes an image representing the landscape viewed from the position of the touched icon and the like. An image showing the landscape viewed from the position of the user terminal 100, or a landscape viewed from the touch position on the map (assuming that the map is enlarged and the icon size and the finger size are approximately the same). An image showing the above is assumed.

(14) In the above embodiment, the character is arranged inside the celestial sphere, but the character image may be attached to the inner peripheral surface of the celestial sphere.

(15) In the above embodiment, an index indicating the position of the user terminal 100 is fixedly displayed at the center of the map on the touch screen 15, and the map is updated every time the user terminal 100 moves by a predetermined amount. ing. However, the map may be fixed and the index may be moved according to the movement of the user terminal 100. In this case, the map on the touch screen 15 is updated to a map in the moving direction of the index by performing a swipe operation or by identifying that the index has approached the end of the map.

(16) In the above embodiment, the map of the predetermined area centered on the position of the user terminal 100 is displayed on the touch screen 15, and the map data is displayed from the server 200 every time the user terminal 100 moves by a predetermined amount. I am trying to get. However, if map data of an area wider than the predetermined area (for example, 9 times the area) is acquired and the position of the predetermined area is moved every time the user terminal 100 moves by a predetermined amount, the map can be moved from the server 200. It is possible to reduce the frequency of acquiring data.

(17) In the above embodiment, the icon is exemplified as the first object, and the character and the avatar are exemplified as the example of the second object. However, both the first object and the second object are two-dimensional images. It may be a three-dimensional image (for example, a 3D model) or the like.

(18) In the above embodiment, an example of controlling the field of view area according to the posture and orientation of the user terminal has been described, but the present invention is not limited to this, and the field of view area is controlled according to the operation of the touch screen 15 by the user. May be good. For example, when a swipe operation is received on the touch screen 15, it may be controlled to move the visual field area in the direction in which the swipe operation is performed by an amount corresponding to the movement amount of the swipe operation, or the touch. When the flick operation is received on the screen 15, the field of view may be controlled to move in the direction in which the flick operation is performed by an amount corresponding to the speed of the flick operation.

<Additional notes>
The matters described in each of the above embodiments will be added below.

(Appendix 1):
According to an aspect of one embodiment shown in the present disclosure, the game program is a game program executed in an information terminal device (user terminal 100 in FIG. 1) including a processor, a memory, an input unit, and a display unit. First step (S207, S208, S210, S207, S208, S210,) generates virtual space data for enabling the processor to identify a virtual space associated with a predetermined image, and arranges an object (monster) in the virtual space. S305), a second step (S301) of arranging the virtual camera in the virtual space, and a third step (S307) of controlling the view area from the virtual camera according to the user's operation on the information terminal device. The fourth step (S302, S304) of displaying the image corresponding to the view area on the display unit is executed, and the first step is the case where the object is not arranged in the view area. The virtual space data is updated so as to move the object in the direction of being arranged in the view area (S305).

(Appendix 2):
In (Appendix 1), the game program causes the processor to display the object on the display unit and satisfies a predetermined condition (establishes an opening condition), thereby performing game processing according to the object. The fifth step (S211 and S212) for performing the above is executed.

(Appendix 3):
In (Appendix 2), the fourth step superimposes the image on the image and displays a reference image at a predetermined position of the display unit (S304), and the predetermined condition displays the object at the predetermined position. It is established by letting it.

(Appendix 4):
In (Appendix 3), the fourth step does not display the reference image when the object is not arranged in the field of view, and the reference is when the object is arranged in the field of view. Display the image.

(Appendix 5):
In any of (Appendix 1) to (Appendix 4), the information terminal device includes an image pickup unit (17), and a predetermined image is an image output from the image pickup unit.

(Appendix 6):
In any of (Appendix 1) to (Appendix 5), in the first step, when the virtual space data is generated, the object is arranged in an area other than the field of view area.

(Appendix 7):
In any of (Appendix 1) to (Appendix 6), when the first step generates the virtual space data, the object is placed at a predetermined position in the virtual space regardless of the field of view. Deploy.

(Appendix 8):
In any of (Appendix 1) to (Appendix 7), the first step performs specific notification when the object is arranged in the field of view region.

(Appendix 9):
In any of (Appendix 1) to (Appendix 8), the first step communicates with a server that manages landscape images of various places to acquire a landscape image corresponding to a predetermined position as the predetermined image (S207). ).

(Appendix 10):
According to an aspect of one embodiment shown in the present disclosure, the game method is a game method executed by an information terminal device (user terminal 100 in FIG. 1) including a processor, a memory, an input unit, and a display unit. Is the first step (S207, S208, S210, S207, S208, S210, in which the computer generates virtual space data for identifying a virtual space associated with a predetermined image, and arranges an object (monster) in the virtual space. S305), a second step (S301) of arranging the virtual camera in the virtual space, and a third step (S307) of controlling the view area from the virtual camera according to the user's operation on the information terminal device. A fourth step (S302, S304) for displaying an image corresponding to the view area on the display unit is provided, and the first step is the object when the object is not arranged in the view area. Is updated in the virtual space data so as to move in the direction of being arranged in the view area (S305).

(Appendix 11):
According to an aspect of one embodiment shown in the present disclosure, the information processing device (user terminal 100 in FIG. 1) executes a storage unit (120 in FIG. 2) for storing a game program and the game program. As a result, a control unit (110 in FIG. 2) that controls the operation of the information processing device is provided, and the control unit generates virtual space data for making it possible to identify a virtual space associated with a predetermined image. A first step (S207, S208, S210, S305) for arranging an object (monster) in the virtual space, a second step (S301) for arranging a virtual camera in the virtual space, and the above for the information terminal device. The third step (S307) of controlling the view area from the virtual camera according to the operation of the user and the fourth step (S302, S304) of displaying the image corresponding to the view area on the display unit are executed. In the first step, when the object is not arranged in the view area, the virtual space data is updated so as to move the object in the direction of being arranged in the view area (S305).

[Example of realization by software]
Control of the control block of the control unit 110 (particularly, the operation reception unit 111, the display control unit 112, the UI control unit 113, the animation generation unit 114, the game progress unit 115, the analysis unit 116 and the progress information generation unit 117), and the control unit 210. Blocks (particularly progress support unit 211 and shared support unit 212) and control blocks of control unit 310 (particularly, operation reception unit 311, display control unit 312, UI control unit 313, animation generation unit 314, progress simulation unit 315). , Character control unit 316 and reaction processing unit 317) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or by software using a CPU (Central Processing Unit). You may.

In the latter case, the control unit 110, the control unit 210 or the control unit 310, or an information processing device including a plurality of these, is a CPU that executes instructions of a program that is software that realizes each function, the above program, and various types. It is equipped with a ROM (Read Only Memory) or storage device (these are referred to as "recording media") in which data is readable by a computer (or CPU), a RAM (Random Access Memory) for expanding the above program, and the like. .. Then, the object of the present invention is achieved by the computer (or CPU) reading the program from the recording medium and executing the program. As the recording medium, a "non-temporary tangible medium", for example, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, the program may be supplied to the computer via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. It should be noted that one aspect of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present invention.

1 game system, 2 networks, 10, 20, 30 processors,
11,21,31 Memory, 12,22,32 Storage, 13,23,33 Communication IF (operation unit), 14,24,34 Input / output IF (operation unit), 15,35 Touch screen (display unit, operation unit) ), 17 camera (operation unit), 18 distance measuring sensor (operation unit), 100 user terminal (computer, information processing device), 110, 113, 210, 310 control unit, 111, 311 operation reception unit, 112, 312 display Control unit, 113,313 UI control unit, 114,314 Animation generation unit, 115 game progress unit, 116 analysis unit, 117 progress information generation unit, 120, 220, 320 storage unit, 131 game program, 132 game information, 133 users Information, 134 character control program, 151,351 input unit (operation unit), 152,352 display unit, 200 server (computer), 211 progress support unit, 212 sharing support unit, 300 operation instruction device (NPC control device, character control) Device), 315 progress simulation unit, 316 character control unit, 317 reaction processing unit, 1010 object, 1020, 3030 controller, 1030 storage medium, 3010 microphone, 3020 motion capture device.

Claims (11)

A game program executed in an information terminal device including a processor, a memory, an input unit, and a display unit.
The game program is supplied to the processor.
The first step of generating virtual space data for identifying a virtual space associated with a predetermined image and arranging an object in the virtual space, and
The second step of arranging the virtual camera in the virtual space and
A third step of controlling the field of view of the virtual camera to an area in the virtual space according to the user's operation on the information terminal device.
The fourth step of displaying the image corresponding to the field of view on the display unit is executed.
The first step is a character object involved in the success or failure of a predetermined condition in the game is disposed in the virtual space, or when the user has the character object without operation is disposed in the virtual space, et al. When the virtual space data is updated so as to move the character object in the direction of being arranged in the view area, and the character object is not arranged in the view area controlled by the user's operation. In addition, a game program that updates virtual space data so as to move the character object in the direction in which the character object is arranged in the visible area regardless of the position outside the visible area. .. The game program is supplied to the processor.
The game program according to claim 1, wherein the character object is displayed on the display unit and a predetermined condition is satisfied to execute a fifth step of performing a game process according to the character object. In the fourth step, a reference image is displayed at a predetermined position on the display unit by superimposing it on the image.
The game program according to claim 2, wherein the predetermined conditions are satisfied by displaying the character object at the predetermined position. The fourth step is, without displaying the reference image when the character object is not located in the viewing area, displaying the reference image when the character object is disposed in said viewing area , The game program according to claim 3. The information terminal device includes an imaging unit and has an imaging unit.
The game program according to any one of claims 1 to 4, wherein the predetermined image is an image output from the imaging unit. The game program according to any one of claims 1 to 5, wherein the first step arranges the character object in an area other than the field of view area when the virtual space data is generated. The first step is any one of claims 1 to 5 , wherein when the virtual space data is generated, the character object is arranged at a predetermined position in the virtual space regardless of the field of view area. The game program described in. The game program according to any one of claims 1 to 7, wherein the first step performs specific notification when the character object is arranged in the visual field area. The game program according to any one of claims 1 to 8, wherein the first step communicates with a server that manages landscape images of various places to acquire a landscape image corresponding to a predetermined position as the predetermined image. .. A game method executed by an information terminal device including a processor, a memory, an input unit, and a display unit.
In the game method, the computer
The first step of generating virtual space data for identifying a virtual space associated with a predetermined image and arranging an object in the virtual space, and
The second step of arranging the virtual camera in the virtual space and
A third step of controlling the field of view of the virtual camera to an area in the virtual space according to the user's operation on the information terminal device.
A fourth step of displaying an image corresponding to the field of view on the display unit is provided.
The first step is a character object involved in the success or failure of a predetermined condition in the game is disposed in the virtual space, or when the user has the character object without operation is disposed in the virtual space, et al. When the virtual space data is updated so as to move the character object in the direction of being arranged in the view area, and the character object is not arranged in the view area controlled by the user's operation. A game method in which virtual space data is updated so as to move the character object in the direction in which the character object is arranged in the visible area regardless of the position outside the visible area. .. It is an information processing device
A memory unit that stores game programs and
A control unit that controls the operation of the information processing device by executing the game program is provided.
The control unit
The first step of generating virtual space data for identifying a virtual space associated with a predetermined image and arranging an object in the virtual space, and
The second step of arranging the virtual camera in the virtual space and
A third step of controlling the field of view of the virtual camera to an area in the virtual space according to the user's operation on the information terminal device.
The fourth step of displaying the image corresponding to the field of view on the display unit is executed.
The first step is a character object involved in the success or failure of a predetermined condition in the game is disposed in the virtual space, or when the user has the character object without operation is disposed in the virtual space, et al. When the virtual space data is updated so as to move the character object in the direction of being arranged in the view area, and the character object is not arranged in the view area controlled by the user's operation. Information processing that updates virtual space data so as to move the character object in the direction in which the character object is arranged in the visible area regardless of the position outside the visible area. apparatus.