JP6722316B1 - Distribution program, distribution method, computer, and viewing terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a distribution program, a distribution method, a distribution server, and a viewing terminal capable of inviting a viewer to support such as the insertion of an item. A computer delivers data for enabling display of a game play image of a game that is cleared by satisfying a predetermined achievement condition on a user terminal. At this time, the computer specifies the number of user terminals displaying the game play video, that is, the number of viewers, and adjusts the degree of difficulty for satisfying the achievement condition in accordance with the number of viewers. [Selection diagram] Fig. 21

Description

The present invention relates to a distribution program, a distribution method, a computer, and a viewing terminal.

Patent Document 1 describes an information processing system that delivers a live video to a viewing terminal.

JP 2012-120098 A

However, the above-described conventional technique has room for increasing the viewer's preference for the content.

The present invention has been conceived in view of the above circumstances, and an object thereof is to provide a distribution program, a distribution method, a computer, and a viewing terminal that can further enhance the viewer's preference for content. Is.

According to an aspect of an embodiment shown in the present disclosure, a computer including a processor and a memory, which distributes data for enabling display of a game play video of a game that is cleared by satisfying a predetermined condition on a viewing terminal. A distribution program executed by is provided. The distribution program causes the processor to execute a step of specifying the number of views of the viewing terminal displaying the game play video, and a step of adjusting the difficulty level for satisfying a predetermined condition according to the number of views.

According to an aspect of one embodiment, executed by a computer that includes a processor and a memory, and that distributes data for enabling display of a game play video of a game that is cleared by satisfying a predetermined condition on a viewing terminal. Delivery methods are provided. The distribution method includes a step of causing the computer to specify the number of views of the viewing terminal displaying the game play video, and a step of adjusting the difficulty level for satisfying a predetermined condition according to the number of views.

According to one aspect of one embodiment, there is provided a computer that distributes data for enabling display of a game play image of a game that is cleared by satisfying a predetermined condition on a viewing terminal. The computer includes a storage unit that stores the distribution program and a control unit that controls the operation of the computer by executing the distribution program. The control unit indicates the number of views of the viewing terminal displaying the game play video. The step of specifying and the step of adjusting the difficulty level for satisfying the predetermined condition are executed according to the number of views.

According to an aspect of one embodiment, a viewing program executed by a viewing terminal including a processor, a memory, and a display unit is provided. The viewing program displays the game play video to a server that distributes data for enabling the processor to specify the game play video of the game that will be cleared by satisfying a predetermined condition. A step of transmitting information for identifying the number of views of the terminal, and a game play image of a game in which the degree of difficulty for satisfying a predetermined condition is adjusted according to the number of views of the viewing terminal based on the information from the server. Perform the steps and to display.

According to the present invention, it is possible to further enhance the viewer's preference for content.

It is a figure showing the outline of the composition of the HMD system according to a certain embodiment. FIG. 16 is a block diagram showing an example of a hardware configuration of a computer according to an embodiment. It is a figure which represents notionally the uvw visual field coordinate system set to HMD according to a certain embodiment. It is a figure which represents notionally one aspect expressing the virtual space according to one embodiment. It is a figure showing from above the head of the user wearing the HMD according to an embodiment. It is a figure showing the YZ section which looked at the field of view from the X direction in virtual space. It is a figure showing the XZ section which looked at the field of view from the Y direction in virtual space. It is a figure which shows an example of the virtual space prescribed|regulated in the HMD set according to a certain embodiment, and the object arrange|positioned at the said virtual space. (A) is a figure showing a schematic structure of a controller according to an embodiment, and (B) is an example of each direction of yaw, roll, and pitch defined with respect to a user's right hand according to an embodiment. FIG. It is a block diagram showing an example of the hardware constitutions of the server according to a certain embodiment. FIG. 2 is a block diagram showing a computer according to an embodiment as a module configuration. It is a block diagram showing a detailed configuration of a module of a computer according to an embodiment. It is a figure which shows the hardware constitutions of the user terminal according to a certain embodiment. (A) is a figure which shows an example of the virtual space prescribed|regulated in the user terminal according to a certain embodiment, and the object arrange|positioned at the said virtual space, (B) is a visual field displayed on the said user terminal. It is a figure which shows an example of an image. FIG. 4 is a block diagram showing a functional configuration of a user terminal, a server, and an HMD set included in the HMD system according to an embodiment. It is a figure which shows the detailed structure of the virtual space control part contained in the user terminal according to a certain embodiment. It is a figure which shows the detailed structure of the virtual space control part contained in the HMD set according to a certain embodiment. (A) is a figure which shows another example of the visual field image displayed on a user terminal, (B) is a figure which shows another example of the visual field image displayed on a user terminal, (C) is FIG. 11 is a diagram showing still another example of the visual field image displayed on the user terminal, and FIG. 13D is a diagram showing another example of the visual field image displayed on the user terminal. 7 is a timing chart showing a part of the operation of the user terminal and the computer according to the item input operation. It is a flowchart which shows a part of flow of the process performed in a HMD system. It is a flowchart which shows another part of the flow of the process performed in a HMD system.

Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated. In one or more embodiments shown in the present disclosure, elements included in each embodiment can be combined with each other, and the resultant product is also a part of the embodiment shown in the present disclosure.

[Configuration of HMD system]
The configuration of an HMD (Head-Mounted Device) system 100 will be described with reference to FIG. 1. FIG. 1 is a diagram showing a schematic configuration of an HMD system 100 according to the present embodiment. The HMD system 100 is provided as a home system or a business system.

The HMD system 100 includes a server 600, an HMD set 110, an external device 700, a network 2, and a plurality of user terminals 800. The HMD set 110 is configured to be communicable with the server 600, the external device 700, and the user terminal 800 via the network 2. The HMD set 110 includes an HMD 120, a computer 200, an HMD sensor 410, a display 430, and a controller 300. The HMD 120 includes a monitor 130, a gaze sensor 140, a first camera 150, a second camera 160, a microphone 170, and a speaker 180. The controller 300 may include a motion sensor 420.

In one aspect, the computer 200 can be connected to the Internet or other network 2 and can communicate with the server 600 or other computers connected to the network 2. Examples of other computers include a user terminal 800, an external device 700, and a computer of another HMD set 110. In another aspect, HMD 120 may include sensor 190 instead of HMD sensor 410.

The HMD 120 is attached to the head of the player 5 and can provide the player 5 with a virtual space during operation. More specifically, the HMD 120 displays an image for the right eye and an image for the left eye on the monitor 130, respectively. When each eye of the player 5 visually recognizes each image, the player 5 can recognize the image as a three-dimensional image based on the parallax of both eyes. The HMD 120 can include both a so-called head mounted display including a monitor and a head mounted device to which a terminal having a monitor such as a smartphone can be mounted. The HMD 120 provides a virtual space for allowing the player 5 to play a game that is cleared by satisfying a predetermined achievement condition, for example. The player 5 distributes data for enabling the play screen of the game to be displayed on the user terminal 800, and is therefore also referred to as a distributor.

Note that the genre of the game is not limited to a particular genre, and the HMD system 100 can execute games of all genres. For example, games on sports such as tennis, table tennis, dodge ball, baseball, soccer and hockey, puzzle games, quiz games, RPG (Role-Playing Game), adventure games, shooting games, simulation games, training games, and It may be an action game or the like.

Further, the play mode of this game is not limited to a specific play mode. The HMD system 100 can provide a virtual space for playing a game of any play mode. For example, a single-player game played by a single player 5, a multi-player game played by a plurality of players 5, or, among the multi-player games, a battle game in which a plurality of players 5 compete, and a cooperative play in which a plurality of players 5 cooperate. It may be a game or the like.

The monitor 130 is realized as, for example, a non-transmissive display device. In one aspect, the monitor 130 is arranged on the main body of the HMD 120 so as to be positioned in front of both eyes of the player 5. Therefore, the player 5 can immerse himself in the virtual space when viewing the three-dimensional image displayed on the monitor 130. In one aspect, for example, an avatar object that the player 5 can operate and other objects are arranged in the virtual space. In one aspect, the monitor 130 can be realized as a liquid crystal monitor or an organic EL (Electro Luminescence) monitor included in a so-called smartphone or other information display terminal.

In another aspect, the monitor 130 can be realized as a transmissive display device. In this case, the HMD 120 may be an open type such as a spectacle type instead of the closed type that covers the eyes of the player 5 as shown in FIG. 1. The transmissive monitor 130 may be temporarily configurable as a non-transmissive display device by adjusting the transmittance thereof. The monitor 130 may include a configuration for simultaneously displaying a part of an image forming the virtual space and the real space. For example, the monitor 130 may display an image of the real space taken by a camera mounted on the HMD 120, or may make the real space visible by setting a part of the transmittances high.

In one aspect, monitor 130 may include a sub-monitor for displaying an image for the right eye and a sub-monitor for displaying an image for the left eye. In another aspect, the monitor 130 may be configured to integrally display an image for the right eye and an image for the left eye. In this case, the monitor 130 includes a high speed shutter. The high-speed shutter operates so that the image for the right eye and the image for the left eye can be displayed alternately so that the image is recognized by only one of the eyes.

In one aspect, the HMD 120 includes a plurality of light sources (not shown). Each light source is realized by, for example, an LED (Light Emitting Diode) that emits infrared rays. The HMD sensor 410 has a position tracking function for detecting the movement of the HMD 120. More specifically, the HMD sensor 410 reads a plurality of infrared rays emitted by the HMD 120 and detects the position and inclination of the HMD 120 in the physical space.

In another aspect, the HMD sensor 410 may be implemented by a camera. In this case, the HMD sensor 410 can detect the position and inclination of the HMD 120 by executing the image analysis process using the image information of the HMD 120 output from the camera.

In another aspect, the HMD 120 may include a sensor 190 as a position detector instead of the HMD sensor 410 or in addition to the HMD sensor 410. The HMD 120 can detect the position and the tilt of the HMD 120 itself using the sensor 190. For example, when the sensor 190 is an angular velocity sensor, a geomagnetic sensor, or an acceleration sensor, the HMD 120 may use any one of these sensors instead of the HMD sensor 410 to detect its own position and tilt. As an example, when the sensor 190 is an angular velocity sensor, the angular velocity sensor detects the angular velocity around the three axes of the HMD 120 in the physical space over time. The HMD 120 calculates the temporal change of the angle around the three axes of the HMD 120 based on each angular velocity, and further calculates the inclination of the HMD 120 based on the temporal change of the angle.

The gaze sensor 140 detects the directions in which the right and left eyes of the player 5 are directed. That is, the gaze sensor 140 detects the line of sight of the player 5. The detection of the direction of the line of sight is realized by, for example, a known eye tracking function. The gaze sensor 140 is realized by a sensor having the eye tracking function. In one aspect, the gaze sensor 140 preferably includes a sensor for the right eye and a sensor for the left eye. The gaze sensor 140 may be, for example, a sensor that emits infrared rays to the right and left eyes of the player 5 and detects the rotation angle of each eyeball by receiving reflected light from the cornea and iris with respect to the emitted light. The gaze sensor 140 can detect the line of sight of the player 5 based on each detected rotation angle.

The first camera 150 photographs the lower part of the face of the player 5. More specifically, the first camera 150 photographs the nose and mouth of the player 5. The second camera 160 photographs the eyes and eyebrows of the player 5. The casing of the HMD 120 on the player 5 side is defined as the inside of the HMD 120, and the casing of the HMD 120 opposite to the player 5 is defined as the outside of the HMD 120. In an aspect, the first camera 150 may be arranged outside the HMD 120 and the second camera 160 may be arranged inside the HMD 120. The images generated by the first camera 150 and the second camera 160 are input to the computer 200. In another aspect, the first camera 150 and the second camera 160 may be realized as one camera, and the one camera may be used to capture the face of the player 5.

The microphone 170 converts the utterance of the player 5 into an audio signal (electrical signal) and outputs it to the computer 200. The speaker 180 converts the audio signal into audio and outputs the audio to the player 5. In another aspect, HMD 120 may include earphones instead of speaker 180.

The controller 300 is connected to the computer 200 by wire or wirelessly. The controller 300 receives an instruction input from the player 5 to the computer 200. In one aspect, the controller 300 is configured to be held by the player 5. In another aspect, the controller 300 is configured to be attachable to a part of the body or clothing of the player 5. In yet another aspect, the controller 300 may be configured to output at least one of vibration, sound, and light based on a signal transmitted from the computer 200. In still another aspect, the controller 300 receives an operation from the player 5 for controlling the position and movement of the object arranged in the virtual space.

In one aspect, the controller 300 includes multiple light sources. Each light source is realized by, for example, an LED that emits infrared rays. The HMD sensor 410 has a position tracking function. In this case, the HMD sensor 410 reads a plurality of infrared rays emitted by the controller 300 and detects the position and inclination of the controller 300 in the physical space, that is, the movement of the player's body. In another aspect, the HMD sensor 410 may be implemented by a camera. In this case, the HMD sensor 410 can detect the position and inclination of the controller 300 by executing the image analysis process using the image information of the controller 300 output from the camera.

The motion sensor 420 is attached to the hand of the player 5 in a certain situation, and detects the movement of the hand of the player 5. For example, the motion sensor 420 detects the rotation speed, the rotation speed, etc. of the hand. The detected signal is sent to the computer 200. The motion sensor 420 is provided in the controller 300, for example. In one aspect, the motion sensor 420 is provided, for example, in the controller 300 configured to be held by the player 5. In another aspect, for safety in the physical space, the controller 300 is attached to something that does not easily fly by being attached to the hand of the player 5, such as a glove type. In still another aspect, a sensor that is not attached to the player 5 may detect the movement of the hand of the player 5. For example, a signal from a camera that shoots the player 5 may be input to the computer 200 as a signal representing the operation of the player 5. The motion sensor 420 and the computer 200 are wirelessly connected to each other, for example. In the case of wireless, the communication form is not particularly limited, and, for example, Bluetooth (registered trademark) or other known communication methods are used.

The display 430 displays an image similar to the image displayed on the monitor 130. Accordingly, a person other than the player 5 wearing the HMD 120 who is involved in data distribution (also referred to as a distributor like the player 5) can view the same image as the player 5. The image displayed on the display 430 does not have to be a three-dimensional image, and may be an image for the right eye or an image for the left eye. Examples of the display 430 include a liquid crystal display and an organic EL monitor.

The server 600 can send the program to the computer 200. In another aspect, the server 600 distributes the data provided from the computer 200 for displaying the virtual space to a plurality of user terminals (eg, user terminals 800A, 800C, 800D) connectable to the server 600. obtain. The computer 200 may deliver the data without going through the server 600.

The server 600 may communicate with other computers 200 for providing virtual reality to the HMD 120 used by other players. For example, when a plurality of players play a participation-type game in an amusement facility, each computer 200 communicates a signal based on the operation of each player with another computer 200 via the server 600, and a plurality of players in the same virtual space. It enables players to enjoy a common game. Each computer 200 may communicate a signal based on the action of each player with another computer 200 without passing through the server 600.

The external device 700 may be any device that can communicate with the computer 200. The external device 700 may be, for example, a device capable of communicating with the computer 200 via the network 2, or a device capable of directly communicating with the computer 200 by short-range wireless communication or wired connection. Examples of the external device 700 include, but are not limited to, smart devices, PCs (Personal Computers), and peripheral devices of the computer 200.

[Computer hardware configuration]
The computer 200 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing an example of a hardware configuration of computer 200 according to the present embodiment. The computer 200 includes a processor 210, a memory 220, a storage 230, an input/output interface (hereinafter, IF) 240, and a communication IF 250 as main components. Each component is connected to the bus 260.

The processor 210 executes a series of instructions included in a program stored in the memory 220 or the storage 230 based on a signal given to the computer 200 or when a predetermined condition is satisfied. In one aspect, the processor 210 is realized as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an MPU (Micro Processor Unit), an FPGA (Field-Programmable Gate Array), or other device.

The memory 220 temporarily stores programs and data. The program is loaded from the storage 230, for example. The data includes the data input to the computer 200 and the data generated by the processor 210. In one aspect, the memory 220 is implemented as a RAM (Random Access Memory) or other volatile memory.

The storage 230 permanently holds programs and data. The storage 230 is realized as, for example, a ROM (Read-Only Memory), a hard disk device, a flash memory, or another non-volatile storage device. The programs stored in the storage 230 include a program for providing a virtual space in the HMD system 100, a simulation program, a game program, a user authentication program, and a program for realizing communication with another computer 200. The data stored in the storage 230 includes data and objects for defining the virtual space.

In another aspect, the storage 230 may be realized as a removable storage device such as a memory card. In yet another aspect, instead of storage 230 built in computer 200, a configuration using programs and data stored in an external storage device may be used. With such a configuration, for example, in a situation where a plurality of HMD systems 100 are used, such as in an amusement facility, it is possible to collectively update programs and data.

The input/output IF 240 communicates signals with the HMD 120, the HMD sensor 410, the motion sensor 420, and the display 430. The monitor 130, the gaze sensor 140, the first camera 150, the second camera 160, the microphone 170, and the speaker 180 included in the HMD 120 can communicate with the computer 200 via the input/output IF 240 of the HMD 120. In one aspect, the input/output IF 240 is realized using a USB (Universal Serial Bus), a DVI (Digital Visual Interface), an HDMI (registered trademark) (High-Definition Multimedia Interface), and other terminals. The input/output IF 240 is not limited to the above.

In certain aspects, the input/output IF 240 may also be in communication with the controller 300. For example, the input/output IF 240 receives input of signals output from the controller 300 and the motion sensor 420. In another aspect, the input/output IF 240 sends the instruction output from the processor 210 to the controller 300. The command instructs the controller 300 to perform vibration, voice output, light emission, or the like. Upon receiving the command, the controller 300 executes any one of vibration, voice output, and light emission according to the command.

The communication IF 250 is connected to the network 2 and communicates with another computer (for example, the server 600) connected to the network 2. In one aspect, the communication IF 250 is realized as, for example, a LAN (Local Area Network) or other wired communication IF, or a WiFi (Wireless Fidelity), Bluetooth (registered trademark), NFC (Near Field Communication), or other wireless communication IF. It The communication IF 250 is not limited to the above.

In one aspect, the processor 210 accesses the storage 230, loads one or more programs stored in the storage 230 into the memory 220, and executes a series of instructions included in the program. The one or more programs may include an operating system of the computer 200, an application program for providing a virtual space, game software executable in the virtual space, and the like. The processor 210 sends a signal for providing a virtual space to the HMD 120 via the input/output IF 240. The HMD 120 displays an image on the monitor 130 based on the signal.

In the example shown in FIG. 2, the computer 200 is shown to be provided outside the HMD 120, but in another aspect, the computer 200 may be built in the HMD 120. As an example, a portable information communication terminal (for example, a smartphone) including the monitor 130 may function as the computer 200.

The computer 200 may be configured to be commonly used by the plurality of HMDs 120. With such a configuration, for example, the same virtual space can be provided to a plurality of players, so that each player can enjoy the same application as other players in the same virtual space.

In one embodiment, in the HMD system 100, a real coordinate system that is a coordinate system in the real space is preset. The real coordinate system has three reference directions (axes) that are respectively parallel to the vertical direction in the real space, the horizontal direction orthogonal to the vertical direction, and the front-back direction orthogonal to both the vertical direction and the horizontal direction. The horizontal direction, vertical direction (vertical direction), and front-back direction in the real coordinate system are defined as the x-axis, the y-axis, and the z-axis, respectively. More specifically, in the real coordinate system, the x axis is parallel to the horizontal direction of the real space. The y-axis is parallel to the vertical direction of the real space. The z-axis is parallel to the front-back direction in real space.

In one aspect, HMD sensor 410 includes an infrared sensor. When the infrared sensor detects the infrared rays emitted from the respective light sources of the HMD 120, the presence of the HMD 120 is detected. The HMD sensor 410 further detects the position and inclination (direction) of the HMD 120 in the real space according to the movement of the player 5 wearing the HMD 120, based on the value of each point (each coordinate value in the actual coordinate system). To do. More specifically, the HMD sensor 410 can detect a temporal change in the position and inclination of the HMD 120 by using each value detected over time.

Each inclination of the HMD 120 detected by the HMD sensor 410 corresponds to each inclination around the three axes of the HMD 120 in the real coordinate system. The HMD sensor 410 sets the uvw visual field coordinate system to the HMD 120 based on the inclination of the HMD 120 in the actual coordinate system. The uvw visual field coordinate system set in the HMD 120 corresponds to the viewpoint coordinate system when the player 5 wearing the HMD 120 views an object in the virtual space.

[Uvw view coordinate system]
The uvw visual field coordinate system will be described with reference to FIG. FIG. 3 is a diagram conceptually showing a uvw visual field coordinate system set in HMD 120 according to an embodiment. The HMD sensor 410 detects the position and inclination of the HMD 120 in the real coordinate system when the HMD 120 is activated. The processor 210 sets the uvw visual field coordinate system in the HMD 120 based on the detected values.

As shown in FIG. 3, the HMD 120 sets a three-dimensional uvw visual field coordinate system with the head of the player 5 wearing the HMD 120 as the center (origin). More specifically, the HMD 120 defines the horizontal direction, the vertical direction, and the front-rear direction (x axis, y axis, z axis) that define the real coordinate system by the inclination around each axis of the HMD 120 within the real coordinate system. Three directions newly obtained by inclining about the axis are set as a pitch axis (u axis), a yaw axis (v axis), and a roll axis (w axis) of the uvw visual field coordinate system in the HMD 120.

In one aspect, when the player 5 wearing the HMD 120 stands upright and visually recognizes the front, the processor 210 sets the uvw visual field coordinate system parallel to the real coordinate system in the HMD 120. In this case, the horizontal direction (x axis), the vertical direction (y axis), and the front-back direction (z axis) in the real coordinate system are the pitch axis (u axis) and yaw axis (v axis) of the uvw visual field coordinate system in the HMD 120. , And the roll axis (w axis).

After the uvw visual field coordinate system is set in the HMD 120, the HMD sensor 410 can detect the tilt of the HMD 120 in the set uvw visual field coordinate system based on the movement of the HMD 120. In this case, the HMD sensor 410 detects the pitch angle (θu), the yaw angle (θv), and the roll angle (θw) of the HMD 120 in the uvw visual field coordinate system as the inclination of the HMD 120. The pitch angle (θu) represents the tilt angle of the HMD 120 around the pitch axis in the uvw visual field coordinate system. The yaw angle (θv) represents the tilt angle of the HMD 120 around the yaw axis in the uvw visual field coordinate system. The roll angle (θw) represents the tilt angle of the HMD 120 around the roll axis in the uvw visual field coordinate system.

The HMD sensor 410 sets the uvw visual field coordinate system in the HMD 120 after the HMD 120 has moved to the HMD 120 based on the detected inclination of the HMD 120. The relationship between the HMD 120 and the uvw visual field coordinate system of the HMD 120 is always constant regardless of the position and inclination of the HMD 120. When the position and the inclination of the HMD 120 change, the position and the inclination of the uvw visual field coordinate system of the HMD 120 in the actual coordinate system change in association with the change of the position and the inclination.

In one aspect, the HMD sensor 410 uses the HMD 120 based on the light intensity of infrared light acquired based on the output from the infrared sensor and the relative positional relationship between the points (for example, the distance between the points). The position in the real space may be specified as the relative position with respect to the HMD sensor 410. The processor 210 may determine the origin of the uvw visual field coordinate system of the HMD 120 in the real space (real coordinate system) based on the specified relative position.

[Virtual space]
The virtual space will be further described with reference to FIG. FIG. 4 is a diagram conceptually showing one aspect of expressing virtual space 11 according to an embodiment. The virtual space 11 has a spherical structure that covers the entire center 12 in the 360° direction. In FIG. 4, the celestial sphere in the upper half of the virtual space 11 is illustrated in order not to complicate the description. Each mesh is defined in the virtual space 11. The position of each mesh is defined in advance as coordinate values in the XYZ coordinate system, which is the global coordinate system defined in the virtual space 11. The computer 200 associates each partial image forming the panoramic image 13 (still image, moving image, etc.) expandable in the virtual space 11 with each corresponding mesh in the virtual space 11.

In a certain aspect, in the virtual space 11, an XYZ coordinate system whose origin is the center 12 is defined. The XYZ coordinate system is, for example, parallel to the real coordinate system. The horizontal direction, the vertical direction (vertical direction), and the front-back direction in the XYZ coordinate system are defined as the X axis, the Y axis, and the Z axis, respectively. Therefore, the X axis of the XYZ coordinate system (horizontal direction) is parallel to the x axis of the real coordinate system, the Y axis of the XYZ coordinate system (vertical direction) is parallel to the y axis of the real coordinate system, and the X axis of the XYZ coordinate system is The Z axis (front-back direction) is parallel to the z axis of the real coordinate system.

When the HMD 120 is activated, that is, in the initial state of the HMD 120, the virtual camera 14 is arranged at the center 12 of the virtual space 11. In an aspect, the processor 210 displays the image captured by the virtual camera 14 on the monitor 130 of the HMD 120. The virtual camera 14 similarly moves in the virtual space 11 in association with the movement of the HMD 120 in the physical space. As a result, changes in the position and inclination of the HMD 120 in the physical space can be reproduced in the virtual space 11 as well.

The uvw visual field coordinate system is defined for the virtual camera 14 as in the case of the HMD 120. The uvw visual field coordinate system of the virtual camera 14 in the virtual space 11 is defined so as to be linked to the uvw visual field coordinate system of the HMD 120 in the real space (real coordinate system). Therefore, when the inclination of the HMD 120 changes, the inclination of the virtual camera 14 also changes accordingly. The virtual camera 14 can also move in the virtual space 11 in conjunction with the movement of the player 5 wearing the HMD 120 in the real space.

The processor 210 of the computer 200 defines the view area 15 in the virtual space 11 based on the position and the inclination (reference line of sight 16) of the virtual camera 14. The field of view 15 corresponds to a region of the virtual space 11 that the player 5 wearing the HMD 120 visually recognizes. That is, it can be said that the position of the virtual camera 14 is the viewpoint of the player 5 in the virtual space 11.

The line of sight of the player 5 detected by the gaze sensor 140 is the direction in the viewpoint coordinate system when the player 5 visually recognizes an object. The uvw visual field coordinate system of the HMD 120 is equal to the viewpoint coordinate system when the player 5 visually recognizes the monitor 130. The uvw view coordinate system of the virtual camera 14 is linked to the uvw view coordinate system of the HMD 120. Therefore, HMD system 100 according to a certain aspect can regard the line of sight of player 5 detected by gaze sensor 140 as the line of sight of player 5 in the uvw visual field coordinate system of virtual camera 14.

[Player's line of sight]
The determination of the line of sight of the player 5 will be described with reference to FIG. FIG. 5 is a diagram showing the head of player 5 wearing HMD 120 according to an embodiment from above.

In a certain aspect, the gaze sensor 140 detects each line of sight of the right eye and the left eye of the player 5. In a certain aspect, when the player 5 is looking close, the gaze sensor 140 detects the sight lines R1 and L1. In another aspect, when the player 5 is looking far away, the gaze sensor 140 detects the sight lines R2 and L2. In this case, the angle formed by the lines of sight R2 and L2 with respect to the roll axis w is smaller than the angle formed by the lines of sight R1 and L1 with respect to the roll axis w. The gaze sensor 140 transmits the detection result to the computer 200.

When the computer 200 receives the detection values of the sight lines R1 and L1 from the gaze sensor 140 as the detection result of the sight line, the computer 200 specifies the attention point N1 which is the intersection of the sight lines R1 and L1 based on the detection value. On the other hand, when the computer 200 receives the detection values of the sight lines R2 and L2 from the gaze sensor 140, the computer 200 specifies the intersection of the sight lines R2 and L2 as the gaze point. The computer 200 specifies the line of sight N0 of the player 5 based on the specified position of the gazing point N1. The computer 200 detects, as the line of sight N0, for example, a direction in which a straight line passing through the midpoint of a straight line connecting the right eye R and the left eye L of the player 5 and the gazing point N1 extends. The line of sight N0 is the direction in which the player 5 is actually directing his or her eyes with both eyes. The line of sight N0 corresponds to the direction in which the player 5 is actually directing his or her line of sight to the visual field region 15.

In another aspect, the HMD system 100 may include a television broadcast receiving tuner. With such a configuration, the HMD system 100 can display a television program in the virtual space 11.

In still another aspect, the HMD system 100 may include a communication circuit for connecting to the Internet or a call function for connecting to a telephone line.

[Field of view]
The visibility region 15 will be described with reference to FIGS. 6 and 7. FIG. 6 is a view showing a YZ cross section of the view field 15 in the virtual space 11 as seen from the X direction. FIG. 7 is a view showing an XZ cross section of the view field 15 in the virtual space 11 as seen from the Y direction.

As shown in FIG. 6, the view field region 15 in the YZ section includes a region 18. The area 18 is defined by the position of the virtual camera 14, the reference line of sight 16, and the YZ section of the virtual space 11. The processor 210 defines a range including the polar angle α around the reference line of sight 16 in the virtual space as a region 18.

As shown in FIG. 7, the view region 15 in the XZ section includes a region 19. The area 19 is defined by the position of the virtual camera 14, the reference line of sight 16, and the XZ section of the virtual space 11. The processor 210 defines a range including the azimuth angle β around the reference line of sight 16 in the virtual space 11 as a region 19. The polar angles α and β are determined according to the position of the virtual camera 14 and the inclination (direction) of the virtual camera 14.

In one aspect, the HMD system 100 provides the player 5 with a view in the virtual space 11 by displaying the view image 17 on the monitor 130 based on a signal from the computer 200. The visual field image 17 is an image corresponding to a portion of the panoramic image 13 corresponding to the visual field region 15. When the player 5 moves the HMD 120 mounted on the head, the virtual camera 14 also moves in conjunction with the movement. As a result, the position of the view field 15 in the virtual space 11 changes. As a result, the visual field image 17 displayed on the monitor 130 is updated to the image of the panoramic image 13 that is superimposed on the visual field area 15 in the direction in which the player 5 is facing in the virtual space 11. The player 5 can visually recognize a desired direction in the virtual space 11.

Thus, the inclination of the virtual camera 14 corresponds to the line of sight (reference line of sight 16) of the player 5 in the virtual space 11, and the position where the virtual camera 14 is arranged corresponds to the viewpoint of the player 5 in the virtual space 11. Therefore, by changing the position or the inclination of the virtual camera 14, the image displayed on the monitor 130 is updated and the field of view of the player 5 is moved.

While wearing the HMD 120, the player 5 can visually recognize only the panoramic image 13 developed in the virtual space 11 without visually recognizing the real world. Therefore, the HMD system 100 can give the player 5 a high sense of immersion in the virtual space 11.

In an aspect, the processor 210 may move the virtual camera 14 in the virtual space 11 in conjunction with the movement of the player 5 wearing the HMD 120 in the real space. In this case, the processor 210 specifies the image area (visual field area 15) projected on the monitor 130 of the HMD 120 based on the position and inclination of the virtual camera 14 in the virtual space 11.

In one aspect, virtual camera 14 may include two virtual cameras, a virtual camera for providing an image for the right eye and a virtual camera for providing an image for the left eye. Appropriate parallax is set in the two virtual cameras so that the player 5 can recognize the three-dimensional virtual space 11. In another aspect, the virtual camera 14 may be realized by one virtual camera. In this case, the image for the right eye and the image for the left eye may be generated from the image obtained by one virtual camera. In the present embodiment, the virtual camera 14 includes two virtual cameras, and the roll axis (w) generated by combining the roll axes of the two virtual cameras is adapted to the roll axis (w) of the HMD 120. The technical idea according to the present disclosure will be exemplified as one configured as described above.

[Objects placed in virtual space]
An example of the virtual space 11 will be described with reference to FIG. Multiple types of objects are arranged in the virtual space 11. The plurality of types of objects include an avatar object 6 that is an alternation of the player 5, operation objects such as virtual hands operated by the controller 300, character objects, landscapes including forests, mountains, and the like arranged according to the progress of the game story, This includes background objects such as cityscapes and animals. FIG. 8 shows an example in which the avatar object 6 and the objects A to D are arranged. Examples of the objects A to D include, but are not limited to, character objects and background objects. The avatar object 6 is moved/placed at a position corresponding to the movement of the player 5. Further, the objects A to D and the like (hereinafter, also referred to as other objects) are operated/placed at positions according to the progress of the game based on the game program.

For example, in a battle game in which the avatar object 6 is played against an enemy character, the object of the enemy character, the obstacle object that interferes with the attack of the enemy character, and the like correspond to other objects. Further, in a puzzle game in which the arrangement of blocks is rearranged in an avatar object, objects of a plurality of blocks having different colors and shapes correspond to other objects.

Furthermore, in the escape game in which an avatar object escapes from a closed room, objects such as furniture (tables, chairs, chests, beds, etc.) placed in the room, objects for items to escape (keys and diaries), etc. Equivalent to. Further, in a music game in which a musical instrument is played by an avatar object, an object of a musical instrument (piano, violin, etc.), an object of another character co-starring with the avatar object, and the like correspond to other objects.

[controller]
An example of the controller 300 will be described with reference to FIG. 9. FIG. 9 is a diagram showing a schematic configuration of the controller 300 according to an embodiment.

As shown in FIG. 9, in one aspect, the controller 300 may include a right controller 300R and a left controller (not shown). The right controller 300R is operated by the right hand of the player 5. The left controller is operated by the left hand of the player 5. In one aspect, the right controller 300R and the left controller are symmetrically configured as separate devices. Therefore, the player 5 can freely move the right hand holding the right controller 300R and the left hand holding the left controller, respectively. In another aspect, the controller 300 may be an integrated controller that receives operations of both hands. The right controller 300R will be described below.

The right controller 300R includes a grip 310, a frame 320, and a top surface 330. The grip 310 is configured to be gripped by the right hand of the player 5. For example, the grip 310 can be held by the palm of the right hand of the player 5 and three fingers (middle finger, ring finger, little finger).

The grip 310 includes buttons 340 and 350 and a motion sensor 420. The button 340 is arranged on the side surface of the grip 310 and receives an operation by the middle finger of the right hand. The button 350 is arranged on the front surface of the grip 310 and receives an operation by the index finger of the right hand. In one aspect, buttons 340 and 350 are configured as trigger-type buttons. The motion sensor 420 is built in the housing of the grip 310. If the movement of the player 5 can be detected from around the player 5 by a camera or other device, the grip 310 may not include the motion sensor 420.

The frame 320 includes a plurality of infrared LEDs 360 arranged along the circumferential direction thereof. The infrared LED 360 emits infrared light according to the progress of the program while the program using the controller 300 is being executed. The infrared rays emitted from the infrared LED 360 can be used to detect each position and posture (tilt, orientation) of the right controller 300R and the left controller. In the example shown in FIG. 9, the infrared LEDs 360 arranged in two rows are shown, but the number of arrays is not limited to that shown in FIG. 9. A single row or an array of three or more rows may be used.

The top surface 330 includes buttons 370 and 380 and an analog stick 390. Buttons 370 and 380 are configured as push buttons. Buttons 370 and 380 accept an operation by the thumb of the player 5's right hand. The analog stick 390 receives an operation in an arbitrary direction of 360 degrees from an initial position (neutral position) in a certain aspect. The operation includes, for example, an operation for moving an object arranged in the virtual space 11.

In one aspect, the right controller 300R and the left controller include batteries for driving the infrared LEDs 360 and other components. Batteries include, but are not limited to, rechargeable, button type, dry cell type, and the like. In another aspect, the right controller 300R and the left controller may be connected to the USBIF of the computer 200, for example. In this case, the right controller 300R and the left controller do not require batteries.

As shown in states (A) and (B) of FIG. 9, for example, the yaw, roll, and pitch directions are defined for the right hand of the player 5. When the player 5 extends his thumb and forefinger, the direction in which the thumb extends is the yaw direction, the direction in which the index finger extends is the roll direction, and the direction perpendicular to the plane defined by the yaw direction axis and the roll direction axis is the pitch direction. Is defined as

[Server hardware configuration]
The server 600 according to the present embodiment will be described with reference to FIG. FIG. 10 is a block diagram showing an example of a hardware configuration of server 600 according to an embodiment. The server 600 includes a processor 610, a memory 620, a storage 630, an input/output IF 640, and a communication IF 650 as main components. Each component is connected to the bus 660.

Processor 610 executes a series of instructions included in a program stored in memory 620 or storage 630 based on a signal provided to server 600 or when a predetermined condition is satisfied. In one aspect, processor 610 is implemented as a CPU, GPU, MPU, FPGA or other device.

The memory 620 temporarily stores programs and data. The program is loaded from the storage 630, for example. The data includes data input to the server 600 and data generated by the processor 610. In one aspect, memory 620 is implemented as RAM or other volatile memory.

The storage 630 permanently holds programs and data. The storage 630 is realized as, for example, a ROM, a hard disk device, a flash memory, or another non-volatile storage device. The program stored in the storage 630 realizes a program for providing a virtual space in each of the HMD system 100 and the user terminal 800, a simulation program, a game program, a user authentication program, and communication with the computer 200 and the user terminal 800. The program may be included. The data stored in the storage 630 may include data and objects for defining the virtual space.

In another aspect, the storage 630 may be realized as a removable storage device such as a memory card. In still another aspect, instead of the storage 630 built in the server 600, a configuration using programs and data stored in an external storage device may be used. With such a configuration, for example, in a situation where a plurality of HMD systems 100 are used, such as in an amusement facility, it is possible to collectively update programs and data.

The input/output IF 640 communicates signals with input/output devices. In one aspect, the input/output IF 640 is realized by using a USB, DVI, HDMI (registered trademark) or other terminal. The input/output IF 640 is not limited to the above.

The communication IF 650 is connected to the network 2 and communicates with each of the computer 200 and the user terminal 800 connected to the network 2. In one aspect, the communication IF 650 is realized, for example, as a LAN or other wired communication IF, or as a WiFi, Bluetooth (registered trademark), NFC, or other wireless communication IF. The communication IF 650 is not limited to the above.

In one aspect, the processor 610 accesses the storage 630, loads one or more programs stored in the storage 630 into the memory 620, and executes a series of instructions included in the program. The one or more programs may include an operating system of the server 600, an application program for providing a virtual space, game software executable in the virtual space, and the like. The processor 610 may send a signal for providing a virtual space to each of the computer 200 and the user terminal 800 via the input/output IF 640.

[HMD controller]
The control device of the HMD 120 will be described with reference to FIG. 11. In one embodiment, the control device is realized by computer 200 having a well-known configuration. FIG. 11 is a block diagram showing a computer 200 according to an embodiment as a module configuration.

As shown in FIG. 11, the computer 200 includes a control module 510, a rendering module 520, a memory module 530, and a communication control module 540. In one aspect, control module 510 and rendering module 520 are implemented by processor 210. In another aspect, multiple processors 210 may operate as control module 510 and rendering module 520. The memory module 530 is realized by the memory 220 or the storage 230. The communication control module 540 is realized by the communication IF 250.

The control module 510 controls the virtual space 11 provided to the player 5. The control module 510 uses the virtual space data representing the virtual space 11 to define the virtual space 11 in the HMD system 100. The virtual space data is stored in, for example, the memory module 530. The control module 510 may generate virtual space data or acquire virtual space data from the server 600 or the like.

The control module 510 arranges the object in the virtual space 11 using the object data representing the object (arrangement data for arranging (displaying) the object (display data)). The object data is stored in the memory module 530, for example. The control module 510 may generate the object data or acquire the object data from the server 600 or the like.

The control module 510 arranges an avatar object imitating the player 5 in the virtual space 11 based on the image including the player 5. In one aspect, the control module 510 arranges in the virtual space 11 an avatar object that has been selected by the player 5 from a plurality of types of avatar objects (for example, an object imitating an animal or an object of a deformed person). .. In one aspect, control module 510 arranges the avatar object of player 5 of another computer 200 connected via network 2 in virtual space 11. In another aspect, the control module 510 may arrange the avatar object of the player 5 in the virtual space 11.

The control module 510 identifies the inclination of the HMD 120 based on the output of the HMD sensor 410. In another aspect, control module 510 identifies the tilt of HMD 120 based on the output of sensor 190 that functions as a motion sensor. The control module 510 detects organs (for example, mouth, eyes, eyebrows) forming the face of the player 5 from the images of the face of the player 5 generated by the first camera 150 and the second camera 160. The control module 510 detects the movement (shape) of each detected organ.

The control module 510 detects the line of sight of the player 5 in the virtual space 11 based on the signal from the gaze sensor 140. The control module 510 detects a viewpoint position (coordinate value in the XYZ coordinate system) at which the detected line of sight of the player 5 and the celestial sphere in the virtual space 11 intersect. More specifically, the control module 510 detects the viewpoint position based on the line of sight of the player 5 defined by the uvw coordinate system and the position and inclination of the virtual camera 14. The control module 510 transmits the detected viewpoint position to the server 600. In another aspect, the control module 510 may be configured to transmit the sight line information representing the sight line of the player 5 to the server 600. In this case, the viewpoint position can be calculated based on the line-of-sight information received by the server 600.

The control module 510 reflects the movement of the body of the player 5 detected by the HMD sensor 410 in the avatar object. For example, the control module 510 detects that the player 5 is crouching and causes the avatar object to crouch down. The control module 510 reflects the detected motion of the facial organ on the face of the avatar object arranged in the virtual space 11. In one aspect, control module 510 reflects the movement of controller 300 on an avatar object or an operation object. In this case, the controller 300 includes a motion sensor for detecting the movement of the controller 300, an acceleration sensor, or a plurality of light emitting elements (for example, infrared LEDs). In another aspect, the control module 510 may receive the line-of-sight information of the other player 5 from the server 600 and reflect it on the line-of-sight of the avatar object of the other player 5.

The control module 510 arranges an object including an operation object for receiving the operation of the player 5 in the virtual space 11, in the virtual space 11. By operating the operation object, the player 5 operates, for example, an object arranged in the virtual space 11. In one aspect, the operation object may include, for example, a hand object that is a virtual hand corresponding to the hand of the player 5. In one aspect, the control module 510 moves the hand object in the virtual space 11 based on the output of the motion sensor 420 so as to interlock with the movement of the hand of the player 5 in the real space. In an aspect, the operation object may correspond to the hand part of the avatar object.

When each of the objects arranged in the virtual space 11 collides with another object, the control module 510 detects the collision. The control module 510 can detect, for example, a timing at which a collision area of a certain object and a collision area of another object touch, and when the detection is performed, a predetermined process is performed. The control module 510 can detect the timing when the object is separated from the state in which the objects are in contact with each other, and when the detection is performed, a predetermined process is performed. The control module 510 can detect that the objects are in contact with each other. For example, control module 510, when the operation object touches another object, detects that the operation object touches the other object and performs a predetermined process.

In one aspect, control module 510 controls image display on monitor 130 of HMD 120. For example, the control module 510 arranges the virtual camera 14 in the virtual space 11. The control module 510 controls the position of the virtual camera 14 in the virtual space 11 and the inclination (direction) of the virtual camera 14. The control module 510 defines the field of view 15 according to the tilt of the head of the player 5 wearing the HMD 120 and the position of the virtual camera 14. The rendering module 520 generates the visual field image 17 displayed on the monitor 130 based on the determined visual field area 15. The visual field image 17 generated by the rendering module 520 is output to the HMD 120 by the communication control module 540.

When the control module 510 detects an utterance using the microphone 170 of the player 5 from the HMD 120, the control module 510 identifies the computer 200 to which the voice data corresponding to the utterance is transmitted. The voice data is transmitted to the computer 200 specified by the control module 510. When the control module 510 receives voice data from another user's computer 200 via the network 2, the control module 510 outputs a voice (utterance) corresponding to the voice data from the speaker 180.

The memory module 530 holds data used by the computer 200 to provide the virtual space 11 to the player 5. In one aspect, the memory module 530 holds space information, object information, and player information.

The spatial information holds one or more templates defined to provide the virtual space 11.

The object information includes a plurality of panoramic images 13 forming the virtual space 11, and object data for arranging objects in the virtual space 11. The panoramic image 13 may include a still image and a moving image. The panoramic image 13 may include an image in unreal space and an image in real space. Examples of the image in the unreal space include an image generated by computer graphics.

The player information holds a player ID that identifies the player 5. The player ID may be, for example, an IP (Internet Protocol) address or a MAC (Media Access Control) address set in the computer 200 used by the player. In another aspect, the player ID may be set by the player. The player information includes a program or the like for causing the computer 200 to function as a control device of the HMD system 100.

The data and programs stored in the memory module 530 are input by the player 5 of the HMD 120. Alternatively, the processor 210 downloads a program or data from a computer (for example, the server 600) operated by a business operator that provides the content, and stores the downloaded program or data in the memory module 530.

The communication control module 540 can communicate with the server 600 and other information communication devices via the network 2.

In one aspect, the control module 510 and the rendering module 520 can be implemented using Unity (registered trademark) provided by Unity Technologies, Inc., for example. In another aspect, the control module 510 and the rendering module 520 can be implemented as a combination of circuit elements that implement each process.

The processing in the computer 200 is realized by hardware and software executed by the processor 210. Such software may be stored in advance in the memory module 530 such as a hard disk. The software may be stored in a computer-readable non-volatile data recording medium such as a CD-ROM and distributed as a program product. Alternatively, the software may be provided as a downloadable program product by an information provider connected to the Internet or other network. Such software is read from a data recording medium by an optical disk drive or other data reading device, or downloaded from the server 600 or other computer via the communication control module 540, and then temporarily stored in the storage module. .. The software is read from the storage module by the processor 210 and stored in the RAM in the form of an executable program. The processor 210 executes the program.

[Detailed module configuration]
The module configuration of the computer 200 will be described in detail with reference to FIG. FIG. 12 is a block diagram showing a detailed configuration of modules of computer 200 according to an embodiment. As shown in FIG. 12, the control module 510 includes a virtual object generation module 1421, a virtual camera control module 1422, an operation object control module 1423, an avatar object control module 1424, a motion detection module 1425, a collision detection module 1426, and a virtual object. A control module 1427 is provided.

The virtual object generation module 1421 generates data for arranging various virtual objects in the virtual space 11. In an aspect, the virtual object may include, for example, landscapes including forests, mountains, and the like, cityscapes, animals, and the like arranged according to the progress of the game story. In one aspect, virtual objects can include avatar objects, control objects, and stage objects.

The virtual camera control module 1422 controls the behavior of the virtual camera 14 in the virtual space 11. The virtual camera control module 1422 controls, for example, the arrangement position of the virtual camera 14 in the virtual space 11 and the orientation (tilt) of the virtual camera 14.

The operation object control module 1423 controls an operation object for receiving the operation of the player 5 in the virtual space 11. The player 5 operates, for example, a virtual object arranged in the virtual space 11 by operating the operation object. In one aspect, the operation object may include, for example, a hand object (virtual hand) corresponding to the hand of the player 5 wearing the HMD 120. In one aspect, the operation object may correspond to the hand portion of the avatar object described below.

The avatar object control module 1424 reflects the movement of the player 5 detected by the HMD sensor 410 on the avatar object. For example, the avatar object control module 1424 detects that the player 5 has crouched and generates data for crouching the avatar object. In an aspect, the avatar object control module 1424 reflects the movement of the controller 300 on the avatar object. In this case, the controller 300 includes a motion sensor for detecting the movement of the controller 300, an acceleration sensor, or a plurality of light emitting elements (for example, infrared LEDs). The avatar object control module 1424 reflects the motion of the facial organs detected by the motion detection module 1425 on the face of the avatar object placed in the virtual space 11. That is, the avatar object control module 1424 reflects the action of the face of the player 5 on the avatar object.

The movement detection module 1425 detects the movement of the player 5. The movement detection module 1425 detects the movement of the hand of the player 5, for example, according to the output of the controller 300. The movement detection module 1425 detects the movement of the body of the player 5 according to the output of the HMD sensor 410, for example. The motion detection module 1425 can also detect the motion of the facial organs of the player 5.

The collision detection module 1426 detects a collision when each of the virtual objects arranged in the virtual space 11 collides with another virtual object. The collision detection module 1426 can detect the timing at which a certain virtual object touches another virtual object, for example. The collision detection module 1426 can detect the timing when the virtual object and the other virtual object are apart from each other. The collision detection module 1426 can also detect that one virtual object is in contact with another virtual object. The collision detection module 1426 detects, for example, when the operation object touches another virtual object, the operation object touches the other object. The collision detection module 1426 executes a predetermined process based on these detection results.

The virtual object control module 1427 controls the behavior of virtual objects other than the avatar object in the virtual space 11. As an example, the virtual object control module 1427 transforms the virtual object. As another example, the virtual object control module 1427 changes the placement position of the virtual object. As another example, virtual object control module 1427 moves a virtual object.

[Hardware configuration of user terminal]
A user terminal (viewer terminal) 800 according to the present embodiment will be described with reference to FIG. FIG. 13 is a block diagram showing an example of a hardware configuration of user terminal 800 according to an embodiment. The user terminal 800 (computer, information processing device) may be a mobile terminal such as a smartphone, a feature phone, a PDA (Personal Digital Assistant), or a tablet computer. The user terminal 800 may be a game device suitable for game play. As illustrated, the user terminal 800 includes a processor 810, a memory 820, a storage 830, a communication IF 13, an input/output IF 840, a touch screen 870 (display unit), a camera 860, and a distance measuring sensor 880. These components included in the user terminal 800 are electrically connected to each other by a communication bus. Note that the user terminal 800 may include an input/output IF 840 to which a display (display unit) configured separately from the main body of the user terminal 800 can be connected instead of or in addition to the touch screen 870.

Further, as shown in FIG. 13, the user terminal 800 may be configured to be able to communicate with one or more controllers 1020. The controller 1020 establishes communication with the user terminal 800 according to a communication standard such as Bluetooth (registered trademark). The controller 1020 may have one or more buttons or the like, and transmits an output value based on the input operation of the user 8 to the buttons or the like to the user terminal 800. Note that the user 8 is also a viewer because he/she is also a viewer of the distributed content. Further, the controller 1020 may include various sensors such as an acceleration sensor and an angular velocity sensor, and outputs output values of the various sensors to the user terminal 800.

Note that instead of or in addition to the user terminal 800 including the camera 860 and the distance measuring sensor 880, the controller 1020 may include the camera 860 and the distance measuring sensor 880.

It is desirable that the user terminal 800 causes the user 8 who uses the controller 1020 to input the user identification information such as the name or login ID of the user 8 via the controller 1020 when the game (or viewing) is started, for example. As a result, the user terminal 800 can associate the controller 1020 with the user 8 and determine which user 8 the output value belongs to based on the transmission source (controller 1020) of the received output value. Can be specified.

When the user terminal 800 communicates with a plurality of controllers 1020, each user 10 holds each controller 1020 so that the user terminal 800 does not communicate with other devices such as the server 600 via the network 2 and the one user terminal Multiplay can be realized with 800. In addition, each user terminal 800 communicates with each other according to a wireless standard such as a wireless LAN standard (communication is connected without passing through the server 600), so that a plurality of user terminals 800 can locally realize multi-play. When the above-described multiplay is locally realized by one user terminal 800, the user terminal 800 may further include at least a part of various functions of the server 600, which will be described later. When the above-described multiplay is locally realized by the plurality of user terminals 800, the plurality of user terminals 800 may be provided with various functions of the server 600, which will be described later, in a distributed manner.

Note that the user terminal 800 may communicate with the server 600 even when the above-described multiplay is realized locally. For example, information indicating a play result such as a score or a win or loss in a game and user identification information may be associated with each other and transmitted to the server 600.

Moreover, the controller 1020 may be configured to be attachable to and detachable from the user terminal 800. In this case, a coupling part with the controller 1020 may be provided on at least one surface of the housing of the user terminal 800. When the user terminal 800 and the controller 1020 are connected by wire via the connecting unit, the user terminal 800 and the controller 1020 send and receive signals via wire.

As shown in FIG. 13, the user terminal 800 may accept mounting of the storage medium 1030 such as an external memory card via the input/output IF 840. As a result, the user terminal 800 can read the program and data recorded in the storage medium 1030. The program recorded in the storage medium 1030 is, for example, a game program.

The user terminal 800 may store the game program acquired by communicating with an external device such as the server 600 in the memory 820 of the user terminal 800, or the game program acquired by reading from the storage medium 1030 in the memory 820. May be stored in.

As described above, the user terminal 800 includes the communication IF 850, the input/output IF 840, the touch screen 870, the camera 860, the distance measuring sensor 880, and the speaker 890 as an example of a mechanism for inputting information to the user terminal 800. Prepare Each of the above-described units as a mechanism for inputting can be regarded as an operation unit configured to receive the input operation of the user 8.

For example, when the operation unit is configured by at least one of the camera 860 and the distance measuring sensor 880, the operation unit detects the object 1010 near the user terminal 800 and performs an input operation from the detection result of the object. Identify. As an example, the hand of the user 8 as the object 1010, a marker having a predetermined shape, or the like is detected, and the input operation is specified based on the color, shape, movement, or type of the object 1010 obtained as a detection result. To be done. More specifically, when the hand of the user 8 is detected from the captured image of the camera 860, the user terminal 800 uses the gesture (a series of movements of the hand of the user 8) detected based on the captured image to the user 8 Is specified and accepted as the input operation of. The captured image may be a still image or a moving image.

Alternatively, when the operation unit includes the touch screen 870, the user terminal 800 identifies and accepts the operation of the user 8 performed on the input unit 8701 of the touch screen 870 as the input operation of the user 8. Alternatively, when the operation unit is configured by the communication IF 850, the user terminal 800 identifies and receives a signal (for example, output value) transmitted from the controller 1020 as the input operation of the user 8. Alternatively, when the operation unit is configured by the input/output IF 840, a signal output from an input device (not shown) different from the controller 1020 connected to the input/output IF 840 is specified and accepted as the input operation of the user 8. ..

The processor 810 controls the operation of the entire user terminal 800. The processor 810 includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit).

The processor 810 reads the program from the storage 830 and loads it in the memory 820. The processor 810 executes the expanded program.

The memory 820 is a main storage device. The memory 820 is configured by a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory 820 provides a work area to the processor 810 by temporarily storing a program, virtual space data, object data, and the like read by the processor 810 from a storage 830 described later. The memory 820 also temporarily stores various data generated while the processor 810 operates according to the program.

In the present embodiment, the program may be a game program for realizing the game on the user terminal 800. Alternatively, the program may be a game program for realizing the game by cooperation between the user terminal 800 and the server 600. Alternatively, the program may be a game program for realizing the game by cooperation of the user terminal 800, the server 600, and the HMD set 110. Note that the game realized by the cooperation of the user terminal 800 and the server 600 and the game realized by the cooperation of the user terminal 800, the server 600, and the HMD set 110 are, for example, a browser activated in the user terminal 800. It may be a game executed above. Alternatively, the program may be a game program for realizing the game by cooperation of a plurality of user terminals 800. In addition, the various data includes data regarding the game such as user information and game information, and instructions or notifications transmitted and received between the respective devices of the HMD system 100.

The storage 830 is an auxiliary storage device. The storage 830 is configured by a storage device such as a flash memory or an HDD (Hard Disk Drive). The storage 830 stores virtual space data, object data, and the like. The virtual space data and object data are updated when the user terminal 800 first downloads an application (including a viewing application) related to the game, or updates an application (including a viewing application) related to the game. At the time, it is provided from the server 600 to the user terminal 800.

The communication IF 850 controls transmission/reception of various data in the user terminal 800. The communication IF 850 controls, for example, communication using a wireless LAN, wired LAN, wireless LAN, or Internet communication via a mobile phone network, and communication using short-distance wireless communication.

The input/output IF 840 is an interface for the user terminal 800 to accept data input, and is an interface for the user terminal 800 to output data. The input/output IF 840 may input/output data via a USB or the like. The input/output IF 840 may include, for example, a physical button of the user terminal 800, a camera, a microphone, a speaker, or the like.

The touch screen 870 of the user terminal 800 is an electronic component that combines an input unit 8701 and a display unit 8702. The input unit 8701 is, for example, a touch-sensitive device, and is configured by, for example, a touch pad. The display unit 8702 is composed of, for example, a liquid crystal display, an organic EL display, or the like. The input unit 8701 detects a position at which an operation of the user 8 (mainly a physical contact operation such as a touch operation, a slide operation, a swipe operation, and a tap operation) on the input surface is detected, and information indicating the position is displayed. It has a function of transmitting as an input signal. The input unit 8701 may include a touch sensing unit (not shown). The touch sensing unit may be of any type such as a capacitance type or a resistance film type.

Like the touch screen 870 of the user terminal 800, the display 430 of the HMD set 110 may be configured by a touch screen in which an input unit and a display unit are combined.

Although not shown, the user terminal 800 may include one or more sensors for specifying the holding posture of the user terminal 800. This sensor may be, for example, an acceleration sensor or an angular velocity sensor. When the user terminal 800 includes a sensor, the processor 810 can also specify the holding posture of the user terminal 800 from the output of the sensor and perform processing according to the holding posture. For example, the processor 810 may perform vertical screen display in which a vertically long image is displayed on the display unit 8702 when the user terminal 800 is held vertically. On the other hand, when the user terminal 800 is held in the horizontal orientation, a horizontally long image may be displayed on the display unit. As described above, the processor 810 may be capable of switching between the vertical screen display and the horizontal screen display according to the holding posture of the user terminal 800.

The speaker 890 outputs a sound based on the sound data. The camera 860 includes an image sensor and the like, and converts the incident light incident from the lens into an electric signal to generate a captured image.

The distance measuring sensor 880 is a sensor that measures the distance to the measurement target. The distance measuring sensor 880 includes, for example, a light source that emits pulse-converted light and a light receiving element that receives the light. The distance measuring sensor 880 measures the distance to the measurement object by the light emission timing from the light source and the light reception timing of the reflected light generated by the light emitted from the light source reflected on the measurement object. The distance measuring sensor 880 may include a light source that emits light having directivity.

Here, an example in which the user terminal 800 receives the detection result of detecting the object 1010 near the user terminal 800 using the camera 860 and the distance measuring sensor 880 as the input operation of the user 8 will be further described. The camera 860 and the distance measuring sensor 880 may be provided, for example, on the side surface of the housing of the user terminal 800. A distance measuring sensor 880 may be provided near the camera 860. As the camera 860, for example, an infrared camera can be used. In this case, the camera 860 may be provided with a lighting device that emits infrared rays, a filter that blocks visible light, and the like. Thereby, the detection accuracy of the object based on the image captured by the camera 860 can be further improved regardless of whether it is outdoors or indoors.

The processor 810 may perform one or more processes of the following processes (1) to (5) on the captured image of the camera 860. (1) The processor 810 identifies whether or not the hand of the user 8 is included in the captured image by performing image recognition processing on the captured image of the camera 860. The processor 810 may use, for example, a technique such as pattern matching as the analysis technique used in the above-described image recognition processing. (2) Further, the processor 810 detects the gesture of the user 8 from the shape of the hand of the user 8. The processor 810 specifies the number of fingers of the user 8 (the number of extended fingers) from the shape of the hand of the user 8 detected from the captured image, for example. The processor 810 further specifies the gesture made by the user 8 from the specified number of fingers. For example, when the number of fingers is 5, the processor 810 determines that the user 8 has made a “par” gesture. Further, when the number of fingers is 0 (no finger is detected), the processor 810 determines that the user 8 has made a gesture of “goo”. Further, when the number of fingers is two, the processor 810 determines that the user 8 has made a gesture of “cutting”. (3) The processor 810 performs the image recognition process on the image captured by the camera 860 to determine whether the user's 8 finger is in the state where only the forefinger is raised or the user's 8 finger is repelled. To detect. (4) The processor 810, based on at least one of the image recognition result of the image captured by the camera 860, the output value of the distance measuring sensor 880, and the like, the object 1010 near the user terminal 800 (the hand of the user 8). Etc.) and the user terminal 800. For example, the processor 810 determines whether the hand of the user 8 is near the user terminal 800 (for example, a distance less than a predetermined value) or far (for example, depending on the size of the shape of the hand of the user 8 specified from the image captured by the camera 860). It is detected whether the distance is a predetermined value or more). If the captured image is a moving image, the processor 810 may detect whether the hand of the user 8 is approaching or moving away from the user terminal 800. (5) When it is determined that the distance between the user terminal 800 and the hand of the user 8 changes while the hand of the user 8 is detected based on the image recognition result of the image captured by the camera 860 and the like. The processor 810 recognizes that the user 8 is shaking his hand in the shooting direction of the camera 860. When an object is detected or not detected by the distance measuring sensor 880, which has a higher directivity than the shooting range of the camera 860, the processor 810 causes the user 8 to shake his hand in a direction orthogonal to the shooting direction of the camera. Recognize that.

In this way, the processor 810 recognizes whether the user 8 is clasping his/her hand based on the image recognition of the image captured by the camera 860 (whether the gesture is “goo” or another gesture (for example, “par”)). If there is). The processor 810 also detects the shape of the hand of the user 8 and how the user 8 is moving this hand. Further, the processor 810 detects whether the user 8 is moving this hand close to or away from the user terminal 800. Such an operation can correspond to an operation using a pointing device such as a mouse or a touch panel. The user terminal 800, for example, moves the pointer on the touch screen 870 according to the movement of the hand of the user 8 to detect the gesture “goo” of the user 8. In this case, the user terminal 800 recognizes that the user 8 is continuing the selection operation. The continuation of the selection operation corresponds to, for example, maintaining the state where the mouse is clicked and pressed, or maintaining the state where the touch panel is touched after the touchdown operation. Further, when the user 8 further moves the hand while the gesture “goo” of the user 8 is detected, the user terminal 800 responds to such a series of gestures with a swipe operation (or a drag operation). It can also be recognized as an operation. Further, when the user terminal 8 detects a gesture such that the user 8 repels a finger based on the detection result of the hand of the user 8 by the image captured by the camera 860, the user terminal 800 transmits the gesture to a mouse click or a touch panel. It may be recognized as an operation corresponding to the tap operation.

<Virtual space in user terminal 800>
FIG. 14 is a diagram schematically showing an example of the virtual space 11 and the view field image 1400 defined in the user terminal 800. In FIG. 14A, an avatar object 6 and other objects A to D are arranged in the virtual space 11. The computer 200 delivers, to the user terminal 800, operation instruction data (described later) for specifying the arrangement and operation of the avatar object 6 and the other objects A to D in the virtual space 11 shown in FIG. Therefore, the arrangement and movement of the avatar object 6 and the other objects A to D in the virtual space 11 shown in FIG. 14 are the same as the arrangement and movement of the avatar object 6 and the other objects A to D in the virtual space 11 shown in FIG. Match. The user 8A holds the user terminal 800A in the left hand. In the example of FIG. 14, the user 8A views the live game progress part, which is a program demonstrated by the avatar object 6, while viewing the screen of the user terminal 800A.

In the virtual space 11 defined by the user terminal 800, the avatar object 6 makes the same movement as the movement of the avatar object 6 in the virtual space 11 shown in FIG. 8 based on the movement instruction data. The user 8A views the performance of the avatar object 6 as a participant of the live game progression part through the screen of the user terminal 800A. In addition, the other users 8C and 8D view the performance of the avatar object 6 as participants of the live game progression part through the screens of the other user terminals 800C and 800D. In this way, the live game progress part progressed by the avatar object 6 is simultaneously delivered to the plurality of users 8.

In the example of FIG. 14A, the virtual camera 20A is arranged in front of the avatar object 6 in the virtual space 11 defined by the user terminal 800A. The virtual camera 20A defines the view field 21 according to the position and orientation of the virtual camera 20A. The processor 810 generates a visual field image 1400 corresponding to the visual field region 21 and displays it on the display unit 8702 of the touch screen 870 as shown in FIG. That is, the view field 21 is defined from the viewpoint of the virtual camera 20A, and the view image 1400 is also displayed from the viewpoint of the virtual camera 20A. The view image 1400 includes at least the avatar object 6 that performs the performance. The user 8A visually recognizes the view image 1400 to visually recognize the avatar object 6 and a part of the virtual space 11 in which the avatar object 6 appears. As a result, the user 8A can obtain a virtual experience as if the avatar object 6 were an actual distributor.

<Functional configuration of the HMD system 100>
FIG. 15 is a block diagram showing the functional configurations of the HMD set 110, the user terminal 800, and the server 600 included in the HMD system 100. Each of the HMD set 110, the user terminal 800, and the server 600 has a functional configuration necessary for functioning as a general computer (not shown) and a functional configuration necessary for realizing a known function in a game. May be included.

The HMD set 110 arranges/moves an object in the virtual space 11 shown in FIG. 8 and generates movement instruction data for placing/moving the object in the virtual space 11 shown in FIG. Has a function of supplying to. The motion instruction data may be any data as long as it is data for allowing the user terminal 800 to display the game play video in the live game progression part progressed by the avatar object 6. For example, the motion of the movement of the player 5 (model, etc.) Motion capture data (also referred to as motion data) input via 420 may be included, audio data in which the voice of the player 5 (voice actor, etc.) is recorded may be included, and other objects by the player 5 may be included. May include operation history data indicating a history of input operations for moving the object, and arrange or move an object in the virtual space 11 based on a command associated with a series of input operations or a game program. It may include a motion command group in which commands are arranged in time series. The HMD set 110 functions as a control unit 2100 (control module 510, rendering module 520) and a storage unit 2200 (memory module 530) in cooperation with the processor 210, the memory 220, the storage 230, the communication IF 250, the input/output IF 240, and the like. To do.

The user terminal 800 has a function as an input device that receives an input operation of the user 8 and a function as an output device that outputs a game image or sound. The user terminal 800 functions as the control unit 8100 and the storage unit 8200 in cooperation with the processor 810, the memory 820, the storage 830, the communication IF 850, the input/output IF 840, and the like.

The server 600 has a function of communicating with each user terminal 800 and supporting viewing of a game image on the user terminal 800. For example, when the user terminal 800 first downloads or updates the application related to this game, it is data that should be stored in the user terminal 800 in order to display the game play image, and may be included in the game play image. The object data (also referred to as object display data or object data) is provided to the user terminal 800.

The server 600 has a function of mediating between the user terminal 800 and the HMD set 110. As a result, the HMD set 110 can supply the operation instruction data to the user terminal 800 or a group of a plurality of user terminals 800 in a timely manner and without mistaking the destination. The server 600 functions as the control unit 6100 and the storage unit 6200 in cooperation with the processor 610, the memory 620, the storage 630, the communication IF 650, the input/output IF 640, and the like.

If the present game is a multi-play game, the server 600 may have a function of communicating with each HMD set 110 participating in the game to mediate exchange between the HMD sets 110 and a synchronization control function. Good.

The storage unit 2200 stores the game program 231. The storage unit 8200 stores a game program 831. The storage unit 6200 stores the game program 631. The game program 231 is a game program executed by the HMD set 110. The game program 831 is a game program executed by the user terminal 800. The game program 631 is a game program executed by the server 600. A game related to the HMD system 100 is realized by the devices operating in cooperation with each other based on the game programs 231, 631, and 831. The game programs 231 and 831 may be stored in the storage unit 6200 and downloaded to the storage units 2200 and 8200, respectively.

The storage units 2200, 8200, and 6200 store game information 132 and user information 133, respectively. The game information 132 is data that the control units 2100, 8100 and 6100 refer to when executing the game programs 231, 831 and 631, respectively. The user information 133 is data regarding the account of the user 8. In the storage units 2200 and 6200, the game information 132 and the user information 133 are stored for each user terminal 800. The user information 133 may include a purchase history of virtual currency (billing item) and a purchase or acquisition history of a specific item.

(Functional configuration of the HMD set 110)
The control unit 2100 executes the game program 231 stored in the storage unit 2200 to integrally control the HMD set 110. For example, the control unit 2100 arranges/moves an object in the virtual space 11 shown in FIG. 8 according to the operations of the game program 231 and the player 5, generates operation instruction data associated with the arrangement/motion, and causes the user terminal 800 to generate the motion instruction data. Supply. The control unit 2100 may further execute the game program 231 if necessary. Further, the control unit 2100 communicates with the server 600 and the user terminal 800 that is executing the present game to send and receive information.

The control unit 2100, according to the description of the game program 231, the operation reception unit 2101, the display control unit 2102, the UI control unit 2103, the animation generation unit 2104, the game progress unit 2105, the virtual space control unit 2106, and the reaction processing unit 2107. Function as. The control unit 2100 can also function as another functional block (not shown) in order to control an object that appears in the game according to the property of the game executed in the HMD system 100.

The operation receiving unit 2101 detects and receives the input operation of the player 5. The input operation is, for example, an input unit integrally formed with the display unit when the HMD 120, the motion sensor 420, and the display 430 are touch screens, a mouse (not shown), a keyboard (not shown), and the like. It is input from the device through the input/output IF 34. The operation reception unit 2101 determines what input operation is performed based on the action exerted by the player 5, and outputs the result to each element of the control unit 2100.

A user interface (hereinafter, UI) control unit 2103 controls the UI image displayed on the HMD 120 or the display 430.

The animation generation unit 2104 generates animations showing the motions of various objects based on the control modes of various objects. For example, the animation generation unit 2104 may generate an animation or the like that reproduces the game screen actually displayed on the user terminal 800 that is the communication partner.

The display control unit 2102 outputs, to the HMD 120 or the display 430, an image in which the processing result executed by each of the above-described elements is reflected.

The game progression unit 2105 progresses the game based on the avatar object 6 according to the input operation by the player 5 and the operation of the user 8 of the user terminal 800. For example, the game progression unit 2105 performs a predetermined game process when the avatar object 6 performs a predetermined action. Further, for example, the game progression unit 2105 receives information indicating the operation of the user 8 on the user terminal 800, and performs the game process based on the operation of the user 8. The game progression unit 2105 updates various game parameters based on the game process. The game information including the game parameter is supplied to the user terminal 800 via the server 600.

The virtual space control unit 2106 includes the modules 1421 to 1427 of the control module 510 described with reference to FIG. These details are as already described.

The virtual space control unit 2106 performs various controls for sharing the virtual space 11 with the user terminal 800. FIG. 16 is a diagram showing a detailed configuration of the virtual space control unit 2106. As shown in FIG. 16, the virtual space control unit 2106 includes the modules 1421 to 1427 described with reference to FIG. The virtual space control unit 2106 operates the avatar object 6 in the HMD set 110 and controls the behavior of the virtual object by the operations of these modules 1421 to 1427. In addition, the virtual space control unit 2106 generates the operation instruction data for operating the avatar object 6 in the user terminal 800 and the operation instruction data for controlling the behavior of each virtual object based on the operation of the modules 1421 to 1427. To do. These operation instruction data are supplied to the user terminal 800 via the server 600. For example, the virtual space control unit 2106 generates motion instruction data for instructing the object to be controlled to speak based on the voice data input by the player 5 (voice actor, etc.) via the microphone 170. The operation instruction data thus generated includes at least the above-mentioned voice data. In addition, for example, the player 5 (model or the like) generates motion instruction data for instructing the object to be controlled to perform a motion based on the motion capture data input via the motion sensor 420. The motion instruction data thus generated includes at least the above-mentioned motion capture data. In addition, for example, the player 5 operates an object to be controlled based on a history of input operations input by the player 5 via an input mechanism such as the controller 300 or an operation unit such as a touch screen, a mouse, and a keyboard, that is, operation history data. The motion instruction data for instructing the action is generated. The motion instruction data thus generated includes at least the above-mentioned operation history data. The operation history data is, for example, information in which an operation log indicating which button of the controller 300 is pressed by the player 5 when the screen is displayed on the HMD 120 is arranged in chronological order. .. Alternatively, the virtual space control unit 2106 identifies a command instructing the operation of the object, which is associated with the input operation input by the player 5 via the above-described input mechanism or operation unit. Then, the virtual space control unit 2106 arranges the commands in the input order to generate a motion command group indicating a series of motions of the object, and generates motion instruction data instructing to operate the object according to the motion command group. You may. The motion command data thus generated includes at least the above-mentioned motion command group.

The reaction processing unit 2107 receives feedback regarding the reaction of the user 8 from the user terminal 800 and outputs it to the player 5 of the HMD set 110. In the present embodiment, for example, the user terminal 800 allows the user 8 to create a comment for the object while operating the object according to the above-described operation instruction data. The reaction processing unit 2107 receives the comment data of the comment and outputs it. The reaction processing unit 2107 may display the text data corresponding to the comment of the user 8 on the display unit 352, or may output the voice data corresponding to the comment of the user 8 from a speaker (not shown).

(Functional configuration of server 600)
The control unit 6100 controls the server 600 by executing the game program 631 stored in the storage unit 6200. For example, the control unit 6100 transmits various data and programs to the user terminal 800. The control unit 6100 receives part or all of the game information or the user information from the user terminal 800. When the game is a multi-play game, the control unit 6100 may receive a request for multi-play synchronization from the HMD set 110 and transmit data for synchronization to the HMD set 110. Further, the control unit 6100 communicates with the user terminal 800 and the HMD set 110 to send and receive information as necessary.

The control unit 6100 functions as the progress support unit 6101 and the sharing support unit 6102 according to the description of the game program 631. The control unit 6100 can also function as other functional blocks (not shown) in order to support the progress of the game on the user terminal 800, depending on the nature of the game to be executed.

The progress support unit 6101 communicates with the user terminal 800 and provides support for the user terminal 800 to progress various parts included in the present game. For example, the progress support unit 6101 provides the user terminal 800 with information necessary for proceeding the game when the user terminal 800 progresses the game.

The sharing support unit 6102 communicates with the plurality of user terminals 800 and the HMD set 110, and supports the progress of the game and sharing of the virtual space 11 between these devices. The sharing support unit 6102 may have a function of matching the online user terminal 800 with the HMD set 110. As a result, information can be smoothly transmitted and received between the user terminal 800 and the HMD set 110.

(Functional configuration of user terminal 800)
The control unit 8100 centrally controls the user terminal 800 by executing the game program 831 stored in the storage unit 8200. For example, the control unit 8100 supports the progress of the game by the player 5 according to the operations of the game program 831 and the user 8. Further, the control unit 8100 communicates with the HMD set 110 via the server 600 to send and receive information as needed during the progress of the game by the player 5.

The control unit 8100, according to the description of the game program 831, the operation reception unit 8101, the display control unit 8102, the UI control unit 113, the animation generation unit 8104, the game progress unit 8105, the virtual space control unit 8106, and the progress information generation unit. 8107. The control unit 8100 can also function as other functional blocks (not shown) in order to progress the game depending on the nature of the game to be executed.

The operation receiving unit 8101 detects and receives the input operation of the user 8 on the input unit 8701. The operation reception unit 8101 determines what input operation has been performed based on the action exerted by the user 8 on the console via the touch screen 870 and other input/output IFs 14, and outputs the result to each element of the control unit 8100. Output. The details of the function of the operation receiving unit 8101 are almost the same as those of the operation receiving unit 2101 in the HMD set 110.

For example, the operation receiving unit 8101 receives an input operation on the input unit 8701, detects the coordinates of the input position of the input operation, and specifies the type of the input operation. The operation reception unit 8101 identifies, as the type of input operation, for example, a touch operation, a slide operation, a swipe operation, a tap operation, or the like. Further, the operation receiving unit 8101 detects that the contact input is released from the touch screen 870 when the input that is continuously detected is interrupted.

The UI control unit 8103 controls a UI image displayed on the display unit 8702 to construct a UI. The UI image is a tool for the user 8 to perform input necessary for the progress of the game to the user terminal 800, or a tool for obtaining information output during the progress of the game from the user terminal 800. The UI image is, for example, but not limited to, an icon, a button, a list, a menu screen, or the like.

The animation generation unit 8104 generates animations showing the motions of various objects based on the control modes of various objects. For example, the animation generation unit 8104 may generate an animation or the like that represents a state in which an object moves as if it were there, moved its mouth, or changed its facial expression.

The display control unit 8102 outputs, to the display unit 8702 of the touch screen 870, the game screen on which the processing result executed by each element described above is reflected. The display control unit 8102 may display a game screen including the animation generated by the animation generating unit 8104 on the display unit 8702. Also, the display control unit 8102 may superimpose and draw the above-mentioned UI image controlled by the UI control unit 8103 on the game screen. Further, the display control unit 8102 may superimpose and draw various game parameters on the game screen based on the game information supplied from the HMD set 110.

The virtual space control unit 8106 performs various controls for sharing the virtual space 11 with the HMD set 110. FIG. 17 is a diagram showing a detailed configuration of the virtual space control unit 8106. As shown in FIG. 17, the virtual space control unit 8106 includes a virtual object generation module 8121, a virtual camera control module 8122, an avatar object control module 8124, and a virtual object control module 8127.

The virtual object generation module 8121 has the same configuration as the virtual object generation module 1421 described with reference to FIG. Here, the virtual object generated in the user terminal 800 is synchronized with the virtual object generated in the HMD set 110. However, whether or not to synchronize each virtual object may be determined for each virtual object. For example, among the virtual objects generated by the HMD set 110, some virtual objects may not be generated by the user terminal 800. Further, among the virtual objects generated by the HMD set 110, there may be virtual objects generated in different display modes on the user terminal 800. The display form may be, for example, color, transparency, etc., but is not limited to these. Furthermore, the virtual space 11 created in the user terminal 800 may include virtual objects other than the virtual objects created in the HMD set 110.

The virtual camera control module 8122 is configured similarly to the virtual camera control module 1422 described with reference to FIG. Here, the virtual cameras 20A, 20C, 20D arranged in the virtual spaces 11A, 11C, 11D realized in the user terminals 800A, 800C, 800D are the virtual cameras arranged in the virtual space 11 realized in the HMD set 110. It is different from 14. That is, the view image of the virtual space 11 shared between the HMD set 110 and the user terminal 800 may be different between the HMD set 110 and the user terminal 800.

In the user terminals 800A, 800C, and 800D, the positions and directions of the virtual cameras 20A, 20C, and 20D may or may not be operable by the users 8A, 8C, and 8D. When the operation is impossible, the positions and directions of the virtual cameras 20A, 20C, 20D may be the same. In this case, the plurality of users 8 will view the common view image through each user terminal 800. That is, in this case, the plurality of users 8 can view the view image (live image) captured by the common virtual camera.

In this embodiment, the positions and directions of the virtual cameras 20A, 20C, and 20D can be operated by the users 8A, 8C, and 8D, and a description will be centered on an example in which a plurality of users 8 view different view images. In a certain aspect, the position and direction of the virtual camera 20A change according to a slide operation (or a swipe operation) on the touch screen of the user terminal 800A. For example, the position of the virtual camera 20A moves to the left in response to a slide operation to the left, to the right in response to a slide operation to the right, and upward in response to a slide operation to the up. Move to, and move downward according to the downward slide operation. At this time, the orientation of the virtual camera 20A is adjusted, for example, so that the avatar object 6 fits within the visual field area 21 (specifically, the avatar object 6 becomes the center of the visual field area 21).

The avatar object control module 8124 operates according to the motion instruction data instead of operating according to the movement of the HMD 120 or the movement of the controller 300 with respect to the avatar object control module 1424 described with reference to FIG. The configuration is similar except that the points are different. The operation instruction data is generated in the HMD set 110 according to the movement of the HMD 120 or the movement of the controller 300, and is distributed to the user terminal 800.

The virtual object control module 8127 has the same configuration as the virtual object control module 1427 described with reference to FIG. 12 except that it operates according to the operation instruction data. The motion instruction data is generated in the HMD set 110 so as to represent the behavior of virtual objects other than the avatar object 6 in the HMD set 110, and is distributed to the user terminal 800.

In this way, the virtual space control unit 8106 analyzes (renders) the motion instruction data and causes the avatar object 6 and the virtual object to operate based on the analysis result. In the present embodiment, the virtual space control unit 8106 uses the operation instruction data supplied by the HMD set 110 as a trigger to be received via the communication IF 33, and based on the data, the avatar object 6 or another virtual object. To operate. This allows the user 8 to show the avatar object 6 and other virtual objects that operate in real time.

The game progression unit 8105 supports the progress of the game by the player 5 of the HMD set 110 according to the input operation of the user 8 input through the operation reception unit 8101. For example, the game progression unit 8105 supports the progress of the game by the player 5 by arranging the item objects in the virtual space 11 during the progress of the game.

The progress information generation unit 8107 generates progress information indicating the progress of the game support executed by the game progress unit 8105, and transmits the progress information to the server 600 or the HMD set 110 at appropriate times. The progress information may include, for example, information designating the currently displayed game screen, or may include a progress log showing the progress of the game in time series by characters and symbols. In the HMD system 100, in an embodiment in which the server 600 and the HMD set 110 do not need progress information, the progress information generation unit 8017 may be omitted.

Note that the functions of the HMD set 110, the server 600, and the user terminal 800 shown in FIG. 15 are merely examples. Each device of the HMD set 110, the server 600, and the user terminal 800 may have at least a part of the functions of another device. Furthermore, another device other than the HMD set 110, the server 600, and the user terminal 800 may be a constituent element of the HMD system 100, and the other device may execute a part of the processing in the HMD system 100. That is, the computer that executes the game program in the present embodiment may be any of the HMD set 110, the server 600, the user terminal 800, and another device other than the HMD set 110, and is realized by a combination of a plurality of these devices. May be.

Note that the functions of the server 600 and the user terminal 800 shown in FIG. 15 are merely examples. The server 600 may include at least a part of the functions included in the user terminal 800. In addition, the user terminal 800 may include at least a part of the functions included in the server 600. Further, an apparatus other than the user terminal 800 and the server 600 may be a constituent element of the HMD system 100, and the other apparatus may be caused to execute a part of the processing in the HMD system 100. That is, the computer that executes the game program in the present embodiment may be any of the user terminal 800, the server 600, and other devices, or may be realized by a combination of a plurality of these devices.

<Game outline>
With reference to FIGS. 18A to 18D, the game executed by the HMD system 100 according to the present embodiment (hereinafter, this game) is, for example, an avatar object for operating a weapon such as a gun or a knife. 6 and a plurality of enemy objects 23 are made to appear in the virtual space 11, and the avatar object 6 is made to compete with the enemy objects 23. Various game parameters such as the physical strength of the avatar object 6, the number of magazines that can be used, the number of remaining bullets of the gun, the number of remaining enemy objects 23, etc. are updated according to the progress of the game.

A plurality of stages are prepared in this game, and the player 5 can clear the stage by satisfying a predetermined achievement condition associated with each stage. The predetermined achievement condition is established by, for example, defeating all the appearing enemy objects 23, defeating a boss object among the appearing enemy objects 23, acquiring a predetermined item, or reaching a predetermined position. It may include a condition to do.

In this game, in order to share the virtual space 11 between the HMD set 110 and the plurality of user terminals 800, game information including the above-mentioned various game parameters and operation instruction data for arranging/moving an object, It is delivered live to a plurality of user terminals 800 every predetermined time.

As a result, on the touch screen 870 of the user terminal 800 that is watching the game, the view image 1400 of the view area 21 defined by the virtual camera 20 corresponding to the user terminal 800 in the virtual space 11 is displayed. In addition, in the upper right and upper left of the view image 1400, parameter images representing the physical strength of the avatar object 6, the number of usable magazines, the number of remaining bullets of the gun, the number of remaining enemy objects 23, and the like are superimposed and displayed. It

Details of the operation instruction data are as follows. That is, during the live distribution, the computer 200 of the HMD set 110 causes the operation instruction data for controlling the operation of the avatar object 6 according to the operation of the player 5, and the placement and operation of other objects such as the enemy object 23 according to the game program. For example, operation instruction data for controlling the above is generated, and the operation instruction data is distributed to the plurality of user terminals 800 via the server 600. Each of the plurality of user terminals 800 analyzes (renders) the operation instruction data, triggered by receiving the operation instruction data.

That is, the action instruction data includes information for specifying the type of the object to be placed, the position, the posture, the orientation, etc. of the object, and the user terminal 800 analyzes which object by analyzing the action instruction data. At what position in the virtual space 11 and in what attitude and orientation, etc. are specified.

Object data such as the avatar object 6 and the enemy object 23 is stored in advance in the memory 820 of the user terminal 800. The user terminal 800 uses the object data to set an object of a type according to the analysis result of the operation instruction data at a position in the virtual space 11 according to the analysis result, and a posture/orientation according to the analysis result. And so on. The arrangement and movement of the avatar object 6, the enemy object 23, etc. in the virtual space 11 defined by the user terminal 800 match the arrangement and movement of the avatar object 6, the enemy object 23, etc. in the virtual space 11 specified by the computer 200. ..

The computer 200 of the HMD set 110 changes the level design corresponding to the difficulty level of the game according to the number of user terminals 800 (viewers) who are viewing the game. That is, the computer 200 adjusts the degree of difficulty for satisfying the achievement condition associated with the stage according to the number of viewers when each of the plurality of stages is started. In one aspect, the computer 200 can expect a lot of support from viewers as will be described later when the number of viewers increases, and as a result, the difficulty of the game is prevented in order to prevent the player 5 from easily clearing the game. Increase the degree.

The difficulty level is defined based on, for example, the fighting ability and appearance amount of the enemy object 23 and the fighting ability of the avatar object 6. In one aspect, when the number of viewers is 0, the computer 200 sets each of the combat ability and the appearance amount of the enemy object 23 and the battle ability of the avatar object 6 to initial values, and as the number of viewers increases, Each of the combat ability and the appearance amount of the enemy object 23 may be increased from the initial value, or the combat ability of the avatar object 6 may be decreased from the initial value. The number of viewers to which the initial value is set is not limited to the case where the number of viewers is 0, and may be the case where the number is any number other than 0.

In one aspect, the combat ability of the enemy object 23 is defined by the moving speed (agility) and physical strength of the enemy object 23, and the appearance amount of the enemy object 23 is the total number and the appearance frequency of the enemy objects 23 appearing in the current stage. Stipulated by Further, the fighting ability of the avatar object 6 is defined by the moving speed (agility) of the avatar object 6, the physical strength, and a correction value depending on the type of weapon/armor to be equipped.

On the touch screen 870 of the user terminal 800, a UI image 22 for accepting an item input operation for supporting the avatar object 6 from the user 8 is displayed so as to be superimposed on the image representing the virtual space 11. Icons such as magazines, first-aid kits, and obstacles (triangular cones, barricades, etc.) are drawn on the UI image 22, and the item insertion operation corresponds to the operation of tapping one of the icons.

When the user 8 performs the item input operation, the user terminal 800 consumes the virtual currency (value item) that the user 8 purchases and owns, and a predetermined effect object 24 such as a present box (see FIG. 18(C)) is arranged in the virtual space 11. The effect by the effect object 24 (hereinafter, also referred to as a throwing effect) is executed for a predetermined time (for example, 2 seconds). The presentation effect is, for example, to display a countdown at the same time as arranging the present box, and open the present box lid at the timing when the count value becomes zero. The size, shape, color, etc. of the present box may be the same regardless of the type of the inserted item, or may be different depending on the type of the item or the amount of virtual currency consumed. Good. The virtual currency is associated with the user 8 by, for example, billing or clearing a quest in the game. The virtual currency may be paid or free.

Further, with reference to FIG. 19, the user terminal 800 transmits the item input information to the computer 200 via the server 600 according to the item input operation. The item input information is information for identifying the type of the item designated by the item input operation, and assistance that the computer 200 arranges the item in the virtual space 11 or makes it available in the virtual space 11. Information for specifying the timing of activating the effect (supporting effect) is included. Here, the activation timing of the support effect is set so as to coincide with the timing at which the effect by the effect object 24 ends (that is, the timing when the predetermined time has elapsed since the effect object 24 was placed in the virtual space 11). ing. It should be noted that the support effect of the item may be activated immediately or after a certain period of time has elapsed since the item was inserted without performing the effect.

If the item to be thrown in is an obstacle, the user terminal 800 specifies a partial range within the visual field of the virtual camera 20 as the item throwing range. At this time, the item input information includes information for specifying the item input range. The item input range is, for example, a range around the avatar object 6.

Upon receiving the item input information, the computer 200, in order to support the avatar object 6, the item corresponding to the item type specified by the item input information, and the activation timing (more specifically, the item specified by the item input information). In addition, at the timing when the predetermined time has elapsed after receiving the item input information), the item placement information is placed in the virtual space 11 or can be used in the virtual space 11.

As a result, if the item type is magazine, the computer 200 restores the remaining number of guns used by the avatar object 6 at the activation timing. If the item type is the first aid kit, the computer 200 restores the physical strength of the avatar object 6 at the activation timing. Further, if the item type is an obstacle, the computer 200 specifies any position within the item input range specified from the item input information as an item input position, and activates the object representing the obstacle. It is placed at the item insertion position at the timing. The obstacle is, for example, an item having a function of inhibiting the progress and attack of the enemy object 23. Therefore, it can be said that the obstacle is an item that supports the avatar object 6 by disposing the obstacle.

The computer 200 adjusts the degree (size) of the support effect according to the number of viewers when the current stage is started. In one aspect, the computer 200 sets the degree of the support effect to an initial value when the number of viewers is 0, and decreases the degree of the support effect as the number of viewers increases. The degree of the support effect is defined by the recovery amount for the number of remaining bullets of the gun used by the avatar object 6 and the physical strength of the avatar object 6, and for the obstacle by size, strength, weight and the like.

Therefore, when the degree of the support effect is increased, the recovery amount of the number of remaining bullets of the gun or the recovery amount of the physical strength of the avatar object 6 is increased, and the size, strength, weight, etc. of the obstacle are increased. An increase in the amount of remaining bullets or an increase in the amount of physical strength of the avatar object 6 increases the combat time of the avatar object 6, and an increase in the size, strength, weight, etc. of the obstacle causes the enemy object 23 to increase. It takes longer to reach the avatar object 6.

When the input item is an obstacle, the computer 200 generates action instruction data including information for identifying the object type of the obstacle, the position and the posture of the object, and stores the action instruction data in the server. It is delivered to a plurality of user terminals 800 via 600 (see FIG. 19).

Each user terminal 800 specifies the type of item object to be placed, the position and posture of the item object by analyzing the operation instruction data. In addition, each user terminal 800 arranges the item object in the virtual space 11 based on the analysis result using the object data stored in advance in the memory 820.

In this way, the object data is stored in advance on the user terminal 800 side, and when arranging the object, the operation instruction data having a significantly smaller data amount than the moving image data is transmitted to the plurality of user terminals 800. As a result, it is possible to shorten the period from when the item is input until the item object is displayed on the user terminal 800, and at the same time, the arrangement timing of the item object can be synchronized in each of the plurality of user terminals 800. In the user terminal 800 that has performed the item input operation, the item object is placed in the virtual space 11 at the same time when the effect by the effect object 24 ends.

(About operation)
20 and 21 are flowcharts showing an example of the basic game progress of this game. Here, the process according to the flowchart shown in FIG. 20 is performed by the operation receiving unit 8101, the display control unit 8102, the UI control unit 8103, the animation generation unit 8104, the game progress unit 8105, and the virtual space provided in the control unit 8100 of the user terminal 800. It is executed by cooperation of the control unit 8106 and the progress information generation unit 8107. Further, the processing according to the flowchart shown in FIG. 21 is performed by the operation accepting unit 2101, the display controlling unit 2102, the UI controlling unit 2103, the animation generating unit 2104, the game progressing unit 2105, the virtual space controlling unit provided in the control unit 2100 of the computer 200. By the cooperation of the 2106 and the reaction processing unit 2107, the processing is performed every predetermined time (for example, 1/60 seconds).

Note that a part of the processing of the flowcharts shown in FIGS. 20 and 21 may be executed by the server 600 and the processing result may be transmitted to the user terminal 800 or the computer 200. In addition, the transmission/reception of information between the user terminal 800 and the computer 200 is performed via the server 600, but is not limited to this, and may be performed without passing through the server 600. Good.

Referring to FIG. 20, in step S01, it is determined based on an operation input from touch screen 870 whether or not the user 8 has performed a viewing start operation. If it is determined that the viewing start operation has been performed, the process proceeds to step S02, and the viewing start information is transmitted to the computer 200. In step S03, the virtual space 11 is defined based on the virtual space data stored in the storage 830. In step S04, the virtual camera 20 is arranged at a predetermined initial position in the virtual space 11. The initial position of the virtual camera 20 is, for example, a position where the center 12 of the virtual space 11 shown in FIG.

In step S05, the operation instruction data and the game information distributed from the computer 200 are received. In step S06, the action instruction data is analyzed to identify the position and the posture of the virtual object such as the avatar object 6 and the enemy object 23. In step S06, virtual objects such as the avatar object 6 and the enemy object 23 are placed in the virtual space 11 or the already placed virtual objects are set based on the analysis result and the object data stored in the memory 820. Make it work. In step S06, various game parameter values such as the physical strength of the avatar object 6, the number of magazines that can be used, the number of bullets remaining in the gun, the number of remaining enemy objects 23, and the like are specified based on the game information.

As will be described later, the operation instruction data and the game information are transmitted from the computer 200 at predetermined time intervals (1/60 seconds). Therefore, in step S06, the object in the virtual space 11 is updated every predetermined time based on the received motion instruction data, and various game parameter values are updated every predetermined time based on the received game information. The objects arranged in the virtual space 11 also include the object of the item input by the user 8.

In step S07, the visual field area 21 is defined according to the current position and orientation of the virtual camera 20, and the visual field image 1400 corresponding to the visual field area 21 is generated. In step S08, the UI image 22 for accepting the item input operation from the user 8 and the parameter image representing the various game parameter values are superimposed on the view image 1400 and displayed on the touch screen 870 (see FIG. 18). ). As a result, the game play image of the present game is displayed on the touch screen 870.

On the UI image 22, an icon or the like for accepting an item input operation from the user 8 is drawn. In one aspect, the items include a magazine of guns used by the avatar object 6, a first aid box for restoring the physical strength of the avatar object 6, and obstacles such as triangular cones and barricades for blocking the attack of the enemy object 23. ..

It should be noted that each item is associated with a consumption amount of virtual currency required for throwing the item and points for supporting the avatar object 6. The point associated with the item is set to a value according to the consumption amount of virtual currency required to throw the item, for example, the larger the consumption amount of virtual currency is, the larger the point is set. There is.

A parameter image showing the physical strength of the avatar object 6, the number of magazines that can be used, and the number of remaining bullets of the gun is displayed in the upper right of the view image 1400 in a superimposed manner, and the parameter image showing the remaining number of the enemy object 23 is , Is displayed in the upper left of the view image 1400 in a superimposed manner.

In step S09, it is determined whether or not an item input operation is performed on the UI image 22 based on the operation input from the touch screen 870. If it is determined that the item input operation has been performed, the process proceeds to step S10.

In step S10, the virtual currency corresponding to the inserted item is consumed from the virtual currency owned by the user 8. That is, when the item insertion operation is performed, the virtual currency is consumed by the amount corresponding to the item.

If the item designated by the item input operation is an obstacle, a part of the range in the visual field image 1400 is specified as the item input range based on the position and orientation (viewpoint) of the virtual camera 20 in step S11. For example, as shown in FIG. 18B, in a situation where the virtual camera 20 captures the virtual space 11 from the right side of the avatar object 6 at a wide angle, the floor surface in front of the avatar object 6 is specified as the item input range. When the process of step S11 is completed, the process proceeds to step S12. If the item designated by the item insertion operation is the magazine or the first aid kit, the process proceeds to step S12 without executing the process of step S11.

In step S12, the item input information is transmitted to the computer 200. In the item input information, the type of the item specified by the item input operation, the timing at which the support effect by the item is activated, the amount of points associated with the item, and the ID of the user 8 who performed the item input operation are specified. Contains information to do so. Further, when the process of step S11 is executed, the item input information also includes information for specifying the item input range (viewpoint of the virtual camera 20). When the amount of points associated with the item is managed by the computer 200, the amount of points need not be included in the item input information.

In step S13, a predetermined effect object 24 different from the input item (regardless of the input item) is arranged in the virtual space 11. The effect object 24 is arranged, for example, between the position of the virtual camera 20 and the position of the avatar object 6 in the virtual space 11. Here, the effect object 24 is, for example, a present box. In the effect by the effect object 24, the countdown is started at the same time when the present box is arranged, and when the count value becomes 0, the lid is opened. Further, the effect ends at the timing when a predetermined time (2 seconds) has elapsed since the effect object 24 was placed in the virtual space 11.

Referring to FIG. 19, the object of the item designated by the item input operation receives the action instruction data corresponding to the object from the computer 200, and thereby the virtual space 11 defined in each of the plurality of user terminals 800. Is located in.

That is, in the user terminal 800 that has performed the item input operation, when the effect object 24 is arranged according to the item input operation in the virtual space 11 defined by the user terminal 800 and a predetermined time has elapsed from the arrangement. Item objects are arranged based on the operation instruction data transmitted to the. On the other hand, in another user terminal 800, the effect object 24 is not placed in the virtual space 11, and the item object is placed at the same timing as the item object is placed in the user terminal 800 that has performed the item input operation. Are arranged in the virtual space 11. When the process of step S13 is completed, or when it is not determined in step S09 that the item input operation is performed, the process proceeds to step S14.

The user 8 can also input and send a comment to the avatar object 6 by operating the user terminal 800. The comment is transmitted to the computer 200 during the viewing period (for example, the period in which the processes of steps S05 to S14 are executed). When the computer 200 receives the comment from the user terminal 800, the computer 200 can display the user name on the display 430. The player 5 can input a comment for the comment. The comments input by the user and the player 5 are distributed from the computer 200 to the plurality of user terminals 800. In each user terminal 800, the comment is displayed on the touch screen 870 while being superimposed on the view image 1400.

In step S14, it is determined based on the operation input from the touch screen 870 whether or not the viewing end operation has been performed by the user 8. If it is not determined that the viewing end operation has been performed, the process returns to step S05. As a result, every time the operation instruction data is received from the computer 200, the process of controlling the movement and arrangement of the object is repeatedly executed.

On the other hand, when it is determined that the viewing end operation has been performed, the viewing end information is transmitted to the computer 200 in step S15, and then the process ends.

With reference to FIG. 21, in step S21, it is determined whether or not it is the timing to start the stage of the present game, based on the game parameter indicating the progress status of the game. When it is determined that it is the timing to start the stage, the process proceeds to step S22. In step S22, based on the viewing start information transmitted from the user terminal 800 at the start of viewing (step S02 in FIG. 20) and the viewing end information transmitted from the user terminal 800 at the end of viewing (step S15 in FIG. 20). , The current number of viewers, that is, the number of user terminals 800 currently watching the game is specified.

In step S23, the point adjustment amount for adjusting the points associated with the item input by the user 8 in the plus (increasing) direction is specified according to the number of viewers. Specifically, as the number of viewers increases, the point adjustment amount is increased. For example, when the number of viewers is 0, the point adjustment amount is set to 0% increase, and when the number of viewers is 1 or more and less than 100, the point adjustment amount is set to 5% increase. When the number is 101 or more and less than 200, the point adjustment amount is set to 10% increase, and when the number of viewers is 201 or more, the point adjustment amount is set to 20% increase.

As will be described later, the points are given to the avatar object 6. The avatar object 6 can acquire an item by performing a gacha operation when the given points reach a predetermined value. By using the acquired item, the avatar object 6 can increase the possibility of satisfying the achievement condition, and can make the progress of the game advantageous to the player.

In step S24, the difficulty level of the stage to be started from now and the degree of the support effect for supporting the avatar object 6 are adjusted according to the number of viewers viewing the stage. Specifically, with respect to the difficulty level of the stage, the more the number of viewers increases, the more the combat ability and appearance amount of the enemy object 23 increase, and the battle ability of the avatar object 6 decreases. To adjust. Regarding the extent of the support effect, as the number of viewers increases, the amount of remaining bullets or the amount of physical strength of the avatar object 6 is reduced to reduce the size, strength, weight, etc. of obstacles. By doing so, the support effect is reduced.

For example, when the number of viewers is 0, the combat ability and appearance amount of the enemy object 23, the battle ability of the avatar object 6, the recovery amount of the remaining number of guns, the recovery amount of the physical strength of the avatar object 6, and the obstacles. Set the size, strength, and weight to the initial values. When the number of viewers is 1 or more and less than 100, the combat ability and appearance amount of the enemy object 23 are set to 5% increase from the initial value, and the battle ability of the avatar object 6 is 5% from the initial value. The amount of remaining bullets is restored, the amount of physical strength of the avatar object 6 is restored, and the size, strength, and weight of obstacles are set to be 5% less than the initial values.

When the number of viewers is 101 or more and less than 200, the combat ability and appearance amount of the enemy object 23 are set to 10% increase from the initial value, and the battle ability of the avatar object 6 is 10% from the initial value. The amount of remaining bullets is restored, the amount of physical strength of the avatar object 6 is restored, and the size, strength, and weight of obstacles are set to be 10% less than the initial values. When the number of viewers is 201 or more, the combat ability and the appearance amount of the enemy object 23 are set to 20% increase from the initial value, and the battle ability of the avatar object 6 is set to 20% decrease from the initial value. Then, the recovery amount of the remaining number of bullets of the gun, the recovery amount of the physical strength of the avatar object 6, the size, strength, and weight of the obstacle are set to be reduced by 20% from the initial values.

The battle ability of the enemy object 23 is defined by, for example, the moving speed (agility) of the enemy object 23 and the physical strength of the current stage at the start of battle. Further, the appearance amount of the enemy objects 23 is defined by, for example, the total number of the enemy objects 23 appearing in the current stage and the appearance frequency of the enemy objects 23 in the current stage. The fighting ability of the avatar object 6 is defined by, for example, the moving speed (agility) of the avatar object 6, the physical strength of the avatar object 6 at the start of the battle in the current stage, and the correction value depending on the type of weapon/armor to be equipped.

When the process of step S24 is completed, the process proceeds to step S25. If it is not determined in step S21 that the stage has started, the process proceeds to step S25 without executing the processes of steps S22 to S24.

In step S25, it is determined whether the item input information is received from the user terminal 800 based on the input from the communication IF 250. When it is determined that the item insertion information is received, the process proceeds to step S26, and the avatar object 6 is given support points. Specifically, the amount of points included in the item input information is corrected based on the point adjustment amount specified in step S23, and the corrected amount of points is given to the avatar object 6. For example, if the amount of points included in the item input information is 50 points and the point adjustment amount specified in step S23 is increased by 10%, 55 points (=50×1.1) are set as the support points for the avatar. It is attached to the object 6.

In step S27, when the information for specifying the item input range is included in the item input information, an arbitrary position within the item input range is specified as the item input position. However, the center position of the item input range may be specified as the item input position, and a position corresponding to the positional relationship between the avatar object 6 and the enemy object 23 among the positions within the item input range (for example, the avatar object). 6 and the enemy object 23 closest to the avatar object 6) may be specified as the item insertion position.

When the process of step S27 is completed, the process proceeds to step S28. If the information for specifying the item input range is not included in the item input information, the process proceeds to step S28 without executing the process of step S27. In step S28, the type of the item designated by the item input operation and the timing of arranging the item object in the virtual space 11 and activating the support effect are specified based on the item input information. Specifically, in the activation management table (not shown), the type of the item and the activation timing of the support effect (that is, the timing when the predetermined time has elapsed after receiving the item input information) are set.

When the process of step S28 is completed, the process proceeds to step S29. Also, when it is not determined in step S25 that the item input information is received, the process proceeds to step S29. In step S29, whether or not the activation timing (arrangement timing of the item objects) set in the activation management table has arrived is determined based on a timer (not shown) provided in the computer 200.

If the item input information has not been received yet, or if the item input information has been received but the activation timing has not yet arrived, it is not determined in step S29 that the activation timing has arrived. At this time, the process proceeds to step S31 without executing the process of step S30.

On the other hand, when it is determined that the activation timing has arrived, the process proceeds to step S30, and the support effect according to the type of item set in the activation management table is activated. At this time, the user ID of the user who has input the item may be distributed to the plurality of user terminals 800. In each user terminal 800, the image representing the user ID is displayed on the touch screen 870 while being superimposed on the view image 1400.

In step S30, specifically, if the item is a magazine, the remaining number of guns used by the avatar object 6 is restored to make the game progress to the player 5's advantage, and if the item is a first aid kit, The physical strength of the avatar object 6 is restored, and the game progress is favored to the player 5. If the item is an obstacle, the object of the obstacle is placed at the item insertion position specified in step S27 among the positions in the virtual space 11 to make the game progress to the player 5 advantageously. The number of bullets, the amount of recovery of physical strength, the size, strength, and weight of the obstacle are defined according to the degree of the support effect adjusted in step S24. When the process of step S30 is completed, the process proceeds to step S31.

In step S31, it is determined whether or not the gacha operation is performed by the avatar object 6 based on the input from the controller 300 or the motion sensor 420. The gacha operation can be performed when the support points given to the avatar object 6 reach a predetermined value. When it is determined that the gacha operation has been performed, the process proceeds to step S32, and the cheering points given to the avatar object 6 are consumed to obtain the item.

The items acquired by the gacha operation include, for example, unique items different from the items that can be input by the user 8. The items acquired by the gacha operation include items that can be used with or without the support of the user. The item to be acquired may be the same item that can be input by the user 8 or an item that can be used with the support of the user 8.

In step S33, the effect of improving the possibility of establishment (improvement of improving the possibility of establishing the achievement condition) according to the acquired item is activated. Specifically, the object of the item (for example, knife) is placed on the floor surface in front of the avatar object 6 (for example, the knife is dropped). The avatar object 6 can compete with the enemy object 23 using the object. This can increase the possibility of clearing the game. The power (for example, size) of the object may be defined according to the degree of the support effect adjusted in step S24.

When the process of step S33 is completed, the process proceeds to step S34. If it is not determined in step S31 that the gacha operation has been performed, the process proceeds to step S34 without executing the processes of steps S32 and S33. In step S34, the game progresses based on the game program. Specifically, the avatar object 6, the enemy object 23, and the other objects (including the item object input in step S30) are arranged in the virtual space 11 according to the difficulty level adjusted in step S24. Updates such as moves and changes. Further, various game parameters such as the physical strength of the avatar object 6, the number of usable magazines, the number of remaining bullets of the gun, the remaining number of the enemy object 23, etc. are initialized or updated in a mode according to the difficulty level.

In step S35, in order to make it possible to specify the placement/motion of the avatar object 6 and the placement/motion of another object such as the enemy object 23 based on the objects in the virtual space 11 updated in step S34. The operation instruction data is generated, and the operation instruction data is distributed to the plurality of user terminals 800. When the obstacle object is placed in the virtual space 11 by the process of step S30, the action instruction data for specifying that the object is placed is distributed in this step. In step S35, game information including various game parameters initialized or updated in step S34 is generated, and the game information is distributed to the plurality of user terminals 800.

As described above, the process according to the flowchart shown in FIG. 21 is executed every predetermined time (1/60 seconds). Therefore, the operation instruction data and the game information are distributed to the plurality of user terminals 800 via the server 600 at each predetermined time. In each user terminal 800, a game play image is displayed on the touch screen 870 based on the operation instruction data and the game information. When the process of step S35 is completed, the process returns.

<Effect of this embodiment>
According to the present embodiment, a plurality of game play images of a game that is cleared by the avatar object 6 appearing in the virtual space 11 satisfying a predetermined achievement condition are generated based on operation instruction data distributed from the computer 200. Displayed on each of the user terminals 800. The computer 200 identifies the number of user terminals 800 displaying the game play video, that is, the number of viewers, and adjusts the difficulty level for establishing the achievement condition according to the number of viewers.

As a result, it is possible to encourage the viewer to support such as the introduction of an item. That is, the greater the number of viewers, the higher the difficulty level, so that it can be expected that the consumption of virtual currency will increase due to the large number of viewers throwing in items.

Further, according to the present embodiment, when the item input information is received from the user terminal 800 in response to the item input operation by the user 8, the computer 200 activates the support effect for supporting the establishment of the achievement condition. As a result, the user 8 can be actively involved in the game play by the player 5, and, in turn, the taste and viewing motivation of the game can be improved.

Further, according to the present embodiment, the item insertion operation is an operation that involves consumption of virtual currency owned by the user 8. As a result, the user 8 will carefully perform the item insertion operation while checking the progress of the game by the avatar object 6 and the support situation of the other users 8, and the game can be expanded more than the case where the item can be inserted indefinitely. Can be interesting.

Further, according to the present embodiment, the degree of the support effect for supporting the establishment of the achievement condition is adjusted according to the number of viewers. Specifically, the larger the number of viewers, the smaller the degree of support effect. As a result, when the number of viewers is large, it can be expected that the number of support opportunities from the viewers increases, but the difficulty level increases and the degree of support effect decreases. On the other hand, when the number of viewers is small, it is expected that the support opportunities from the viewers will decrease, but the difficulty level will decrease and the degree of support effect will increase. As a result, regardless of the number of viewers, it can be expected that the possibility that the player 5 can clear the game will converge within a certain range, and the possibility that the game will be cleared by the player 5 will be extremely changed according to the number of viewers. It is possible to prevent it (easy or difficult).

Furthermore, according to the present embodiment, points are associated with the items to be input, and the points are given to the avatar object 6 by the item input operation. When the given points reach a predetermined value, the avatar object 6 can put the item into the virtual space 11 by operating the gacha. The possibility that the player 5 can clear the game is improved by inserting an item by the gacha operation. Further, the amount of adjustment in the plus direction of the points given to the avatar object 6 changes according to the number of viewers. Specifically, as the number of viewers increases, the adjustment amount in the plus direction is increased. Therefore, in order to increase the number of viewers and obtain more points by inserting items, it is possible to motivate the player 5 to distribute a higher level game play video or a game play video that is interesting to the viewer. it can.

Furthermore, according to this embodiment, the amount of points associated with an item is set to an amount corresponding to the amount of virtual currency consumed when the item is inserted. As a result, the feeling of the user 8 (size of feeling to support) can be reflected in the amount of points given to the avatar object 6.

Further, according to the present embodiment, the game includes a plurality of stages, each of which is associated with an achievement condition, and the difficulty level of each stage is adjusted according to the number of viewers when the stage is started. .. As a result, the difficulty level can be finely adjusted as compared with, for example, the difficulty level being adjusted according to the number of viewers at the start of the first stage. Further, the processing load for adjusting the difficulty level can be reduced as compared with the case where the number of viewers is specified at any time to adjust the difficulty level even during the stage.

Further, according to the present embodiment, the game is a battle game in which the avatar object 6 plays against the enemy object 23, and the fighting ability of the avatar object 6, the fighting ability of the enemy object 23, and the appearance amount depend on the number of viewers. Be adjusted. Specifically, the smaller the number of viewers, the higher the fighting ability of the avatar object 6, and the larger the number of viewers, the higher the fighting ability of the enemy object 23 and the larger the appearance amount of the enemy object 23. As a result, it is possible to prevent the situation in which the player 5 cannot easily clear the game because the number of viewers is small. In addition, the motivation for supporting the player 5 can be properly exercised for the viewer.

Further, according to the present embodiment, the game progresses in a mode according to the difficulty level, and the game information including the game parameter indicating the progress status of the game is distributed to the user terminal 800. As a result, the physical strength of the avatar object 6, the number of magazines that can be used, the number of remaining bullets of the gun, the number of remaining enemy objects 23, and the like can be displayed on the user terminal 800.

Further, according to the present embodiment, the difficulty level is adjusted according to the number of viewers. Therefore, in the player 5 who operates the avatar object 6, the game operation is improved so that a higher level game play video or viewers can enjoy it. By distributing interesting gameplay videos, the motivation is to increase the number of viewers and distribute more difficult and high-level gameplay videos. As a result, a virtuous cycle of promotion of game operation→increased number of viewers→improvement of game operation→... is promoted. Furthermore, by adjusting the difficulty level, it becomes difficult for the viewer to predict the development of the game, so that the taste of the game play video and the viewer's willingness to watch can be improved.

According to the present embodiment, the user terminal 800 displays the game play image representing the virtual space 11 of the present game on the touch screen 870. When an item input operation for designating an item object to be placed in the virtual space 11 is received from the user 8, the user terminal 800 of the user 8 transmits the item input information to the computer 200 via the server 600. , The effect image by the effect object 24 is displayed on the touch screen 870.

The computer 200 arranges the item in the virtual space at a timing according to the item input information, generates operation instruction data regarding the item, and distributes the operation instruction data to the plurality of user terminals 800 via the server 600. The user terminal 800 viewing the game arranges the item object designated by the user in the virtual space 11 based on the operation instruction data. In addition, the data amount of the motion instruction data is significantly smaller than that of, for example, object data, and the time required to generate and transmit the motion instruction data can be shortened. As a result, the arrangement of the item objects can be synchronized among the plurality of user terminals 800, and the period from the item input operation to the arrangement of the item objects can be shortened as much as possible.

Further, in the virtual space 11 defined in the user terminal 800 where the item input operation is performed, the effect image by the effect object 24 is displayed until the item object is arranged. As a result, it is possible to provide a period from when the user performs the item input operation until the item object is arranged in the virtual space 11, and it is possible to prevent the user from feeling uncomfortable.

Further, according to the present embodiment, the effect image is displayed by disposing the effect object 24 in the virtual space 11. Therefore, even when an image other than the virtual object (for example, an image representing the user ID of the user 8 who has inserted the item, a comment input by the user or the player, etc.) is superimposed on the view image 1400 and displayed. It is possible to prevent the image other than the superimposed virtual object from being hidden by the effect object 24 and being invisible, and to prevent the taste of the game play image from being deteriorated.

Furthermore, according to the present embodiment, a plurality of types of item objects are provided, while the effect object 24 is defined as an object regardless of the type of the thrown item object. As a result, the processing load on the user terminal 800 can be reduced as much as possible.

Further, according to the present embodiment, the display data for displaying the object in the virtual space 11 is not received at the timing of arranging in the virtual space 11, but is stored in the storage 830 in advance. Each of the plurality of user terminals 800 watching the game arranges the item object in the virtual space 11 based on the operation instruction data and using the display data. In addition, the user terminal 800 on which the item input operation is performed executes the effect by the effect object 24 for a predetermined time.

Here, the item input information includes the timing (timing of the support effect) at which the effect by the effect object 24 ends, and the user terminal 800 sends the item input information to the server 600 when the item input operation is received. Via the computer 200. As a result, the computer 200 arranges the item object in the virtual space 11 at the timing specified by the item input information, generates motion instruction data, and transmits the motion instruction data to each of the plurality of user terminals 800. As a result, in the user terminal 800 that has performed the item input operation, the item object can be placed in the virtual space 11 at the same time when the effect by the effect object 24 is completed. That is, the effect produced by the effect object 24 and the arrangement of the item objects can be seamlessly connected.

Further, according to the present embodiment, the user terminal 800 arranges the virtual camera 20 in the virtual space 11 and displays the view image 1400 showing the view of the virtual camera 20 on the touch screen 870. At this time, the user terminal 800 specifies the item input range according to the range of the view image 1400, and transmits the item input information including the item input range to the computer 200 via the server 600. Thereby, the item object can be arranged in the field of view of the virtual camera 20. Further, the item input range is changed according to the position and orientation of the virtual camera 20 by a user operation. This enables strategic support such as throwing an obstacle object at a position between the avatar object 6 and the enemy object 23.

Further, according to the present embodiment, the position at which the thrown item object is arranged is determined by the computer 200 from the item throw range. At this time, the computer 200 can determine the position in consideration of the positional relationship with other objects that have already been arranged, and can distribute the action instruction data for specifying the determined position. As a result, it is possible to prevent unexpected collision or interference between the item object input by the operation of the user 8 and the other objects already arranged.

<Modification>
Modifications and the like of the embodiment described above are listed below.

(1) In the above embodiment, the amount of points given to the avatar object 6 is changed according to the number of viewers. However, instead of or in addition to changing the point, the predetermined value that the avatar object 6 needs to reach to perform the gacha operation may be changed according to the number of viewers.

(2) In the above-described embodiment, the timing at which the effect by the effect object 24 ends is included in the item input information, and when the user terminal 800 receives the item input operation, the user terminal 800 transmits the item input information via the server 600. It is transmitted to the computer 200. However, the item input information is transmitted to the computer 200 via the server 600 when the effect ends (when a predetermined time elapses) without including the end timing of the effect in the item input information. Good. In this case, the computer 200 may arrange the corresponding items when the item input information is received, and generate/distribute the operation instruction data. The amount of motion instruction data is much smaller than that of object data. Therefore, by transmitting the item insertion information when the effect is finished, the item object is placed in the virtual space 11 almost at the same time as the end of the effect by the effect object 24, and the operation instruction data is sent to each of the plurality of user terminals 800. Can be sent. Further, if the effect time by the effect object 24 is fixed and the effect time is known by the computer 200 side, the effect by the effect object 24 is ended at the same time as the effect even if the end timing of the effect is not included in the item insertion information. It becomes possible to arrange the item object in the virtual space 11 and transmit the operation instruction data to each of the plurality of user terminals 800.

(3) In the above embodiment, when the item insertion operation is performed, the virtual currency owned by the user 8 is consumed. Here, the consumption amount of virtual currency may be changed according to the number of viewers. Even when the same item is inserted, for example, as the number of viewers increases, more virtual currency may be required (the consumption amount increases). In this case, the amount of points associated with the item may be fixedly set regardless of the amount of virtual currency consumed.

(4) In the above embodiment, both the fighting ability and the appearance amount of the enemy character are reduced when the difficulty level is lowered. However, the difficulty level is comprehensively evaluated based on the battle ability and the appearance amount, and as long as the difficulty level is low, the appearance amount is decreased while increasing the battle ability while decreasing the appearance amount while decreasing the appearance amount. You may make it increase. Further, when adjusting the difficulty level, only one of the battle ability and the appearance amount may be changed.

(5) In the above embodiment, the number of viewers at the current stage is not displayed on the game play video. However, the number of viewers may be displayed on the game play video. Instead of or in addition to this, information that can specify the degree of difficulty according to the number of viewers may be displayed on the game play video.

(6) In the above embodiment, the player 5 wears the HMD set 110 and controls the motion of the avatar object 6. However, the player 5 may display the avatar object 6 on a stationary monitor such as a monitor for desktop PC, and control the operation of the avatar object 6 with a hand controller or a keyboard. Alternatively, the avatar object 6 may be displayed on the screen of the mobile information terminal, and the operation of the avatar object 6 may be controlled by a touch operation on the screen.

(7) In the above embodiment, the item object is put into the virtual space 11 in response to the tap operation on the icon on the UI image 22. However, the item object may be thrown into the virtual space 11 in response to a flick operation or a swipe operation. In this case, the item input range may be specified based on the mode of flick operation (operation direction) and the mode of swipe operation (speed, time or distance of touch operation). Further, the item object may be thrown into the virtual space 11 in response to a voice input instead of a touch operation on the screen.

(8) In the above embodiment, the user terminal 800 specifies the item input range, and the computer 200 specifies any position within the item input range as the item input position. However, the position itself where the item object to be input in the user terminal 800 is placed (item input position) itself may be directly specified. In this case, if the item object is thrown into the virtual space 11 in response to the flick operation or the swipe operation, the item throwing position is determined based on the mode (speed, touch operation time or distance) of the flick operation or the swipe operation. You may specify. In addition, as for the item insertion position, after selecting the item you want to insert by touch operation, touch the position where you want to place the item continuously, or move the touch operation position where you selected the item you want to insert to the position you want to arrange. It may be specified by canceling it.

(9) In the above embodiment, when the viewpoint changing operation is performed, the viewpoint of the virtual camera 20 is changed. At this time, depending on a specific viewpoint changing operation (such as a touch operation on a predetermined viewpoint changing icon). The viewpoint of the virtual camera 20 may be set to the viewpoint of the avatar object 6 or the viewpoint of the enemy object 23. Further, when the viewpoint is the viewpoint of the enemy object 23, when the enemy object 23 is defeated, the viewpoint of the virtual camera 20 is arranged at the initial position or set to the viewpoint of another enemy object 23. You may do it.

(10) In the above embodiment, as the number of viewers increases, the combat ability and appearance amount of the enemy object 23 increase, the combat ability of the avatar object 6 decreases, and the support effect for supporting the avatar object 6 is provided. An example of reducing the number has been described. However, instead of this, as the number of viewers increases, the fighting ability and appearance amount of the enemy object 23 decrease, the fighting ability of the avatar object 6 increases, and the support effect for supporting the avatar object 6 increases. You may do it. That is, the difficulty level for the player 5 to satisfy the achievement condition of the game may decrease as the number of viewers increases and increase as the number of viewers decreases.

(11) In the above embodiment, the fighting ability of the avatar object 6 or the enemy object 23 is defined based on the physical strength at the start of battle in the current stage, and the physical strength is increased or decreased according to the number of viewers. However, instead of or in addition to increasing or decreasing the physical strength, the amount of decrease in the physical strength due to damage may be increased or decreased according to the number of viewers.

(12) In the above embodiment, the enemy object 23 is a non-player object that operates according to the game program and cannot be directly operated by the player 5. However, the enemy object 23 may be a player object that can be directly operated by another player 5. In this case, a certain enemy object 23 may be a player object on a certain stage and a non-player object on another stage, and the properties of the enemy object 23 may be different for each stage. Further, the enemy object 23 may be a player object that a certain user can operate using a user terminal.

(13) In the above embodiment, the amount of adjustment in the plus direction of the points given to the avatar object 6 increases as the number of viewers increases. However, as the number of viewers decreases, the adjustment amount in the plus direction may be increased. In this case, the user 8 is motivated to actively support the unpopular avatar object 6 and have the player 5 remember the user 8.

(14) In the above embodiment, when an item input operation is performed on the user terminal 800, a presentation object 24 such as a predetermined present box that is not related to the item to be input is arranged in the virtual space 11 of the user terminal 800. I am trying. However, when the item input operation is performed, the object of the input item may be displayed at a predetermined position instead of the effect object 24. In this case, when a predetermined time elapses from the item input operation, the effect produced by the effect object 24 ends, and the object based on the operation instruction data distributed from the computer 200 is placed in the virtual space 11.

(15) In the above embodiment, it is assumed that the user terminal 800 displays a game play image of a game in which the avatar object 6 is played against the enemy object 23. However, an avatar object that simply talks may be displayed on the user terminal 800.

(16) In the above-described embodiment, the timing of arranging the object of the item input by the user 8 in the virtual space 11 is the computer in both the user terminal 800 performing the item input operation and the other user terminal 800. It is specified based on the operation instruction data distributed from 200. However, with respect to the user terminal 800 that has performed the item input operation, the arrangement timing can be specified without being based on the operation instruction data. Therefore, the item object may be arranged in the virtual space 11 by executing different processes between the user terminal 800 that performed the item input operation and the other user terminal 800. Specifically, the user terminal 800 that has performed the item input operation performs the process of arranging the item object after a predetermined time has passed from the item input operation, while the other user terminals 800 are the operations distributed from the computer 200. You may make it perform the process which arrange|positions the said item object based on order data.

(17) In the above embodiment, a plurality of stages are prepared, and the difficulty level of the game is adjusted according to the number of viewers when each stage is started. However, the number of viewers may be grasped in real time (or every fixed time (1 minute)), and the difficulty level may be adjusted even during the stage.

(18) In the above-described embodiment, it is assumed that the operation of the user 8 (item insertion operation or the like) is provided to support the establishment of the achievement condition in the game progressed by the avatar object 6. However, the operation of the user 8 may have an obstructive effect that obstructs the achievement of the achievement condition in the game progressed by the avatar object 6 (makes the player 5 disadvantageous). Specifically, by the operation of the user 8, the first aid box is provided to the enemy object 23 in the above-described embodiment to restore the game parameter relating to the physical strength of the enemy object 23, or the ax or the hoe that the enemy object 23 can use. Is introduced into the virtual space 11 to increase the game parameter relating to the attack power of the enemy object 23, thereby hindering the progress of the game by the avatar object 6 (that is, making the progress of the game disadvantageous to the player 5). Good.

(19) In the above embodiment, the number of viewers is classified in units of 100, and the greater the number of viewers in the range of 200 or less, the larger the degree of difficulty increase. However, the increase in the degree of difficulty does not necessarily have to correspond to the increase in the number of viewers. That is, the amount of increase in difficulty when the number of viewers is 1 or more and less than 100 may be made larger than the amount of increase in difficulty when the number of viewers is 101 or more and less than 200. Further, the difficulty level is not limited to adjustment in units of 100 viewers, and may be adjusted in units of 1 viewer. Further, as the number of viewers increases, a larger unit (0 to 10 people, 11 people-50 people, 51 people-150 people, 151 people-300 people, etc.) may be adjusted.

(20) In the above embodiment, a battle game in which the avatar object 6 competes with the enemy object 23 is assumed, and the difficulty level is defined based on the combat ability and appearance amount of the enemy object 23 and the battle ability of the avatar object 6. In addition, in order to support the avatar object 6, items such as a magazine, a first aid box, and obstacles are provided as items that the user 8 can insert.

However, assuming that a puzzle game in which the arrangement of blocks is rearranged in the avatar object 6 is assumed as the main game, the difficulty level is based on the number of blocks, the size of blocks, the type of blocks, and the like required to satisfy the achievement condition. As an item that the user 8 can insert, a hammer or a bomb for destroying obstructive objects (unnecessary blocks, walls, figurines) may be provided.

Also, assuming an escape game in which the avatar object 6 escapes from a closed room as the main game, the degree of difficulty is the escape support item that suggests the variety of indoor arrangements, the position of the key to escape, and the location of the key. It may be defined based on the number of items, etc., and any of the escape support items may be provided as an item that the user 8 can insert. In this case, the degree of the support effect is defined based on the number of escape support items that can be input.

(21) In the above embodiment, the example in which the effect object 24 is arranged so that the effect image is displayed at a position that does not overlap the avatar object 6 and that does not impair the visibility of the avatar object 6 has been described. .. However, the effect object 24 may be arranged so as to be displayed at a position partially overlapping the avatar object 6, or may be a transparent object (for example, a semitransparent object).

(22) In the above embodiment, the effect image is displayed by disposing the effect object 24 in the virtual space 11. However, instead of arranging the effect object 24 in the virtual space 11, the effect image may be displayed on the touch screen 870 by superimposing the effect image on the view field image 1400.

(23) In the above embodiment, the item input information includes information for specifying the item input range. However, instead of the information for specifying the item input range, information for specifying the viewpoint of the virtual camera 20 may be included in the item input information.

(24) In the above embodiment, when arranging an item object in the virtual space 11 shown in FIG. 8, the computer 200 can specify the arrangement and the arrangement timing at a stage before the item object is arranged. You may make it generate|occur|produce the operation|movement instruction|indication data for performing, and deliver it to the user terminal 800. In this case, the action instruction data includes, in addition to the information for identifying the placement/action of the item object, information for identifying the timing for placing the love item object. Also, the user terminal 800 arranges the object in the virtual space 11 shown in FIG. 14 at the timing.

(25) In the above embodiment, the computer 200 distributes the operation instruction data to the plurality of user terminals 800 every predetermined time. However, the motion instruction data may be distributed when the object changes in the virtual space 11 shown in FIG.

(26) In the above embodiment, when granting support points to the avatar object 6, the amount of points included in the item input information is corrected based on the point adjustment amount specified in step S23. .. However, the point adjustment amount specified in step S23 is included in the game information and distributed to the user terminal 800 so that the point adjustment amount (or the adjusted point) is displayed on the visual field image 1400 in accordance with the item. You may In this case, the user can grasp how much the points given to the avatar object 6 are adjusted (or the adjusted points) before the item input operation.

(27) In the embodiment described above, when the game difficulty level is adjusted by the computer 200, the difficulty level is included in the game information, distributed to the user terminal 800, and displayed on the visual field image 1400 in a superimposed manner or displayed by the user. The type and number of items that 8 can throw may be made different according to the difficulty level.

(28) In the above embodiment, a plurality of stages are prepared for the game, and the difficulty level is adjusted according to the number of viewers at the start of each stage. However, one stage may be prepared for the game, and the difficulty level may be adjusted according to the number of viewers at the start of the stage. Further, regardless of the number of stages, the difficulty level may be adjusted according to the number of viewers at a predetermined timing in the progress of the game.

<Appendix>
The matters described in each of the above embodiments will be additionally described below.

(Appendix 1):
According to an aspect of an embodiment shown in the present disclosure, data for enabling display of a game play image of a game, which includes a processor and a memory and is cleared by satisfying a predetermined condition, on the viewing terminal (800). A distribution program executed by a distribution computer (200), wherein the distribution program specifies, in the processor, the number of views of a viewing terminal displaying the game play video (S22), and the viewing. According to the number, the step (S24) of adjusting the difficulty level for satisfying the predetermined condition is executed.

(Appendix 2):
In (Supplementary Note 1), the distribution program causes the processor to support the establishment of the predetermined condition in response to receipt of operation information transmitted from the viewing terminal based on a predetermined operation by a viewer. The step of exerting (S30) is executed.

(Appendix 3):
In (Supplementary Note 2), the predetermined operation is an operation involving consumption of virtual currency associated with the viewer.

(Appendix 4):
In (Supplementary Note 2) or (Supplementary Note 3), the distribution program causes the processor to execute a step (S24) of changing the magnitude of the support effect in accordance with the number of views.

(Appendix 5):
In (Supplementary Note 4), in the changing step, when the number of viewings is a first number, the supporting action is smaller than when the number of viewings is a second number smaller than the first number.

(Appendix 6):
In any one of (Supplementary note 2) to (Supplementary note 5), the game is a game that causes an item associated with points to appear by receiving the operation information, and the step of exerting depends on the item. The distribution program exerts a supporting action, and the distribution program provides the processor with points associated with the item to the distributor (S26), and when the points allocated to the distributor reach a predetermined value, The step (S33) of improving the possibility that the predetermined condition is satisfied is executed.

(Appendix 7):
In (Supplementary Note 6), the distribution program causes the processor to execute a step of changing the predetermined value according to the number of views.

(Appendix 8):
In (Supplementary Note 6) to (Supplementary Note 7), the distribution program causes the processor to execute a step (S23) of changing the amount of points given to the distributor according to the number of views.

(Appendix 9):
In any one of (Supplementary note 6) to (Supplementary note 8), the predetermined operation is an operation involving consumption of virtual currency associated with the viewer, and the amount of points associated with the item is It is set according to the consumption of virtual currency required for appearance.

(Appendix 10):
In any one of (Supplementary Note 1) to (Supplementary Note 9), the adjusting step adjusts the difficulty level according to the number of views when the game is started.

(Appendix 11):
In (Supplementary Note 10), the game includes a plurality of stages, each of which is associated with a predetermined condition, and the adjusting step is performed according to the number of views when each of the plurality of stages is started. Adjust the degree of difficulty for satisfying a predetermined condition associated with the stage.

(Appendix 12):
In any one of (Supplementary Note 1) to (Supplementary Note 11), the data includes at least motion data indicating a movement of a distributor, and in the game, a player object that operates based on the motion data fights another object. In the game, the adjusting step changes the difficulty by changing at least one of the ability of the player object, the ability of the other object, and the appearance amount of the other object according to the number of views. Adjust the degree.

(Appendix 13)
In any one of (Supplementary Note 1) to (Supplementary Note 12), the distribution program causes the processor to control the progress of the game in a mode according to the degree of difficulty adjusted by the adjusting step (S34). A step of generating object information for specifying the type and position of the game object arranged according to the progress of the game (S35), and specifying a game parameter updated according to the progress of the game. The step of generating parameter information (S35) is further executed, and the data includes at least the object information and the parameter information.

(Appendix 14):
In (Supplementary Note 1), the distribution program exerts an inhibitory effect on the processor that inhibits the establishment of the predetermined condition when receiving operation information transmitted from the viewing terminal in response to a predetermined operation by a viewer. The step and the step of changing the magnitude of the inhibition effect according to the number of views are executed.

(Appendix 15):
In (Supplementary Note 14), the data includes at least motion data indicating a movement of a distributor, the game is a game in which a player object that operates based on the motion data battles another object, and the step of exerting is , Update game parameters so that the player object is at a disadvantage.

(Appendix 16):
According to an aspect of an embodiment shown in the present disclosure, data for enabling display of a game play image of a game, which includes a processor and a memory and is cleared by satisfying a predetermined condition, on the viewing terminal (800). A distribution method executed by a distribution computer (200), which comprises the step of the computer identifying the number of views of a viewing terminal displaying the game play video (S22), A step (S24) of adjusting the difficulty level for satisfying the predetermined condition according to the number.

(Appendix 17):
According to an aspect of an embodiment shown in the present disclosure, a computer (200) that distributes data for enabling display of a game play video of a game that is cleared by satisfying a predetermined condition on a viewing terminal (800). A storage unit (2200) for storing a distribution program and a control unit (2100) for controlling the operation of the computer by executing the distribution program, wherein the control unit is the game play video. The step of specifying the number of views of the viewing terminal displaying (S22) and the step of adjusting the degree of difficulty for satisfying the predetermined condition according to the number of views (S24) are executed.

(Appendix 18):
According to an aspect of one embodiment shown in the present disclosure, a viewing program executed by a viewing terminal (800) including a processor, a memory, and a display unit, the viewing program causing the processor to clear a game. A step of transmitting information for allowing the number of views to be specified to a computer that adjusts the degree of difficulty for satisfying a predetermined condition for making the number of views of a viewing terminal displaying a game play video of the game. (S02, S15), receiving from the computer data for enabling display of the game play video of the game with the adjusted difficulty level on the viewing terminal (S05), and based on the data , Displaying the game play image of the game with the adjusted difficulty level (S06 to S08).

[Example of software implementation]
Each control block of the control units 2100, 6100, and 8100 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or by software using a CPU (Central Processing Unit). May be realized.

In the latter case, the information processing apparatus including at least one of the control units 2100, 6100, and 8100 has a CPU that executes instructions of a program that is software that realizes each function, and the program and various data are a computer (or CPU). A ROM (Read Only Memory) or a storage device (these are referred to as a "recording medium") recorded so as to be readable by a RAM, a RAM (Random Access Memory) for expanding the program, and the like. Then, the computer (or CPU) reads the program from the recording medium and executes the program to achieve the object of the present invention. As the recording medium, a "non-transitory tangible medium", for example, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. Note that one aspect of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, but various modifications can be made within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in the different embodiments Is also included in the technical scope of the present invention.

The embodiments disclosed this time are to be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description but by the claims, and is intended to include meanings equivalent to the claims and all modifications within the scope.

2 network, 5 player, 6 avatar object, 8 user, 11 virtual space, 12 center, 13 panoramic image, 14,20 virtual camera, 15,21 view area, 16 reference line of sight, 17,1400 view image, 18,19 area , 100 HMD system, 110 HMD set, 120 HMD, 130 monitor, 140 gaze sensor, 150 first camera, 160 second camera, 170 microphone, 180 speaker, 190 sensor, 200 computer, 210, 610, 810 processor, 220, 620,820 memory, 230,630,830 storage, 240,640,840 input/output interface, 250,650,850 communication interface, 260,660 bus, 300 controller, 300R right controller, 300L left controller, 310 grip, 320 frame , 330 top surface, 340, 350, 370, 380 button, 360 infrared LED, 390 analog stick, 410 HMD sensor, 420 motion sensor, 430 display, 510 control module, 520 rendering module, 530 memory module, 540 communication control module, 600 server, 700 external device, 1421, 8121 virtual object generation module, 1422, 8122 virtual camera control module, 1423 operation object control module, 1424, 8124 avatar object control module, 1425 motion detection module, 1426 collision detection module, 1427, 8127 Virtual object control module, 800 user terminal, 860 camera, 870 touch screen, 880 distance measuring sensor, 2100, 6100, 8100 control unit, 2200, 6200, 8200 storage unit 2101, 8101 operation reception unit, 2102, 8102 display control unit, 2103, 8103 UI control section, 2104, 8104 animation generation section, 2105, 8105 game progress section, 2106, 8106 virtual space control section, 2107 reaction processing section, 8107 progress information generation section, 6101 progress support section, 6102 sharing support section, 231, 631, 831 game program, 132 game information, 133 user information, 1020 controller, 1030 storage medium

Claims (13)

A distribution program executed by a computer including a processor and a memory, which distributes data for enabling display of a game play image of a game that is cleared by satisfying a predetermined condition,
The distribution program causes the processor to
Identifying the number of views of the viewing terminal displaying the game play video,
In response to receiving operation information transmitted from the viewing terminal based on a predetermined operation by a viewer, exerting a support action for supporting the establishment of the predetermined condition;
A distribution program that executes a step of changing the number of views so that the support effect is smaller than when the number of views is a first number and a second number that is smaller than the first number . The distribution program according to claim 1 , wherein the predetermined operation is an operation involving consumption of virtual currency associated with the viewer. The game is a game that causes an item associated with points to appear by receiving the operation information.
The step of exerting exerts a supporting action according to the item,
The distribution program causes the processor to
Awarding points to the distributor associated with the item;
The delivery program according to claim 1 or 2 , wherein when the number of points given to the distributor reaches a predetermined value, a step of exerting an improving action of improving the possibility that the predetermined condition is satisfied is executed. The distribution program causes the processor to
The distribution program according to claim 3 , wherein a step of changing the predetermined value is executed according to the number of views. The distribution program causes the processor to
The distribution program according to claim 3 or 4 , wherein a step of changing the amount of points given to the distributor according to the number of views is executed. The predetermined operation is an operation involving consumption of virtual currency associated with the viewer,
The distribution program according to any one of claims 3 to 5 , wherein the amount of points associated with the item is set according to the consumption amount of virtual currency required for the appearance of the item. The distribution program causes the processor to
Executing a step of adjusting the difficulty level for satisfying the predetermined condition according to the number of views,
The distribution program according to any one of claims 1 to 6 , wherein the adjusting step adjusts the difficulty level according to the number of views when the game is started. The game includes a plurality of stages, each of which is associated with a predetermined condition,
The distribution program according to claim 7 , wherein the adjusting step adjusts a difficulty level for satisfying a predetermined condition associated with the stage according to the number of views when each of the plurality of stages is started. .. The data includes at least motion data indicating a movement of a distributor,
The game is a game in which a player object that operates based on the motion data fights another object,
The distribution program causes the processor to
Executing a step of adjusting the difficulty level for satisfying the predetermined condition according to the number of views,
In the adjusting step, the difficulty level is adjusted by changing at least one of the ability of the player object, the ability of the other object, and the appearance amount of the other object according to the number of views. The distribution program according to any one of claims 1 to 8 . The distribution program causes the processor to
Adjusting the degree of difficulty for satisfying the predetermined condition according to the number of views,
Controlling the progress of the game in a manner according to the difficulty level adjusted by the adjusting step,
Generating object information for specifying the type and position of the game object arranged according to the progress of the game,
Generating parameter information for specifying game parameters updated according to the progress of the game,
Wherein the data comprises at least said said object information parameter information distribution program according to any one of claims 1 to 9. A distribution method executed by a computer including a processor and a memory, which distributes data for enabling display of a game play image of a game that is cleared by satisfying a predetermined condition,
In the distribution method, the computer
Identifying the number of views of the viewing terminal displaying the game play video,
In response to receiving operation information transmitted from the viewing terminal based on a predetermined operation by a viewer, exerting a support action for supporting the establishment of the predetermined condition;
And a step of changing the number of viewings so that the support effect is smaller than when the number of viewings is a first number and a second number that is smaller than the first number . A computer that distributes data for enabling display of a gameplay image of a game that is cleared by satisfying a predetermined condition on a viewing terminal,
A storage unit for storing the distribution program,
A control unit that controls the operation of the computer by executing the distribution program,
The control unit is
Identifying the number of views of the viewing terminal displaying the game play video,
In response to receiving operation information transmitted from the viewing terminal based on a predetermined operation by a viewer, exerting a support action for supporting the establishment of the predetermined condition;
A computer, when the number of viewings is a first number, changing so that the support effect is smaller than when the number of viewings is a second number smaller than the first number . A viewing program executed by a viewing terminal including a processor, a memory, and a display unit,
The viewing program causes the processor to
A computer on the basis of a predetermined operation by the viewer support action to support the establishment of a predetermined condition for clearing the game, according to the number of viewing of the viewing terminal that displays the game play image of the game, the viewing When the number is the first number, information for enabling the computer to change the assisting action to be smaller than when the second number is smaller than the first number is specified so that the number of views can be specified. The step of sending,
From the computer, receiving data for a game play image of the game the assistance effects were found varied displayable in the viewing terminal,
The data on the basis, and a step of displaying a game play image of the game the assistance effects were found varied, viewing program.