JP7323751B2 - game system and program - Google Patents

Description

The present invention relates to a game system, a program, and the like.

2. Description of the Related Art A game system is known in which posted content such as game videos can be posted to a posting site. As a conventional technique of such a game system, for example, the technique disclosed in Patent Document 1 is known. In the game system of Patent Literature 1, when posting content is shared by other players on the network, the content is processed to add a copyright notice or the like. Also, in recent years, a technique called photogrammetry that generates a three-dimensional model from a photographed image has been attracting attention. In photogrammetry, analysis processing is performed based on two-dimensional photographed images obtained by photographing an object, which is an object in the real world, from a plurality of photographing directions, and the shape, dimensions, etc. of the object are obtained. Then, a three-dimensional model that can be arranged in a virtual space is generated based on the determined shape, dimensions, and the like. Photogrammetry is also called 3D scanning. As a conventional technique of 3D scanning, there is a technique disclosed in Patent Document 2, for example.

JP 2015-58072 A Japanese Patent Application Laid-Open No. 2017-130008

In a game system that allows posting of posted content, only the posted content posted by the player can be viewed by the user on the posting site. Therefore, although the player can check the impression information such as the number of users' support and the number of views of the posted content, such impression information is not reflected in the game played by the player.

According to the present disclosure, it is possible to provide a game system, a program, and the like capable of reflecting impression information on posted content in a game played by a player.

According to one aspect of the present invention, a posting processing unit performs processing for posting posted content, which is an image or video posted by a player, to a posting site; a parameter setting unit that acquires information and sets game parameters based on the acquired impression information; and a game processing unit that performs game processing of a game. The present invention also relates to a program that causes a computer to function as the above units, or a computer-readable information storage medium that stores the program.

In one aspect of the present invention, a process of posting posted content, which is a player's posted image or posted video, to a posting site is performed, and impression information of the posted content by a user viewing the posted content is acquired. Then, game parameters are set based on the acquired impression information, and game processing of the game played by the player who posted the posted content is performed based on the set game parameters. Thus, according to one aspect of the present invention, when player's posted content is posted to a posting site, impression information for the posted content is obtained and fed back to the game played by the player. Therefore, it is possible to provide a game system or the like that can reflect impression information on posted content in a game played by a player.

In one aspect of the present invention, the game processing unit performs the game processing of the game in which a character related to the posted content appears, and the parameter setting unit performs the game processing for the character based on the impression information. The game parameters may be set.

In this way, in a game in which a character related to posted content appears, game processing can be executed by setting the game parameters of the character based on the impression information on the posting site for the posted content. .

Further, in one aspect of the present invention, the parameter setting unit sets a basic parameter value of the game parameter based on an analysis result of an object appearing in the posted content, and sets the game parameter set to the basic parameter value. may be varied based on the impression information.

In this way, the basic parameter values of the game parameters can be set based on the analysis result of the target object, and the values of the game parameters can be changed from the basic parameter values according to the impression information. Therefore, it is possible to set game parameters that reflect both the analysis result of the object and the impression information.

Further, in one aspect of the present invention, the parameter setting unit performs analysis processing of the object based on a photographed image of the object photographed by the photographing unit, and based on the analysis result of the analysis processing, the Base parameter values may be set.

By doing so, it is possible to specify the type of the object and set the basic parameter values of the game parameters by the analysis processing based on the photographed image of the object.

In one aspect of the present invention, the impression information is information on the number of times the posted content is supported, information on the number of views, information on the viewing time, or information on the number of times the posted content is transmitted to other users. good too.

By using such impression information, it is possible to reflect the number of support, the number of views, the viewing time, or the number of transmissions of the posted content in the game played by the player.

Further, in one aspect of the present invention, the parameter setting unit determines that the user who has given the impression information to the posted content by viewing the posted content on the posting site is a player having a predetermined relationship with the player. The impression information used for setting the game parameter may be changed according to whether or not there is.

In this way, impression information viewed by a player having a predetermined relationship has a different degree of change in impression information than impression information viewed by other players, and game parameters can be set according to impression information. can be made different.

In one aspect of the present invention, the parameter setting unit sets the player's personal information based on the player's posted information, and uses the set personal information to set the game parameter. Impression information may vary.

By doing so, it is possible to change the impression information according to the personal information set based on the player's posted information, and to change the game parameters set based on the impression information.

Further, in one aspect of the present invention, the posted information may be information on the number of posted contents by the player, the number of times of posting, or the accumulated time of posting time.

In this way, the impression information is changed according to the player's personal information set based on the number of posted contents of the player, the number of times of posting, or the cumulative time of posting, and the game parameters set based on the impression information are changed. It becomes possible to let

Further, in one aspect of the present invention, the game processing unit performs processing for allowing the player to acquire game points according to the result of the game played by the player, and the post processing unit performs the post processing by the player. A process of consuming the game points of the player may be performed when the content is posted.

In this way, the player aims to earn game points by playing the game in order to post the posted content to the posting site, and the player's degree of immersion and enthusiasm for the game can be improved. .

In one aspect of the present invention, the post processing unit performs a process of associating the posted content posted by the player with a game ID of the game played by the player, and the parameter setting unit performs The impression information of the posted content associated with the ID may be obtained, and the game parameters of the game corresponding to the game ID may be set based on the obtained impression information.

In this way, it is possible to specify, based on the game ID, which game the posted content or the impression information given to the posted content posted by the player corresponds to. Therefore, it is possible to set game parameters based on the impression information of the posted content by simple processing using the game ID.

In one aspect of the present invention, a storage unit that stores a group of captured images obtained by capturing images of an object from a plurality of capturing directions by a capturing unit; a movement processing unit that performs processing to move a primitive in a virtual space; A texture generation unit that generates a texture to be mapped onto the primitive based on the group of captured images, and an image generation unit that maps the texture onto the primitive and generates a virtual space image viewed from a virtual camera in the virtual space. and may include

According to one aspect of the present invention, a group of photographed images is acquired by photographing an object from a plurality of photographing directions, and textures generated based on the group of photographed images are mapped to primitives and correspond to the object. It becomes possible to generate a virtual space image including an image of a display object that is displayed. As a result, it is possible to provide an image generation system or the like that can cause a display object corresponding to an object to appear in a virtual space while faithfully expressing the shape of the object.

Further, in one aspect of the present invention, the movement processing unit performs a process of moving the primitive in the virtual space based on movement control information, and the texture generation unit performs a process of moving the primitive according to the movement control information of the primitive. The texture to be mapped to the primitive is generated based on the captured image selected from the captured image group, and the image generation unit maps the texture, which changes according to the movement control information, to the primitive. , the virtual space image may be generated.

In this way, a virtual space image including an image of a displayed object corresponding to the target object can be generated by mapping the image of the texture that changes according to the movement control state of the primitive to the primitive.

1 is a block diagram showing a configuration example of a game system according to this embodiment; FIG. Explanatory drawing of the server system and terminal device which implement|achieve a game system. 3(A) and 3(B) are explanatory diagrams of a technique for making a character corresponding to an object appear in a game based on a photographed image of the object. An example of a posting screen on a posting site. Another example of the posting screen of the posting site. 4 is a flowchart for explaining processing of the embodiment; 5 is a flowchart for explaining processing for setting basic parameter values based on the analysis result of the object; FIG. 4 is an explanatory diagram of processing for setting basic parameter values based on the analysis result of the object; 10 is a flowchart for explaining processing for changing impression information of players having a predetermined relationship; FIG. 4 is an explanatory diagram of processing for changing impression information of players having a predetermined relationship; 9 is a flowchart for explaining processing for setting player's personal information and changing impression information based on player's posted information. FIG. 10 is an explanatory diagram of processing for setting player's personal information based on the player's posted information and changing impression information; FIG. 11 is an explanatory diagram of a method of accepting submission of posted content on the condition that game points earned in a game are consumed; FIG. 11 is an explanatory diagram of a method of setting game parameters by associating posted content and impression information with game IDs; 15(A) and 15(B) are explanatory diagrams of a method of obtaining photographed images obtained by photographing an object from a plurality of photographing directions. 16(A) and 16(B) are explanatory diagrams of a method of generating a texture from a photographed image. Explanatory drawing about the relationship between a primitive and a virtual camera. FIG. 4 is an explanatory diagram of a texture mapping technique that changes according to movement control information; Explanatory drawing of the generation method of an effect image. 5 is a flowchart of processing for generating a virtual space image based on a captured image group; FIG. 4 is an explanatory diagram of a method of photographing an object in a 360-degree photographing direction range; FIG. 4 is an explanatory diagram of a method of selecting a photographed image according to movement control information from a photographed image group; 23A to 23C are explanatory diagrams of a method of moving a primitive and a virtual camera with their positional relationship fixed. 4 is a flow chart of processing to make pixels of a color corresponding to the background color transparent. 25A to 25C are explanatory diagrams of a method of generating an effect image using primitives for effect images. FIG. 4 is an explanatory diagram of a method for setting initial placement positions of primitives for effect images; FIG. 4 is an explanatory diagram of post-effect processing for a virtual space image; FIG. 4 is an explanatory diagram of a method of generating an image of another display object corresponding to another object; Explanatory diagram of a method of arranging particles around a primitive. A configuration example of a game system provided with an imaging section, an arrangement section, and a rotation movement mechanism.

The present embodiment will be described below. It should be noted that the embodiments described below do not unduly limit the content of the claims. Moreover, not all the configurations described in this embodiment are essential configuration requirements.

1. 1. Game System FIG. 1 is a block diagram showing a configuration example of a game system (game device, terminal device, image generation system, server system) according to the present embodiment. The game system of this embodiment is not limited to the configuration of FIG. 1, and various modifications such as omitting some of its components or adding other components are possible.

The operation unit 160 is used by a player (user) to input various operational input information (input information). The operation unit 160 can be implemented by, for example, operation buttons, direction keys, joysticks, levers, touch panel type displays, or the like.

The photographing unit 162 is for photographing an object, and is realized by an image sensor such as a CCD or CMOS sensor and an optical system including a focus lens and the like. As the imaging unit 162, a camera such as a digital camera or a video camera can be used, for example. A physical object is, for example, an object in the real world, and is a subject of the imaging unit 162 .

The storage unit 170 stores various information. The storage unit 170 functions as a work area for the processing unit 100, the communication unit 196, and the like. Programs and data necessary for executing the programs are held in this storage unit 170 . The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), HDD (hard disk drive), SSD (Solid State Drive), optical disk device, or the like. The storage unit 170 includes an impression information storage unit 172 , a parameter storage unit 174 , a captured image information storage unit 176 , a virtual space information storage unit 177 and a drawing buffer 178 . The impression information storage unit 172 stores impression information that is given to posted content through viewing by a posting site user. The parameter storage unit 174 stores information on various parameters such as game parameters. The captured image information storage unit 176 stores information of the captured image captured by the imaging unit 162 . For example, it stores information about a group of captured images. The virtual space information storage unit 177 stores information about virtual space, which is a three-dimensional object space. For example, it stores information about objects placed in the virtual space. The drawing buffer 178 is a buffer that can store image information in units of pixels, such as a frame buffer and a work buffer.

The information storage medium 180 is a computer-readable medium and stores programs, data, and the like. The information storage medium 180 can be realized by an optical disk (DVD, BD, CD), HDD, semiconductor memory (ROM), or the like. The processing unit 100 performs various processes of this embodiment based on programs (data) stored in the information storage medium 180 . That is, in the information storage medium 180, a program (a program for causing the computer to execute the processing of each unit) for functioning a computer (a device having an input device, a processing unit, a storage unit, and an output unit) as each unit of the present embodiment is stored. is stored.

The display unit 190 outputs an image generated according to this embodiment, and its function can be realized by an LCD, an organic EL display, a CRT, a touch panel display, an HMD (Head Mounted Display), or the like. The sound output unit 192 outputs the sound generated according to this embodiment, and its function can be realized by a speaker, headphones, or the like.

An I/F (interface) unit 194 performs interface processing with the portable information storage medium 195, and its function can be realized by an ASIC for I/F processing. The portable information storage medium 195 is used by the player to store various types of information, and is a storage device that retains the storage of this information even when the power is not supplied. The portable information storage medium 195 can be implemented by an IC card (memory card), USB memory, magnetic card, or the like.

The communication unit 196 communicates with the outside (another device) via a wired or wireless network, and its function is implemented by hardware such as a communication ASIC or a communication processor, and communication firmware. It can be realized by

Note that programs (data) for causing a computer to function as each part of the present embodiment are delivered from an information storage medium of a server (host device) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. You may The use of information storage media by such servers can also be included within the scope of this embodiment.

The processing unit 100 (processor) performs post processing, parameter setting processing, game processing, editing processing, acquisition processing, analysis processing, movement processing, texture generation processing, image It performs generation processing, sound generation processing, or the like.

Each process of this embodiment performed by each part of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of this embodiment can be implemented by a processor that operates based on information such as a program and a memory that stores information such as the program. In the processor, for example, the function of each section may be implemented by separate hardware, or the function of each section may be implemented by integrated hardware. For example, a processor includes hardware, which may include circuitry for processing digital signals and/or circuitry for processing analog signals. For example, the processor can be configured with one or more circuit devices (such as ICs) or one or more circuit elements (such as resistors and capacitors) mounted on a circuit board. The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as GPU (Graphics Processing Unit) or DSP (Digital Signal Processor) can be used. Alternatively, the processor may be a hardware circuit based on ASIC. The processor may also include amplifier circuits, filter circuits, and the like that process analog signals. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD) or an optical storage device such as an optical disk device. For example, the memory stores instructions readable by a computer, and the instructions are executed by the processor to implement the processing of each part of the processing unit 100 . The instruction here may be an instruction set that constitutes a program, or may be an instruction that instructs a hardware circuit of a processor to operate.

The processing unit 100 includes a post processing unit 102, a parameter setting unit 104, a game processing unit 106, an editing processing unit 108, an acquisition unit 110, an analysis unit 111, a movement processing unit 112, a texture generation unit 114, an image generation unit 120, and a sound generation unit. A portion 130 is included. As described above, each process of this embodiment executed by these units can be realized by a processor (or processor and memory). It should be noted that various modifications such as omitting some of these constituent elements (each section) or adding other constituent elements are possible.

The posting processing unit 102 performs processing regarding posting of posted content. A parameter setting unit 104 sets various parameters such as game parameters. Details of the post processing unit 102 and the parameter setting unit 104 will be described later.

The game processing unit 106 performs various game processes for the player to play the game. Game processing includes, for example, processing for starting a game when a game start condition is satisfied, processing for progressing a started game, processing for ending a game when a game end condition is satisfied, or calculating a game result. processing, etc.

The edit processing unit 108 performs edit processing for the player to edit the shot image. The acquisition unit 110 performs acquisition processing of the captured image captured by the imaging unit 162 . For example, it performs a process of receiving or reading information of a captured image from the imaging unit 162 . The analysis unit 111 performs analysis processing on the object. For example, analysis processing such as silhouette analysis of the object is performed based on the photographed image of the object.

The movement processing unit 112 performs processing for moving objects such as primitives in the virtual space. For example, in the present embodiment, processing for setting a virtual space (object space) in which a plurality of objects are arranged is performed. For example, moving objects (people, robots, cars, trains, airplanes, ships, monsters or animals, etc.), maps (terrain), buildings, spectator seats, courses (roads), trees, walls, water surfaces, etc. A process of arranging and setting objects (objects composed of primitives such as polygons, free-form surfaces, subdivision surfaces, etc.) in the virtual space is performed. That is, the position and rotation angle (synonymous with orientation and direction) of the object in the world coordinate system are determined, and at that position (X, Y, Z) at that rotation angle (rotation angle around the X, Y, Z axes) the object is placed. Specifically, in the virtual space information storage unit 177 of the storage unit 170, object information such as the position, rotation angle, movement speed, movement direction, etc. of an object in the virtual space is stored as virtual space information. are stored in association with A process of updating the object information, which is the virtual space information, for each frame, for example, is performed. Then, the movement processing unit 112 performs processing for moving objects such as primitives in the virtual space thus set. For example, a process of updating information of objects such as primitives is performed. It also performs motion processing for moving objects.

The texture generation unit 114 performs processing for generating textures to be mapped onto primitives. For example, processing for generating a texture is performed based on the captured image acquired by the acquisition unit 110 .

The image generator 120 performs image generation processing. For example, drawing processing is performed based on the results of various processes performed by the processing unit 100 to generate an image and display it on the display unit 190 . Specifically, geometry processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. coordinates, texture coordinates, color data, normal vectors or alpha values, etc.) are created. Based on this drawing data (primitive surface data), an object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is drawn in the drawing buffer 178 . As a result, a virtual space image viewed from the virtual camera in the virtual space is generated. Note that the drawing processing performed by the image generation unit 120 can be realized by vertex shader processing, pixel shader processing, or the like.

The sound generation unit 130 performs sound generation processing based on the results of various processes performed by the processing unit 100 . Specifically, it generates music (music, BGM), sound effects, voice, or the like, and causes the sound output unit 192 to output it.

The game system of this embodiment includes a post processing unit 102, a parameter setting unit 104, and a game processing unit 106, as shown in FIG.

The posting processing unit 102 performs processing for posting posted content to a posting site. Posted content is, for example, a player's posted image or posted video. Posted content is, for example, captured content by a player. A posted image or posted video is, for example, an image or video of an object shot by the player using the shooting unit 162 . The object is, for example, a real-world object owned by the player, such as a plastic model, a figure, or a doll. The object is a real-world object corresponding to a display object such as a character appearing in a game played by the player. The posted image or posted video may be a game image or game video. A game image or a game video is an image or video that captures a state of a game played by a player. For example, the game animation is called a player's gameplay animation or a game commentary animation. The posting processing unit 102 performs a process of uploading posted content, which is a player's posted image or posted video, to a network as a process of posting posted content to a posting site. The posted content to be uploaded is associated with, for example, the ID of the game played by the player or the ID of the user. A posting site is a site on a network to which posted content such as a posted image or a posted video can be uploaded, and is called an image posting site or a video posting site. A posting site is, for example, a site where an unspecified number of users can post posted content. The posting site may be operated by the maker of the game played by the player. Alternatively, a posting site, such as a video sharing service or image sharing service, allows an unspecified number of users to share and view posted videos or posted images posted by an unspecified number of users on a server on the Internet. It may be a posting site by a service that provides

The parameter setting unit 104 acquires impression information (browsing index information) of the posted content by users of the posting site who viewed the posted content. The acquired impression information is stored in the impression information storage unit 172 . For example, the parameter setting unit 104 acquires, from the posting site, impression information given to the posted content by the user of the posting site viewing the posted content on the posting site. Then, the game parameters are set based on the acquired impression information. The set game parameters are stored in the parameter storage section 174 . The impression information (impression parameter) is, for example, information (parameter) given to the posted content as a result of browsing of the posted content by the user on the posting site. For example, the impression information is index information related to viewing of posted content, such as viewing count information, viewing time information, viewing evaluation information, or transmission count information of posted content. The impression information given to the posted content is associated with the posted content and stored, for example, in the database of the posting site. The impression information represents the evaluation value of the impression of the posted content, and the evaluation value of the impression of the posted content becomes higher, for example, as the number of user views on the posting site increases. Alternatively, the evaluation value of the impression becomes higher as the number of users who give high evaluations to the posted content and support it increases. Alternatively, the evaluation value of the impression becomes higher as the viewing time of the posted content by the user becomes longer. Alternatively, the evaluation value of the impression becomes higher as the number of times that the user of the posting site communicates the posted content to other users increases. For example, the higher the number of times a user who browses posted content communicates the posted content to other users by retweeting or the like, the higher the evaluation value of the impression.

The parameter setting unit 104 sets game parameters used for game processing based on such impression information. For example, the game parameters are set based on the impression evaluation value for the posted content. For example, the game parameters are set such that the higher the impression evaluation value, the more advantageous the player. For example, the parameter setting unit 104 sets game parameters of a display object such as a character corresponding to an object appearing in a posted image or posted video that is posted content. For example, when the posted image or posted video is a captured image or captured video of an object in the real world, the parameter setting unit 104 sets game parameters for a display object such as a character corresponding to the object. . Further, when the posted image or posted video is a game image or game video that captures the state of the game played by the player, the parameter setting unit 104 displays characters or the like that are objects appearing in the game image or game video. Set game parameters for things. For example, the parameter setting unit 104 sets game parameters such as attack power, defense power, endurance, movement ability, running ability, special ability, hit points, magic points, or level of displayed objects such as characters. For example, the game parameters are set such that the higher the impression evaluation value, the higher the attack power, defense power, movement ability, running ability, special ability, hit points, magic points, level, or the like.

Then, the game processing unit 106 performs game processing of the game played by the player who posted the posted content, based on the game parameters set based on the impression information. For example, in a game played by a player, a display object such as a character corresponding to an object appearing in a posted image or posted video appears. A parameter setting unit 104 sets game parameters of the displayed object such as the character. Then, the game processing unit 106 performs game processing of a game in which display objects such as characters appear, based on the set game parameters. For example, it performs game start processing, game progress processing, game end processing, or calculation processing of game results. For example, the game processing unit 106 performs game processing based on game parameters such as attack power, defense power, endurance, movement ability, running ability, special ability, hit points, magic points, or level of displayed objects such as characters. . For example, game processing is performed based on these game parameters that are set to advantageous values for higher impression evaluation values.

The game processing unit 106 also performs game processing of a game in which a character related to posted content appears. Then, the parameter setting unit 104 sets game parameters for the character based on the impression information. For example, characters related to posted content appear in a game played by a player. A character related to the posted content is, for example, a character corresponding to an object appearing in a photographed image or a photographed video that is a posted image or a posted video, or a character that appears in a game image or a game video that is a posted image or a posted video. . When the player posts the posted content to the posting site and acquires the impression information of the posted content, game parameters for the character related to the posting site are set based on the acquired impression information. That is, the game parameters of the character corresponding to the object appearing in the photographed image or photographed moving image, which is the posted content, or the character appearing in the game image or the game moving image, which is the posted content, are set. For example, game parameters such as attack power, defense power, movement ability, running ability, special ability, hit points, magic points, or level of the character are set. Then, the game processing of the game in which the character appears is executed based on the set game parameters.

Also, the parameter setting unit 104 sets the basic parameter values of the game parameters based on the analysis result of the object appearing in the posted content. Then, the game parameters set as the basic parameter values are changed based on the impression information. For example, the analysis unit 111 analyzes an object appearing in posted content. For example, silhouette analysis of the object is performed, and the type of the object is specified. Then, the parameter setting unit 104 sets a basic parameter value corresponding to the type of object as the value of the game parameter. For example, basic parameter values are set for the offensive power, defensive power, endurance, movement ability, running ability, special ability, hit points, magic points, level, etc. of displayed objects such as characters. For example, when the object is determined to be of the first type based on the analysis result of the object, the parameter setting unit 104 sets the value of the game parameter to the first basic parameter value, and the object is If it is determined to be of the second type, the value of the game parameter is set to the second basic parameter value. Then, the parameter setting unit 104 changes the value of the game parameter set as the basic parameter value in this way based on the impression information. For example, the game parameters are set such that the higher the impression evaluation value, the higher the game parameter value from the basic parameter value. Specifically, the higher the impression evaluation value, the higher the value of game parameters such as attack power, defense power, endurance, movement ability, running ability, special ability, hit points, magic points, or level. Vary game parameters to increase.

The parameter setting unit 104 also performs analysis processing of the object based on the captured image of the object captured by the imaging unit 162, and sets basic parameter values based on the analysis result of the analysis processing. For example, an object in the real world is captured by the capturing unit 162 . Then, the analysis unit 111 performs silhouette analysis of the target object based on the photographed image, and identifies the type of the target object. Then, the parameter setting unit 104 sets the game parameters to basic parameter values corresponding to the type of the identified object. In this case, the posted content for which the posting processing unit 102 performs the posting process is a photographed image or a photographed moving image obtained by photographing the object by the photographing unit 162 .

Impression information is information on the number of times the posted content has been supported, information on the number of views, information on the viewing time, or information on the number of times the posted content has been transmitted to other users. The information on the number of support for posted content is, for example, information such as the number of times the posted content was given a high evaluation such as “Like” or the number of users who gave the posted content a high evaluation. The information on the number of views is information such as the number of times the posted content has been viewed and the number of users who have viewed the posted content. The browsing time information is information on the browsing time of the user who browsed the posted content and the total browsing time. Information on the number of transmissions of posted content to other users is information on the number of times a user who viewed the posted content transmitted the posted content to other users by retweeting, etc., and the number of users who transmitted the posted content. be. The evaluation value of the impression, which is the impression information, is set to a higher evaluation value as the number of support, the number of views, or the number of transmissions of the posted content increases, or the viewing time increases. preferential).

In addition, the parameter setting unit 104 sets the game parameters according to whether or not the user who gives the impression information to the posted content by browsing the posted content on the posting site is a player having a predetermined relationship with the player. Vary the impression information used. A player having a predetermined relationship with a player is, for example, a player who is treated as having a predetermined relationship in a game. For example, a player having a predetermined relationship with the player is a player's friend player, a player belonging to the same group (same team, etc.) as the player, or the like. When a user who gives impression information to posted contents is a player having a predetermined relationship such as a friend player or a player in the same group, the impression information is made different from a case where the user does not have the predetermined relationship. For example, if the user who gave the impression information is a player with a predetermined relationship, the impression information is changed so that the evaluation value of the impression becomes a high evaluation value. Then, the parameter setting unit 104 sets game parameters based on the changed impression information. For example, basic parameter values of game parameters are set based on impression information that changes depending on whether the player has a predetermined relationship.

Also, the parameter setting unit 104 sets the player's personal information based on the player's posted information. Then, the impression information used for setting the game parameters is changed according to the set personal information. For example, it collects posted information, which is information about posting of posted content by a player. For example, it collects posted information, which is information about posting histories. Then, the parameter setting unit 104 performs setting processing of the player's personal information associated with each player based on the posted information. For example, player parameter setting processing, which is set as the player's personal information, is performed. Then, the parameter setting unit 104 sets game parameters based on the impression information that changes based on the player's personal information.

For example, the posted information is information on the number of pieces of content posted by the player, the number of times of posting, or the accumulated time of posting. For example, the parameter setting unit 104 may set the number of posted contents, which is the number of posted contents that the player has posted so far, the number of times of posting, which is the number of times the posted contents have been posted, or the cumulative time of posting of the posted contents on the posting site. Set the player's personal information based on posted information such as For example, personal information is set to specify whether the player has a large number of posted contents, a large number of postings, or a large number of cumulative posting times. Impression information is changed according to personal information set according to the number of posted contents, the number of times of posting, or the cumulative time of posting. For example, the higher the number of pieces of posted content or the number of times of posting by a player, or the longer the accumulated posting time, the higher the evaluation value of the impression of the player is set. Then, the parameter setting unit 104 sets the game parameters so that the player's game play becomes more advantageous as the number of pieces of posted content or the number of times of posting by the player increases, or as the posted cumulative time increases.

Also, the game processing unit 106 performs processing for allowing the player to obtain game points according to the result of the game played by the player. Then, the posting processing unit 102 performs processing for consuming the player's game points when the player posts the posted content. For example, when a player plays a game or when a good game result is obtained by playing the game, the player is allowed to acquire game points, which are predetermined points. Then, when the player performs an operation to post the posted content, the game points are consumed by, for example, subtracting predetermined points from the game points owned by the player. In other words, the player is permitted to post content to the posting site on the condition that game points are consumed. Then, game parameters are set based on the impression information of the posted content, and game processing for the player to play the game is performed based on the set game parameters. Then, based on the results of the game played by the player, the player is allowed to acquire game points.

The posting processing unit 102 also performs a process of associating the posted content posted by the player with the game ID of the game played by the player. A game ID is information for identifying a game, and is, for example, an ID given by a game maker according to the title of each game. The parameter setting unit 104 acquires impression information of posted content associated with this game ID. Then, based on the obtained impression information, the game parameters of the game corresponding to the game ID are set. For example, the posting processing unit 102 performs a process of posting posted content associated with a game ID to a posting site. Impression information by the user who viewed this posted content is given to the posted content. In this case, the game ID is associated with the posted content to which the impression information is given. The parameter setting unit 104 acquires impression information of posted content associated with the game ID from, for example, a posting site. Based on the game ID, the game associated with the posted content is specified, and the game parameters of the specified game are set.

The game system of this embodiment further includes an acquisition unit 110, a storage unit 170, a movement processing unit 112, a texture generation unit 114, and an image generation unit 120, as shown in FIG.

The acquiring unit 110 acquires a captured image group obtained by capturing an object from a plurality of capturing directions using the capturing unit 162 . The captured image group may be, for example, a plurality of still images captured by a digital camera, or may be a plurality of images forming a moving image captured by a digital camera or a video camera. In this case, the photographed image group becomes a group of images constituting a moving image encoded by MPEG or the like. That is, the photographed image group may be movie images such as MPEG. Note that the game system of this embodiment does not have to have the imaging unit 162 , and in this case, the acquisition unit 110 acquires the captured image via the I/F unit 194 and the communication unit 196 .

The storage unit 170 stores the acquired photographed image group. For example, when the acquisition unit 110 acquires a group of captured images, information on the acquired group of captured images is saved and stored in the storage unit 170 . Specifically, the captured image information storage unit 176 of the storage unit 170 stores the information of the captured image group.

The movement processing unit 112 performs processing for moving primitives in the virtual space based on the movement control information. For example, based on the movement control information, the primitive is translated or rotated in the virtual space. The movement control information is information for controlling the movement of primitives. Operation input information input by the player using the operation unit 160, for example, can be used as the movement control information. Alternatively, movement control information for controlling a series of movements of primitives may be stored in the storage unit 170, and the stored movement control information may be read from the storage unit 170 to control the movement of primitives. In this way, it is possible to implement movement control such that the primitive automatically moves according to the movement control information. As a result, for example, a game system or the like that enables viewing of display objects (for example, fish, animals, etc.) corresponding to the target object can be realized.

The texture generation unit 114 performs processing for generating textures to be mapped onto primitives based on the captured images selected from the captured image group. For example, texture generation processing is performed based on a photographed image selected from a photographed image group in accordance with primitive movement control information. Specifically, based on the movement control information of the primitive, the photographed image corresponding to the movement control information is read from the storage unit 170 from the photographed image group. The texture generation unit 114 then generates a texture based on the read photographed image. For example, of a photographed image of an object, a portion of the object in which the object is captured is generated as a texture image. Specifically, the background image portion of the captured image is made transparent, and the image portion of the object is cut out to generate the texture. By mapping the texture to the primitive, it becomes possible to display the image of the display object corresponding to the target object. Here, the primitive is, for example, a primitive surface, such as a polygon. Specifically, the primitives are billboard polygons placed facing the virtual camera. The primitive may be a free-form surface, a subdivision surface, or the like.

The image generation unit 120 maps the generated textures to primitives to generate a virtual space image seen from a virtual camera in the virtual space. For example, a virtual space image is generated by mapping textures that change according to movement control information to primitives. For example, by mapping a texture based on a captured image selected from a captured image group according to movement control information to a primitive, the texture mapped to the primitive changes according to the movement control information of the primitive. That is, from among a group of captured images obtained by capturing images of an object from a plurality of capturing directions, a captured image that conforms to the primitive movement control state is selected, and a texture generated based on the selected captured image is Mapping to primitives. By doing so, a texture image corresponding to the movement control state of the primitive is mapped to the primitive, and a virtual space image in which a display object corresponding to the object is displayed can be generated.

The movement processing unit 112 also performs processing for moving the primitive and the virtual camera according to the movement control information while the positional relationship between the primitive and the virtual camera is fixed. For example, the positional relationship between the primitive and the virtual camera is fixed so that the distance between the primitive and the virtual camera is constant. As an example, the positional relationship between the primitive and the virtual camera is fixed so that the primitive faces the virtual camera and the distance between the primitive and the virtual camera is constant. The state in which the primitive faces the virtual camera is, for example, the state in which the line-of-sight direction of the virtual camera is orthogonal to the surface of the primitive. Then, the movement processing unit 112 performs processing for moving the primitive and the virtual camera integrally while the positional relationship between the primitive and the virtual camera is thus fixed. For example, in the case of movement control information for upward, downward, leftward, or rightward translational movement in the virtual space, the movement processing unit 112 performs processing for upward, downward, leftward, or rightward translational movement of the primitive and the virtual camera. Alternatively, in the case of the movement control information for rotating around the X-axis, Y-axis or Z-axis in the virtual space, the movement processing unit 112 rotates the primitive and the virtual camera around the X-axis, Y-axis or Z-axis. process to cause

Further, the photographing unit 162 photographs the object and the background of the object. The shooting unit 162 may be included in the game system, or may be provided separately from the game system. The texture generation unit 114 determines whether the color of each pixel in the captured image corresponds to the background color. Then, when it is determined that the pixel has a color corresponding to the background color, a texture is generated by performing processing to make the pixel having a color corresponding to the background color transparent. For example, the texture generation unit 114 determines whether or not the color of each pixel of the captured image corresponds to the background. For example, when the photographing unit 162 photographs an object, the background color is set to a predetermined color such as green or blue. For example, the background color is set to a predetermined color different from the color of the object. For example, if the object has multiple colors, the background color is set to a predetermined color different from any of these multiple colors. For example, a background object arranged around an object at the time of photographing is set to a predetermined color. The background color is preferably set to a color that is complementary to the color of the object. Then, when the pixel to be processed is determined to be a pixel of a color (for example, green or blue) corresponding to the background, the texture generation unit 114 performs processing to make the pixel transparent. For example, in alpha compositing, which is translucent processing, by setting the alpha value of the pixel to 0, the pixel is made transparent. Note that the pixel-by-pixel processing as described above can be realized by a pixel shader or the like.

Further, the texture generation unit 114 selects a captured image from the captured image group and generates a texture based on the selected captured image by performing seek control of a moving image composed of the captured image group based on the movement control information. do. For example, it performs seek control for fast-forwarding and rewinding of a moving image (movie) of the captured image group, and seeks and selects the captured image corresponding to the movement control information. A texture is then generated based on the selected photographed image. Textures generated in this manner are mapped onto primitives that are translated or rotated according to the movement control information.

The photographed image group is a group of images in which the change in the photographing direction of the photographing unit 162 with respect to the object falls within a photographing direction range of 180 degrees or more. Desirably, as shown in FIG. 21, which will be described later, the photographed image group is an image group in which the change in the photographing direction of the photographing unit 162 with respect to the object is within a photographing direction range of 360 degrees. For example, the imaging direction of the imaging unit 162 is directed toward the object, and the imaging direction is set in the direction in which the object is gazed at. The shooting direction range is a range in which the angle of the shooting direction changes from 0 degrees to β while the object is being gazed at. In this embodiment, β is set to 180 degrees or more, preferably β=360 degrees as shown in FIG.

The movement processing unit 112 also performs movement processing of a second primitive whose relative positional relationship with respect to the primitive changes according to the movement control information. For example, a movement process such as rotationally moving the second primitive with reference to the primitive is performed. Then, the image generation unit 120 generates, as a virtual space image, an image including the texture-mapped primitive image and the second primitive image. For example, the primitive is for displaying an image of a display object corresponding to the object, and texture based on the photographed image of the object is mapped to the primitive. On the other hand, the second primitive is for displaying, for example, an image of an accompanying object corresponding to the object. The accompaniment is, for example, a display item such as an effect of a display item, a possession, an accessory, equipment, a weapon or armor, and a second primitive image is an effect of a display item, an accessory, an accessory, an accessory, or the like. , images of weapons or armor. The second primitive may be, for example, a polygon such as a billboard polygon, a free-form surface, a subdivision surface, or the like. Alternatively, the second primitive may constitute a three-dimensional object representing an appendage of the representation. By using such a second primitive, images such as effects, belongings, ornaments, equipment, weapons, and armor that are not found in objects in the real world can be displayed by adding them to display objects corresponding to the objects. become able to.

Further, the movement processing unit 112 performs processing for moving the second primitive based on the primitive from the initial placement position of the second primitive set based on the analysis result of the object. For example, a process of moving the second primitive from the initial placement position with reference to the primitive is performed based on the movement control information. For example, the analysis unit 111 performs analysis processing of a target object, which is an object in the real world. For example, the analysis unit 111 performs analysis processing such as silhouette analysis of the target object to identify the type, shape, and the like of the target object. Then, the movement processing unit 112 arranges the second primitive at the initial arrangement position according to the type and shape of the target object, and rotates or translates the second primitive from the initial arrangement position with reference to the primitive. Perform processing to move. For example, when the object is of the first type or the first shape, the second primitive is placed at the first initial placement position and the movement processing is performed, and the object is of the second type or the second shape. If it is a shape, the second primitive is placed at the second initial placement position and movement processing is performed.

The image generator 120 also performs hidden surface removal processing for the second primitive in accordance with the movement control information. That is, the second primitive rotates or translates so that the relative positional relationship with respect to the primitive changes according to the movement control information. Then, when it is determined based on the movement control information that the accompanying object represented by the second primitive has come to a position hidden from the virtual camera with respect to the display object represented by the primitive, the second primitive is moved. Perform hidden surface removal processing. Then, hidden surface removal processing is performed so that the attached object represented by the second primitive appears to be hidden by the display object represented by the primitive. By doing so, it is possible to display images of the display object and its accompanying objects without contradiction.

The image of the second primitive is, for example, an effect image. For example, the second primitive image is an effect (game effect) image, which is a special graphic representing light, flame, smoke, jetting, blinking, explosion, weapon attack, magic attack, or the like. By using the effect image as the second primitive image in this way, it is possible to generate an effect in the virtual space, which is the game space, that cannot be generated with the object in the real world.

The image generator 120 also generates, as a virtual space image, an image including a primitive image and images of a plurality of objects set in the virtual space. Then, post-effect processing is performed on the generated virtual space image. For example, post-effect processing such as blur processing, brightness adjustment processing, or hue adjustment processing is performed. Specifically, the image generation unit 120 performs post-effect processing on a virtual space image in which other objects are displayed so that objects represented by primitives are displayed without discomfort. For example, post-effect processing is performed to blur the outline of the display object represented by the primitive so that the outline, which is the boundary between the display object and the virtual space image, becomes inconspicuous. Also, if there is a difference between the brightness of the displayed object and the brightness of the surrounding virtual space image, the image generator 120 performs post-effect processing to reduce this difference. For example, a texture mapped to a primitive is generated based on a photographed image obtained by photographing an object in the real world. For this reason, the brightness of the texture image also fluctuates according to the shooting environment, and a difference occurs between the brightness of the image of the displayed object and the brightness of the virtual space image around the displayed object. The image generator 120 performs post-effect processing to reduce the difference.

The acquiring unit 110 also acquires a captured image group for another display object obtained by capturing another object corresponding to another display object from a plurality of shooting directions. That is, a captured image group for another display object obtained by capturing another target object corresponding to another display object different from the display object corresponding to the primitive is acquired. For example, if the displayed object represented by the primitive is a character, the other displayed object is, for example, an enemy character that fights against the character. Then, the texture generation unit 114 generates the texture for the other display object based on the captured image selected from the captured image group for the other display object according to the movement control information for the other display object. The image generation unit 120 then maps the texture for the other display object, which changes according to the movement control information for the other display object, onto the primitive for the other display object, thereby generating a virtual space image. For example, the movement processing unit 112 performs processing for moving primitives for other display objects in the virtual space according to movement control information for other display objects. Then, the texture for the other display object that changes according to the movement control information for the other display object is mapped onto the primitive for the other display object that moves in this way. This makes it possible to generate realistic images of other displayed objects, such as enemy characters, with a small processing load.

The image generator 120 also generates an image in which particles are displayed around the primitive as a virtual space image. For example, in a virtual space, particles are generated so that the particles are arranged around primitives to generate a virtual space image. For example, the image generator 120 performs effect processing (post-effect processing) for generating particles. Since particles are present around the primitives in this way, it is possible to generate a virtual space image in which the displayed objects corresponding to the primitives move naturally in the virtual space.

Further, as shown in FIG. 30, which will be described later, the game system of the present embodiment includes a photographing unit 162 such as a camera, an arrangement unit 10 (placement unit) on which the object POB is arranged, and a rotation movement mechanism 12. can be done. The rotational movement mechanism 12 is a mechanism that performs rotational movement for changing the photographing direction of the photographing unit 162 with respect to the object POB arranged in the arrangement unit 10 . In FIG. 30, the rotation movement mechanism 12 realized by a driving unit such as a motor rotates the arrangement unit 10 like a turntable, thereby changing the photographing direction of the photographing unit 162 with respect to the object POB. By providing the placement unit 10 and the rotational movement mechanism 12 as described above, it is possible to acquire a group of captured images in which the imaging direction of the imaging unit 162 with respect to the object POB is in the imaging direction range of a predetermined angle or more.

The game system of this embodiment can also be realized using a server system. FIG. 2 shows a configuration example of the server system 500 and the terminal devices TM1 and TM2 that implement the game system.

In FIG. 2, a server system 500 (information processing system) is connected to terminal devices TM1 to TMn via a network 510 for communication. For example, the server system 500 is a host, and the terminal devices TM1-TMn are clients. Alternatively, the game system of this embodiment can also be realized by a blockchain technique. For example, a program called a smart contract that can be executed on Ethereum may be used to execute each process of the game system of this embodiment. In this case, the terminals TM1-TMn are connected peer-to-peer. Various types of information such as game information communicated between the terminal devices TM1 to TMn are transferred using blockchain. Note that each of the terminal devices TM1 to TMn is hereinafter referred to as a terminal device TM as appropriate.

The server system 500 can be realized by, for example, one or a plurality of servers (management server, game server, billing server, service providing server, content distribution server, authentication server, database server, communication server, etc.). This server system 500 can provide various services for operating community websites and online games, manage data necessary for game execution, and distribute client programs and various data. As a result, for example, the terminal device TM, which is a player terminal, accesses the server system 500 in order to use SNS (Social Networking Service) or the like, and the online game provided by the server system 500, such as a social game or a household game, can be accessed. It is possible to play network games such as

The network 510 (distribution network, communication line) is a communication path using, for example, the Internet or a wireless LAN. Communication networks such as networks, cable networks, and wireless LANs can be included. Also, the communication method may be wired or wireless.

The terminal device TM (player terminal) is, for example, a terminal having a network connection function (Internet connection function). As these terminal devices TM, various devices such as mobile communication terminals (smartphones, mobile phones), mobile game devices, home game devices (stationary type), and arcade game devices can be used. Alternatively, an information processing device such as a personal computer (PC) or a tablet computer may be used as the terminal device TM. Alternatively, a wearable device (HMD, watch-type device, etc.) that is worn on the player's head or arm may be used as the terminal device TM.

Each processing of the processing unit 100 of the game system of this embodiment may be realized by the processing unit (processor) of the server system, or may be realized by the processing unit (processor) of the terminal device TM. Alternatively, it may be realized by distributed processing of the processing unit of the server system 500 and the processing unit of the terminal device TM, or may be realized by a method using the processing unit of the terminal device TM and blockchain.

2. Method of this Embodiment Next, the method of this embodiment will be described in detail. In the following, a case where a posted image or a posted video that is posted content is a photographed image or a photographed video obtained by photographing an object in the real world will be mainly described as an example. Not limited. The posted image or posted video may be a game image or game video obtained by capturing (recording) the game play of the player.

2.1 Description of Game First, an example of a game realized by the game system of this embodiment will be described. In the present embodiment, it is possible to post posted content, which is a posted image or posted video of an object in the real world photographed by the imaging unit 162, to a posting site. Based on the impression information given to the posted content on the posting site, game parameters are set, and the game played by the player is processed based on the set game parameters. In a game realized by game parameters set based on impression information, an image of a display object such as a character corresponding to an object photographed by the photographing unit 162 is displayed as a game image. A player enjoys a game in which objects corresponding to objects are displayed as game images. This makes it possible to give the player a feeling of virtual reality as if an object in the real world appeared in the game space.

For example, a technique called photogrammetry has been known in the past. In this photogrammetry, a 3D scan is performed based on images of objects in the real world photographed from multiple shooting directions, and the images are arranged in virtual space. Generate a possible 3D model. However, in 3D scanning, there is a limit to the resolution of captured images, so when an object has a fine shape, it is difficult to generate a 3D model that faithfully reproduces this fine shape. . In addition, the process of generating a 3D model by 3D scanning puts a heavy processing load on the computer. There is also the problem that it is difficult to

Therefore, in the game of this embodiment, the texture is generated using the photographed image of the object. Then, by mapping the texture generated based on the captured image to the primitives in the virtual space, a virtual space image is generated in which the display object corresponding to the object is displayed. Specifically, based on the movement control information, primitives realized by polygons or the like are moved within the virtual space. As the movement control information, for example, player's operation input information can be used. Alternatively, it may be movement control information for moving a primitive along a predetermined trajectory. Then, using the movement control information used for primitive movement control, an appropriate photographed image is selected from a plurality of photographed images obtained by photographing the object. Then, the texture generated based on the selected captured image is mapped to the primitive that moves based on the movement control information to generate a virtual space image, which is an image viewed from the virtual camera in the virtual space. That is, by mapping textures on primitives, an image of a display object such as a character corresponding to the object is generated, and a virtual space image including the image of this display object is generated. By doing so, it becomes possible to generate a virtual space image including an image of a display object in which the shape of the object is faithfully reproduced without performing heavy-load processing such as 3D scanning.

Specifically, as shown in FIG. 3A, in the game of the present embodiment, the photographing unit 162 photographs the object POB from a plurality of photographing directions. In FIG. 3A, the object POB is a plastic model of a robot. This target object POB is placed on a placement section 10, which is a turntable, and the placement section 10 is rotated using a rotational movement mechanism 12 realized by a motor or the like. For example, the placement unit 10 is rotated 360 degrees during the imaging time of about 30 to 60 seconds. As the background of the object POB, a monochromatic background portion 20 such as a green background or a blue background is arranged. By doing so, for example, as shown in FIG. 21, which will be described later, the object POB can be photographed by the photographing unit 162 within a 360-degree photographing direction range. can be obtained. Specifically, by shooting a movie using the shooting unit 162, it is possible to obtain a group of shot images that are moving images (movies) shot in a shooting direction range of 360 degrees.

In the game of the present embodiment, after such shooting is completed, a character CH (in a broad sense, a display object) corresponding to the object POB is virtualized in a short time with one action as shown in FIG. The character CH is made to appear in the space so that the player can play a game using this character CH. For example, in FIG. 3B, three-dimensional objects OB1, OB2, and OB3 such as rocks are arranged in a virtual space, which is a three-dimensional object space, and an enemy character CHE, which is an enemy robot, also appears. By operating the operation unit 160 such as a game controller, the player can move the character CH as indicated by A1 and A2. In the image of the robot character CH, an image of the jet flame VN of the vernier, which is an auxiliary device, is also displayed.

In this embodiment, the case where the object is a plastic model of a robot will be mainly described as an example, but the object is not limited to this. The object may be, for example, a ship such as a battleship, an airplane such as a fighter plane, a tank, a car, or a plastic model such as a monster. Also, the target object is not limited to a plastic model or model, and may be any object that actually exists in the real world. For example, objects include dolls, figures, real-world vehicles such as cars, motorcycles, and automobiles, everyday items such as home appliances, stationery, and clocks, works of art such as sculptures and paintings, and construction of buildings and bridges. Various objects (subjects) such as things can be assumed.

2.2 Setting Game Parameters Based on Impression Information In this embodiment, a process of posting posted content, which is a player's posted image or posted video, to a posting site is performed. In addition, it acquires impression information of the posted content by the user who viewed the posted content on the posting site, and sets game parameters based on the acquired impression information. Based on the game parameters set based on the impression information, the game processing of the game played by the player who posted the posted content is performed.

For example, the game system of the present embodiment, as shown in FIG. Do the process of posting to. For example, it performs processing such as uploading posted content to a posting site. A posting site is a site on a network where posted content, which is a posted image or posted video, can be posted and viewed. The posting site may be a site operated by the maker of the game played by the player, or may be a site where an unspecified number of users view posted content posted by an unspecified number of users on a server on the Internet. It may be a possible site. The game system then acquires impression information of the posted content on the posting site. For example, it acquires the impression information of the posted content by the user who viewed the posted content on the posting site. For example, it receives impression information from a posting site server.

FIG. 4 shows an example of a posting screen on the posting site. On this posted posting screen, posted contents CP1 to CP4 uploaded to the posting site are displayed and posted. That is, posted contents CP1 to CP4 are displayed so that users of the posting site can view them. The posted contents CP1 to CP4 are, for example, posted images or posted moving images shot by the shooting unit 162 as shown in FIG. 3A. For example, the posted image PIM1, which is the posted content CP1, is a photographed image of the object POB1, which is a plastic model in the real world. The posted image PIM2, which is the posted content CP2, is a photographed image of the object POB2, which is a plastic model in the real world. As described with reference to FIG. 3A, in the game played by the players who posted the posted contents CP1 and CP2, characters corresponding to the objects POB1 and POB2 appear in the game space and displayed as game images.

These posted contents CP1 and CP2 are provided with impression information such as "likes", the number of views, viewing time, and the number of retweets. Here, "Likes" is information on the number of supports for posted content, and is, for example, impression information on the number of times the user gave a good evaluation and supported the posted content and the number of people who supported the posted content. The number of views is impression information of the number of views, which is the number of times the posted content has been viewed or the number of people who have viewed it. The viewing time is impression information of the viewing time, which is the time spent viewing the posted content (total viewing time). The number of retweets is impression information of the number of transmissions of posted content to other users. The impression information is given to each posted content by the user of the posting site viewing the posted content. The game system of this embodiment acquires impression information associated with posted content. For example, it receives impression information associated with posted content from a posting site server.

FIG. 5 shows another example of the posting screen of the posting site. On this posted posting screen, game videos PV1 to PV4 obtained by capturing (recording) the games played by the players are displayed and posted as posted contents CP1 to CP4. The game videos PV1 to PV4 are called game play videos or game commentary videos, and are videos in which the state of the player's game play is captured. As posted content, a game image in which the player's game play is captured may be displayed. Impression information such as the number of supports (likes), the number of views, the viewing time, and the number of transmissions (retweets) is given to the game videos PV1 to PV4, which are the posted contents CP1 to CP4. The game system of this embodiment may acquire impression information given to the game videos PV1 to PV4 in this way.

In the present embodiment, game parameters are set based on the impression information thus acquired, and game processing of a game played by the player who posted the posted content is performed based on the set game parameters. conduct. For example, as shown in FIG. 3A, the player takes a picture of an object POB such as a plastic model, and the taken image or the taken video of the object POB is posted to the posting site as posted content. Then, the users of the posting site view the posted content, and impression information such as the number of support, the number of views, the viewing time, or the number of transmissions is provided, and the game system acquires the impression information. Then, based on the impression information, the game parameters for the game shown in FIG. 3(B) are set. Specifically, the attack power, defense power, endurance, movement ability, running ability, special ability, hit point, magic point, level, etc. of the character CH appearing in the game space corresponding to the photographed object POB. Set parameters. For example, these game parameters are set so that the greater the number of impressions, views, or transmissions, or the longer the viewing time, the more advantageous the player is. For example, if the evaluation value of impression information for posted content is high, attack power, defense power, endurance, movement ability or running ability will be high, special ability or special skill will be given, hit points, magic points or level becomes higher, and the player comes to be treated preferentially in the game. As shown in FIG. 5, when the posted content is a game video or game image, game parameters such as characters appearing in the game video or game image are set based on the impression information for the posted content.

FIG. 6 is a flowchart for explaining the processing of this embodiment. First, the game system performs posting processing of posted content to the posting site (step S1). For example, it performs processing such as uploading posted content to a posting site via a network. Next, the impression information given to the posted content is acquired (step S2). For example, it acquires impression information such as the number of users of the posting site, the number of views, the viewing time, or the number of transmissions. Then, the game parameters are set based on the acquired impression information (step S3). For example, game parameters of a game corresponding to a posted image or posted video that are posted content are set based on the impression information of the posted content. Then, based on the set game parameters, the game processing of the game played by the player who posted the posted content is executed (step S4). For example, game processing of a game corresponding to the posted image or posted video is executed.

As described above, according to the present embodiment, when posted content showing an object of a game is posted on a posting site, impression information for the posted content is acquired and fed back to the game played by the player. . For example, in FIGS. 3A and 3B, the player shoots a plastic model (object POB) owned by the player, and a character corresponding to the plastic model appears in the game, and the character is operated. You can enjoy the game. In such a game, a player can post a photographed image or a photographed moving image of a plastic model that the player owns to a posting site as posted content. When a large number of users view, support, or retweet the posted content of the player in which the plastic model is displayed, or view the posted content for a long time, the evaluation value of the impression of the posted content becomes a high evaluation value. Then, the high evaluation value of this impression will be reflected in the game parameters of the character appearing in the game corresponding to the plastic model, and the character's ability such as offensive power, defensive power, endurance or movement ability will increase. do. This allows the player to advance the game using the character to an advantage. From the player's point of view, when the plastic model owned by the player is highly rated on the posting site, the ability of the character appearing in the game corresponding to the plastic model increases. Therefore, it is possible to stimulate the player's degree of attachment to the plastic model, and to remarkably improve the amusement and enthusiasm of the game in which the character corresponding to the object such as the plastic model appears.

Further, in the present embodiment, game processing is performed for a game in which a character related to posted content appears. Then, based on the impression information of the posted content acquired by posting the posted content to the posting site, game parameters for the character are set.

For example, by photographing an object as shown in FIG. 3A, game processing of a game in which a character corresponding to the object appears as shown in FIG. 3B is performed. This character is a character related to the posted content, which is the photographed image or the photographed moving image of FIG. 3A. In this case, as shown in FIG. 4, a captured image or captured video is posted as posted content to the posting site, and impression information about the posted content is acquired. When a game image or game video is posted to a posting site as shown in FIG. 5, the character related to the posted content is the character appearing in the game image or game video. Then, when a character related to the posted content appears in the game in this way, the game parameters of the character are set based on the impression information of the posted content. That is, game parameters such as the character's offensive power, defensive power, movement ability, running ability, special ability, hit points, magic points, or level are set based on the impression information. In this way, in a game in which a character related to posted content appears, game processing can be executed by setting the game parameters of the character based on the impression information on the posting site for the posted content. . Therefore, when the number of views, the number of supports, or the number of transmissions of posted content related to a character increases, or when the viewing time increases, the evaluation value of the impression increases, and the game parameters of the character appearing in the game also change to the player. It will change to an advantageous value. As a result, the player's enthusiasm and immersion in the game can be significantly improved.

Further, in the present embodiment, basic parameter values of game parameters are set based on analysis results of objects appearing in posted content. Then, the game parameters set as the basic parameter values are changed based on the impression information. Specifically, analysis processing of the object is performed based on the captured image of the object captured by the imaging unit 162, and basic parameter values are set based on the analysis result of the analysis processing.

FIG. 7 is a flow chart illustrating processing for setting basic parameter values based on the analysis result of the object. First, an analysis process of the object appearing in the posted content is performed (step S21). For example, as shown in FIG. 3A, based on the photographed image or the like photographed by the photographing unit 162, the analysis processing of the object is performed, and the type of the object or the like is specified. Then, based on the analysis result of the object, the basic parameter values of the game parameters are set (step S22). For example, the game parameters are set to basic parameter values corresponding to the type of the object specified based on the analysis result. Next, the game parameters set as the basic parameter values are changed based on the impression information (step S23). For example, the value of the game parameter is changed from the basic parameter value so that the higher the evaluation value of the impression, the more advantageous the player. Then, based on the game parameters, the game processing of the game played by the player who posted the posted content is executed (step S24).

As described above, in the present embodiment, the basic parameter values of the game parameters are set based on the analysis result of the object appearing in the posted content. Specifically, based on the analysis result of the object, the type of the object is specified, and the values of the game parameters are set to the basic parameter values corresponding to the type. Then, the game parameters set as the basic parameter values are changed based on the impression information.

For example, in FIG. 8, object types RBA, RBB, and RBC are identified based on the analysis result of the object. For example, if the object is a plastic model of a robot as shown in FIG. 3A, robot types RBA, RBB, and RBC are specified based on the analysis results of the plastic model that is the object. When the type of robot specified based on the analysis result is RBA, the basic parameter values of attack power, defense power, endurance, movement ability, hit points, and level, which are game parameters, are ATA, DFA, and EDA. , MAA, HPA, LVA. Based on the impression information, the game parameter values change from the basic parameter values ATA, DFA, EDA, MAA, HPA, and LVA. For example, the game parameters are set such that the higher the impression evaluation value, the greater the increase from the basic parameter values ATA, DFA, EDA, MAA, HPA, and LVA. If the type of robot specified based on the analysis result is RBB, the basic parameter values of attack power, defense power, endurance, movement ability, hit points, and level, which are game parameters, are ATB, DFB, and EDB. , MAB, HPB, LVB. Based on the impression information, the game parameter values change from the basic parameter values ATB, DFB, EDB, MAB, HPB, and LVB. For example, the game parameters are set such that the higher the impression evaluation value, the greater the increase from the basic parameter values ATB, DFB, EDB, MAB, HPB, and LVB.

In this way, the basic parameter values corresponding to the initial values and reference values of the game parameters are set based on the analysis results of the target object, and the values of the game parameters are changed from the basic parameter values according to the impression information. it becomes possible to change. Therefore, it is possible to set game parameters that reflect both the analysis result of the object and the impression information.

Further, in the present embodiment, analysis processing of the object is performed based on the photographed image of the object photographed by the photographing unit 162, and basic parameter values are set based on the analysis result of the analysis processing. For example, as shown in FIG. 3A, analysis processing is performed based on a photographed image of an object photographed by the photographing unit 162 to specify the type of the object appearing in the photographed image. Then, as described with reference to FIG. 8, the game parameters are set to the basic parameter values corresponding to the type of the object, etc., and the game parameters set to the basic parameter values are changed based on the impression information.

In this way, the type of the target object can be identified by analysis processing based on the photographed image of the target object, and basic parameter values corresponding to the type of the target object can be set as game parameter values. Become.

For example, when a character corresponding to an object appears in a game, the problem is how to set the basic parameter values of the game parameters. In this regard, according to the present embodiment, by photographing an object, it is possible to make a character corresponding to the object appear in the game, and at the same time, the basic parameter values of the game parameters of the character can be set to the character. It becomes possible to set based on the analysis result of the captured image of the corresponding object. Therefore, in a game in which a character corresponding to an object appears in the game space, the basic parameter values of the game parameters of the character can be set to appropriate values according to the type of the object.

Further, in this embodiment, it is used for setting game parameters depending on whether or not a user who gives impression information to posted content by browsing the posted content on the posting site is a player having a predetermined relationship with the player. Vary impression information. FIG. 9 is a flow chart for explaining a process of changing impression information of players in a predetermined relationship.

First, by browsing the posted content, the information of the user of the posting site who gave impression information to the posted content is collected (step S31). For example, from the server of the posting site, the information of the user of the posting site who gave the impression information to the posted content is received. For example, when acquiring impression information, information about the user who provided the impression information is also acquired in association with the impression information. Then, the user who gave the impression information determines whether or not the user has a predetermined relationship with the player, such as a friend player (step S32). Players having a predetermined relationship include, for example, a player's friend player and a player belonging to the same group (same team) as the player. If the user who gave the impression information is a player who has a predetermined relationship with the player, the impression information is changed (step S33). For example, the impression information is changed so that the evaluation value of the impression increases. Then, the game parameters are set based on the impression information (step S34). For example, when a player such as a friend player who has a predetermined relationship with the player gives impression information to the posted content, the evaluation value of the impression increases, and the game parameters set based on the impression information are also more advantageous to the player. will be set to the desired value.

For example, as shown in FIG. 10, if the player who gave the impression information is a friend player (in a broad sense, a player with a predetermined relationship), the number of support, the number of views, the viewing time, and the number of retweets, which are the impression information, change. Rates VRA, VRB, VRC, VRD are set to large values. For example, for other players who are not friend players, the rate of change in the number of support, number of views, view time, and number of retweets is set to, for example, 1.0. Set to a value greater than 1.0. Therefore, in the case of a friend player, the number of support, the number of browsing, the browsing time, and the number of retweets change at rates of change VRA, VRB, VRC, and VRD greater than 1.0. Therefore, in the impression information browsed by the friend player, the evaluation value of the impression changes to a higher evaluation value than the impression information browsed by other players who are not the friend player, and the game parameters are also more advantageous to the player. will change to the desired value. Therefore, it is possible to perform game processing that treats players with a predetermined relationship, such as friend players, more preferentially than other players.

Further, in this embodiment, the player's personal information is set based on the player's posted information, and the impression information used for setting the game parameters is changed according to the set personal information. Here, the posted information is, for example, information on the number of pieces of content posted by the player, the number of times of posting, or the accumulated time of posting.

FIG. 11 is a flow chart for explaining the process of setting the player's personal information based on the player's posted information and changing the impression information. First, post information such as the number of content posted by the player, the number of times of posting, or accumulated posting time is acquired (step S41). For example, post information such as the number of posted contents that the player has posted so far, the number of times that the posted contents have been posted, or the cumulative time of posting the posted contents on the posting site. do. Then, based on the posted information, the player's personal information is set (step S42). For example, personal information is set to specify whether the player has a large number of posted contents, a large number of postings, or a large number of cumulative posting times. Then, change processing of impression information based on personal information is performed (step S43). For example, the impression information is changed so that the evaluation value of the impression increases as the number of pieces of posted content or the number of times of posting by the player increases, or as the accumulated posting time increases. Then, based on the impression information, game parameters are set, and based on the set game parameters, the game processing of the game played by the player who is the contributor is executed (steps S44, S45).

FIG. 12 is an explanatory diagram of a process of setting the player's personal information based on the player's posted information and changing the impression information. FIG. 12 shows the relationship between the number of pieces of posted content, the number of times of posting, the accumulated posting time, and the parameter values of impression information, which are posted information. The impression information parameter value corresponds to the impression rating value. As shown in FIG. 12, the larger the number of posted contents or the number of times of posting, or the longer the accumulated posting time, the higher the impression information parameter value and the higher the impression evaluation value. Therefore, the game parameters set based on the impression information are also set to values that make the player more advantageous. That is, for a player who has posted a large number of posted contents, posted a large number of times, or has posted a long cumulative time, the personal information of the player is set such that the impression information is changed to a higher value. Therefore, when a player in which such personal information is set posts posted content to a posting site, the parameter value of the impression information of the posted content changes to a higher value than other players. Game parameters are also set to values that are advantageous to the player. Therefore, the more the posted content is posted, the more the player can advance the game in an advantageous manner, and the player's degree of enthusiasm and immersion in the game can be increased.

Further, in this embodiment, processing is performed for the player to acquire game points according to the result of the game played by the player, and processing for consuming the game points of the player is performed when the posted content is posted by the player. For example, as shown in FIG. 13, the player can obtain predetermined game points by playing the game shown in FIG. 3(B). For example, in the game of FIG. 3B, the player obtains game points by defeating an enemy character, capturing an enemy base, or completing a predetermined mission. Earned game points are accumulated in association with the player. When the player posts the posted content to the posting site, the game points are consumed. For example, a player can post posted content to a posting site on the condition that game points are consumed.

In this way, the player will play the game with all his might in order to post the posted content in which his/her own plastic model or the like is reflected on the posting site. Then, the user consumes the game points acquired by playing the game to post posted content showing a new plastic model or the like. By repeating posting of posted content by the player in this way, as described with reference to FIGS. The rate of change of values will also increase. As a result, the game parameter changes to a value that gives the player an advantage, allowing the player to proceed with the game more favorably. As a result, more game points can be obtained by playing the game, and the posted content can be repeatedly posted. By doing so, the posting of posted content and the player's game play are encouraged in a chain manner, and the player's degree of immersion and enthusiasm for the game can be significantly improved.

Further, in the present embodiment, a process of associating the posted content posted by the player with the game ID of the game played by the player is performed. Then, the impression information of the posted content associated with the game ID is acquired, and the game parameters of the game corresponding to the game ID are set based on the acquired impression information.

For example, in FIG. 14, the posting processing unit 102 performs a process of associating the posted content with the game ID and posting the posted content on the posting site. That is, a process of uploading information in which the posted content is associated with the game ID to the posting site is performed. As described with reference to FIGS. 4 and 5, the posted content posted to the posting site is given impression information such as the number of views, the viewing time, the number of supports, or the number of transmissions (the number of retweets). The game ID associated with the posted content is also associated with this impression information. That is, to which game the impression information given to the posted content corresponds is specified by the association of the game ID. Then, the parameter setting unit 104 acquires impression information associated with the game ID. For example, a process of downloading impression information associated with a game ID from a posting site is performed. Then, the parameter setting unit 104 sets game parameters of the game corresponding to the game ID based on the acquired impression information. That is, based on the game ID associated with the impression information, the game corresponding to the posted content to which the impression information is assigned is identified, and game parameters for the game are set based on the obtained impression information. The game processing unit 106 executes game processing based on the game parameters set in this manner.

By associating the game ID with the posted content and the impression information in this manner, it is possible to determine which game the posted content and the impression information given to the posted content and the posted content posted by the player correspond to. can be identified based on Therefore, it is possible to set game parameters based on the impression information of the posted content by simple processing using the game ID.

2.3 Image Generation Method Next, the image generation method of the present embodiment described with reference to FIGS. 3A and 3B will be described in detail with reference to FIGS. 15A to 19. FIG. First, as shown in FIG. 15A, the object POB is arranged on the arrangement section 10, which is a turntable. Then, for a photographing time of 30 to 60 seconds, the object POB is photographed by the photographing unit 162 against the background portion 20 such as a green screen while rotating the placement unit 10 by 360 degrees as shown in B1 and B2. Moving image data obtained by, for example, movie shooting by the shooting unit 162 is taken into the processing device 200 . This moving image corresponds to a group of photographed images obtained by photographing the object POB from a plurality of photographing directions by the photographing unit 162 .

Although FIG. 15A shows an example in which the processing device 200 that implements the game system of this embodiment is a PC (personal computer), this embodiment is not limited to this. The processing device 200 that implements the game system may be a commercial game device as shown in FIG. 30 described later, or may be another type of device such as a home game device. For example, the processing device 200 may be a mobile communication terminal such as a smart phone or a tablet PC. In this case, the photographing unit 162 can be realized by a built-in camera of the portable communication terminal or the like.

A group of captured images, which are moving images captured by the capturing unit 162 , are stored in the storage unit 170 of the processing device 200 . For example, in a specified folder of the storage unit 170, data of a moving image, which is a group of shot images in a shooting direction range of 360 degrees, for example, is automatically saved. FIG. 15B is an example of the captured image IM included in the captured image group (moving image). This photographed image IM is a photographed image obtained by photographing the rear side, which is the back side of the object POB in FIG. The photographed image IM includes an image of the object POB and an image of the background BG formed by the background portion 20 of FIG. 15(A). The background BG is, for example, a monochromatic background such as a green background or a blue background. In FIG. 15A, a group of captured images is acquired by capturing a movie of the object POB by the capturing unit 162. For example, frame-by-frame capturing of the object POB is performed while changing the capturing direction of the capturing unit 162. You may acquire a picked-up image group by performing.

Then, in this embodiment, as shown in FIG. 16A, the texture TEX generated based on the photographed image IM of FIG. 15B is mapped onto the primitive PM. In this case, as shown in FIG. 16(B), the background BG in FIG. 15(B) is transparently processed in real time, and the texture TEX in which only the character CH corresponding to the object POB is displayed is mapped onto the primitive PM. be done. That is, as schematically shown in FIG. 16B, among the pixels of the texture TEX, the pixels corresponding to the background BG are set to transparent, and only the pixels corresponding to the character CH are cut out to generate the texture TEX. be done. A character CH is a display object that appears in the game corresponding to the object POB. Since the image of the character CH is an image based on the photographed image IM described with reference to FIGS. 15A and 15B, the detailed shape of the object POB can be reproduced more faithfully than when 3D scanning is used. image.

The primitive PM is placed in a virtual space that is a three-dimensional object space, and various objects such as objects OB1, OB2, and OB3 representing rocks are placed in this virtual space. And in this embodiment, this primitive PM moves in the virtual space according to the movement control information. Specifically, the operation input information input by the player using the operation unit 160 is used as movement control information to rotate or translate the primitive PM in the virtual space. Alternatively, the primitive PM may rotate or translate in the virtual space based on movement control information for automatically moving the primitive PM. Then, as will be described later, a texture TEX is generated based on a photographed image selected according to the movement control information from among the photographed images of the moving images photographed in FIGS. 15A and 15B. The generated texture TEX is mapped to the primitive PM. As a result, the texture TEX, which changes according to the movement control information, can be mapped onto the primitive PM to generate a virtual space image viewed from the virtual camera in the virtual space. According to this embodiment, the target object POB, such as a plastic model of a robot, appears in the virtual space, which is the game space, as it is. Therefore, the player can feel the virtual reality as if the object POB owned by the player, such as a plastic model, really appears in the virtual space, making it possible to realize an unprecedented type of game system. become.

FIG. 17 is a diagram showing the relationship between the primitive PM and the virtual camera VC in the virtual space. Objects OB1 to OB3 representing rocks, an enemy character CHE that is an enemy robot, and the like are arranged in the virtual space. VM is the view volume of the virtual camera VC and corresponds to the display range (drawing range) of the virtual camera VC.

As shown in FIG. 17, in this embodiment, the positional relationship between the primitive PM and the virtual camera VC is fixed. For example, while the positional relationship between the primitive PM and the virtual camera VC is fixed, the primitive PM and the virtual camera VC are moved according to the movement control information. For example, the rail RL connecting the primitive PM and the virtual camera VC is moved according to the movement control information. Specifically, in FIG. 17, billboard polygons are used as primitive PMs. For example, the distance between the primitive PM and the virtual camera VC is constant, and the primitive PM is arranged to face the virtual camera VC. For example, the primitive PM is arranged such that the distance between the primitive PM and the virtual camera VC is constant, and the line-of-sight direction VL of the virtual camera VC is orthogonal to the plane of the primitive PM. In this way, even when the primitive PM is arranged in a three-dimensional virtual space, it is possible to produce an effect in which the primitive PM does not appear flat from the player's point of view. It is possible to give the player a virtual reality feeling as if the CH exists in the virtual space.

Further, in this embodiment, as shown in FIG. 18, the image of the texture TEX to be mapped onto the primitive PM is changed according to the movement control information of the primitive PM. Specifically, according to the player's operation input to the operation unit 160, C1, C2, C3, C3, C3, C3, C3, C1, C2, C3, C1, C2, C3, C1, C2, C3, C1, C2, C3, C1, C2, C3, C3, C3, C1, C2, C3, C3, C1, C2, C3, C1, C2, C3, C1, C3, C3, C3, C3, C3, C3 Rotate the primitive PM as indicated by C4. That is, the rail RL connecting the virtual camera VC and the primitive PM is rotated around the position of the virtual camera VC. In the case of translational movement, the virtual camera VC and primitive PM are translated integrally. That is, the rail RL connecting the virtual camera VC and the primitive PM is translated. For example, when an operation input instructing the left direction is performed, the primitive PM is rotationally moved in the direction indicated by C1 with the position of the virtual camera VC as the fulcrum. When an operation input instructing the right direction is performed, the primitive PM is rotationally moved in the direction indicated by C2 with the position of the virtual camera VC as the fulcrum. Similarly, when an operation input instructing the downward direction or the upward direction is performed, the primitive PM is rotationally moved in the directions indicated by C3 and C4, respectively, with the position of the virtual camera VC as the fulcrum. By doing so, the process of moving the primitive PM according to the operation input information, which is the movement control information, is realized.

In conjunction with such movement of the primitive PM, the texture TEX mapped to the primitive PM is changed. Specifically, as shown in FIGS. 15(A) and 15(B), moving images of the object POB in a 360-degree photographing direction range are reproduced in conjunction with the movement of the primitive PM. , changes the texture TEX mapped to the primitive PM in conjunction with the movement of the primitive PM. For example, when the player performs an operation input pointing to the left direction to rotate the primitive PM around the position of the virtual camera VC as a fulcrum as shown in C1 in FIG. A moving image is reproduced as shown in the reproduction direction DR of . For example, it is possible to reproduce a moving image such that an image of the object POB (character CH) photographed from the rear side as shown in D1 in FIG. 18 changes to an image of the object POB (character CH) photographed from the left rear side as shown in D2. conduct. Furthermore, moving image reproduction is performed such that the image is changed to the photographed image of the object POB from the left front side as shown in D3, and the photographed image of the object POB is changed to the photographed image of the object POB from the front side as shown in D4. The photographed images indicated by D1, D2, D3, and D4 constitute the photographed image group of this embodiment. By doing so, it is possible to generate a virtual space image that looks as if the character CH, which is a three-dimensional display object, is rotating and moving in the virtual space while using the texture TEX based on the two-dimensional photographed image. Become.

In addition, as shown in FIG. 19, this embodiment also performs effect processing for realizing 3D effect expression such as the jet flame VN of a vernier and the beam BM emitted by a beam cannon. In this embodiment, in order to realize such effect processing, the relative positional relationship with respect to the primitive PM changes according to the movement control information, as will be described later with reference to FIGS. Prepare primitives PMV and PMB to be used. Primitives PMV and PMB are second primitives, for example polygons. An image (texture) representing the jet flame VN is drawn on the primitive PMV, and an image (texture) representing the beam BM is drawn on the primitive PMB. Then, according to movement control information (operation input information) for moving the primitive PM, the relative positional relationship of the primitives PMV and PMB with respect to the primitive PM is changed as indicated by E1 and E2 in FIG. Then, an image including an image of the primitive PM to which the texture TEX is mapped and images of the primitives PMV and PMB (second primitives) is generated as a virtual space image.

For example, when the primitive PM rotates, the primitive PMV for the injection flame VN is rotated as indicated by E1 in FIG. 19 in conjunction with this. That is, as indicated by F1 in FIG. 19, the primitive PMV on which the jet flame VN is drawn is rotated so that the jet flame VN appears to be jetted from the auxiliary device of the vernier of the character CH drawn on the texture TEX. Further, when the primitive PM is rotationally moved, the primitive PMB for the beam BM is rotationally moved as indicated by E2 in FIG. 19 in conjunction therewith. That is, as shown in F2 in FIG. 19, the primitive PMB on which the beam BM is drawn is rotated so that the beam BM appears to be emitted from the beam cannon of the character CH drawn on the texture TEX.

As described above, in this embodiment, the primitives PMV and PMB representing the injection of the jet flame VN and the emission of the beam BM are moved in conjunction with the reproduction of the moving images shown in D1 to D4 in FIG. This makes it possible to realistically express effects such as jet flame VN and beam BM. Also, as will be described later, by controlling the drawing order of the primitive PMV and PMB from the position of the virtual camera VC, it is possible to realize the appearance and gameplay of a 3D model while being a 2D model. ing. That is, in this embodiment, as shown in FIGS. 15A and 15B, a virtual space image including an image of the character CH corresponding to the object POB such as a plastic model is created based on the photographed image of the object POB such as a plastic model. However, the jet flame VN and the beam BM cannot be represented by the real-world object POB. Therefore, the jet flame VN and the beam BM are expressed using primitives PMV and PMB (second primitives) whose relative positional relationship with respect to the primitive PM changes. Then, the relative positional relationship of the primitives PMV and PMB with respect to the primitive PM is changed so as not to contradict the moving image reproduction of the character CH as shown in D1 to D4 in FIG. As a result, it becomes possible to realize effect expression of jet flame VN and beam BM that cannot be expressed with the object POB in the real world.

2.4 Texture Mapping According to Movement Control Information Next, details of the image generation method of this embodiment will be described. FIG. 20 is a flowchart of processing for generating a virtual space image based on a captured image group. First, a group of photographed images obtained by photographing the object POB from a plurality of photographing directions is obtained (step S51). For example, as shown in FIG. 15A , by shooting a movie with the shooting unit 162 , a group of shot images, which are moving images of the object POB, are acquired and loaded into the processing device 200 . Then, the obtained photographed image group is stored in the storage unit 170 (step S52). That is, the data of the photographed image group, which is a moving image, is stored and saved in the memory of the processing device 200 . Next, the texture TEX is generated based on the photographed image selected according to the movement control information of the primitive PM (step S53). For example, based on movement control information (operation input information), a corresponding captured image is selected from a group of captured images such as D1 to D4 in FIG. Generate a texture TEX like this. Then, the texture TEX that changes according to the movement control information is mapped onto the primitive PM that moves according to the movement control information to generate a virtual space image seen from the virtual camera in the virtual space (step S54). For example, as indicated by C1 to C4 in FIG. 18, the primitive PM rotates about the position of the virtual camera VC, or the virtual camera VC and the primitive PM are integrated in accordance with the movement control information (operation input information). to move in translation. Then, the texture TEX that changes in conjunction with the movement of the primitive PM is mapped onto the primitive PM. For example, when the primitive PM rotates leftward about the position of the virtual camera VC as a fulcrum (rotation center) as shown in C1 in FIG. , a photographed image corresponding to the rotation angle of the primitive PM is selected, and the texture TEX based on the selected photographed image is mapped onto the primitive PM. This makes it possible to generate a realistic virtual space image in which the three-dimensional model character CH corresponding to the object POB appears to be moving in the virtual space while using the two-dimensional photographed image.

Further, in the present embodiment, the photographed image group is an image group in which the change in the photographing direction of the photographing unit 162 with respect to the object POB is in the photographing direction range of 180 degrees or more. For example, in FIG. 21, the object POB is photographed by the photographing unit 162 in the photographing direction range RDR in which the change of the photographing direction DCM with respect to the object POB is 360 degrees. For example, in FIG. 21, the angle of the imaging direction DCM of the imaging unit 162 when imaging the back of the object POB is 0 degrees, and the angle of the imaging direction DCM when imaging the left side of the object POB is 0 degrees. The angle is 90 degrees. Further, the angle of the imaging direction DCM when imaging the front of the object POB is 180 degrees, and the angle of the imaging direction DCM when imaging the right side of the object POB is 270 degrees. . A shooting direction range RDR in FIG. 21 is a range in which the shooting direction DCM of the shooting unit 162 changes from 0 degrees to 360 degrees. However, for example, the photographing direction range RDR may be set to 180 degrees such that the photographing direction DCM changes from 0 to 90 degrees and from 360 degrees to 270 degrees. You can also set the direction range.

By using a group of photographed images in which the change in the photographing direction of the photographing unit 162 with respect to the object POB is 180 degrees or more in this manner, even when the primitive PM is rotated in various directions, the photographing direction can be changed. It becomes possible to generate a texture based on a suitable corresponding photographed image and map it to the primitive PM.

Note that FIGS. 15A and 21 show the case where the imaging direction DCM is rotated around the vertical direction along the main axis of the object POB, for example, but the present embodiment is not limited to this. For example, the photographed image group may be obtained by photographing the object POB while rotating the photographing direction DCM about the horizontal direction, which is the direction orthogonal to the main axis of the object POB, as the rotation axis. In this way, even when the primitive PM is rotationally moved in the direction of C3 or C4 in FIG. 18, for example, it is possible to map the texture TEX based on the appropriate photographed image corresponding to the rotational movement to the primitive PM. In FIG. 15A, by rotating the object POB, a group of photographed images in the photographing direction range RDR as shown in FIG. 21 is obtained. A captured image group in the shooting direction range RDR may be acquired by rotating around the center. That is, the photographing unit 162 is moved on a circle centered on the object POB in the photographing direction DCM such that the object POB is gazed at.

Further, when photographing is performed in a plurality of photographing directions as shown in FIG. 21, it is desirable that the number of photographing directions, that is, the number of images in the photographed image group is as large as possible. For example, when the number of image frames per second is p (eg, p=30, 60, etc.), the number of images in the captured image group corresponding to the number of shooting directions is preferably p or more. That is, the object POB is photographed in at least p photographing directions, and a photographed image group including at least p photographed images is acquired. In this way, smooth and well-textured animation can be played back and mapped onto the primitive PM for at least one second.

Further, in this embodiment, a texture to be mapped onto the primitive PM is generated based on the captured image selected from the captured image group (first and second captured image groups) according to the movement control information of the primitive PM. . Specifically, for example, a captured image is selected from the captured image group and a texture is generated based on the selected captured image by performing seek control of a moving image composed of a captured image group based on the movement control information. .

For example, in FIG. 22, the photographed images IM1 to IMj are the photographed image group, and textures are generated from the photographed image group based on the photographed image IMi selected according to the movement control information of the primitive PM, and mapped onto the primitive PM. be. Here, i and j are integers satisfying 1≤i≤j. For example, j is the number of images in the captured image group, and if p is the number of image frames per second as described above, it is desirable that j≧p.

Then, in FIG. 22, seek control of a moving image constituted by a group of photographed images IM1 to IMj is performed based on movement control information. For example, in the case of seek control for rewinding, seek control is performed in the direction DS1 in FIG. 22, and a photographed image corresponding to the movement control information is selected from a group of photographed images IM1 to IMj. On the other hand, in the case of fast-forward seek control, seek control is performed in the direction DS2, and a photographed image corresponding to the movement control information is selected from a group of photographed images IM1 to IMj. For example, it is assumed that seek numbers SN1 to SNj are associated with captured images IM1 to IMj. In this case, for example, one of the seek numbers SN1 to SNj is selected according to the movement control information of the primitive PM, the captured image associated with the selected seek number is selected, the texture is generated, and the primitive Mapped to PM. For example, when the seek number SNi is selected by the movement control information, the captured image IMi associated with the seek number SNi is selected, the texture is generated, and the texture is mapped onto the primitive PM. In this way, it is possible to effectively utilize the seek control of a moving image composed of a group of photographed images, select an appropriate photographed image corresponding to the movement control information of the primitive PM, generate a texture, and map it to the primitive PM. become.

Further, in the present embodiment, the processing of moving the primitive PM and the virtual camera VC according to the movement control information is performed while the positional relationship between the primitive PM and the virtual camera VC is fixed. For example, in FIGS. 23A to 23C, a texture representing an image of the character CH is mapped onto the primitive PM.

Although the image of the character CH is actually a two-dimensional image, FIGS. described in The same applies to the following description.

In FIGS. 23A to 23C, the distance between the virtual camera VC and the primitive PM is constant and fixed. That is, the distance between the viewpoint position PS of the virtual camera VC and the plane of the primitive PM is constant. The primitive PM is arranged so as to face the virtual camera VC, and the primitive PM is arranged so that the line-of-sight direction VL of the virtual camera VC is orthogonal to the plane of the primitive PM. As described above, in this embodiment, the primitive PM and the virtual camera VC are moved in the virtual space while the positional relationship between the primitive PM and the virtual camera VC is fixed. For example, billboard polygons are used as primitive PMs. By doing so, it is possible to generate an image that looks like a pseudo three-dimensional image as an image of a display object such as the character CH that is displayed by mapping the texture onto the primitive PM.

Then, as shown in C1 of FIG. 18, for example, when the player performs an operation input pointing to the left, the viewpoint position of the virtual camera VC changes as shown in FIGS. 23A to 23B. The primitive PM rotates counterclockwise with the PS as a fulcrum (rotation center). At this time, the distance between the virtual camera VC and the primitive PM is constant, and the line-of-sight direction VL of the virtual camera VC is perpendicular to the plane of the primitive PM. With the positional relationship between the primitive PM and the virtual camera VC fixed as described above, the primitive PM and the virtual camera VC are rotationally moved based on the movement control information indicating the left direction as indicated by C1 in FIG. ing. The image of the character CH mapped to the primitive PM at this time is an image obtained by rotating the character CH so that the orientation changes to the left (counterclockwise), as indicated by D2 in FIG. For example, the image of the character CH is an image of the object POB corresponding to the character CH viewed from the left rear side. With this configuration, when the player issues a leftward operation instruction, the image of the character CH turned counterclockwise is displayed as a virtual space image. It is possible to display an appropriate image of the character CH according to the movement control information.

Further, as shown in C2 of FIG. 18, for example, when the player's operation input pointing to the right direction is performed, the viewpoint position of the virtual camera VC is changed as shown in FIGS. The primitive PM rotates clockwise with the PS as a fulcrum. At this time, the distance between the virtual camera VC and the primitive PM is constant, and the line-of-sight direction VL of the virtual camera VC is perpendicular to the plane of the primitive PM. With the positional relationship between the primitive PM and the virtual camera VC fixed as described above, the primitive PM and the virtual camera VC rotate and move based on the movement control information indicating the right direction as indicated by C2 in FIG. ing. At this time, the image of the character CH mapped to the primitive PM is an image obtained by rotating the character CH so that the orientation changes to the right (clockwise) direction. For example, the image of the character CH is an image of the object POB corresponding to the character CH viewed from the rear right. With this configuration, when the player issues a rightward operation instruction, the image of the character CH turned clockwise is displayed as a virtual space image. It is possible to display an appropriate image of the character CH according to the movement control information.

Further, in this embodiment, as shown in FIGS. 15A and 15B, the photographing unit 162 photographs the object POB and the background BG of the object POB. For example, by photographing the background portion 20 in FIG. 15A, a monochromatic background BG is photographed as shown in FIG. 15B. Then, it is determined whether or not the color of each pixel of the photographed image corresponds to the color of the background. Then, when it is determined that the pixel has a color corresponding to the background color, a texture is generated by performing processing to make the pixel having a color corresponding to the background color transparent.

FIG. 24 shows a flowchart of processing for making pixels of a color corresponding to the background color transparent. The processing in FIG. 24 can be implemented by, for example, a pixel shader. First, the color of the pixel to be processed is determined (step S61). Then, it is determined whether or not the color of the pixel to be processed corresponds to the background color (step S62). For example, in the case of a green screen, when the color of the pixel to be processed is green, it is determined that the color corresponds to the background color. In the case of blue background, when the color of the pixel to be processed is blue, it is determined that the color corresponds to the background color. Then, when it is determined that the color of the pixel to be processed corresponds to the color of the background, the pixel to be processed is set to transparent (step S63). Taking the alpha compositing process as an example, if the color of the pixel to be processed is determined to correspond to the color of the background, the alpha value of the pixel to be processed is set to zero. Then, it is determined whether or not all the pixels of the captured image have been processed (step S64), and if all the pixels have not been processed, the pixel to be processed is set to the next pixel (step S65), and step Return to S11. On the other hand, when all the pixels of the captured image have been processed, the process ends.

By performing the processing shown in FIG. 24, the texture TEX shown in FIG. 16B can be generated from the captured image IM shown in FIG. 15B. This makes it possible to generate an appropriate virtual space image in which other objects in the virtual space are displayed in the background BG portion. The processing shown in FIG. 24 can be realized by a pixel shader based on a shader program, and can be realized by simple processing with a light processing load. Therefore, as shown in FIGS. 3(A) and 3(B), the process of photographing the object POB and making the displayed object such as the character CH corresponding to the object POB appear in the virtual space with one action is as follows. It can be easily realized.

Note that the background color does not have to be a fixed color, and the background color may be set variably. For example, the background color is variably set according to the color of the object POB. For example, the background color is set to a color that does not exist in the object POB, or the complementary color of the color of the object POB is set as the background color. Specifically, in FIGS. 3A and 3B, a background portion 20 whose color can be variably set is used. For example, the color of the background portion 20 is variably set by projecting light of a predetermined color, which is the background color, using a projector. Alternatively, a display device such as a curved display device is used as the background portion 20 to display a screen of a predetermined color as the background color, thereby setting the color of the background portion 20 variably. By doing so, it becomes possible to set the background color to an appropriate color according to various objects POB.

In addition, in this embodiment, movement processing is performed for a second primitive whose relative positional relationship with respect to the primitive changes according to the movement control information. Then, an image including the texture-mapped primitive image and the second primitive image is generated as a virtual space image.

For example, in FIG. 25A, the primitives PMV and PMB are arranged as the second primitives with reference to the position of the primitive PM. As described with reference to FIG. 19, the primitive PMV is a primitive for displaying an image of the vernier jet flame VN, and the primitive PMB is a primitive for displaying an image of the beam BM fired by the beam cannon. The images of the jet flame VN and the beam BM may be generated using a three-dimensional object. In this case, the primitives PMV and PMB are polygons or the like that constitute the object.

25(A) to 25(C), as described with reference to FIGS. 23(A) to 23(C), the process of moving the primitive PM according to the movement control information is performed. An image (texture) of the character CH mapped onto the primitive PM is also generated using an appropriate photographed image corresponding to the movement control information. 25(A) to 25(C), the movement processing of the primitives PMV and PMB is performed so that the relative positional relationship with respect to the primitive PM changes according to the movement control information.

For example, in FIG. 25A, an image in which the character CH is directed in the line-of-sight direction VL of the virtual camera VC is mapped onto the primitive PM. Specifically, as in the case where the shooting direction DCM is 0 degree in FIG. 21, the texture generated based on the photographed image of the object POB photographed directly behind is mapped to the primitive PM as the image of the character CH. . In this case, the primitive PMV for the injection flame VN is arranged at the position directly behind the character CH. Also, since the character CH has a beam cannon in its right hand, for example, a primitive PMB for beam BM is arranged in the front right direction of the character CH. As a result, as shown in FIG. 19, an appropriate virtual space image can be generated in which the jet flame VN is jetted from the position of the vernier, which is an auxiliary device, and the beam BM is jetted from the position of the beam cannon.

On the other hand, in FIG. 25B, as indicated by C1 in FIG. 18, the player has issued an operation instruction to the left, and this causes the position of the virtual camera VC to be the fulcrum to turn left (counterclockwise). ), the primitive PM is rotating. Along with such rotational movement of the primitive PM, the image of the character CH mapped on the primitive PM also turns counterclockwise as indicated by D2 in FIG. The relative positional relationship of the primitives PMV and PMB with respect to the primitive PM also changes so that the image of the character CH turns counterclockwise in this way. That is, the relative positional relationship of the primitive PMV with respect to the primitive PM is changed so that the primitive PMV is positioned behind the character CH whose direction is turned counterclockwise. Specifically, the primitive PMV is rotationally moved counterclockwise with respect to the primitive PM. Also, the relative positional relationship of the primitive PMB with respect to the primitive PM is changed so that the primitive PMB is positioned in the front right direction of the character CH whose direction is turned counterclockwise. Specifically, the primitive PMB is rotationally moved counterclockwise with respect to the primitive PM. By doing so, it becomes possible to generate an appropriate virtual space image in which the jet flame VN is ejected from the position of the vernier and the beam BM is emitted from the position of the beam cannon.

In FIG. 25(C), as shown at C2 in FIG. 18, the player has given an operation instruction to the right, and as a result, the virtual camera VC moves to the right (clockwise) with the position of the virtual camera VC as a fulcrum. A primitive PM is rotating. Along with such rotational movement of the primitive PM, the image of the character CH mapped on the primitive PM also turns clockwise. The relative positional relationship of the primitives PMV and PMB with respect to the primitive PM also changes so that the image of the character CH turns clockwise in this way. That is, the primitive PMV is rotationally moved clockwise on the basis of the primitive PM so that the primitive PMV is positioned behind the character CH whose direction has been turned clockwise. Also, the primitive PMB is rotationally moved clockwise on the basis of the primitive PM so that the primitive PMB is positioned in the front right direction of the character CH whose direction is changed clockwise. By doing so, it becomes possible to generate an appropriate virtual space image in which the jet flame VN is ejected from the position of the vernier and the beam BM is emitted from the position of the beam cannon.

Further, in this embodiment, the hidden surface removal processing of the second primitive is performed according to the movement control information. For example, in FIG. 25B, the image of the beam BM is an image that should be hidden behind the character CH when viewed from the virtual camera VC. For example, in the positional relationship shown in FIG. 25A, the image of the beam BM is an image that should be displayed without being hidden by the character CH. However, when the primitive PM is rotationally moved as shown in FIG. 25B and the primitive PMB is rotationally moved counterclockwise with respect to the primitive PM, the image of the beam BM of the primitive PMB is hidden by the character CH. Becomes an image that should be displayed. Therefore, in this case, processing for hidden surface elimination is performed on the primitive PMB for the beam BM. By performing the hidden surface removal processing of the primitive PMB in this way, the image of the beam BM is hidden from the virtual camera VC, and an appropriate virtual space image can be generated. That is, normally, hidden surface removal processing is performed by judging the anteroposterior relationship (depth value) of the primitives PM, PMV, and PMB as seen from the virtual camera VC. In this regard, in this embodiment, the hidden surface removal process is performed by judging the anteroposterior relationship between the character CH mapped onto the primitive PM and the beam BM or jet flame VN based on the movement control information. By doing so, it becomes possible to generate a virtual space image in which hidden surface removal has been appropriately performed.

Further, in this embodiment, processing is performed to move the second primitive based on the primitive PM from the initial placement position of the second primitive set based on the analysis result of the target object POB. For example, in FIG. 26, the injection position of the injection flame VN of the vernier and the emission position of the beam BM are specified by performing analysis processing such as silhouette analysis of the object POB. That is, the ejection position of the jet flame VN and the ejection position of the beam BM differ according to the type and shape of the object POB. Therefore, by performing analysis processing such as silhouette analysis based on the photographed image of the object POB, the type and shape of the object POB are specified, and the ejection position of the jet flame VN and the emission position of the beam BM are specified. Then, as shown in FIG. 26, the specified injection position of the injection flame VN is set to the initial placement position PI1 of the primitive PMV for the injection flame VN. Also, the identified beam BM emission position is set to the initial arrangement position PI2 of the primitive PMB for the beam BM. Then, as shown in FIGS. 25A to 25C, the primitives PMVs and PMBs are moved from these initial placement positions PI1 and PI2 based on the primitives PMVs. That is, with PI1 and PI2 as initial placement positions, the primitives PMV and PMB are rotationally moved with reference to the primitive PMV. In this way, the primitives PMV and PMB are placed at the appropriate initial placement positions PI1 and PI2 according to the analysis result of the target object POB, and when the primitive PM moves according to the movement control information, the movement is interlocked with the movement. The image of the injection flame VN and the image of the beam BM can be displayed at the appropriate position.

In the target object POB, markers are attached to the jetting position of the jet flame VN and the emitting position of the beam BM, and in the analysis processing of the target object POB, the initial arrangement position of the second primitive is obtained by performing the recognition processing of these markers. may be determined. That is, the initial arrangement position PI1 of the primitive PMV for the jet flame VN and the initial arrangement position PI2 of the primitive PMB for the beam BM are determined based on the result of the marker recognition processing.

In this embodiment, the images of the jet flame VN and the beam BM, which are the images of the primitive PMV and PMB, are effect images. That is, in the present embodiment, the image of the object POB is photographed by the photographing unit 162 to generate the texture and display the image of the character CH corresponding to the object POB. cannot be photographed by photographing by the photographing unit 162 . Therefore, in the present embodiment, images of effects such as jet flame VN and beam BM are generated using primitives PMV and PMB arranged relative to primitive PM. In this way, an effect image that cannot be photographed by the photographing unit 162 can be displayed along with the image of the character CH corresponding to the object POB.

Also, in this embodiment, an image including a primitive image and images of a plurality of objects set in the virtual space is generated as the virtual space image, and post-effect processing is performed on the generated virtual space image. For example, in FIG. 27, as virtual space images, an image of a character CH, which is an image of a primitive PM, and an image including rock objects OB1, OB2, and OB3 set in the virtual space and an object image of an enemy character CHE are generated. ing. Then, post-effect processing is performed on the virtual space image generated in this way. For example, post-effect processing such as blur processing, brightness adjustment processing, or hue adjustment processing is performed. For example, post-effect processing is performed on the virtual space image in which the other objects OB1, OB2, OB3, etc. are displayed so that the image of the character CH represented by the primitive PM is displayed in a natural manner. For example, post-effect processing is performed to blur the outline of the character CH represented by the primitive PM so that the outline, which is the boundary between the character CH and the virtual space image, becomes inconspicuous. Also, if there is a difference between the brightness of the image of the character CH and the brightness of the surrounding virtual space image, post-effect processing is performed to reduce this difference. By doing so, it is possible to generate a high-quality and realistic virtual space image in which the image of the character CH generated based on the captured image blends seamlessly into the surrounding virtual space.

Further, in this embodiment, a group of photographed images for another display object obtained by photographing another object corresponding to another display object from a plurality of photographing directions is acquired. Then, according to the movement control information for the other display object, the texture for the other display object is generated based on the photographed image selected from the group of photographed images for the other display object. Then, the texture for the other display object, which changes according to the movement control information for the other display object, is mapped to the primitive for the other display object to generate a virtual space image. Here, another display object is, for example, an enemy character.

For example, in FIG. 28, a virtual space image including images of enemy characters CHE1 and CHE2, which are other displayed objects, is generated. In this case, a group of photographed images obtained by photographing objects corresponding to enemy characters CHE1 and CHE2 from a plurality of photographing directions is obtained. For example, in the same manner as in FIGS. 15A and 15B, plastic models of enemy robots corresponding to enemy characters CHE1 and CHE2 are photographed from a plurality of photographing directions. (for display object) is acquired. Textures TEXE1 and TEXE2 for the enemy characters CHE1 and CHE2 are generated based on the captured images selected from the group of captured images for the enemy characters CHE1 and CHE2 according to the movement control information for the enemy characters CHE1 and CHE2. That is, the enemy characters CHE1 and CHE2 move in the virtual space based on the movement control information for the enemy characters CHE1 and CHE2. Based on the movement control information for the enemy characters CHE1 and CHE2, captured images are selected from a group of captured images for the enemy characters CHE1 and CHE2 to generate textures TEXE1 and TEXE2 for the enemy characters CHE1 and CHE2. By doing so, textures TEXE1 and TEXE2 that reflect the movement control information can be generated, as in the case of the player's character CH. Then, as shown in FIG. 28, a virtual space image is generated by mapping the generated textures TEXE1 and TEXE2 onto the primitives PME1 and PME2 for the enemy characters CHE1 and CHE2.

In this manner, for the enemy characters CHE1 and CHE2, as in the case of the character CH, an effect can be achieved in which plastic models of the enemy robots, which are objects corresponding to the enemy characters CHE1 and CHE2, appear in the virtual space. be possible. As a result, it is possible to realize an unprecedented game in which the plastic model of the player's robot and the plastic model of the enemy robot compete in a virtual space. In addition, the images of the enemy characters CHE1 and CHE2 can also be images that reflect the movement control information for the enemy characters CHE1 and CHE2, making it possible to generate more realistic images. For example, in FIG. 28, for the enemy character CHE1, an image is generated that looks forward right with respect to the primitive PME1, and an image of the enemy character CHE1 that faces the character CH is generated as a virtual space image. become. As for the enemy character CHE2, an image is generated that looks forward left based on the primitive PME2, and an image of the enemy character CHE2 that faces the character CH is generated as a virtual space image. As a result, the player's sense of virtual reality can be improved.

Also, in this embodiment, an image in which particles are displayed around the primitive PM is generated as a virtual space image. For example, in FIG. 29, particles PT are generated around the primitive PM on which the image of the character CH is mapped. The display processing of the particles PT is processing for representing an event composed of particles in motion, and for example, controls the movement of the particles PT by physics simulation. For example, more precise particle control can be achieved by setting environmental conditions such as the initial velocity and weight of the particles PT, gravity, and air resistance when they are generated. As an example, the storage unit 170 is provided with a buffer for managing the vertex coordinates of the particles PT, and the behavior of the particles PT is controlled by recursively performing shader calculations.

That is, in the present embodiment, the image of the character CH that looks like a pseudo three-dimensional image is generated using the two-dimensional captured image of the object POB. On the other hand, other objects in the virtual space are represented by three-dimensional models. Therefore, unless some measures are taken, the image of the character CH, which is a pseudo three-dimensional image, and the image of another object, which is a three-dimensional model, will cause a sense of incongruity, and the player's sense of virtual reality will be spoiled. There is a risk of loss. In this regard, if the particles PT are generated around the primitive PM on which the image of the character CH is mapped as shown in FIG. It becomes possible to create a three-dimensional sense of space. This makes it possible to give the player a virtual reality feeling as if the three-dimensional model character CH were moving in a three-dimensional virtual space.

FIG. 30 shows an application example of the game system of this embodiment to a commercial game device 210 . In the game system of FIG. 30, in addition to the commercial game device 210, which is the main device, a photographing section 162, an arrangement section 10 in which the object POB is arranged, and a rotational movement mechanism 12 are provided. Specifically, in the game system of FIG. 30, a shooting housing 220 is provided, and this shooting housing 220 is provided with a shooting section 162 , a placement section 10 , and a rotational movement mechanism 12 . A background section 20 is also provided in the imaging housing 220 . The rotational movement mechanism 12 is a mechanism that performs rotational movement for changing the photographing direction of the photographing unit 162 with respect to the object POB arranged in the arrangement unit 10 . In FIG. 30, the rotational movement mechanism 12 rotates the placement unit 10 to change the photographing direction of the photographing unit 162 with respect to the object POB. The game device 210 (body-side housing) and the shooting housing 220 are connected for communication, for example, by wire or wirelessly. ing.

In the game system shown in FIG. 30, the player first places an object POB, such as a plastic model of a robot that the player wishes to photograph, in the placement section 10 of the housing 220 for photography. Then, when the player performs an operation for instructing, for example, photographing on the game device 210, the rotation movement mechanism 12 rotates the placement unit 10, and the photographing unit 162 moves the object within a 360-degree photographing direction range as shown in FIG. Take a picture of the POB. Data of the moving image (captured image group) obtained by shooting is transferred to the game device 210 and stored in the storage unit 170 of the game device 210 . As shown in FIGS. 3A and 3B, the player can play a game in which the character CH corresponding to the object POB appears in the virtual space with one action after photographing the object POB. become. As a result, the player can make the character CH corresponding to the object POB such as a plastic model owned by the player appear in the virtual space and enjoy the game using the character CH, realizing an unprecedented game. becomes possible.

Although the present embodiment has been described in detail as above, those skilled in the art will easily understand that many modifications are possible without substantially departing from the novel matters and effects of the present disclosure. Accordingly, all such modifications are intended to be included within the scope of this disclosure. For example, a term (plastic model, character, etc.) that is described at least once in the specification or drawings together with a different term (object, display object, etc.) that has a broader definition or has the same meaning cannot be used anywhere in the specification or drawings. Different terms can be substituted. In addition, the acquisition processing of the photographed image group, the primitive movement processing, the texture generation processing, the virtual space image generation processing, etc. are not limited to those described in the present embodiment, and equivalent methods, processing, and configurations are also possible in the present invention. Included within the scope of disclosure.

CP1-CP4 posted content, PV1-PV4 game videos,
PIM1 to PIM4 Posted image, POB, POB1, POB2 Object,
PM, PMV, PMB, PME1, PME2 primitives,
TEX, TEXE1, TEXE2 Texture, PT Particle,
CH character, CHE, CHE1, CHE2 enemy character,
OB1 to OB3 Object, IM Photographed image, BG Background,
RDR shooting direction range, VC virtual camera, VL viewing direction,
PS viewpoint position, RL rail, VM view volume,
VN jet flame, BM beam, DCM shooting direction, TM, TM1, TM2 terminal device,
10 arrangement part, 12 rotation movement mechanism, 20 background part,
100 processing unit, 102 posting processing unit, 104 parameter setting unit,
106 game processing unit, 108 editing processing unit, 110 acquisition unit,
111 analysis unit, 112 movement processing unit, 114 texture generation unit,
120 image generation unit, 130 sound generation unit, 160 operation unit, 162 imaging unit,
170 storage unit, 172 impression information storage unit, 174 parameter storage unit,
176 captured image information storage unit, 177 virtual space information storage unit,
178 drawing buffer, 180 information storage medium, 190 display unit, 192 sound output unit,
194 I/F unit, 195 portable information storage medium, 196 communication unit,
200 processing device, 210 game device, 220 shooting housing,
500 server system, 510 network

Claims (15)

a posting processing unit that performs a process of posting a captured image of an object, which is an object in real space, captured by a shooting unit on a posting site as posted content;
a parameter setting unit that acquires impression information of the posted content by a user who viewed the posted content on the posting site, and sets game parameters based on the acquired impression information;
a texture generation unit that generates an image of the object appearing in the captured image as a texture;
performing game processing in which the character appears in a game by generating an image of the character corresponding to the object by mapping the texture, and setting game parameters for the character based on the impression information ; a game processing unit that performs the game processing of the game played by the player who is the contributor of the posted content, based on the game parameters;
A game system comprising: a posting processing unit that performs a process of posting a captured image of an object, which is an object in real space, captured by a shooting unit on a posting site as posted content;
a parameter setting unit that acquires impression information of the posted content by a user who viewed the posted content on the posting site, and sets game parameters based on the acquired impression information;
An image of the character is generated based on the image of the object appearing in the photographed image and a primitive for representing the character corresponding to the object, and the character appearing in the game is moved by movement control of the primitive. A game process for moving is performed, game parameters for the character are set based on the impression information, and the game is played by the player who is the poster of the posted content based on the game parameters. a game processing unit that performs processing;
A game system comprising: In claim 2,
a texture generation unit that generates a texture of the image of the object appearing in the captured image;
The game processing unit
A game system characterized by generating an image of the character corresponding to the object by mapping the texture.. In any one of claims 1 to 3 ,
The parameter setting unit
A basic parameter value of the game parameter is set based on an analysis result of the object appearing in the posted content, and the game parameter set to the basic parameter value is changed based on the impression information. game system. In claim 4 ,
The parameter setting unit
A game characterized in that analysis processing of the object is performed based on the photographed image of the object photographed by the photographing unit, and the basic parameter value is set based on the analysis result of the analysis processing. system. In any one of claims 1 to 5 ,
The game system, wherein the impression information is information on the number of times the posted content has been supported, information on the number of views, information on the viewing time, or information on the number of times the posted content has been transmitted to other users. In any one of claims 1 to 6 ,
The parameter setting unit
Depending on whether or not the user who gives the impression information to the posted content by browsing the posted content on the posting site is a player having a predetermined relationship with the player, the game parameters may be set. A game system characterized by changing the impression information to be used. In any one of claims 1 to 7 ,
The parameter setting unit
A game system, wherein personal information of the player is set based on the posted information of the player, and the impression information used for setting the game parameters is changed according to the set personal information. In claim 8 ,
The game system, wherein the posted information is information on the number of pieces of content posted by the player, the number of times of posting, or cumulative time of posting. In any one of claims 1 to 9 ,
The game processing unit
performing a process of allowing the player to acquire game points according to the result of the game played by the player;
The post processing unit is
A game system characterized by performing a process of consuming the game points of the player when the player posts the posted content. In any one of claims 1 to 10 ,
The post processing unit is
performing a process of associating a game ID of the game played by the player with the posted content posted by the player;
The parameter setting unit
A game system characterized by acquiring the impression information of the posted content associated with the game ID, and setting the game parameters of the game corresponding to the game ID based on the acquired impression information. . In claim 1 or 3 ,
a storage unit that stores a group of photographed images obtained by photographing the object from a plurality of photographing directions by the photographing unit;
a movement processing unit that performs processing for moving primitives in a virtual space;
an image generator;
including
The texture generation unit
generating the texture to be mapped to the primitive based on the group of captured images ;
The image generator is
A game system, wherein the texture is mapped onto the primitive to generate a virtual space image viewed from a virtual camera in the virtual space. In claim 12 ,
The movement processing unit
performing a process of moving the primitive in the virtual space based on the movement control information;
The texture generation unit
generating the texture to be mapped to the primitive based on the captured image selected from the captured image group according to the movement control information of the primitive;
The image generator is
A game system, wherein the texture that changes according to the movement control information is mapped onto the primitive to generate the virtual space image. a posting processing unit that performs a process of posting a captured image of an object, which is an object in real space, captured by a shooting unit on a posting site as posted content;
a parameter setting unit that acquires impression information of the posted content by a user who viewed the posted content on the posting site, and sets game parameters based on the acquired impression information;
a texture generation unit that generates an image of the object appearing in the captured image as a texture;
performing game processing in which the character appears in a game by generating an image of the character corresponding to the object by mapping the texture, and setting game parameters for the character based on the impression information ; A game processing unit that performs the game processing of the game played by the player who is the poster of the posted content based on the game parameters,
A program characterized by making a computer work. a posting processing unit that performs a process of posting a captured image of an object, which is an object in real space, captured by a shooting unit on a posting site as posted content;
a parameter setting unit that acquires impression information of the posted content by a user who viewed the posted content on the posting site, and sets game parameters based on the acquired impression information;
An image of the character is generated based on the image of the object appearing in the photographed image and a primitive for representing the character corresponding to the object, and the character appearing in the game is moved by movement control of the primitive. A game process for moving is performed, game parameters for the character are set based on the impression information, and the game is played by the player who is the poster of the posted content based on the game parameters. As a game processing unit that performs processing,
A program characterized by making a computer work.

Images