JP6362634B2 - Image generation system, game device, and program - Google Patents

Description

The present invention relates to an image generation system , a game device, a program, and the like.

  2. Description of the Related Art Conventionally, an image generation system of a type that captures a subject such as a player and reflects a captured image on a game character or the like is known. As a conventional technique of such an image generation system, for example, there is a technique disclosed in Patent Document 1. In this prior art, a character is formed by combining a real image from the imaging unit and a graphics image from the graphics storage unit, and the formed character is displayed on the screen of the display unit.

JP-A-7-192143

  According to this prior art, it is possible to enjoy a game by displaying on the screen a character synthesized with a captured image of the player. However, no consideration has been given to the problem of the arrangement relationship between the character synthesized with the player's captured image and other characters.

  According to some aspects of the present invention, it is possible to provide an image generation system, a program, and the like that can generate a composite image in which a subject image or a subject character connected to the subject image and a character are appropriately arranged.

  According to one aspect of the present invention, an input processing unit that acquires a captured image of a subject, an overlap determination unit that performs an overlap determination process, and a synthesis target image including a character image are cut out from the captured image of the subject. An image generation unit that generates a composite image obtained by combining the subject images, and the overlap determination unit performs an overlap determination process between the character and the subject image or a subject character connected to the subject image, When it is determined that the character and the subject image or the subject character overlap each other, the image generation unit performs a rearrangement process so that the character and the subject image or the subject character do not overlap each other. And an image generation system for generating the composite image. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  In one aspect of the present invention, an image in which a subject image is combined with a combining target image including a character image is generated. In this case, an overlap determination between the character and the subject image or the subject character is performed, and when it is determined that they overlap, a relocation process is performed so that the character does not overlap the subject image or the subject character. Is called. By performing such rearrangement processing, it is possible to generate a composite image in which a subject image or a subject character connected to the subject image and a character are appropriately arranged.

  In the aspect of the invention, the subject image is a face image of the subject, the overlap determination unit performs an overlap determination process between the character and the face image of the subject, and the image generation unit includes: If it is determined that the character and the face image of the subject overlap, the rearrangement process is performed so that the character and the face image of the subject do not overlap, and the composite image is It may be generated.

  In this way, when an image in which the face image of the subject is combined with the composition target image including the character image is generated, the rearrangement processing is performed so that the character and the face image of the subject do not overlap. Will be done. Accordingly, it is possible to suppress the generation of a composite image in which the character and the subject's face image have an inappropriate composition.

  In one aspect of the present invention, the subject character is a model object composed of a plurality of objects, and the image generation unit is configured to display the subject image at a predetermined position of the model object as an image of the subject character. An image in which is displayed may be generated.

  In this way, it is possible to generate a subject character image in which a subject image is displayed in a predetermined portion of the subject character and a model object image is displayed in the other portion.

  In the aspect of the invention, the image generation unit may generate the synthesized image in which a synthesis position of the subject image in the synthesis target image changes according to the movement of the subject.

  In this way, when the subject moves, the composition position of the subject image changes, and there is a possibility that the character and the subject image overlap each other. Can be prevented.

  In the aspect of the invention, the subject character is a model object including a plurality of objects, and the image generation unit is arranged in the object space at a position corresponding to the position of the subject. The subject character image may be generated by performing the rendering process.

  In this way, a model object image arranged and rendered in the object space can be displayed as an image of the subject character, so that a higher quality composite image can be generated.

  In the aspect of the invention, when the rearrangement process is performed, the image generation unit performs the rendering process of the model object arranged at the rearrangement position in the object space based on the illumination model. Then, an image of the subject character may be generated.

  In this way, it is possible to generate an image of a model object that is appropriately shaded at the rearrangement position as the image of the subject character.

  In one embodiment of the present invention, a subject information acquisition unit that acquires skeleton information of the subject based on sensor information from a sensor, and a character that performs processing for moving the subject character based on the skeleton information of the subject A processing unit (a subject information acquisition unit and a character processing unit that function as a computer), and the image generation unit includes an arrangement position of the model object that is the subject character in the object space, and a shape of the model object The rearrangement process may be performed using at least one of the arrangement positions of the objects constituting the model object.

  In this way, it is possible to identify the movement of the subject based on the skeleton information acquired based on the sensor information and generate an image of the subject character that moves according to the movement of the subject. Then, when the model object that is the subject character is placed in the object space, the rearrangement process is performed using the placement position and shape of the model object or the placement positions of the objects constituting the model object. As a result, relocation processing that effectively uses the skeleton information can be realized.

  In the aspect of the invention, the image generation unit may generate a plurality of the composite images having different rearrangement modes by the rearrangement process.

  In this way, it is possible to reduce the unnatural feeling that the player feels with respect to the composite image obtained by the rearrangement process, increase the variety of the images that are selection candidates, and the like.

  Further, according to one aspect of the present invention, the image processing apparatus may include a print processing unit that performs processing for printing an image selected from the plurality of composite images on a print medium (even if a computer functions as the print processing unit). Good).

  In this way, an image selected from the composite images in various rearrangement modes can be printed on the print medium and provided to the player.

  In the aspect of the invention, the image generation unit may perform a size change process on at least one of the character, the subject character, and the subject image during the rearrangement process.

  In this way, the balance of the composition in the composite image after the rearrangement process can be appropriately adjusted by the process of changing the size of the character, the subject character, or the subject image.

  In the aspect of the invention, the image generation unit may change the size of the character according to the size of the subject character or the subject image.

  In this way, even when the composition balance of the composite image is deteriorated due to, for example, the size of the subject character or the subject image, this can be solved by performing the character size changing process.

  In the aspect of the invention, the image generation unit may change the size of at least one of the subject character and the subject image according to the size of the character.

  In this way, even when the composition balance of the composite image is deteriorated due to the size of the character, for example, this can be solved by performing the process of changing the size of the subject character or the subject image.

  In the aspect of the invention, the image generation unit may change the size change rate of the subject character and the size of the subject image when changing the size of the subject character and the subject image according to the size of the character. The rate of change may be different.

  In this way, even when the size of the subject character and the subject image is changed and the size balance between the two becomes worse, the size change rate of the subject character is different from the size change rate of the subject image. , This will be solved.

  In the aspect of the invention, the image generation unit may perform color information change processing for at least one of the character, the subject character, and the subject image during the rearrangement processing.

  In this way, the color information of the character, the subject character, or the subject image can be adjusted in the composite image after the rearrangement process, and a higher-quality composite image can be provided.

  In the aspect of the invention, the image generation unit may perform the color information changing process according to the degree of association between the character and the subject character.

  In this way, in the composite image after the rearrangement process, appropriate color information can be adjusted according to the degree of association between the character and the subject character.

  In one aspect of the present invention, the image generation unit may perform a boundary region between the character and the subject character or a boundary region between the character and the subject image during the rearrangement process. Decoration processing may be performed.

  In this way, it becomes possible to adjust the boundary area between the character after the rearrangement processing and the subject character or the subject image so as not to stand out.

  In one aspect of the present invention, the subject character and the character are model objects configured by a plurality of objects, and the image generation unit is configured to include the subject character and the character that are the model objects arranged in an object space. The rearrangement process of changing at least one of the position and the direction of at least one of the subject character and the character in the object space when it is determined that there is an overlap with the virtual camera May be performed.

  In this way, when the subject character and the character are model objects arranged in the object space, the subject character and the character overlap as seen from the virtual camera by changing the position and direction of the subject character and the character. Can be realized.

  In one embodiment of the present invention, a game processing unit that performs a game process is included (a computer is caused to function as the game processing unit), and the image generation unit is configured to perform a game process between the subject character and the character during the game process. And performing the rearrangement process for changing at least one of the position and direction of at least one of the subject character and the character in the object space when it is determined that there is an overlap when viewed from the virtual camera. Also good.

  In this way, in the game, by changing the position and direction of the subject character and the character, the rearrangement process is performed to suppress the overlap between the subject character and the character viewed from the virtual camera. An image viewed from the camera can be generated.

  In one aspect of the present invention, when the image generation unit determines that there is an overlap between the subject character and the character when viewed from the virtual camera set at the first viewpoint position, While changing the position of the virtual camera to a second viewpoint position different from the first viewpoint position, the rearrangement process for changing the direction of the subject character and the character may be performed.

  In this way, when viewed from the virtual camera at the first viewpoint position, even if the subject character and the character overlap, the virtual camera position is changed to the second viewpoint position, and the subject character and By changing the direction of the character (the direction in which it faces), it becomes possible to generate an image that does not appear to overlap.

1 is a configuration example of an image generation system according to the present embodiment. An application example of the image generation system of the present embodiment to a game machine for business use. 3A and 3B show application examples of the image generation system of the present embodiment to a home game device and a personal computer. 4A and 4B show examples of depth information and body index information. Explanatory drawing of skeleton information. Explanatory drawing of the image-synthesis method of a character image and a player's face image. FIG. 7A shows an example of a captured image of a player, and FIG. 7B shows an example of a combined image of a character and a face image. The example of the game image produced | generated by this embodiment. FIG. 9A and FIG. 9B are explanatory diagrams of the problem of overlap between the player's face image and the character. Explanatory drawing of the rearrangement method of this embodiment. FIGS. 11A and 11B show examples of setting the facial areas of various characters. Explanatory drawing of the other example of the rearrangement method of this embodiment. Explanatory drawing of the method of moving a character according to a player's motion. Explanatory drawing of the method of operating a character using skeleton information. Explanatory drawing of the rendering process of a model object. An example of model object information. Explanatory drawing of the method of producing | generating the some synthesized image from which a rearrangement aspect differs. 18A and 18B are explanatory diagrams of a method for changing the character size in accordance with the player character size. FIGS. 19A and 19B are explanatory diagrams of a technique for changing the size of the player character in accordance with the size of the character. FIG. 20A shows an example of a size change rate, and FIG. 20B shows an example of a table that associates player characters with characters. Explanatory drawing of the method of changing the color information of a player character, a character, or a face image. Explanatory drawing of the decoration process in a border area. Explanatory drawing of the modification of this embodiment. FIG. 24A and FIG. 24B are also explanatory diagrams of modifications of the present embodiment. FIG. 25A and FIG. 25B are also explanatory diagrams of a modified example of the present embodiment. The flowchart which shows the detailed process example of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Image Generation System FIG. 1 shows a configuration example of an image generation system (image generation apparatus, game system, game apparatus) of the present embodiment. The image generation system includes a processing unit 100, an operation unit 160, a sensor 162, a storage unit 170, a display unit 190, a sound output unit 192, an I / F unit 194, a communication unit 196, and a printing unit 198. Note that the configuration of the image generation system of the present embodiment is not limited to that shown in FIG. 1, and various modifications may be made such as omitting some of the components (each unit) or adding other components.

  The processing unit 100 performs various processes such as an input process, an arithmetic process, and an output process based on operation information from the operation unit 160, sensor information from the sensor 162, a program, and the like.

  Each processing (each function) of this embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the function of each unit may be realized by individual hardware, or the function of each unit may be realized by integrated hardware. The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Processing Unit) can be used. The processor may be an ASIC hardware circuit. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD) or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and the processing (function) of each unit of the processing unit 100 is realized by executing the instructions by the processor. The instruction here may be an instruction set constituting a program, or an instruction for instructing an operation to the hardware circuit of the processor.

  The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The input processing unit 102 performs various types of information input processing. For example, the input processing unit 102 performs a process of receiving player operation information input by the operation unit 160 as an input process. For example, a process of acquiring operation information detected by the operation unit 160 is performed. Further, the input processing unit 102 performs a process of acquiring sensor information from the sensor 162 as an input process. The input processing unit 102 performs a process of reading information from the storage unit 170 as an input process. For example, a process of reading information specified by the read command from the storage unit 170 is performed. Further, the input processing unit 102 performs processing for receiving information via the communication unit 196 as input processing. For example, processing for receiving information from an external device (another image generation system, server system, etc.) of the image generation system via the network is performed. The reception process is a process of instructing the communication unit 196 to receive information, acquiring information received by the communication unit 196, and writing the information in the storage unit 170.

  The arithmetic processing unit 110 performs various arithmetic processes. For example, the arithmetic processing unit 110 performs arithmetic processing such as game processing, object space setting processing, character processing, game results calculation processing, virtual camera control processing, image generation processing, or sound generation processing. The calculation processing unit 110 includes a game processing unit 111, an object space setting unit 112, a character processing unit 113, a subject information acquisition unit 114, an overlap determination unit 115, a game score calculation unit 118, a virtual camera control unit 119, and an image generation unit 120. A sound generation unit 130 and a print processing unit 132.

  The game process includes a process for starting a game when a game start condition is satisfied, a process for advancing the game, or a process for ending a game when a game end condition is satisfied. This game processing is executed by the game processing unit 111 (game processing program module).

  The object space setting process is a process for arranging and setting a plurality of objects in the object space. This object space setting process is executed by the object space setting unit 112 (a program module for the object space setting process). For example, the object space setting unit 112 includes characters (people, robots, animals, monsters, airplanes, ships, fighters, tanks, battleships, cars, etc.), maps (terrain), buildings, courses (roads), trees that appear in the game. Various objects representing objects such as walls and water surfaces (objects composed of primitive surfaces such as polygons, free-form surfaces or subdivision surfaces) are arranged and set in the object space. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects. Specifically, the object information storage unit 172 of the storage unit 170 stores object information that is information such as the position, rotation angle, movement speed, and movement direction of the object (part object) in association with the object number. . The object space setting unit 112 performs processing for updating the object information for each frame, for example.

  Character processing (moving body calculation processing) is various calculation processing performed on a character (moving body). For example, the character processing is processing for moving a character (display object appearing in a game) in an object space (virtual three-dimensional space, three-dimensional game space) or processing for moving the character. This character processing is executed by the character processing unit 113 (character processing program module). For example, the character processing unit 113 uses a character (model) based on operation information input by the player through the operation unit 160, sensor information from the sensor 162, a program (movement / motion algorithm), various data (motion data), and the like. Control processing for moving the object) in the object space and moving the character (motion, animation) is performed. Specifically, a simulation process for sequentially obtaining character movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) every frame (for example, 1/60 second). I do. The frame is a unit of time for performing character movement / motion processing (simulation processing) and image generation processing.

  The game score calculation process is a process of calculating the player's game score. For example, the game score calculation process is a process for calculating points and points that the player acquires in the game, and a process for calculating game results such as in-game currency, medals or tickets. This game score calculation processing is executed by the game score calculation unit 118 (program module for game score calculation processing).

  The virtual camera control process is a process for controlling a virtual camera (viewpoint, reference virtual camera) for generating an image that can be seen from a given (arbitrary) viewpoint in the object space. This virtual camera control process is executed by the virtual camera control unit 119 (virtual camera control process program module). Specifically, the virtual camera control unit 119 controls processing (viewpoint position, line-of-sight direction or image) for controlling the position (X, Y, Z) or rotation angle (rotation angle around the X, Y, Z axes) of the virtual camera. Process to control corners).

  The image generation processing is processing for generating an image (game image) displayed on the display unit 190 and an image printed by the printing unit 198, and may include various image composition processing and image effect processing. it can. The sound generation process is a process for generating a sound (game sound) such as BGM, sound effect, or sound output from the sound output unit 192, and can include various sound synthesis processes, sound effect processes, and the like. . These image generation processing and sound generation processing are executed by the image generation unit 120 and the sound generation unit 130 (program modules for image generation processing and sound generation processing).

  For example, the image generation unit 120 performs drawing processing based on the results of various processing (game processing and simulation processing) performed by the processing unit 100, thereby generating an image and outputting the image to the display unit 190. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image information in units of pixels such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. Thereby, an image that is visible from a given viewpoint (virtual camera) in the object space is generated. Note that the drawing processing performed by the image generation unit 120 may be realized by vertex shader processing, pixel shader processing, or the like.

  The output processing unit 140 performs various types of information output processing. For example, the output processing unit 140 performs a process of writing information in the storage unit 170 as an output process. For example, a process of writing information specified by the write command to the storage unit 170 is performed. Further, the output processing unit 140 performs a process of outputting the generated image information to the display unit 190 and outputting the generated sound information to the sound output unit 192 as an output process. The output processing unit 140 performs a process of transmitting information via the communication unit 196 as an output process. For example, processing for transmitting information to an external device (another image generation system, server system, etc.) of the image generation system via a network is performed. The transmission process is a process of instructing the communication unit 196 to transmit information, or instructing the communication unit 196 to transmit information. Further, the output processing unit 140 performs processing for transferring an image to be printed on the print medium to the printing unit 198 as output processing.

  The operation unit 160 (operation device) is used by a player (user) to input operation information, and functions thereof are direction instruction keys, operation buttons, analog sticks, levers, various sensors (angular velocity sensor, acceleration sensor, etc.). ), A microphone or a touch panel display.

  The sensor 162 detects sensor information for acquiring subject information. The sensor 162 can include, for example, a color sensor 164 (color camera) and a depth sensor 166 (depth camera).

  The storage unit 170 (memory) serves as a work area for the processing unit 100, the communication unit 196, and the like, and its functions can be realized by a RAM, an SSD, an HDD, or the like. Then, the game program and game data necessary for executing the game program are held in the storage unit 170. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

  An information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and functions as an optical disk (DVD, CD, etc.), HDD (hard disk drive), memory (ROM, etc.), etc. Can be realized. The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. A program for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment on the information storage medium 180 (a program for causing the computer to execute processing of each unit). I can remember.

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by an LCD, an organic EL display, a CRT, an HMD, or the like. The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC for I / F processing or the like. The portable information storage medium 195 is for a user to save various types of information, and is a storage device that retains storage of such information even when power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

  The communication unit 196 communicates with an external device (another image generation system, server system, etc.) via a network, and functions thereof include hardware such as a communication ASIC or a communication processor, This can be realized by communication firmware.

  The printing unit 198 prints an image on a print medium such as print paper or sticker paper. The printing unit 198 can be realized by, for example, a printing head, a printing medium feeding mechanism, or the like. Specifically, the print processing unit 132 (print processing program module) of the processing unit 100 performs processing for selecting a print target image, and instructs the printing unit 198 to print the selected print target image. . Thereby, the printed matter on which the print target image is printed is paid out from a payout port 152 in FIG. 2 described later. The print target image is, for example, an image obtained by photographing the player's character during the game, or a commemorative photo image taken together with the player's character and another character.

  Note that a program (data) for causing a computer to function as each unit of the present embodiment is transferred from the information storage medium included in the server system (host device) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. You may distribute. Use of the information storage medium by such a server system can also be included in the scope of the present invention.

  2, 3 </ b> A, and 3 </ b> B are diagrams illustrating examples of hardware devices to which the image generation system of the present embodiment is applied.

  FIG. 2 is an example of an arcade game apparatus to which the image generation system of this embodiment is applied. This arcade game device is realized by an operation unit 160 realized by operation buttons and direction instruction buttons, a sensor 162 having a color sensor 164 and a depth sensor 166, a display unit 190 realized by an LCD, a CRT, and the like, and a speaker. A sound output unit 192, a coin insertion port 150, and a payout port 152 for printed matter such as photographs. The player PL performs various operations for playing the game while viewing the game image displayed on the display unit 190. The movement of the player PL (movement of a part such as a limb or movement of position) is detected by the sensor 162. A game process corresponding to the detection result is performed, and a game image based on the game process is displayed on the display unit 190.

  The hardware device to which the image generation system of the present embodiment is applied is not limited to the arcade game device as shown in FIG. 2, for example, a home game device shown in FIG. 3A or FIG. The present invention can be applied to various hardware devices such as a personal computer (information processing device) shown in FIG. In FIG. 3A, a sensor 162 (sensor device) having a color sensor 164 and a depth sensor 166 is connected to a main body device of a consumer game device, and the sensor 162 is disposed, for example, near a television which is a display unit. Then, by detecting the operation of the player by the sensor 162, the main device of the consumer game device executes various game processes and displays a game image on the television screen. In FIG. 3B, the sensor 162 is connected to the main unit of the personal computer, the operation of the player is detected by the sensor 162, and a game image based on the result of the game processing is displayed on a liquid crystal display as a display unit.

  As shown in FIG. 1, the image generation system (image generation device, game device, game system) of the present embodiment includes an input processing unit 102 that acquires a captured image of a subject, and an overlap determination unit 115 that performs an overlap determination process. And an image generation unit 120 that generates a composite image in which a subject image cut out from a captured image of the subject is combined with a composition target image including a character image.

  The subject is, for example, the player PL shown in FIG. The subject may be an animal other than a human or an object other than an animal. The captured image is, for example, an image (color image such as an RGB image) captured by a color sensor 164 (color camera) included in the sensor 162. The color sensor 164 and the depth sensor 166 may be provided separately. In the compositing target image, a character image and a background image are displayed. A portion in which a subject such as a player is captured is cut out from the captured image taken by the color sensor 164, and the cut out subject image is combined with a synthesis target image (virtual space image).

  The overlap determination unit 115 (overlap determination process program module) performs an overlap determination process between a character and a subject image or a subject character connected to the subject image. That is, an overlap determination process between the character displayed in the compositing target image and the subject image or the subject character is performed. For example, it is determined whether there is an overlap between the character (a part of the character) and the subject image or the subject character.

  The subject character is, for example, a player character. For example, when a subject image (for example, a face image) cut out from a captured image is combined with a portion corresponding to a predetermined part (for example, a face) of the subject character, the subject image and the subject character are displayed together. . For example, a composite character image is formed by a subject image and a subject character image connected to the subject image.

  Then, when it is determined that the character and the subject image or the subject character overlap, the image generation unit 120 performs a rearrangement process so that the character and the subject image or the subject character do not overlap each other, and the composite image Is generated. For example, a rearrangement process for moving the subject image and the subject character away from the character is performed to generate a composite image in which the character, the subject image, and the subject character are displayed. In the rearrangement process, the character may be moved instead of the subject image or the subject character, or both the subject image, the subject character, and the character may be moved.

  The subject image is, for example, a face image of the subject. For example, a face image that is a subject image is acquired by cutting out a face portion from a captured image that shows the entire subject. The overlap determination unit 115 performs an overlap determination process between the character's face and the subject's face image. For example, it is determined whether or not there is an overlap between the face area set to include the face of the character and the face image area set to include the face image of the subject.

  Then, when it is determined that the character and the face image of the subject overlap, the image generation unit 120 performs a rearrangement process so that the character and the face image of the subject do not overlap, and generates a composite image To do. For example, a rearrangement process for moving the face image (subject character) away from the character is performed to generate a composite image in which the character, the face image, and the subject character are reflected.

  Note that the target of the overlap determination with the face image of the subject is, for example, a character part, and more specifically, for example, the character face. For example, when it is determined that a part such as the character's face and the face image of the subject overlap, the rearrangement process may be performed so that the part of the character and the face image of the subject do not overlap. In this case, the part of the character is not limited to the face, and may be a part of the character's hand, foot, or torso. In the rearrangement process, not the face image (subject character) but the character may be moved, or both the face image and the character may be moved. The subject image may be an image of a part other than the subject's face (for example, hands, feet, fingers, hair, etc.), or an image of an object held by the subject.

  The subject character is a model object composed of a plurality of objects, for example. For example, it is a three-dimensional model object composed of a plurality of three-dimensional objects (part objects). Each object is composed of, for example, a plurality of polygons (primitive surfaces in a broad sense).

  In this case, the image generation unit 120 generates an image in which the face image of the subject is displayed at the position of a predetermined part (for example, face, hand, or foot) of the model object as the image of the subject character. For example, the model object is composed of a plurality of part objects, and a subject image (partial image) cut out from the captured image is combined and displayed on a predetermined part. In this case, the position of a predetermined part such as a face can be specified by, for example, skeleton information (movement information in a broad sense) that is subject information acquired by the subject information acquisition unit 114 (a program module for subject information acquisition processing).

  Further, the image generation unit 120 generates a composite image in which the composition position of the subject image in the composition target image changes according to the motion of the subject (part movement, position movement, etc.). For example, the subject information acquisition unit 114 acquires subject information for specifying the motion of the subject based on the sensor information from the sensor 162. For example, skeleton information that is subject information is acquired. Based on the skeleton information, the movement of the subject is specified, and the image generation unit 120 generates a composite image in which the composite position of the subject image changes according to the movement of the subject. For example, when the subject image is a face image, the position of the subject's face is specified, and the face image is synthesized at a location corresponding to the face position.

  When the subject character is a model object, the image generation unit 120 performs rendering processing of the model object arranged at a position corresponding to the position of the subject in the object space, and generates an image of the subject character. For example, the position of the subject is specified based on the subject information acquired by the subject information acquisition unit 114, and the model object that is the subject character is arranged at a position corresponding to the specified position of the subject in the object space. . Then, the rendering process of the model object is performed, and an image of the subject character that can be seen from the virtual camera is generated.

  Then, when the above-described rearrangement processing is performed, the image generation unit 120 performs rendering processing of the model object disposed at the rearrangement position in the object space based on the illumination model, and generates an image of the subject character May be. In this way, when the position of the model object in the object space is moved by the rearrangement process, the model object rendering process based on the illumination model is performed at the rearranged position after the movement. Therefore, an image of the model object that has been shaded at the rearrangement position can be generated as the image of the subject character.

  In the present embodiment, the subject information acquisition unit 114 acquires skeleton information of the subject (subject information in a broad sense) based on the sensor information from the sensor 162. Further, the character processing unit 113 performs processing for moving the subject character based on the skeleton information of the subject. As a result, the subject character moves according to the movement of the subject (part movement, position movement, etc.). Then, the image generation unit 120 performs the rearrangement process using at least one of the arrangement position of the model object that is the subject character, the shape of the model object, and the arrangement position of the objects constituting the model object in the object space. .

  That is, in the object space, the model object that is the subject character operates based on the skeleton information of the subject. That is, the model object in the object space operates according to the movement of the subject. Then, using the arrangement position and shape of the model object operating in the object space or the arrangement positions of the objects constituting the object, the rearrangement processing is performed so that the character and the subject image or the subject character do not overlap each other. Is done. For example, the arrangement position and shape of the model object that is the subject character are changed, or the objects that constitute the model object (for example, the head object) are changed so that such overlapping does not occur. In this way, the skeleton information for moving the subject character can be effectively used to realize the rearrangement processing of the present embodiment.

  Further, the image generation unit 120 generates a plurality of composite images having different rearrangement modes by the rearrangement process. For example, in the present embodiment, a rearrangement process is performed so as to prevent the character and the subject image or the subject character from overlapping, and a composite image is generated. The plurality of composite images having different rearrangement modes are composite images having different positional relationships among the rearranged character, subject image, and subject character. For example, in the first composite image, the positional relationship between the rearranged character, the subject image, and the subject character is the first positional relationship, and in the second composite image, the rearranged character, the subject image, The positional relationship of the subject character is a second positional relationship different from the first positional relationship.

  Then, the print processing unit 132 performs processing for printing an image selected from the plurality of composite images on a print medium. The plurality of composite images may be composite images having different aspects of the rearrangement process, or may be composite images having the same aspect of the rearrangement process. For example, the print processing unit 132 performs processing for displaying a plurality of composite images on the selection screen as print candidate images, processing for instructing the printing unit 198 to print the selected composite image, and the like.

  For example, it is assumed that a plurality of composite images having different rearrangement modes are displayed on the display unit 190, and the player selects a desired composite image from the plurality of composite images. Then, the print processing unit 132 instructs the print unit 198 to print the selected composite image on a print medium, and the print unit 198 displays the composite image on a print medium such as print paper or sticker paper. Print. As a result, the printed matter on which the composite image is printed is paid out from the payout port 152 in FIG.

  Note that the plurality of generated composite images may be transmitted to a server or the like via the communication unit 196, for example. The plurality of images may be displayed on a display unit of an information terminal such as a smartphone or tablet PC included in the player so that the player can select a desired composite image on the screen of the display unit of the information terminal. .

  Further, the image generation unit 120 may perform a size change process on at least one of the character, the subject character, and the subject image during the rearrangement process. For example, the size of the character, subject character, or subject image is changed from the original (default) size.

  Specifically, the image generation unit 120 changes the size of the character according to the size of the subject character or the subject image. For example, when the player who is the subject is a child, the size of the subject character and the subject image is smaller than when the player is an adult. In this case, in conjunction with the size of the subject character or subject image that has become smaller, the size of the character that appears together is also reduced. When the player, who is the subject, approaches the sensor 162 (color sensor 164) in FIG. 2, the size of the composite character image composed of the subject character image and the subject image increases. In this case, the size of the character shown together is also increased in conjunction with the size of the increased composite character image.

  The image generation unit 120 may change the size of at least one of the subject character and the subject image according to the size of the character. For example, it is assumed that a plurality of characters having different sizes are prepared as characters appearing together in the composite image. In this case, when generating a composite image in which the first character having a large size is displayed together, the size of the subject character or the subject image is increased. On the other hand, when generating a composite image in which a second character with a small size is displayed together, the size of the subject character or subject image is reduced.

  The image generation unit 120 may change the size change rate of the subject character and the size change rate of the subject image when changing the size of the subject character and the subject image according to the size of the character. For example, when the size of the subject character and the subject image is changed according to the size of the character, if the size is changed at the same size change rate, the visual balance may be deteriorated. In this case, the deterioration of the balance of appearance is suppressed by making the size change rate of the subject character different from the size change rate of the subject image.

  Further, the image generation unit 120 may perform color information change processing on at least one of the character, the subject character, and the subject image during the rearrangement processing. For example, when the positional relationship between the character and the subject character or subject image is changed by the rearrangement process, the original color information may have a poor visual balance. In this case, the color balance is changed by changing the color of the character, the subject character, or the subject image by the color information changing process. This change in color information may be a change in color or a change in brightness (luminance). Alternatively, the color information changing process may be realized by changing the texture.

  The image generation unit 120 may perform color information change processing according to the degree of association between the character and the subject character. For example, when the degree of association between the character and the subject character is high, color information changing processing is performed so that the character and the subject character have different shades and brightness. For example, when the costume worn by the character and the costume worn by the subject character are the same or similar, it is determined that the degree of association between the character and the subject character is high, and the color information is displayed so that the color and brightness of the character appear different. The change process is performed.

  Further, the image generation unit 120 may perform a decoration process on the boundary region between the character and the subject character or the boundary region between the character and the subject image during the rearrangement processing. In this way, after the rearrangement process, the boundary area between the character and the subject character and the boundary area between the character and the subject image become familiar with the decoration process and can be made inconspicuous. As the decoration process, for example, a display object (object) for decoration is arranged in the boundary area, and various image effects are applied to the boundary area.

  In the present embodiment, both the subject character and the character may be model objects composed of a plurality of objects. Then, it is determined that there is an overlap as seen from the virtual camera between the subject character and the character that are model objects arranged in the object space. In this case, the image generation unit 120 performs a rearrangement process of changing at least one of the position and direction (for example, the direction in which the character is directed) in at least one of the subject character and the character in the object space. For example, rearrangement processing is performed to change at least one of the position and direction of the subject character, change at least one of the position and direction of the character, or change at least one of the position and direction of both the subject character and the character. .

  The game processing unit 111 performs a game process for the player to play the game. Then, it is determined that there is an overlap between the subject character and the character when viewed from the virtual camera during the game processing. In this case, the image generation unit 120 performs a rearrangement process for changing at least one of the position and direction of at least one of the subject character and the character in the object space. The generated image after the rearrangement processing in the game is printed on a print medium by the printing unit 198 and is paid out from the payout port 152, for example. Alternatively, the generated image information may be transmitted to a server or the like via the communication unit 196.

  Further, it is assumed that it is determined that there is an overlap between the subject character and the character when viewed from the virtual camera set at the first viewpoint position. In this case, the image generation unit 120 changes the position of the virtual camera to a second viewpoint position different from the first viewpoint position, and performs a rearrangement process for changing the subject character and the direction of the character. In this way, even when the subject character and the character overlap each other when viewed from the virtual camera at the first viewpoint position, the position of the virtual camera is changed to the second viewpoint position and the direction of the subject character and character ( By changing the (facing direction), it is possible to generate an image that does not overlap the subject character and the character (an image in which the overlap is suppressed).

2. Next, the method of this embodiment will be described in detail. In the following, the case where the method of the present embodiment is applied to a game in which a character moves according to the movement of the player will be described. However, the method of the present embodiment is not limited to this, and various games (RPG games, music Game, battle game, communication game, robot game, card game, sports game, action game, etc.).

2.1 Description of Game First, an example of a game realized by the image generation system of this embodiment will be described. In the present embodiment, the movement of the player PL (subject in a broad sense) is detected by the sensor 162 in FIG. 2, and a game process that reflects the detected movement is performed to generate a game image.

  As shown in FIG. 2, the sensor 162 (image sensor) is installed so that the imaging direction (optical axis direction) faces the player PL (user, operator), for example. For example, the imaging direction of the sensor 162 is set in the depression direction with respect to the horizontal plane so that the entire child can be imaged. In FIG. 2, the sensor 162 is installed beside the display unit 190, but the installation position is not limited to this, and can be installed at an arbitrary position (for example, a lower part or an upper part of the display unit 190).

  The sensor 162 includes a color sensor 164 and a depth sensor 166. The color sensor 164 captures a color image (RGB image) and can be realized by a CMOS sensor, a CCD, or the like. The depth sensor 166 projects light such as infrared rays and detects depth of reflection information (depth information) by detecting the reflection intensity of the projected light and the time until the projected light returns. For example, the depth sensor 166 can be configured by an infrared projector that projects infrared rays and an infrared camera. For example, depth information is acquired by a TOF (Time Of Flight) method. The depth information is information in which a depth value (depth value) is set at each pixel position. In the depth information, the depth value (depth value) of the player and the surrounding landscape is set as, for example, a gray scale value.

  The sensor 162 may be a sensor in which the color sensor 164 and the depth sensor 166 are separately provided, or may be a sensor in which the color sensor 164 and the depth sensor 166 are combined. The depth sensor 166 may be a sensor other than the TOF method (for example, light coding). Various methods for obtaining depth information can be used. For example, depth information may be obtained by a distance measuring sensor using ultrasonic waves.

  4A and 4B are examples of depth information and body index information acquired based on the sensor 162, respectively. FIG. 4A conceptually shows depth information, and this depth information is information representing the distance of a subject such as a player viewed from the sensor 162. The body index information in FIG. 4B is information representing a person area. The position and shape of the player's body can be specified by this body index information.

  FIG. 5 is an example of skeleton information acquired based on sensor information from the sensor 162. In FIG. 5, position information (three-dimensional coordinates) of bones constituting the skeleton is acquired as position information of the joints (parts) C0 to C20 as the skeleton information. C0, C1, C2, C3, C4, C5, and C6 correspond to the waist, spine, center of shoulder, right shoulder, left shoulder, neck, and head, respectively. C7, C8, C9, C10, C11, and C12 correspond to the right elbow, right wrist, right hand, left elbow, left wrist, and left hand, respectively. C13, C14, C15, C16, C17, C18, C19, and C20 respectively correspond to the right hip, left hip, right knee, right heel, right foot, left knee, left heel, and left foot. Each bone constituting the skeleton corresponds to each part of the player reflected on the sensor 162. For example, the subject information acquisition unit 114 specifies the three-dimensional shape of the player based on sensor information (color image information and depth information) from the sensor 162. Then, using the information of the three-dimensional shape, the motion vector (optical flow) of the image, and the like, each part of the player is estimated, and the joint position of each part is estimated. Then, based on the two-dimensional coordinates of the pixel position in the depth information corresponding to the estimated joint position and the depth value set in the pixel position, the three-dimensional coordinate information of the position of the skeleton joint is obtained, and FIG. Acquire skeleton information as shown in. By using the acquired skeleton information, it is possible to specify the movement of the player (movement of a part such as a limb or movement of a position). This makes it possible to move the character according to the movement of the player. For example, when the player PL moves the limb in FIG. 2, the limb of the character (player character) displayed on the display unit 190 can be moved in conjunction with the movement. Further, when the player PL moves back and forth and right and left, the character can be moved back and forth and right and left in the object space in conjunction with the movement.

  In this embodiment, a composite image of a captured image obtained by photographing the player PL by the color sensor 164 of the sensor 162 and an image of a character (player character) is generated. Specifically, a composite image of a face image (subject image, part image in a broad sense) cut out from a captured image and a character image is generated.

  For example, in FIG. 6, a model object of a character CHP (costume) is prepared, and the face image IMF of the player PL cut out from the captured image is displayed on the polygon SCI (billboard polygon, screen). The model object of the character CHP is composed of objects of a plurality of parts other than the face (head), and is a character wearing a beautiful costume.

  In FIG. 6, a polygon SCI face image IMF is displayed on the extended line connecting the viewpoint position of the virtual camera VC and the face position of the character CHP. By setting the face image IMF of the virtual camera VC, the character CHP, and the polygon SCI in such an arrangement relationship, an image in which the face image IMF of the player is combined with the face portion of the character CHP can be generated.

  Note that the image synthesis method of the face image IMF for the character CHP is not limited to the method shown in FIG. For example, various image synthesis methods such as mapping the texture of the face image IMF (subject image, part image) to the object constituting the face (predetermined part) of the character CHP can be adopted.

  For example, FIG. 7A shows an example of a captured image of the player PL captured by the color sensor 164 of the sensor 162. A face image IMF of the player PL is cut out (trimmed) from the captured image and synthesized with the image of the character CHP by the image synthesis method of FIG. 6, thereby generating a composite image as shown in FIG. In FIG. 7B, the face part is the face image IMF of the player PL, and the part other than the face is an image of the character CHP that is a CG image. As a result, the player PL can play the game with the character CHP as his character, wearing a costume that is worn by the main characters of the fairy tales and anime, so that the fun of the game and the enthusiasm of the player can be improved. It can be improved.

  FIG. 8 is an example of a game image generated by the image generation system of the present embodiment and displayed on the display unit 190 of FIG. The character CHP combined with the face image IMF of the player PL has, for example, a magic wand ST in its hand. When the player PL in FIG. 2 moves the arm, the movement of the arm is detected by the sensor 162, and information on the skeleton in which the bone of the arm is moving is acquired as the skeleton information in FIG. As a result, the arm of the character CHP on the game image shown in FIG. 8 moves, and the enemy character EN1, EN2, EN3 can be hit and attacked with the magic wand ST. The player's game results are calculated based on the number of defeated enemies and the acquisition of bonus points.

  As described above, according to the method of the present embodiment, the player PL puts the costumes of the main characters of fairy tales and anime on the character CHP, which is his own character, and feels as if he is the main character, as shown in FIG. You will be able to play games like this. Therefore, it is possible to realize an interesting game that the player PL such as a child can enjoy.

2.2 Rearrangement Processing In this embodiment, an image showing the state of the player character CHP in the game as shown in FIG. 8, or an image in the commemorative photo shooting mode taken together with the character CHP and another character. Is printed on the print medium and output from the payout port 152 of FIG.

  FIGS. 9A and 9B are examples of images displayed on the display unit 190 in the commemorative photo shooting mode. For example, in FIGS. 9A and 9B, the character CH is displayed together with the player character CHP (subject character in a broad sense) in which the player's face image is synthesized. The player is instructed to stand on the left side of the character CH at the time of shooting. Then, after the transition to the shooting mode, the shutter (the shutter of the virtual camera) is released at the timing when a predetermined time has elapsed, and the composite image of the character CHP and the character CH of the player at that timing becomes the print target image. Also in this shooting mode, the movement of the player is detected by the sensor 162 in FIG. 2, and when the player moves to the left and right, the character CHP also moves to the left and right.

  In FIG. 9A, the face image IMF of the player and the face FC of the character CH do not overlap, but in FIG. 9B, the face image IMF and the face FC overlap. This overlap can be determined, for example, by whether or not the area AFP of the face image IMF and the area AFC of the face FC of the character CH overlap.

  For example, the game of this embodiment is a game for children and the like. For this reason, even if it is instructed to stand on the left side of the character CH at the time of shooting, the child moves and the shutter is released in a state where the face image IMF and the face FC overlap as shown in FIG. Will occur. In the image of FIG. 9B, the face FC of the character CH shown together is hidden behind the player's face image IMF, making it difficult to see. For this reason, the composition of the commemorative photo is not preferable, and the value of the commemorative photo is reduced.

  Therefore, in the present embodiment, when such an overlap occurs, the rearrangement process for adjusting the standing position of the character CHP (face image IMF) is performed to solve such an overlap problem.

  FIG. 10 is a diagram for explaining the method of this embodiment. As shown in FIG. 10, an area AFP of the face image IMF of the player character CHP and an area AFC of the face FC of the character CH are set.

  The area AFP of the face image IMF can be set based on, for example, the face position (C6) in the skeleton information of FIG. For example, an area AFP (frame) of a given size is set with reference to the face position (C6) in the skeleton information. For example, the size of the area AFP can be set based on the size of the skeleton of the player specified by the skeleton information shown in FIG. For example, if the player is an adult, the size of the area AFP increases, and if the player is a child, the size decreases. For example, in the present embodiment, a method of setting the size of the character CHP (costume) based on the size of the skeleton of the player specified by the skeleton information or the like is adopted. Just set the size. For example, the area AFP is desirably an area having a size that includes the face image IMF. In FIG. 10, the area AFP has a rectangular shape, but may have another shape such as a circular shape.

  The area AFC of the character CH is set to a large size that includes the face FC of the character CH. For example, when the character CH is a two-dimensional image (two-dimensional picture), an appropriate position and size of the area AFC may be set for each image. For example, FIGS. 11A and 11B are examples of images of characters CHA and CHB different from those in FIG. Thus, the position and size of the area AFC are set for each image of the characters CHA and CHB. For example, the character CHB in FIG. 11B has a lower height than the character CH in FIG. 10, and thus the area AFC is set to a lower position. For example, if the character has a large face size, the size of the area AFC may be increased accordingly. The shape of the area AFC is not limited to a rectangular shape, and may be another shape such as a circular shape.

  Note that, as the character CH in FIG. 10, a character constituted by a three-dimensional model object may be used as in the character CHP. That is, an image of the character CH is generated by performing rendering processing of a model object composed of a plurality of objects. In this case, the position and size of the area AFC may be set based on the position of the model object that realizes the character CH in the object space and the shape of the model object.

  In the present embodiment, the movement of the player is detected by the sensor 162, and the character CHP is moved according to the movement of the player. Therefore, when the player moves, the character CHP moves in conjunction with it, and the position of the face image IMF also moves up, down, left, and right on the composite image in FIG. For this reason, as shown in B1 of FIG. 10, a situation occurs in which the face image IMF and the face FC of the character CH collide (hit) and overlap. When such a situation occurs, the composition of the character CHP and the character CH becomes strange, and a low-quality photograph is printed when the generated composite image is printed.

  Therefore, in this embodiment, when it is determined that such face overlap has occurred, a rearrangement process as shown in B2 of FIG. 10 is performed. For example, as shown in A1 of FIG. 10, the composite character image composed of the character CHP and the face image IMF is moved to the left side. That is, the composite character image is moved in a direction away from the character CH. For example, in FIG. 10, the character CHP and the image IMF are combined so that the right side coordinate (X coordinate) of the area AFP of the face image IMF matches the left side coordinate (X coordinate) of the area AFC of the face FC of the character CH. Move the character image. That is, a rearrangement process is performed in which the face image IMF is moved to the left by the face FC of the character CH.

  By doing so, it is possible to avoid a situation in which the face image IMF of the player and the face FC of the character CH overlap, and a composite image having a more appropriate composition can be generated. Therefore, by printing the composite image after the rearrangement process as a photograph, it becomes possible to provide the player with a printed commemorative photograph that the player is satisfied with.

  In addition, the rearrangement process of this embodiment is not limited to the method shown in FIG. 10, and various deformation | transformation implementation is possible. For example, although the composite character image (CHP, IMF) is moved in FIG. 10, both the composite character image (CHP, IMF) and the character CH are moved away from each other, or the character CH is moved. Thus, the rearrangement process may be realized. In FIG. 10, rearrangement processing is performed so that the face image IMF of the player and the face FC of the character CH do not overlap, but the present embodiment is not limited to this. For example, a rearrangement process may be performed so that parts (for example, hands and feet) other than both faces do not overlap.

  Further, as shown in FIG. 12, a rearrangement process may be performed so that the character CHP (composite character image) and the character CH do not overlap. For example, in FIG. 12, an area ACHP that includes the character CHP and an area ACH that includes the character CH are set. In C1 of FIG. 12, it is determined that the area ACHP and the area ACH overlap, and the character CHP and the character CH overlap. In this case, as shown by C2 in FIG. 12, a rearrangement process is performed so that the character CHP and the character CH do not overlap. That is, the character CHP is moved to the left side, for example, so that the area ACHP and the area ACH do not overlap. Note that it is possible to move both the character CHP and the character CH away from each other, or to move the character CH. As shown in FIG. 12, it is possible to generate a composite image with an appropriate composition by detecting an overlap between characters and performing a rearrangement process so that they do not overlap.

  As described above, in the present embodiment, the face image IMF (subject image) cut out from the captured image of the player (subject) with respect to the compositing target image (virtual space image including the background image) including the character CH image. A combined image is generated by combining. Then, an overlap determination process is performed between the character CH and the face image IMF (subject image) or the character CHP (subject character) connected to the face image IMF. For example, an overlap determination process between the character CH and the composite character image (CHP, IMF) is performed. Specifically, in FIG. 10, an overlap determination process between the character CH (face FC) and the face image IMF is performed, and in FIG. 12, an overlap determination process between the character CH and the character CHP (subject character) is performed. .

  If it is determined that the character CH and the face image IMF (subject image) or character CHP (subject character) overlap, the character CH and the face image IMF or character CHP are not overlapped. An arrangement process is performed to generate a composite image.

  More specifically, when the subject image is the face image IMF of the player (subject), as shown in FIG. 10, an overlap determination process between the character CH (for example, face FC) and the player's face image IMF is performed. Done. When it is determined that the character CH (face FC) and the face image IMF are overlapped, a rearrangement process is performed so that the character CH (face FC) and the face image IMF do not overlap each other. An image is generated. As a result, a composite image in which the faces of the characters CH and CHP are displayed side by side without being overlapped can be taken as a commemorative photo and provided to the player as a printed matter.

  In this embodiment, for example, a character CHP (subject character) displayed on the display unit 190 in FIG. 13 is a model object composed of a plurality of objects. That is, an image of the character CHP is generated with a three-dimensional CG object composed of a primitive surface such as a polygon. As shown in FIG. 13, an image in which the face image IMF of the player PL (subject) is displayed at the face position of the model object is generated as the image of the character CHP. Such a combined character image of the character CHP and the face image IMF can be generated by, for example, the image combining method described with reference to FIG.

  As shown in FIG. 13, when the player PL (subject) moves, a composite image is generated in which the composite position of the face image IMF (subject image) in the compositing target image changes according to the movement of the player PL. Are displayed on the display unit 190. That is, when the player PL moves to the right and the face moves to the right, the face image IMF displayed on the display unit 190 also moves to the right accordingly. Similarly, when the player PL moves to the left and the face moves to the left, the face image IMF also moves to the left accordingly.

  Specifically, in this embodiment, the movement of the character CHP is controlled using the skeleton information described with reference to FIG. For example, the motion of the character CHP is reproduced by the motion data based on the skeleton information, and the character CHP is operated.

  FIG. 14 is a diagram for conceptually explaining the skeleton. The skeleton for moving the character CHP is a three-dimensional skeleton arranged and set at the position of the character CHP, and SK represents a projection of the skeleton on the screen SCS. As described with reference to FIG. 5, the skeleton is composed of a plurality of joints, and the position of each joint is represented by three-dimensional coordinates. The bone of the skeleton moves in conjunction with the movement of the player PL in FIG. When the bone of the skeleton moves, the part corresponding to the bone of the character CHP also moves in conjunction with this movement. For example, when the player PL moves his / her arm, the bone of the skeleton's arm moves and the arm of the character CHP moves accordingly. When the player PL moves his / her foot, the skeleton's foot bones move in conjunction with this, and the character CHP's feet also move. When the player PL moves his / her head, the skeleton's head bone moves and the character CHP's head moves accordingly. In FIG. 14, for example, it is assumed that the sensor 162 is disposed at the viewpoint position of the virtual camera VC, and the imaging direction of the sensor 162 is oriented in the line-of-sight direction of the virtual camera VC.

  Thus, in this embodiment, the character CHP operates in conjunction with the movement of the player PL. Accordingly, when the player PL moves his / her head, the face image IMF displayed on the display unit 190 also moves in conjunction with this, and therefore, as shown in FIG. 9B, the face image IMF and the compositing target image are displayed. A situation may occur in which the face FC of the displayed character CH overlaps. In this embodiment, the rearrangement process as shown in FIG. 10 is also performed in such a case, so that such a situation can be avoided and a composite image with an appropriate composition can be provided to the player. .

  In the present embodiment, the character CHP is a model object composed of a plurality of objects, and the model object arranged at a position corresponding to the position of the player PL (subject) in the object space (three-dimensional virtual space). By performing this rendering process, an image of the character CHP (subject character) is generated. For example, in FIG. 15, the character CHP is arranged at a position corresponding to the position of the player PL in FIG. 13 in the object space. For example, when the player PL moves forward / backward / left / right, the character CHP also moves forward / backward / left / right in the object space.

  And the rendering process of the character CHP which is a model object is performed based on the illumination model using the light source LS as shown in FIG. Specifically, lighting processing (shading processing) based on the illumination model is performed. This lighting processing includes information on the light source LS (light source vector, light source color, brightness, light source type, etc.), a line-of-sight vector of the virtual camera VC, a normal vector of an object constituting the character CHP, and an object material (color). , Material) and the like. Illumination models include the Lumbard diffuse lighting model that considers only ambient light and diffuse light, the phone lighting model that considers specular light in addition to ambient light and diffuse light, and the Bling phone lighting model. is there.

  By performing the lighting process based on the illumination model in this way, it is possible to generate a real and high-quality image in which the character CHP is appropriately shaded by the light source LS. For example, if lighting processing is performed using a spotlight light source, an image of a character CHP (costume) that appears to be illuminated by the spotlight can be generated, and the virtual reality of the player can be improved.

  Here, as a technique for realizing the rearrangement process of FIG. 10, for example, a first technique that is a two-dimensional rearrangement process and a second technique that is a three-dimensional rearrangement process can be assumed.

  For example, in the first method, the rearrangement process of FIG. 10 is performed by changing the relative positional relationship between the two-dimensional image in which the character CH is displayed and the two-dimensional image in which the character CHP and the face image IMF are combined. Realize. For example, a two-dimensional image of the character CH is set in the first layer, and a two-dimensional image obtained by combining the character CHP and the face image IMF is set in the second layer. If an overlap between the face FC of the character CH and the face image IMF is detected, the rearrangement process of FIG. 10 is realized by relatively shifting the second layer with respect to the first layer. For example, in FIG. 10, the rearrangement process is realized by shifting the second layer in which the composite image of the character CHP and the face image IMF is set to the left side. According to this first method, there is an advantage that the rearrangement process of FIG. 10 can be realized by a process with a small processing load.

  On the other hand, in the second method, for example, the rearrangement process of FIG. 10 is realized by changing the position of the character CHP or the like in the object space. For example, FIG. 16 is an example of model object information of the character CHP. The model object information includes information on the position and direction of the model object in the object space. It also includes information on a plurality of objects OB1, OB2, OB3. In the second method, the rearrangement process of FIG. 10 is realized by changing the position of the model object included in the model object information of FIG. In the second method, for example, it is desirable to generate an image of the character CH using a model object composed of a plurality of objects. In this case, the rearrangement process of FIG. 10 can be realized by changing the relative positional relationship between the model object of the character CHP and the model object of the character CH in the object space.

  For example, when the rearrangement process is performed in the state of the two-dimensional image as in the first method described above and the position of the character CHP is moved, the shading of the character CHP after the rearrangement process becomes an inappropriate shading. There is a risk of becoming. For example, in FIG. 10, it is assumed that the light source of the spotlight is arranged at a position corresponding to the upper side of the character CH. In this case, in the state of B1 in FIG. 10 before the rearrangement process is performed, a rendering image in which the spotlight is shaded to illuminate the character CHP from above is generated as an image of the character CHP. Become. However, when the rearrangement process is performed as shown in B2 of FIG. 10, there is actually no spotlight above the character CHP, but even after the rearrangement process, the spotlight is illuminated from above. An image of the character CHP to which shading is applied is displayed. Therefore, there is a contradiction in shading, and the player may feel unnaturalness.

  In this regard, in the second method, even when the rearrangement process is performed, the rendering process of the model object of the character CHP arranged at the rearrangement position in the object space is performed based on the illumination model, and the character An image of CHP (subject character) is generated. Therefore, there is an advantage that it is possible to avoid a situation in which the above-described shading contradiction occurs and to generate a more natural and realistic image. Note that the rearrangement process of the present embodiment is not limited to the rearrangement process when compositing a photographic image for printing, and may be a realtime rearrangement process during game play, for example.

  In the present embodiment, as described with reference to FIG. 14 and the like, the skeleton information of the player PL is acquired based on the sensor information from the sensor 162, and the character CHP is operated based on the skeleton information. Thereby, the character CHP that is the model object can be operated in accordance with the movement of the player PL. Then, the rearrangement process of FIG. 10 is performed using the arrangement position of the model object (character CHP), the shape of the model object, or the arrangement positions of the objects constituting the model object in the object space.

  For example, when the rearrangement process of FIG. 10 is performed, the arrangement position of the model object (character CHP) in the object space is shifted so as not to overlap with the character CH (for example, a three-dimensional model object character), or the model object Change the shape. Alternatively, the position of an object constituting the model object (for example, a part object such as a head, a hand, or a foot) is changed so as not to overlap with the character CH. For example, in FIG. 10, a rearrangement process for shifting the head object of the model object of the character CHP in the direction of A1 is performed. In this way, by using the skeleton information, the rearrangement process shown in FIG. 10 can be performed in the system that can move the model object (character CHP) according to the movement of the player PL. Thus, a rearrangement process suitable for an image generation system using skeleton information can be realized.

2.3 Generation of Composite Image Various methods are conceivable as a method for generating a composite image of the character CHP and the character CH according to the present embodiment.

  For example, in the present embodiment, a plurality of composite images having different rearrangement modes by the rearrangement process may be generated. Then, a process of printing an image selected by the player from a plurality of composite images on a print medium is performed. As an example, an image selected from a plurality of composite images having different rearrangement modes is printed. Alternatively, an image selected from a plurality of composite images is transmitted to the Internet or the like by the communication unit 196 in FIG. 2, and the image is managed by a server. For example, a display of an information terminal such as a smartphone, a tablet PC, or a personal computer is displayed. To display.

  For example, in the composite image shown in D1, D2, and D3 in FIG. 17, the rearrangement modes of the character CHP and the character CH are different from each other. For example, in FIG. 10, rearrangement for moving the character CHP from the character CH (FC) to the left side is performed. On the other hand, in D1 and D2 in FIG. 17, a rearrangement process for moving the character CHP in the diagonally downward left direction is performed, and in D3, a rearrangement process in which the character CHP is moved in the diagonally downward right side is performed. And are rearranged composite images. When the player selects a desired composite image from the plurality of composite images, the selected composite image is printed as a commemorative photo.

  For example, when the rearrangement process as shown in FIG. 10 is performed, the actual position of the player in front of the display unit 190 and the position of the character CHP do not correspond to each other, so that the player may feel unnaturalness. .

  In this regard, if a plurality of composite images having different rearrangement modes as shown in FIG. 17 are displayed on the player, the unnatural feeling felt by the player can be reduced. If a plurality of composite images having different rearrangement modes as shown in FIG. 17 are displayed, the variety of candidate images to be printed can be increased, and the range of selection targets of the player can be widened.

  In the present embodiment, the size changing process for at least one of the character CH, the character CHP (subject character), and the face image IMF (subject image) may be performed during the rearrangement process. For example, the size of the character CH is changed according to the size of the character CHP or the face image IMF.

  For example, in FIG. 18A, the first player with a high height is playing a game, and the size of the character CHP is increased in accordance with the height of the first player. A face image IMF in FIG. 18A is a face image obtained by photographing the first player. On the other hand, in FIG. 18B, the second player with a short height is playing the game, and the size of the character CHP is reduced in accordance with the low height of the second player. A face image IMF2 in FIG. 18B is a face image obtained by photographing the second player.

  That is, in this embodiment, the skeleton information as shown in FIG. 5 is acquired by recognizing the player's skeleton by the sensor 162. Then, the size of the character CHP is set according to the size of the acquired skeleton. In this way, the size of the character CHP displayed on the screen is linked to the player's physique, and the virtual reality of the player can be improved. That is, in a tall player, the corresponding character CHP is tall, and in a short player, the corresponding character CHP is also short. Can give the virtual reality that

  Then, when the size of the character CHP changes in this way, it is preferable as a commemorative photo composition to change the size of the character CH shown together in association with it. For example, in FIG. 18A, the character CH is displayed so as to be tall corresponding to the tall character CHP, and in FIG. 18B, the character CH is also displayed corresponding to the short character CHP. Displayed to be lower. Accordingly, the appearance of the composition when the character CHP and the character CH are lined up is more preferable, and an image suitable for a commemorative photo can be printed and provided to the player.

  Note that when the height of the player is different, the face image may be adjusted according to the size of the character CHP. For example, when the size of the character CHP is large as shown in FIG. 18A, the size of the face image IMF of the first player is also increased accordingly. On the other hand, when the size of the character CHP is small as shown in FIG. 18B, the size of the face image IMF2 of the second player is also reduced accordingly. By doing so, it is possible to improve the balance of the appearance of the composite character image composed of the character CHP and the face images IMF and IMF2.

  In the present embodiment, the size of the character CHP or the face image IMF may be changed according to the size of the character CH.

  For example, in FIG. 19A, the character CH shown together in the commemorative photo is a tall character. In this case, the size of the player character CHP is increased in accordance with the tall character CH. On the other hand, in FIG. 19 (B), the characters CHB appearing together in the commemorative photo are short characters. In this case, the size of the player character CHP is reduced in accordance with the short character CHB.

  In this way, the appearance of the composition when the character CHP and the character CH are arranged as shown in FIG. 19A, or the appearance of the composition when the character CHP and the character CHB are arranged as shown in FIG. 19B. However, the image looks more preferable, and an image suitable for a commemorative photo can be printed and provided to the player. In other words, the player can take a commemorative photo with a good-looking composition, regardless of which character is selected by the player as a character to be taken together in the commemorative photo.

  Note that when the sizes of the character CHP and the face image IMF are changed according to the size of the character CH as shown in FIGS. 19A and 19B, the size change rate of the character CHP and the face image IMF It is desirable to vary the size change rate. For example, in FIG. 20A, the size change rate of the face image IMF is set to SRF, and the size change rate of the character CHP is set to SRC. In this case, the size change rates SRF and SRC are made different.

  For example, as shown in FIGS. 19A and 19B, when the size of the character CHP of the player is changed in accordance with the sizes of the characters CH and CHB, the size change rate SRC of the character CHP and the face image IMF If the size change rate SRF is set to the same value, the apparent balance may become unnatural. For example, in FIG. 19A, the face image IMF becomes too large for the body portion of the character CHP and looks unnatural, or in FIG. 19B, the face image for the body portion of the character CHP. There is a possibility that the IMF becomes too small and looks unnatural.

  In this regard, as shown in FIG. 20A, if the size change rate SRC of the character CH and the size change rate SRF of the face image IMF can be set separately, the unnatural appearance will occur as described above. The occurrence of a situation can be effectively prevented.

  In the present embodiment, color information change processing for at least one of the character CH, the character CHP (subject character), and the face image IMF (subject image) may be performed during the rearrangement processing. For example, as shown in A1 of FIG. 21, the color information of the character CH, the character CHP, or the face image IMF is changed when the rearrangement process for preventing the face image IMF and the face FC of the character CH from overlapping each other is performed. . For example, the color information is changed according to the degree of association between the character CH and the player character CHP.

  For example, it is assumed that the degree of association between the character CH and the character CHP is high, and the shape of the costume worn by the character CH and the shape of the costume worn by the character CHP are similar. In this case, in order to make the difference between the costumes after the rearrangement stand out, the color of the costume of the character CH and the color of the costume of the character CHP are changed. For example, the color information is changed so that the colors of the two costumes are different.

  On the other hand, it is assumed that the degree of association between the character CH and the character CHP is low, and the color and shape of the costume worn by the character CH and the color and shape of the costume worn by the character CHP are completely different colors and shapes. In this case, color information changing processing is performed in the boundary region between the character CH and the character CHP so as to adjust the colors of the costumes of the character CH and the character CHP. For example, color gradient processing is performed in the boundary region between the two, and color brightness adjustment is performed. By doing so, it is possible to improve the appearance and quality of the combined image of the character CH and the character CHP that are displayed side by side after the rearrangement process. Note that the degree of association between the character CH and the player character CHP may be determined based on, for example, table data representing the degree of association between characters as shown in FIG.

  In the present embodiment, in the rearrangement process, the decoration process may be performed on the boundary region between the character CH and the player character CHP or the boundary region between the character CH and the face image IMF.

  For example, in FIG. 22, a decoration process is performed in which a display object such as a flower or a heart mark is arranged between the character CH and the character CHP or between the character CH and the face image IMF. By performing such a decoration process, it becomes possible to adjust the boundary area between the character CH after the rearrangement process and the character CHP or the face image IMF so that the boundary area is not noticeable. The composite image can be provided to the player. The display object (object) used for the decoration process may be an item display object owned by the player, or a display object associated with the character CH or the character CHP. Also good. Further, as a decoration process, an image effect process for changing brightness or the like may be performed on a boundary area between the character CH and the character CHP or the face image IMF. Thus, various processes can be assumed as the decoration process of the present embodiment.

2.4 Modifications Next, various modifications of the present embodiment will be described. For example, in FIG. 23, both the character CHP (subject character) and the character CH are model objects composed of a plurality of objects. Then, in E1 of FIG. 23, as shown in FIG. 24A, it is determined that there is an overlap between the character CHP and the character CH, which are model objects arranged in the object space, as viewed from the virtual camera VC. Yes. That is, the character CHP and the character CH appear to overlap in the image viewed from the virtual camera VC. In the present embodiment, when such an overlap is detected, a rearrangement process is performed in which at least one of the position and direction of at least one of the character CHP and the character CH is changed. Here, the position is the character CHP and the arrangement position (representative position) of the character CH, and the direction is the direction in which the character CHP and the character CH are facing, for example.

  For example, in E2 of FIG. 23, as shown in FIG. 24B, rearrangement processing for changing the position of the character CHP in the object space is performed. Specifically, as indicated by F1 in FIG. 24B, the position of the character CHP is moved leftward to increase the distance from the character CH. As a result, as shown at E2 in FIG. 23, it is possible to generate an image that looks like the character CHP and the character CH do not overlap each other when viewed from the virtual camera VC.

  In the rearrangement process, the position of the character CH may be changed, or the positions of both the character CHP and the character CH may be changed. Alternatively, the rearrangement process may be realized by changing the direction of the character CHP or the character CH.

  For example, in FIG. 25A, it is determined that there is an overlap between the character CHP and the character CH when viewed from the virtual camera VC set at the first viewpoint position. That is, even if the character CHP and the character CH are shifted by a predetermined distance back and forth, the character CHP and the character CH appear to overlap each other when viewed from the virtual camera VC set at the first viewpoint position.

  In this case, as shown in FIG. 25B, the position of the virtual camera is changed to a second viewpoint position different from the first viewpoint position. For example, in FIG. 25A, the virtual camera VC is arranged at the first viewpoint position in the front direction of the characters CHP and CH. However, in FIG. The position of the virtual camera VC is changed to the second viewpoint position. Further, in FIG. 25B, as indicated by G2 and G3, the directions of the characters CHP and CH are also changed. That is, the directions of the characters CHP and CH are rotated as indicated by G2 and G3 so as to face the virtual camera VC indicated by G1. By doing so, the characters CHP and CH overlapped when viewed from the virtual camera VC in FIG. 25A cannot be seen with the virtual camera VC indicated by G1 in FIG. Thus, a rearrangement process that suppresses the overlap between the two can be realized. In this way, the rearrangement process can also be realized by changing the directions of the characters CHP and CH.

  In the present embodiment, as described with reference to FIG. 8, a game process for the player to play the game is performed. The rearrangement process described with reference to FIGS. 23 to 25B may be performed during the game process. For example, when it is determined that there is an overlap between the character CHP and the character CH when viewed from the virtual camera during the game processing, the character in the object space is displayed as shown in FIGS. A rearrangement process for changing at least one of the position and direction of at least one of the CHP and the character CH is performed.

  For example, in the present embodiment, at an arbitrary timing in the game, the player is automatically photographed using the character CHP, and the automatically photographed image can be displayed later. Specifically, as shown in FIG. 17, the automatically shot image is displayed on the display unit 190 as a print candidate image together with the image in the commemorative shooting mode. When the player selects an image for automatic shooting during the game, the image is printed on a print medium and paid out from the payout port 152. Thereby, the player can look back at his / her own game play later.

  Then, the rearrangement process described with reference to FIGS. 23 to 25B is performed when such an automatically shot image during the game is generated. In this way, the rearrangement process is performed automatically so that the character CHP and the character CH do not overlap, and an automatically shot image during the game is generated, and an automatically shot image with an appropriate composition is generated. Can be provided to the player.

  Further, the rearrangement process may be controlled in accordance with the degree of overlap of each part of the character CHP and the character CH. For example, the shift amount during the rearrangement process is controlled. For example, when the character CHP and the character CH are overlapped at three locations of the hand, the foot, and the head (face), the shift amount during the rearrangement process is increased, and the position of the character CHP or the like is largely shifted, for example. On the other hand, if the hand and foot overlap but the head (face) does not overlap, the shift amount during the rearrangement process is reduced. Alternatively, the amount of overlap (for example, the overlap area) between the character CHP and the character CH is calculated, and when the amount of overlap is large, the shift amount during the rearrangement process is increased, and when the amount of overlap is small, the rearrangement process is performed. In this case, the shift amount may be reduced.

3. Detailed Processing Next, a detailed processing example of this embodiment will be described with reference to the flowchart of FIG.

  First, a face image is cut out from the captured image of the player (step S1). For example, the position of the player's face image IMF in the captured image, which is a color image, is identified using the skeleton information described with reference to FIG. 5, and an area of a given size centered on the position is trimmed. Cut out the image IMF.

  Next, a rendering process of the rendered player character image and the face image is performed (step S2). For example, as described with reference to FIG. 15, an image of the player character CHP is generated by rendering processing using an illumination model. Then, for example, the image of the player character CHP and the face image IMF are combined by the image combining method described with reference to FIG.

  Next, based on the skeleton information and the like, an area of the player's face image to be combined with the player character is set (step S3). For example, the position of the face image IMF synthesized with the player character CHP is specified based on the skeleton information described with reference to FIGS. 5 and 14, and the area AFP of the face image IMF is set as shown in FIG.

  Next, it is determined whether or not there is an overlap between the face image area and the character face area (step S4). If there is an overlap, the player character (face image) rearrangement process is performed, and at this time, the player character (face image), character size and color information change process is executed (step S5). That is, as shown in B1 of FIG. 10, when there is an overlap between the area AFP of the face image IMF and the area AFC of the face FC of the character CH, as shown in B2 and A1 of FIG. Perform relocation processing. At this time, as described with reference to FIGS. 18A to 22, the player character CHP (IMF) and the size and color information of the character CH are changed.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term (player, player character, face image, etc.) described together with a different term (subject, subject character, subject image, etc.) in a broader sense or the same meaning at least once in the specification or drawing It can be replaced by the different terms at any point. Further, the image composition process, the overlap determination process, the rearrangement process, the rendering process, the subject movement specifying process, the size and color information changing process, and the like are not limited to those described in the present embodiment, and are equivalent to these. Techniques are also included in the scope of the present invention.

PL player (subject), CHP character (subject character),
IMF face image (subject image), CH, CHA, CHB character, FC face,
AFP, AFC, ACHP, ACH area, SC skeleton,
100 processing units, 102 input processing units, 110 arithmetic processing units, 111 game processing units,
112 object space setting unit, 113 character processing unit,
114 subject information acquisition unit, 115 overlap determination unit, 118 game score calculation unit,
119 Virtual camera control unit, 120 image generation unit, 130 sound generation unit,
132 print processing unit, 140 output processing unit, 150 payout slot, 152 coin insertion slot,
160 operation unit, 162 sensor, 164 color sensor, 166 depth sensor,
170 storage unit, 172 object information storage unit, 178 drawing buffer,
180 information storage medium, 190 display unit, 192 sound output unit, 194 I / F unit,
195 Portable information storage medium, 196 communication section, 198 printing section

Claims (19)

An input processing unit for acquiring a captured image of a subject;
A subject information acquisition unit that acquires subject information for specifying the movement of the subject based on sensor information from the sensor;
An overlap determination unit that performs an overlap determination process;
An image generation unit that generates a composite image in which a subject image cut out from the captured image of the subject is combined with a synthesis target image including a character image;
Including
The image generation unit
Generating the synthesized image in which the synthesis position of the subject image in the synthesis target image changes according to the movement of the subject specified by the subject information;
The overlap determination unit
Performing an overlap determination process between the character and the subject image or a subject character connected to the subject image;
The image generation unit
When it is determined that the character and the subject image or the subject character overlap due to the movement of the subject , a rearrangement process is performed so that the character and the subject image or the subject character do not overlap. And generating the composite image. In claim 1 ,
The subject character and the character are model objects composed of a plurality of objects,
The image generation unit
When it is determined that there is an overlap when viewed from a virtual camera between the subject character and the character that is the model object arranged in the object space, at least the subject character and the character in the object space An image generation system that performs the rearrangement process of changing at least one of a position and a direction for one. In claim 2 ,
Including a game processing unit for performing game processing;
The image generation unit
During the game by the game process, when it is determined that there is an overlap between the subject character and the character when viewed from the virtual camera, at least one of the subject character and the character in the object space, An image generation system that performs the rearrangement process of changing at least one of a position and a direction. In claim 2 or 3 ,
The image generation unit
When it is determined that there is an overlap between the subject character and the character when viewed from the virtual camera set at the first viewpoint position, the position of the virtual camera is different from the first viewpoint position. An image generation system characterized by performing the rearrangement process of changing the subject character and the direction of the character while changing to a second viewpoint position. A game processing unit for performing game processing;
An input processing unit for acquiring a captured image of a subject in the game by the game process;
An overlap determination unit that performs an overlap determination process;
An image generation unit that generates a composite image in which a subject image cut out from the captured image of the subject in the game is combined with a synthesis target image including an image of a character appearing in the game ;
A communication department;
Including
The overlap determination unit
Performing an overlap determination process between the character and the subject image or a subject character connected to the subject image;
The image generation unit
When it is determined that the character and the subject image or the subject character overlap in the game, a relocation process is performed so that the character and the subject image or the subject character do not overlap. Generate the composite image ;
The communication unit is
An image generation system , wherein the composite image subjected to the rearrangement process is transmitted to a server and displayed on a display unit of an information terminal . A game processing unit for performing game processing;
An input processing unit for acquiring a captured image of a subject in the game by the game process;
An overlap determination unit that performs an overlap determination process;
An image generation unit that generates a composite image in which a subject image cut out from the captured image of the subject in the game is combined with a synthesis target image including an image of a character appearing in the game ;
A printing section;
Including
The overlap determination unit
Performing an overlap determination process between the character and the subject image or a subject character connected to the subject image;
The image generation unit
When it is determined that the character and the subject image or the subject character overlap in the game, a relocation process is performed so that the character and the subject image or the subject character do not overlap. , Generating a plurality of composite images having different rearrangement modes by the rearrangement process as a plurality of print candidate images ,
The printing unit
An image generation system, wherein an image selected from the plurality of print candidate images is printed on a print medium . In claim 5 or 6 ,
A subject information acquisition unit that acquires subject information for specifying the movement of the subject based on sensor information from the sensor;
The image generation unit
An image generation system that generates the composite image in which a composite position of the subject image in the composition target image changes according to the movement of the subject specified by the subject information . In claim 1, 2, 3, 4 or 7 ,
The subject character is a model object composed of a plurality of objects,
The image generation unit
An image generation system characterized by generating an image of the subject character by performing rendering processing of the model object arranged at a position corresponding to the position of the subject in an object space. In claim 8 ,
Including a character processing section,
The subject information acquisition unit
Based on the sensor information from the sensor, it acquires skeleton information of the object,
The character processing unit
There line processing for operating the object character based on the skeleton information of the subject,
The image generation unit
Performing the rearrangement process using at least one of an arrangement position of the model object as the subject character in the object space, a shape of the model object, and an arrangement position of the objects constituting the model object. An image generation system characterized by the above. In claim 8 or 9 ,
The image generation unit
When the rearrangement processing is performed, rendering of the model object disposed at the rearrangement position in the object space is performed based on an illumination model, and an image of the subject character is generated. Image generation system. In any one of Claims 1 thru | or 10 .
The subject image is a face image of the subject;
The overlap determination unit
Perform an overlap determination process between the character and the face image of the subject,
The image generation unit
If it is determined that the character and the face image of the subject overlap, the rearrangement process is performed so that the character and the face image of the subject do not overlap, and the composite image is An image generation system characterized by generating. In any one of Claims 1 thru | or 11 ,
The image generation unit
In the rearrangement process, a size change process is performed on at least one of the character, the subject character, and the subject image. In any one of Claims 1 to 12 ,
The image generation unit
An image generation system that performs color information change processing on at least one of the character, the subject character, and the subject image during the rearrangement processing. In claim 13 ,
The image generation unit
An image generation system that performs a change process of the color information in accordance with a degree of association between the character and the subject character. In any one of Claims 1 thru | or 14 .
The image generation unit
In the rearrangement process, an image generation system that performs a decoration process on a boundary region between the character and the subject character or a boundary region between the character and the subject image. An image generation system according to any one of claims 1 to 15,
  A display unit for displaying the composite image;
  An operation unit for inputting operation information of the player as the subject;
  A game apparatus comprising: An input processing unit for acquiring a captured image of a subject;
A subject information acquisition unit that acquires subject information for specifying the movement of the subject based on sensor information from the sensor;
An overlap determination unit that performs an overlap determination process;
As an image generation unit that generates a composite image in which a subject image cut out from the captured image of the subject is combined with a synthesis target image including a character image,
Make the computer work,
The image generation unit
Generating the synthesized image in which the synthesis position of the subject image in the synthesis target image changes according to the movement of the subject specified by the subject information;
The overlap determination unit
Performing an overlap determination process between the character and the subject image or a subject character connected to the subject image;
The image generation unit
When it is determined that the character and the subject image or the subject character overlap due to the movement of the subject , a rearrangement process is performed so that the character and the subject image or the subject character do not overlap. And generating the composite image. A game processing unit for performing game processing;
An input processing unit for acquiring a captured image of a subject in the game by the game process;
An overlap determination unit that performs an overlap determination process;
An image generation unit that generates a composite image in which a subject image cut out from the captured image of the subject in the game is combined with a synthesis target image including an image of a character appearing in the game ;
As a communication department
Make the computer work,
The overlap determination unit
Performing an overlap determination process between the character and the subject image or a subject character connected to the subject image;
The image generation unit
When it is determined that the character and the subject image or the subject character overlap in the game, a relocation process is performed so that the character and the subject image or the subject character do not overlap. Generate the composite image ;
The communication unit is
A program characterized in that the composite image subjected to the rearrangement process is transmitted to a server and displayed on a display unit of an information terminal . A game processing unit for performing game processing;
An input processing unit for acquiring a captured image of a subject in the game by the game process;
An overlap determination unit that performs an overlap determination process;
An image generation unit that generates a composite image in which a subject image cut out from the captured image of the subject in the game is combined with a synthesis target image including an image of a character appearing in the game ;
As a printing department,
Make the computer work,
The overlap determination unit
Performing an overlap determination process between the character and the subject image or a subject character connected to the subject image;
The image generation unit
When it is determined that the character and the subject image or the subject character overlap in the game, a relocation process is performed so that the character and the subject image or the subject character do not overlap. , Generating a plurality of composite images having different rearrangement modes by the rearrangement process as a plurality of print candidate images ,
The printing unit
A program for printing an image selected from the plurality of print candidate images on a print medium .