JP2006271657A - Program, information storage medium, and image pickup and display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide new interest in image pickup by utilizing image recognition processing without especially limiting a recognition object. <P>SOLUTION: When the camera unit 7 of a portable game device 1000 is activated, a picked-up image by the camera unit 7 is displayed in real time on a display 1. Then, when a shutter is turned ON, a ghost is combined with the picked-up image and displayed. At this time, even when the image of the same object is picked up, the ghost to be displayed is made different depending on a virtual lens to be mounted on the camera unit 7. That is, when the image of the object O1 is picked up by using a virtual lens, a ghost G1 is displayed (a). In addition, when the image of the same object O1 is picked up by using a different virtual lens, a ghost G2 is displayed (b). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a program for causing a display device to control display of an image captured by an imaging unit.

An image recognition technique for recognizing the content of a captured image by performing image recognition on the captured image is used in various fields. For example, as an application example of this image recognition technology, Patent Document 1 discloses a game device that performs a card game and a fortune-telling device that performs tarot fortune-telling. In such an apparatus, various kinds of cards such as playing cards and tarot cards and recognition objects such as dice are imaged using a camera, and the arrangement and the like are recognized by pattern recognition processing for performing image recognition on the captured image.
JP 2002-49909 A

  The technology of Patent Document 1 described above assumes that the shape and content of the recognition object are predetermined, but the recognition object is not particularly limited, and a new interest in imaging is realized by using image recognition processing. Isn't it possible? The present invention has been made in view of the above circumstances.

The first invention for solving the above-described problems is
To cause a computer to control display of an image captured by an imaging unit (for example, the camera unit 7 in FIG. 1 and the imaging unit 200 in FIG. 6) on a display device (for example, the display 1 in FIG. 1 and the image display unit 430 in FIG. 6). (For example, the game program 510 of FIG. 6),
Condition group selection means (for example, the virtual lens management unit 312 in FIG. 6) that selects a composite image condition group from a plurality of types of composite image condition groups (for example, the library of the embodiment) set in advance based on a user operation. Step S3) of FIG.
Synthesis determination means (for example, the image recognition unit 314 in FIG. 6) that determines whether or not the captured image matches any composite image condition included in the composite image condition group selected by the condition group selection means. Similarity calculation unit 316 and appearance determination unit 318; steps S7 to S11 in FIG.
Character image selection means for selecting a character image to be combined with the captured image from a plurality of preset character images based on the composite image condition determined to be matched by the combination determination means (for example, the appearance of FIG. 6 Determination unit 318; steps S13 to S15 in FIG.
Synthetic image display control means (for example, display control unit 322 in FIG. 6; step S17 in FIG. 14) for combining the character image selected by the character image selection means with the captured image and controlling display on the display device;
As a program for causing the computer to function.

In addition, the fourteenth invention
Imaging means (for example, the camera unit 7 in FIG. 1 and the imaging unit 200 in FIG. 6);
A display unit (for example, the display 1 in FIG. 1 and the image display unit 430 in FIG. 6) that displays an image captured by the imaging unit;
Condition group selection means for selecting a composite image condition group from a plurality of preset composite image condition groups based on a user operation;
Synthesis determination means for determining whether or not the captured image matches any composite image condition included in the composite image condition group selected by the condition group selection means;
A character image selection unit that selects a character image to be combined with the captured image from a plurality of preset character images based on the combined image condition determined to be matched by the combination determination unit;
Combined image display control means for combining the character image selected by the character image selection means with the captured image and controlling display on the display device;
(For example, the portable game apparatus 1000 in FIGS. 1 and 6).

  According to the first or fourteenth aspect, when display control of a captured image by the imaging unit is performed, the captured image is set to any composite image condition included in the composite image condition group selected based on the user operation. It is determined whether or not they match, and a character image based on the combined image condition determined to match is combined with the captured image and displayed.

  That is, when the captured image is different, the combined image condition that matches the captured image is different, so that the character image combined with the captured image is different. Also, since different composite image condition groups are selected, the composite image conditions included therein are different. Therefore, even for the same captured image, the composite image conditions that match this differ, and the character combined with the captured image The image is different. Accordingly, a combined image condition group to be selected even when a character image in a captured image is combined and displayed, and a different character image is combined and displayed depending on the object to be captured, or even when capturing the same object. It is possible to realize a new interest in imaging such that different character images are combined and displayed depending on the image.

As a second invention, the program of the first invention is
The composite image condition group includes a plurality of composite image conditions associated with different character images in advance.
The character image selection means selects a character image corresponding to a composite image condition determined to be matched by the composition determination means;
Thus, a program for causing the computer to function may be used.

  According to the second invention, the composite image condition group includes a plurality of composite image conditions that are associated with different character images in advance, and the character image corresponding to the composite image condition determined to match the captured image is It is combined with the captured image. That is, when the same composite image condition group is selected, when the same object is imaged, the same character image is always synthesized and displayed on the captured image.

As a third invention, the program of the first or second invention is
A virtual optical part (for example, a virtual lens of the embodiment) that is a predetermined optical system part that can be virtually mounted on the imaging unit is preliminarily set to any one of the plurality of types of composite image condition groups. There are multiple types associated with each other,
The condition group selection means selects a virtual optical part to be virtually mounted from among the plurality of types of virtual optical parts according to a user operation (for example, the virtual lens management unit 312 in FIG. 6, FIG. 14). Steps S1: YES to S3), and a composite image condition group corresponding to the virtual optical part selected by the parts selection unit is selected from the plurality of types of composite image condition groups.
Thus, a program for causing the computer to function may be used.

  According to the third aspect of the present invention, a virtual optical part to be mounted on the imaging means is selected according to a user operation from a plurality of types of virtual optical parts prepared in advance, and is associated with the selected virtual optical part. The composite image condition group being selected is selected. That is, if the selected virtual optical part is different, the corresponding composite image condition group is different, and therefore the character image combined with the captured image is different. Therefore, for a user, even when the same object is imaged by “replacement” of virtual optical parts such as a virtual photographic lens and a filter attached to the virtual photographic lens, different character images are combined with the captured image. It can be displayed.

As a fourth invention, the program of any one of the first to third inventions is provided.
The synthesis determination means is
A feature extraction unit (for example, the image recognition unit 314 in FIG. 6; step S7 in FIG. 14) that performs a feature extraction process for extracting a feature portion of a captured image by the imaging unit;
Feature portion determination means for determining whether or not the feature part image extracted by the feature extraction means matches any composite image condition included in the composite image condition group selected by the condition group selection means ( For example, the similarity calculation unit 316 and the appearance determination unit 318 in FIG. 6; steps S9 to S15 in FIG.
It is good also as a program for making the said computer function so that it may have.

  According to the fourth aspect, the feature portion of the captured image is extracted, and whether or not the extracted image of the feature portion matches any composite image condition included in the selected composite image condition group. Is determined. That is, the character image to be combined with the captured image is determined based on the characteristic part of the captured image.

As a fifth invention, the program of the fourth invention is
The composite image condition includes at least an object shape condition,
The feature extraction means causes the computer to function as a feature portion to extract the shape of an object shown in a captured image;
The feature portion determination means causes the computer to function to determine whether or not the object shape extracted by the feature extraction means matches an object shape condition included in a composite image condition;
It may be a program for

  According to the fifth invention, the composite image condition includes at least the object shape condition, the shape of the object shown in the captured image is extracted as the feature portion, and the extracted object shape is the composite image condition. It is determined whether or not the shape condition of the object included in is met. That is, the character image to be combined with the captured image is determined based on at least the shape of the captured object.

The sixth invention is:
To cause a computer to control display of an image captured by an imaging unit (for example, the camera unit 7 in FIG. 1 and the imaging unit 200 in FIG. 6) on a display device (for example, the display 1 in FIG. 1 and the image display unit 430 in FIG. 6). (For example, the game program 510 of FIG. 6),
A plurality of types of feature data are extracted from the captured image by at least two feature extraction processes selected based on a user operation from among three or more feature extraction processes having different extraction criteria when extracting feature data of the captured image. Feature extraction means to extract (for example, the image recognition unit 314 in FIG. 6; step S7 in FIG. 14),
A plurality of character images associated with a plurality of feature data are set in advance, and each of the plurality of character images is extracted by a plurality of feature data associated with the character image and the feature extraction unit. Character image selection means (for example, similarity calculation unit 316 and appearance determination unit 318 in FIG. 6; steps S9 to S15 in FIG. 14) that compares a plurality of types of feature data and selects a character image to be combined with the captured image. ),
A synthesized image display control unit (for example, the display control unit 322 in FIG. 6; step S17 in FIG. 14) that synthesizes the character image selected by the character image selection unit with the captured image and controls display on the display device;
As a program for causing the computer to function.

The fifteenth invention
Imaging means (for example, the camera unit 7 in FIG. 1 and the imaging unit 200 in FIG. 6);
A display unit (for example, the display 1 in FIG. 1 and the image display unit 430 in FIG. 6) that displays an image captured by the imaging unit;
A plurality of types of feature data are extracted from the captured image by at least two feature extraction processes selected based on a user operation from among three or more feature extraction processes having different extraction criteria when extracting feature data of the captured image. Feature extracting means for extracting;
A plurality of character images associated with a plurality of feature data are set in advance, and each of the plurality of character images is extracted by a plurality of feature data associated with the character image and the feature extraction unit. Character image selection means for comparing a plurality of types of feature data and selecting a character image to be combined with the captured image;
Combined image display control means for combining the character image selected by the character image selection means with the captured image and controlling the display on the display device;
(For example, the portable game apparatus 1000 in FIGS. 1 and 6).

  According to the sixth or fifteenth invention, when display control of the captured image by the imaging means is performed, at least two feature extraction processes selected based on the user operation from among the three or more feature extraction processes, A plurality of types of feature data are extracted from the captured image. Then, for each of the plurality of character images, a character image selected by comparing a plurality of feature data previously associated with the character image and a plurality of types of extracted feature data is combined with the captured image. Display control.

  That is, since different types of extracted feature data are different for different captured images, the result of comparison with the feature data of each character image is different, and the character image combined with the captured image is different. Accordingly, it is possible to realize a new interest in imaging such that a character image in a captured image is combined and displayed, and a different character image is combined and displayed depending on an object to be captured.

As a seventh invention, the program of the sixth invention is
The plurality of feature data previously associated with the character image includes at least data relating to the shape of the object,
The at least two feature extraction processes selected by the feature extraction means include a shape extraction process for extracting the shape of an object shown in a captured image as feature data.
Thus, a program for causing the computer to function may be used.

  According to the seventh aspect, the plurality of feature data associated with the character image includes at least data relating to the shape of the object, and at least two feature extraction processes to be selected are reflected in the captured image. A shape extraction process for extracting the shape of a moving object as feature data is included. That is, the character image to be combined with the captured image is determined based on at least the shape of the captured object.

As an eighth invention, the program of the sixth or seventh invention is
A virtual optical part (for example, a virtual lens of the embodiment) that is a predetermined optical system part that can be virtually mounted on the imaging unit is associated with at least two feature extraction processes among the three or more feature extraction processes in advance. Multiple types are prepared,
The feature extraction unit selects a virtual optical part to be virtually mounted from the plurality of types of virtual optical parts according to a user operation (for example, the virtual lens management unit 312 in FIG. 6; FIG. 14). Steps S1: YES to S3), and a plurality of types of feature data are extracted from the captured image by a feature extraction process corresponding to the virtual optical part selected by the parts selection unit.
Thus, a program for causing the computer to function may be used.

According to the eighth invention,
A virtual optical part to be mounted on the imaging means is selected according to a user operation from a plurality of types of virtual optical parts prepared in advance, and at least two feature extraction processes associated with the selected virtual optical part Thus, a plurality of types of feature data are extracted from the imaging. That is, if the selected virtual optical part is different, the corresponding feature extraction process is different, so the character image combined with the captured image is different. Therefore, for the user, for example, a virtual photographic lens or attached to this By “changing” virtual optical parts such as filters, it is possible to realize that different character images are combined and displayed on the captured image even when the same object is imaged.

As a ninth invention, the program of the third or eighth invention is
The computer is caused to function as synthesized character storage means (for example, the storage unit 500 in FIG. 6; step S19 in FIG. 14) that stores the character of the character image synthesized with the captured image by the synthesized image display control means as an acquired character. ,
The computer functions as shooting level changing means (for example, the player level management unit 324 in FIG. 6; step S25 in FIG. 14) for changing the shooting level of the user based on the acquired character stored in the synthesized character storage means. Let
The computer is caused to function as usable part changing means (for example, virtual lens management unit 312 in FIG. 6; step S27 in FIG. 14) that changes virtual optical parts that can be virtually mounted according to the current shooting level. ,
The computer selects the virtual optical part to be virtually mounted out of the virtual optical parts usable by the usable part variable means according to the current photographing level according to a user operation. Make it work,
It may be a program for

  According to the ninth aspect, the character of the character image combined with the captured image is stored as an acquired character, and the user's shooting level is changed based on the stored acquired character. The virtual optical parts that can be virtually mounted are varied according to the current shooting level, and among the virtual optical parts that can be used according to the current shooting level, virtual optics to be virtually mounted A part is selected according to a user operation.

  Therefore, for example, the more acquired characters, the higher the shooting level of the user, and the higher the shooting level, the more virtual optical parts that can be used, and the more acquired characters the more acquired characters, It is possible to add interest such that the number of usable virtual optical parts increases and the number of character images that can be combined and displayed on the captured image increases. In addition, since it is selected according to the user operation from the available virtual optical parts, even when the same object is imaged, various different character images can be obtained by exchanging the virtual optical parts. You can enjoy being displayed.

As a tenth invention, the program of the ninth invention is
The computer as a usable part number variable means (for example, virtual lens management unit 312 in FIG. 6; step S27 in FIG. 14) for varying the number of virtual optical parts that can be virtually mounted according to the current photographing level. Function
The part selection means selects a virtual optical part to be virtually mounted according to a user operation within the range of the number of virtual optical parts that can be used by the usable part number variable means according to the current shooting level. To make the computer function,
It may be a program for

  According to the tenth aspect, the number of virtual optical parts that can be virtually mounted is varied according to the current shooting level, and the number of virtual optical parts that can be used according to the current shooting level. Within this range, the virtual optical part is selected by the user operation.

As an eleventh invention, the program of the ninth or tenth invention is
The shooting level varying means causes the computer to function to change the shooting level based on the number of acquired characters stored by the synthesized character storage means;
It may be a program for

  According to the eleventh aspect, the shooting level is changed based on the stored number of acquired characters.

As a twelfth invention, the program according to any of the ninth to eleventh inventions,
Whether or not to synthesize the character image selected by the character image selection unit with the captured image, and to cause the computer to function as an appearance determination unit that determines with given accuracy according to the current shooting level;
Causing the computer to function so as to synthesize the character image with a captured image by the imaging unit and control display on the display device when the combined image display control unit determines to combine the appearance determination unit;
It may be a program for

  According to the twelfth aspect, whether or not to synthesize the selected character image with the captured image is determined with a given accuracy according to the current shooting level. Display control is performed by combining the image with the captured image.

The thirteenth invention
A computer-readable information storage medium (for example, the storage unit 500 in FIG. 6) storing the program of any one of the first to twelfth inventions.

  Here, the “information storage medium” is a storage medium such as a hard disk, MO, CD-ROM, DVD, memory card, or IC memory that can be read by a computer. Therefore, according to the thirteenth aspect, by causing the computer to read the information stored in the information storage medium and executing the arithmetic processing, the same effects as in any of the first to twelfth aspects are achieved. Can play.

  According to the present invention, a character image in a captured image is combined and displayed, and a different character image is combined and displayed depending on the object to be captured. Even when the same object is captured, a virtual image to be selected is selected. It is possible to realize a new interest in imaging, such as combining and displaying different character images depending on optical parts.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In the following, a case where the present invention is applied to a portable game device will be described, but embodiments to which the present invention can be applied are not limited thereto.

[Appearance of game device]
FIG. 1 is an external view showing an example of a portable game apparatus 1000 in the present embodiment. FIG. 4A shows a front view of the portable game apparatus 1000, and FIG. 4B shows a rear view. As shown in the figure, the portable game apparatus 1000 includes a display 1, a speaker 3, and operation keys 5 on the front surface of a substantially rectangular casing. In addition, the camera unit 7 is provided on the upper side of the housing, and an insertion port for inserting the game cartridge 10 is provided on the lower side.

  The display 1 is a color liquid crystal display with a backlight such as a TFT display, and displays various information, images, and the like. The display 1 functions as an electronic viewfinder when the camera unit 7 is activated, and displays a captured image by the camera unit 7 on a monitor.

  The operation keys 5 are for a player (user) to input a game operation, and each key includes a shutter key for inputting an imaging instruction and a lens replacement key for inputting a virtual lens replacement instruction. Is assigned.

  The camera unit 7 has a photographic lens 8 formed of glass or the like provided on the back side thereof, and an imaging element such as a CMOS or a CCD, and digitally converts image data imaged by the imaging element through the photographic lens 8. Convert to data and output. In addition, although this camera unit 7 is comprised integrally with the housing | casing, it is good also as being comprised so that attachment or detachment is possible.

  In addition, the portable game apparatus 1000 includes a reading device that reads game information (game program and game data) stored in the game cartridge 10 inserted into the insertion slot, and other external devices such as other portable game apparatuses 1000. It includes a communication device for connecting and performing wireless / wired communication, and a control device equipped with a CPU, IC memory, and the like. The CPU mounted on the control device executes various processes based on programs and data read from the IC memory and the game cartridge 10, operation signals of the operation keys 5, image data input from the camera unit 7, and the like. Then, an image signal such as a game screen and a sound signal of game sound are generated. Then, the generated image signal is output to the display 1 to display the game screen, and the sound signal is output to the speaker 3 to output the game sound.

  Information (system program, game program, game data, etc.) necessary for the portable game apparatus 1000 to execute a game is stored in an IC memory, a game cartridge 10 or the like mounted on the control apparatus. More specifically, the system program is stored in the IC memory of the control device, and the game program and game data are stored in the game cartridge 10. Therefore, the player can cause the portable game apparatus 1000 to execute a different game by exchanging the game cartridge 10.

[Overview]
In the game of the present embodiment, an effect is performed as if the “ghost” that is the character of the game exists in the surrounding space of the player that is the real space.

2-4 is a figure which shows the outline | summary of the game of this embodiment.
As shown in FIG. 2A, when the camera unit 7 of the portable game apparatus 1000 is activated, an image (captured image) captured by the photographing lens 8 is displayed on the display 1 in real time. In this state, when the operation key 5 is operated to input an imaging instruction (shutter ON), the ghost G1 is displayed over the captured image at the time when the imaging instruction is input (when the shutter is ON). That is, the ghost G1 “appears”. The ghost G1 can be captured (acquired) by performing a predetermined capture process for the ghost G1 that has appeared. Note that the ghost does not always appear due to the input of the imaging instruction, and may not appear.

  At this time, the portable game apparatus 1000 performs a predetermined image recognition process on the captured image at the time when the shooting instruction is input (when the shutter is turned on), and based on the feature data of the captured image obtained as a result in advance. One of a plurality of prepared ghosts is selected and displayed on the display 1.

  Which ghost appears among a plurality of ghosts depends on the subject. That is, as shown in FIG. 5B, the same ghost G1 appears even when the same subject O1 is imaged at a location different from that shown in FIG. Further, as shown in FIG. 3, when a different subject O2 is photographed, a different ghost G2 appears.

  In this embodiment, a lens (virtual lens) that is a virtual optical part that can be virtually mounted on the camera unit 7 can be “replaced”. A plurality of types of virtual lenses are prepared, and the types and appearance probabilities (appearance probabilities) of ghosts that can appear for each type differ. That is, even when the same subject is imaged, the displayed ghost differs depending on the type of virtual lens to be attached. The player can select an appropriate virtual lens according to the type of ghost to be captured from the plurality of types of virtual lenses.

  For example, as shown in FIG. 4A, when a subject O1 is imaged using (wearing) a certain virtual lens, a ghost G1 appears, but a different virtual lens is used as shown in FIG. 4B. When the same subject O1 is imaged, a different ghost G3 appears.

  The types of virtual lenses include (1) a virtual lens according to the characteristics of the subject to be imaged and (2) a virtual lens according to the type of ghost that appears. (1) The virtual lens corresponding to the characteristics of the subject includes, for example, a “color-based” virtual lens in which a ghost appears when a subject of a specific color such as red, blue, green, and yellow is imaged. When imaging a subject with a specific pattern, such as a “shape-based” virtual lens, striped pattern, grid pattern, or solid color, where a ghost appears when imaging a subject with a specific shape such as a circle, triangle, or quadrilateral There is a “patterned” virtual lens where ghosts appear. In addition, (2) virtual lenses according to the type of ghost include, for example, a “speed lens” in which a ghost that has a high moving speed appears, and a “rare lens” in which a ghost with a small number but high value appears. There is a virtual lens.

  A plurality of types of virtual lenses are prepared, but the types of virtual lenses that can be used differ depending on the current player level (shooting level). Note that the player level is determined according to, for example, the type and number of ghosts captured so far. That is, the player level increases as more types of ghosts are captured.

  FIG. 5 is a diagram illustrating an example of the relationship between the type of virtual lens and the player level. As shown in the figure, each virtual lens is associated with a player level at which it can be used, and becomes usable when the corresponding player level is reached. In the figure, when the player level is “beginning”, an “introductory lens” in which a ghost can appear relatively easily when any subject is imaged, but the player level is “intermediate”. Then, in addition to this, virtual lenses such as “red lens”, “striped lens”, and “triangular lens” can be used. When the player level becomes “advanced”, virtual lenses such as “speed lens”, “rare lens”, and “blue lens” can be used. That is, all virtual lenses can be used. Each virtual lens has a lower (smaller) appearance probability of a ghost as the corresponding player level is higher.

[Function configuration]
FIG. 6 is a block diagram illustrating an example of a functional configuration of the portable game apparatus 1000. According to the figure, the portable game apparatus 1000 is functionally configured to have an operation input unit 100, an imaging unit 200, The processing unit 300, the image display unit 430, the sound output unit 440, the storage unit 500, and the communication unit 600 are configured.

  The operation input unit 100 receives an operation instruction from the player, and outputs an operation signal corresponding to the operation to the processing unit 300. In particular, in the present embodiment, an imaging execution instruction and a virtual lens replacement instruction are detected and output to the processing unit 300. In FIG. 1, the operation key 5 corresponds to this.

  The imaging unit 200 includes an imaging element such as a CMOS or CCD, a photographing lens that forms an image of a light beam of a subject on the imaging element, and an A / D conversion that converts an electrical signal (analog image signal) output from the imaging element into a digital signal. A captured image data of the subject is output to the processing unit 300 including a circuit. In FIG. 1, the camera unit 7 corresponds to this.

  The processing unit 300 performs various arithmetic processes such as overall control of the portable game apparatus 1000, game progress control, and image generation. This function is realized by, for example, an arithmetic device such as a CPU (CISC type, RISC type), ASIC (gate array, etc.) or a control program thereof. In FIG. 1, a CPU or the like mounted on a built-in control device corresponds to this.

  In addition, the processing unit 300 includes a game calculation unit 310 that mainly performs calculation processing related to game execution, and an image generation unit 330 that generates a game image based on various data obtained by the processing of the game calculation unit 310. And a sound generator 340 for generating game sounds such as sound effects and BGM.

  The game calculation unit 310 performs various game processes based on game information (program and data) read from the storage unit 500, operation signals input from the operation input unit 100, captured image data input from the imaging unit 200, and the like. Execute. In the present embodiment, the game calculation unit 310 includes a virtual lens management unit 312, an image recognition unit 314, a similarity calculation unit 316, an appearance determination unit 318, a display control unit 322, and a player level management unit 324. Including.

  The virtual lens management unit 312 manages virtual lenses based on the virtual lens information 522. Specifically, in accordance with a virtual lens replacement instruction input from the operation input unit 100, a virtual lens to be used (used lens) is replaced. That is, referring to the virtual lens information 522, the used lens is changed (exchanged) to a virtual lens selected from the currently available virtual lenses. Further, according to the current player level, the availability / impossibility of each of the plurality of virtual lenses prepared in advance is changed. That is, when the player level increases, a virtual lens corresponding to the increased player level can be newly used.

  The virtual lens information 522 is information regarding a plurality of virtual lenses prepared in advance. FIG. 7 shows an example of the data configuration of the virtual lens information 522. According to the figure, the virtual lens information 522 associates, for each virtual lens, a name (virtual lens name) 522a, a library 522b, a usable level 522c, a usable flag 522d, and a usable flag 522e. I remember.

  The library 522b stores the name of the library (used library) used when recognizing the captured image when the corresponding virtual lens is used. The library is information such as an image recognition method for a captured image, a ghost that may appear, an appearance condition thereof, and the like, and this information is stored in the library information 524. In this embodiment, a virtual lens and a library are associated with each other on a one-to-one basis, and each virtual lens is associated with a library having contents corresponding to the player level at which the virtual lens can be used. That is, the higher the player level that can be used, the lower the ghost appearance probability.

  The usable level 522c stores a player level value at which the corresponding virtual lens can be used. In this embodiment, the player level has three levels of “beginner”, “intermediate”, and “advanced”, and any one of “beginner”, “intermediate”, and “advanced” is set according to each. Yes.

  The availability flag 522d is a flag indicating whether or not the corresponding virtual lens is usable. Whether it is usable or not is determined according to the current player level and the usable level 522c. That is, if the current player level has reached the usable level 522c, it is usable ("1"), and if it has not reached the usable level 522c, it is unusable ("0").

  The use flag 522e is a flag indicating whether or not the corresponding virtual lens is used (whether it is a used lens). The use flag 522e is usable, that is, the usable flag 522d is set to “1”. Among the virtual lenses, one virtual lens is used lens (“1”).

  The library information 524 is information regarding a plurality of libraries prepared in advance, and includes a plurality of library data 525 for each library. 8 to 10 show examples of the data structure of the library data 525. FIG. 8 to 10, the library data 525 includes a corresponding library name (library name) 525a, recognition method information 525b, ghost information 525c, and threshold information 525d.

  The recognition method information 525b is information for designating an image recognition method for a captured image, and stores one or a plurality of image recognition methods and weights in association with each other. The weight is a value indicating the degree of importance with respect to the corresponding image recognition method, and is set so that the total weight of each image recognition method is “1.0”. Based on this weight value, the overall similarity between the feature data of the captured image and the feature data of each ghost in the ghost information 525c is calculated.

  For example, in “Library 1” shown in FIG. 8, “shape recognition” and “color recognition” are designated as the image recognition methods in the recognition method information 525b. In the “library 2” shown in FIG. 9, “pattern recognition” and “color recognition” are designated as image recognition methods. Further, in “library 3” shown in FIG. 10, “shape recognition” and “color recognition” are designated as image recognition methods, as in “library 1” shown in FIG. Yes.

  The ghost information 525c is information on a ghost that can appear when the library is used, and stores the name (ghost name) and feature data in association with each other for each ghost.

  The feature data stores a feature value corresponding to each image recognition method specified by the recognition method information 525b. For example, in “Library 1” shown in FIG. 8, “shape recognition” and “color recognition” are designated as image recognition methods, and “shape” and “color” are assigned to each ghost corresponding to these image recognition methods. "Is set. In the “library 2” shown in FIG. 9, “pattern recognition” and “color recognition” are designated as image recognition methods, and “ghost” and “pattern” are assigned to each ghost corresponding to these image recognition methods. A value for "Color" is set. In the “library 3” shown in FIG. 10, “shape recognition” and “color recognition” are designated as image recognition methods. Corresponding to these image recognition methods, “shape” and “ A value for "Color" is set.

  For each ghost in the ghost information 525c, for each image recognition method, the associated feature data and the feature data of the captured image are compared, and the similarity between the two data is calculated. Then, the total similarity value is calculated by multiplying the calculated similarity for each image recognition method by the weight of each image recognition method specified by the recognition method information 525b.

  The threshold information 525d is information serving as a criterion for determining whether or not each ghost of the ghost information 525c appears (displayed). Specifically, the threshold information 525d is a total value of the calculated similarity of each ghost of the ghost information 525c. Stores the threshold. That is, the larger the threshold, the smaller the ghost appearance probability. In the present embodiment, the ghost having the largest similarity in the ghost information 525c with a total value greater than the threshold value 525d is determined as the ghost to appear.

  In FIG. 6, when an imaging instruction is input from the operation input unit 100, the image recognition unit 314 performs image recognition processing on the captured image data input from the imaging unit 200 and extracts feature data of the captured image. Specifically, with reference to the library information 524, image recognition processing is performed by an image recognition method specified by a library (used library) corresponding to the used lens. The captured image data is stored in the captured image information 526.

  Here, image recognition methods specified by each library include shape recognition, color recognition, and pattern recognition. In shape recognition, for example, a Hough transform is performed on captured image data to detect a straight line component and its strength, a shape of a subject is recognized by a combination of the detected straight lines, and a feature portion based on the recognized shape is extracted. In the color recognition, the color of the entire captured image or the feature portion recognized by the shape recognition is recognized. In the pattern recognition, for example, a Fourier transform is performed on the captured image data to extract a frequency component, and the entire captured image or the pattern of the feature portion recognized by the shape recognition is recognized. In the present embodiment, image recognition is performed on captured image data by using one or a plurality of image recognition methods, and feature data of the captured image is extracted for each image recognition method.

  The image recognition result by the image recognition unit 314 is stored in the image recognition result information 528. FIG. 11 shows an example of the data configuration of the image recognition result information 528. According to the figure, the image recognition result information 528 stores the image recognition method 528a and the extracted feature data 528b in association with each other.

  This figure shows a case where the library used is “library 1” shown in FIG. Since the image recognition methods designated by “Library 1” are “shape recognition” and “color recognition”, extracted feature data for “shape” and “color” are stored here. Further, when “library 2” shown in FIG. 9 is a use library, extracted feature data for “pattern” and “color” is stored, and “library 3” shown in FIG. 10 is used library. In the case of, feature data for “shape” and “color” is stored as in “library 1”.

  The similarity calculation unit 316 calculates the similarity for each ghost specified in the use library based on the image recognition result by the image recognition unit 314. Specifically, with reference to the library data 525 and image recognition result information 528 of the used library, for each ghost of the ghost information 525c, for each image recognition method designated by the recognition method information 525b, the feature data and the captured image The similarity with the feature data is calculated according to a predetermined calculation formula. Then, the similarity for each image recognition method calculated is multiplied by the weight specified by the recognition method information 525b to calculate a total value of similarity.

  The similarity calculated by the similarity calculation unit 316 is stored in the similarity calculation information 532. FIG. 12 shows an example of the data configuration of the similarity calculation information 532. According to the figure, the similarity calculation information 532 stores the name (ghost name) 532a and the calculated similarity 532b in association with each ghost specified by the library used. The similarity 532b includes the similarity for each image recognition method specified in the library used and the total value of the similarity.

  This figure shows a case where the library used is “library 1” shown in FIG. Since the image recognition methods specified in “Library 1” are “shape recognition” and “color recognition”, here, the calculated similarity for each of “shape” and “color”, and the similarity of these similarities The total value is stored.

  The appearance determination unit 318 determines a ghost to appear based on the similarity calculated by the similarity calculation unit 316. Specifically, referring to the similarity calculation information 532, the ghost having the largest similarity value is selected, and the overall value of the similarity level of the selected ghost is specified by the threshold information 525d of the library used. It is determined whether or not the threshold value is exceeded. If it is equal to or greater than the threshold, it is determined that the ghost appears.

  The display control unit 322 controls the image generation unit 330 to control image display on the image display unit 430. Specifically, a captured image based on the captured image data input from the imaging unit 200 is displayed as a moving image on the image display unit 430, and a ghost image determined to appear by the appearance determination unit 318 is superimposed on the captured image. To display.

  The player level management unit 324 refers to the ghost capture information 534 and changes the player level based on the types of ghosts captured so far. The current player level is stored in the player level information 536.

  The ghost capture information 534 is information indicating a ghost captured so far. FIG. 13 shows an example of the data configuration of the ghost capture information 534. According to the figure, the ghost capture information 534 includes a plurality of ghost capture data 535 for each library. The ghost capture data 535 includes the name of the corresponding library (library name) 535a, list information 535b, and the number of captures 535c.

  The list information 535b stores, for each ghost of the corresponding library, the name (ghost name) and a capture flag indicating whether or not it has been captured. The capture flag is set to “1” if the corresponding ghost has been captured, and is set to “0” if it has not been captured.

The number of captures 535c is the number of captured ghosts M with respect to the total number of ghosts N of the corresponding library. This figure shows ghost capture data 535 for “library 1” and “library 2”. According to the figure, the "Library 1", of the total N _A pet ghost, M _A fish is caught already, the "Library 2", of the total N _B animals ghost, M _B mice Has been captured.

  The player level management unit 324 changes the player level based on the capture number 535c. That is, for each library corresponding to each usable virtual lens, a capture rate is calculated by dividing the total ghost number N by the current capture number M. If the calculated capture rate is equal to or greater than a predetermined value (for example, 0.8) in all the libraries corresponding to each usable virtual lens, the player level is increased by one step.

  The image display unit 430 displays a game image based on the image signal from the processing unit 300. In particular, in the present embodiment, a captured image obtained by the imaging unit 200 is displayed on the monitor in real time according to the control of the display control unit 322, and a ghost image determined to appear is superimposed on the captured image. This function is realized by hardware such as CRT, LCD, ELD, for example. In FIG. 1, the display 1 corresponds to this.

The sound generation unit 340 generates game sounds such as sound effects and BGM used during the game, and outputs the generated game sound signal to the sound output unit 440.
The sound output unit 440 outputs game sounds such as BGM and sound effects based on the sound signal from the sound generation unit 340. This function is realized by, for example, a speaker. In FIG. 1, the speaker 3 corresponds to this.

  The storage unit 500 stores a system program for realizing various functions for causing the processing unit 300 to control the portable game apparatus 1000 in an integrated manner, a program and data necessary for executing the game, and the like. Used as a work area of the processing unit 300, temporarily stores calculation results executed by the processing unit 300 according to various programs, input data input from the operation input unit 100, and the like. This function is realized by, for example, various IC memories, hard disks, CD-ROMs, DVDs, MOs, RAMs, VRAMs, and the like. In FIG. 1, ROM, RAM, and game cartridge 10 mounted on the control device correspond to this.

  Further, the storage unit 500 stores a game program 510 and game data for causing the processing unit 300 to function as the game calculation unit 310. The game data includes virtual lens information 522, library information 524, captured image information 526, image recognition result information 528, similarity calculation information 532, ghost capture information 534, and player level information 536. ing.

  The communication unit 600 connects to a predetermined communication line and performs data communication with an external device such as another portable game device 1000. This function is realized by a wireless communication module such as Bluetooth (registered trademark) or IrDA, a modem, TA, a jack of a wired communication cable, a control circuit, and the like. In FIG. 1, the built-in communication device corresponds to this.

[Process flow]
FIG. 14 is a flowchart for explaining the flow of the game process in the present embodiment. This process is realized by the processing unit 300 executing a process according to the game program 510.

  According to the figure, first, the virtual lens management unit 312 determines whether or not a lens replacement instruction is input from the operation input unit 100, and if it is input (step S1: YES), the lens to be used is instructed. Change to a virtual lens (lens exchange) (step S3). Next, the image recognizing unit 314 determines whether or not a shooting instruction is input from the operation input unit 100 (shutter ON). If not input (step S5: NO), the process returns to step S1.

  If a shooting instruction has been input (step S5: YES), the image recognition unit 314 refers to the library information 524 and performs an image recognition method on the captured image by an image recognition method specified by a library (used library) corresponding to the used lens. Image recognition processing is performed, and feature data of the captured image is extracted (step S7).

  Next, the similarity calculation unit 316 refers to the library information 524 and performs a loop A process on all ghosts specified in the library in use in order. That is, in the loop A, the similarity calculation unit 316 refers to the image recognition result information 528, and for each image recognition method specified by the library used, the target ghost feature data and the extracted imaging Based on the image feature data, the similarity between the two data is calculated according to a predetermined calculation formula (step S9). Then, the calculated similarity of each image recognition method is multiplied by the weight set for each image recognition method, and the total value of the similarity is calculated (step S11).

  When the processing of loop A for all ghosts is completed, the appearance determination unit 318 then refers to the similarity calculation information 532 and selects the ghost having the highest similarity value (step S13). Then, it is determined whether or not the total value of the similarity of the selected ghost is equal to or greater than a threshold value specified by the library used. If it is equal to or greater than the threshold value (step S15: YES), the selected ghost appears. Judge that you want to. Then, the display control unit 322 causes the image display unit 430 to display the ghost image on the captured image (step S17). Thereafter, the game calculation unit 310 performs a predetermined capture process based on an operation signal from the operation input unit 100 (step S19), and if the capture is successful (step S21: YES), captures the ghost. The ghost capture information 534 is updated.

  Subsequently, the player level management unit 324 refers to the ghost capture information 534, calculates a capture rate for each ghost in the library in use, and determines whether or not all the calculated capture rates are equal to or greater than a predetermined value. . As a result, if all the values are equal to or greater than the predetermined value (step S23: YES), the player level is increased by one step (step S25). Then, the virtual lens management unit 312 updates the virtual lens information 522 so that the virtual lens corresponding to the player level can be used (step S27).

  Thereafter, the game calculation unit 310 determines whether or not to end the game. If the game is not ended (step S29: NO), the process returns to step S1, and if the game is ended (step S29: YES), the process is performed. Exit.

[Action / Effect]
As described above, according to the present embodiment, when the camera unit 7 of the portable game apparatus 1000 is activated and a subject is imaged, a ghost corresponding to the subject is displayed on the display 1 so as to overlap the captured image. Also, if the virtual lens (used lens) virtually attached to the camera unit 7 is different, a different ghost is displayed even when the same subject is imaged.

  At this time, in the portable game apparatus 1000, when an imaging instruction is input by the player, a ghost to be displayed is determined based on a library (used library) corresponding to the used lens. That is, image recognition is performed on the captured data by the image recognition method specified by the library used to extract the feature data of the captured image, and the feature data and the extracted captured image for each ghost specified by the library used The similarity is calculated based on the feature data. Then, a ghost image having the highest total similarity value and equal to or higher than the threshold value specified by the use library is combined with the captured image and displayed.

  That is, if the lens used is different, the corresponding ghost is different because the corresponding library is different. Therefore, when the shutter is turned on, a ghost image is synthesized and displayed on the captured image, and the ghost displayed is different even when the same subject is imaged by exchanging the lens used. realizable.

  Furthermore, the usable virtual lenses differ depending on the player level, and the usable virtual lenses increase as the player level increases. The player level is determined based on the number of captured ghosts, and increases as a result of capturing more than a predetermined type of ghosts. Therefore, the more imaging and capturing more ghosts, the higher the player level and the more virtual lenses available, i.e. the more ghosts that can be captured. Can you capture a game that never gets tired?

[Modification]
The application of the present invention is not limited to the above-described embodiments, and can be appropriately changed without departing from the spirit of the present invention.

(A) Number of appearing ghosts For example, in the embodiment described above, when an imaging instruction is input, one ghost having the highest (larger) similarity value and not less than a predetermined threshold value appears. However, this may be caused to cause all ghosts whose total value of similarity is equal to or greater than the threshold to appear.

(B) Appearance probability (accuracy)
In the above-described embodiment, the ghost appearance probability is determined based on the threshold value specified by the threshold information 525d of the library data 525. However, the appearance probability may be determined according to the player level. Specifically, among the ghosts specified in the library to be used, the ghost having the largest total similarity and having a predetermined value or more is set as an appearance candidate ghost, and the appearance candidate ghost is set according to the player level. It is determined whether or not to appear according to the appearance probability. At this time, as the player level is higher, the appearance probability is set lower, and as a result, the ghost capture difficulty can be made higher (harder).

(C) Correspondence Relationship between Virtual Lens and Library In the above-described embodiment, the virtual lens and the library correspond one-to-one, but a plurality of libraries may be associated with one virtual lens. One library may be associated with a plurality of virtual lenses in common.

(D) Virtual Optical Part In the above-described embodiment, the virtual lens that is virtually mounted as the virtual optical part has been described as an example. However, this may be a virtual filter that is virtually mounted on the photographing lens. . In this case, as in the above-described embodiment, a library is associated with each virtual filter, and image recognition for captured image data and determination of a ghost to appear using a library corresponding to a virtual filter to be virtually mounted. I do. Here, the virtual filter and the library may correspond one-to-one or may correspond one-to-one.

  Furthermore, both the virtual lens and the virtual filter may be virtually mounted. In this case, image recognition for captured image data and determination of a ghost to appear are performed using libraries corresponding to virtual lenses and virtual filters to be virtually mounted.

(E) Ghost to appear In the above-described embodiment, the same ghost appears (displayed) when the same subject is imaged using the same virtual lens, but the same virtual lens is used. Even if the same subject is imaged, different ghosts may appear.

  In this case, each library data 525 constituting the library information 524 is configured as library data 525A shown in FIGS. That is, the library data 525A includes a library name 525a, recognition method information 525b, feature information 525e, and threshold information 525d.

  The feature information 525e is information that specifies the feature of the captured image in which a ghost may appear when the library is used, and stores feature data and an appearance ghost ID in association with each other. The feature data stores a feature value corresponding to each image recognition method specified by the recognition method information 525b. The appearance ghost ID is an ID (number) for designating an appearing ghost, and stores a different value for each feature data.

  The similarity calculation unit 316 calculates the similarity between the feature data designated by the feature information 525e in the used library and the feature data of the captured image for each image recognition method. Then, the similarity for each calculated image recognition method is multiplied by the weight of the image recognition method specified by the recognition method information 525b and added to calculate a total value of similarity.

  In addition, the appearance determination unit 318 refers to the feature information 525e of the used library, and has a feature that the total value of the similarity calculated by the similarity calculation unit 316 is the largest and is equal to or larger than the threshold specified by the threshold information 525d. An appearance ghost ID corresponding to the data is selected. Then, with reference to the ghost information 538, it is determined that a ghost corresponding to the selected appearance ghost ID appears.

  The ghost information 538 is information for designating a ghost to appear based on the appearance ghost ID, and includes a plurality of ghost data 539 as shown in FIG. Each ghost data 539 stores an appearance ghost ID 539a and a ghost name 539b in association with each other. The appearance ghost ID 539a stores the value of the appearance ghost ID specified by the feature information 525e of each library data 525A, and is the same for each ghost data 539. And the ghost name 539b matched with each appearance ghost ID 539a differs for every ghost data 539. FIG.

  The appearance determination unit 318 determines that a ghost associated with the appearance ghost ID selected in any of the ghost data 539 from among the ghost data 539 appears. Therefore, when the same subject is imaged using the same virtual lens, any ghost selected from a plurality of ghosts prepared in advance appears.

  In this case, the ghost data 539 used for determining the ghost to be determined to appear may be determined randomly, for example, or may be determined based on whether or not a predetermined game condition is satisfied. Further, each ghost data 539 may be associated with a virtual filter that is another virtual optical part described above, and the ghost data 539 corresponding to the virtual filter to be mounted may be used. Specifically, when only a certain virtual lens is mounted, when only a virtual filter is mounted in addition to the same virtual lens, or when another virtual filter is mounted in addition to the same virtual lens, different ghosts are used. Data 539 may be used.

(F) Apparatus to be applied In addition, in the above-described embodiment, the case where the present invention is applied to a portable game apparatus has been described. Also good.

An example of the appearance of a portable game device in an embodiment. The schematic diagram at the time of "capture mode" in an embodiment. The schematic diagram at the time of "capture mode" in an embodiment. The schematic diagram at the time of "capture mode" in an embodiment. An example of a virtual lens. 2 is a functional configuration example of a portable game device. The data structural example of virtual lens information. Data structure example of library data. Data structure example of library data. Data structure example of library data. The data structural example of image recognition result information. The data structural example of similarity calculation information. Data configuration example of ghost capture information. The flowchart of the process at the time of "capture mode" in this embodiment. The structural example of the library data in a modification. The structural example of the library data in a modification. The structural example of the library data in a modification. The data structural example of the ghost information in a modification.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1000 Portable game device 100 Operation input part 200 Imaging part 300 Processing part 310 Game operation part 312 Virtual lens management part 314 Image recognition part 316 Similarity calculation part 318 Appearance judgment part 322 Display control part 324 Player level management part 330 Image generation part 340 Sound generation unit 430 Image display unit 440 Sound output unit 500 Storage unit 510 Game program 522 Virtual lens information 524 Library information 525 Library data 526 Captured image information 528 Image recognition result information 532 Similarity calculation information 534 Ghost capture information 535 Ghost capture data 536 Player level information 600 Communication unit

Claims (15)

A program for causing a display device to control display of an image captured by an imaging unit on a computer,
Condition group selection means for selecting a composite image condition group from a plurality of preset composite image condition groups based on a user operation,
A synthesis determination unit that determines whether or not the captured image matches any composite image condition included in the composite image condition group selected by the condition group selection unit;
A character image selection unit that selects a character image to be combined with the captured image from a plurality of preset character images based on the combined image condition determined to be matched by the combination determination unit;
Combined image display control means for combining the character image selected by the character image selecting means with the captured image and controlling display on the display device;
A program for causing the computer to function as The composite image condition group includes a plurality of composite image conditions associated with different character images in advance.
The character image selection means selects a character image corresponding to a composite image condition determined to be matched by the composition determination means;
The program according to claim 1 for causing the computer to function. A plurality of types of virtual optical parts, which are predetermined optical system parts that can be virtually mounted on the imaging means, are prepared in advance in association with any one of the plurality of types of composite image condition groups. And
The condition group selection means includes part selection means for selecting a virtual optical part to be virtually mounted from the plurality of types of virtual optical parts according to a user operation, Selecting a composite image condition group corresponding to the virtual optical part selected by the parts selection means from
The program according to claim 1 or 2 for causing the computer to function as described above. The synthesis determination means is
Feature extraction means for performing a feature extraction process for extracting a feature portion of an image captured by the imaging means;
A feature part determination unit that determines whether an image of the feature part extracted by the feature extraction unit matches any composite image condition included in the composite image condition group selected by the condition group selection unit; ,
The program according to any one of claims 1 to 3, for causing the computer to function so as to include a computer program. The composite image condition includes at least an object shape condition,
The feature extraction means causes the computer to function as a feature portion to extract the shape of an object shown in a captured image;
The feature portion determination means causes the computer to function to determine whether or not the object shape extracted by the feature extraction means matches an object shape condition included in a composite image condition;
A program according to claim 4 for. A program for causing a display device to control display of an image captured by an imaging unit on a computer,
A plurality of types of feature data are extracted from the captured image by at least two feature extraction processes selected based on a user operation from among three or more feature extraction processes having different extraction criteria when extracting feature data of the captured image. Feature extraction means for extracting;
A plurality of character images associated with a plurality of feature data are set in advance, and each of the plurality of character images is extracted by a plurality of feature data associated with the character image and the feature extraction unit. Character image selection means for comparing a plurality of types of feature data and selecting a character image to be combined with the captured image;
A combined image display control unit configured to combine the character image selected by the character image selection unit with the captured image and control display on the display device;
A program for causing the computer to function as The plurality of feature data previously associated with the character image includes at least data relating to the shape of the object,
The at least two feature extraction processes selected by the feature extraction means include a shape extraction process for extracting the shape of an object shown in a captured image as feature data.
The program according to claim 6 for causing the computer to function as described above. A plurality of types of virtual optical parts, which are predetermined optical system parts that can be virtually mounted on the imaging means, are prepared in advance in association with at least two of the three or more feature extraction processes,
The feature extraction unit includes a part selection unit that selects a virtual optical part to be virtually mounted from the plurality of types of virtual optical parts according to a user operation, and the virtual optical part selected by the part selection unit A plurality of types of feature data are extracted from the captured image by feature extraction processing corresponding to
The program according to claim 6 or 7 for causing the computer to function as described above. Causing the computer to function as a combined character storage unit that stores the character of the character image combined with the captured image by the combined image display control unit as an acquired character;
Based on the acquired character stored by the synthesized character storage means, the computer functions as a shooting level variable means for changing the shooting level of the user,
Causing the computer to function as usable parts variable means for changing virtual optical parts that can be virtually mounted according to the current shooting level;
The computer selects the virtual optical part to be virtually mounted out of the virtual optical parts usable by the usable part variable means according to the current photographing level according to a user operation. Make it work,
A program according to claim 3 or 8 for use. Causing the computer to function as a usable part number variable means for varying the number of virtual optical parts that can be virtually mounted according to the current shooting level;
The part selection means selects a virtual optical part to be virtually mounted according to a user operation within the range of the number of virtual optical parts that can be used by the usable part number variable means according to the current shooting level. To make the computer function,
The program according to claim 9. The shooting level varying means causes the computer to function to change the shooting level based on the number of acquired characters stored by the synthesized character storage means;
The program of Claim 9 or 10 for. Whether or not to synthesize the character image selected by the character image selection unit with the captured image, and to cause the computer to function as an appearance determination unit that determines with given accuracy according to the current shooting level;
Causing the computer to function so as to synthesize the character image with a captured image by the imaging unit and control display on the display device when the combined image display control unit determines to combine the appearance determination unit;
The program as described in any one of Claims 9-11 for.   The computer-readable information storage medium which memorize | stored the program as described in any one of Claims 1-12. Imaging means;
A display unit for displaying an image captured by the imaging unit;
Condition group selection means for selecting a composite image condition group from a plurality of preset composite image condition groups based on a user operation;
Synthesis determination means for determining whether or not the captured image matches any composite image condition included in the composite image condition group selected by the condition group selection means;
A character image selection unit that selects a character image to be combined with the captured image from a plurality of preset character images based on the combined image condition determined to be matched by the combination determination unit;
Combined image display control means for combining the character image selected by the character image selection means with the captured image and controlling display on the display device;
An image pick-up display device. Imaging means;
A display unit for displaying an image captured by the imaging unit;
A plurality of types of feature data are extracted from the captured image by at least two feature extraction processes selected based on a user operation from among three or more feature extraction processes having different extraction criteria when extracting feature data of the captured image. Feature extracting means for extracting;
A plurality of character images associated with a plurality of feature data are set in advance, and each of the plurality of character images is extracted by a plurality of feature data associated with the character image and the feature extraction unit. Character image selection means for comparing a plurality of types of feature data and selecting a character image to be combined with the captured image;
Combined image display control means for combining the character image selected by the character image selection means with the captured image and controlling the display on the display device;
An image pick-up display device.

Images