JP2006271663A - Program, information storage medium, and image pickup and display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a new interest in image pickup by utilizing an image recognition technique without especially limiting a recognition object. <P>SOLUTION: When the camera unit 7 of a portable game device 1000 is activated, a finder image is displayed on a display 1. When a bait selecting operation is input in the state of photographing an object OB3, the kind of bait is selected by moving a cursor CS on the displayed list LS of the kinds of the bait and then a bait dispersion executing operation is input, the image of selected bait A is combined with the finder image and displayed (a). Then, when the image of the same object OB3 is picked up (shutter is turned ON) after the lapse of prescribed time, the image of a ghost GS3 corresponding to the dispersed bait A is combined with the picked-up image and displayed. That is, the ghost GS3 appears (b). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention allows a computer to control the display of a finder image captured by an imaging unit on a display device, and to perform display control by combining a captured image captured by a shutter operation and a character image. The present invention relates to a program for performing display control as if a character exists in space.

An image recognition technique for recognizing a captured image and recognizing its contents is used in various fields. For example, as an application example of the image recognition technology, Patent Document 1 discloses a game device that performs a card game and a fortune-telling device that performs tarot fortune-telling. In such an apparatus, various kinds of cards such as playing cards and tarot cards and recognition objects such as dice are imaged using a camera, and the arrangement and the like are recognized by pattern recognition processing for performing image recognition on the captured image.
JP 2002-49909 A

  The technology of Patent Document 1 described above assumes that the shape and content of the recognition object are predetermined, but the recognition object is not particularly limited, and a new interest in imaging is realized by using image recognition technology. Isn't it possible? The present invention has been made in view of the above circumstances.

The first invention for solving the above-described problems is
On the computer,
The display device (for example, the display 1 in FIG. 1 and the image display unit 410 in FIG. 7) controls display of the finder image captured by the imaging means (for example, the camera unit 7 in FIG. 1 and the imaging unit 200 in FIG. 7). A program for performing display control as if a character exists in real space by synthesizing and displaying a character image with a captured image captured by a shutter operation.
A finder image feature analysis unit that captures a finder image when a predetermined condition generation instruction operation is input and analyzes a feature portion of the captured image, and based on the feature portion analyzed by the finder image feature analysis unit Condition generation storage means for generating and storing a composite image condition that is an image condition for determining whether or not to synthesize a character image with a captured image (for example, the firewood execution unit 320 and the storage unit in FIG. 7) 500, steps S3 to S11 in FIG.
A captured image feature analyzing unit that analyzes a feature portion of the captured image captured by the shutter operation when the shutter operation is performed, and the feature portion analyzed by the captured image feature analyzing unit is the condition generation storage unit; Determining means for determining whether or not the composite image condition stored by (for example, the imaging execution unit 330 in FIG. 7, steps S15 to S19 in FIG. 16),
When the determination means determines that the image is satisfied, the display control means (for example, the imaging execution unit 330 in FIG. 7 or step T113 in FIG. 17) displays the character image combined with the captured image captured by the shutter operation. ),
As a program for causing the computer to function (for example, a game program 510 in FIG. 7).

The tenth invention is
Imaging means (for example, the camera unit 7 in FIG. 1 and the imaging unit 200 in FIG. 7) and a display device for displaying the finder image captured by the imaging means (for example, the display 1 in FIG. 1 and the image display in FIG. 7). 410), and image display for performing display control as if the character exists in real space by combining the image of the character with the captured image captured by the shutter operation and performing display control. A device (for example, the portable game device 1000 of FIGS. 1 and 7),
A finder image feature analysis unit that captures a finder image when a predetermined condition generation instruction operation is input and analyzes a feature portion of the captured image, and based on the feature portion analyzed by the finder image feature analysis unit Condition generation storage means for generating and storing a composite image condition that is an image condition for determining whether or not to synthesize a character image with a captured image;
A captured image feature analyzing unit that analyzes a feature portion of the captured image captured by the shutter operation when the shutter operation is performed, and the feature portion analyzed by the captured image feature analyzing unit is the condition generation storage unit; Determining means for determining whether or not the composite image condition stored by
Display control means for combining and displaying a character image on the captured image captured by the shutter operation when it is determined that the determination means is satisfied;
It is an image pick-up display device provided with.

  According to the first or tenth invention, a finder image is captured when a predetermined condition generation instruction operation is input, and a composite image condition is generated and stored based on the analyzed feature portion of the captured image. Is done. Further, when a shutter operation is performed, it is determined whether or not the analyzed characteristic portion of the captured image captured by the shutter operation satisfies the stored composite image condition, and it is determined that the feature is satisfied In addition, a character image is combined with the captured image and displayed.

  That is, if the captured image captured by the shutter operation is substantially the same as the finder image when the condition generation instruction operation is input, it is determined that the analyzed feature portion of the captured image satisfies the stored composite image condition. Is done. For this reason, after inputting a condition generation instruction operation in a state where a certain place or subject is being photographed, when the place or subject is imaged, the character image is synthesized and displayed on the captured image, as if the character exists in real space. It is possible to realize a new interest in imaging as if an image was captured. Also, by inputting a compositing instruction operation in advance, it is possible to display a character image in a composited image when a desired place or subject is imaged.

As a second invention, the program of the first invention is
When the condition generation instruction operation is input, an attraction effect processing means (for example, an attraction effect processing unit that performs an effect process as if attracting a character by combining a given attraction object with the viewfinder image and controlling the display) The firewood execution unit 320 in FIG. 7 and step S13 in FIG. 16 may be a program for causing the computer to function.

  According to the second aspect of the invention, when a condition generation instruction operation is input, an effect process as if attracting a character is performed by combining a given attracting object with a finder image and controlling the display. Is called. Therefore, for example, an object that is preferred by the character as an object, for example, a game-like effect of attracting (attracting) the character by placing it on the place where the image is taken when the condition generation instruction operation is input or the position of the subject. it can.

As a third invention, the program of the first or second invention is
The finder image feature analysis means analyzes finder image shape analysis means (for example, firewood execution unit 320 in FIG. 7 and step S9 in FIG. 16) that analyzes the shape of the object shown in the finder image and extracts it as a feature portion. Have
The condition generation storage unit generates a shape condition based on the shape of the object analyzed by the finder image shape analysis unit as the composite image condition (for example, the firewood execution unit 320 in FIG. 7, Step S11) of FIG.
The captured image feature analysis means has captured image shape analysis means (for example, the imaging execution unit 330 in FIG. 7 and step S17 in FIG. 16) that analyzes the shape of the object shown in the captured image and extracts it as a feature portion. And
The determination unit determines whether or not the characteristic part of the object shape analyzed by the captured image shape analysis unit satisfies the shape condition generated by the shape condition generation unit (for example, FIG. 7). The imaging execution unit 330 has step S19) in FIG.
Thus, a program for causing the computer to function may be used.

  According to the third aspect of the invention, the shape of the object shown in the finder image is analyzed and extracted as a feature portion, and a shape condition based on the analyzed object shape is generated as a composite image condition. Then, the shape of the object shown in the captured image is analyzed and extracted as a feature portion, and it is determined whether or not the feature portion of the analyzed object shape satisfies the generated shape condition. That is, whether or not the character image is combined with the captured image is determined depending on whether or not the captured object shape satisfies the shape condition of the object photographed when the condition generation instruction operation is input. The

As a fourth invention, the program of any one of the first to third inventions is provided.
The condition generation instruction operation includes a character instruction operation for instructing a character to be combined with a captured image,
The condition generation storage means stores the composite image condition generated when the condition generation instruction operation is input in association with the character instructed by the character instruction operation included in the condition generation instruction operation;
The display control unit synthesizes a character image associated with a composite image condition determined to be satisfied by the determination unit with a captured image and performs display control;
Thus, a program for causing the computer to function may be used.

  According to the fourth aspect of the invention, the condition generation instruction operation includes a character instruction operation that specifies a character to be combined with the captured image, and the combined image condition generated when the condition generation instruction operation is input is: It is stored in association with the character instructed by the character instruction operation included in this condition generation instruction operation. Then, the character image associated with the composite image condition determined to satisfy the characteristic part of the captured image is combined with the captured image and displayed. Accordingly, by inputting a character instruction operation for instructing a character together with the condition generation instruction operation, a desired character is added to the captured image when the subject or the place photographed at the time of inputting the condition generation instruction operation is imaged. It can be displayed in combination.

Moreover, as a fifth invention, the program of any one of the first to fourth inventions,
The condition generation storage means causes the computer to function so as to store the generated composite image condition in association with the generation time,
Elapsed time determination for determining whether the elapsed time from the generation time associated with the composite image condition determined to be satisfied by the determination means to the time when the shutter operation is performed satisfies a given time condition Causing the computer to function as means (for example, the ghost appearance determination unit 334 in FIG. 7 and steps T9 to T11 in FIG. 17);
When the display control means is determined to be satisfied by the determination means and is determined to be satisfied by the elapsed time determination means, the computer functions to control display by combining a character image with a captured image. It may be a program for

  According to the fifth aspect of the invention, the generated composite image condition is stored in association with the generation time. Then, it is determined that the feature portion of the captured image satisfies the composite image condition, and the elapsed time from the generation time corresponding to the composite image condition to the time when the shutter operation is performed satisfies the given time condition. In such a case, the character image is combined with the captured image and displayed.

  In other words, even if the place or subject that was shot at the time of inputting the condition generation instruction operation is imaged, the elapsed time from the input of the condition generation instruction operation to the input of the shutter operation does not satisfy the time condition In this case, the character image is not combined with the captured image. Therefore, for example, if a predetermined time elapses from the input of the condition generation instruction operation as a time condition, it is possible to realize an effect as if the character is moving to the place or subject.

As a sixth invention, the program of the fifth invention is
When it is determined by the determination means that the elapsed time is long, but it is determined that the given time condition is not satisfied, the given trace object is combined with the captured image and displayed. As a program for causing the computer to function as trace effect processing means (for example, the ghost appearance determination unit 334 in FIG. 7 and step T15 in FIG. 17) that performs effect processing as if a character existed by controlling. good.

  According to the sixth aspect, when it is determined that the feature portion of the captured image satisfies the composite image condition, but it is determined that the time condition is not satisfied because the elapsed time is long, a given By performing display control by combining the trace object with the captured image, an effect process as if the character existed is performed. That is, an effect as if the character has already left can be realized by the trace object indicating that the character existed.

As a seventh invention, the program of the fifth or sixth invention is
When the condition generation instruction operation is input, an attraction effect processing means (for example, an attraction effect processing means for performing an effect process as if attracting a character by combining a given attraction object with the finder image and controlling the display) Firewood execution unit 320 in FIG. 7, step S13 in FIG.
If it is determined by the determination means that the elapsed time is short but it is determined that the given time condition is not satisfied, the attracting object is combined with the captured image and displayed. Thus, unarrived effect processing means for performing effect processing as if the character has not yet arrived (for example, the imaging execution unit 330 in FIG. 7 and step T15 in FIG. 17),
As a program for causing the computer to function.

  According to the seventh aspect, when a condition generation instruction operation is input, an effect process as if attracting a character is performed by combining and displaying a given attracting object on the finder image. In addition, when it is determined that the feature portion of the captured image satisfies the composite image condition, but it is determined that the time condition is not satisfied because the elapsed time is short, the attracting object is displayed in a composite image on the captured image. As a result, an effect process is performed as if the character has not yet come.

As an eighth invention,
Finder image determination means for analyzing a characteristic part of the finder image and determining whether the analyzed characteristic part satisfies a composite image condition stored by the condition generation storage means;
Notification control means for performing a predetermined notification process for notifying whether or not a character exists based on a determination result by the finder image determination means;
As a program for causing the computer to function.

  According to the eighth aspect of the invention, it is determined whether or not the analyzed feature portion of the finder image satisfies the stored composite image condition, and based on the determination result, whether the character image is combined with the captured image. A predetermined notification process for notifying whether or not a character exists is performed. That is, based on the finder image, whether or not the character image is combined with the captured image is notified as to whether or not the character exists. For this reason, for example, even if the place or subject that was shot when inputting the condition generation instruction operation is remembered, the character image can be reliably combined with the captured image by inputting the shutter operation with reference to the notification content. It can be displayed.

  The ninth invention is a computer-readable information storage medium (for example, the storage unit 500 in FIG. 7) storing the program of any one of the first to eighth inventions.

  Here, the “information storage medium” is a storage medium such as a hard disk, MO, CD-ROM, DVD, memory card, or IC memory that can be read by a computer. Therefore, according to the ninth aspect, by causing the computer to read the information stored in the information storage medium and executing the arithmetic processing, the same effect as any one of the first to eighth aspects can be obtained. Can play.

  According to the present invention, after inputting a condition generation instruction operation while shooting a certain place or subject, when the place or subject is picked up, the character image is synthesized and displayed on the picked-up image, as if in the real space. A new interest in imaging can be realized as if an existing character was imaged. Also, by inputting a compositing instruction operation in advance, it is possible to display a character image in a composited image when a desired place or subject is imaged.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In the following, the case where the present invention is applied to a portable game device will be described, but the application of the present invention is not limited to this.

[appearance]
FIG. 1 is an external view showing an example of a portable game apparatus 1000 in the present embodiment. FIG. 4A shows a front view of the portable game apparatus 1000, and FIG. 4B shows a rear view. As shown in the figure, the portable game apparatus 1000 includes a display 1, a speaker 3, and operation keys 5 on the front surface of a substantially rectangular casing. In addition, the camera unit 7 is provided on the upper side of the housing, and an insertion port for inserting the game cartridge 10 is provided on the lower side.

  The display 1 is a color liquid crystal display with a backlight such as a TFT display, and displays various information, images, and the like. The display 1 functions as an electronic viewfinder when the camera unit 7 operates, and displays a viewfinder image (image captured by the photographing lens 8) by the camera unit 7.

  The operation key 5 is for a player (user) to input a game operation, and includes a shutter key 5a for inputting a shutter operation, a fire key 5b for inputting a food selection operation and a fire feed execution operation, and a cross key. 5c is included.

  The camera unit 7 has a photographic lens 8 formed of glass or the like provided on the back side thereof, and an imaging element such as a CMOS or a CCD, and digitally converts image data imaged by the imaging element through the photographic lens 8. Convert to data and output. In addition, although this camera unit 7 is comprised integrally with the housing | casing, it is good also as being comprised so that attachment or detachment is possible.

  In addition, the portable game apparatus 1000 includes a reading device that reads game information (game program and game data) stored in the game cartridge 10 inserted into the insertion slot, and other external devices such as other portable game apparatuses 1000. It has a communication device for connecting and performing wireless / wired communication, and a control device equipped with a CPU, IC memory, and the like. The CPU mounted on the control device executes various processes based on programs and data read from the IC memory and the game cartridge 10, operation signals of the operation keys 5, image data input from the camera unit 7, and the like. Then, an image signal such as a game screen and a sound signal of game sound are generated. Then, the generated image signal is output to the display 1 to display the game screen, and the sound signal is output to the speaker 3 to output the game sound.

  Information (system program, game program, game data, etc.) necessary for the portable game apparatus 1000 to execute a game is stored in an IC memory or a game cartridge 10 mounted on the control apparatus. More specifically, the system program is stored in the IC memory of the control device, and the game program and game data are stored in the game cartridge 10. Therefore, the player can cause the portable game apparatus 1000 to execute a different game by exchanging the game cartridge 10.

[Overview]
In the game of the present embodiment, a game effect is performed as if a ghost (character) exists in the space around the player, which is a real space.

2-6 is a figure for demonstrating the game outline | summary of this embodiment.
As shown in FIG. 2A, when the camera unit 7 of the portable game apparatus 1000 is activated, an image (finder image) captured by the photographing lens 8 is displayed on the display 1. When the shutter operation is performed in this state (shutter ON), a ghost image is combined with the captured image captured by the shutter operation and displayed on the display 1. That is, a ghost “appears”. The shutter operation can be input by operating the shutter key 5a.

  FIG. 6A shows a case where the shutter is turned on while the photographing lens 8 captures the subject OB1, that is, a case where the subject OB1 is imaged, and a ghost GS1 appears. The ghost can be “captured” by performing a predetermined capture process for the ghost that has appeared. Note that a ghost does not always appear when the shutter is turned on, but may not appear.

  At this time, in the portable game apparatus 1000, when a shutter operation is performed, a predetermined image recognition process for analyzing a characteristic portion of the captured image is performed, and the portable game apparatus 1000 is prepared in advance based on the characteristic data obtained as a result. Any one of a plurality of ghosts is selected, combined with the captured image, and displayed on the display 1.

  Which ghost appears among a plurality of ghosts depends on the subject. That is, as shown in FIG. 4B, when a subject OB2 different from the subject OB1 is imaged, a ghost GS2 different from the ghost GS1 appears. Also, as shown in FIG. 3, when the same subject OB1 is imaged at a location different from that in FIG. 2A, the same ghost GS1 appears.

  Further, in the present embodiment, it is possible to carry out “maki food” as if the “food” that is an attracting object is sprinkled in the real space and the ghost is attracted (attracted) by this food. That is, as shown in FIG. 4A, when the food selection operation is performed while the camera unit 7 is activated, a list LS of types of food that can be rolled is displayed on the display 1. When the cursor CS on the list LS is moved to select the type of food and then the firewood execution operation is performed, an image corresponding to the selected type of food is combined with the finder image and displayed. In other words, food is “sown”.

  FIG. 6A shows a case where food A is sprinkled while the photographing lens 8 is capturing the subject OB3, that is, a state where the subject OB3 is being photographed. The food selection operation can be input by operating the firewood food key 5b, and the movement operation of the cursor CS can be input by operating the cross key 5c. Further, the firewood execution operation can be input by operating the firewood feed key 5b again.

  Then, as shown in FIG. 6B, when a predetermined time has elapsed since the input of the firewood execution operation, when the same subject is imaged, the ghost image is combined with the captured image and displayed on the display 1. The That is, a ghost appears. FIG. 5B shows a case where the subject OB3 is imaged, and a ghost GS3 appears.

  The ghost that appears at this time is determined by the type of food and does not depend on the subject being photographed. That is, as shown in FIG. 5A, as in the case of FIG. 4A, a food selection operation is performed while the subject OB3 is being photographed, and the cursor CS on the displayed food type list LS is displayed. Is moved to select food B and firewood execution operation is performed. Then, the image of the food B different from the food A is combined with the finder image and displayed. That is, food B is covered. Then, as shown in FIG. 5B, when the subject OB3 is imaged after a lapse of a predetermined time, a ghost GS4 different from the ghost GS3 is displayed.

  That is, the ghost that appears when the same subject is imaged is determined depending on the type of food. That is, the type of ghost that appears can be instructed by designating the type of rolling food. For this reason, the player can select a type of food according to the ghost that he / she wants to appear.

  In addition, there is a time condition for the appearance of a ghost due to the execution of firewood feed. That is, the ghost appears only when the elapsed time since the execution of the firewood feed is within a predetermined time range and the same subject as the subject photographed at the time of the input of the firewood feed operation is imaged. In this case, no ghost appears.

  For example, as shown in FIG. 4, when the elapsed time after feeding A (from the execution of the feeding of the feeding A) is within a predetermined time range (for example, after 10 minutes and before 20 minutes) When the same subject OB3 is imaged, a ghost GS1 corresponding to the food A is displayed.

  However, as shown in FIG. 6 (a), when the same subject OB3 is imaged when the elapsed time since the feeding of the food A has not reached the predetermined time range (for example, the elapsed time is 5 minutes). A complete image of the food A immediately after being shown in FIG. 4A is displayed, and no ghost appears. That is, an effect is made as if the ghost has not yet come.

  Further, as shown in FIG. 6 (b), when the same subject OB3 is imaged when the elapsed time since the feeding of the food A exceeds the predetermined time range (for example, the elapsed time is 30 minutes), A ghost does not appear, and an image of a remnant of food A that is a trace object representing a trace in which the ghost was present is displayed. That is, an effect is made as if the ghost that had been drawn to the food A has already left.

[Function configuration]
FIG. 7 is a block diagram illustrating an example of a functional configuration of the portable game apparatus 1000. According to the figure, the portable game apparatus 1000 functionally includes an operation input unit 100, an imaging unit 200, a processing unit 300, an image display unit 410, a sound output unit 420, and a storage unit 500. The communication unit 600 is provided.

  The operation input unit 100 receives an operation instruction from the player, and outputs an operation signal corresponding to the operation to the processing unit 300. In particular, in the present embodiment, an input of a food selection operation, a firewood execution operation, or a shutter operation is detected and output to the processing unit 300. In FIG. 1, the operation key 5 corresponds to this.

  The imaging unit 200 includes an imaging element such as a CMOS or CCD, a photographing lens that forms an image of a light beam of a subject on the imaging element, and an A / D conversion that converts an electrical signal (analog image signal) output from the imaging element into a digital signal. A captured image data of the subject is output to the processing unit 300 including a circuit. In FIG. 1, the camera unit 7 corresponds to this.

  The processing unit 300 performs various arithmetic processes such as overall control of the portable game apparatus 1000, game progress control, and image generation. This function is realized by, for example, an arithmetic device such as a CPU (CISC type, RISC type), ASIC (gate array, etc.) or a control program thereof. In FIG. 1, a CPU or the like mounted on a built-in control device corresponds to this.

  The processing unit 300 includes a game calculation unit 310 that mainly performs calculation processing related to game execution, and an image generation unit 340 that generates a game image based on various types of data obtained by the processing of the game calculation unit 310. , A sound generation unit 350 that generates game sounds such as sound effects and BGM, and a time measurement unit 360 that measures time.

  The game calculation unit 310 performs various game processes based on game information (program and data) read from the storage unit 500, operation signals input from the operation input unit 100, image data input from the imaging unit 200, and the like. Execute. In the present embodiment, the game calculation unit 310 includes a firewood execution unit 320 and an imaging execution unit 330.

  The firewood execution unit 320 executes predetermined firewood processing. Specifically, when a food selection operation is input from the operation input unit 100, the food information 522 is referred to and a list of food types prepared in advance is displayed.

  The food information 522 is information regarding food that can be rolled up. FIG. 8 shows an example of the data configuration of the food information 522. According to the figure, the food information 522 stores names (food names) 522a, ghost names 522b, and appearance periods 522c for a plurality of types of foods in association with each other. The ghost name 522b is a name of a ghost that can appear when the corresponding food is spread. The appearance period 522c is a period in which a ghost can appear when the corresponding food is sprinkled, and is set as a time range based on the time when the food is sprinkled (the execution time of the firewood feed).

  After that, when a firewood execution operation is input from the operation input unit 100, the firewood execution unit 320 takes in a finder image at the time of input of this execution operation, and analyzes predetermined feature of the captured image Processing is performed to extract feature data.

  Although there are various image recognition methods performed here, in this embodiment, feature data is extracted for each image recognition method using any one or a plurality of methods among shape recognition, color recognition, and pattern recognition. Specifically, in shape recognition, a Hough transform is performed on target image data to detect a straight line component and its strength, a shape of the subject is recognized by a combination of the detected straight lines, and a feature based on the recognized shape Extract the part. In color recognition, the color of the entire image or the feature portion recognized by shape recognition is recognized. In pattern recognition, for example, a Fourier transform is performed on target image data to extract a frequency component, and a pattern of a feature portion recognized by the entire image or shape recognition is recognized.

  The image recognition method performed by the firewood execution unit 320 is specified by the image recognition method information 526. FIG. 9 shows an example of the data configuration of the image recognition method information 526. According to the figure, the image recognition method information 526 stores an image recognition method 526a and a weight 526b in association with each other. The weight 526b is a value indicating the importance of the corresponding image recognition method, and based on this value, as will be described later, the feature data of the captured image, the feature data of the finder image captured at the time of firewood feeding, The total value of the similarity with the feature data of each ghost being calculated is calculated.

  When the feature data of the imaging data is extracted, the firewood execution unit 320 uses the extracted feature data as the input time of the firewood execution operation and the type of the live food (selected at the time of input of the firewood execution operation). It is added to the firewood execution information 532 in association with the type of food.

  The maki food execution information 532 is information related to the maki food execution contents. FIG. 10 shows an example of the data configuration of firewood execution information 532. According to the figure, the firewood execution information 532 includes different execution numbers. For each 532a, an execution time 532b, a food name 532c, and feature data 532d are stored in association with each other. Data corresponding to 532a is data related to the execution of one firewood feed. The execution time 532b is the time at which the firewood execution operation is input. The food name 532c is the type of food that has been sowed. The feature data 532d is feature data extracted from the viewfinder image when the firewood feeding operation is input.

  In addition, when a firewood execution operation is input, the firewood execution unit 320 synthesizes and displays a food image corresponding to the selected food type on the finder image for a predetermined time. As a result, an effect is realized as if food is being applied to the place where the image is being taken (real space). These food images are prepared for each type of food and stored in the food image information 523.

  The imaging execution unit 330 includes a similarity calculation unit 332 and a ghost appearance determination unit 334, and executes predetermined imaging processing. Specifically, when a shutter operation is input from the operation input unit 100, a predetermined image recognition process for analyzing a feature portion of a captured image by the shutter operation is performed, and feature data is extracted. Here, the image recognition method performed by the imaging execution unit 330 is specified by the image recognition method information 526 shown in FIG.

  The feature data extracted by the imaging execution unit 330 is stored in the captured image recognition result information 534. FIG. 11 shows an example of the data configuration of the captured image recognition result information 534. According to the figure, the captured image recognition result information 534 stores an image recognition method 534a and feature data 534b calculated by the image recognition method in association with each other. The image recognition method 534a is a method specified by the image recognition method information 526. For example, in the figure, extracted feature data for “shape recognition” and “color recognition” specified by the image recognition method information 526 shown in FIG. 9 is stored.

  The similarity calculation unit 332 calculates the similarity between the extracted feature data of the captured image and the feature data of the finder image captured at the time of executing the firewood feeding or the feature data of each ghost prepared in advance.

  Specifically, referring to the firewood execution information 532, each execution No. The similarity between the feature data and the extracted feature data of the captured image is calculated. That is, each execution No. For each image recognition method, the similarity between the corresponding feature data and the extracted feature data is calculated. Then, referring to the image recognition method information 526, the calculated similarity is multiplied by a weight corresponding to the image recognition method and added to calculate a total value of similarity.

  The similarity calculated here is stored in the calculated similarity information for firewood feed 536. FIG. 12 shows an example of the data structure of the calculated similarity information for firewood feed 536. According to the figure, the calculation similarity information 536 for firewood feed is stored in the execution number stored in the firewood execution information 532. For each 536a, the calculated similarity 536b is stored in association with each other. The similarity 536b includes a similarity for each image recognition method specified by the image recognition method information 526 and a total value of these similarities. For example, in the figure, the similarity for “shape recognition” and “color recognition” specified by the image recognition method information 526 shown in FIG. 9 and the total value of the similarity are stored.

  Also, the similarity calculation unit 332 refers to the ghost information 524 and calculates the similarity between the feature data of each ghost and the extracted captured image feature data.

  The ghost information 524 is information relating to a ghost prepared in advance. FIG. 13 shows an example of the data structure of the ghost information 524. According to the figure, the ghost information 524 stores names (ghost names) 524a and feature data 524b in association with each other for a plurality of ghosts. The feature data 524b stores a value corresponding to each image recognition method specified by the image recognition method information 526. For example, in the same figure, values of “shape” and “color” are set corresponding to “shape recognition” and “color recognition” specified by the image recognition method information 526 shown in FIG.

  The similarity calculation unit 332 calculates the similarity between the corresponding feature data and the extracted feature data for each image recognition method for each ghost stored in the ghost information 524. Then, referring to the image recognition method information 526, the calculated similarity is multiplied by a weight corresponding to the image recognition method and added to calculate a total value of similarity.

  The similarity calculated here is stored in the normal calculation similarity information 537. FIG. 14 shows an example of the data structure of the normal calculation similarity information 537. According to the figure, the calculated similarity information for normal use 537 stores the calculated similarity 537 b in association with each ghost 537 a specified by the ghost information 524. Similar to the calculated similarity information for firewood feed 536, the similarity 537b includes the similarity for each image recognition method specified by the image recognition method information 526 and the total value of these similarities. For example, in the figure, the similarity for “shape recognition” and “color recognition” specified by the image recognition method information 526 shown in FIG. 9 and the total value of the similarity are stored.

  The similarity calculated by the similarity calculation unit 332 is represented by a decimal value in the range of “0.0” to “1.0”, and the minimum value “0.0” represents a complete mismatch, and the maximum The value “1.0” represents a complete match. The similarity calculation method is a known method using pattern matching or the like, for example, and detailed description thereof is omitted.

  The ghost appearance determination unit 334 determines the appearance of a ghost based on the similarity calculated by the similarity calculation unit 332. Specifically, first, the appearance of a ghost for the firewood that has been executed so far is determined. That is, referring to the calculated similarity information 536 for the firewood feed, the execution number with the maximum total value of the similarity is shown. Select. And the selected execution No. It is determined whether or not the total value of the similarity is equal to or more than a predetermined firewood appearance threshold.

  The appearance threshold for firewood feed is a threshold value that is a criterion for determining whether or not to make a ghost appear in the execution of firewood feed, and is set to a value close to “1.0” indicating complete match. In other words, if the appearance data is equal to or greater than the appearance threshold, the feature data of the captured image substantially matches the feature data of the viewfinder image when the firewood food was executed in the past, that is, the place where the current image was taken has executed firewood food in the past It corresponds to the case where it can be regarded as a place. Therefore, in this case, it is determined that a ghost appears.

  The value of the appearance threshold for firewood feed is stored in the appearance threshold information 528. FIG. 15 shows an example of the data configuration of the appearance threshold information 528. According to the figure, the appearance threshold information 528 stores the appearance threshold 528a for firewood and the appearance threshold 528b for normal use. The normal appearance threshold value 528b is a threshold value that serves as a criterion for determining whether or not a ghost prepared in advance (stored in the ghost information 524) appears, as will be described later. Further, the normal appearance threshold 528b is set lower than the firewood appearance threshold 528a.

  The ghost appearance determination unit 334 then selects the selected execution number. When it is determined that the total value of the similarity is equal to or greater than the appearance threshold for firewood feeding, the selected execution No. The elapsed time from the firewood feed execution time to the shutter operation input time is calculated. Next, referring to the food information 522, the selected execution No. The appearance period corresponding to the type of food is determined, and it is determined whether or not the calculated elapsed time is within the determined appearance period.

  If it is within the appearance period, the selected execution number is referred to the food information 522. It is determined that a ghost corresponding to the type of food appears, and the image of the ghost is combined with the captured image and displayed on the image display unit 410. If the elapsed time is not within the determined appearance period, images corresponding to the elapsed time before and after the appearance period are combined with the captured image and displayed on the image display unit 410. That is, if the elapsed time has not reached the appearance period, the selected execution No. A complete image of the food is combined with the captured image and displayed. On the other hand, if the elapsed time exceeds the appearance period, the executed execution No. The image of the wreckage of the food is combined with the captured image and displayed. The ghost image is stored in the ghost image information 525, and the complete image of the food and the image of the debris are stored in the food image information 523.

  In addition, the ghost appearance determination unit 334 selects the execution number selected from the calculated similarity information for firewood feed 536. If the total value of the similarities is not equal to or greater than the appearance threshold for firewood feed, the process proceeds to a process for determining the appearance of a ghost prepared in advance, assuming that the place imaged this time is not the place where firewood feed has been executed in the past.

  That is, with reference to the normal calculation similarity information 537, a ghost having the maximum similarity is selected. Then, it is determined whether or not the total value of the similarity of the selected ghost is equal to or greater than a predetermined normal appearance threshold, and if it is equal to or greater than the normal appearance threshold, it is determined that the selected ghost appears. The ghost image is combined with the captured image and displayed on the image display unit 410. If it is not equal to or greater than the normal appearance threshold, it is determined that no ghost appears. Here, the normal appearance threshold is stored in the appearance threshold information 528. A ghost image is stored in the ghost image information 525.

  The image display unit 410 displays a game image based on the image signal from the image generation unit 340. In particular, in the present embodiment, the finder image from the imaging unit 200 is displayed on the monitor in real time, and the image of the food sprinkled by the input of the firewood feeding operation is displayed on the finder image, and is determined to appear. The image of the ghost thus displayed is superimposed on the captured image. This function is realized by hardware such as CRT, LCD, ELD, for example. In FIG. 1, the display 1 corresponds to this.

The sound generation unit 350 generates game sounds such as sound effects and BGM used during the game, and outputs a sound signal of the generated game sounds to the sound output unit 420.
The sound output unit 420 outputs game sounds such as BGM and sound effects based on the sound signal from the sound generation unit 350. This function is realized by, for example, a speaker. In FIG. 1, the speaker 3 corresponds to this.

  The storage unit 500 stores a system program for realizing various functions for causing the processing unit 300 to control the portable game apparatus 1000 in an integrated manner, a program and data necessary for executing the game, and the like. Used as a work area of the processing unit 300, temporarily stores calculation results executed by the processing unit 300 according to various programs, input data input from the operation input unit 100, and the like. This function is realized by, for example, various IC memories, hard disks, CD-ROMs, DVDs, MOs, RAMs, VRAMs, and the like. In FIG. 1, ROM, RAM, and the like mounted on the control device correspond to this.

  Further, the storage unit 500 stores a game program 510 and game data for causing the processing unit 300 to function as the game calculation unit 310. The game data includes food information 522, food image information 523, ghost information 524, ghost image information 525, image recognition method information 526, appearance threshold information 528, firewood food execution information 532, and captured image recognition. The result information 534, the firewood calculation similarity information 536, and the normal calculation similarity information 537 are included.

  The communication unit 600 connects to a predetermined communication line and performs data communication with an external device such as another portable game device 1000. This function is realized by a wireless communication module such as Bluetooth (registered trademark) or IrDA, a modem, TA, a jack of a wired communication cable, a control circuit, and the like. In FIG. 1, the built-in communication device corresponds to this.

[Process flow]
FIG. 16 is a flowchart for explaining the flow of the game processing in the present embodiment. This process is realized by the game calculation unit 310 executing a process according to the game program 510.

  According to the figure, first, the game calculation unit 310 causes the image display unit 410 to display a finder image based on the image data input from the imaging unit 200 (step S1).

  Next, the firewood food execution unit 320 determines whether an food selection operation has been input from the operation input unit 100, and if it has not been input (step S3: NO), the process proceeds to step S15. If the food selection operation is input (step S3: YES), the food information prepared in reference to the food information 522 is displayed in a list on the finder image. And according to the operation input from the operation input part 100, the kind of food is selected (step S5).

  Next, the firewood execution unit 320 determines whether or not a firewood execution operation has been input from the operation input unit 100, and if it has not been input (step S7: NO), the process proceeds to step S15. If a firewood execution operation is input (step S7: YES), a finder image at the time of input of the firewood execution operation is captured, and an image recognition method specified by the image recognition method information 526 is captured for this captured image. Then, image recognition processing is performed, and feature data is extracted for each image recognition method (step S9). Then, the extracted feature data is associated with the input time (execution time) of the firewood execution operation and the type of food selected at the input time of the execution operation, and is added to the firewood execution information 532 ( Step S11).

  Thereafter, the firewood execution unit 320 performs firewood production processing for the finder image. That is, a complete image of the food corresponding to the type of the selected food is synthesized and displayed on the finder image for a certain period of time, and an effect is given as if the food was scattered at the shooting location (step) S13).

  Subsequently, the imaging execution unit 330 determines whether or not a shutter operation has been input from the operation input unit 100. If it has not been input (step S15: NO), the process proceeds to step S25. If the shutter operation is input (step S15: YES), the finder image at the time of the shutter operation input is taken as a captured image, and the image recognition method specified by the image recognition method information 526 for this captured image. Then, image recognition processing is performed to extract feature data for each image recognition method (step S17). Next, a ghost appearance determination process is executed (step S19).

FIG. 17 is a flowchart for explaining the flow of the ghost appearance determination process.
According to the figure, in the ghost appearance determination process, first, each execution number stored in the firewood feed execution information 532 is displayed. The process of loop A is executed for the items in order. That is, in the loop A, the similarity calculation unit 332 performs the target execution No. for each image recognition method. The similarity between the feature data and the extracted feature data of the captured image is calculated (step T1). Next, the calculated similarity is multiplied by a weight corresponding to the image recognition method specified by the image recognition method information 526 and added to calculate a total value of similarity (step T3).

  All execution Nos. When the processing of the loop A targeting is completed, the ghost appearance determination unit 334 determines the ghost to appear. That is, each execution No. Among these, the execution No. with the maximum total value of the calculated similarity is shown. (Step T5), and the selected execution number is selected. It is determined whether or not the total value of the similarity is equal to or greater than the appearance threshold for firewood.

  If it is equal to or greater than the firewood appearance threshold (step T7: YES), the ghost appearance determination unit 334 determines the selected execution number. The elapsed time from the execution of this to the input time of the shutter operation is calculated (step T9). Next, in the food information 522, the selected execution No. The appearance period associated with the type of food is determined, and it is determined whether or not the calculated elapsed time is within the appearance period.

  If the elapsed time is within the appearance period (step T <b> 11: YES), the ghost appearance determination unit 334 selects the execution No. selected in the food information 522. It is determined that a ghost associated with the type of food appears, and the ghost image is combined with the captured image and displayed on the image display unit 410 (step T13).

  On the other hand, if the elapsed time is not within the appearance period (step T11: NO), it is determined that the ghost does not appear, and an image of the food according to the context between the elapsed time and the appearance period is combined with the captured image. Are displayed on the image display unit 410. That is, if the elapsed time has not reached the appearance period, the selected execution No. A complete image of the food of the feed is combined with the captured image and displayed. If the appearance period is exceeded, the selected execution No. is selected. The image of the food remains is combined with the captured image and displayed (step T15).

  In step T7, the selected execution No. If the total value of the similarities is not equal to or greater than the appearance threshold for firewood feeding (step T7: NO), normal appearance determination processing is executed (step T17).

FIG. 18 is a flowchart for explaining the flow of the normal appearance determination process.
According to the figure, in the normal appearance determination process, the process of loop B is executed for all the ghosts specified by the ghost information 524 in order, that is, in the loop B, the similarity calculation unit 332 performs the image recognition method. Every time, the similarity between the feature data of the target ghost and the feature data of the extracted captured image is calculated (step P1). Then, the calculated similarity is multiplied by a weight corresponding to the image recognition method specified by the image recognition method information 526 and added to calculate a total value of similarity (step P3).

  When the processing of loop B for all ghosts is completed, the ghost appearance determination unit 334 selects a ghost having the highest calculated similarity value from all ghosts (step P5). It is determined whether or not the total value of the ghost similarity is greater than or equal to the normal appearance threshold.

If it is equal to or greater than the normal appearance threshold (step P7: YES), the ghost appearance determination unit 334 determines that the selected ghost appears, and synthesizes the ghost image with the captured image and displays it on the image display unit 410. (Step P9). On the other hand, if it is not equal to or greater than the normal appearance threshold (step P7: NO), it is determined that no ghost appears (step P11).
If the above process is performed, this normal appearance determination process will be complete | finished.

  When the above processing is performed, the ghost appearance determination process is terminated, and subsequently, the game calculation unit 310 determines whether or not the ghost has appeared, and if it has appeared (step S21: YES), the operation input unit. A predetermined ghost capturing process is executed based on the operation signal from 100 (step S23). Thereafter, it is determined whether or not to end the game. If the game is not ended (step S25: NO), the process returns to step S1, and if it is ended (step S25: YES), the game process is ended.

[Action / Effect]
As described above, according to the present embodiment, when the camera unit 7 of the portable game apparatus 1000 is activated, the food selection operation is input, the food is selected, and the firewood execution operation is input. The image of the selected type of food is combined and displayed on the viewfinder image. That is, food is fed. Then, after the predetermined time has elapsed, when the subject photographed at the time of input of the firewood feeding operation is imaged, a ghost image corresponding to the live food is combined with the captured image and displayed. That is, a ghost appears.

  At this time, in the portable game device 1000, when a firewood execution operation is input, the feature data of the captured finder image is extracted, the extracted feature data, the input time of the firewood execution operation, and the selected food Are associated with each other and added to the firewood feed execution information 532. When a shutter operation is input, each execution number of the feature data of the captured image and the firewood feed execution information 532 is displayed. Similarity with the feature data is calculated, and a ghost that appears is determined based on the calculated similarity. That is, the execution No. with the largest total value of the calculated similarity is shown. And select the selected execution number. The total value of the similarities is equal to or more than a predetermined firewood appearance threshold, and the execution No. In the food information 522, when the elapsed time from the execution time of the firewood food is within the food appearance period, A ghost image associated with the type of food is combined with the captured image and displayed.

  As a result, it is possible to realize a new interest in imaging as if an image of a character existing in real space was captured. Further, when the player inputs a firewood execution operation, a ghost can appear when a desired place or subject is imaged. In addition, the ghost that appears at the time of imaging is determined by the type of food selected at the time of input of the firewood execution operation, that is, the type of food that has been scattered, so the desired ghost appears by appropriately selecting the type of food. It becomes possible to make it.

  In addition, by setting an appearance period in which a ghost can appear for each type of food, it is possible to realize an effect as if the ghost is coming to the real space. Further, in this case, when the elapsed time from the execution of the firewood feed (input of the firewood feed execution operation) has not reached the appearance period, the complete image of the food is displayed in the captured image and exceeds the appearance period. In this case, by synthesizing and displaying the image of the remnant of the food on the captured image, it is possible to achieve an effect as if the food had been eaten and left after the ghost came to the food.

[Modification]
The application of the present invention is not limited to the above-described embodiments, and can be appropriately changed without departing from the spirit of the present invention. For example, you may deform | transform as follows.

(A) Ghost Appearing from Fired Food In the above-described embodiment, the ghost that appears depends on the type of food that has been used. However, the type of food to be fed may not be selected. In this case, the ghost that appears by firewood is determined, for example, as follows.

(A-1) Randomly determined Specifically, when a firewood execution operation is input, the feature data of the captured finder image is stored in the firewood execution information. When a shutter operation is input, the similarity between the feature data of the captured image and the feature data stored in the firewood execution information is calculated, and the total value of the calculated similarities appears for a predetermined firewood feed. If it is equal to or greater than the threshold value, it is determined that a ghost appears, and for example, a plurality of firewood ghosts prepared in advance, or a ghost image randomly selected from ghosts stored in ghost information 524 Is combined with the captured image and displayed (appears).

(A-2) A ghost according to a place where food is used Specifically, when a firewood execution operation is input, the feature data of the captured viewfinder image and each ghost information 524 stored The total value of the similarity with the ghost feature data is calculated, and the ghost having the highest (highest) calculated total value of the similarity is associated with the captured image feature data and stored in the firewood execution information. Then, when a shutter operation is input, the similarity between the feature data of the captured image and the feature data stored in the firewood execution information is calculated, and the total value of the calculated similarity is a predetermined firepower. If it is equal to or greater than the use appearance threshold value, it is determined that a ghost appears, and the ghost image associated with the feature data in the firewood feed execution information is combined with the captured image and displayed.

(B) Number of Corresponding Ghosts In the above-described embodiment, in the food information 522 (see FIG. 8), the type of food and the ghost are associated on a one-to-one basis. Also good. Specifically, a plurality of ghosts are associated with each type of food in the food information. When a shutter operation is input, a ghost image selected at random, for example, a ghost image selected at random is combined with a captured image and displayed.

  In addition, as shown in FIG. 19, a plurality of ghosts having different appearance periods may be associated with each type of food in the food information. In this case, when a shutter operation is input, a ghost image of an appearance period in which the elapsed time is satisfied among the ghosts corresponding to the live food is synthesized and displayed on the captured image. By doing in this way, even if it is a case where the same place where firewood feeding was performed in the past is imaged, it becomes possible to make a different ghost appear depending on when it images.

(C) Elapsed Time Displayed by Timer In addition, the elapsed time from the execution time of firewood feed (input time of firewood feed execution operation) may be displayed as a timer. When the firewood is executed a plurality of times, the elapsed time from each execution time may be displayed in parallel. In this way, the player can pick up an image at an appropriate timing and cause a ghost to appear without forgetting that the firewood food has been executed.

(D) Ghost sensor Furthermore, it is good also as performing as if the ghost sensor which detects presence of the ghost in the surrounding space of the portable game device 1000 is provided. This ghost sensor reports whether or not a ghost image is to be combined with a captured image as the presence of a ghost in the surrounding space of the apparatus when a shutter operation is input.

  Specifically, a finder image is captured every predetermined time, and image recognition processing is performed on the captured image to extract feature data. Then, the extracted feature data and each execution number stored in the firewood food execution information 532 are displayed. The similarity with the feature data is calculated, and based on the calculated similarity, it is displayed as a detection result (ghost reaction) for the presence of a ghost. For example, as in the case of the input of the shutter operation, the calculated execution No. Whether or not to make a ghost appear is determined based on the similarity, and the determination result is notified by, for example, display / non-display of a predetermined display body indicating whether or not the ghost appears. Alternatively, each execution No. calculated Among the total values of the similarities, the largest value is displayed as a ghost reaction intensity as a meter. Thereby, even if the place where the food is sprinkled is remembered, the ghost can be surely caused to appear by referring to the displayed ghost reaction.

An example of the appearance of a portable game device according to the present embodiment. The schematic diagram of this embodiment. The schematic diagram of this embodiment. The schematic diagram of this embodiment. The schematic diagram of this embodiment. The schematic diagram of this embodiment. 2 is a functional configuration example of a portable game device. Data configuration example of food information. The data structural example of image recognition method information. The data structural example of maki feed execution information. The data structural example of captured image recognition result information. The data structural example of the calculation similarity information for firewood feed. The data structural example of ghost information. The data structural example of the calculation similarity information for normal use. The data structural example of appearance threshold value information. The flowchart of the game processing of this embodiment. The flowchart of the ghost appearance determination process performed during a game process. The flowchart of the normal appearance determination process performed during a ghost appearance determination process. The modification of the data structure of food information.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1000 Portable game device 100 Operation input part 200 Imaging part 300 Processing part 310 Game operation part 320 Firewood execution part 330 Imaging execution part 332 Similarity calculation part 334 Ghost appearance determination part 340 Image generation part 350 Sound generation part 360 Time counting part 410 Image display unit 420 Sound output unit 500 Storage unit 510 Game program 522 Food information 523 Food image information 524 Ghost information 525 Ghost image information 526 Image recognition method information 528 Appearance threshold information 532 Fired food execution information 534 Captured image recognition result information 536 Fired food Calculated similarity information 537 Normal calculated similarity information 600 Communication unit

Claims (10)

On the computer,
Whether the character exists in the real space by controlling the display of the finder image captured by the imaging means on the display device and combining the captured image captured by the shutter operation and controlling the display. A program for performing display control such as
A finder image feature analysis unit that captures a finder image when a predetermined condition generation instruction operation is input and analyzes a feature portion of the captured image, and based on the feature portion analyzed by the finder image feature analysis unit , Condition generation storage means for generating and storing a composite image condition, which is an image condition for determining whether or not to synthesize a character image with a captured image;
A captured image feature analyzing unit that analyzes a feature portion of the captured image captured by the shutter operation when the shutter operation is performed, and the feature portion analyzed by the captured image feature analyzing unit is the condition generation storage unit; Determining means for determining whether or not the composite image condition stored by
Display control means for synthesizing and displaying a character image on the captured image captured by the shutter operation when it is determined that the determination means is satisfied;
A program for causing the computer to function as   When the condition generation instruction operation is input, the computer is used as an attraction effect processing means for performing an effect process as if attracting a character by combining a given attracting object with the viewfinder image and controlling the display. The program of Claim 1 for functioning. The finder image feature analysis means has a finder image shape analysis means for analyzing the shape of an object shown in the finder image and extracting it as a feature portion,
The condition generation storage means has shape condition generation means for generating a shape condition based on the shape of the object analyzed by the finder image shape analysis means as the composite image condition,
The captured image feature analysis means has captured image shape analysis means for analyzing the shape of an object shown in the captured image and extracting it as a feature portion,
The determination unit includes a shape determination unit that determines whether or not the feature portion of the object shape analyzed by the captured image shape analysis unit satisfies the shape condition generated by the shape condition generation unit.
The program according to claim 1 or 2 for causing the computer to function as described above. The condition generation instruction operation includes a character instruction operation for instructing a character to be combined with a captured image,
The condition generation storage means stores the composite image condition generated when the condition generation instruction operation is input in association with the character instructed by the character instruction operation included in the condition generation instruction operation;
The display control unit synthesizes a character image associated with a composite image condition determined to be satisfied by the determination unit with a captured image and performs display control;
The program according to any one of claims 1 to 3, for causing the computer to function as described above. The condition generation storage means causes the computer to function so as to store the generated composite image condition in association with the generation time,
Elapsed time determination for determining whether the elapsed time from the generation time associated with the composite image condition determined to be satisfied by the determination means to the time when the shutter operation is performed satisfies a given time condition Causing the computer to function as a means;
When the display control means is determined to be satisfied by the determination means and is determined to be satisfied by the elapsed time determination means, the computer functions to control display by combining a character image with a captured image. The program as described in any one of Claims 1-4 for making it do.   When it is determined by the determination means that the elapsed time is long, but it is determined that the given time condition is not satisfied, the given trace object is combined with the captured image and displayed. The program according to claim 5 for causing the computer to function as trace effect processing means for performing effect processing as if a character existed by controlling. Attraction effect processing means for performing an effect process as if attracting a character by combining a given attracting object with the viewfinder image and controlling the display when the condition generation instruction operation is input,
If it is determined by the determination means that the elapsed time is short but it is determined that the given time condition is not satisfied, the attracting object is combined with the captured image and displayed. By means of this, a non-arrival effect processing means for performing an effect process as if the character has not yet come,
The program according to claim 5 or 6 for causing the computer to function. Finder image determination means for analyzing a characteristic part of the finder image and determining whether the analyzed characteristic part satisfies a composite image condition stored by the condition generation storage means;
Notification control means for performing a predetermined notification process for notifying whether or not a character exists based on a determination result by the finder image determination means;
The program as described in any one of Claims 1-7 for functioning the said computer as.   The computer-readable information storage medium which memorize | stored the program as described in any one of Claims 1-8. An imaging unit, and a display device that displays a finder image captured by the imaging unit, and by combining the captured image captured by the shutter operation and controlling the display of the character, An image pickup display device that performs display control as if a character exists in
A finder image feature analysis unit that captures a finder image when a predetermined condition generation instruction operation is input and analyzes a feature portion of the captured image, and based on the feature portion analyzed by the finder image feature analysis unit Condition generation storage means for generating and storing a composite image condition that is an image condition for determining whether or not to synthesize a character image with a captured image;
A captured image feature analyzing unit that analyzes a feature portion of the captured image captured by the shutter operation when the shutter operation is performed, and the feature portion analyzed by the captured image feature analyzing unit is the condition generation storage unit; Determining means for determining whether or not the composite image condition stored by
Display control means for combining and displaying a character image on the captured image captured by the shutter operation when it is determined that the determination means is satisfied;
An image pickup display device comprising:

Images