JP5013549B2 - Program, information storage medium, photo printing apparatus and photo printing method - Google Patents

Description

  The present invention relates to a program, an information storage medium, a photo printing apparatus, and a photo printing method.

  2. Description of the Related Art Conventionally, a photo sticker manufacturing machine (an example of a photo printing apparatus) that edits and prints an image of a user subject photographed by a photographing unit such as a CCD camera is known.

  In the photo sticker manufacturing machine, it is possible to edit a subject image and generate and enjoy a photo sticker having a high degree of freedom different from that of a normal photo.

JP 10-308911 A

  In the above document, an editing process is disclosed in which only a person is cut out from the first photographed image, reduced, placed at an appropriate position, and then combined with the next photographed image.

  However, it is preferable to be able to provide more interesting composite photographs by enabling various kinds of over-shooting according to the user's preference because the user can be amazed by simply combining a plurality of captured images.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a program, an information storage medium, an image generation apparatus, a photographic printing apparatus, and an information storage medium having a highly flexible overlapping function. It is to provide a photo printing method.

(1) The present invention
A photo printing apparatus that includes an imaging unit and a display unit, captures an image of a subject captured by the imaging unit, edits and prints the image,
An overshoot processing means for performing an overshoot process for generating an overshoot image of the subject;
Means for generating a print image based on the superimposed image,
Overshoot processing means
Means for capturing in real time a current sampled image in which a background image is extracted from a current image by capturing an image of a subject being photographed by an imaging unit with a sampled color as a background;
Means for storing a current sampled image at a given timing in a storage unit as a previously captured image;
Means for accepting a context instruction input for instructing a context of a current extracted image and a previously captured image when generating a superimposed image;
A live view image that determines the front-rear relationship between the current sampled image and the previous captured image based on the context instruction input and generates a live view image that is synthesized in real time and output to the display unit. Generating means;
Based on the front-rear direction instruction input, the front-rear relationship between the current sampled image and the previous captured image is determined, and an overlapping image that generates a superimposed image of the current orientation image and the previous captured image corresponding to the live view image at a given timing Photographing image generation means;
Related to a photographic printing apparatus.

  The present invention also relates to a program that causes a computer to function as each of the above means. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each of the above-described means. The present invention also relates to a photo printing method including a step of executing each of the above means.

  Overshooting is a composite photo in which the current subject image is aligned with the previous subject image superimposed on the front or back of the previous subject image while viewing the previous subject image at the stage of shooting. Means shooting.

  A superimposed image is an image obtained by combining a plurality of subject images (for example, a current subject image and a previous subject image) by overshooting.

  The extraction process of the extraction color may be realized by, for example, chroma key processing or may be realized by mask processing. The chroma key is a technique for extracting an area having a specific color (extracted color) from an image and embedding another image therein.

  The method of embedding another image is realized by setting the α value (a value indicating transparency) of an area having a specific color to 1, and performing translucent synthesis (for example, α blending processing) with another image. I can do it.

  Mask processing is a process of creating a mask image in which all pixel values of a specific area of an image (extracted color area in the present invention) are set to 1, and all other parts are set to 0. Is a method of synthesizing both images by embedding the image A and embedding the image B in one portion of the mask image.

  A live view image is an image obtained by combining the previous captured image (image of the subject only) extracted from the previous subject image and the current sampled image extracted from the currently captured subject image in real time. is there.

  More specifically, the previously captured image means still image data, and is an image corresponding to the time when the shutter (shooting button) is pressed. On the other hand, the currently extracted image means image data such as a so-called moving image in which a subject or the like facing the camera in real time is taken as a sequential image and repeatedly displayed on the display unit. Note that the current image to be displayed may be an image including a background portion.

  By pressing the shutter while viewing the current sampling image that is moving during shooting, it is possible to acquire still image data corresponding to that point. This is stored in the storage unit as the previous captured image. As a result, the previously captured image does not exist when the first image is taken.

  The previous captured image is an image obtained by extracting the background portion. This is because the previous captured image is displayed on the display unit, the current image is newly displayed in the extracted background area, and the next captured image and the current image are viewed on the display unit while the next image is displayed. This is so that the shutter can be pressed. Detailed overlay processing will be described later.

  The context instruction input may be realized, for example, by touching an instruction button displayed on a touch panel display.

  It is possible to instruct the context of the current extracted image and the previous captured image by inputting the context instruction. For example, when “currently extracted image is before previous captured image” is instructed, the live view image is generated assuming that the current extracted image is positioned before the previous captured image in the depth direction. Therefore, an image in which the currently extracted image is superimposed on the previously captured image is generated. For example, when “currently extracted image is behind previous captured image” is instructed, the live view image is generated assuming that the current extracted image is positioned behind the previous captured image in the depth direction. Therefore, an image in which the previously captured image is superimposed on the currently extracted image is generated.

  In the present invention, when the player performs positioning for overshooting while viewing the live view image, a context instruction is input, and each time an image in which the context of the current extracted image and the previous captured image is switched is replaced. It is displayed on the live view image in real time. Accordingly, it is possible to perform overlay shooting with a high degree of freedom in response to changes reflecting the player's intention, and the player can generate a desired overlay image while checking the synthesis result in real time with the live view image. it can.

  Each means constituting the overlap processing means may be realized by software, may be realized by hardware, or may be realized by cooperation of software and hardware.

  The photographic printing apparatus of the present invention also includes a photographic printing apparatus that prints a seal so that the captured and edited image can be used as a photographic sticker.

(2) The photo printing apparatus, the program, the information storage medium, and the photo printing method of the present invention are:
The overshoot processing means includes:
The present invention is characterized in that the currently picked-up image at the previous shooting timing is subjected to the overlap shooting process as the previous captured image.

  In this way, it is possible to overlap images to be taken in time series.

(3) The photo printing apparatus, program, information storage medium, and photo printing method of the present invention are:
The overshoot processing means includes:
An image obtained by extracting a background portion from the superimposed image is subjected to an overlapping image process as a previously captured image.

  In this way, it is possible to perform further overlapping (overlapping of a plurality of images) on the previously generated overlapping image. Images over time can be overlaid.

(4) The photo printing apparatus, the program, the information storage medium, and the photo printing method of the present invention are:
The live view image generation means includes
The first buffer for storing the previously captured image, the second buffer for storing the currently extracted image generated in real time, the image of the first buffer, and the image of the second buffer are combined. Including a third buffer for writing live view images,
Based on the context instruction input, the writing order of the previously captured image and the current extracted image to the third buffer is determined, and the live view image is generated by sequentially overwriting the third buffer according to the determined writing order. It is characterized by that.

(5) The photo printing apparatus, program, information storage medium, and photo printing method of the present invention are:
One feature of the present invention is to replace one of the buffers with an image obtained by extracting a background portion from the superimposed image after the timing of overlapping the current image and the previous captured image is determined.

  In this way, the number of buffers used can be reduced as compared to a case where a buffer is newly prepared for an image obtained by extracting a background portion from a superimposed image.

(6) The photo printing apparatus, the program, the information storage medium, and the photo printing method of the present invention are:
The superimposed image generation means includes
Based on the context instruction input, the order of writing the previously captured image and the current sampled image to a given buffer is determined, and sequentially overwritten to the given buffer according to the determined order of writing to give the background portion. The color is set to generate an overlapped image.

(7) The photo printing apparatus, program, information storage medium, and photo printing method of the present invention are:
Means for generating a preview image of the latest superimposed image stored in the storage unit and outputting the preview image to the display unit;
Means for accepting an instruction to end or continue the overlay,
When an instruction input to end overshooting is received, a print image is generated based on the overshooting image corresponding to the preview image,
When receiving an instruction to continue overshooting, the latest overshooting image corresponding to the preview image is used as the previous captured image, and overshooting processing with the current image is performed.

(8) The photo printing apparatus, the program, the information storage medium, and the photo printing method of the present invention are:
Means for generating a preview image of the latest superimposed image stored in the storage unit and outputting the preview image to the display unit;
The previous state in which the previous captured image used in generating the latest superimposed image, the previous captured image, or the previous superimposed image of the latest superimposed image is stored as a previous state storage image. Stored image storage means;
Means for accepting the cancellation input of the latest superimposed image;
When a cancel input is accepted, the previous state saved image stored in the previous state saved image storage means is used as the previous captured image, and an overshoot process with the current image is performed.

  If a cancel input is made, a print image may be generated based on the previous captured image stored in the previously captured image storage unit.

  In addition, when an instruction input to end overshooting is received following the cancel input, a print image may be generated based on the previous captured image stored in the previous captured image storage unit.

The right view for demonstrating the whole photo printing apparatus of this embodiment. The perspective view of the imaging | photography block of the photographic printing apparatus of this embodiment. The front view of the imaging | photography block of the photographic printing apparatus of this embodiment. It is an example of the block diagram of the photo printing apparatus of this embodiment. It is a figure for demonstrating the superposition photography of this Embodiment. The imaging | photography screen at the time of imaging | photography the 1st image is shown. The imaging | photography screen after completion | finish of imaging | photography of the 1st image is shown. The imaging | photography screen at the time of imaging | photography of the 2nd image is shown. The imaging | photography screen after completion | finish of imaging | photography of the 2nd image is shown. The figure explaining the front-and-rear relationship between the currently extracted image and the last captured image. The figure explaining the superimposition image produced | generated according to context. The figure for demonstrating the specific example of the image compositing process of superposition photography. The figure for demonstrating the specific example of the image compositing process of superposition photography. The flowchart which shows an example (live view image generation) of the superposition photography process of this Embodiment. The flowchart which shows an example (live view image generation) of the superposition photography process of this Embodiment. 6 is a flowchart illustrating an example of an overlap shooting process according to the present embodiment (continuation or end process of overlap shooting when a preview image is displayed). 6 is a flowchart illustrating an example of a superposition process according to the present embodiment (cancellation process when displaying a preview image).

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

1. Configuration of Photo Printing Apparatus FIGS. 1, 2 and 3 show an example of an external view of a photo printing apparatus of the present embodiment (photo vending apparatus and photo sticker printing apparatus in a narrow sense). FIG. 1 is an example of a right side view for explaining the entire photographic printing apparatus of this embodiment (including a photographing block and an editing unit block), and FIG. 2 is a perspective view of the photographing block of the photographic printing apparatus of this embodiment. FIG. 3 is a front view of the photographing block of the photo printing apparatus according to the present embodiment.

  First, the user (P1 in FIG. 1) shoots a subject (for example, self) on the front side (FIG. 3) of the shooting block 2 of the housing. Next, the user (P2 in FIG. 1) performs an editing operation on the image photographed in the editing block 3 provided on the back side of the housing, for example.

  As shown in the perspective view of FIG. 2 and the front view of FIG. 3, the photographing block 2 of the photo printing apparatus 1 of the present embodiment includes a camera 10 (imaging device) for photographing a subject. The camera 10 can be realized by, for example, a CCD camera, a C-MOS camera, or a video camera.

  The camera 10 photographs a subject from the front direction and functions as an imaging unit.

  The photographing block 2 of the photographic printing apparatus 1 includes a display 20. The display 20 is attached to the housing 50 so that the display screen faces the user at a height viewed from the user's viewpoint. The video imaged by the camera 10 is displayed on the display 20, and the user can check whether the user's own pose is appropriate by viewing the video image displayed on the display 20.

  Further, as shown in FIG. 1, a base 52 and a back plate 54 are provided in the housing 50 of the photo printing apparatus. The base 52 is a base for a subject (user) to stand on it during shooting. The base 52 is preferably provided with a mark for the subject (user) to determine the standing position. The mark in this case may be, for example, a mark in the shape of the sole of the foot or a line for preventing the subject (user) from approaching the camera 10 too much.

  The back plate 54 (back member) is for blocking light from the outside during photographing. As will be described later, the back plate 54 may have a function as a blue back when chroma key composition is performed for composition of additional display objects (background or characters).

  A curtain or the like may be used as the back plate 54.

  The photo printing apparatus 1 includes a photo receiving port 40 as shown in FIG. A seal or the like on which a photographed and edited image is printed is output to the receiving port 40.

  FIG. 4 is an example of a block diagram of the photo printing apparatus of the present embodiment. Note that the photo printing apparatus does not have to include all the components (respective parts) in FIG. 4, and may be configured such that some of them are omitted.

  The photographing unit 198 is for photographing a subject and can be realized by, for example, a CCD camera, a C-MOS camera, or a video camera, and functions as a subject image capturing unit.

  An operation unit 160 (a pointing device, a lever, a button, or the like) is used by the user to perform a selection operation or an editing operation of the editing content selection menu.

  The storage unit 170 (RAM) is a work area such as the processing unit 100 or the communication unit 196. An information storage medium 180 (a computer-readable medium such as a CD, DVD, HDD, or ROM) stores programs and data. The information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  The display 190 displays an image, and is, for example, the photographing display 20 in FIG. 2 or an editing display (not shown).

  The photographing display 20 is, for example, a touch panel or the like. When the user touches an input button displayed on the display, various instruction inputs (for example, a context instruction input or an instruction to continue / end overshooting) Input or cancel input).

  As the editing display, for example, a liquid crystal tablet, a touch panel, or the like is used, and a handwritten image can be input by drawing a character or a figure by bringing the tip of a touch pen (an example of a pointing device) into contact with the display surface. . Further, a stamp image such as a star mark or a heart mark prepared in advance is selected, and the stamp image can be input by bringing the tip of the touch pen into contact with the display surface.

  The sound output unit 192 outputs sounds such as sounds and game sounds.

  The portable information storage device 194 stores user personal data, save data for editing, and the like.

  The printing unit 195 performs processing for printing the captured image on a print medium (seal paper, photographic paper, plastic plate, or recording layer). In this case, there are various printing methods such as a sublimation type, a thermal transfer type, an ink jet method, and a laser printing method. As the printer for printing, an ink jet printer, a laser printer, a sublimation printer, a thermal transfer printer, a melt printer, a thermal printer, a photographic paper printer, an instant film printer, or the like may be used.

  The communication unit 196 performs various controls for performing communication via a network such as the Internet. By using the communication unit 196, the generated image data can be transmitted via the network.

  The processing unit 100 (processor) performs various processes such as a game process, an image generation process, and a sound generation process based on operation data from the operation unit 160, a program, and the like. In this case, the processing unit 100 performs various processes using the main storage unit 172 in the storage unit 170 as a work area. The function of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) or ASIC (gate array, etc.) and a program (game program).

  The processing unit 100 includes an editing processing unit 110, an image generation unit 120, a sound generation unit 130, and an overshoot processing unit 140.

  The editing processing unit 110 performs editing processing on the captured image based on input information for editing from the operation unit 160.

  The image generation unit 120 generates an image based on the result of shooting or editing, and outputs the image to the display 190.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, or sounds, and outputs the game sounds to the sound output unit 192.

  The overshooting processing unit 140 captures an image of a subject being captured by the imaging unit as a current image with a sampling color as a background, and generates a current sampling image in which a background portion is extracted from the current image in real time. Means for storing the current sampled image at the timing in the storage unit as a previously captured image, and means for receiving a context instruction input for instructing the context of the current sampled image and the previously captured image when generating a superimposed image. Based on the context instruction input, a live view that determines the context of the current extracted image and the previous captured image and generates a live view image that is synthesized in real time and output to the display unit in real time. Based on the image generation means and the input / output instruction, the current extracted image and the previous capture To determine the context of the image, serves as an overlapping taken image generating means for generating a superimposed taken image currently extraction image and the previous captured image which correspond to the live view image at a given timing.

  You may make it perform a superposition imaging | photography process by making the present sampling image at that time in the last imaging | photography (shutter) timing into the last captured image.

  An image obtained by extracting a background portion from the superimposed image may be subjected to the overlapping shooting process as a previously captured image.

  The live view image generation means includes a first buffer for storing a previously captured image, a second buffer for storing a currently extracted image generated in real time, an image in the first buffer, and a first buffer. A third buffer for writing a live view image obtained by synthesizing the images of the two buffers, and determining the order of writing the previously captured image and the current extracted image to the third buffer based on the context instruction input. The live view image may be generated by sequentially overwriting the third buffer in accordance with the writing order.

  After determining the timing of overlapping the current image and the previous captured image, one of the buffers may be replaced with an image obtained by extracting the background portion from the superimposed image.

  Based on the context instruction input, the order of writing the previously captured image and the current sampled image to a given buffer is determined, and sequentially overwritten to the given buffer according to the determined order of writing to give the background portion. The colors may be set to generate an overlapping image.

  When a preview image of the latest superimposed image stored in the storage unit is generated and output to the display unit, an instruction to end or continue the overlay is received, and an instruction to end the overlay is received When a print image is generated based on the overshoot image corresponding to the preview image and an instruction input for continuing the overshoot is received, the latest overshoot image corresponding to the preview image is used as the previously captured image as the current image. You may make it perform the superposition photographing process.

  A preview image of the latest superimposed image stored in the storage unit is generated and output to the display unit, and the previous captured image or the latest superimposed image used when the latest superimposed image is generated is generated. When one of the previous superimposed images is stored as the previous state saved image, the cancel input of the latest superimposed image is accepted, and the cancel input is accepted, the previous state stored in the previous state saved image storage means The state storage image may be used as a previously captured image, and an overlapping shooting process with the current image may be performed.

  The communication unit 196 performs processing for transmitting or receiving data via a network such as the Internet. More specifically, the communication unit 196 transmits data generated from the captured image of the camera to an external server or the like via the network. In this way, the user (subject) can download image data of the subject himself / herself from the server to the personal computer of his / her home. Based on the downloaded image data, it is possible to print and output an image on paper or a sticker using a printer at home. It is also possible to store images taken by the user on a server, download them to a photo printing apparatus, print them, and output them.

  The function of the communication unit 196 can be realized by hardware such as a communication device (IC), a communication program, or the like. Note that either the printing unit 195 or the communication unit 196 may be omitted.

  Note that the photo printing apparatus according to the present embodiment is not limited to the one that shoots the entire body of the subject, and may shoot only the upper body of the subject.

The subject photographed by the photo printing apparatus of the present embodiment is not limited to a human being.
For example, the present embodiment can be applied to an apparatus that takes a photograph of a product to be exhibited at an auction or the like. In this case, if data transmission via the Internet using the communication unit 196 is linked to the auction listing, a photo printing apparatus convenient for the exhibitor can be provided.

  The photo printing apparatus of this embodiment can also be used for a game apparatus of a type that uses a photo image of a player in a game. That is, the photo printing apparatus of the present embodiment can be made to function as an image capturing device of a game device.

2. Overshooting process FIG. 5 is a diagram for explaining overshooting according to the present embodiment.

  In the present embodiment, an overlap shooting mode is prepared separately from the normal shooting mode. When the overlap shooting mode is selected, a maximum of four images can be overlapped.

  Overshooting or overshooting is the process of aligning the current subject while viewing the previous subject image at the stage of shooting, and displaying the current subject image in front of or behind the previous subject image. It means taking composite photos.

  A superimposed image is an image obtained by combining a plurality of subject images (for example, a current subject image and a previous subject image) by overshooting.

  Reference numeral 210 denotes a subject image taken for the first time.

  Reference numeral 220 denotes a superimposed image obtained by superimposing the second subject image 222 on the first subject image 212.

  When the second image is captured, the first captured image 212 is displayed as still image data on the display (20 in FIG. 3), and the current camera (10 in FIG. 3) captures the image. A live view image is displayed in which the subject image is superimposed on the front or back like a movie, so that the player can adjust the position for the second shooting (adjusting the standing position and posture while viewing the live view image). )I do. Then, by pressing a shooting button displayed on the display at a desired timing, the current image at that time is determined as still image data, and is combined with the previous image that is still image data. With this, it is possible to take a superposed image of two images.

  Overshooting photography can synthesize still image data a plurality of times by repeating this procedure. Here, the still image data may be stored as separate still image data without being combined. In this way, it is possible to edit each still image data later.

  A live view image is an image obtained by combining the previous captured image (image of the subject only) extracted from the previous subject image and the current extracted image extracted from the current image currently being captured in real time. is there.

  Reference numeral 230 denotes a superimposed image obtained by superimposing the third subject image 232 on the first subject image 212 and the second subject image 222.

  When the third image is captured, a composite image (still image data) of the first captured image 212 and the second image 222 is displayed on the display (20 in FIG. 3), and is superimposed on the current camera. Since the live view image in which the subject image being photographed (10 in FIG. 3) is superimposed on the front or back is displayed, the player can adjust the position for the third shooting while viewing the live view image ( Adjust standing position and posture). Then, by pressing a shooting button displayed on the display at a desired timing, it is possible to take an image of three images.

  Reference numeral 240 denotes a superimposed image obtained by superimposing a fourth subject image 242 on a first subject image 212, a second subject image 222, and a third subject image 232.

  When the fourth image is captured, a composite image (still image data) of the first captured image 212, the second image 222, and the third image 232 is displayed on the display (20 in FIG. 3). In addition, since a live view image is displayed in which the subject image currently captured by the camera (10 in FIG. 3) is superimposed on the front or back of the image, the player captures the fourth time while viewing the live view image. Position adjustment (adjustment of standing position and posture). Then, by pressing the shooting button displayed on the display at a desired timing, it is possible to similarly shoot a four-shot image.

  Note that shooting may be automatically performed (shutter is released) after a certain time without pressing the shooting button.

  6 to 9 are diagrams for explaining a shooting screen (image displayed on the display 20 of FIG. 3) in the overlap shooting mode of the present embodiment.

  FIG. 6 shows a shooting screen when shooting the first image.

  310 is a live view image. The live view image 310 when the first image is captured is an image obtained by combining the subject image currently captured by the camera (10 in FIG. 3) and a given background color by real-time chroma key processing.

  In the real-time chroma key processing, a background portion is extracted from an image currently captured by the camera (10 in FIG. 3) (for example, transparency is set as an α value of a pixel in the background portion). A cut-out image) is generated, and a given background color is synthesized with the background portion.

  Reference numeral 320 denotes a button for instructing photographing timing. Since this display is composed of a touch panel, the player can instruct shooting timing by touching the button on the screen.

  In the present embodiment, after a predetermined time has elapsed since the player touched the button 320 on the screen, the shooting (shutter) timing arrives, and the image at that time is taken in to become the first shot image.

  Reference numeral 330 denotes a countdown display until photographing. Reference numeral 340 denotes an indication of the number of mosquitoes.

  FIG. 7 shows a shooting screen after the first image is shot.

  Reference numeral 350 denotes a preview image. A preview image 350 after the first image is captured is an image obtained by synthesizing a captured image and a given background color at the first capturing timing by chroma key processing.

  In the chroma key processing, a background image is extracted from the captured image at the first capturing timing (for example, transparency is set as the α value of the pixel in the background portion), and an extracted image (an image in which the subject portion 352 is cut out) is generated. A given background color is synthesized with the background portion.

  Reference numerals 354 and 356 denote buttons for accepting an instruction input to end or continue the superposition (354 is an instruction input to end the superposition and 356 is an instruction input to continue the superposition). Since this display is composed of a touch panel, the player can instruct the end or continuation of the super-shooting by touching the buttons 354 and 356 on the screen.

  When the overshoot end button 354 is pressed, a print image is generated based on the overshoot image corresponding to the preview image 350. In addition, when the continue shooting button 356 is pressed, an image corresponding to the preview image 350 is used as a previous captured image, and an overlapping shooting process with the current image is performed.

  Reference numeral 342 denotes the number of swordfish.

  FIG. 8 shows a shooting screen when shooting the second image.

  Reference numeral 360 denotes a live view image. The live view image 360 when the second image is captured is composed of the previously captured image 362, the subject image 364 currently captured by the camera (10 in FIG. 3), and the given background color by real-time chroma key processing. It is an image.

  In real-time chroma key processing, the background part is extracted from the previously captured image obtained by extracting the background part and the image currently captured by the camera (10 in FIG. 3) (for example, transparency is set as the α value of the pixels in the background part). A currently extracted image (an image in which the subject portion 362 is cut out) is generated, and an image (overlapped image) in which a previously captured image and the current extracted image are combined and a given background color is combined with the background portion is generated. The

  Reference numeral 320 denotes a button for instructing photographing timing. Since this display is composed of a touch panel, the player can instruct shooting timing by touching the button 320 on the screen.

  In the present embodiment, after a predetermined time has elapsed since the player touched the button 320 on the screen, the current shooting timing has arrived, and the image at that time is captured to form the second shot image.

  Reference numeral 370 denotes a button for instructing the front-rear relationship between the currently extracted image and the previously captured image when generating the superimposed image. Since this display is composed of a touch panel, the player can instruct the front-rear relationship between the current extracted image and the previously captured image when generating the superimposed image by touching the button 370 on the screen. In the present embodiment, there are two types of modes, “a mode in which the current extracted image is superimposed on the previous captured image” and “mode in which the current extracted image is superimposed on the previous captured image”, and each time the button is pressed. It is configured to change modes.

  In the case of the “mode in which the current extracted image is superimposed on the previous captured image”, the previous captured image and the current extracted image are in the context shown by 410 and 412 in FIG. 10 (the current extracted image 412 is in the depth direction z). The live view image 360 and the superimposed image are synthesized on the assumption that the image is positioned before the previous captured image 410).

  Accordingly, as shown in FIG. 11B, an image in which the subject portion (currently extracted image) 412 of the current image is overwritten on the subject portion (previously captured image) 410 of the previously captured image is generated.

  Further, in the case of the “mode in which the current extracted image is superimposed on the back of the previous captured image”, the previous extracted image and the current extracted image are in the context shown by 410 and 414 in FIG. And the live view image 360 and the superimposed image are combined.

  Accordingly, as shown in FIG. 11A, an image is generated in which the subject portion (previously captured image) 410 of the previously captured image is overwritten on the subject portion (currently extracted image) 412 of the current image.

  In the present embodiment, when the player performs positioning for overlay shooting while viewing the live view image, each time the context instruction button 370 is pressed, the context between the current extracted image and the previous captured image is changed each time. The replaced image is displayed on the live view image in real time. Accordingly, it is possible to perform overlay shooting with a high degree of freedom in response to changes reflecting the player's intention, and the player can generate a desired overlay image while checking the synthesis result in real time with the live view image. it can.

  Reference numeral 330 denotes a countdown display until photographing. Reference numeral 340 denotes an indication of the number of mosquitoes.

  FIG. 9 shows a shooting screen after the shooting of the second image.

  Reference numeral 380 denotes a preview image. The preview image 380 after the second image has been captured is an overlapped image (the subject portion 382 of the first image and the subject portion 383 of the second image) at the second shooting timing, a given background color, and the like. Is an image synthesized by chroma key processing.

  In the chroma key process, a background portion is extracted from a captured image (overlapped image) at the second capturing timing (for example, transparency is set as an α value of a pixel in the background portion), and extracted images (subject portions 382 and 383 are extracted. Image) is generated, and a given background color is synthesized with the background portion.

  Reference numerals 384 and 386 denote buttons for accepting an instruction input to end or continue the superposition (384 is an instruction input to end the superposition and 386 is an instruction input to continue the superposition). Since this display is composed of a touch panel, the player can instruct the end or continuation of the super-shooting by touching the buttons 384 and 386 on the screen.

  When the overshoot end button 384 is pressed, a print image is generated based on the overshoot image corresponding to the preview image 380. In addition, when the continue shooting button 386 is pressed, an image corresponding to the preview image 380 is used as a previous captured image, and an overlapping shooting process with the current image is performed.

  Reference numeral 342 denotes the number of superimposed shots.

  FIG. 12 is a diagram for explaining a specific example of the image composition processing for overshooting.

  Reference numeral 510 denotes a previous photographed image of the subject photographed by the imaging unit with the extracted color as a background before photographing the current image 530. Reference numeral 512 denotes a subject portion of the previous captured image 510, and reference numeral 514 denotes a background portion of the previous captured image 510. The background portion is a sampling color (for example, blue for a blue background and green for a green background).

  In the present embodiment, a previous captured image 520 is generated by extracting a background portion (extracted color portion) 514 from the previous captured image 510 (for example, the background portion can be extracted by chroma key processing). In the previously captured image 520, the subject portion 522 is extracted, and the background portion 524 is transparent.

  Reference numeral 530 denotes a current photographed image photographed by the imaging unit. Reference numeral 532 denotes a subject portion of the currently photographed image 530, and reference numeral 534 denotes a background portion of the currently photographed image 530. The background portion is a sampling color (for example, blue for a blue background and green for a green background).

  In the present embodiment, a previously captured image 520 is generated by extracting the background portion (extracted color portion) 534 from the current photographed image 530 (for example, the background portion can be extracted by chroma key processing). In the currently extracted image 540, the subject portion 542 is extracted, and the background portion 544 is transparent.

  A live view image (570 or 580) that determines the front-rear relationship between the current sampled image and the previous captured image based on the context instruction input and combines the current sampled image 540 and the previous captured image 520 in real time and outputs them to the display unit. ) Is generated.

  When the current extracted image is arranged in front of the previous captured image, a composite image as shown by 560 is generated by overwriting the current extracted image 540 on the previously captured image 520. Can do. In the composite image 560, the current subject portion 564 is overwritten on the previous subject portion 562, and the background portion 566 is transparent.

  Reference numeral 580 denotes an image obtained by synthesizing a given background color 586 with the background portion 566 of the synthesized image 560, and can be used as a live view image.

  When the current extracted image is arranged behind the previous captured image, the composite image as shown in 550 is generated by overwriting the previously extracted image 520 on the current extracted image 540. Can do. In the composite image 550, the previous subject portion 552 is overwritten on the current subject portion 554, and the background portion 556 is transparent.

  Reference numeral 570 denotes an image obtained by synthesizing a given background color 576 with the background portion 556 of the synthesized image 550, and can be used as a live view image.

  Note that 570 or 580 generated by performing the above processing at the photographing timing can be used as a superimposed image.

  FIG. 13 is a diagram for describing a specific example of the image composition processing for overshooting.

  Reference numeral 610 denotes a superimposed image (for example, a superimposed image 580 generated by the processing described with reference to FIG. 12) generated by the overlapping shooting process. Reference numeral 612 denotes a subject portion of the superimposed image 610, and reference numeral 614 denotes a background portion of the superimposed image 610. The background portion is a given background color or sampling color (e.g. blue for a blue background, green for a green background).

  In this embodiment, a background portion (extracted color portion) 614 is extracted from the superimposed image 610 to generate a previously captured image 620 (for example, the background portion can be extracted by chroma key processing). In the previously captured image 620, the subject portion 622 is extracted, and the background portion 624 is transparent.

  Note that the background color sampling process can be omitted by using, for example, a composite image (eg, 560 in FIG. 12) in which the background portion generated by the past superimposing process is transparent.

  Reference numeral 630 denotes a currently captured image (for example, a third captured image) captured by the imaging unit. Reference numeral 632 denotes a subject portion of the currently photographed image 630, and 634 denotes a background portion of the currently photographed image 630. The background portion is a sampling color (for example, blue for a blue background and green for a green background).

  In the present embodiment, a previously captured image 620 is generated by extracting the background portion (extracted color portion) 634 from the current photographed image 630 (for example, the background portion can be extracted by chroma key processing). Currently extracted image 640 has subject portion 642 extracted and background portion 644 is transparent.

  A live view image (670 or 680) that determines the front-rear relationship between the current sampled image and the previous captured image based on the context instruction input, synthesizes the current sampled image 640 and the previous captured image 620 in real time, and outputs them to the display unit. ) Is generated.

  When the current extracted image is arranged in front of the previous captured image, a composite image as shown in 660 is generated by overwriting the current extracted image 640 on the previous captured image 620. Can do. In the composite image 660, the current subject portion 664 is overwritten on the subject portion 662 of the previous superimposed image, and the background portion 666 is transparent.

  Reference numeral 680 denotes an image obtained by synthesizing a given background color 686 with the background portion 666 of the synthesized image 660, and can be used as a live view image.

  When the current extracted image is arranged behind the previous captured image, the composite image as shown in 650 is generated by overwriting the previously extracted image 620 on the current extracted image 640. Can do. In the composite image 650, the subject portion 652 of the previous superimposed image is overwritten on the current subject portion 654, and the background portion 656 is transparent.

  Reference numeral 670 denotes an image obtained by synthesizing a given background color 676 to the background portion 656 of the synthesized image 650, and can be used as a live view image.

  Note that 670 or 680 generated by performing the above processing at the photographing timing can be used as a superimposed image.

  FIG. 14 is a flowchart illustrating an example of the overshoot process (live view image generation) according to the present embodiment.

  The following processing is performed for each frame displayed on the display unit or for each predetermined time.

  First, an image obtained by extracting a background portion from an image of a subject photographed by the imaging unit with the extracted color as a background is stored in the storage unit as a previously captured image (step S10).

  Next, the previous captured image stored in the storage unit is stored in the previous buffer (layer) (step S20).

  Next, the current extracted image obtained by extracting the background portion from the image of the subject being imaged by the imaging unit with the extracted color as the background is stored in the current buffer (layer) (step S40).

  Next, the front-rear relationship between the previous captured image and the current sampled image is determined based on the contextual instruction input, and the previous captured image and the current sampled image are combined to generate a live view image (step S50).

  Next, based on the context instruction input, the front-rear relationship between the current sampled image and the previous captured image is determined, and the current sampled image and the previous captured image at a given timing are combined to give the background portion a given color Is set to generate a superimposed image (step S60).

  FIG. 15 is a flowchart showing an example (live view image generation) of the overlapping shooting process according to the present embodiment.

  The following processing is performed for each frame displayed on the display unit or for each predetermined time.

  The live view subject image at a given timing is taken as the previous captured image (step S110).

  Next, the current extracted image obtained by extracting the background portion from the image of the subject being imaged by the imaging unit with the extracted color as the background is stored in the current buffer (layer) (step S130).

  Next, the front-rear relationship between the previous captured image and the current sampled image is determined based on the context instruction input, and the previous captured image and the current sampled image are combined to generate a live view image (step S140).

  Next, based on the context instruction input, the front-rear relationship between the current sampled image and the previous captured image is determined, and the current sampled image and the previous captured image at a given timing are combined to give the background portion a given color Is set to generate a superimposed image (step S150).

  FIG. 16 is a flowchart showing an example of the overshoot process of the present embodiment (continuation or end process of overshoot when displaying a preview image).

  The following processing is performed for each frame displayed on the display unit or for each predetermined time.

  A preview image of the latest superimposed image stored in the storage unit is generated and output to the display unit (step S210).

  Next, an instruction input to end or continue overshooting is received (step S220).

  Next, when an instruction to end overshooting is received, a print image is generated based on the overshot image corresponding to the preview image (step S230).

  Next, when an instruction input to continue overshooting is received, the latest overshooting image corresponding to the preview image is used as the previous captured image, and an overshooting process with the current image is performed (step S240).

  FIG. 17 is a flowchart illustrating an example of the overlap shooting process (cancellation process when displaying a preview image) according to the present embodiment.

  The following processing is performed for each frame displayed on the display unit or for each predetermined time.

  First, either the previous captured image used in generating the latest superimposed image or the previously captured image immediately before the latest superimposed image is stored in the storage unit as the previous state storage image (step S310). .

  Next, a preview image of the latest superimposed image stored in the storage unit is generated and output to the display unit (step S320). A cancel input of the latest superimposed image is accepted (step S330).

  Next, when a cancel input is received, the previous state saved image stored in the previous state saved image storage means is used as the previous captured image, and an overshoot process with the current image is performed (step S340).

  The present invention is not limited to the one described in the above embodiment, and various modifications can be made.

  In the invention according to the dependent claims of the present invention, a part of the constituent features of the dependent claims can be omitted. Moreover, the principal part of the invention according to one independent claim of the present invention can be made dependent on another independent claim.

DESCRIPTION OF SYMBOLS 1 Photo printing apparatus 10 Camera 20 Display 40 Photo receiving port 100 Processing part 110 Editing processing part 120 Image generation part 130 Sound generation part 140 Overlay processing part 160 Operation part 170 Storage part 174 Drawing buffer 180 Information storage medium 190 Display 192 Sound Output section,
194 Portable information storage device 195 Printing unit 196 Communication unit 198 Imaging unit

Claims (7)

An imaging device that includes an imaging unit and a display unit, captures and edits an image of a subject captured by the imaging unit,
Including an overshoot processing means for performing an overshoot process for generating an overshoot image of the subject;
The overshoot processing means includes:
Means for capturing in real time a current sampled image in which a background image is extracted from a current image by capturing an image of a subject being photographed by an imaging unit with a sampled color as a background;
Means for storing a current sampled image at a given timing in a storage unit as a previously captured image;
Live view image generation means for generating a live view image that is synthesized in real time with the current extracted image and the previous captured image and output to the display unit;
An overlay image generation means for generating an overlay image corresponding to a live view image at a given timing;
Means for outputting, together with the latest superimposed image, a superimposed image end / continuation instruction input acceptance image to the display unit,
If an instruction to end overshooting is received, the overtaking process is terminated, and if an instruction input to continue overtaking is received, an image obtained by extracting a background portion from the overshooting image is previously captured. An imaging apparatus characterized in that the superposition processing is continued as an image . In claim 1,
The overshoot processing means includes:
Previous state storage image storage means for storing either the previous captured image used when generating the latest superimposed image or the previous superimposed image of the latest superimposed image as a previous state storage image;
Means for accepting a cancellation input of the latest superimposed image,
An imaging apparatus, wherein when a cancel input is received, a previous state saved image stored in a previous state saved image storage unit is used as a previous captured image, and an overshoot process is performed with a currently extracted image . In claim 1 or 2 ,
The overshoot processing means includes:
An imaging apparatus characterized by performing a superimposition process using a current sampling image at a previous imaging timing as a previously captured image. A program for controlling an imaging device that includes an imaging unit and a display unit, captures and edits an image of a subject captured by the imaging unit,
The computer functions as an overshoot processing means for performing an overshoot process for generating an overshoot image of the subject,
The overshoot processing means includes:
Means for capturing in real time a current sampled image in which a background image is extracted from a current image by capturing an image of a subject being photographed by an imaging unit with a sampled color as a background;
Means for storing a current sampled image at a given timing in a storage unit as a previously captured image;
Live view image generation means for generating a live view image that is synthesized in real time with the current extracted image and the previous captured image and output to the display unit;
An overlay image generation means for generating an overlay image corresponding to a live view image at a given timing;
Means for outputting, together with the latest superimposed image, a superimposed image end / continuation instruction input acceptance image to the display unit,
When accepting an instruction input lap taking the termination ends the overlap taking process, when accepting an instruction input lap taken continue, an image was drawn background portion from the overlapped taken image, the previous capture A program characterized in that the superposition processing is continued as an image . A computer-readable information storage medium, wherein the program according to claim 4 is stored. A photo printing apparatus that includes an imaging unit and a display unit, captures an image of a subject captured by the imaging unit, edits and prints the image,
Including an overshoot processing means for performing an overshoot process for generating an overshoot image of the subject;
The overshoot processing means includes:
Means for capturing in real time a current sampled image in which a background image is extracted from a current image by capturing an image of a subject being photographed by an imaging unit with a sampled color as a background;
Means for storing a current sampled image at a given timing in a storage unit as a previously captured image;
Live view image generation means for generating a live view image that is synthesized in real time with the current extracted image and the previous captured image and output to the display unit;
An overlay image generation means for generating an overlay image corresponding to a live view image at a given timing;
Means for outputting, together with the latest superimposed image, a superimposed image end / continuation instruction input acceptance image to the display unit,
If an instruction to end overshooting is received, the overtaking process is terminated, and if an instruction input to continue overtaking is received, an image obtained by extracting a background portion from the overshooting image is previously captured. A photographic printing apparatus, characterized in that the overtaking process is continued as an image . A photographic printing method of a photographic printing apparatus that includes an imaging unit and a display unit, captures an image of a subject photographed by the imaging unit, edits and prints the image,
Including an overshoot processing step for performing an overshoot process for generating an overshoot image of the subject;
The overshoot processing step includes:
Capturing an image of a subject being photographed by the imaging unit as a background with a sampling color as a current image, and generating a current sampling image in which a background portion is extracted from the current image in real time;
Storing a current sampled image at a given timing in a storage unit as a previously captured image;
A live view image generation step of generating a live view image that is synthesized in real time with the current extracted image and the previous captured image and output to the display unit;
A superimposed image generation step for generating a superimposed image corresponding to the live view image at a given timing;
A step of outputting an image for accepting completion / continuation of the continuous shooting together with the latest superimposed image to the display unit,
If an instruction to end overshooting is received, the overtaking process is terminated, and if an instruction input to continue overtaking is received, an image obtained by extracting a background portion from the overshooting image is previously captured. A photographic printing method for a photographic printing apparatus, characterized in that the superposition processing is continued as an image .

Images