JP4336215B2 - Automatic photo creation device and automatic photo creation method - Google Patents

Description

  The present invention relates to an automatic photo creation apparatus that captures a user with a camera and outputs a composite image generated based on the captured image as a photograph.

2. Description of the Related Art Conventionally, there is known a photo creation device for a game where a user is photographed with a camera and the photographed image is output as a photograph. Such a play photo creation device is highly playable or entertaining, and therefore, an image to be combined with a photographed image is prepared from a variety of background images and foreground images prepared in advance according to the user's preference. Many are configured so that a user can freely select and draw using a pen-type input means such as a touch pen or a light pen. Further, a member that provides a background such as a background curtain having a predetermined color or pattern behind the user so as to constitute a background of the user that is actually photographed with the user (hereinafter referred to as a “background providing unit”) ) Is often provided. Furthermore, in order to appropriately change the background according to the user's preference, there is an amusement photo creation device including a video display device in which electroluminescence elements and the like are arranged in a matrix as a background providing unit (see Patent Document 1). ). In this game photo creation device, a moving image or a still image displayed on a video display device provided behind the user is photographed together with the user to obtain a photographed image with the moving image or the still image as a background. . With this configuration, it is possible to take photographs with various images displayed behind the user, so that the user can obtain photographs that feel as if they were taken in various places.
JP 2002-320178 A

  However, in the above conventional game photo creation device, the user can select a background image to be displayed on a video display device as a background providing unit from a plurality of types of background images stored in advance. There are not many different backgrounds.

  Further, in the above conventional game photo creation device, since the user can edit graffiti etc. on the photographed image after shooting, the user can obtain a variety of photos according to the preference by the editing operation. Can do. However, since only one of the background images displayed on the video display device, which is the background providing unit before shooting, is selected as described above, it was created according to the user's preference before shooting. The background image cannot be displayed on the video display device.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide an automatic photo creation apparatus and an automatic photo creation method capable of displaying a background image created in accordance with the user's preference before shooting on a background providing unit.

The first invention includes a shadow means Taking for photographing a user as a subject in a predetermined imaging area, illuminating means for illuminating the object by the flashing during photographing by the photographing means, by said photographing means An automatic photo creation device comprising output means for outputting a composite image including a photographed image obtained as a photograph,
A background presenting means for displaying an image to be used as a background on the display surface, the display surface being disposed behind the user so as to face the photographing means;
Input means for accepting an operation by the user of the image displayed on the display surface for editing on the display surface of the background presentation means,
In response to an operation by the user accepted by the input means, the image processing means for newly generating an image to be the background by editing the image to be the background, and
The background presenting means displays an image to be a background newly generated by the image processing means on the display surface ,
The input means includes a predetermined input device that is carried by the user and can be arranged at an arbitrary position in a predetermined space near the background presentation means, and the position of the display surface of the background presentation means and the input device Accepts a position designation operation by the user based on the relationship;
The photographing unit is configured to photograph an image to be a background displayed on the display surface together with the user as a subject .

According to a second invention, in the first invention,
The background presentation means displays an image to be a background and an image to be a foreground on the display surface,
The image processing means generates the composite image by combining the image to be the foreground with the captured image as a foreground.

According to a third invention, in the first invention,
The input means receives a position specifying operation by the user based on a physical action on the display surface of the background presentation means.

According to a fourth invention, in the first invention,
The input device is a light source;
The input means further includes a light detection device provided near an end of the display surface, and receives a position specifying operation by the user by detecting the position of the light source with respect to the display surface by the light detection device. It is characterized by.

A sixth invention is an illumination step of illuminating the object by emitting a shadow step Taking be taken by a predetermined imaging means user as a subject in a predetermined imaging area, the flash at the time of photographing in the photographing step An automatic photo creation method including a printing step of printing a composite image including a photographed image obtained in the photographing step as a photograph,
A background presentation step of displaying an image to be used as a background on a display surface disposed behind the user so as to face the photographing unit;
An input step of accepting an operation by the user for editing an image displayed on the display surface on the display surface;
An image processing step for generating an image to be newly set as a background by editing the image to be set as the background in response to an operation by the user accepted in the input step ,
In the background presentation step, an image to be newly generated in the image processing step is displayed on the display surface ,
In the input step, a position designation operation by the user based on a positional relationship between a predetermined input device that is carried by the user and can be arranged at an arbitrary position in a predetermined space near the background presentation means and the display surface is performed. Accept
In the photographing step, together with the user, an image to be a background displayed on the display surface is photographed as a subject .

According to the first aspect, the composite image is generated and generated by the image processing means in accordance with the operation by the user accepted by the input means while displaying the background image to the user by the background presentation means. The synthesized image is immediately displayed to the user by the background presentation means. Thus, unlike editing on a small screen such as a commonly used liquid crystal touch panel, the user can edit while viewing a background image displayed in a size that should actually be taken. it can. Therefore, high playability or amusement can be obtained, and a composite image to be obtained can be easily estimated before photographing, so that a composite image in accordance with the user's intention can be obtained. Moreover, since it is possible to obtain a sense of reality that stands behind the actually displayed background, high playability or entertainment can be obtained.
According to the first aspect of the invention, the editing operation can be performed at a position preferred by the user, so that the user can also edit while facing the background presentation means. Therefore, high playability or amusement can be obtained, and the editing operation can be performed intuitively, so that the editing operation becomes easy.

  According to the second aspect of the invention, various composite images can be obtained by synthesizing a foreground image with a captured image, which is a part of the image displayed on the display surface of the background presentation means. Therefore, high playability or entertainment can be obtained.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
<1. Overall configuration>
FIG. 1 is a side view of an amusement photo creation apparatus that is an automatic photo creation apparatus according to an embodiment of the present invention. FIG. 2 is a front view of the main body 4 of the amusement photo creation apparatus ( It is the figure seen from the user U as a to-be-photographed object. Hereinafter, with reference to FIG. 1 and FIG. 2, an overall configuration of the game photo creation device according to the present embodiment will be described.

  This play photo creation apparatus includes a shooting room 2 in which a user U enters and a main body 4 that generates a composite image including a shot image of the user U and outputs it as a photo sticker (or photo card). The imaging room 2 is provided with an LED display device 101 that is a background display device that provides the background of the user U, and two light detection devices 102L and 102R in the vicinity of the center of both sides (hereinafter these 2). In the case where the individual photodetection devices are not distinguished, they are indicated by reference numeral “102”). In addition, a handheld input device 40 that is an operation means including a predetermined light source for indicating a position and a plurality of switches is held (carried) in the hand of the user U. The configurations and operations of the photodetection device 102 and the handheld input device 40 will be described later.

  In the LED display device 101, a plurality of light emitting units made up of LEDs (Light Emitting Diodes) are arranged in a matrix, and light of three primary colors is appropriately emitted from the three types of light emitting units forming the pixels, thereby obtaining a predetermined background. Display an image.

  The main body 4 is arranged below the camera 10 as a camera 10 as an imaging means for photographing the user U, a flash 11 as an illuminating means arranged at an appropriate position above the camera 10 to emit a flash. A preview monitor 22 which is a display device comprising a CRT (Cathode Ray Tube) or a liquid crystal display panel, a screen for displaying a photographed image and performing free drawing (doodle) by the user U, an operation screen, etc. Liquid crystal touch panel 20 composed of a liquid crystal display to be provided and a transparent sheet for detecting an operation position covering the operation screen, a touch pen 21 used for an operation on the liquid crystal touch panel 20, and an illumination that emits a flash arranged at an appropriate position below these And a flash 12 as means. In the figure, one touch pen 21 is provided, but two or more touch pens 21 may be provided. The liquid crystal touch panel 20 may be a liquid crystal touch panel having an electrostatic induction type operation position detection function that does not include the transparent sheet.

  The camera 10 is typically a digital camera that generates a digital image signal using a CCD (Charge Coupled Device), and is provided on the user U existing on the floor surface of the photographing room 2 and behind the user U. The LED display device 101 is photographed, and an image signal representing the photographed image is output. The LED display device 101 is bright (with high brightness) so that it is not canceled out by a strong flash emitted from the flashes 11 and 12 when the user U presses a shutter button (not shown) for shooting. A background image is displayed. Further, at the time of shooting, the shutter speed, aperture, etc. of the camera 10 are appropriately adjusted (for example, the flash is operated for a short time during a relatively long exposure), so that the background image is shot clearly. Also good.

  The preview monitor 22 is configured to display an image represented by the image signal in real time, and is used to confirm a captured image to be obtained by the camera 10.

  The liquid crystal touch panel 20 functions as an operation unit that accepts various operations by the user U, such as an operation unit for performing graffiti.

  The main body unit 4 is configured with a computer at the center, and a composite image including a photographed image obtained by the main control device and the I / O control device that controls each unit and performs image processing such as image composition to be described later, and the camera 10 is a photo sticker. (Or a photo card). Further, the main body 4 is provided with a coin insertion slot 26 below the front surface and a photographic sticker outlet 28 on the side surface. Furthermore, the main body 4 includes lighting devices 13L and 13R that are always turned on during the operation of the present photo creating device, on the left and right sides of the camera 10, respectively.

<2. Configuration of photodetection device>
Next, the configuration of the light detection device 102 will be described. FIG. 3 is a view of the LED display device 101 and the vicinity thereof in the game photo creation device shown in FIG. 1 as viewed from the front (that is, from the camera 10 of the main body 4). The user U shown in FIG. 3 stands toward the LED display device 101, and a handheld input device 40, which is an operation means including a predetermined light source for indicating the position and a plurality of switches, is held (carried). Has been. The hand-held input device 40 is connected to the main body 4 by a predetermined signal line (and a power supply line to the light source), but is connected wirelessly by using, for example, radio waves or infrared rays. May be. As shown in FIG. 3, two photodetecting devices 102L and 102R are provided in the vicinity of the center of both sides of the LED display device 101 of the game photo creation device. The photodetecting devices 102L and 102R are arranged at a predetermined interval in the horizontal direction. .

  FIG. 4 is a side view showing a configuration example of the photodetection device 102. In the case of this configuration example, the light detection device 102 includes a housing formed with a slit extending in the horizontal direction (left-right direction) on the front side of the LED display device 101, that is, the side facing the main body 4 and the user U as a subject. A plurality of (three in this example) light receiving elements (photosensors) 1021 to 1023 are arranged in a row in the vertical direction on the inner surface of the housing facing the slit. Then, the detection signals S1 to S3 output from the light receiving elements 1021 to 1023 are input to the main controller in the main body 4. When the light source exists in front of the light detection device 102 and at a position indicated by a solid line in FIG. 4, the intensity of the detection signal S2 of the center light receiving element 1022 among the three light receiving elements 1021 to 1023 becomes the largest, When a light source exists in front of the light detection device 102 and at a position indicated by a dotted line in FIG. 4, the intensity of the detection signal S1 of the upper light receiving element 1021 among the three light receiving elements 1021 to 1023 is the highest. Therefore, based on the three detection signals S <b> 1 to S <b> 3, the vertical position of the light source of the handheld input device 40 held by the user U, which is a light source existing in front of the light detection device 102, can be calculated.

  Further, since two such light detection devices 102 are arranged at a predetermined interval in the horizontal direction (left-right direction), a difference in light detection signals between these light detection devices 102L and 102R, that is, detection is performed. The position in the horizontal direction (left and right direction) of the light source (of the handheld input device 40) existing in the front can be calculated based on the difference in light intensity. Furthermore, the distance (position in the front-rear direction) of the light source (of the handheld input device 40) from the LED display device 101 can be calculated as necessary.

  In the configuration shown in FIG. 4, a plurality (three) of light receiving elements 1021 to 1023 are arranged in a line in the vertical direction, but in addition to this, a plurality (three) of light receiving elements are also arranged in the horizontal direction. By arranging the light receiving elements, a plurality (9) of light receiving elements are arranged in a matrix, and instead of slits formed in the housing, pinholes that are dotted openings are formed. May be. According to this configuration, the position in the horizontal direction (left-right direction) as well as the vertical direction (up-down direction) of the light source existing in front of the light detection device 102 is calculated based on the detection signals of the plurality of light receiving elements. Can do. In this case, only one photodetection device 102 may be provided. Also, three or more photodetectors that detect light from an arbitrary direction ahead are arranged at a predetermined interval from each other, and the intensity of light detected by these photodetectors or the difference in intensity between them is determined. Based on this, the positions in the horizontal direction and vertical direction (left and right direction and up and down direction) of the light source (of the handheld input device 40) existing in front of the light detection device 102 may be calculated. In this case, if the emission intensity (luminous intensity) of the light source is known, the distance from the detection device to the light source can be calculated from the detected intensity.

<3. Functional configuration>
FIG. 5 is a block diagram showing the configuration of the main part of the play photo creating apparatus according to the present embodiment as seen from the functional aspect. Functionally, the game photo creation device includes an imaging unit 52, a confirmation display unit 54, a main display / operation unit 62, a background display unit 64, an output unit 66, an illumination unit 70, an I / O The O control unit 72, the main control unit 80, the light detection unit 91, and the handheld input unit 92 are configured.

  In this configuration, the imaging unit 52 corresponds to the camera 10 configured using an imaging device such as a CCD, and captures an image in real time (this image may be referred to as a “through image”, In this case, an image signal representing a “captured image for monitoring” is output. This image signal is input to the main control unit 80 and temporarily stored as monitor image data in its internal memory. The monitor image data is supplied from the main control unit 80 to the confirmation display unit 54 as a monitor image signal. The confirmation display unit 54 corresponds to the preview monitor 22 and displays a monitor photographic image in real time based on the monitor image signal.

  The main display / operation unit 62 corresponds to the liquid crystal touch panel 20 and accepts an operation of the user U related to graffiti processing, a shutter operation, an operation for print output, and the like. To the main control unit 80. Now, assuming that a shutter button (not shown) is pressed for shooting by the user U, the flashing is performed in the shooting direction of the camera 10 after elapse of a predetermined time of about several seconds based on an instruction from the main control unit 80. 11 and 12 emit a flash. At that time, an image signal output from the imaging unit 52 as a signal representing a captured image of the user U (and the LED display device 101) is input to the main control unit 80, and serves as a memory or an auxiliary storage device in the main control unit 80. Stored as photographed image data. The output unit 66 corresponds to a printer built in the main body unit 4, and outputs an image represented by the captured image data as a photo sticker (or photo card) based on an instruction from the main control unit 80.

  The background display unit 64 corresponds to the LED display device 101 in the photographing room 2 and projects the background image on the LED display device 101 based on an image signal indicating the background image given from the main control unit 80.

  The illumination unit 70 corresponds to the illumination devices 13L and 13R and the flashes 11 and 12 in the main body unit 4, and is turned on / off and dimmed by the I / O control unit 72 based on an instruction from the main control unit 80. .

  The I / O control unit 72 corresponds to an I / O control device built in the main body unit 4, controls the illumination unit 70 based on an instruction from the main control unit 80, and a later-described coin detection unit (not shown). ) Is transferred to the main control unit 80.

  The hand-held input unit 92 corresponds to the hand-held input device 40 that is carried by the user U in the photographing room 2, and accepts the operation of the user U with respect to a plurality of built-in switches. Signals indicating these operations are input to the main control unit 80 as operation signals.

  The light detection unit 91 corresponds to the light detection devices 102L and 102R in the photographing room 2, and the above-described three detection signals output for each light detection device according to the position of the light source (of the handheld input device 40). S1 to S3 are given to the main controller 80. Based on these detection signals, the main control unit 80 calculates the horizontal and vertical positions of the light source of the handheld input device 40 held by the user U, which is the light source existing in front of the light detection device 102.

  The main control unit 80 is built in the main body unit 4 and corresponds to a main control unit mainly composed of a computer including a CPU (Central Processing Unit), a memory, a frame buffer, a timer, an auxiliary storage device, and the like. When the CPU executes the predetermined program stored in, each unit is instructed as described above in order to control each unit based on the operation signal and the detection signal input as described above. In addition, a part of the captured image data is rewritten based on an operation signal for performing graffiti processing on the composite image, thereby generating a composite image that is an image obtained by drawing a predetermined image on the composite image. The generated composite image is displayed in the main display / operation unit 62 by being written in the frame buffer. When the image composition as described above is completed, the composite image is then output from the output unit 66 as a photo sticker or the like. The outputted photographic sticker or the like is taken out from an outlet 28 provided on the side surface of the main body 4.

  In addition to the above components, a coin detection unit (not shown) for detecting coins inserted into the coin insertion slot 26 in the main body unit 4 is further provided in the main body unit 4, and the main control unit 80 Based on the detection result of the detection unit, each unit is controlled so as to allow the user U to play with the present photo creation device, such as generation of a composite image by photographing or drawing the captured image for a predetermined time. Since the control operation by the coin control unit and the main control unit 80 based on the detection result is the same as that of the conventional game photo creation device and is well known, detailed description thereof will be omitted.

  The predetermined program executed in the main control device is provided by, for example, a CD-ROM that is a recording medium on which the program is recorded. That is, a CD-ROM serving as a recording medium for the predetermined program is mounted on a CD-ROM driving device built in the main control device as an auxiliary storage device, and the predetermined program is read from the CD-ROM to be an auxiliary storage device. Installed on the hard disk device. Then, when a predetermined operation for starting up the present photo creating device is performed, the predetermined program installed in the hard disk device is transferred to the memory in the main control device and temporarily stored therein, and the main control It is executed by the CPU in the apparatus. Thereby, control of each part and image processing by the main controller are realized.

<4. Operation>
As described above, the operation of the main control unit 80 in the present embodiment is realized by executing the predetermined program by the internal CPU. FIG. 6 is a flowchart showing the operation of the main control unit 80 realized in this way. In the present embodiment, when a predetermined coin is inserted into the coin insertion slot 26, the main control unit 80 (main control device) operates as follows.

  First, the main control unit 80 performs initialization processing of the apparatus, that is, initialization of each hardware and initialization processing of data stored in the main control unit 80 as a set value, and further for predetermined shooting. A timer is set so that a time-out occurs after the elapse of time (hereinafter referred to as “shooting time”), and the timer is started (step S10).

  Next, the main control unit 80 performs a photographing process for photographing the user U (step S20). Detailed processing (subroutine) of this photographing processing will be described. FIG. 7 is a flowchart showing the procedure of this subroutine.

  First, the main control unit 80 causes the user U to select one of a plurality of background images stored as image files in the auxiliary storage device in advance when a predetermined operation described later is performed by the user U. Input request (hereinafter referred to as “selection menu”) is displayed on the background display unit 64, and any of the background images is selected by a selection operation described later of the user U (held handheld input device 40). (Step S210). When the above operation by the user U is not performed, the processing here is omitted and the selection menu is not displayed. Hereinafter, the display and the selection operation will be specifically described with reference to FIG.

  FIG. 8 is a schematic diagram illustrating a display example of the LED display device 101. More specifically, FIG. 8A is a display example when a selection menu is displayed, and FIG. 8B is a selection menu. It is a display example when is not displayed. It is assumed that a predetermined initial background image is selected until a background image is selected by the user U. Here, the background image shown in FIG. 8B is an initial background image. To do.

  Referring to FIG. 8A, a selection menu 111 listing character strings (or reduced images of the background images) describing the plurality of background images is displayed near the center on the right side of the figure. The person U selects a character string corresponding to a desired background image from these character strings. The operation of the user U causing the selection menu to appear (pop-up) or to be deleted (closed) is performed by a menu switch for receiving the operation among a plurality of switches built in the handheld input device 40. The operation of the user U for selecting a desired background image is performed by a selection switch for receiving the operation among a plurality of switches built in the handheld input device 40.

  Instead of the selection by the selection switch, the background image may be selected based on the light source of the handheld input device 40 and the position of the handheld input device 40 detected by the light detection device 102. That is, by detecting the position of the handheld input device 40 in the front-rear direction (that is, the direction perpendicular to the display surface of the LED display device 101), when the distance from the LED display device 101 becomes very close, the handheld input device 40 The coordinate of the selection menu corresponding to the position in the horizontal direction and the vertical direction (left and right direction and up and down direction) is acquired, and the background image indicated by the character string displayed at the position corresponding to this coordinate is selected. Good. Such an operation can be realized by an operation in which the user U brings the handheld input device 40 closer to the LED display device 101.

  Next, the main control unit 80 causes the background display unit 64 to display the selected background image (step S220). Specifically, the main control unit 80 converts an image file indicating a background image into an image signal and gives the image signal to the LED display device 101, and the LED display device 101 displays the background image. It is assumed that the background image displayed here reflects the editing result when editing as described later (for example, editing in which a part of the image is moved) is performed.

  Subsequently, the main control unit 80 selects an image (hereinafter referred to as “movable image”) whose display position can be changed (moved) to an arbitrary position by an operation of the user U among images included in the background image. Whether or not it has been determined is determined by the position of the handheld input device 40 (step S230). The background image is a combination of a basic background image (for example, an image such as a landscape or a pattern) that constitutes a basic background and one or more movable images (for example, an image such as the sun or a fence). The position (coordinates) information at which the movable image is to be synthesized is predetermined in relation to the background image, and can be changed as appropriate. If a movable image is selected, the process proceeds to the next step S240. If not selected, the process of step S240 is omitted, and the process proceeds to step S250.

  In step S240, the main control unit 80 displays the selected movable image on the background display unit 64 in accordance with the editing operation (position designation operation) of the user U by the handheld input device 40. Hereinafter, the edit operation for selecting and moving the movable image will be specifically described with reference to FIG.

  FIG. 9 is a diagram for describing an editing operation for selecting and moving a movable image. More specifically, FIG. 9A is a diagram illustrating a state when a movable image is selected. (B) is a figure which shows a state when the movement of a movable image is completed.

  Referring to FIG. 9A, the user U performs an operation of bringing the handheld input device 40 held with the right hand closer to an image representing the sun that is a movable image in the background image. Here, by detecting the position of the handheld input device 40 in the front-rear direction, when the distance from the LED display device 101 becomes very close, the horizontal direction and the vertical direction of the handheld input device 40 (left-right direction and up-down direction). The coordinates of the image corresponding to the position are acquired, and the movable image displayed at the position corresponding to the coordinates is selected. By this selection operation, the image representing the sun which is the movable image is in a selected state, and the movable image 112 being selected indicated by a dotted line in the figure is in a state different from the normal display state, for example, blinking or lightened in color. Is displayed. This selection operation may be performed by a selection switch built in the handheld input device 40. The selected movable image 112 thus selected is displayed in real time so as to move in accordance with the position of the handheld input device 40 in the horizontal direction and vertical direction (left and right direction and up and down direction). Therefore, if the handheld input device 40 is moved in the direction of the one-dot chain line shown in FIG. 9A (that is, from right to left in the figure), the position at which the selected movable image 112 is displayed moves according to the change in position. To do. Thereafter, when an operation for completing the movement of the selected movable image, for example, an operation similar to the above selection operation or an operation for stopping the movement for a predetermined time is performed, the selected movable image 112 is released from the selected state. It is displayed in the normal display state as the movable image 113 at the time of non-selection shown in 9 (b).

  Since the movable image can be moved to a desired position in this way, a background image rich in changes according to the preference of the user U can be generated from the predetermined background image. Further, unlike editing on a small screen of the liquid crystal touch panel 20 (or preview monitor 22), the user U edits a background image displayed in a size that should be actually captured by the LED display device 101. Can do. Therefore, high playability or entertainment can be obtained, and a photographed image to be obtained by photographing (a background image appears behind the user U) can be easily estimated before photographing. A captured image including a background along the line can be obtained. Furthermore, since the user U can edit the background image while facing the LED display device 101, high playability or entertainment can be obtained, and the editing operation can be performed intuitively so that the editing operation is easy. It becomes.

  Here, the editing mode in which the movable image is moved is illustrated as the editing operation. However, the editing mode is not limited as long as the editing is performed on the background image. For example, an image that changes the entire background image, the color tone of the movable image, a stamp image corresponding to the graffiti process, or a predetermined (virtual) graffiti pen trajectory image corresponding to the position of the handheld input device 40 is further included. A mode of generating a background image as if it was doodled by combining the images may be used.

  FIG. 10 is a diagram illustrating an example of a background image generated by the editing operation as described above. As described above, the user U can appropriately edit the background image so as to obtain a desired background.

  Next, the main control unit 80 determines whether or not a shutter button (not shown) or a shutter button displayed on the screen of the main display / operation unit 62 has been pressed based on the operation signal (step S250). If the shutter button has been pressed, the process proceeds to the next step S260. If not, the process returns to step S210 and the above process is repeated until the shutter button is pressed (S210 → S220 → S230 → S240 → S250 → S210). Note that when the shooting time ends without the shutter button being pressed, the processing when the shutter button is pressed is automatically performed.

  When the shutter button is pressed, the main control unit 80 informs the user of the start of shooting on the screen of the main display / operation unit 62 and takes a picture on the imaging unit (camera) 52 after a predetermined time of about several seconds elapses. Send a signal (shutter signal). Thereby, in synchronization with the shutter operation of the imaging unit 52, the illumination unit (flash) 70 emits flash light, and the main control unit 80 starts the capture process. That is, the main control unit 80 receives the image signal output from the imaging unit 52 as a signal representing the captured image of the user U illuminated by the flash from the illumination unit (flash) 70, and stores it in the memory or the auxiliary storage device. The captured image is stored as an image file (step S260). Note that the capture process is executed each time the shutter button is pressed during a predetermined shooting time, and the shot image is temporarily saved as an image file.

  Further, the main control unit 80 determines which background image stored in the auxiliary storage device is the background image displayed on the background display unit 64 when a shooting signal (shutter signal) is sent to the imaging unit (camera) 52. For example, by a file name and the like, and information indicating editing contents (for example, coordinates indicating which movable image is moved to which position) for the background image is also stored (step S270). Note that only the edited background image may be stored, but it is preferable that the edited background image be stored again in the subsequent graffiti process (step S40).

  When the above subroutine processing is completed, the processing returns to the processing shown in FIG. 6, and then the main control unit 80 finishes shooting due to the timer indicating the shooting time being timed out or before the shooting time elapses. However, it is determined whether or not the photographing is finished by performing an operation for instructing the main display / operation unit 62 to finish the photographing process (step S30). When the shooting is finished, the process proceeds to the next step S40. If shooting is not completed, the process returns to step S20, and the above process is repeated until shooting is completed (S20 → S30 → S20).

  When shooting is finished, the main control unit 80 accepts an operation by the user U for graffiti, and graffiti processing including image processing according to the operation is performed (step S40). This graffiti process is provided with a predetermined time limit, and the virtual graffiti of the user U with respect to the captured image or the composite image is received within this time limit. Specifically, a stamp image or a predetermined (virtual) graffiti arranged at a predetermined position on the plurality of photographed images or composite images displayed on the main display / operation unit 62 based on the operation of the user U. By further synthesizing a pen trajectory image or the like, a composite image as if it was doodled is generated. In addition, an operation for re-editing the background image after editing may be accepted. Specifically, the changed background image may be combined with the corresponding photographed image area by changing again the information indicating the editing content of the background image (typically, coordinate information of the movable image). . An operation of discarding the background image and recombining the background image different from the background image with the captured image may be accepted. This graffiti process is performed until the time limit elapses or until the graffiti is stopped (or the start of printing is instructed) by the operation on the main display / operation unit 62 before the time limit elapses.

  Next, in the printing process in step S50, upon receiving an operation signal indicating a print instruction, the main control unit 80 outputs an output of a composite image displayed on the main display / operation unit 62 based on the operation signal. The unit (printer) 66 is instructed. As a result, the printer as the output unit 66 outputs the composite image as a photo sticker. As a result, the printing process ends. The outputted photo sticker is taken out by a user U from an outlet 28 provided on the side surface of the main body 4. When this printing process is finished, all the processes are finished, and a standby state is entered until a coin corresponding to a predetermined amount is newly inserted into the coin insertion slot 26. In this standby state, when a coin corresponding to a predetermined amount is newly inserted, the same processing (steps S10 to S50) as described above is executed, and then the process returns to step S10 again.

<5. Effect>
As described above, according to the present embodiment, the LED display device 101 displays a background image for the user U and receives an editing operation for the background image. Thus, unlike editing on a small screen such as a commonly used liquid crystal touch panel, the user can edit while viewing a background image displayed in a size that should actually be taken. it can. Therefore, high playability or amusement can be obtained, and a captured image to be obtained can be easily estimated before shooting, so that a captured image including a background according to the user's intention can be obtained.

<6. Modification>
In the above embodiment, the position of the light source of the handheld input device 40 is calculated based on the detection results of the light detection devices 102L and 102R as light detection means. For example, infrared light detection means (infrared light) An optical sensor) may be provided, and the position of a handheld input device having an infrared light source may be calculated based on the detection result. Further, in place of such light detection means, a sound wave or radio wave detection means (microphone, ultrasonic sensor, radio wave sensor or the like) is provided to calculate the position of a handheld input device having a sound source or radio wave source. May be. In this case, it is possible to use a method in which a plurality of the sound wave and radio wave detection means are arranged at a predetermined interval from each other and the position of the sound source or radio wave source is calculated based on the phase difference of the sound wave or radio wave detected by them. it can. Furthermore, in the above-described embodiment, the position information of the handheld input device (attribute information conceptually) includes a light source (including not only visible light but also light source of invisible light such as infrared light), transmission of radio waves. Source, or position information of sound sources (including not only audible sounds but also non-audible sounds such as ultrasonic waves) sound source (a wave source that emits waves propagating through space), and a wave source from which the position information should be obtained However, the wave source type may be changed by a user operation or the like. In this way, since the handheld input device emits light or sound according to the selection of the user U, playability or entertainment can be enhanced.

  In the above embodiment, the light detection devices 102L and 102R are provided near the center of both sides of the LED display device 101 in the automatic photo creation device, and the light source of the handheld input device is based on the detection values of the light detection devices 102L and 102R. However, instead of this, a predetermined wave source (such as a light source, a sound source, or a radio wave source) is provided in the vicinity of both sides of the LED display device 101, and is carried by the user U and is used by the user U. You may make it provide the detection apparatus of the said wave source which can be arrange | positioned in the arbitrary positions in the predetermined space of the vicinity. The detection value detected by the detection device is input to the main control unit 80 via a predetermined signal line, and the position of the handheld detection device is calculated based on the detection value.

  In the above embodiment, the coordinates indicated by the user U are received by the light detection device and the light detection means, but an edit position for performing an edit operation on the background image projected on the LED display device 101 or the like is acquired. However, the configuration is not limited to the above configuration. For example, a contact sensor, a proximity sensor, or the like is arranged on the surface or inside of the LED display device 101, and the user U can arbitrarily select the LED display device 101. When a hand or an object is brought into contact with or close to the position, the position may be detected. The physical action to be given to the display surface of the LED display device 101 is any as long as it can discriminate a position where a physical action such as light irradiation is given in addition to contact or proximity of a hand or the like. It may be something like this. Further, by distinguishing the feature points such as the light source (of the handheld input device 40) and the user U's hand that are gripped by the user U based on a known image recognition technique, the feature points and the LED display device 101 The position of the feature point may be calculated based on the positional relationship. Furthermore, a pointing device (for example, a trackball or a joystick) that is carried by the user U and can be placed at any position in a predetermined space near the user U is provided, and an LED display is displayed according to the operation of the pointing device. Editing may be performed based on the position of the cursor displayed on the device 101. Furthermore, since the editing operation does not necessarily have to be performed facing the LED display device 101, the operation unit is not limited as long as it is an operation unit for editing a background image. For example, instead of the handheld input device 40, the operation means may be the liquid crystal touch panel 20 and the touch pen 21, or a newly provided liquid crystal touch panel or other input device. Here, when there are two or more users, it is also conceivable that, for example, a certain user performs an editing operation using the operation means, and the remaining users stand in front of the LED display device 101. In this case, the user who performs the editing operation can easily guess the captured image including the image of the user standing against the background before shooting, and all the users are displayed on the LED display device 101. This makes it easy to communicate with each other.

  The LED display device 101 in the one embodiment is sufficient if it is a display device that can display a background image. For example, a display device including a projector and a screen, a display device in which light emitting parts such as light bulbs are arranged in a matrix, an inorganic device It may be a display device using an EL (Electro Luminescence) element or an organic EL element, a liquid crystal display, or a plasma display.

  Of the background image in the above-described embodiment, a region of a portion overlapping with the image showing the user U is hidden behind the user and is not photographed.However, a part of the background image is a foreground image, The foreground image may be combined with the captured image so as to hide the image area indicating the overlapping user U. That is, the background image in the one embodiment may include a foreground image in the composite image. Note that the operation of the user U for selecting the foreground image from the background image may be performed during the photographing process in step S20 or may be performed during the graffiti process in step S40. FIG. 11 is a diagram illustrating an example of a composite image when such a background image includes a foreground image. The fence 114 shown in the figure is displayed on the LED display device 101 as a background image hidden behind the user U at the time of shooting (for example, as shown in FIG. 10 when viewed from the main body unit 4). As a result of the fence 114 being synthesized as a foreground image, a synthesized image as shown in FIG. 11 is obtained. As described above, a part of the background image can be set as the foreground image according to the preference of the user U, so that the playability or entertainment of the present apparatus can be enhanced.

It is a side view of the photo creation apparatus for play concerning one embodiment of the present invention. It is a front view which shows the main-body part of the photo production apparatus for play which concerns on one Embodiment. It is the figure which looked at the LED display apparatus and its vicinity of the photo production apparatus for play which concern on one Embodiment from the front. It is a figure showing an example of 1 composition of a photodetection device in one embodiment. It is a block diagram which shows the structure which looked at the principal part of the photo production apparatus for play which concerns on one Embodiment from the functional surface. It is a flowchart for demonstrating operation | movement of the main-control part in the photo production apparatus for play which concerns on one Embodiment. It is a flowchart which shows the procedure of the imaging | photography process in one Embodiment. It is a schematic diagram which shows the example of a display of the LED display apparatus in one Embodiment. FIG. 10 is a diagram for describing an editing operation for selecting and moving a movable image in one embodiment. In one embodiment, it is a figure which shows the example of the background image produced | generated by predetermined | prescribed editing operation. In one embodiment, it is a figure which shows the example of a synthesized image in case a foreground image is contained in a background image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 2 ... Shooting room 4 ... Main-body part 10 ... Camera 11,102 ... Flash 20 ... Liquid crystal touch panel 21 ... Touch pen 40 ... Handheld input device 52 ... Imaging part (camera)
54 ... Confirmation display (preview monitor)
62 ... Operation unit (LCD touch panel)
64 ... Background display section (LED display device)
66 ... Output unit (printer)
70: Illumination unit 72: I / O control unit (I / O control device)
80: Main control unit (main control device)
91 .. Photodetector (photodetector)
92 ... Hand-held input unit (hand-held input device)
DESCRIPTION OF SYMBOLS 101 ... LED display apparatus 102 ... Photodetection apparatus U ... User

Claims (5)

An image capturing unit that captures an image of a user who is a subject in a predetermined image capturing area, an illumination unit that illuminates the subject by emitting a flash when image capturing is performed by the image capturing unit, and a composite image including a captured image obtained by the image capturing unit. An automatic photo creation device comprising output means for outputting an image as a photograph,
A background presenting means for displaying an image to be used as a background on the display surface, the display surface being disposed behind the user so as to face the photographing means;
Input means for accepting an operation by the user for editing an image displayed on the display surface of the background presenting means on the display surface;
In response to an operation by the user accepted by the input means, the image processing means for newly generating an image to be the background by editing the image to be the background, and
The background presenting means displays an image to be a background newly generated by the image processing means on the display surface,
The input means includes a predetermined input device that is carried by the user and can be arranged at an arbitrary position in a predetermined space near the background presentation means, and the position of the display surface of the background presentation means and the input device Accepts a position designation operation by the user based on the relationship;
The automatic photographing apparatus characterized in that the photographing unit photographs together with the user an image to be displayed as a background displayed on the display surface as a subject. The background presentation means displays an image to be a background and an image to be a foreground on the display surface,
2. The automatic photo creation apparatus according to claim 1, wherein the image processing unit generates the composite image by combining the image to be the foreground with the captured image as a foreground.   2. The automatic photo creation apparatus according to claim 1, wherein the input unit receives a position designation operation by the user based on a physical action on the display surface of the background presentation unit. The input device is a light source;
The input means further includes a light detection device provided near an end of the display surface, and receives a position specifying operation by the user by detecting the position of the light source with respect to the display surface by the light detection device. The automatic photo creating apparatus according to claim 1, wherein: Obtained in a photographing step for photographing a user who is a subject in a predetermined photographing region by a predetermined photographing means, an illumination step for illuminating the subject by emitting a flash during photographing in the photographing step, and the photographing step. An automatic photo creation method including a printing step of printing a composite image including a photographed image as a photo,
A background presentation step of displaying an image to be used as a background on a display surface disposed behind the user so as to face the photographing unit;
An input step of accepting an operation by the user for editing an image displayed on the display surface on the display surface;
An image processing step for generating an image to be newly set as a background by editing the image to be set as the background in response to an operation by the user accepted in the input step,
In the background presentation step, an image to be newly generated in the image processing step is displayed on the display surface,
In the input step, a position designation operation by the user based on a positional relationship between a predetermined input device that is carried by the user and can be arranged at an arbitrary position in a predetermined space near the background presentation means and the display surface is performed. Reception In the photographing step, together with the user, an image to be used as a background displayed on the display surface is photographed as a subject, and an automatic photo creation method is characterized.

Images