JP5482830B2 - Photo sticker creation apparatus, photo sticker creation method, and program - Google Patents

Description

  The present invention relates to a photo sticker creation apparatus, a photo sticker creation method, and a program, and in particular, a photograph that can present to a user a range where image processing of a face portion is performed in a photographed image obtained by photographing. The present invention relates to a sticker creating apparatus, a photo sticker creating method, and a program.

  Conventionally, a user (subject) is photographed, and a graffiti editing process is performed in which a prepared image is combined with the obtained photographed image or a character or a line drawing is superimposed, printed on sticker paper, and a photo sticker There is a photographic seal machine provided to users.

  This photo sticker is installed, for example, in an entertainment (game) facility such as a game center, and provides services mainly to high school girls and female junior high school students for a fee. Users can not only enjoy creating photo stickers as a game, but also cut out photo stickers with edited images printed in various sizes and paste them on their belongings. I collect a lot of sticker papers and paste them on a notebook etc. to carry them like an album. The notebook is referred to as a pre-book among users such as high school girls.

  The game for creating a photo sticker is performed in a series of steps of photographing a subject (user himself), editing a graffiti on the photographed image, and printing and outputting the edited image on a photo sticker. The user plays this series of processes within the time limit, and receives a photo sticker created as a product. Therefore, in order to improve user satisfaction, it is important to improve the fun of the photo sticker creation work as well as to improve the quality of the photo sticker.

  Therefore, in order to provide a photo sticker that is more satisfying for the user, in recent photo stickers, whether or not the correction is made or the range of the moving image (live view image) that is confirmed by the user who is the subject at the time of shooting. Diversification of functions at the time of shooting, such as instructing the user and guiding the user to the standing position.

  Specifically, for example, a function has been proposed in which a user himself selects and corrects a portion to be corrected for a live view image at the time of shooting (see Patent Document 1). In addition, for example, a function for guiding a standing position for photographing for each user has been proposed so that a plurality of users can evenly photograph a plurality of photographed images (see Patent Document 2). Furthermore, for example, a function has been proposed in which a trimming frame is displayed when a live view image is displayed, and a captured image obtained by combining an image trimmed with the frame with a compositing image is obtained (see Patent Document 3).

  In the field of cameras and video cameras, for example, a video camera that displays a face frame so that the face part that is the subject can be recognized, or when a face recognition part is cut out from a captured image, An image processing apparatus for displaying has been proposed. Furthermore, a camera has been proposed in which a shutter is provided when the smile level of a face-recognized portion exceeds a predetermined value.

JP 2005-277772 A Japanese Patent No. 3801147 JP 2008-79273 A

  However, in the case of the photographic sticker described in Patent Document 1, the user has to specify the part to be corrected, and the operation is troublesome. In addition, in the case of the photo sticker described in Patent Document 2, it is necessary to perform shooting while alternately checking the standing position and the shooting monitor, and if the number of shots increases, the position is checked in a narrow shooting space. Multiple people go back and forth.

  Furthermore, in the case of the photographic sticker described in Patent Document 3, the trimmed image can be combined with the image for composition, but when the live view image is displayed, only the trimmed portion is displayed in an enlarged manner. Further, when combining, it is necessary to insert and combine the subjects one by one, and it takes time to generate one photographed image.

  The present invention has been made in view of such a situation, and makes it possible to present to a user a range in which image processing of a face portion is performed in a photographed image obtained by photographing.

Photo sticker creation device which is an aspect of the present invention is a range to recognize the face of the user and photographing means, in the user's shooting moving images captured by the imaging means for photographing the user, In addition, at least one of a frame and a region indicating a target range, which is a range where image processing is performed on the user's captured moving image and captured still image, is superimposed on the captured moving image or the image-processed moving image. Display control means for controlling the display unit to display in real time; storage means for storing the user 's photographed still image photographed by the photographing means at a predetermined timing; and the target range of the photographed moving image in, recognizing the face recognition means the face of the user, the shooting moving images of the target range the user's face is recognized by the image processing by the face recognition unit, said image processing Generates a saw moving image, said image processing the captured still image within the target range, image processing means for generating image processed still image, the synthesis image for synthesizing with the image processed moving image, a subject Selection means for selecting an image for sample synthesis in which an alternative model is arranged, and the image processing of the target range in which the user's face is recognized according to the size of the model in the image for sample synthesis A moving image is scaled, the scaled moving image of the target range is synthesized with the synthesis image corresponding to the sample synthesis image selected by the selection unit, and the synthesized video Combining processing means for generating, editing means for performing a predetermined editing process on the image-processed still image to generate an edited image, and output means for outputting the edited image, The display control means is the same display unit or other display unit as the synthesized moving image synthesized by the synthesis processing unit for the captured moving image of the target range in which the user's face is recognized by the face recognizing unit. To display in real time.

  The photographing means of this photo sticker creating apparatus is constituted by, for example, a camera, the display control means is constituted by, for example, a display control section, the image processing means is constituted by, for example, an image processing section, and the editing means is, for example, The editing unit is configured, and the output unit is configured by a print processing unit, for example. The face recognition means of this photo sticker creating apparatus is constituted by, for example, a face image recognition unit. The selection means of this photo sticker creating apparatus is constituted by, for example, an operation input processing section, and the composition processing means is constituted by, for example, a composition processing section.

In the photo sticker creating apparatus according to one aspect of the present invention, a user is photographed and is in a range where the user's face is recognized in a photographed moving image of the photographed subject, and the photographed moving image of the user At least one of a frame line and a region indicating a target range, which is a range where image processing is performed on an image and a captured still image, is superimposed on the captured moving image or the image processed moving image and displayed on the display unit in real time Be controlled. Further, at a predetermined timing, stored captured still image of the captured user, the scope of shooting a moving image, is recognized face of the user, capturing a moving image of the target range the user's face is recognized Is processed to generate an image processed moving image, a captured still image in the target range is processed, and an image processed still image is generated. Also, a sample synthesis image in which a model instead of the subject is arranged is selected as a synthesis image to be synthesized with the image processed moving image, and the user's face is selected according to the size of the model in the sample synthesis image. The image processed moving image in the target range in which the image is recognized is scaled, and the scaled image processed moving image in the target range is combined with the synthesis image corresponding to the sample synthesis image selected by the selection unit Thus, a synthesized moving image is generated. Further, a predetermined editing process is performed on the image-processed still image to generate an edited image, and the edited image is output. Then, control is performed so that the captured moving image in the target range in which the user's face is recognized is displayed in real time on the same display unit or another display unit as the combined synthesized moving image.

  Thereby, the user can instantly understand which part of the captured image is subjected to image processing. Alternatively, the user can be guided into the frame line. Accordingly, the user can obtain an image that has been subjected to image processing and a sticker on which the image is printed without taking time, and thus improvement in user satisfaction can be expected.

  As a result, the user can feel as if the image on the display unit is the same as the real image.

  Thereby, the user can instantly understand which part of the captured image is recognized as a face and is subjected to image processing.

  As a result, the user can take a picture while viewing the actual image and the composite image.

The synthesis processing means scales the image-processed still image in the target range in which the user's face is recognized according to the size of the model in the sample synthesis image, and scales the target. a range wherein the image processed still image, by combining with the synthesis image, synthesized still image to generate said editing means, generating the edited image is subjected to predetermined editing process on the synthetic still image can do.

  When there are a plurality of target ranges, the display control means can perform control so that at least one of a frame line and a region indicating the target range is displayed on the display unit by a different display method for each target range.

  Thereby, even if there are a plurality of users, the user can be guided to a predetermined position without going back and forth in the imaging space.

  The display control means can control to display at least one of a frame line and a region indicating the target range on the display unit using different display methods according to the number of photographing counts.

  This makes it possible for the user to be aware that shooting is immediate.

The photo sticker creating method according to one aspect of the present invention is a photo sticker creating method of a photo sticker creating apparatus for creating a photo sticker, a photographing step of photographing a user by the photo sticker creating apparatus, and the use of the photographed use a range recognizes the face of the user in capturing a moving image of the user in capturing a moving image of the user, and is the range for performing image processing on captured moving image and capturing a still image of the user A display control step for controlling at least one of a frame line and a region indicating an image processing target range to be superimposed on the captured moving image or the image-processed moving image and displayed on the display unit in real time; and at a predetermined timing a storage step of storing the captured still image of the user taken by the processing of the photographing step, the target range of the photographed moving image Oite, wherein the user's face recognizing facial recognition step, the captured video image of the target range the user's face is recognized by the processing of the face recognition step and image processing, the image processed moving image Image processing step for generating a still image after image processing by processing a captured still image in the target range, and a composition image for combining with the image processed moving image, instead of the subject. A selection step of selecting a sample synthesis image in which a model is arranged, and the image-processed moving image in the target range in which the user's face is recognized according to the size of the model in the sample synthesis image. The image processed moving image of the target range that has been scaled and scaled, and the synthesis image corresponding to the sample synthesis image selected by the processing of the selection step, And a composite processing step for generating a composite moving image, an editing step for performing a predetermined editing process on the image-processed still image to generate an edited image, and an output step for outputting the edited image In the display control step, the same display as the synthesized moving image synthesized by the process of the synthesizing step is performed on the captured moving image of the target range in which the user's face is recognized by the process of the face recognizing step. Control to display in real time on the display unit or other display unit.

According to another aspect of the present invention, there is provided a program for controlling a photo sticker creating apparatus that creates a photo sticker, a shooting step for shooting a user, and a user 's shooting moving image of the user . A frame line indicating a target range of image processing that is a range in which the user's face is recognized in a captured moving image and is a range in which image processing is performed on the user's captured moving image and captured still image A display control step for controlling at least one of the areas to be superimposed on the captured moving image or the processed moving image and displayed on the display unit in real time, and at a predetermined timing, the region was captured by the processing of the capturing step a storage step of storing the captured still image of the user, in the target range of the photographed moving image, recognizes the face of the user Kao認A step, said face imaging moving image of the target range the user's face is recognized by image processing by the processing of the recognition step, to generate the image processed moving image, the captured still image of the target range image processed and an image processing step of generating an image processed still image, the synthesis image for synthesizing the image processed moving image, selection for selecting a model arranged sample images to be combined in place of the subject And scaling the image-processed moving image of the target range in which the user's face is recognized according to the size of the model in the sample composition image, and scaling the scaled target range of the target range A synthesis processing step for synthesizing the image processed moving image and the synthesis image corresponding to the sample synthesis image selected by the processing of the selection step to generate a synthesized moving image. An edit step for performing a predetermined editing process on the image-processed still image to generate an edited image, and an output step for outputting the edited image. In the display control step, the face recognition The captured moving image in the target range in which the user's face is recognized by the processing of the step is displayed in real time on the same display unit or other display unit as the synthesized moving image synthesized by the processing of the synthesizing step. The photographic sticker creating apparatus is caused to execute a process for controlling the photographic sticker.

  This program is recorded on a predetermined recording medium, read by a drive, for example, and installed in the photo sticker creating apparatus. Recording media include magnetic disks made of floppy (registered trademark) disks, optical disks made of CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc), MD (Mini Disc) (registered trademark), etc. And a removable medium such as a semiconductor memory.

  According to one aspect of the present invention, it is possible to display the target range of image processing in a captured moving image on the display unit in real time by superimposing the captured image on the captured moving image. In particular, the user can clearly grasp the face recognition result.

It is a perspective view which shows the structural example of the photograph sticker production apparatus to which this invention is applied. It is the perspective view which looked at the photo sticker production apparatus of FIG. 1 from another angle. It is a perspective view which shows the example of installation of the photograph sticker production apparatus of FIG. It is a figure explaining the user's space movement in a photograph sticker creation apparatus. It is a figure which shows the structural example of the front of the front unit of an imaging | photography unit. It is a figure which shows the structural example of the front of the back unit of an imaging | photography unit. It is a figure which shows the structural example of the side surface of an edit unit. It is a figure which shows the structural example of the other side of an edit unit. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of the control part of FIG. It is a functional block diagram which shows the detailed structural example of the imaging | photography process part of FIG. It is a flowchart explaining a photograph sticker creation game process. It is a flowchart explaining a live view imaging process. It is a figure which shows the example of a display of a live view screen. It is a figure which shows the example of a display of the operation screen in a live view imaging | photography process. It is a flowchart explaining the display process of a live view screen. It is a figure which shows the example of a display of the image for sample synthesis | combination, and a live view screen. It is a figure which shows the example of a display of the image for sample synthesis | combination, and a live view screen. It is a figure which shows the example of a display of a live view screen. It is a flowchart explaining the display process of a live view screen. It is a figure which shows the example of a display of the image in the display process of a live view screen. It is a figure which shows the example of a display of a live view screen. It is a figure which shows the example of a display of the image in the display process of a live view screen. It is a figure which shows the example of a display of a live view screen.

  Hereinafter, a photo sticker creating apparatus 1 according to an embodiment of the present invention will be described in detail with reference to the drawings.

  The photo sticker creating apparatus 1 enhances the entertainment of shooting and editing operations, and allows the user to execute those operations as a game (play service), and the shot / edited images are stored in a photo sticker and a photo sticker notebook. It is a game device (play service providing device) that is provided to the user as a page or data and receives the consideration from the user.

  Here, terms such as a user in this specification are defined.

  A user refers to a person who plays a game on the photo sticker creating apparatus 1. The user group refers to a group of one or more users who are accompanied by each process of the game (photographing, editing, etc. described later) in the photo sticker creating apparatus 1. Therefore, the term “user group” may refer to a single user, or may refer to two or more users. However, it is usually assumed that there are about 2 to 4 user groups due to restrictions such as shooting space and editing space.

  In the photo sticker creation game executed by the photo sticker creation device 1, the user group (which may be one person or two or more persons as described above) determines the price of the game. Shoot the subject as a subject, select one or more images to be edited (images to be edited) from one or more of the resulting images, and edit them sequentially Makes the captured image rich (edited image) by editing it using the editing function (graffiti editing function) that combines the frame image that is the background and foreground as the target image, the handwritten line drawing, and the stamp image. . After the game ends, the user group receives a photo sticker or the like on which the edited image is printed as a product.

  The photo sticker creating apparatus 1 is usually installed in a game center or a store in a sightseeing spot. The manager who installed the photo sticker creating apparatus 1 manages and operates the photo sticker creating apparatus 1 to allow a user represented by a female junior high school student to play a photo sticker creating game for a fee, and to make a profit by the fee. Therefore, the high profit rate of the photo sticker creating apparatus 1 is important for managers of stores and the like.

  That is, it is desirable that the photo sticker creating apparatus 1 has a high rate of return per unit time. Moreover, in the case of a normal store, the installation place of the photograph sticker production apparatus 1 is limited by restrictions, such as a floor area and a structure. Therefore, it is desirable that the photo sticker creating apparatus 1 has a high profit rate per unit floor area. Furthermore, since the size and shape of each store are not usually the same, and other game machines and the like installed together with the photo sticker creating apparatus 1 are also different, the higher the degree of freedom of the installation location, the better. Furthermore, it is desirable for the user to use it repeatedly several times.

  As a method of improving the profit rate, for example, it is necessary to improve the rotation rate of the photo sticker creation game. That is, the rate of return per unit time is increased by increasing the number of games played within a predetermined time. However, if there is no user who plays the photo sticker creation game, the profitability will not improve. That is, it is also important to improve the user's expectation and satisfaction with respect to the photo sticker creation game of the photo sticker creation device 1.

  For example, the photo sticker creating apparatus 1 can increase the number of users by providing a function with high expectation that a person who has never played a photo sticker creating game will want to play. Further, by providing a function with a high degree of satisfaction that the user who played has thought that “it was fun, I would like to play again”, the photo sticker creating apparatus 1 increases the number of regular users, so-called repeaters, The number can be further increased. That is, the profit of the photo sticker creating apparatus 1 is improved.

  For the user group, in the photo sticker creation game by the photo sticker creation device 1, the photographer creates a subject, performs graffiti editing on the photographed image, and obtains a photo sticker or the like as a product. There is sex.

  Examples of methods for improving the amusement of the photo sticker creation game include an improvement in image quality of the photographing function, a multifunctional editing function such as graffiti, an improvement in operability, and adjustment of play time and waiting time.

  Examples of methods for improving user satisfaction with photo stickers include improved hardware such as improved quality of sticker paper, high-quality printing, special color printing, and the size of edited images on photo stickers. It is possible to devise the arrangement.

  Girls junior high and high school students who are assumed to be the main users not only stick the obtained photo sticker to their property, but also exchange the photo sticker or talk about the photo sticker as a topic. Therefore, for example, when the image content of a photo sticker is flashy, interesting, scarce, or novel, the user not only likes the image himself, but also uses the photo sticker as a topic. We can expect conversation to be exciting.

  In addition, by using such a photo sticker, it can be expected that the photo sticker itself also serves as an advertisement for the photo sticker creating apparatus 1. Therefore, improving the amusement of photo stickers not only improves the satisfaction of the user, but also increases the expectations of others, attracting customers due to the spread of reputation, that is, new users by so-called word-of-mouth Can be expected to increase.

  In other words, in the photo sticker creation game, by providing a function that can create an image that users will like, not only the satisfaction of the user with the photo sticker creation game but also the satisfaction with the photo sticker can be improved. Furthermore, the topicality of the photo sticker and the advertising effect can be improved at the same time.

  The photo sticker creating apparatus 1 will be specifically described. FIG. 1 is a perspective view showing an external appearance of a photographic sticker creating apparatus 1.

  As shown in FIG. 1, the photo sticker creating apparatus 1 is roughly divided into a photographing unit 12, an editing unit 13, a ceiling lighting unit 14, and a background curtain unit 15.

  The shooting unit 12 selects a shooting course for the photo sticker creation game, inputs a fee, and guides (explains) the flow and play of the photo sticker creation game with video and audio. After such acceptance, the photographing unit 12 further has a function of photographing a subject (user), and the subject is photographed in an internal space (photographing space 32 (FIG. 4)) described later. Is done.

  The photographing unit 12 includes a front unit 12A and a rear unit 12B.

  The front unit 12A is a unit arranged on the side facing the user (subject) in the shooting space 32, and is configured to receive and take a picture (camera 51, touch panel monitor 52, flashlight 53, etc. (FIG. 5)). Is provided.

  The front unit 12 </ b> A has a milky white acrylic plate 54 formed in a substantially semi-cylindrical curved surface on the front surface, and irradiation light from a lighting device (such as a fluorescent lamp (not shown)) installed on the back of the milky white acrylic plate 54. Is irradiated to the subject. A configuration example of the front unit 12A will be described later with reference to FIG.

  The rear unit 12B is a unit that is arranged behind the user (subject) in the shooting space 32, and is a unit that plays the role of the user when the front unit 12A takes a picture. On the upper part of the rear unit 12B, for example, a background curtain unit 15 composed of a movable curtain (background curtain) used for the background is disposed. A configuration example of the rear unit 12B will be described later with reference to FIG.

  The editing unit 13 is provided with a configuration (for example, a tablet built-in monitor 62, a touch pen 63, etc. (FIG. 7)) for a user group to perform graffiti editing or the like on an edited image. As will be described later with reference to FIG. 7, the editing unit 13 is for performing graffiti editing or the like on each of two opposing faces so that two groups of users can simultaneously perform editing work. A configuration is provided.

  Thereby, the photo sticker creating apparatus 1 can execute a plurality of photo sticker making games in parallel. In other words, a plurality of user groups can play the photo sticker creation game in the photo sticker creation device 1 at the same time. In order to further improve the rotation rate of the photo sticker creation game, the editing unit 13 is subjected to three or more graffiti edits so that two or more user groups can simultaneously perform the graffiti edit. A configuration for this may be provided.

  The ceiling lighting unit 14 is provided above the shooting space 32 and incorporates a flashlight that irradiates flash light toward the shooting space 32 in accordance with the shooting timing. The ceiling lighting unit 14 further includes a lighting device such as a fluorescent lamp, and is configured to constantly illuminate the imaging space 32. Note that the imaging space 32 is simply configured as a closed space, is difficult for light from the outside to enter, tends to be dark, and the operability for the user can be reduced. Therefore, the ceiling illuminating unit 14 can illuminate the shooting space 32 with the built-in lighting device, thereby suppressing a decrease in user operability. Such illumination is also provided in the front unit 12A and the rear unit 12B.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 of FIG. 1 as viewed from the editing unit 13 side.

  The editing unit 13 is installed adjacent to the photographing unit 12 behind the front unit 12A when viewed from the user located in the photographing space 32. A first editing interface 13A and a second editing interface 13B are provided on two sides of the editing unit 13 that are orthogonal to the front unit 12A.

  In other words, the editing unit 13 includes two groups of users who perform a photo sticker creation game in a state where they face each other across the editing unit 13 in a direction perpendicular to the direction connecting the front unit 12A and the rear unit 12B. Two editing interfaces 13A and 13B are provided so that the above can be performed. Details of the configuration of these editing interfaces will also be described later with reference to FIG.

  In addition, a photo sticker discharge unit 13 </ b> C for discharging a photo sticker printed as a result of the photo sticker creation game is provided on the surface of the editing unit 13 facing the photographing unit 12.

  FIG. 3 is an external view showing an installation example of the photo sticker creating apparatus 1.

  When the photo sticker creating apparatus 1 is installed in a game center or the like, for example, as shown in FIG. 3, a shooting space in which a side curtain 21 is provided so as to surround the shooting unit 12 and the editing unit 13 and a shooting operation is performed. 32 and the editing space 33 in which editing work is performed are simply enclosed to improve the closeability of each space. In other words, for example, the side curtain 21 contributes to high-quality shooting and the visibility of the editing screen by stabilizing the environment in each space, or blocks the field of view from outside each space. It is possible to perform operations such as shooting and editing without being conscious of the line of sight from the outside (users of the next user group in standby, etc.).

  The external surface of the side curtain 21 is usually used as a place for advertising the photographic sticker creating apparatus 1 itself, and the model name and model of the photographic sticker creating apparatus 1 are increased so as to attract attention at the place of installation. A flashy design image representing the image is drawn.

  As described above, the photo sticker creating apparatus 1 causes a plurality of user groups to play a photo sticker creating game. In addition, the photo sticker creating apparatus 1 can simultaneously execute a plurality of photo sticker creating games. That is, the photo sticker creating apparatus 1 can cause a plurality of user groups to play a photo sticker creating game at the same time. At this time, each user group performs each work of the photo sticker creation game while moving through a plurality of spaces provided in the photo sticker creation device 1, and advances the game.

  Next, the flow of the photo sticker creating game by the photo sticker creating device 1 and the accompanying movement of the user group space will be described.

  FIG. 4 is a plan view of the user group's space movement during the game as viewed from above the photo sticker creating apparatus 1.

  As shown in FIG. 4, a user group (a user group located in A or A ′) who intends to play the photo sticker creation game has a photographing unit in a standby area 31 outside the photo sticker creation device 1. It is checked whether 12 shooting spaces 32 (space formed between the front unit 12A and the rear unit 12B shown by a dotted line in the drawing) are vacant, and if they are vacant, they enter the shooting space 32 as they are.

  On the other hand, when the shooting unit 12 is used by the previous user group, the camera waits until the shooting space 32 becomes free, the previous user group finishes shooting and moves to the editing unit 13 side, and the shooting space 32 is moved. After vacating, the user group that has been waiting enters the imaging space 32 from the waiting area 31.

  The user group (user group located in B) who entered the shooting space 32 operates the touch panel monitor 52 provided in front of the front unit 12A to accept the process (select course, add option, input price). Etc.) is performed, and a photographing operation (main photographing) is performed in which the subject becomes a subject and performs photographing.

  Instead of performing the receiving process in the imaging space 32, the receiving process may be performed in the standby area 31. In this case, for example, a user interface for receiving processing may be provided on the side surface of the front unit 12A.

  The user group that has finished photographing is prompted to select a plurality of editing target images to be sent to the subsequent stage in order to make them the subject of editing processing and printing processing. After this selection, according to the movement guide displayed on the touch panel monitor 52, the first editing space 33A (the first editing interface 13A side of the editing unit 13) or the editing work indicated by the dotted line in the figure from the shooting space 32 or The second editing space 33B (the second editing interface 13B side of the editing unit 13) moves to the guided side. It should be noted that the movement guidance at this time is usually guided to the vacant side of the first editing space 33A or the second editing space 33B.

  The user group (user located in C or C ') moved to the first editing space 33A or the second editing space 33B performs a graffiti editing work. Hereinafter, when it is not necessary to distinguish the first editing space 33A and the second editing space 33B from each other, they are simply referred to as the editing space 33.

  Thereafter, the user group waits until the photo sticker is printed, and during this waiting time, the user group performs a mini-game as a post-service processing in the editing space 33 or takes a photographed image or edits on the portable terminal. Sent images can be sent.

  Then, when printing is completed, a notice to that effect is given to the user group. Following this guidance, the user group moves to the printed matter receiving area 34 in front of the photo sticker discharge unit 13C, receives the discharged photo sticker paper, and ends the photo sticker creation game.

  In the photo sticker creation game as described above, when the user group that occupied the shooting space 32 moves to the first editing space 33A or the second editing space 33B, the shooting space 32 becomes free. Can use the imaging space 32 for the next new user group. Further, when the user group in the first editing space 33A or the user group in the second editing space 33B moves to the printed material receiving area 34, the editing space (the first editing space 33A or the second editing space 33B) becomes empty. Therefore, the photo sticker creating apparatus 1 can allow the user group that has been in the photographing space 32 to use the editing space.

  In other words, the photo sticker creating apparatus 1 uses the standby area 31, the shooting space 32, the first editing space 33A, the second editing space in order to improve the rotation rate per unit time and unit floor area of the photo sticker creating game. Using 33B and the printed matter receiving area 34, a photo sticker creation game can be played simultaneously for a plurality of user groups (multiple customer service can be performed).

  In addition, the structure of the housing | casing 10 of the photograph sticker production apparatus 1 mentioned above is arbitrary, and a structure other than the above-mentioned may be sufficient. Similarly, the method of multiple customer service is also arbitrary.

  Next, each unit constituting the photo sticker creating apparatus 1 will be described in detail.

  FIG. 5 is a front view of the front unit 12 </ b> A of the photographing unit 12.

  As shown in the figure, a coin insertion / return port 50 is provided at the lower right of the front of the front unit 12A so that the user can pay for a photo sticker creation game or return fishing to the user. ing.

  Note that the payment of the price for playing the photo sticker creation game is not limited to coins. In addition, instead of cash (coins and banknotes) that are actually distributed, it is also possible to make payments using prepaid cards, coins, electronic money, and the like that are distributed in amusement facilities where the photo sticker creation device 1 is installed. May be.

  In addition, the next user group waiting in the standby area 31 may be allowed to enter a fee before entering the shooting space 32. In this case, the coin insertion / return port 50 may be provided, for example, on the outer side surface of the front unit 12A. Further, in this case, the next user is kept waiting in the standby area 31 until the shooting space 32 becomes empty, and voice guidance for guiding the next user group to the shooting space 32 is output after the shooting space 32 is empty. You may make it do.

  A camera 51, a touch panel monitor 52, a flashlight 53-5, and a speaker 55-1 are provided in front of the front unit 12A. Further, flashlights 53-1 to 53-4 are provided on the front side of the front unit 12A.

  The front side surface and the lower wall surface of the front unit 12A are configured by milky white acrylic plates 54-1 to 54-4 formed in a substantially semi-cylindrical curved surface.

  Luggage storage areas 56-1 and 56-2 are provided at the lower left and right of the front of the front unit 12A for placing baggage and the like of a user who is photographing.

  The camera 51 employs an imaging device such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor), and is an imaging device that converts an optical image of a subject into image data as an electronic signal. In the shooting process of the creation game, a moving image is acquired for confirming the appearance of the user in the shooting space 32 as a subject, and a still image is shot at a predetermined shutter timing. The number and installation locations of the cameras 51 are arbitrary.

  The camera 51 is installed at a slightly higher position as compared with the conventional photo sticker creating apparatus, and a wide-angle lens is used. As a result, the whole-body photographing with the subject standing, which is difficult in the conventional photo sticker creating apparatus, is easily realized.

  The touch panel monitor 52 includes a display 123 such as a CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display), and a colorless and transparent touch panel 124 (for example, a pressure-sensitive type or an electromagnetic induction type) laminated thereon (both shown in FIG. 9). ).

  The display 123 displays an operation screen for the user to select a shooting course or select a foreground or background at the time of reception, and the touch panel 124 receives a tap operation with a user's finger, for example. Has been made.

  Prior to the shutter timing, the display 123 displays the moving image of the subject acquired by the camera 51 as it is or in a state where the background or foreground composite image is combined (live view display). Do). By looking at the live view display displayed on the display 123, the user can confirm his / her appearance. Further, the display 123 displays a still image taken by the camera 51 or a synthesized still image obtained by synthesizing a still image with a synthesis image as a shooting result.

  The flashlights 53-1 to 53-5 flash in accordance with the shooting timing of the camera 51 and irradiate the subject. Hereinafter, when it is not necessary to distinguish the flashlights 53-1 to 53-5, they are simply referred to as the flashlight 53.

  An illumination device such as a fluorescent lamp that illuminates the imaging space 32 is provided behind the milky acrylic plates 54-1 to 54-4.

  Whether the shooting space 32 surrounded by the side curtain 21 by the milky acrylic plates 54-1 to 54-4, the lighting device provided behind the ceiling plates 14, and the ceiling lighting unit 14 is a fitting room wrapped in light. Thus, the whole body of the subject (user) can be illuminated without shadows, and more beautiful images can be taken. Furthermore, it is possible to give the user a good impression that the shooting space 32 is wide, comfortable, clean, bright, and the like.

  Note that the installation of the milky white acrylic plates 54-1 to 54-3 may be omitted, and an illumination device such as a fluorescent lamp may be arranged at a position that can be directly seen by the user. Further, instead of the flashlight 53, an illumination device such as a fluorescent lamp may be arranged. Further, a flashlight may be installed at the position (including the back) of the milky white acrylic plate 54-4.

  Speakers 55-1 to 55-3 (FIG. 6) appropriately output guidance voice, background music (BGM), sound effects, etc. in the shooting work of the photo sticker creation game. In addition, the installation place of the speakers 55-1 to 55-3 is arbitrary.

  The luggage storage place 56-1 and the luggage storage place 56-2 are shelves that can be used as a place for baggage by the user at the time of photographing. Each of the luggage storage place 56-1 and the luggage storage place 56-2 does not get in the way of shooting, that is, does not get in the way when the user takes a shooting pose, and the flashlight 53 emits flash light. It is provided in a position that does not interfere.

  By placing his / her baggage in the luggage storage area 56-1 or the luggage storage area 56-2, the user can perform the photographing work more comfortably and safely. In the following, when it is not necessary to distinguish the luggage storage 56-1 and the luggage storage 56-2 from each other, they are simply referred to as the luggage storage 56. By providing the luggage storage place 56, it is possible to prevent a situation in which the baggage is soiled due to the baggage being placed on the floor or the user is damaged by the withdrawal.

  Of course, you may make it provide things other than the structure mentioned above in the front surface 12A-1 of the front unit 12A.

  FIG. 6 is a front view of the rear unit 12B of the photographing unit 12 located on the back side of the user group that is the subject in the photographing space 32. FIG.

  As shown in the drawing, on the left side of the rear unit 12B, a speaker 55-2, a flashlight 53-6, and an illumination device 57-1 are provided in order from the top. Similarly, on the right side of the rear unit 12B, a speaker 55-3, a flashlight 53-7, and an illumination device 57-2 are provided in order from the top.

  Note that the flashlight 53-6 and the illuminating device 57-1 and the flashlight 53-7 and the illuminating device 57-2 are provided slightly inward toward the subject.

  Next, the configuration of the editing unit 13 will be described in detail.

  FIG. 7 is a diagram illustrating a configuration example of one first editing space 33 </ b> A among the editing spaces 33 provided in two places in the editing unit 13.

  As shown in the figure, an illuminating device 61 for illuminating the first editing space 33A that is darkened because it is partitioned by the side curtain 21 or the like is provided at the top of the first editing interface 13A.

  With this lighting device 61, it is possible to suppress a reduction in the editing work efficiency of the user in the editing space 33 covered with the side curtain 21, and to improve the safety of the first editing space 33A.

  In the configuration example of FIG. 7, the upper part of the first editing interface 13A in which the lighting device 61 is provided of the editing unit 13 penetrates to the second editing space 33B side, and the lighting device 61 is the first. The editing space 33A and the second editing space 33B are shared. That is, the illumination device 61 illuminates not only the first editing space 33A but also the second editing space 33B. Note that the installation position and the number of the illumination devices 61 are arbitrary.

  The first editing interface 13A is provided with a tablet built-in monitor 62 on the front thereof, and touch pens (touch pen 63-1 and touch pen 63-2) are arranged on the left and right of the tablet built-in monitor 62, respectively. Further, the first editing interface 13A is provided with a speaker 64 and an additional coin insertion / return opening 65.

  The tablet built-in monitor 62 includes a display 141 such as a CRT or LCD and a tablet 142 stacked on the display 141 (both of which are shown in FIG. 9). The display 141 is a GUI for editing a captured image obtained by a shooting operation in a shooting space. The editing screen or the like is displayed, and the tablet 142 inputs a user operation.

  The editing screen displayed on the display 141 of the tablet built-in monitor 62 is a graffiti editing by a plurality of users constituting the user group individually or jointly using the touch pen 63-1 or 63-2. The two images to be edited can be displayed simultaneously. The two images to be simultaneously displayed for graffiti editing may be the same or different.

  The tablet 142 of the tablet built-in monitor 62 is, for example, a pressure-sensitive type or electromagnetic induction type input device, is colorless and transparent, and uses an operation from a user using the touch pen 63-1 or the touch pen 63-2 as position information. Convert.

  The touch pens 63-1 and 63-2 provided on the left and right of the tablet built-in monitor 62 are detachably fixed to the editing unit 13 by a predetermined attachment, and a plurality of users constituting a user group can By using each of the touch pens, it is possible to play the editing work process of the photo sticker creation work at the same time. It is also identified whether the input operation is performed using the touch pen 63-1 or the input operation is performed using the touch pen 63-2. Hereinafter, when there is no need to distinguish between the touch pen 63-1 and the touch pen 63-2, they are simply referred to as the touch pen 63.

  The touch pen 63 is electrically connected to the control unit 101 (FIG. 9) installed inside the editing unit 13 by wire or wireless. The touch pen 63 operates in cooperation with the colorless and transparent tablet 142 superimposed on the display screen of the display 141 of the tablet built-in monitor 62. When the user operates these touch pens 63 and taps the tablet 142 (to bring the touch pen 63 and the display screen of the tablet built-in monitor 62 into contact (or close proximity)) or move the tablet 142 on the tablet 142. These operate as input devices that receive input from the user. The number of touch pens 63 to be installed, the installation position, the shape, and the like are arbitrary.

  The speaker 64 outputs voices such as guidance voices, sound effects, and BGM, for example. The number, design, shape, etc. of the speakers 64 are arbitrary.

  The additional coin insertion / return port 65 is used to add a coin as an additional fee when the user group wants to extend the editable time, when a plurality of photo stickers are added and printed, or when a page of a photo sticker notebook is printed. It is provided for throwing in or returning fishing. Note that the payment of this additional price is not limited to coins, and it is naturally possible to pay even with banknotes. In addition, instead of cash (coins and banknotes) that are actually distributed, payment can also be made with prepaid cards, coins, electronic money, etc. distributed at amusement facilities where the photo sticker creation device 1 is installed. May be.

  However, the extension of the editable time is performed when the shooting operation is not currently performed in the shooting space 32 (when there is no next user) or the other editing interface (in this case, the second editing interface). 13B) is possible only when it is vacant, and it may not be possible to extend when the shooting operation is performed in the shooting space 32 and the other editing interface is used.

  The configuration example on the second editing space 33B side of the editing unit 13 is basically the same as the configuration example on the first editing space 33A side shown in FIG.

  FIG. 8 is a diagram illustrating a configuration example of the photographic sticker discharge unit 13 </ b> C provided in the editing unit 13.

  As shown in the figure, the photo sticker discharge portion 13C is provided with a photo sticker discharge port 71, and a photo sticker (sticker paper 162 on which an edited photographed image is printed) is discharged. The photo sticker is created by printing an image for printing created by operating the editing interface 13A or 13B by a printer 114 (FIG. 9) built in the editing unit 13 on a sticker sheet.

  Next, an internal configuration example of the photo sticker creating apparatus 1 will be described.

  FIG. 9 is a block diagram illustrating a functional configuration example of the photo sticker creating apparatus 1. In addition, about the site | part mentioned above, since the same code | symbol is attached | subjected, the description is abbreviate | omitted.

  The photo sticker creating apparatus 1 includes a control unit 101 that controls the entire apparatus of the photo sticker creating apparatus 1. In the control unit 101, a storage unit 102, a communication unit 103, a drive 104, a ROM (Read Only Memory) 106, a RAM (Random Access Memory) 107, a photographing unit 111, an editing unit 113, and a printer 114 each have a predetermined bus. Connected through.

  The storage unit 102 has a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 101 in the storage medium or is recorded in the storage medium. The setting information is read and supplied to the control unit 101. Further, the storage unit 102 stores the photo sticker (image data) created by each user group.

  Under the control of the control unit 101, the communication unit 103 is connected to another communication device, specifically via an external network such as the Internet or a public telephone network, or simply through a communication cable (both not shown). For example, it communicates with the user's mobile phone, the user's personal computer, the central management server, or the like. More specifically, the communication unit 103 transmits transmission information supplied from the control unit 101 to another communication device, or supplies reception information supplied from another communication device to the control unit 101.

  The drive 104 includes a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc), a BD (Blu ray Disc)), a magneto-optical disk, and A removable medium 105 such as a semiconductor memory is appropriately mounted, and computer programs and data read from the removable medium 105 are supplied to the control unit 101 as necessary, and stored or installed in the storage unit 102 or the like.

  The ROM 106 stores programs and data executed by the control unit 101 in advance, and the ROM 106 supplies the programs and data to the control unit 101 in accordance with control from the control unit 101. The RAM 107 temporarily holds data and programs processed by the control unit 101.

  The photographing unit 111 is a block relating to the photographing unit 12 and includes a background curtain unit 15, a camera 51, a touch panel monitor 52, a speaker 55, a coin processing unit 121, and an illumination control unit 122.

  The background curtain unit 15 is a unit having a plurality of elevating curtains used as a background and a control unit that controls the curtains used as a background in the process of shooting a photo sticker creation game. The curtains have different colors, patterns, patterns, etc. and have different backgrounds. That is, the user can select the background color, pattern, pattern, etc. by selecting the curtain to be adjusted.

  The background curtain unit 15 (the control unit thereof) is provided at the upper part of the rear unit 12B, and one or more curtains selected by the user are placed behind the shooting space 32 (behind the user who is the subject). Hanging. At this time, unnecessary curtains that are already suspended are wound up and stored. Actually, the background curtain unit 15 operates under the control of the control unit 101, and suspends or stores the curtain according to the background control signal supplied from the control unit 101.

  Note that the material, shape, size, and the like of each curtain are arbitrary, and include, for example, panels and solid shapes. Moreover, the material, shape, size, etc. of each curtain may be different from each other (the material, shape, size, etc. need not be unified for all curtains). Further, the background curtain unit 15 is only required to allow the user to select a background. For example, a curtain other than a lift type such as a slide type, an open / close type, and a folding type may be used.

  Furthermore, the curtain used as the background is not suspended, but the shooting space 32 facing the front surface 12A-1 of the front unit 12A in the side surface of the rear unit 12B on the shooting space 32 side, that is, in the shooting space 32. You may make it stick on the surface used as the back of. Alternatively, the user may manually select and install a curtain prepared in the background curtain unit 15 without using the control unit 101.

  Note that a background other than the background curtain unit 15 may be used as a background at the time of shooting. For example, a picture or item brought by the user may be pasted on the back surface (or curtain) of the shooting space 32, or an image brought by the user or selected may be displayed on the back of the shooting space 32. (Or curtains) may be displayed or projected.

  In addition, a single chroma key curtain is attached in advance to the back of the shooting space 32, or an elevating chroma key curtain is provided on the back of the shooting space 32, and a plurality of types of composite background images are prepared. In the editing process, a background image desired by the user may be combined with the curtain portion.

  As described above, by allowing the user to select the background by some method, it is possible to provide an image more suitable for the user's request.

  The camera 51 is controlled by the control unit 101 to shoot a subject (user) in the shooting space 32 in the shooting work process of the photo sticker creation game. For example, the camera 51 captures a user's moving image in real time under the control of the control unit 101, and supplies the captured moving image data to the control unit 101. Further, the camera 51 acquires a captured image (still image) by operating a mechanical shutter based on a shutter control signal supplied from the control unit 101, and supplies the acquired still image data to the control unit 101. To do.

  The display 123 of the touch panel monitor 52 displays an image based on the RGB signal supplied from the control unit 101 on the display 123. The touch panel 124 of the touch panel monitor 52 supplies position information to the control unit 101 when the user taps (contacts or approaches) the touch panel with his / her own finger or the like. The control unit 101 analyzes the position information, identifies and accepts information and instructions input by the user with respect to the display image.

  The speaker 55 outputs, for example, sound of a sound signal supplied from the control unit 101 (such as shooting work guidance sound, sound effect, or background music).

  The coin processing unit 121 identifies the type of coin inserted into the coin insertion / return port 50 and notifies the control unit 101 of the identification result.

  Based on the illumination control signal supplied from the control unit 101, the illumination control unit 122 flashes the flashlight 53, and the illumination device provided behind the milky acrylic plate 54, the illumination device 57 of the rear unit 12 </ b> B, and the like. Turns on and off.

  The editing unit 113 is a block related to the editing unit 13, and includes a first editing unit 113A corresponding to the first editing interface 13A and a second editing unit 113B corresponding to the second editing interface 13B. The first editing unit 113A and the second editing unit 113B have the same configuration. The first editing unit 113A will be described below, but the description can also be applied to the second editing unit 113B. .

  The first editing unit 113A includes a coin processing unit 130 in addition to the tablet built-in monitor 62, the touch pen 63, and the speaker 64 described above with reference to FIG.

  As described above, the tablet built-in monitor 62 includes the display 141 and the tablet 142. The display 141 of the tablet built-in monitor 62 displays an image related to editing such as an editing input GUI and a captured image corresponding to the RGB signal supplied from the control unit 101.

  Further, the display 141 of the tablet built-in monitor 62 displays a mini game screen in the after-mentioned customer service process described later.

  The tablet 142 of the tablet built-in monitor 62 supplies position information indicating the tapped position to the control unit 101 in response to an operation of tapping (contacting or approaching) the tablet 142 by the user using the touch pen 63. The control unit 101 analyzes the position information, identifies and accepts information and instructions input by the user with respect to the display image (GUI or the like). That is, editing input for a captured image (a composite image created using the captured image) is performed using these configurations.

  The speaker 64 outputs the sound of the sound signal supplied from the control unit 101 (editing sound for editing work, sound effects, sound related to the editing work process of the photo sticker creation game such as BGM).

  The coin processing unit 130 identifies the type of coin inserted into the additional coin insertion / return port 65 and notifies the control unit 101 of the identification result.

  The printer 114 prints a photo sticker as a result of the editing operation performed by the editing unit 113 on the sticker sheet 162 by using two built-in heads 151 and 152. The printer 114 has a built-in cutter 153, and cuts and outputs a sticker sheet 162 on which a photo sticker is printed at a predetermined position.

  That is, when the printer 114 acquires the result of the editing operation performed by the first editing unit 113A from the control unit 101, the printer 114 acquires the sticker sheet 162 from the paper supply unit 161 and prints the photo sticker by the head 151. Further, when the printer 114 acquires the result of the editing operation performed by the second editing unit 113B from the control unit 101, the printer 114 acquires the sticker sheet 162 from the paper supply unit 161 and prints the photo sticker by the head 152.

  When the printer 114 finishes printing the photo sticker, it prints the printed sticker paper 162, cuts it at a predetermined position, and discharges it from the photo sticker discharge port 71. This printed sticker sheet 162 is provided to the user group as a photo sticker that is a product of the photo sticker creation game.

  Thus, by discharging the cut sticker paper 162, the user does not need to cut the sticker paper 162 with scissors or the like, so that the user's trouble can be saved.

  Next, the control unit 101 will be described. FIG. 10 shows a configuration example of functional blocks realized by the control unit 101 executing a program stored in the ROM 106 or the like.

  The control unit 101 performs a process related to a shooting work process of the photo sticker creation game, such as a pre-service processing unit 201 that performs a process related to a charge input when starting the photo sticker creation game, and a user group. A shooting processing unit 202, an editing processing unit 203 that performs processing related to a photo sticker creation game editing process such as graffiti editing for a captured image, and a printing process that performs processing related to a photo sticker creating game printing process such as sticker paper printing. And a post-service processing unit 205 that performs processing related to the post-service process of the photo sticker creation game that serves the user group that has finished the editing work.

  That is, the control unit 101 controls processing relating to each process of the photo sticker creation game.

  FIG. 11 shows a detailed configuration example of the imaging processing unit 202 in FIG. The imaging processing unit 202 includes an operation input processing unit 211, a face image recognition unit 212, an image processing unit 213, a composition processing unit 214, a display control unit 215, and a management unit 216. Hereinafter, when it is not necessary to distinguish between a moving image captured by the camera 51 and a still image, that is, when both are common, they are simply referred to as an image (captured image or subject image).

  The operation input processing unit 211 controls the touch panel monitor 52 to cause the user group to select a photographing course, to cause the user group to select a composite image, and to be an editing target from among the photographed images. Processing for causing the user group to select (edit target image) is performed.

  The face image recognition unit 212 recognizes the position of the face of the user (subject) by a method such as detecting an eye in a captured image or a predetermined range in the captured image. Note that the face image recognition unit 212 can easily recognize the number of subjects from the recognition result of the face position.

  When the face of the subject is recognized by the face image recognition unit 212, the image processing unit 213 performs image processing on the recognized subject's face range or a preset range of images in the captured image. Do. Specifically, the image processing unit 213 performs, for example, image processing for correcting (converting) the skin color of the subject to a good-looking skin color, or when eye detection is performed, for example, Image processing is performed to correct the appearance of the subject so that the eyes of the subject are sharp.

  The composition processing unit 214 performs processing for compositing the acquired subject image or a part of the subject image with the selected composition image. For example, the synthesis processing unit 214 trims a part of the subject image as necessary, enlarges or reduces the trimmed part, and synthesizes the image for synthesis.

  The display control unit 215 displays the captured moving image or the moving image combined with the combining image (the combined moving image) on the display 123 of the touch panel monitor 52 in a live view. The displayed moving image is subjected to image processing according to the recognition result of the face of the subject. At this time, the display control unit 215 performs live view display by superimposing a target frame indicating a target range of image processing on the moving image on the moving image.

  In addition, the display control unit 215 displays a still image (combined still image) combined with the combining image on the display 123 of the touch panel monitor 52 as a photographing result.

  The management unit 216 controls the shutter timing of the camera 51 and measures the number of shutters and the elapsed time during each game.

  Next, a series of processing of the photo sticker creating game by the photo sticker creating device 1 will be described with reference to the flowchart of FIG.

  A user who plays the photo sticker creation game moves from the standby area 31 to the shooting space 32 and pays by inserting coins that are the price of the game into the coin insertion / return port 50 provided in the front unit 12A of the shooting unit 12. . In response to this coin insertion, the coin processing unit 121 identifies the type of coin and supplies an activation signal including the identification result to the control unit 101. In step S1, the advance customer service processing unit 201 of the control unit 101 determines whether or not a price has been inserted based on the activation signal. If it is determined that a valid price has been inserted, the process proceeds to step S2. .

  In step S <b> 2, the shooting processing unit 202 controls each unit of the shooting unit 111, and executes live view shooting processing that is processing related to shooting work of the photo sticker creation game performed in the shooting space 32. In the live view shooting process, a moving image with the user as a subject is always displayed on the touch panel monitor 52 in a state as it is or in a state where a composition image is combined. Therefore, the user can confirm his / her appearance while viewing the image on the touch panel monitor 52. The live view shooting process will be described later with reference to FIG.

  When the live view shooting process is completed, in step S3, the shooting processing unit 202 sends the user in the shooting space 32 who has finished the shooting operation to the first editing space 33A or the second editing space 33B by an image or sound. A movement guidance process for encouraging movement is performed.

  In step S <b> 4, the editing processing unit 203 performs editing processing, which is processing related to editing work of the photo sticker creation game, in accordance with an operation from the user who has moved to the editing space 33.

  When the editing operation is completed, in step S5, the print processing unit 204 controls the printer 114 to perform a printing process for printing the edited image obtained by the editing operation on a sticker sheet.

  In step S6, the post-mortem service processing unit 205 can perform services such as mini-games and image transfer to a user waiting for completion of printing, or can post a photo sticker notebook or post a photo sticker. Perform customer service.

  When the post-service processing is completed, the post-service processing unit 205 performs movement guidance for moving the user of the editing space 33 to the printed material receiving area 34 in step S7. When the printing process is completed, the print processing unit 204 controls the printer 114 in step S8 to cut the printed sticker sheet appropriately and discharge it from the photo sticker discharge port 71. Thus, a series of processes of the photo sticker creation game is completed.

  Next, the live view shooting process of step S2 in the series of processes of the photo sticker creation game described above will be described in detail with reference to the flowchart of FIG.

  In step S101, the operation input processing unit 211 of the shooting processing unit 202 displays a shooting course selection screen using the touch panel monitor 52, and prompts the user to select a shooting course.

  For example, examples of courses that can be selected by the user include discerning courses and combination image courses. When the disciplined course is selected, the same number of shot still images as the number of shots is obtained, and a plurality of images to be edited are selected from the shot still images.

  On the other hand, when the combination image course is selected, a larger number of images than the number of times of photographing are obtained, and a plurality of editing target images are selected from among the images. Hereinafter, the description of the operation example after the selected course is selected will be continued.

  In step S102, the management unit 216 of the shooting processing unit 202 starts measuring the elapsed time t of the live view shooting process.

  In step S <b> 103, the operation input processing unit 211 displays a composition image selection screen using the touch panel monitor 52 and prompts the user to select a composition image.

  Here, the composition image is a background image or a foreground image to be combined with a captured image. Note that the composition image selection screen includes not only a composition image but also a sample composition image obtained by compositing a model image instead of the subject in the photographed image and the composition image (for example, sample composition in FIG. 17A described later). An image for use 241) may be displayed. The sample synthesis image may be an image in which a model is originally reflected instead of synthesis.

  In step S <b> 104, the management unit 216 controls the camera 51 to start acquisition of a subject moving image (subject moving image).

  In step S105, the face image recognition unit 212 of the shooting processing unit 202 recognizes the position of the user (subject) face in the subject moving image acquired in step S104, and the image processing unit 213 of the shooting processing unit 202. In the subject moving image, the recognized face range of the subject is subjected to image processing as a target range for image processing. Then, the display control unit 215 of the photographing processing unit 202 uses the touch panel monitor 52 to display a live view screen 230 as illustrated in FIG. 14A, for example. For example, the live view display is performed by superimposing the target frames 231A and 231B that are the range of the face of the recognized subject and indicate the target range of the image processing on the subject moving image that has been acquired and is processed in step S104. Is done.

  In the case of FIG. 14A, first, the face image recognition unit 212 recognizes the positions of the faces of the subject A and the subject B in the subject moving image, and the recognized face ranges of the subject A and the subject B are subject to image processing, respectively. As a range, the image processing unit 213 performs image processing. Then, a subject frame 231A indicating the target range of image processing corresponding to the subject A and a target indicating the target range of image processing corresponding to the subject B are added to the subject moving image whose target range is image-processed by the display control unit 215. A frame 231 </ b> B is superimposed and displayed as a live view screen 230.

  In FIG. 14A, a frame line surrounded by phrases is used as the target frames 231A and 231B, but is not limited to this, and a decorated design image (frame line) may be used.

  That is, in the case of FIG. 14A, the target frame is not displayed unless the face range is recognized. Therefore, by viewing the live view screen 230, the user can see how his / her image is and what part is image-processed (corrected), that is, whether his / her face is image-processed (corrected). It can be confirmed intuitively.

  Details of the live view screen display processing in step S105 will be described later with reference to FIG.

  In step S106, the management unit 216 starts a countdown (for example, the initial value is 3 seconds) until the shutter timing. At this time, the management unit 216 controls the display control unit 215 to display, for example, “3, 2, 1, 0” or the like on the touch panel monitor 52 according to the remaining number of seconds (count) until the shutter timing. Further, a sound of countdown is output from the speaker 55 to notify the user of the shutter timing, and the camera 51 is controlled to execute shooting in synchronization with the shutter timing.

  As a result, a still image of the subject is output from the camera 51, and the above-described target range is subjected to image processing and stored in the still image of the subject. In addition, when compositing with a compositing image, a still image of the subject is output from the camera 51, and the above-described target range is subjected to image processing in the still image of the subject, and is combined with the compositing image and stored. .

  Specifically, the touch panel monitor 52 includes “3, 2, 1, 0” and the like and the remaining number of seconds until the shutter timing (count). 230 is displayed. Then, in the count “1.5 or 1”, the black target frames 233A and 233B are superimposed on the live frame of FIG. 14B in place of the target frames 231A and 231B that are wrapped in the phrase on the live view screen 230 of FIG. 14A. A view screen 232 is displayed. Further, in the case of the count “0”, the live view screen 234 of FIG. 14C showing “Look at the camera!” And an arrow indicating the installation direction of the camera 51 is displayed to direct the user's line of sight toward the camera. The

  This allows the user to completely recognize the part to be image-processed until immediately before shooting, and to clearly recognize what facial expression is shot.

  In the example of FIG. 14B, black frame lines are used as the target frames 233A and 233B. However, the present invention is not limited to this, and a design image (frame line) to which a ribbon or the like is added may be used. That is, the target frames 233A and 233B displayed in the count “1.5, 1” may be any type of frame line different from the target frames 231A and 231B displayed in the count “3, 2”. It may be a frame line.

  Further, a composite image corresponding to the number of users (how many people are shown in the photograph) is stored in advance, and the number of users is input by the user before the start of shooting (for example, before step S103). In S103, a composition image corresponding to the number of persons input may be displayed on the composition image selection screen so that the user can select it. In this case, shooting can be started when the number of faces recognized in step S105 matches the input number of people, and shooting can be disabled when they do not match.

  At this time, not only the number of people but also the position of the user in the image for synthesis may be determined, and whether or not it matches the position may be put in a determination condition as to whether or not photographing can be started. In addition, a determination condition is set such that shooting is started when the number of people recognized by the recognition result of the face image recognition unit 212 matches the number of people set in the selected composition image without inputting the number of people. May be.

  In the case of non-coincidence, or when face recognition is inappropriate (for example, when only one eye is detected by eye detection), it is desirable to inform the user of non-coincidence using a screen or voice. . In addition, if it is determined that the image cannot be taken, the image is taken after a predetermined time regardless of whether the image is not matched or not properly recognized. In this case, guidance such as “Image processing (correction) will not be performed!” Is given on the screen or voice.

  In the above description, the example in which the same frame line is displayed on the live view screen in step S105 and the live view screen of the count “3, 2” in step S106 has been described. A frame may be displayed, or the frame may not be displayed until the count occurs, and the frame may be displayed for the first time after the count reaches “3, 2”.

  In addition, the subject moving image before image processing may be displayed on the live view screen in step S105, but the subject moving image subjected to image processing may be displayed as described above. Conventionally, an image processed (corrected) image has not been displayed on the subject moving image. However, for example, an image processed image after skin conversion or an image processed image after eye processing when eyes are detected Is displayed. This makes it possible to make the user feel that the processed image is the same as the actual image before shooting it, and to make it easy to imagine a perfect (good looking) shot image. it can.

  Next, in step S <b> 107, the display control unit 215 displays a shooting result screen using the touch panel monitor 52. In other words, in the subject still image acquired at the shooting timing, the target range is subjected to image processing, and the subject still image subjected to image processing is displayed on the touch panel monitor 52 as a shooting result screen.

  In step S108, the management unit 216 determines whether or not the number of shootings has reached a predetermined number X (for example, 6 times). If it is determined that the number of shootings has not reached the predetermined number X, the process returns to step S105, and the subsequent steps are repeated. Thereafter, when it is determined in step S108 that the number of photographing has reached the predetermined number X, the process proceeds to step S109.

  In step S109, the management unit 216 determines whether or not the elapsed time t has passed a predetermined time T (for example, 5 minutes). If it is determined that the elapsed time t has not passed the predetermined time T, bonus shooting (shooting exceeding a predetermined number X times) is permitted, and the process returns to step S105.

  Conversely, if it is determined that the elapsed time t has passed the predetermined time T, the process proceeds to step S110.

  In step S110, the operation input processing unit 211 uses the touch panel monitor 52 to display an editing target image selection screen 235 as shown in FIG. 15, for example, and allows the user to select from a plurality of captured subject still images. Prompts to select multiple images to edit. Here, the editing target image refers to an image that is output to the subsequent stage of the live view imaging process and is printed on the sticker sheet 162 after the editing process is performed.

  In the example of FIG. 15, subject still images with numbers 1 to 6 are displayed on the edit target image selection screen 235, and the subject recognition result in step S105 is displayed below each subject still image. As a result (that is, an image processing result), a recognition OK image indicating that the face of the subject has been recognized (recognized and image processed), or the face of the subject has not been recognized (image processing has been performed without being recognized). A recognition NG image indicating that the color is not present) is displayed in a different color.

  In this way, the user can be prompted not to select an image that could not be recognized. Thereby, it is possible to prevent the user from being satisfied and outputting an image that has not been subjected to image processing and is not satisfied.

  After the editing target image is determined as described above, the live view shooting process is ended.

  As described above, in the live view shooting process, shooting can be performed X times regardless of the elapsed time t. Furthermore, when the elapsed time t has not passed the predetermined time T, bonus shooting can be permitted. An upper limit may be set for the number of times of bonus shooting. Further, there is no limit on the number of times of bonus shooting, and bonus shooting may be permitted as long as the elapsed time t has not passed the predetermined time T.

  In the live view shooting process described above, the shooting processing unit 202 autonomously starts the countdown until the shutter timing. However, the countdown may be started in response to a predetermined shooting operation from the user. Good.

  Next, another example of the live view screen display process in step S105 in FIG. 13 will be described with reference to the flowchart in FIG. For example, a case where the sample composition image 241 shown in FIG. 17A is selected in step S103 of FIG. 13 will be described as an example.

  In the example of FIG. 17A, a sample composition image 241 is shown on the right side of the composition image. In the display process of FIG. 16, a live view screen for guiding the subject is displayed at the position of the model image (that is, the range where the model image is located).

  In step S131, the camera 51 acquires a subject moving image. In step S132, the face image recognition unit 212 recognizes the position of the face of the user (subject) in the subject moving image acquired in step S131, and the image processing unit 213 recognizes the face of the recognized subject in the subject moving image. Is processed as a target range for image processing.

  In step S133, the display control unit 215 determines whether or not the target range of the image processing is the position of the model image in the sample composite image 241. If it is determined in step S133 that the image processing target range is not the position of the model image, the process proceeds to step S134.

  In step S134, the composition processing unit 214 composes the composition image and the subject moving image subjected to the image processing, and the display control unit 215 superimposes the target frame 243 and the target frame 244a on the composite image. The live view screen 242 is displayed to guide the user to move.

  In the example of FIG. 17B, a target frame 243 that indicates the position (range) of the face of the model of the sample composition image 241 in FIG. 17A is combined with a composite image in which the composition image and the subject moving image subjected to image processing are combined. The live view screen 242 is shown in which the position of the face of the subject A is recognized in step S132 and the target frame 244a indicating the target range of the image processed image is superimposed.

  In step S134, such a live view screen 242 is displayed, and movement guidance for guiding the user to the target frame 243, such as “Please move to the position of the right frame!” This is done with the screen and sound. Although not shown in FIG. 17B, an arrow from the target frame 244a toward the target frame 243 may be displayed on the live view screen 242 as movement guidance.

  Thereafter, the processing returns to step S131, and the subsequent processing is repeated. That is, since the user moves in response to the movement guidance in step S134, the subject moving image is acquired in step S131. In step S132, face recognition and image processing are performed on the subject moving image. In step S133, image processing is performed. Whether the target range is the position of the model image is determined.

  If the user has not moved to the position of the model image, it is determined in step S133 that the target area for image processing is not the position of the model image, and the process proceeds to step S134 again. In step S134, for example, the display control unit 215 synthesizes the image for synthesis and the subject moving image subjected to image processing, and adds the synthesized image to the target frame 243 and the target frame 244a according to the movement of the user. The live view screen 245 of FIG. 17C on which the current target frame 244b approaching the target frame 243 is superimposed is displayed, and further movement guidance is performed.

  That is, the display control unit 215 moves and displays the target frame 244b in accordance with the movement of the user (recognized correction target range).

  In FIG. 17C, the user and the target frame 244a in the example of FIG. 17B are also shown for convenience of explanation, but are not actually displayed.

  On the other hand, when it is determined in step S133 that the target range of the image processing is the position of the model image, the process proceeds to step S135.

  In step S135, the display control unit 215 synthesizes the composition image and the subject moving image subjected to image processing, displays the live view screen 246 in FIG. 17D in which the target frame 247 is superimposed on the synthesized image, and moves Give guidance.

  In the example of FIG. 17D, the target frame 243 (the position of the model face of the sample combining image 241 in FIG. 17A) and the target frame are combined with the combined image obtained by combining the combining image and the subject moving image subjected to image processing. As a result of matching 244a (the recognized position of the face of the subject A in FIG. 17B), a live view screen 246 is shown in which the target frame 243 is superimposed as the target frame 247.

  After that, in step S106 in FIG. 13, the management unit 216 starts countdown and executes photographing. Also in this case, when the count reaches “0” in the countdown, “Look at the camera!” And an arrow indicating the installation direction of the camera 51 are shown in FIG. 17E to direct the user's line of sight toward the camera. A live view screen 248 is displayed.

  In the example of FIG. 17, the case where the user's distance from the camera 51 is not too close and not too far (that is, a suitable distance) with respect to the model of the sample synthesis image has been described. As shown in the example of FIG. 18, the user may be too close or too far from the camera 51 with respect to the model of the sample composition image.

  The model face size in the sample composition image 251 in FIG. 18A is smaller than the model face size in the sample composition image 241 in FIG. 17A so that the whole body falls within the composition image. The position of the model face in the sample image 251 is arranged above the position of the model face in the sample composition image 241 in FIG. 17A.

  Therefore, in the example of FIG. 18B, a target frame 253 indicating the position of the face of the model of the sample composition image 251 in FIG. 18A is added to the composite image in which the composition image and the subject moving image subjected to image processing are combined. A live view screen 252 in which the position of the face of the subject A is recognized and the target frame 254a indicating the target range subjected to image processing is superimposed is shown. The target frame 253 is the target frame 243 in FIG. 17B. Smaller than and located on the screen.

  For example, when such a live view screen 252 is displayed in step S134 of FIG. 16 described above, for example, “Move to the right rear so that the face enters the right frame!” Then, movement guidance for guiding the user to the target frame 253 is performed by a screen or a voice.

  In response to this, the user moves to the right rear with respect to the live view screen 252 (the touch panel monitor 52 or the camera 51). For example, in the next step S134, the target frame 253 and As the user moves, the live view screen 255 of FIG. 18C is displayed in which the current target frame 254b that is closer to the target frame 253 than the target frame 254a and is smaller in size is superimposed, and further movement guidance is provided. Done.

  Further, as a result of the user moving to the right rear side with respect to the live view screen 255, it is determined in step S133 that the target range of the image processing is the position of the model image. In step S134, the target image is displayed on the synthesized image. As a result of the match between the frame 253 (the face position of the model of the sample composition image 251 in FIG. 18A) and the target frame 254a (the recognized face position of the subject A in FIG. 18B), the target frame 253 is set as the target frame 257. A superimposed live view screen 256 is shown.

  In this case as well, in the countdown of step S106 in FIG. 13, when the count reaches “0”, “Look at the camera!” Indicates the installation direction of the camera 51 in order to direct the user's line of sight toward the camera. The live view screen 258 shown in FIG. 18E with an arrow is displayed.

  As described above, the frame indicating the target range of the image processing is too large or too small depending on the model (user) up-image and whole-body image (that is, close to or far from the camera) in the sample composition image. In some cases, the user can be guided by changing the size of the frame so as to match the sample composition image.

  Accordingly, the user can be easily moved to a position corresponding to the size of the target frame indicating the position of the model of the sample composition image.

  In the above description, the image of the target range is processed and displayed after the face position is recognized. For example, the recognition is performed after the position of the target frame matches the position of the target frame. Display may be performed by performing image processing in the target range of the image processing performed.

  In the above description, an example in which there is one user has been described. However, when there are a plurality of users, each user whose face position is recognized is represented by a plurality of target frames (models). The position may be guided to the target frame closest to the corresponding recognized face position.

  Thereby, a plurality of users can easily be guided to the position of the model of the sample composition image without going back and forth.

  Further, for example, when the user is composed of a plurality of people (four people in the case of FIG. 19), the color and shape of the target frame may be divided into left and right as shown in FIG. 19A. As shown in FIG. 19B, each user may be divided.

  In the example of FIG. 19A, the user A is photographed in the lower left of the live view screen 261, the user B in the upper left, the user C in the lower right, and the user D in the upper right. A target frame 262 indicating a target range of image processing as a result of recognition of the user A's face is displayed with a black frame line on the face of the user A at the lower left of the live view screen 261. On the face of user B at the upper left of the live view screen 261, a target frame 263 indicating a target range of image processing as a result of recognition of the face of user B is displayed with a black frame line.

  Further, on the face of the user C at the lower right of the live view screen 261, the target frame 264 indicating the target range of image processing as a result of the recognition of the face of the user C is a color different from black such as yellow (hatching) ) It is displayed with a border. On the face of the user D at the upper right of the live view screen 261, a target frame 265 indicating a target range of image processing as a result of recognition of the user D's face is displayed with a yellow frame line. That is, among the target frames displayed on the live view screen 261, the target frames 262 and 263 displayed on the left side are displayed with black frame lines, and the target frames 264 and 265 displayed on the right side are yellow frame lines. Is displayed.

  Also in the example of FIG. 19B, the user A is photographed at the lower left of the live view screen 271, the user B is photographed at the upper left, the user C is photographed at the lower right, and the user D is photographed at the upper right. A target frame 272 indicating a target range of image processing as a result of recognition of the user A's face is displayed as a black frame line on the face of the user A at the lower left of the live view screen 271. On the face of user B at the upper left of the live view screen 271, a target frame 273 indicating a target range of image processing as a result of recognition of the face of user B is displayed, for example, with a yellow (coarse hatched) frame line. ing.

  Further, on the face of the user C at the lower right of the live view screen 271, a target frame 274 indicating a target range of image processing as a result of recognition of the face of the user C is displayed with a blue (fine hatched) frame line. ing. On the face of the user D at the upper right of the live view screen 271, a target frame 275 indicating a target range of image processing as a result of recognition of the user D's face is displayed with a white frame line. That is, the target frames displayed on the live view screen 271 are all displayed with different color frame lines.

  In this way, when there are a plurality of users, by displaying the target frame with different frame lines, the plurality of users can easily be guided to the position of the model of the sample composition image without going back and forth. it can. Of course, the target frame may be displayed with a frame line of the same color as the corresponding target frame and by changing the pattern.

  In the above description, the example in which the user is guided to the position of the model of the sample composition image (the range in which the model is located) to change the size of the user's face in the captured image has been described. Referring to FIG. 20, an example in which a target frame indicating a range to be subjected to image processing is displayed in advance, the image in the target frame is scaled (enlarged or reduced), and is embedded in the composite image will be described. To do.

  The flowchart in FIG. 20 shows still another example of the live view screen display process in step S105 in FIG. 13, and FIG. 21 is referred to as appropriate in the description of FIG. In the example of FIG. 21, for example, an image example displayed on the live view screen when a synthesis image for two users is selected is shown.

  In step S151, the camera 51 acquires a subject moving image. In step S152, the display control unit 215 superimposes the target frames 282a and 282b indicating the target range of the image processing on the subject image 281 (moving image) in FIG. 21A and displays the live view on the live view screen.

  The number of target frames is displayed according to the number of users input in advance by the user. In the example of FIG. 21A, the range indicated by the target frame is a range where face recognition is performed, a target range for image processing, and a trimming range for inset synthesis. In step S152, only the image within the target frame may be displayed. However, it is easier to understand the range when the target frame is superimposed on the subject moving image and the entire subject moving image is displayed.

  In response to this, the users A and B move to put their faces in the target frames 282a and 282b, respectively. That is, in the case of the example of FIG. 21A, it can be said that displaying the target frame itself provides movement guidance for guiding the user to the target frame.

  The management unit 216 has started counting the elapsed time t2 after the target frames 282a and 282b are displayed. In step S153, whether or not the measured time t2 has passed a predetermined time T2 (for example, 5 seconds). Determine whether. If it is determined that the predetermined time T2 has not elapsed, the process returns to step S151 and the subsequent processes are repeated.

  If it is determined in step S153 that the predetermined time T2 has elapsed, in step S154, the face image recognition unit 212 performs face recognition on the subject moving image in the image processing target range, and the image processing unit 213 Image processing is performed according to the recognition result.

  In step S155, the compositing processing unit 214 enlarges / reduces the target range of the image processing in the subject moving image that has undergone image processing according to the compositing image, and composites it with the compositing image. Specifically, the compositing processing unit 214 performs an inset compositing process from an image-processed subject image by scaling the image in the target range according to the compositing image.

  In step S156, the display control unit 215 performs live view display by superimposing a target frame on the subject image 283 (moving image) subjected to image processing, as shown in FIG. 21B. In step S157, the display control unit 215 performs FIG. As shown, the synthesized image 284 synthesized in step S155 is displayed in live view.

  In the example of FIG. 21B, the position of the face of the subject A is recognized and corrected in the image processing target range indicated by the target frame 282a. Similarly, in the image processing target range indicated by the target frame 282b, The position of the face of the subject B is recognized and corrected, and as a result, the subject image 283 displayed by superimposing the target frames 282a and 282b is shown. The subject image 283 is a moving image.

  In the example of FIG. 21C, the target range indicated by the target frame 282a is trimmed from the subject image 283 that has been subjected to image processing, and the target range from the image indicated by the enlarged target frame 285a and the corrected subject image 283 are set. A target image indicated by a frame 282b is trimmed, and an image of a range indicated by an enlarged target frame 285b is combined with an image for synthesis 286, and a composite image 284 is shown. That is, in the synthesized image 284, the image in the range indicated by the target frame 285a and the target frame 285b that are fitted and synthesized is a moving image.

  For example, the display control unit 215 displays the subject image 283 in FIG. 21B and the composite image 284 in FIG. 21C as one live view screen 291 as shown in FIG. 22, for example.

  In the example of FIG. 22, an example in which a sample combining image 292, a subject image 283, and a combined image 284 are displayed on the live view screen 291 from the left in the drawing.

  Thus, the user can view the actual moving image and the combined moving image at the same time, so that the user can take a picture while checking his / her position and his / her face in the combining. In other words, since it is not necessary to alternately check the standing position and the photographing monitor, it is possible to suppress the right-and-left movement in the photographing space.

  Note that in step S154 of FIG. 20 described above, as shown in FIG. 23A, face recognition could not be performed in the target range indicated by the target frame 282b due to, for example, the user B standing too far behind. In this case, in step S156, the display control unit 215 performs live view display of the subject image 301 (moving image) in which the target frame 282a and the target frame 282b that could not be recognized are superimposed. At this time, the target frame 282b that could not be recognized is displayed by a different display method from the target frame 282a that could be recognized.

  In the example of FIG. 23A, the recognized object frame 282a is displayed as a solid line, whereas the unrecognized object frame 282b is displayed as a dotted line.

  In this case, in step S155 of FIG. 20, instead of the face image of the user B that could not be recognized (the image of the target range indicated by the target frame 282b), the model image of the sample synthesis image or the recognized use The face image of the person A may be trimmed and combined, or the image in the target range indicated by the target frame 282b may be trimmed and directly combined (without image processing).

  In the example of FIG. 23B, an example of a composite image 302 is shown in which an image in the target range indicated by the target frame 282b that could not be recognized is trimmed and directly fitted and combined.

  In the example of FIG. 23B, the target range indicated by the target frame 282a is trimmed from the subject image 301 subjected to image processing, and the image of the range indicated by the enlarged target frame 303a and the face of the subject B are not recognized. Therefore, the composite image 302 is obtained by trimming the target range indicated by the target frame 282b from the uncorrected subject image 301 and fitting the composite image 304 with the image of the range indicated by the reduced target frame 303b. Are displayed on the live view screen 291. That is, in the composite image 302, the image in the range indicated by the target frame 303a and the target frame 303b is a moving image.

  In addition, in the image processing target range indicated by the plurality of target frames, only the image of the target range whose face is recognized may be separately displayed as a face-recognized image in the vicinity of the live view screen. As a result, the user can clearly grasp the face recognition result.

  In the above description, an example in which the sample composition image 292, the subject image 283, and the composite image 284 are displayed on one live view screen 291 has been described with reference to FIG. May be displayed on one live view screen. Further, first, only the sample composition image and the subject moving image may be displayed as one live view screen, and the synthesized image may be displayed after the subject moving image.

  Note that the subject moving image and the composite image may be displayed separately using a plurality of monitors. In this case, in order to prevent the user's line of sight from being greatly diverted, the camera is moved up and down, left and right, etc. It is desirable to install a plurality of monitors near the camera.

  Furthermore, the subject moving image and the composite image can be displayed as in the live view screen 311 in FIG. On the live view screen 311, the composite image 302 of FIG. 23B is displayed, and a moving image (face recognition) of the target range of the image processing shown in the target frames 282a and 282b of the subject image 301 of FIG. 312a and 312b are displayed.

  Also in this case, since the user can view the actual moving image and the combined moving image at the same time, the user can take a picture while confirming his / her position and his / her face in the combining.

  However, it is better to display in parallel as in the live view screen 291 than in the live view screen 311 because the position of the target frame in the entire subject image can be easily grasped.

  In the above description, an example in which a square frame line is displayed as a frame indicating the target range of image processing has been described, but various shapes such as a circle, a star shape, and a heart shape may be used instead of a square. It may be a line. Further, the example of the frame line has been described as indicating the target range of the image processing. However, the frame line is not limited to the frame line but may be a frame line and a region or a region. Of course, the frame indicating the range of the model may also be a frame of various shapes such as a circle, a star, or a heart, and is not limited to the frame, but may be a frame and a region, or a region. May be.

  As described above, according to the photo sticker creation apparatus 1 according to the present embodiment, the target range of image processing is displayed on the live view screen. While confirming the range, the user can move as necessary to perform shooting. Thus, the face and the like can be corrected with good appearance without instructing the image processing range and the like, and the satisfaction of the user can be increased.

  Also, according to the photo sticker creating apparatus 1 according to the present embodiment, a frame indicating a target range of image processing and a target frame are displayed and guided. Thereby, since the user can be guided in advance and the same captured image as the desired sample composition image can be obtained easily, the satisfaction of the user can be increased.

  Furthermore, according to the photo sticker creating apparatus 1 of the present embodiment, the subject image and the composite image on which the frame indicating the correction target range is superimposed are displayed, so that the user can change his / her position and his / her own in the composition. You can shoot while checking your face. This also makes it possible to easily obtain the same photographed image as the desired sample composition image, thereby increasing the user's satisfaction.

  By the way, the above-described series of processes can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 9, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the main body of the apparatus. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 105 made of semiconductor memory, etc., but also pre-installed in the device body The ROM 106 in which the program is recorded and the hard disk included in the storage unit 102 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, printing on a predetermined size of paper or film, poster paper, a card such as a telephone card, or a cloth such as a T-shirt. You may make it do.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses. In the above, the configuration described as one device may be divided and configured as a plurality of devices. Conversely, the configurations described above as a plurality of devices may be combined into a single device. Of course, configurations other than those described above may be added to the configuration of each device. Furthermore, if the configuration and operation of the entire system are substantially the same, a part of the configuration of a certain device may be included in the configuration of another device.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 12 Image pick-up unit 13 Editing unit 101 Control part 111 Image pick-up part 113 Editing part 201 Pre-service reception process part 202 Image pick-up process part 203 Edit process part 204 Print processing part 205 Subsequent service process part 211 Operation input process part 212 Recognition unit 213 Image processing unit 214 Composition processing unit 215 Display control unit 216 Management unit

Claims (6)

Photographing means for photographing a user;
A range recognizes the face of the user in capturing a moving image of the user taken by the imaging means, and, to the extent that performs image processing on captured moving image and capturing a still image of the user Display control means for controlling at least one of a frame line and a region indicating a certain target range to be superimposed on the captured moving image or the image-processed moving image and displayed on the display unit in real time;
Storage means for storing the user 's photographed still image photographed by the photographing means at a predetermined timing;
Face recognition means for recognizing the user's face in the target range of the captured moving image;
The shooting moving images of the target range the user's face is recognized by the image processing by the face recognition unit, and generates the image processed moving image, by image processing the captured still image of the target range, the image Image processing means for generating a processed still image;
A selecting means for selecting a sample composition image in which a model instead of a subject is arranged in a composition image for composition with the image processed moving image;
According to the size of the model in the sample composition image, the image-processed moving image of the target range in which the user's face is recognized is scaled, and the image-processed of the target range scaled Combining a moving image with the combining image corresponding to the sample combining image selected by the selecting unit, and generating a combined moving image;
Editing means for performing a predetermined editing process on the image-processed still image to generate an edited image;
Output means for outputting the edited image, and
The display control means includes the same display unit or other display as the synthesized moving image synthesized by the synthesis processing means for the captured moving image of the target range in which the user's face is recognized by the face recognition means. Photo sticker creation device that controls to display in real time on the screen. The synthesis processing means scales the image-processed still image in the target range in which the user's face is recognized according to the size of the model in the sample synthesis image, and scales the target. a range wherein the image processed still image, by combining with the synthetic image to generate a combined still picture,
The photo sticker creating apparatus according to claim 1, wherein the editing unit performs a predetermined editing process on the synthesized still image to generate the edited image. The display control means, when there are a plurality of the target ranges, controls to display at least one of a frame line and a region indicating the target range on the display unit by a display method different for each target range. The photo sticker production apparatus according to 1 or 2. 4. The control unit according to claim 1, wherein the display control unit performs control so that at least one of a frame line and a region indicating the target range is displayed on the display unit by a different display method according to a shooting count number. 5. The photo sticker making apparatus as described. In the photo sticker creating method of the photo sticker creating device for creating the photo sticker,
By the photo sticker creation device,
A shooting step for shooting the user;
A range recognizes the face of the user in capturing a moving image of the user in capturing a moving image of a photographed the user, and image processing for capturing a moving image and capturing a still image of the user A display control step for controlling to display at least one of a frame line and a region indicating an image processing target range, which is a range for performing image processing, on the display unit in real time superimposed on the captured moving image or the image-processed moving image; ,
A storing step for storing the user 's captured still image captured by the capturing step at a predetermined timing;
A face recognition step for recognizing the face of the user in the target range of the captured moving image;
And image processing the captured video image of the target range the user's face is recognized by the processing of the face recognition step, the generated image processed moving image, the captured still image of the target range and image processing An image processing step for generating an image processed still image;
A selection step of selecting a sample synthesis image in which a model instead of a subject is arranged in a synthesis image to be synthesized with the image processed moving image;
According to the size of the model in the sample composition image, the image-processed moving image of the target range in which the user's face is recognized is scaled, and the image-processed of the target range scaled Combining a moving image with the combining image corresponding to the sample combining image selected by the processing of the selecting step, and generating a combined moving image;
An editing step of performing a predetermined editing process on the image-processed still image to generate an edited image;
Outputting the edited image, and
In the display control step, the same display unit as the synthesized moving image synthesized by the process of the synthesizing process is used for the captured moving image of the target range in which the user's face is recognized by the process of the face recognizing step. Or a photo sticker creation method that controls to display in real time on other display units. In a program for controlling a photo sticker creating apparatus that creates a photo sticker,
A shooting step for shooting the user;
A range recognizes the face of the user in capturing a moving image of the user in capturing a moving image of a photographed the user, and image processing for capturing a moving image and capturing a still image of the user A display control step for controlling to display at least one of a frame line and a region indicating an image processing target range, which is a range for performing image processing, on the display unit in real time superimposed on the captured moving image or the image-processed moving image; ,
A storing step for storing the user 's captured still image captured by the capturing step at a predetermined timing;
A face recognition step for recognizing the face of the user in the target range of the captured moving image;
And image processing the captured video image of the target range the user's face is recognized by the processing of the face recognition step, the generated image processed moving image, the captured still image of the target range and image processing An image processing step for generating an image processed still image;
A selection step of selecting a sample synthesis image in which a model instead of a subject is arranged in a synthesis image to be synthesized with the image processed moving image;
According to the size of the model in the sample composition image, the image-processed moving image of the target range in which the user's face is recognized is scaled, and the image-processed of the target range scaled Combining a moving image with the combining image corresponding to the sample combining image selected by the processing of the selecting step, and generating a combined moving image;
An editing step of performing a predetermined editing process on the image-processed still image to generate an edited image;
Outputting the edited image, and
In the display control step, the same display unit as the synthesized moving image synthesized by the process of the synthesizing process is used for the captured moving image of the target range where the user's face is recognized by the process of the face recognizing step Or the program which makes the said photo sticker preparation apparatus perform the process controlled so that it may display on another display part in real time.

Images