JP5488526B2 - Image processing apparatus and image processing method - Google Patents

Description

  In particular, the present invention relates to an image processing apparatus and an image processing method capable of creating a realistic composite image in which a person's shadow is reflected.

  There is known a photo sticker that takes a picture of a user, causes the user to edit the shot image, and prints and provides the edited image on sticker paper. Such a photo sticker is installed in an entertainment facility.

  The flow of one game provided by the photo-seal machine usually shoots a user in the shooting space as a subject, moves the user to the editing space, edits the image according to operations performed in the editing space, The edited image, which is an edited image, is printed on sticker paper and discharged. For example, the shooting space is partitioned from the outside by the casing itself of the photographic sticker or a curtain.

  In such a photo sticker machine, a function of extracting a user's area from an image captured by a camera during a shooting process in a shooting space, and synthesizing and displaying the extracted area and a synthesis image in real time. Some are equipped with. As a result, the user can view the scenery that does not actually exist in the shooting space and the synthesized image in which the user is synthesized, or can save it as a still picture.

  As a process for extracting a user's area from an image captured by a camera, a chroma process using a mask image is usually performed.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for changing the color tone in a boundary portion between a subject and a background image in a stepwise manner by using a mask pattern whose gradation is changed toward the outside of the contour of the subject. .

  In Patent Document 2, when a captured image and a background image are combined, the contour of the mask image obtained by binarizing the captured image is blurred, and the saturation and brightness of the background image are reflected so as to reflect the saturation and brightness of the background image. A technique for correcting the color tone of an outline is disclosed.

  In Patent Document 3, an image obtained by reducing a binarized mask image (reduced mask image) and an image obtained by enlarging the mask image (enlarged mask image) are created, and a glow is applied to a difference area between the reduced mask image and the enlarged mask image. Techniques for performing image processing such as (glow) effect and blur processing are disclosed.

Utility model registration No. 3058664 JP 2000-224410 A JP 2006-060719 A

  According to the above-described technique, it is possible to obtain a composite image in which the background image and the subject are smoothly synthesized by performing image processing such as blurring processing on the vicinity of the contour of the subject. The user's own shadow projected on the wall on the side disappears, resulting in an unnaturally finished image with no reality.

  The present invention has been made in view of such a situation, and makes it possible to create a realistic composite image in which a person's shadow is reflected.

The image processing apparatus of the present invention, based on the captured image, and to reflect the portion of the object caught on the captured image, a portion of the shadow of the object projected on the background curtain at the rear of the subject at the time of shooting, the background A mask image generating means for generating a first mask image that is transmitted at a predetermined transmittance that is partially different depending on the lightness of the color of the curtain, and the subject portion and the shadow portion of the subject from the photographed image; Is extracted using the first mask image, and is combined with a background image that is an image serving as a background of the subject.

  The mask image generating means detects the subject portion, the shadow portion of the subject, and other portions based on the color of each pixel of the captured image, and the first mask image is obtained. Can be generated.

  The synthesizing means includes, from a synthesized image obtained by synthesizing the subject portion extracted using the first mask image and the shadow portion of the subject with the background image, the subject portion and the The shadow portion of the subject can be extracted using the first mask image, and can be combined with the background image again.

  The synthesizing unit extracts the subject portion and the shadow portion of the subject from the photographed image using the first mask image, and generates a color background image that is an image having a color different from the background image. Using the composite image obtained by combining as the captured image, the subject portion and the shadow portion of the subject are extracted from the captured image using the first mask image and combined with the background image. be able to.

  The color background image may be an image of a shadow color projected onto an object having the same color as the color of the background image.

  The synthesizing unit can use the color background image in which the brightness is changed according to the shooting mode of the shot image.

  The mask image generation means generates a second mask image that transmits the portion of the subject and transmits a certain portion around the contour of the subject with a predetermined transmittance based on the captured image, The synthesizing means extracts a portion of the subject and a portion around the contour of the subject from the photographed image using the second mask image, and a color background that is an image having a color different from that of the background image. Using the first mask image to extract the subject part and the shadow part of the subject from the photographed image, using the first mask image as a composite image obtained by combining with the image as the photographed image, to the background image Can be synthesized.

  The synthesizing unit can adjust the color of the shadow portion of the subject before synthesizing the subject portion and the shadow portion of the subject with the background image.

  The mask image generating means processes the first mask image, and the synthesizing means uses the processed first mask image to obtain the subject portion and the shadow portion of the subject. Can be extracted.

  The mask image generation means includes processing for adjusting the contrast of the first mask image according to a tone curve as processing of the first mask image, and processing for blurring an outline of the first mask image. At least one of the processes can be performed.

According to the image processing method of the present invention, based on the photographed image, the portion of the subject that appears in the photographed image is transmitted, and the shadow portion of the subject that is projected onto the background curtain behind the subject at the time of photographing is used as the background. Generates a mask image to be transmitted with a predetermined transmittance that is partially different depending on the brightness of the color of the curtain, and extracts the subject portion and the shadow portion of the subject from the photographed image using the mask image And a step of synthesizing with a background image that is an image that becomes a background of the subject.

In the present invention, based on the photographed image, the portion of the subject that appears in the photographed image is transmitted, and the shadow portion of the subject projected on the background curtain behind the subject at the time of photographing is replaced with the color of the background curtain. A mask image to be transmitted with a predetermined transmissivity partially different depending on the brightness of the image is generated. Further, the portion of the subject and the shadow portion of the subject are extracted from the photographed image using the mask image, and are combined with a background image that is an image that is a background of the subject.

  According to the present invention, a realistic composite image in which a person's shadow is reflected can be created.

It is a block diagram which shows the structural example of an image process part. It is a figure which shows the mode of imaging | photography with a camera. It is a figure which shows the 1st example of a synthetic | combination process. It is a figure which expands and shows the picked-up image of FIG. It is a figure which expands and shows the mask image of FIG. It is a figure which shows the mask image produced | generated by the conventional mask image and a mask image production | generation part. It is a figure which expands and shows the synthesized image of FIG. It is a figure which shows the 2nd example of a synthetic | combination process. It is a figure which shows the 3rd example of a synthetic | combination process. It is a figure which shows the 5th example of a synthetic | combination process. It is a figure which shows the 6th example of a synthetic | combination process. It is a figure which shows the 1st example of the 2 step | paragraph synthetic | combination process in the case of using a different mask image by the 1st step | paragraph synthetic | combination process and a 2nd step | paragraph synthetic | combination process. It is a figure which shows the 2nd example of a 2 step | paragraph synthetic | combination process in the case of using a different mask image by the 1st step | paragraph synthetic | combination process and a 2nd step | paragraph synthetic | combination process. It is a figure which shows the example of a process of a mask image. It is a figure which shows the 3rd example of a 2 step | paragraph synthetic | combination process in case a different mask image is used by the 1st step | paragraph synthetic | combination process and a 2nd step | paragraph synthetic | combination process. It is a figure which shows the example of a process of a mask image. It is a figure explaining the example of the combination of the mask image used for a synthetic | combination process. It is a perspective view which shows the structural example of the external appearance of a photograph sealing machine. It is a perspective view which shows the external appearance of the photographic seal machine of the state which attached the curtain. It is the perspective view which looked at the external appearance of the photograph sealing machine from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging | photography part. It is a figure explaining the color of an imaging part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of an edit part. It is a figure which shows the structural example of a customer service part after the fact. It is a block diagram which shows the example of an internal structure of a photograph sealing machine. It is a flowchart explaining the process which provides a photograph sticker creation game. It is a flowchart explaining the main imaging | photography process performed in step S2 of FIG. It is a figure which shows the example of the screen display in imaging | photography space. It is a figure which shows the example of the screen display in imaging | photography space. FIG. 29 is a flowchart for describing subject image processing performed in step S <b> 3 of FIG. 28. FIG. It is a figure which shows the example of the screen display in imaging | photography space. It is a figure which shows the example of the screen display in imaging | photography space. It is a flowchart explaining the image processing of the picked-up image performed in step S5 of FIG. It is a figure which shows the example of the screen display in edit space. It is a figure which shows the example of the screen display in edit space. It is a perspective view which shows the example of a structure of the other external appearance of a photograph sealing machine. It is a perspective view which shows the external appearance of the photographic sealing machine of FIG. 38 of the state which attached the curtain. It is the perspective view which looked at the external appearance of the photograph sealing machine of FIG. 38 from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of the front of an edit part. It is a figure which shows the structural example of the side surface of an edit part. It is a figure which shows the structural example of a customer service part. It is a block diagram which shows the example of an internal structure of the photograph sticker of FIG. It is a flowchart explaining the process which provides a photograph sticker creation game.

Hereinafter, modes for carrying out the present invention will be described. The description will be made in the following order.
1. 1. About the synthesis process About the structure and operation of the photo seal machine

<About composition processing>
[Configuration example of image processing unit]
FIG. 1 is a block diagram illustrating a configuration example of the image processing unit 1001. The image processing unit 1001 in FIG. 1 is realized in the photo sticker 1 described later.

  The image processing unit 1001 includes a captured image acquisition unit 1011, a mask image generation unit 1012, a synthesis unit 1013, and a background image acquisition unit 1014.

  The captured image acquisition unit 1011 acquires a captured image that is an image captured by the camera. FIG. 2 is a view showing a state of shooting by a camera. As shown in FIG. 2, a shot image obtained by shooting a person standing in front of the wall with a panel or curtain as a background is a shot image. Acquired by the acquisition unit 1011.

  In the example of FIG. 2, two persons are shooting. In the image acquired by the captured image acquisition unit 1011, two persons are shown, and the background color of the two persons is the same as the color of the background curtain behind the two persons. The background curtain is, for example, a one-color curtain such as green. The captured image captured in this manner and acquired by the captured image acquisition unit 1011 is supplied to the mask image generation unit 1012 and the synthesis unit 1013.

  The mask image generation unit 1012 generates a mask image based on the captured image supplied from the captured image acquisition unit 1011 and outputs the mask image to the synthesis unit 1013. The mask image generated by the mask image generation unit 1012 is a mask image that transmits the human part with a transmittance of 100% and transmits the shadow of the person projected on the background curtain at the time of shooting with a predetermined transmittance. is there.

  The synthesizing unit 1013 uses the mask image generated by the mask image generating unit 1012 to extract a person portion and a shadow portion that appear in the captured image supplied from the captured image acquisition unit 1011. The synthesizing unit 1013 generates a synthesized image by synthesizing the person portion and the shadow portion extracted from the captured image with the background image supplied from the background image acquiring unit 1014.

  The composition of the image by the composition unit 1013 is performed such that the part extracted from the captured image is superimposed on the background image supplied from the background image acquisition unit 1014. The composite image includes a shadow portion of the person.

  The background image acquisition unit 1014 acquires an image of a predetermined color such as white or an image with a pattern, and outputs the acquired image as a background image to the synthesis unit 1013. The background image is an image having the same size as the size (number of pixels) of the photographed image, and is prepared in advance.

  By combining with a mask image that can extract the shadow part of the person with a predetermined transmittance, the shadow part of the person can be included in the composite image, and the background image is actually taken as the background It is possible to create a realistic and natural composite image.

[First example of composition processing]
FIG. 3 is a diagram illustrating a first example of the composition processing by the image processing unit 1001.

  As shown in FIG. 3, using a mask image generated based on a photographed image, a person part and a shadow part are extracted from the photographed image, and the extracted person part and shadow part are combined with a background image. As a result, a composite image is generated. Each image will be described.

  FIG. 4 is an enlarged view of the captured image of FIG. The photographed image shows two persons, and outside the outline of the person and near the outline of the person, the shadow of the person projected on the background curtain at the time of shooting is shown in some places. As shown with shadows in FIG. 4, many shadows appear between two persons or between the legs of each person.

  In addition, a background curtain appears in a portion outside the outline of the person in the photographed image. The color of the part where the background curtain is reflected is the same color as the color of the background curtain except for the part where the shadow of the person is reflected. In FIG. 4, a portion indicated by an oblique grid indicates a portion where the background curtain is reflected. Since it is a shadow of a person projected on the background curtain, the color of the shadow portion is a color that is slightly darker than the color of the background curtain.

  FIG. 5 is an enlarged view of the mask image of FIG. When the captured image of FIG. 4 is acquired by the captured image acquisition unit 1011, the mask image generation unit 1012 includes a portion of the captured image that has the same color as the color of the background curtain and a color in which the color of the background curtain is slightly darkened. And other color portions are detected based on the pixel value of each pixel.

  The mask image generation unit 1012 has a transmittance of 0% for the portion of the same color as the color of the background curtain, a transmittance of a portion where the color of the background curtain is slightly darkened, a predetermined transmittance, and a portion of the other colors By making the transmittance of 100% 100%, a mask image as shown in FIG. 5 is generated. The portions other than the color portion of the background curtain and the color portion where the color of the background curtain is slightly darker are portions where a person is reflected.

  In the mask image shown in FIG. 5, the black portion represents the same color as the background curtain color, that is, the portion having a transmittance of 0%, and the black and white mixed portion represents the background curtain. The portion of the color where the color is slightly darkened, that is, the portion where the transmittance is a predetermined transmittance is shown. A white portion (a portion that appears to have a thin check pattern depending on how it is seen) represents a person portion, that is, a portion having a transmittance of 100%.

  The mask image generation unit 1012 generates a mask image by changing the transmittance of the corresponding part according to the darkness of the color of the background curtain that appears in the captured image. The part where the color of the darker background curtain is detected, i.e., the part where the lightness is low, has a higher transmittance, and the part where the lighter background curtain color is detected, i.e., the part where the lightness is high, The transmittance decreases according to the brightness.

  Of the mask image generated by the mask image generation unit 1012, the transmittance of the portion corresponding to the portion where the background curtain is reflected in the captured image is not a uniform transmittance as a whole. Depending on the difference, the transmittance will be different. For example, when a photographed image is taken with illumination from above, the transmittance of the portion corresponding to the upper part of the image where the color of the background curtain with higher brightness is detected becomes lower and more The transmittance of the portion corresponding to the lower part of the image where the color of the background curtain with low lightness is detected is higher, and as a result, the transmittance is different in the upper and lower portions in the mask image generated by the mask image generation unit 1012. It will be.

  As described above, the mask image is generated by setting the transmittance of the portion where the same color as the background curtain color is detected to 0%. According to the conventional mask image generation method, the brightness range of the color to be detected as the background curtain color is wide, and the portion where the transmittance is 0% is relatively wide, whereas the mask image generation is Since the portion 1012 narrows the brightness and detects a portion having the same color as the color of the background curtain, the mask image in which the portion where the transmittance is 0% is narrower than the mask image generated by the conventional method. Is generated.

  FIG. 6 is a diagram illustrating a conventional mask image and a mask image generated by the mask image generation unit 1012. The left side of FIG. 6 represents a conventional mask image, and the right side represents a mask image generated by the mask image generation unit 1012.

  As shown on the left side of FIG. 6, in a conventional mask image, a portion having a certain width that surrounds the entire contour of a person is a portion having a predetermined transmittance, but is generated by a mask image generation unit 1012. In the mask image, the portion outside the outline of the person and where the shadow of the person is actually reflected becomes a portion having a predetermined transmittance. For example, when shooting is performed in an environment where it is difficult for light to hit under a person, a shadow image is generated around the lower body of the person, and a mask image in which the shadow portion has a predetermined transmittance is generated. .

  FIG. 7 is an enlarged view of the composite image of FIG. The synthesizing unit 1013 uses the mask image of FIG. 5 to extract a portion where a person is reflected and a portion where a shadow of the person actually projected on the background curtain is captured from the captured image, and the extracted image Is combined with the background image supplied from the background image acquisition unit 1014 to generate the combined image of FIG.

  The synthesizing unit 1013 performs synthesis by superimposing the person portion and the shadow portion extracted from the photographed image on the background image. Since the shadow part is extracted from the photographed image in a form having a predetermined transmittance, the pixel value of the shadow part of the composite image is the pixel value of the pixel of the shadow part extracted from the photographed image, It becomes a pixel value obtained by mixing the pixel value of the corresponding pixel of the background image in accordance with the transmittance.

  As shown in FIG. 7, the composite image includes two persons extracted from the captured image by using the mask image and two shadows projected on the background curtain at the time of capturing. Further, the part other than the person and the shadow part is the color part of the background image. In FIG. 7, the white portion that is the background of the person represents that the portion is the color portion of the background image.

  By using the mask image generated as described above, it is possible to extract from the photographed image a portion where the person is reflected and a shadow portion of the person actually projected onto the background curtain. Also, depending on how shadows appear in the captured image, the number of semi-transparent areas (areas with a predetermined transmittance) will increase, thereby obtaining a composite image in which the boundary between the background and the person is smoothly blended. Is possible.

  Furthermore, it is possible to generate a realistic composite image in which a person's shadow is reflected in the background image.

[Second example of composition processing]
FIG. 8 is a diagram illustrating a second example of the composition processing by the image processing unit 1001. In the combining process of FIG. 8, the process of extracting a person part and a shadow part using a mask image and combining them with another image is repeated twice.

  The first-stage synthesis process shown in the upper part of FIG. 8 is the same process as the synthesis process shown in FIG. A combined image obtained by the combining process shown in FIG.

  When the composite image is generated by the composite processing in FIG. 8, the composite unit 1013 performs the second-stage composite processing from the composite image A instead of the photographed image, A shadow portion is extracted using a mask image. The mask image used for the second stage compositing process is the same image as the mask image used for the first stage compositing process. Further, the background image used for the second-stage composition process is the same image as the background image used for the first-stage composition process.

  The synthesizing unit 1013 again synthesizes the person portion and the shadow portion extracted from the synthesized image A using the same mask image as the mask image used in the first-stage synthesis process, and generates the synthesized image B. .

  In the case of the composition process shown in FIG. 3, the color of the shadow portion that appears in the composite image is a color obtained by mixing the background curtain color with a slightly darker background curtain color. For example, the color of the shadow part extracted from the photographed image is in front of the background with the same color as the background image color, such as the shadow part color is dark green and the background image color is red. If the color is different from the color of the shadow that appears when shooting while standing, the shadow that appears in the composite image will appear to be an uncomfortable shadow.

  As shown in FIG. 8, after the composite image A is generated by the first-stage composite processing, a human part and a shadow part are extracted from the composite image A using the mask image and composited with the background image again. Thus, it is possible to make the color of the shadow appearing in the composite image B a color that does not cause a sense of incongruity.

  Hereinafter, the combination process in which the image combination is repeated twice as shown in FIG. 8 is referred to as a two-step combination process.

[Third example of composition processing]
FIG. 9 is a diagram illustrating a third example of the composition processing by the image processing unit 1001. In the composition process of FIG. 9, an image different from the background image used for the second-stage composition process is used as the background image during the first-stage composition process.

  When a composite image is generated by the composite processing in FIG. 9, the background image acquisition unit 1014 acquires a background image and a shadow color background image corresponding to the background image, and outputs the background image to the composition unit 1013. The shadow color background image is, for example, an image of a color assumed as a shadow color that appears when standing in front of a plane of the same color as the color of the background image, and is associated with the background image to obtain a background image acquisition unit 1014. Are managed in advance. The color of the shadow color background image is a color different from the color of the background curtain. For example, the color of the background image is slightly darkened. In the shadow color background image and the composite image in FIG. 9, the color of the portion indicated by the vertical and horizontal grids represents the same color as the color of the shadow color background image.

  The first stage compositing process shown in the upper part of FIG. 9 is the same as the first stage compositing process of FIG. 8 except that a shadow color background image is used instead of the background image.

  As the first-stage composition processing, the composition unit 1013 extracts a person part and a shadow part from the photographed image using a mask image generated based on the photographed image, and extracts the extracted person part and shadow part. Is combined with the shadow color background image to generate a composite image C. The color of the shadow portion shown in the composite image C is a color obtained by mixing the color of the shadow portion extracted from the photographed image and the color of the shadow color background image.

  In addition, as indicated by the tip of arrow # 11, the synthesizing unit 1013 extracts a human part and a shadow part from the synthetic image C using a mask image as the second-stage synthesizing process. The synthesizing unit 1013 synthesizes the person portion and the shadow portion extracted from the synthesized image C using the same mask image as the mask image used for the first-stage synthesizing process, and generates a synthesized image D.

  In this way, an image of a color suitable for the background image is prepared as a shadow color background image, and the color of the shadow color background image is used as the shadow color of the person instead of the color of the background image. It is possible to make the color of the shadow appearing a color that does not feel uncomfortable with the color of the background image.

  For example, if the background image is pink, when the gray shadow part extracted from the photographed image is combined with the background image, the shadow part looks dirty, but the red or brown or other pink By using a dark color image as a shadow color background image, it is possible to cause a red or brown shadow to appear in the background image without any sense of incongruity when it is combined with a pink background image.

[Fourth Example of Composition Processing]
You may make it change the color of a shadow color background image according to imaging | photography mode.

  For example, it is assumed that a backlight mode, which is a mode for capturing an image with a backlight atmosphere, and a backlight mode, which is a mode for capturing an image with a backlight environment, are prepared as shooting modes. A user as a subject (a user of the photo sticker 1 described later) selects one of the backlight mode and the follow light mode and performs photographing.

  For example, when the backlight mode is selected, a shadow color background image similar to the shadow color background image used when the follow light mode is selected, but a lighter color image is selected. The first-stage synthesis process described with reference to the reference is performed.

  Further, when the follow light mode is selected, an image having a color similar to that of the shadow color background image used when the backlight mode is selected as the shadow color background image but having a dark color is selected. The first-stage synthesis process described with reference to the reference is performed.

  For example, if the background image is pink, a dark brown shadow background image is used in the follow light mode, and a bright red shadow background image is used in the backlight mode. The background image acquisition unit 1014 acquires such a shadow color background image according to the shooting mode, and outputs it to the synthesis unit 1013.

  The color of the shadow portion that appears in the composite image that is finally obtained by performing the second-stage compositing process is a bright color when in the backlight mode, and a dark color when in the follow light mode. Become.

  As a result, it is possible to express a shadow that appears when shooting with backlight and a shadow that appears when shooting with direct light, and it is possible to generate a realistic composite image.

[Fifth example of composition processing]
FIG. 10 is a diagram illustrating a fifth example of the composition processing by the image processing unit 1001. In the synthesis process of FIG. 10, the first-stage synthesis process is performed using a mask image different from the mask image used for the second-stage synthesis process.

  When the composite image is generated by the composite processing in FIG. 10, the mask image generation unit 1012 detects the same color portion as the background curtain and the other color portions based on the pixel values of the captured image.

  The mask image generation unit 1012 allows a portion other than the same color portion as the background curtain to be a portion of a person, transmits the portion of the person with a transmittance of 100%, and, for example, constants the entire periphery of the person along the outline of the person A mask image that transmits a portion having a predetermined width with a predetermined transmittance is generated. The transmittance of the portion where the background curtain is reflected is 0%. Hereinafter, as appropriate, a mask image in which the transmittance of the person portion is 100%, the transmittance of a certain width portion secured along the contour of the person is a predetermined transmittance, and the transmittance of the background curtain portion is 0%. Is called a conventional mask image.

  The first stage compositing process shown in the upper part of FIG. 10 is the same as the first stage compositing process of FIG. 9 except that the mask image used for image extraction is different.

  The composition unit 1013 uses a conventional mask image generated based on the photographed image as a first-stage composition process, and extracts a person part and a part around the person from the photographed image. The synthesized image E is generated by synthesizing the portion around the person with the shadow color background image. The color of the portion around the person shown in the composite image E is a color obtained by mixing the color of the portion around the person extracted from the photographed image and the color of the shadow color background image.

  Further, as indicated by the tip of arrow # 21, the synthesizing unit 1013 performs a mask image (the same mask image as the mask image in FIG. 9) from the synthesized image E as a second-stage synthesizing process. ) To extract. The synthesizing unit 1013 synthesizes the person portion and the shadow portion extracted from the synthesized image E using a different mask image from the conventional mask image used in the first-stage synthesis process, and generates a synthesized image F. To do.

  Since the conventional mask image transmits a portion around the person with a predetermined transmittance, the color around the person shown in the composite image E includes the color of the shadow color background image. By extracting the human part and the shadow part from the composite image E using the mask image and combining it with the background image, it is possible to incorporate a shadow of a color suitable for the color of the background image into the background image. become.

[Sixth example of composition processing]
FIG. 11 is a diagram illustrating a sixth example of the composition process performed by the image processing unit 1001. In the composition process of FIG. 11, a process for adjusting the shadow color is performed between the first-stage composition process and the second-stage composition process.

  Although the case where the shadow color is adjusted between the first-stage composition process and the second-stage composition process in FIG. 8 will be described, the same process is also performed in the two-stage composition process in FIGS. It is possible to perform the process between the stage synthesis process and the second stage synthesis process.

  When generating a combined image by the combining process of FIG. 11, the mask image generating unit 1012 reverses the white area and the black area of the mask image generated based on the captured image, so that the background mask image as illustrated in FIG. 11 is obtained. Is generated.

  The synthesis unit 1013 completes the background portion (the portion other than the person) based on the background mask image from the synthesized image A obtained by the first-stage synthesis processing after the first-stage synthesis processing in FIG. Extract. The synthesizing unit 1013 adjusts the color of the extracted background part, and synthesizes the background part and the person part whose color has been adjusted, thereby generating a composite image A ′. Adjusting the color of the background portion other than the person portion extracted using the background mask image also adjusts the color of the shadow portion of the person.

  Adjustment of the color of the background portion is performed by adjusting at least one of hue, saturation, and brightness. How to adjust the color of the background portion is determined in advance in association with the background image, for example, and is adjusted so that the color is suitable as a shadow color on the same color plane as the background image color. Is done. The synthesizing unit 1013 performs the second-stage synthesizing process in FIG.

  As described above, by adjusting the hue, saturation, and brightness of the background portion extracted from the synthesis result of the first-stage synthesis process, the second-stage synthesis process can also be performed to obtain a suitable color shadow. It can be reflected in the image.

[Seventh example of composition processing]
A mask image obtained by processing the mask image used for the first-stage compositing process may be used as the mask image used for the second-stage compositing process. The processing of the mask image includes the following processing.
1. 1. Contrast adjustment using tone curve 2. Blur processing 3. Blur processing for shadows 4. Contrast adjustment and blurring using tone curve Contrast adjustment using tone curves and blurring for shadows

1. FIG. 12 shows a case where a mask image obtained by adjusting the contrast of the mask image used in the first-stage compositing process is used as the mask image used in the second-stage compositing process. It is a figure which shows the example of 2 step | paragraph synthetic | combination processes. The process of FIG. 12 is the same as the process of FIG. 9 except that the mask image used for the second-stage compositing process is different.

  In other words, as the first-stage composition processing, the composition unit 1013 extracts a person part and a shadow part from the photographed image using a mask image generated based on the photographed image, and extracts the extracted person part and shadow. Is combined with the shadow color background image to generate a composite image C.

  The mask image generation unit 1012 generates the mask image MA1 by adjusting the contrast of the mask image used for the first-stage compositing process, as indicated by arrow # 31. The mask image MA1 is, for example, an image in which the area of a predetermined transmittance, that is, a shadow portion is different from that of the mask image used in the first-stage composition process, or the transmittance at each position is different. It is an image.

  As indicated by the tip of arrow # 32, the synthesizing unit 1013 extracts a human part and a shadow part from the synthesized image C using the mask image MA1 as the second stage synthesizing process. The synthesizing unit 1013 synthesizes the person portion and the shadow portion extracted from the synthesized image C using the mask image MA1 with the background image to generate a synthesized image G.

  By adjusting the contrast of the mask image, the darkness and spread of the shadow can be adjusted. For example, it is possible to generate a composite image in which the presence of the shadow is conspicuous.

2. Blur Processing FIG. 13 shows a two-stage composition when a mask image obtained by performing a blur process on the mask image used in the first-stage composition process is used as the mask image used in the second-stage composition process. It is a figure which shows the example of a process. The process of FIG. 13 is the same as the process of FIG. 9 except that the mask image used for the second-stage compositing process is different.

  In other words, as the first-stage composition processing, the composition unit 1013 extracts a person part and a shadow part from the photographed image using a mask image generated based on the photographed image, and extracts the extracted person part and shadow. Is combined with the shadow color background image to generate a composite image C.

  The mask image generation unit 1012 performs a blurring process on the mask image used in the first-stage compositing process as shown by an arrow # 41, and generates a mask image MA2. The mask image MA2 is, for example, an image in which the outline of the person and the outline of the shadow are blurred (contrast is low) compared to the mask image used in the first-stage composition process.

  As indicated by the tip of arrow # 42, the synthesizing unit 1013 extracts a human part and a shadow part from the synthesized image C using the mask image MA2 as the second stage synthesizing process. The synthesizing unit 1013 synthesizes the person portion and the shadow portion extracted from the synthesized image C using the mask image MA2 with the background image to generate a synthesized image H.

  Thereby, noise included in the mask image can be removed, and a smooth shadow can be extracted from the composite image C and combined with the background image. Also, a soft atmosphere composite image can be generated by blurring the outline and shadow of a person.

3. Blur Processing for Shadow Part FIG. 14 is a diagram illustrating an example of mask image processing. The process of FIG. 14 makes it possible to blur only the shadow portion while leaving the outline of the person, unlike blurring the entire mask image as shown in FIG.

  First, as shown by an arrow # 51, the mask image generation unit 1012 performs blurring processing on the mask image used in the first-stage composition processing, thereby blurring the outline of the person and the shadow. A certain mask image MA2 is generated. The mask image MA2 in FIG. 14 is the same image as the mask image MA2 in FIG.

  Further, as indicated by arrow # 52, the mask image generation unit 1012 obtains a difference (absolute value) between the mask image used in the first-stage compositing process and the mask image MA2, and generates a difference image. . Of the difference image shown at the tip of arrow # 52, the black portion represents a portion where there is no difference between the mask image used in the first-stage compositing process and the mask image MA2, and the white portion represents a portion where there is a difference. Represent.

  The mask image generation unit 1012 generates a mask image MA3 based on the mask image, the difference image, and the mask image MA2 used for the first-stage composition process, as indicated by arrows # 53, # 54, and # 55. . For example, the mask image generation unit 1012 extracts the contour of the person included in the mask image used in the first-stage composition process using the difference image, and synthesizes the extracted contour with the mask image MA2, thereby mask image MA3. Is generated.

  In the mask image MA3, the outline of the person is clearer than that of the mask image MA2, but the shadow outline is blurred as with the shadow outline of the mask image MA2. The synthesizing unit 1013 performs the second stage synthesizing process of FIG. 13 using the mask image MA3 generated by the mask image generating unit 1012 in this way.

  Thereby, noise included in the mask image can be removed, and a smooth shadow can be extracted and synthesized with the background image. Also, by blurring only the shadow, it is possible to generate a composite image in which the outline of the person is clear but the shadow is soft.

4). Contrast adjustment and blurring process using tone curve Fig. 15 shows the mask image used for the second stage compositing process. After adjusting the contrast of the mask image used for the first stage compositing process, further blurring process is performed. It is a figure which shows the example of a 2 step | paragraph synthetic | combination process in the case of using the mask image obtained by this. The process of FIG. 15 is the same as the process of FIG. 9 except that the mask image used for the second-stage compositing process is different.

  As the first-stage composition processing, the composition unit 1013 extracts a person part and a shadow part from the photographed image using a mask image generated based on the photographed image, and extracts the extracted person part and shadow part. Is combined with the shadow color background image to generate a composite image C.

  The mask image generation unit 1012 generates the mask image MA4 by adjusting the contrast of the mask image used for the first-stage compositing process and performing the blurring process as indicated by an arrow # 61. The mask image MA4 is, for example, an image in which the area of a predetermined transmittance, that is, a shadow portion is different from that of the mask image used in the first-stage compositing process, or the transmittance at each position is different. It is an image. Further, the mask image MA4 is an image in which the outline of the person and the outline of the shadow are blurred as compared with the mask image used in the first-stage composition process.

  As indicated by the tip of arrow # 62, the synthesizer 1013 extracts a human part and a shadow part from the synthesized image C using the mask image MA4 as the second-stage synthesize process. The synthesizing unit 1013 synthesizes the person portion and the shadow portion extracted from the synthesized image C using the mask image MA4 with the background image to generate a synthesized image I.

  By adjusting the contrast of the mask image, the darkness and spread of the shadow can be adjusted. For example, it is possible to generate a composite image in which the presence of the shadow is conspicuous. Further, noise included in the mask image can be removed, and a smooth shadow can be extracted and combined with the background image.

5. FIG. 16 is a diagram illustrating an example of mask image processing. FIG. 16 is a diagram illustrating an example of mask image processing.

  First, the mask image generation unit 1012 performs a blurring process on the mask image MA1 generated by adjusting the contrast of the mask image used in the first-stage compositing process, and as shown by an arrow # 71, A mask image MA4 that is an image in which the contour and the contour of the shadow are blurred is generated. The mask image MA1 in FIG. 16 is the same image as the mask image MA1 in FIG. 12 generated by adjusting the contrast of the mask image used in the first-stage compositing process. Further, the mask image MA4 in FIG. 16 is the same image as the mask image MA4 in FIG.

  Further, the mask image generation unit 1012 generates a difference image representing a difference between the mask image MA1 and the mask image MA4, as indicated by an arrow # 72. Of the difference image indicated by the tip of arrow # 72, the black portion represents a portion where there is no difference between the mask image MA1 and the mask image MA4, and the white portion represents a portion where there is a difference.

  The mask image generation unit 1012 generates a mask image MA5 based on the mask image MA1, the difference image, and the mask image MA4, as indicated by the tip of arrows # 73, # 74, and # 75. For example, the mask image generation unit 1012 generates the mask image MA5 by extracting the contour of the person included in the mask image MA1 using the difference image and combining the extracted contour with the mask image MA4.

  In the mask image MA5, the outline of the person is clearer than that of the mask image MA4, but the shadow outline is blurred as in the case of the shadow outline of the mask image MA4. The synthesizing unit 1013 performs the second stage synthesizing process in FIG. 15 using the mask image MA5 generated by the mask image generating unit 1012 in this way.

  Accordingly, the darkness and spread of the shadow can be adjusted by adjusting the contrast of the mask image. For example, it is possible to generate a composite image in which the presence of the shadow is conspicuous. Also, by blurring only the shadow, it is possible to generate a composite image in which the outline of the person is clear but the shadow is soft.

[Eighth Example of Composition Processing]
FIG. 17 is a diagram illustrating an example of a combination of mask images used for the synthesis process. Here, the mask image used for the first-stage compositing process will be described as mask image X, and the mask image used for the second-stage compositing process will be described as mask image Y.

  In the above description, the mask image obtained by processing the mask image used in the first-stage compositing process is used in the second-stage compositing process. As such, the mask generated based on the captured image is used. It is also possible to use the mask image obtained by processing the image for the first-stage compositing process. It is also possible to use a mask image obtained by processing a mask image generated based on a captured image in both the first-stage synthesis process and the second-stage synthesis process.

  For example, as the mask images X and Y, the first-stage synthesis process and the second-stage synthesis process can be performed using the mask image MA5 generated by the process of FIG.

  Further, the first-stage synthesis process and the second-stage synthesis process can be performed using any of the mask images MA1 to MA4 described above as the mask images X and Y, respectively.

  By using the same mask image for the first-stage synthesis process and the second-stage synthesis process, it is possible to generate a synthesized image in which a person is synthesized in a more natural state. If the mask image used in the first-stage compositing process is different from the mask image used in the second-stage compositing process, for example, the shadow portion of the mask image used in the second-stage compositing process is the shadow of the mask image used in the first-stage compositing process. If it is wider than the area of, the color of the background image (color of the shadow color background image) included in the composite image obtained by the first-stage composite processing will be as if it is bordered by the outline of the person There is, but can prevent such a thing.

<About the structure and operation of the photo sticker>
Next, the configuration and operation of a photo sticker that performs the above-described composition processing will be described.

[External structure of photo sticker]
FIG. 18 is a perspective view showing a configuration example of the appearance of the photographic sealing machine 1 according to an embodiment of the present invention. The image processing unit 1001 in FIG. 1 is realized in the photographic sticker 1 in FIG.

  The photo sticker 1 is a game machine that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker 1 is installed in a store such as a game center. There may be one user or a plurality of users.

  The user who plays the game provided by the photo sticker 1 pays the price, takes a picture of himself as a subject, and performs handwriting on the image to be edited selected from the shot images obtained by shooting. Editing is performed using an editing function for combining line drawings and stamp images, thereby making the photographed image rich and colorful. The user receives the sticker sheet on which the edited image is printed and ends the series of games.

  As shown in FIG. 18, the photo sticker 1 is mainly composed of a photographing unit 11, an editing unit 12, and a subsequent customer service unit 13. The photographing unit 11 and the editing unit 12 are installed in contact with each other, and the editing unit 12 and the subsequent customer service unit 13 are installed in contact with each other.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed with a predetermined distance apart, and photographing processing is performed in a photographing space that is a space formed between the photographing unit 21 and the background unit 22. The state of photographing in FIG. 2 shows the state of photographing in the photographing space of the photo sticker 1.

  The photographing unit 21 is a device that allows a user to perform photographing processing. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing process. The front panel 41 of the photographing unit 21 that constitutes a surface in which the photographing space is desired in front is provided with a touch panel monitor used by the user during photographing processing. When the left side is the left side and the right side is the right side as viewed from the user in the imaging space, the left side of the imaging unit 21 is configured by the side panel 42A, and the right side is configured by the side panel 42B.

  The background unit 22 is attached to the left end of the rear panel 51 and the rear panel 51, which are plate-like members positioned on the rear side of the user who is performing the photographing process facing the front, and is a plate having a narrower width than the side panel 42A. A side panel 52A that is a plate-shaped member and a side panel 52B (FIG. 20) that is a plate-like member that is attached to the right end of the back panel 51 and has a narrower width than the side panel 42B.

  The side panel 42A constituting the left side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided on substantially the same plane, and their upper portions are connected by a connecting part 23A that is a plate-like member. Further, the side panel 42B constituting the right side surface of the photographing unit 21 and the side panel 52B of the background portion 22 are provided on substantially the same plane, and their upper portions are connected by a connecting portion 23B which is a plate-like member.

  An opening formed by being surrounded by the side panel 42 </ b> A of the photographing unit 21, the connecting part 23 </ b> A, and the side panel 52 </ b> A of the background part 22 becomes an entrance G <b> 1 of the photographing space. An opening formed by being surrounded by the side panel 42B of the imaging unit 21, the connecting unit 23B, and the side panel 52B of the background unit 22 is also an entrance G2 of the imaging space.

  The background curtain unit 25 is provided above the background portion 22 so as to be supported by the back panel 51, the side panel 52A, and the side panel 52B. The background curtain unit 25 stores a plurality of roll-up type background curtains having different colors or patterns and used for the background. The background curtain unit 25 operates in conjunction with photographing by a camera or the like provided in the photographing unit 21. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound up.

  A plurality of curtains may be used as one blackboard curtain, and may be prepared as an elevating type background curtain. In addition, a black curtain is attached to the back of the shooting space in advance, and multiple types of background images are prepared so that the user can synthesize the background image desired by the user in the editing process. May be.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed above the photographing space, and the ceiling strobe unit 24 covers the part of the opening. Provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. A fluorescent lamp is provided inside the strobe constituting the ceiling strobe unit 24, and also functions as illumination of the photographing space.

  As shown in FIG. 19, in the opening formed above the imaging space, the front part across the ceiling strobe unit 24 is covered with a ceiling front curtain 61, and the rear part is covered with a ceiling rear curtain 62. At least the inner color of the ceiling front curtain 61 is a dark color such as black, and at least the inner color of the ceiling rear curtain 62 is a bright color such as white.

  Further, as shown in FIG. 19, a side curtain 63 is attached to the entrance G1 of the imaging space. A side curtain (not shown) is also attached to the doorway G2, which is the doorway on the opposite side. At least the inner color of the side curtains attached to the entrances G1 and G2 of the imaging space is a dark color such as black.

  Returning to the description of FIG. 18, the editing unit 12 is a device that allows the user to perform an editing process that is a process of editing an image obtained by the shooting process. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface thereof is in contact with the back surface of the front panel 41 of the photographing unit 21. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by the user during editing processing.

  If the configuration of the editing unit 12 shown in FIG. 18 is the configuration on the front side, the editing unit 12 is used for editing processing on the front side and the back side so that two sets of users can perform editing processing simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the left side of the slope 72, a support portion 73A that has a columnar shape and supports one end of the lighting device 74 is provided. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the support portion 73A. A support portion 73 </ b> B (FIG. 20) that supports the other end of the lighting device 74 is also provided on the right side of the slope 72.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and both ends of the remaining one rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back of the editing unit 12 surrounded by the curtain attached to the curtain rail 26 are editing spaces in which the user performs editing processing.

  FIG. 20 is a perspective view of the photographic sealing machine 1 as seen from another angle.

  The subsequent customer service unit 13 is a device that allows the user to perform the subsequent customer service process. Subsequent customer service processing includes processing for transmitting a photographed image or edited image to a mobile terminal such as a mobile phone, processing for allowing a user to play a mini game, processing for answering a questionnaire, and the like.

  As shown in FIG. 20, the post-service customer unit 13 has a plate-like housing having a predetermined thickness, and is connected to the editing unit 12 so that the back surface thereof is in contact with the left side surface of the editing unit 12. Provided. On the front side of the post-service unit 13, there are provided a tablet built-in monitor used by the user at the time of post-service processing, a discharge port through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the front-end customer service unit 13 becomes a rear-end customer service space where a user waiting for printing on the sticker paper to perform post-service processing.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 21 is a plan view of the photo sticker 1 as viewed from above.

  The user of the photo seal machine 1 takes a picture formed between the photographing part 21 and the background part 22 from the doorway G1 as indicated by the white arrow # 1 or from the doorway G2 as indicated by the white arrow # 2. The camera enters the space A1 and performs a shooting process using a camera or a touch panel monitor provided in the shooting unit 21.

  The user who has finished the shooting process exits the shooting space A1 and moves to the editing space A2-1 using the doorway G1 as indicated by the white arrow # 3, or moves to the editing space A2-1 as indicated by the white arrow # 4. To leave the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing processing. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing processing at the same time.

  After the editing process is finished, printing of an image selected from the photographed image and the edited image is started. During printing of the image, the user who has finished the editing process moves from the editing space A2-1 to the subsequent customer service space A3 as indicated by the white arrow # 5 if the editing process has been performed in the editing space A2-1. Then, the customer service is processed after the fact. In addition, when the editing process is completed in the editing space A2-2, the user who has finished the editing process moves from the editing space A2-2 to the post-service area A3 as indicated by the white arrow # 6. Post service processing is performed in the customer service space A3.

  When the printing of the image is finished, the user receives the sticker paper from the outlet provided in the post-service section 13 and finishes a series of photo sticker creation games.

[Configuration of each device]
Next, the configuration of each device will be described.

  FIG. 22 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured by attaching a front panel 41, a side panel 42A, and a side panel 42B to a base unit 43 having a box shape.

  The front panel 41 is positioned in front of the user who performs the shooting process in the shooting space A1, and the side panel 42A and the side panel 42B are positioned on the left side and the right side of the user who performs the shooting process in the shooting space A1, respectively. The connecting portion 23A is fixed above the side panel 42A, and the connecting portion 23B is fixed above the side panel 42B.

  An imaging / display unit 81 is provided in the approximate center of the front panel 41. The photographing / display unit 81 includes a camera 91, a front strobe 92, and a touch panel monitor 93.

  The camera 91 is configured by an image sensor such as a CCD (Charge Coupled Device), and photographs a user in the photographing space A1. The moving image captured by the camera 91 is displayed on the touch panel monitor 93 in real time. An image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image). The camera shown in FIG. 2 corresponds to the camera 91 in FIG.

  The front strobe 92 provided with a light emitting surface so as to surround the camera 91 emits light in accordance with the photographing by the camera 91 like other strobes, and irradiates the vicinity of the user's face as a subject from the front.

  A touch panel monitor 93 provided on the lower side of the camera 91 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 93 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUI (Graphical User Interface) images and accepts a user's selection operation through the touch panel. ing. On the touch panel monitor 93, a moving image after an image such as a background is appropriately displayed is displayed.

  Further, the touch panel monitor 93 displays a composite image generated by the composite process at a predetermined timing such as during the photographing process.

  On the front panel 41, an upper strobe 82 is installed on the upper side with respect to the position of the photographing / display unit 81. A left strobe 83 is installed on the left side and a right strobe 84 is installed on the right side. A lower strobe 85 is provided at a position below the photographing / display unit 81 so that the upper surface of the base portion 43 protrudes partially.

  The upper strobe 82 irradiates the user from the upper front. The left strobe 83 irradiates the user from the left front, and the right strobe 84 irradiates the user from the right front. The lower strobe 85 irradiates the user from the lower front.

  The base unit 43 is also provided with a foot strobe 86 that irradiates the user's foot. The upper strobe 82, left strobe 83, right strobe 84, lower strobe 85, and foot strobe 86 are provided with fluorescent lamps. Used as illumination in the space A1.

  On the right side of the foot strobe 86, a coin insertion / return port 87 through which a user inserts money is provided.

  Spaces 43A and 43B formed on the left and right sides of the upper surface of the base portion 43 with the lower strobe 85 interposed therebetween are used as a luggage storage place for a user who performs photographing processing to place baggage and the like. For example, near the ceiling of the front panel 41, a speaker for outputting sound such as guidance sound for shooting processing, BGM (Back Ground Music), and sound effects is also provided.

  Of each part of the photographing unit 21 having such a configuration, the color of the part facing the photographing space A1 of the front panel 41, the side panel 42A, the side panel 42B, and the base part 43, and the connecting part 23A and the connecting part 23B. The inner color is a dark color such as black as shown in FIG. As described with reference to FIG. 19, the color inside the ceiling front curtain 61 attached to the opening in front of the ceiling of the photographing space A1 and the color inside the curtain attached to the entrances G1 and G2 are dark colors. For this reason, the color in front of the shooting space A1 is dark overall.

  As will be described later, the background unit 22 is provided with a strobe that irradiates the user in the shooting space A1 from the back side. By making the color in front of the shooting space A1 darker as a whole, it is possible to prevent the light from the strobe provided in the background portion 22 from being reflected in the shooting space A1 and irradiating the user. This makes it possible to shoot at the intended brightness.

  That is, of the light from the strobes provided at both ends of the background portion 22, reflection of light that does not hit the user can be prevented inside the side curtains attached to the entrances G1 and G2. In addition, reflection of light that does not hit the user among the light from, for example, the lower strobe 85 provided in front of the photographing unit 21 can be prevented inside the ceiling front curtain 61. Of the light from the left strobe 83 and the right strobe 84 provided in front of the photographing unit 21, reflection of light that does not hit the user can be prevented inside the side panel 42A and the side panel 42B.

  Further, as described with reference to FIG. 19, the color inside the ceiling rear curtain 62 attached to the opening behind the ceiling of the photographing space A1 is a bright color, and the color behind the photographing space A1 is generally bright. Become a color.

  By making the color behind the imaging space A1 bright overall, it is possible to reflect the light from the strobe provided in the imaging unit 21 within the imaging space A1 and irradiate the user from behind. By irradiating the user from behind and taking a picture, it is possible to take an image in which the contour of the user is reflected in a soft atmosphere, as in the case of taking a picture with backlight.

  FIG. 24 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  As described above, the background curtain unit 25 is provided above the back panel 51. Near the center of the background curtain unit 25, a back center strobe 101 that irradiates a user who is performing a photographing process in the photographing space A1 from the rear center is attached.

  A rear left strobe 102 that irradiates a user who is performing a photographing process in the photographing space A1 from the left rear is provided above the rear panel 51 and on the doorway G1 side. Further, a rear right strobe 103 that irradiates a user who is performing a photographing process in the photographing space A1 from the right rear is provided above the rear panel 51 and on the entrance / exit G2 side.

  FIG. 25 is a diagram illustrating a configuration example of the front side of the editing unit 12 (the editing space A2-1 side).

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of operation input using the touch pen 132A or 132B on a monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image selected as an image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  On the left side of the editing unit 12, a post-service unit 13 is provided.

  FIG. 26 is a diagram illustrating a configuration example of the front side of the post-service unit 13.

  A monitor 161 with a built-in tablet is provided at the upper center of the post-service section 13. A touch pen 162A is provided on the left side of the tablet built-in monitor 161, and a touch pen 162B is provided on the right side. Similarly to the tablet built-in monitor 131, the tablet built-in monitor 161 is configured by superimposing a tablet capable of performing an operation input using the touch pen 162A or 162B on a monitor such as an LCD. On the tablet built-in monitor 161, a screen used for post-service processing such as a mini game is displayed.

  A non-contact type IC reader / writer 163 is provided under the tablet built-in monitor 161, and a sticker paper discharge port 164 is provided under the non-contact type IC reader / writer 163. A speaker 165 is provided below the sticker paper discharge port 164.

  The non-contact type IC reader / writer 163 communicates with a non-contact type IC that is in close proximity, and reads data from the non-contact type IC and writes data to the non-contact type IC.

  In the sticker paper discharge port 164, sticker paper on which an image created by the user of the editing space A2-1 is edited, or the user of the editing space A2-2 performs the editing process. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

  The speaker 165 outputs sound such as guidance voice, BGM, and sound effects for the post-service processing.

[Internal configuration of photo sticker]
Next, the internal configuration of the photo sticker 1 will be described. FIG. 27 is a block diagram showing an example of the internal configuration of the photo sticker 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The overlapping description will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with the components of the photographing unit 208, the editing unit 209, the post-service unit 210, and the printing unit 211.

  In the control unit 201, an image processing unit 1001 having the configuration of FIG. 1 is realized by executing a predetermined program. A captured image obtained by capturing with the camera 91 is acquired by the captured image acquisition unit 1011 of the image processing unit 1001, and the background image and the shadow color background image stored in the storage unit 202 are the background image acquisition unit 1014. Obtained by

  The composite image generated by the combining unit 1013 of the image processing unit 1001 is supplied from the combining unit 1013 to the touch panel monitor 93 or the tablet built-in monitor 131 and displayed. The user can see the composite image in which his / her shadow is reflected.

  The storage unit 202 includes a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 208 includes a coin processing unit 221, a background control unit 222, an illumination control unit 223, a camera 91, a touch panel monitor 93, and a speaker 224 that are configured to perform imaging processing in the imaging space A1.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 87. When the coin processing unit 221 detects that a predetermined amount of coins such as 300 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The background control unit 222 raises and lowers the background curtain stored in the background curtain unit 25 according to the background control signal supplied from the control unit 201. The background curtain may be manually selected by the user.

  The illumination control unit 223 controls the light emission of each strobe in the imaging space A1 according to the illumination control signal supplied from the control unit 201.

  The camera 91 shoots according to the control by the control unit 201 and outputs an image obtained by the shooting to the control unit 201.

  The editing unit 209A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 231 provided on the front side of the editing unit 12 as a configuration for performing editing processing in the editing space A2-1. The editing unit 209B has the same configuration as the editing unit 209A, and performs editing processing in the editing space A2-2.

  The tablet built-in monitor 131 displays an editing screen according to control by the control unit 201, and detects a user operation on the editing screen. A signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The subsequent customer service unit 210 includes a tablet built-in monitor 161, touch pens 162 </ b> A and 162 </ b> B, a non-contact type IC reader / writer 163, and a speaker 165.

  The printing unit 211 includes a printer 241 and a sticker sheet unit 242 that are configured to perform printing processing. The printer 241 prints the photographed image or the edited image obtained by the editing process on the sticker paper stored in the sticker paper unit 242 attached to the printer 241 and discharges it to the sticker paper discharge port 164. The a posteriori customer service unit 210 and the printing unit 211 shown by being surrounded by a one-dot chain line are configured to perform a process for the user in the a posteriori customer service space A3.

[Operation of photo sticker]
Here, with reference to the flowchart of FIG. 28, the process of the photo sticker machine 1 that provides the photo sticker creation game will be described.

  In step S1, the control unit 201 of the photo sticker 1 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221 and waits until it is determined that the coin has been inserted. .

  If it is determined in step S1 that a coin has been inserted, in step S2, the control unit 201 controls the photographing unit 208 to perform the main photographing process. With this photographing process, photographing is performed with the user in the photographing space A1 as the subject. The main photographing process will be described later with reference to the flowchart of FIG.

  In step S3, the control unit 201 performs subject image processing. Various processes such as adjustment of the brightness of the photographed image obtained by the main photographing process are performed by subject image processing. The subject image processing will be described later with reference to the flowchart of FIG.

  In step S4, the control unit 201 guides the user in the shooting space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the touch panel monitor 93 of the photographing unit 208 or by outputting sound from the speaker 224.

  In step S5, the control unit 201 performs image processing of the captured image. The image processing of the captured image is processing for causing the user to select an image to be combined with the captured image selected as the image to be edited and combining the selected image with the captured image. Image processing of the captured image will be described later with reference to the flowchart of FIG.

  In step S6, the control unit 201 controls the editing unit 209A or the editing unit 209B to perform editing processing. The control unit 201 displays an editing screen on the tablet built-in monitor 131, and edits the captured image selected as the editing target in accordance with the editing operation by the user. When the editing is completed, the control unit 201 displays an image selection screen for printing on the tablet built-in monitor 131, and allows the user to select an image to be printed. On the screen for selecting an image to be printed, a photographed image and an edited image are displayed, and a predetermined number of images are selected from them.

  In step S7, the control unit 201 guides the user who has finished the editing process in the editing space A2-1 or the editing space A2-2 to move to the post-service space A3. The guidance of the movement to the post-service space A3 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231.

  In step S <b> 8, the control unit 201 controls the subsequent customer service unit 210 to perform the subsequent customer service process. For example, in the case where the process of transmitting a captured image or an edited image to a mobile terminal is performed as a post-service process, the control unit 201 displays an input screen for an e-mail address of the mobile terminal or a selection screen for an image to be transmitted on a tablet built-in monitor. 161, and an image is transmitted according to an operation by the user. In addition, when the process for causing the user to perform the mini game is performed as the post-service processing, the control unit 201 displays the screen of the mini game on the tablet built-in monitor 161. When performing the process of answering the questionnaire as the post-service processing, the control unit 201 displays the questionnaire screen on the tablet built-in monitor 161 and acquires the answer by the user.

  In parallel with the post-service processing in step S8, the control unit 201 performs printing processing in step S9. The control unit 201 outputs the image selected by the user to the printer 241 and prints it on a sticker sheet.

  When the printing is finished, in step S10, the printer 241 discharges the sticker paper on which the image is printed to the sticker paper discharge port 164 and finishes the process.

  Next, the main photographing process performed in step S2 of FIG. 28 will be described with reference to the flowchart of FIG.

  In step S <b> 21, the control unit 201 displays a reflection selection screen on the touch panel monitor 93 and accepts a reflection selection by the user. The image selection is selection of the image quality of the photographed image, such as hue and sharpness. The control unit 201 adjusts the image quality of the image captured by the camera 91 in accordance with the image selected by the user.

  In step S <b> 22, the control unit 201 displays a shooting method guidance screen on the touch panel monitor 93. After displaying the shooting method guidance screen, the control unit 201 controls the camera 91 to start capturing an image.

  In step S23, the control unit 201 displays the moving image captured by the camera 91 on the touch panel monitor 93 (performs live view display).

  FIG. 30 is a diagram illustrating an example of live view display. An image 501, which is a moving image captured by the camera 91, is displayed almost at the center of the live view display screen, and a message or the like for guiding how to take a pose is displayed around the image 501.

  An image 501 displayed on the live view display screen is, for example, a composite image obtained by performing the first-stage composition processing. The image processing unit 1001 of the control unit 201 performs first-stage composition processing using each image constituting the moving image captured by the camera 91 as a captured image. A composite image such as the composite image A in FIG. 8 or the composite image C in FIG. 9 generated by performing the first-stage composite processing is supplied to the touch panel monitor 93 and displayed as an image 501.

  A synthesized image obtained by performing the second-stage synthesis process may be displayed on a live view display screen. The background image used for the composition process may be selected by the user or may be automatically selected by the photo sticker 1.

  In step S <b> 24, the control unit 201 displays a countdown indicator on the touch panel monitor 93 and notifies the user of shooting timing.

  When the shooting timing comes, in step S25, the control unit 201 controls the camera 91 to perform shooting, and acquires a shot image that is a still image.

  In step S <b> 26, the control unit 201 displays the captured image on the touch panel monitor 93 and causes the user to check the captured result.

  FIG. 31 is a diagram illustrating an example of a shooting result confirmation screen. An image 511 that is a photographed image is displayed in the approximate center of the photographing result confirmation screen, and a message or the like that indicates that it is a photographing result is displayed around the image 511.

  An image 511 displayed on the shooting result confirmation screen is, for example, a composite image obtained by performing the second-stage composition processing. The image processing unit 1001 of the control unit 201 performs a two-stage composition process on the captured image captured by the camera 91 in accordance with the capturing timing. A composite image such as the composite image B of FIG. 8 or the composite image D of FIG. 9 that is finally generated by performing the two-stage composition processing is supplied to the touch panel monitor 93 and displayed as an image 511.

  In step S27, the control unit 201 determines whether or not shooting has been repeated a predetermined number of times. If the control unit 201 determines in step S27 that shooting has not been performed a predetermined number of times, the control unit 201 returns to step S23 and repeats the above processing.

  On the other hand, when it is determined in step S27 that the shooting has been repeated a predetermined number of times such as 6 times, in step S28, the control unit 201 determines whether or not it is within the shooting possible time. For example, if the time since the start of the main photographing process has not passed the time allocated to the main photographing process, it is determined that the time is within the photographing possible time.

  If it is determined in step S28 that the time is within the shootable time, the control unit 201 causes the touch panel monitor 93 to display a bonus shooting guide screen in step S29. The bonus shooting is shooting performed in a form different from the normal shooting performed in step S25. For example, a composite image is combined with a moving image captured by the camera 91 in real time, and an image of the combination result is obtained. Is displayed in live view.

  In step S <b> 30, the control unit 201 reads from the storage unit 202, for example, a shooting composition image that is a composition image to be combined with a moving image. The shooting composition image is not determined in advance, and the user may select a shooting composition image from a plurality of types of images.

  In step S <b> 31, the control unit 201 synthesizes a photographic composition image with each moving image captured by the camera 91, displays the composition result on the touch panel monitor 93, and performs live view display. Similar to the case described with reference to FIG. 30, the composite image obtained by the first-stage composition process or the composite image obtained by the second-stage composition process on the live view display screen at the time of bonus shooting. May be displayed.

  In step S32, the control unit 201 performs bonus shooting. That is, the control unit 201 displays a countdown indicator on the touch panel monitor 93 and notifies the user of the shooting timing.

  When it is time to shoot, in step S33, the control unit 201 controls the camera 91 to perform shooting and obtains a shot image.

  In step S34, the control unit 201 displays a photographed image obtained by the bonus photographing on the touch panel monitor 93, and allows the user to confirm the photographing result. Similarly to the case described with reference to FIG. 31, the composite image obtained by the two-step composition process may be displayed on the photographing result confirmation screen at the time of bonus photographing.

  After confirming the result of the bonus shooting, or when it is determined in step S28 that the time is not within the shooting possible time, the process returns to step S2 in FIG. 28 and the subsequent processing is performed.

  Next, the subject image processing performed in step S3 of FIG. 28 will be described with reference to the flowchart of FIG.

  In step S41, the control unit 201 causes the touch panel monitor 93 to display an eye size selection screen that is used to select the size of the user's eyes that appear in the captured image, and accepts selection by the user. For example, the control unit 201 selects a predetermined photographed image from a plurality of photographed images (images showing a user as a subject) obtained by the main photographing process, and the user's eyes appearing in the selected photographed image. Is detected. The control unit 201 generates a plurality of images with different eye sizes by changing the detected eye size, and displays the images on the eye size selection screen. The user can select the size of the eyes by looking at the image that he / she actually shows.

  FIG. 33 is a diagram illustrating an example of an eye size selection screen used to select the eye size of a subject (user) using a captured image in which the user himself is photographed.

  A captured image 521 obtained by the actual photographing process is displayed on the eye size selection screen. For example, as described with reference to FIG. 29, when the shooting is repeated six times, six shot images are obtained, and in the eye size selection screen, the shot images 521-1 to 6 that are six shot images are displayed. 521-6 is displayed at a position on the left side from the center of the screen.

  The captured images 521-1 to 521-6 are synthesized images that are finally obtained by, for example, two-stage synthesis processing.

  Above the captured images 521-1 to 521-6, it is shown that the size of the eyes can be confirmed by the captured images 521-1 to 521-6 in which the user himself is photographed. Please check with "is displayed.

  On the right side of the eye size selection screen, eye size selection buttons 522-1 to 522-3 are displayed in order from the top. On the eye size selection button 522-1, characters "natural eye" and an image of a model eye with a natural eye size are displayed. In the eye size selection button 522-2, characters "Patch Lee" and an image of a model eye having a slightly larger eye size (for example, about 10% larger than the natural size) are displayed. In addition, on the eye size selection button 522-2, a “recommended” character indicating that it is recommended to select an eye size of this size is displayed together with a heart-shaped figure.

  On the eye size selection button 522-3, characters “volume eye” and an image of a model eye having a relatively large eye size (for example, about 20% larger than the natural size) are displayed. In addition, an arrow from the top to the bottom is displayed on the right side of the eye size selection buttons 522-1 to 522-3, and the word “natural” is displayed above the arrow, and below the arrows. The word “big” is displayed. That is, the eye size increases as the eye size selection button 522-1, the eye size selection button 522-2, and the eye size selection button 522-3 move downward.

  In addition, a determination button 523 that is operated when determining the selection of the eye size is displayed on the lower right of the eye size selection screen. The determination button 523 displays characters “OK”. . In addition, on the upper side of the eye size selection screen, characters “Please select the eye size!” Indicating that the screen is used for selecting the eye size are displayed. In addition, a time limit at which the eye size can be selected is displayed in a countdown manner at a position where “Time” is displayed on the upper right side of the eye size selection screen.

  When such an eye size selection screen is displayed on the touch panel monitor 93 and the user selects any of the eye size selection buttons 522-1 to 522-3, the control unit 201 accepts the selection by the user. Then, the control unit 201 collectively changes the size of the subject's eyes in the captured images 521-1 to 521-6 so that the image of the size selected by the user is captured.

  For example, when the user selects the eye size selection button 522-1, the control unit 201 detects the eye of the subject from the image, and the eye size of the subject of the captured images 521-1 to 521-6 is natural. Image processing is performed to change the size. Then, the control unit 201 updates the display of the eye size selection screen with the captured images 521-1 to 521-6 in which the change is reflected. At this time, the control unit 201 changes the eye size of all of the captured images 521 if all of the captured images 521 are captured in each captured image 521 with respect to all the captured images 521 obtained by the actual capturing process. Image processing is performed for batch image processing.

  Similarly, when the user selects the eye size selection button 522-2, the control unit 201 changes the subject eye size of the captured images 521-1 to 521-6 to be slightly larger, and the change is made. The reflected captured images 521-1 to 521-6 are displayed. When the user selects the eye size selection button 522-3, the control unit 201 changes the size of the user's eyes shown in the captured images 521-1 to 521-6 to be relatively large, and The captured images 521-1 to 521-6 reflecting the change are displayed.

  When the user selects the determination button 523 after selecting the eye size, the eye size of the subject is selected with the size reflected in the captured images 521-1 to 521-6 at that time. Is determined.

  As described above, in the photo sticker 1, when the eye size is selected, the control unit 201 performs image processing to change the eye size of the subject in the captured images 521-1 to 521-6, and the change is performed. The captured images 521-1 to 521-6 reflecting the above are displayed. Therefore, the user can select the optimum eye size while confirming the captured images 521-1 to 521-6 on which the user himself / herself reflects the change in the eye size. As a result, the photograph sticker 1 can provide the captured images 521-1 to 521-6 in which the user who has been subjected to the image processing so as to have a desired eye size is shown.

  In FIG. 33, images of the eyes of a model prepared in advance are displayed on the eye size selection buttons 522-1 to 522-3. For example, the images are captured in the captured images 521-1 to 521-6. Any subject's (user's own) eyes may be used. That is, a predetermined range including the subject's eyes is cut out from the photographed images 521-1 to 521-6, and the eye size of the cut-out image is appropriately changed to the eye size selection buttons 522-1 to 522-3. Can be displayed. The change in the eye size includes, for example, changing the size of the eye itself, changing the size of the black eye, and changing the volume of the eyelashes.

  Returning to the description of FIG. 32, in step S <b> 42, the control unit 201 selects an eye size according to an operation by the user.

  In step S <b> 43, the control unit 201 collectively changes the size of the user's eyes that appear in all the captured images so that the image includes the eyes of the size selected by the user.

  In step S44, the control unit 201 displays the captured image with the eye size changed on the touch panel monitor 93, and allows the user to confirm the result of the eye size change.

  In step S45, the control unit 201 determines whether or not the determination button 523 is pressed based on the information supplied from the touch panel monitor 93. If it is determined that the determination button 523 is not pressed, the control unit 201 returns to step S42 and performs the above processing. repeat.

  On the other hand, if it is determined in step S45 that the enter button has been pressed, in step S46, the control unit 201 determines the eye size, and stores information indicating the determined eye size in the storage unit 202 or the like and saves it. . On the editing target image selection screen or editing screen displayed on the tablet built-in monitor 131 after the image processing of the subject is completed, a photographed image showing the user's eyes in the size selected by the user is displayed.

  In step S <b> 47, the control unit 201 displays a brightness selection screen used for selecting the brightness of the captured image on the touch panel monitor 93 and accepts selection by the user. For example, the control unit 201 selects a predetermined photographed image from a plurality of photographed images obtained by the main photographing process, and generates a plurality of images having different brightness by changing the brightness of the selected photographed image. . The control unit 201 displays the generated plurality of images on the brightness selection screen, and causes the user to select the brightness of the image. The user can select the brightness of the image by looking at the image that he / she actually shows.

  FIG. 34 is a diagram illustrating an example of a brightness selection screen used to select the brightness of a subject using a captured image in which the user himself is photographed.

  A captured image 531 obtained by the actual photographing process is displayed on the brightness selection screen. For example, as described with reference to FIG. 29, when the shooting is repeated six times, six shot images are obtained, and the brightness selection screen displays the shot images 531-1 to 531-1 which are six shot images. 531-6 is displayed on the left side from the center of the screen.

  The captured images 531-1 to 531-6 are synthesized images finally obtained by, for example, two-stage synthesis processing.

  In addition, above the captured images 531-1 to 531-6, “the brightness is adjusted to the user's own brightness” indicating that the brightness of the subject can be confirmed by the captured images 531-1 to 531-6 in which the user himself is photographed. Please check with your face "is displayed.

  On the right side of the brightness selection screen, brightness selection buttons 532-1 to 532-5 are displayed in order from the top. On the brightness selection buttons 532-1 to 532-5, numerical values from “1” to “5” are respectively displayed, and models having different brightness are respectively displayed. The numerical values from “1” to “5” of the brightness selection buttons 532-1 to 532-5 indicate the degree of brightness. The larger the numerical value, the darker the subject becomes.

  The brightness selection button 532-3 displays a standard (natural) brightness model image. The brightness selection button 532-2 displays an image of a model with a slightly brighter hue (for example, the brightness is increased by about 10% from the natural brightness), and the brightness selection button 532-1 has a brightness selection button 532-1. An image of a model having a relatively bright hue (for example, the brightness is increased by about 20% from the natural brightness) is displayed. On the other hand, the brightness selection button 532-4 displays an image of a model with a slightly darker hue (for example, the brightness is reduced by about 10% from the natural brightness), and the model of the brightness selection button 532-5 is An image of a model having a relatively dark hue (for example, the brightness is reduced by about 20% from the natural brightness) is displayed.

  In addition, on the right side of the brightness selection buttons 532-1 to 532-5, characters “whitening”, “recommended”, and “beautiful black” are displayed in order from the top to the bottom. That is, in the arrangement of the brightness selection buttons 532-1 to 532-5, the upper side brightens the subject, and the lower side darkens the subject.

  In addition, a determination button 533 operated when determining the brightness of the subject is displayed on the lower right side of the brightness selection screen. The determination button 533 displays characters “OK”. . In addition, on the upper side of the brightness selection screen, a character “Please choose your favorite brightness!” Is displayed, which indicates that the screen is used for selecting the brightness of the subject. In addition, a time limit in which the brightness of the subject can be selected is displayed in a countdown manner at a position where “Time” is displayed on the upper right side of the brightness selection screen.

  When such a brightness selection screen is displayed on the touch panel monitor 93 and the user selects any of the brightness selection buttons 532-1 to 532-5, the control unit 201 accepts the selection by the user. Then, the control unit 201 collectively changes the brightness of the subjects of the captured images 531-1 to 531-6 so that the subject is captured at the brightness selected by the user. I do.

  For example, when the user selects the brightness selection button 532-3, the control unit 201 detects the subject from the image, and the brightness of the subjects of the captured images 531-1 to 531-6 becomes a natural brightness. The image processing to be changed is performed. Then, the control unit 201 updates the display of the brightness selection screen with the captured images 531-1 to 531-6 in which the change is reflected. At this time, if a plurality of subjects are captured in each captured image 531 with respect to all the captured images 531 obtained by the main capturing process, the control unit 201 changes the brightness of all the subjects. Apply image processing all at once.

  Similarly, when the user selects the brightness selection button 532-2, the control unit 201 changes the brightness of the subjects of the captured images 531-1 to 531-6 to be slightly brighter, and the change is reflected. The captured images 531-1 to 531-6 are displayed. When the user selects the brightness selection button 532-1, the control unit 201 changes the brightness of the subjects of the captured images 531-1 to 531-6 to be relatively bright, and the change is reflected. The captured images 531-1 to 531-6 are displayed. On the other hand, when the user selects the brightness selection button 532-4, the control unit 201 changes the brightness of the subjects of the captured images 531-1 to 531-6 to be slightly dark, and the change is reflected. The captured images 531-1 to 531-6 are displayed. When the user selects the brightness selection button 532-5, the control unit 201 changes the brightness of the subjects of the captured images 531-1 to 531-6 to be relatively dark, and the change is reflected. The captured images 531-1 to 531-6 are displayed.

  When the user selects the determination button 533 after selecting the brightness of the subject, the selection of the brightness of the subject is performed with the brightness reflected in the captured images 531-1 to 531-6 at that time. Is determined.

  As described above, in the photo sticker 1, when the brightness of the subject is selected, the control unit 201 performs image processing to change the brightness of the subject of the captured images 531-1 to 531-6, and changes the change. The captured images 531-1 to 531-6 reflecting the above are displayed. Accordingly, the user can select the optimum brightness of the subject while confirming the captured images 531-1 to 531-6 on which the user himself / herself reflects the change in brightness. As a result, the photograph sticker 1 can provide photographed images 531-1 to 531-6 in which a user who has been subjected to image processing to have a desired brightness is shown.

  In FIG. 34, images of model faces prepared in advance are displayed on the brightness selection buttons 532-1 to 532-5, but are shown as captured images 531-1 to 531-6, for example. Any subject (user's own) face may be used. That is, a predetermined range including the face of the subject is cut out from the captured images 531-1 to 531-6, and the brightness of the subject of the cut-out image is changed as appropriate to change the brightness selection buttons 532-1 to 532-5. Can be displayed.

  When the process of selecting the brightness of the subject is performed after the process of selecting the eye size of the subject as described above, the captured image 531-1 to 531-6 reflects the change of the eye size. The selected subject is displayed.

  Returning to the description of FIG. 32, in step S <b> 48, the control unit 201 selects brightness according to an operation by the user.

  In step S49, the control unit 201 collectively changes the brightness of all the captured images so as to obtain an image having the brightness selected by the user.

  In step S50, the control unit 201 displays the photographed image with the changed brightness on the touch panel monitor 93, and allows the user to confirm the result of the brightness change.

  In step S51, the control unit 201 determines whether or not the determination button 533 is pressed based on the information supplied from the touch panel monitor 93. If it is determined that the determination button 533 is not pressed, the control unit 201 returns to step S48 and performs the above processing. repeat.

  On the other hand, if it is determined in step S51 that the enter button has been pressed, in step S52, the control unit 201 determines the brightness of the image, and stores the information indicating the determined brightness in the storage unit 202 or the like. . On the selection screen for the image to be edited displayed on the touch panel monitor 93 after the image processing of the subject and the editing screen displayed on the tablet built-in monitor 131, a photographed image having the brightness selected by the user is displayed. .

  As described above, the subject image processing is processing for selecting the size of the user's eyes appearing in the captured image and the brightness of the captured image. Thereafter, the process returns to step S3 in FIG. 28, and the subsequent processing is performed.

  Next, image processing of the captured image performed in step S5 of FIG. 28 will be described with reference to the flowchart of FIG. The image processing of the captured image is processing performed for the user in the editing space A2-1 or the editing space A2-2.

  In step S61, the control unit 201 displays an edit target image selection screen on the tablet built-in monitor 131, and accepts selection by the user.

  FIG. 36 is a diagram illustrating an example of a selection screen used to select an image to be edited using a captured image in which the user himself is photographed.

  On the selection screen for the image to be edited, a captured image 541 obtained by the actual photographing process is displayed. For example, as described with reference to FIG. 29, when the shooting is repeated six times, six shot images are obtained, and the shot image 541 that is the six shot images is displayed on the selection screen of the editing target image. 1 to 541-6 are displayed at positions on the left side from the center of the screen.

  The captured images 541-1 to 541-6 are combined images finally obtained by, for example, two-step combining processing.

  Above the captured images 541-1 to 541-6, “Select a graffiti image is selected” indicating that an image to be edited can be selected from the captured images 541-1 to 541-6 in which the user himself is captured. "Ne" is displayed.

  On the right side of the selection screen of the editing target image, an all selection button 542 operated when selecting all the captured images of the captured images 541-1 to 541-6 as editing target images, and the captured images 541-1 to 541 are displayed. A determination button 543 that is operated when a predetermined photographed image of −6 is selected as an image to be edited is displayed. When the select all button 542 is pressed, all of the photographed images 541-1 to 541-6 are stored as images to be edited, and a predetermined photographed image is selected from the photographed images 541-1 to 541-6. When the enter button 543 is pressed in the state, the selected photographed image is saved as an image to be edited.

  Returning to the description of FIG. 35, in step S62, the control unit 201 causes the storage unit 202 to store and save the captured image selected from the selection screen of FIG.

  In step S <b> 63, the control unit 201 causes the tablet built-in monitor 131 to display a shooting composition image selection screen.

  FIG. 37 is a diagram showing an example of a selection screen for selecting a composite image for shooting used to select a composite image for shooting used for the background of the subject captured in the captured image.

  As described above, the composite image obtained by performing the two-stage composition process is displayed during the main photographing process, the subject image process, or the selection of the image to be edited. A two-step composition process is performed so as to compose a plurality of background images at the time of selecting a composite image for shooting, and the selection screen shown in FIG. 37 is displayed.

  On the selection screen for the composite image for shooting, a display area 551 that is a display area of the classification button for the composite image for shooting, a display area 552 that is a display area of the composite image, and a combination of the captured image and the selected composite image are displayed. A display area 553 which is a display area is provided.

  In the display area 551, a normal button 554, a pattern button 555, and a set button 556 are displayed. In the example of FIG. 37, the normal button 554 that is highlighted in black is selected.

  The normal button 554 and the pattern button 555 are operated when the user selects a desired shooting composition image from a plurality of shooting composition images. By selecting the normal button 554, a desired photographic composition image can be selected from among photographic composition images having various colors. Further, by selecting the pattern button 555, it is possible to select a desired photographing composition image from among photographing composition images having various patterns.

  The set button 556 is operated when the user selects a desired set of shooting composition images from a plurality of shooting composition images. The set of photographic composition images includes, for example, any type of photographic composition image according to the number of images (for example, six images) out of a plurality of types of photographic composition images having various colors and patterns. Combined and prepared in advance.

  In the display area 552, a plurality of composite images are displayed. The composite image is an image of a composite result generated by performing the first stage of the two-stage composite process. The synthesized image finally obtained by the two-stage synthesis process may be displayed in the display area 552.

  In the display area 553, the captured image and the selected composite image are displayed. The photographed image and the selected composite image are images of the composite results generated by performing the first stage of the two-stage composite process. The synthesized image finally obtained by the two-stage synthesis process may be displayed in the display area 553.

  When a shooting composition image is selected by operating a button displayed in the display area 551, the image processing unit 1001 of the control unit 201 acquires the shot image selected in the display area 553, and A mask image is generated as described above. The image processing unit 1001 generates a plurality of composite images by extracting a user's part and a shadow part appearing in the photographed image using a mask image, and synthesizing them with each of the selected photographing composition images. They are displayed side by side in the display area 552.

  In the example of FIG. 37, 27 composite images (3 rows × 9 columns) obtained by performing the first-stage compositing process using the shooting compositing images of different colors as the background image are displayed in the display area 552. Is shown in

  For example, when the user selects an arbitrary composite image from a plurality of composite images displayed in the composite image display area 552, a shooting composite image combined with the composite image is selected. . Then, a “completed” mark indicating that the user has already selected is displayed on the composite image selected by the user. In the composite image selected immediately before, a character “SELECT” indicating that the user has just selected is displayed.

  In the display area 553, a composite image 557, which is a composite image selected from the display area 552, and a captured image 558, which is a captured image for which no composite image for capturing has been selected from among the six captured images, are displayed. Is done. In the example of FIG. 37, composite images 557-1 to 557-4 and captured images 558-5 and 558-6 are displayed in the display area 553. Cancel buttons 559-1 to 559-4 are displayed below the composite images 557-1 to 557-4, respectively.

  For example, when the shooting composition image selection screen is first displayed, six captured images 558 are displayed in the display area 553. In the display area 553, the captured images 558 are displayed in order from the left side in the order of shooting by the main shooting process, and the composite image is selected in order from the captured image 558 displayed at the left end. The captured image 558 displayed in the display area 553 is an image in which the size and brightness of the subject's eyes are changed by the above-described subject image processing.

  When the user selects a desired composite image from a plurality of composite images displayed in the composite image display area 552 with respect to the first photographed image 558, the composite image is combined with the composite image. The composite image for shooting is selected. Accordingly, the display of the first photographed image 558 is updated to the composite image 557-1 selected by the user. That is, instead of the first photographed image 558, a composite image 557-1 obtained by compositing the photographing composite image selected by the user is displayed on the background of the subject of the first photographed image 558. . Further, a cancel button 559-1 is displayed below the composite image 557-1.

  In the same manner, when the user sequentially selects a photographic composite image for the second photographic image 558, the third photographic image 558, and the fourth photographic image 558, the user follows the selection. The composite images 557-2 to 557-4 are respectively displayed. Further, cancel buttons 559-2 to 559-4 are displayed below the composite images 557-2 to 557-4, respectively.

  In this way, FIG. 37 shows a selection screen for selecting a composite image for shooting when a composite image for shooting is selected for the fourth captured image 558.

  Accordingly, on the selection screen for the composite image for shooting, the composite image for shooting with respect to the captured image 558-5 is selected. In order to indicate this, a frame 560 is displayed so as to surround the photographed image 558-5, and characters “Please select the fifth background!” Above the display area 553 of the photographed image and the composite image. Is displayed.

  In addition, on the left side of the display area 553 of the captured image and the composite image, there is a character “You can cancel the background selected with the cancel button” indicating that the composite image for shooting that has been selected with the cancel button 559 can be cancelled. It is displayed. In other words, by operating the cancel button 559, the selection of the photographic composite image combined with the composite image 557 displayed above it can be canceled and the photographic composite image can be selected again. In addition, a time limit for selecting a photographic composite image is displayed in a countdown manner at a position where “Time” is displayed on the upper right side of the photographic composite image selection screen.

  On the right side of the composite image display area 552, a button 561 for deleting a person is displayed.

  The erase button 561 is operated when changing the display of the composite image displayed in the display area 552 to a state in which the subject is not composited. For example, the display area 552 normally displays a composite image in which the subject of the captured image and the composite image for shooting are combined, but it may be difficult to confirm the color or pattern of the composite image for shooting depending on the subject. It is assumed that there is. In such a case, when the user operates the button 561 for deleting a person, a composite image for shooting (that is, only the background) is displayed in the display area 552, and the user can take a picture. It becomes easy to confirm the color and pattern of the image for composition.

  In addition, when the person erasing button 561 is operated to display the shooting composition image in the display area 552, the character displayed on the person erasing button 561 is changed to “display person”. . Then, when the display area 552 is a composite image for photographing, when the user operates the button 561 for erasing the person, the display area 552 is restored to the original, as shown in FIG. A synthesized image obtained by synthesizing the image for synthesis is displayed in the display area 552.

  Returning to the description of FIG. 35, in step S <b> 64, the control unit 201 determines a composite image for photographing according to the user's operation on the selection screen of FIG. 37.

  In step S65, the control unit 201 determines whether or not a predetermined time has elapsed since the start of image processing of the captured image. If it is determined that the predetermined time has not elapsed, the processing after step S64 is performed. repeat. On the other hand, when determining that the predetermined time has elapsed, the control unit 201 returns to step S5 in FIG. 28 and performs the subsequent processing.

  Thus, in a series of processes for providing a photo sticker creation game, a two-stage composition process is performed a plurality of times in order to display an image showing a user. Thereby, it is possible to make the user confirm a realistic composite image in which the shadow of the user is reflected. Note that the composite image generated by the two-step composite process is appropriately edited in the edit process, and the composite image that has been edited is printed on a sticker sheet.

[External structure of photo sticker]
FIG. 38 is a perspective view showing another configuration example of the appearance of the photographic sticker 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The image processing unit 1001 in FIG. 1 is realized in the photographic sticker 1 in FIG. Also in the photo seal machine 1 of FIG. 38, the two-stage composition process is performed in the same manner as in the photo seal machine 1 of FIG.

  As shown in FIG. 38, the photo sticker 1 is mainly composed of a photographing unit 11, an editing unit 12, and a customer service unit 301. The editing unit 12 and the customer service unit 301 are installed in contact with each other, and the photographing unit 11 is installed at a position away from the editing unit 12 and the customer service unit 301.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed with a predetermined distance apart, and photographing processing is performed in a photographing space formed between the photographing unit 21 and the background unit 22.

  The photographing unit 21 is a device that allows a user to perform photographing processing. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing process. The front panel 41 of the photographing unit 21 that constitutes a surface in which the photographing space is desired in front is provided with a touch panel monitor used by the user during photographing processing. When the left side is the left side and the right side is the right side as viewed from the user in the imaging space, the left side of the imaging unit 21 is configured by the side panel 42A, and the right side is configured by the side panel 42B.

  The background unit 22 includes a back panel 51 that is a plate-like member positioned on the back side of a user who is performing a photographing process facing the front. A background curtain unit 25 is provided above the background portion 22 so as to be supported by the back panel 51. The background curtain unit 25 stores a plurality of roll-up type background curtains having different colors or patterns and used for the background. The background curtain unit 25 operates in conjunction with photographing by a camera or the like provided in the photographing unit 21. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound up.

  The upper part of the side panel 42A constituting the left side surface of the photographing unit 21 and the background curtain unit 25 are connected by a connecting part 23A that is a plate-like member. Moreover, the upper part of the side panel 42B which comprises the right side surface of the imaging | photography part 21, and the background curtain unit 25 are connected by the connection part 23B which is a plate-shaped member.

  An opening formed by being surrounded by the side panel 42A of the imaging unit 21, the connecting unit 23A, and the back panel 51 of the background unit 22 is an entrance G1 of the imaging space. An opening formed by being surrounded by the side panel 42B of the photographing unit 21, the connecting part 23B, and the back panel 51 of the background 22 is also an entrance G2 of the photographing space.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed above the photographing space, and the ceiling strobe unit 24 covers the part of the opening. Provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. A fluorescent lamp is provided inside the strobe constituting the ceiling strobe unit 24, and also functions as illumination of the photographing space.

  On the back side of the front panel 41, a customer service section 301 is provided at a position separated by a predetermined distance so that the front faces the back of the front panel 41. The customer service section 301 is a device that allows the user to perform customer service processing. The above-described subject image processing is performed as the customer service process. The user of the photo sticker 1 in FIG. 38 performs only the main photographing process in the photographing space out of the main photographing process and the subject image processing included in the photographing process. It will be done in the customer service space that is formed in front of the front.

  The customer service section 301 has a plate-like housing having a predetermined thickness, and is provided so as to be connected to the editing section 12 so that the back surface thereof is in contact with the right side surface of the editing section 12. A tablet built-in monitor used by the user during the customer service process is provided in front of the customer service unit 301.

  A connecting rail 302 is attached above the customer service section 301. The connecting rail is configured by combining three rails 302A to 302C. One end of the rail 302A is fixed to the connecting portion 23A, and the other end is joined to the rail 26A of the curtain rail 26 on the extension of the rail 302A. One end of the rail 302B is fixed to the connecting portion 23B, and the other end is joined to the rail 26B of the curtain rail 26 on the extension of the rail 302B. One end of the rail 302C is joined to the joint between the rail 302A and the rail 26A, and the other end is joined to the joint between the rail 302B and the rail 26B.

  If the configuration of the editing unit 12 shown in FIG. 38 is a front-side configuration, the rail 302C includes a partition curtain 303A that divides the customer service space and the edit space on the front side of the editing unit 12, and a customer service space. A partition curtain 303B that partitions the editing space on the back side of the editing unit 12 is attached. The partition curtains 303 </ b> A and 303 </ b> B are attached substantially parallel to the front of the customer service section 301.

  The curtain that divides the customer service space and the editing space is attached almost in parallel with the front of the customer service unit 301, so that the customer service process using the tablet built-in monitor 161 provided on the front of the customer service unit 301 is performed. The finished user can move to the editing space in the same direction. In addition, by attaching the partition curtains 303A and 303B at a height at which the user's feet in each space can be seen, it is possible to easily move to the editing space. Instead of the partition curtains 303A and 303B, a panel for partitioning the customer service space and the editing space may be provided.

  The editing unit 12 is a device that allows a user to perform editing processing, which is processing for editing an image obtained by shooting processing. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by the user during editing processing. The configuration used for the editing process is provided on the front side and the back side of the editing unit 12 so that the two sets of users can simultaneously perform the editing process.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the left side of the slope 72, a support portion 73A that has a columnar shape and supports one end of the lighting device 74 is provided. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the support portion 73A. Also on the right side of the slope 72, a support portion 73B (FIG. 40) that supports the other end of the lighting device 74 is provided.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rail 26A is joined to the rail 302A of the connecting rail, and the other end of the rail 26A is joined to one end of the rail 26C. One end of the rail 26B is joined to the rail 302B of the connecting rail, and the other end of the rail 26B is joined to the other end of the rail 26C.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back of the editing unit 12 surrounded by the curtain attached to the curtain rail 26 serve as an editing space in which the user performs editing processing.

  FIG. 39 is a view showing the appearance of the photographic sticker 1 with a curtain attached.

  As shown in FIG. 39, a side curtain 63 is attached to the entrance G1 of the imaging space. A side curtain (not shown) is also attached to the doorway G2, which is the doorway on the opposite side. At least the inner color of the side curtains attached to the entrances G1 and G2 of the imaging space is a dark color such as black.

  In addition, in the opening formed above the photographing space, the front part with the ceiling strobe unit 24 interposed therebetween is covered with the ceiling front curtain 61, and the rear part is covered with the ceiling rear curtain 62. At least the inner color of the ceiling front curtain 61 is a dark color such as black, and at least the inner color of the ceiling rear curtain 62 is a bright color such as white.

  A curtain 311A is attached to the rail 302A provided above the customer service space, and a curtain 311B is attached to the rail 302B. A curtain 312A is attached to the rail 26A provided above the editing space, and a curtain 312B is attached to the rail 26B.

  FIG. 40 is a perspective view of the photographic sealing machine 1 of FIG. 38 viewed from another angle.

  The left side surface 76 of the editing unit 12 is provided with a sticker paper discharge port 164 through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the left side surface 76 of the editing unit 12 is a print waiting space where the user waits for the printing of the sticker paper to end.

  Here, the flow of the photo sticker creation game provided by the photo sticker machine 1 of FIG. 38 and the accompanying movement of the user will be described with reference to FIG. FIG. 41 is a plan view of the photo sticker 1 as viewed from above.

  The user of the photo seal machine 1 takes a picture formed between the photographing part 21 and the background part 22 from the entrance / exit G1 as indicated by the white arrow # 11 or from the entrance / exit G2 as indicated by the white arrow # 12. Entering the space A1, the main photographing process of the photographing process is performed using a camera or a touch panel monitor provided in the photographing unit 21.

  The user who has finished the photographing process exits the photographing space A1 using the doorway G1 as indicated by the white arrow # 13 and moves to the customer service space A11, or the doorway as indicated by the white arrow # 14. Using G2, the user leaves the shooting space A1 and moves to the customer service space A11 to perform image processing of the subject.

  The user who has finished image processing of the subject either moves out of the customer service space A11 as indicated by a white arrow # 15 and moves to the editing space A2-1, or as shown by a white arrow # 16. Move out of the space A11 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is to be moved is guided by the screen display on the touch panel monitor of the customer service section 301. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing processing. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing processing at the same time.

  After the editing process is finished, printing of an image selected from the photographed image and the edited image is started. The user who has finished the editing process during image printing moves from the editing space A2-1 to the print waiting space A12 as indicated by the white arrow # 17 if the editing process has been performed in the editing space A2-1. And wait for printing to finish. In addition, when the editing process is completed in the editing space A2-2, the user who has finished the editing process moves from the editing space A2-2 to the print waiting space A12 as indicated by the white arrow # 18, and prints. Wait for printing to finish in the waiting space A12.

  When the printing of the image is finished, the user receives the sticker paper from the sticker paper outlet 164 provided on the left side surface 76 of the editing unit 12 and finishes a series of photo sticker creation games.

  As described above, the image processing of the subject is used by providing the customer service space A11 and performing the subject image processing in the event customer service space A11 which is a space different from the shooting space A1 in which the main shooting process is performed. It becomes possible to make it concentrate on a person. In addition, by performing only the main shooting process in the shooting space A1, it is possible to concentrate the user on the main shooting process.

  The main photographing process and the subject image processing may be performed in the photographing space A1, and processing before editing of the photographed image, such as selection of an image to be edited, may be performed in the mid-customer service space A11.

[Configuration of each device]
Next, the configuration of each device will be described. The front configuration of the imaging unit 21 is the same as the configuration shown in FIGS. 22 and 23. The configuration of the background portion 22 on the photographing space A1 side is the same as the configuration shown in FIG.

  FIG. 42 is a diagram illustrating a configuration example of the front side (editing space A2-1 side) of the editing unit 12.

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of operation input using the touch pen 132A or 132B on a monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image selected as an image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  A customer service section 301 is provided on the right side of the editing section 12.

  FIG. 43 is a diagram illustrating a configuration example of the left side surface of the editing unit 12.

  The left side surface 76 of the editing unit 12 is provided with a sticker paper discharge port 164. In the sticker paper discharge port 164, sticker paper on which an image created by the user of the editing space A2-1 is edited, or the user of the editing space A2-2 performs the editing process. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

  The slope 77 on the editing space A2-2 side has the same configuration as the configuration of FIG.

  FIG. 44 is a diagram illustrating a configuration example of the front of the customer service section 301.

  The configuration of the customer service unit 301 is the same as that of the customer service unit 13 except that the sticker discharge port 164 is not provided. A tablet built-in monitor 161 is provided at the upper center of the customer service section 301. A touch pen 162A is provided on the left side of the tablet built-in monitor 161, and a touch pen 162B is provided on the right side. Similarly to the tablet built-in monitor 131, the tablet built-in monitor 161 is configured by superimposing a tablet capable of performing an operation input using the touch pen 162A or 162B on a monitor such as an LCD.

  A non-contact type IC reader / writer 163 is provided under the tablet built-in monitor 161, and a speaker 165 is provided below the non-contact type IC reader / writer 163. The non-contact type IC reader / writer 163 communicates with a non-contact type IC that is in close proximity, and reads data from the non-contact type IC and writes data to the non-contact type IC. The speaker 165 outputs sounds such as guidance voices, background music, and sound effects for the customer service process.

[Internal configuration of photo sticker]
FIG. 45 is a block diagram showing an example of the internal configuration of the photographic sticker 1 of FIG. The same components as those described with reference to FIG. 27 are denoted by the same reference numerals. The overlapping description will be omitted as appropriate.

  In the control unit 201, an image processing unit 1001 having the configuration of FIG. 1 is realized by executing a predetermined program. A captured image obtained by capturing with the camera 91 is acquired by the captured image acquisition unit 1011 of the image processing unit 1001, and the background image and the shadow color background image stored in the storage unit 202 are the background image acquisition unit 1014. Obtained by

  The customer service section 351 includes a tablet built-in monitor 161, touch pens 162 </ b> A and 162 </ b> B, a non-contact IC reader / writer 163, and a speaker 165 that perform the customer service process in the customer service space A <b> 11.

[Operation of photo sticker]
Here, with reference to the flowchart of FIG. 46, the process of the photo sticker machine 1 of FIG. 38 that provides the photo sticker creation game will be described.

  In step S101, the control unit 201 of the photo sticker 1 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221 and waits until it is determined that the coin has been inserted. .

  When it is determined in step S101 that a coin has been inserted, in step S102, the control unit 201 controls the photographing unit 208 to perform the main photographing process. As described with reference to the flowchart of FIG. 29, the main photographing process shoots a user in the photographing space A1 as a subject.

  In step S103, the control unit 201 guides the user in the shooting space A1 to move to the customer service space A11. The movement guidance to the customer service space A11 is performed by displaying a screen on the touch panel monitor 93 of the photographing unit 208 or by outputting sound from the speaker 224.

  In step S <b> 104, the control unit 201 controls the customer service unit 351 to perform subject image processing according to an operation by a user in the customer service space A <b> 11. With the subject image processing described with reference to the flowchart of FIG. 32, the selection of the user's eye size and the selection of the brightness of the captured image in the captured image obtained by the actual imaging processing are performed in the customer service space A11. Done by users in A selection screen used to select the eye size and a selection screen used to adjust the brightness of the captured image are displayed on the tablet built-in monitor 161 of the customer service unit 301.

  In step S105, the control unit 201 guides the user in the customer service space A11 to move to the editing space A2-1 or the editing space A2-2. Guidance on the movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the tablet built-in monitor 161 of the customer service unit 351 or by outputting sound from the speaker 165.

  In step S106, the control unit 201 performs image processing of the captured image described with reference to the flowchart of FIG.

  In step S107, the control unit 201 controls the editing unit 209A or the editing unit 209B to perform editing processing. The control unit 201 displays an editing screen on the tablet built-in monitor 131, and edits the captured image selected as the editing target in accordance with the editing operation by the user. When the editing is completed, the control unit 201 displays an image selection screen for printing on the tablet built-in monitor 131, and allows the user to select an image to be printed. On the screen for selecting an image to be printed, a photographed image and an edited image are displayed, and a predetermined number of images are selected from them.

  In step S108, the control unit 201 guides the user who has finished editing processing in the editing space A2-1 or the editing space A2-2 to move to the print waiting space A12. The movement guidance to the print waiting space A12 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231. Before guiding the movement to the print waiting space A12, the post-service processing may be performed in the editing space A2-1 or the editing space A2-2.

  In step S109, the control unit 201 performs a printing process. The control unit 201 outputs the image selected by the user to the printer 241 and prints it on a sticker sheet.

  When the printing is finished, in step S110, the printer 241 discharges the sticker paper on which the image is printed to the sticker paper discharge port 164, and ends the processing.

  Note that the non-contact type IC reader / writer 163 may be provided not in the customer service unit 301 but in the editing unit 12. Further, like the photo seal machine 1 in FIG. 18, the photo sticker machine 1 in FIG. 38 may also be provided with the post-service section 13 having the configuration as shown in FIG.

  As described above, the two-step composition process can be performed in the photographic sticker 1 having the external configuration of FIG. The image processing of the captured image may be performed for the user in the customer service space A11.

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

  DESCRIPTION OF SYMBOLS 1 Photo sticker machine, 11 Shooting unit, 12 Editing part, 13 Subsequent customer service part, 21 Photographing part, 22 Background part, 1001 Image processing part, 1011 Photographed image acquisition part, 1012 Mask image generation part, 1013 Composition part, 1014 Background image Acquisition department

Claims (11)

Based on the photographed image, the portion of the subject that appears in the photographed image is transmitted, and the shadow portion of the subject projected on the background curtain behind the subject at the time of photographing is determined according to the lightness of the color of the background curtain. A mask image generating means for generating a first mask image that is transmitted at a predetermined partially different transmittance;
An image comprising: a synthesizing unit that extracts a portion of the subject and a shadow portion of the subject from the photographed image using the first mask image, and combines the extracted portion with a background image that is an image that is a background of the subject. Processing equipment. The mask image generation means detects the subject portion, the shadow portion of the subject, and other portions based on the color of each pixel of the captured image, and generates the first mask image. The image processing apparatus according to claim 1. The synthesizing unit is configured to generate the subject portion and the subject from a synthesized image obtained by synthesizing the subject portion extracted using the first mask image and the shadow portion of the subject with the background image. The image processing apparatus according to claim 1, wherein the shadow portion of the image is extracted using the first mask image, and is combined with the background image again. The synthesizing unit extracts the subject portion and the shadow portion of the subject from the photographed image using the first mask image, and synthesizes the subject portion and a color background image that is an image having a color different from that of the background image. The synthesized image obtained in this manner is used as the photographed image, and the subject portion and the shadow portion of the subject are extracted from the photographed image using the first mask image and synthesized with the background image. Item 3. The image processing apparatus according to Item 1 or 2. The image processing apparatus according to claim 4, wherein the color background image is an image of a shadow color projected onto an object having the same color as the color of the background image. The image processing apparatus according to claim 4, wherein the synthesizing unit uses the color background image whose brightness is changed according to a shooting mode of the captured image. The mask image generating means generates a second mask image that transmits a portion of the subject and transmits a predetermined portion around the contour of the subject with a predetermined transmittance based on the captured image,
The synthesizing unit extracts a portion of the subject and a portion around the contour of the subject from the photographed image using the second mask image, and a color background image that is an image having a color different from that of the background image. Using the first mask image, the subject image and the shadow portion of the subject are extracted from the captured image as a composite image obtained by combining the image and the background image. The image processing apparatus according to claim 1 or 2. The composition unit adjusts the color of the shadow portion of the subject before combining the portion of the subject and the shadow portion of the subject with the background image. Image processing device. The mask image generating means processes the first mask image;
The image processing apparatus according to claim 1, wherein the synthesizing unit extracts a portion of the subject and a shadow portion of the subject using the processed first mask image. The mask image generation means, as the processing of the first mask image, includes at least one of a process of adjusting a contrast of the first mask image according to a tone curve and a process of blurring an outline of the first mask image. The image processing apparatus according to claim 9, wherein any one of the processes is performed. Based on the photographed image, the portion of the subject that appears in the photographed image is transmitted, and the shadow portion of the subject projected on the background curtain behind the subject at the time of photographing is determined according to the lightness of the color of the background curtain. Generate a mask image to be transmitted at a predetermined partially different transmittance,
An image processing method comprising: extracting a portion of the subject and a shadow portion of the subject from the photographed image using the mask image and combining the extracted portion with a background image that is an image serving as a background of the subject.

Images