JP2006033639A - Program, information storage medium, photograph printing device, and photograph printing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a program capable of generating a highly accurate image with α-channel which is capable of highly accurate chroma key synthesis, and to provide a photograph printing device and an information storage medium. <P>SOLUTION: This program includes an α value operating means for obtaining a chroma key synthesis parameter of each pixel on the basis of the hue component of each pixel of an object image and the hue component of an extracted color thereof, and operating an α value corresponding to each pixel of the object image on the basis of the chroma key synthesis parameter; and an extracted color eliminating means for eliminating an extracted color printed on the object image. The α value operating means decides an α value of each pixel of the object image so as to have a functional relation in which the variation ratio of the α value for the chroma key synthesis parameter may be reduced, in the vicinity of a first value indicating that the chroma key synthesis parameter is a foreground image or in the vicinity of a second value indicating that the parameter is a background image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a program, an information storage medium, a photo printing apparatus, and a photo printing method.

  2. Description of the Related Art Conventionally, a photo sticker manufacturing machine (an example of a photo printing apparatus) that edits and prints an image of a user subject photographed by a photographing unit such as a CCD camera is known.

In photo sticker making machines, the background of the subject of the shooting booth is made a specific color, the specific color area is extracted by chroma key processing, mask processing, etc., and the missing part is combined with another image. Has been done.
JP-A-8-65705

  FIG. 23 is a diagram for explaining the chroma key composition.

  The chroma key composition is a technique for separating the foreground 850 and the background (extracted color) 860 from the target image (subject image) 840 and compositing the foreground 850 with a new background (given background) 870.

If the pixel value is X vector = (R, G, B), the foreground is an FG vector, and the background is a BG vector,
Is assumed to hold.

When k = 0, the background is k = 1, the foreground is when k = 1, and when 0 <k <1, it means a translucent portion.
(39) If the pixel value synthesized with the newer background BG ′ vector is the X ′ vector,
From (39) and (40),
If k is obtained, a new pixel value can be calculated.

  When shooting with a monochrome background, it is considered that BG vector = Const. However, since (39) includes the FG vector as an unknown, k cannot be obtained by taking (39). Therefore, the conventional method has been to devise a method for calculating k by setting the FG region with parameters.

  FIG. 24 shows an image generated by the conventional method.

  FIG. 25 is a hair tip portion 810 of FIG. 24 and shows a state 812 in which the hair tip of the subject is mixed with the background color (extracted color) and becomes an intermediate color. Thus, conventionally, when photographing with a single color background, the foreground color and the background color are mixed with each other by the outline or the hair tip, and the intermediate color between the foreground and the background may be obtained. In particular, when synthesizing with a dark background, the background color was mixed with the tip of the hair, etc., and an accurate image could not be obtained.

  FIG. 26 is the skirt portion 820 of FIG. 24 and shows a state 822 in which the background color (extracted color) is reflected in a part of the subject. As described above, when the subject is close to the background or the like, a phenomenon in which the background color is reflected on the subject is seen.

  In the chroma key composition, naturally synthesizing such intermediate color areas leads to an improvement in accuracy.

  In the above document, as an example of a technique for improving the accuracy, a technique is described in which the RGB color space is divided by a set of triangular pyramids centered on the BG vector, and a background area, a foreground area, and an intermediate area are set.

  However, since the method of the above cited reference is a calculation method using a 128-hedron, it is necessary to set three or four kinds of parameters at 66 points which are the vertices, and it is very troublesome to adjust the parameters. There was a point.

  In addition, when chroma key composition is performed using an image composition tool on a personal computer, it is possible to synthesize a highly accurate image by manually adjusting parameters according to individual image states. However, when applied to a photographic printing apparatus or the like, it is difficult to adjust an image by adjusting parameters in consideration of shooting conditions (individual specific conditions such as background, brightness of illumination, and color unevenness). .

Here, an image of the foreground 850 is extracted from the target image (subject image) 840, and an α channel-added layer (image), which is an image obtained by adding an α value to the RGB value of each pixel, is generated. May be combined with (given background) 870. For example, when editing a photo printing apparatus to extract an outline of a subject and apply an effect (for example, when applying a light emitting effect along the contour of the subject),
A semi-transparent composition (α blending process) is performed on the α-channel layer (image) FG and the background BG according to the following equation according to α to calculate a new background (given background) 870 and a composite image.

  Retaining data in the form of a layer with an α channel (image) facilitates image processing such as color adjustment, but in order to solve the above problems and generate a highly accurate image, a layer with an α channel (image ) Must be created with high accuracy.

  The present invention has been made to solve the above-described problems, and an object thereof is a program capable of generating a layer (image) with a high-precision alpha channel capable of accurate chroma key composition. Another object of the present invention is to provide an information storage medium, a photo printing apparatus, and a photo printing method.

(1) The present invention
A program for generating a subject image with an α value from an image of a subject photographed with a sampling color as a background,
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

  The first value indicating that the chroma key composition parameter is a foreground image is 1, for example.

  In the vicinity of the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, correction is performed so that the rate of change of the α value with respect to the chroma key composition parameter is smaller. Is corrected so as to be close to the first value.

  The subject image with an α value generated according to the present invention is used for performing a translucent composition (for example, α blending process) with a given background (new background) based on the α value of each pixel. In this case, it has the same effect as the change rate of the chroma key composition parameter becomes gentle at a portion (near the boundary between the subject image and the background) that is far from the background center on the hue plane.

  When the chroma key composition parameter is in the vicinity of the first value indicating that it is a foreground image, there is a high possibility that a background color is reflected.

  By setting the α value as in the present invention, it is possible to control so that the foreground image is not significantly affected by the new background in the vicinity of the boundary between the foreground and the background when translucent synthesis or the like is performed later.

(2) The present invention
A program for generating a subject image with an α value from an image of a subject photographed with a sampling color as a background,
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

  The second value indicating that the chroma key composition parameter is a background image is 0, for example.

  In the vicinity of the vicinity of the second value indicating that the chroma key composition parameter is a background image, the correction is performed so that the rate of change of the α value with respect to the chroma key composition parameter becomes smaller. This is a case where correction is performed so as to approach the value.

  The subject image with an α value generated according to the present invention is used for performing a translucent composition (for example, α blending process) with a given background (new background) based on the α value of each pixel. In this case, it has the same effect as the change rate of the chroma key composition parameter becomes gentle in the portion (background portion) where the distance from the background center is short on the hue plane.

  When the chroma key composition parameter is in the vicinity of the second value indicating that it is a background image, the pixel is likely to be a background image.

  By setting the α value as in the present invention, it is possible to control so as not to be subject to fluctuations in the hue component of the background when performing translucent synthesis or the like later. Therefore, even when there is color unevenness or color misregistration in the curtain or the like as the background, it is possible to provide a system that can absorb these differences and generate a clean image and is resistant to color unevenness or color misregistration in the background.

(3) The program of the present invention
The sampling color removing means is
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. It is characterized by that.

(4) The present invention
A program for generating a subject image with an α value from an image of a subject photographed with a sampling color as a background,
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The sampling color removing means includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. It is characterized by that.

  In chroma key composition, a pixel value (color, etc.) in a state where there is no background color mixture is estimated from the pixel value (color, etc.) of a given pixel, and that pixel value (color, etc.) is used for the new background (given image). The combined pixel value (color, etc.) is calculated from the pixel value (color, etc.). As in the present invention, it is important to obtain a pixel value (color, etc.) in a state where there is no background color mixing in a subject image with an α value.

  If linearity is assumed on the hue plane, the distance between the hue position of each pixel on the hue plane and the background position set based on the sampling color is closer to the hue position of each pixel of the two predetermined straight lines. It is preferable to obtain the pixel value of the subject image from which the extracted color is removed based on the hue value specified by the point intersecting with the straight line. However, depending on the hue position of each pixel, the distance to the intersection may be too large and exceed the upper limit of the hue plane. According to the present invention, in such a case, the vertical line drawn on the straight line closer to the hue position of each pixel of the two straight lines from the hue position of each pixel intersects with the straight line. The pixel value of the subject image from which the extracted color is removed based on the specified hue value can be approximated.

  Therefore, the pixel value of the subject image from which the extracted color is removed can be obtained regardless of the hue position of each pixel.

(5) The program of the present invention
The α value calculating means is
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(6) The program of the present invention
The α value calculating means is
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(7) The present invention
An information storage medium readable by a computer, wherein the program according to any one of the above is stored.

(8) The present invention
A photo printing device that captures, edits, and prints an image of a photographed subject,
Subject image capturing means for capturing an image of a subject by capturing an image of the subject using an extraction unit as a background with an extraction color; and
Subject image generation means with α value for generating a subject image with α value based on the captured subject image;
a composite image means for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generating means
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(9) The present invention
A photo printing device that captures, edits, and prints an image of a photographed subject,
Subject image capturing means for capturing an image of a subject by capturing an image of the subject using an extraction unit as a background with an extraction color; and
Subject image generation means with α value for generating a subject image with α value based on the captured subject image;
a composite image means for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generating means
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(10) The photo printing apparatus of the present invention comprises:
The sampling color removing means is
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. It is characterized by that.

(11) The present invention
A photo printing device that captures, edits, and prints an image of a photographed subject,
Subject image capturing means for capturing an image of a subject by capturing an image of the subject using an extraction unit as a background with an extraction color; and
Subject image generation means with α value for generating a subject image with α value based on the captured subject image;
a composite image means for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generating means
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The sampling color removing means includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. It is characterized by that.

(12) The photo printing apparatus of the present invention is
The α value calculating means is
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(13) The photo printing apparatus of the present invention
The α value calculating means is
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(14) The present invention provides:
A photo printing method of a photo printing apparatus for capturing, editing, and printing a photographed subject image,
A subject image capturing step of capturing an image of a subject by capturing an image of the subject using an extraction unit with a sampling color as a background; and
A subject image generation step with an α value that generates a subject image with an α value based on the captured subject image;
a composite image step for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generation step includes:
An α value calculation step for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color, and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal step for removing the sampling color reflected in the subject image,
The α value calculating step includes:
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(15) The present invention provides:
A photo printing method of a photo printing apparatus for capturing, editing, and printing a photographed subject image,
A subject image capturing step of capturing an image of a subject by capturing an image of the subject using an extraction unit with a sampling color as a background; and
A subject image generation step with an α value that generates a subject image with an α value based on the captured subject image;
a composite image step for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generation step includes:
An α value calculation step for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color, and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal step for removing the sampling color reflected in the subject image,
The α value calculating step includes:
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. It is characterized by determining.

(16) The present invention provides:
A photo printing method of a photo printing apparatus for capturing, editing, and printing a photographed subject image,
A subject image capturing step of capturing an image of a subject by capturing an image of the subject using an extraction unit with a sampling color as a background; and
A subject image generation step with an α value that generates a subject image with an α value based on the captured subject image;
a composite image step for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generation step includes:
An α value calculation step for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color, and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal step for removing the sampling color reflected in the subject image,
The sampling color removal step includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. It is characterized by that.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

1. Photo Printing Device FIGS. 1, 2 and 3 show an example of an external view of a photo printing device of the present embodiment (in the narrow sense, a photo vending device and a photo sticker printing device). 1 is a right side view of the photographic printing apparatus of the present embodiment, FIG. 2 is a front view of the photographic printing apparatus of the present embodiment, and FIG. 3 is a rear view of the photographic printing apparatus of the present embodiment.

  First, the user (P1 in FIG. 1) takes a picture of a subject (for example, self) on the front side (FIG. 2) of the housing. Next, the user (P2 in FIG. 1) performs an editing operation on the photographed image on the back side (FIG. 3) of the housing.

  As shown in the front view of FIG. 2, the photo printing apparatus 1 of the present embodiment includes cameras 10 and 12 (imaging devices) for photographing a subject. These cameras 10 and 12 can be realized by, for example, a CCD camera, a C-MOS camera, or a video camera. Note that only one camera may be provided instead of a plurality.

  The camera 10 photographs a subject from the front direction and functions as a first imaging unit. The camera 12 captures an original stamp creation accessory (second subject) from above, and functions as a second imaging unit.

  The photo printing apparatus 1 includes a display 20. The display 20 is attached to the housing 50 so that the display screen faces the user at the height of the user's viewpoint. The video shot by the camera 10 (subject shooting camera) is displayed on the display 20, and the user may check whether the user's own pose is appropriate by viewing the video displayed on the display 20.

  The photo printing apparatus 1 includes a display 22. The video shot by the camera 12 (small camera) is displayed on the display 22, and the user looks at the video displayed on the display 22 and confirms whether or not the arrangement and angle of the small items are appropriate. Also good.

  In the present embodiment, the original stamp making accessory (second subject) is placed on the mounting table 18 in the stamp accessory photographing box 16, and the camera 12 (small accessory) set above the mounting table 18. Taken with a shooting camera.

  Further, as shown in FIG. 1, a base 52 and a back plate 54 are provided in the housing 50 of the photo printing apparatus. The base 52 is a base for a subject (user) to stand on it during shooting. The base 52 is preferably provided with a mark for the subject (user) to determine the standing position. The mark in this case may be, for example, a mark in the shape of the sole of the foot or a line for preventing the subject (user) from approaching the camera 10 too much.

  The back plate 54 (back member) is for blocking light from the outside during photographing. As will be described later, the back plate 54 may have a function as a blue back when chroma key composition is performed for composition of additional display objects (background or characters).

  A curtain or the like may be used as the back plate 54.

  As shown in FIG. 3, the photo printing apparatus 1 of the present embodiment includes editing displays 22 and 24. The editing displays 22 and 24 may be liquid crystal displays or touch panel displays.

The photo printing apparatus 1 includes operation units 30 and 32. The operation units 30 and 32 are for performing an operation for editing a captured image and an operation for selecting an edit menu.
The function of the operation unit 30 can be realized by, for example, a pointing device.

  The photo printing apparatus 1 includes a photo receiving port 40 as shown in FIG. A seal or the like on which a photographed and edited image is printed is output to the receiving port 40.

  FIG. 4 is an example of a block diagram of the photo printing apparatus of the present embodiment. Note that the photo printing apparatus does not have to include all the components (respective parts) in FIG. 4, and may be configured such that some of them are omitted.

  The photographing unit is for photographing a subject and can be realized by, for example, a CCD camera, a C-MOS camera, or a video camera, and functions as a subject image capturing unit. For example, two imaging devices are prepared, an image of the first subject is captured using the first imaging device, an image of the first subject is captured, and an image of the second subject is captured using the second imaging device. An image may be taken and an image of the second subject may be captured.

  In addition, a stamp accessory shooting box for shooting an accessory for creating an original stamp (second subject) is provided, and the stamp accessory placed on the mounting table in the stamp accessory shooting box can be shot ( For example, the second imaging device may be arranged above the mounting table.

  An operation unit 160 (a pointing device, a lever, a button, or the like) is used by the user to perform a selection operation or an editing operation of the editing content selection menu.

  The storage unit 170 (RAM) is a work area such as the processing unit 100 or the communication unit 196. An information storage medium 180 (a computer-readable medium such as a CD, DVD, HDD, or ROM) stores programs and data. The information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  The display 190 displays an image, for example, the photographing display 20 in FIG. 2 or the editing displays 22 and 24 in FIG. As the editing display, for example, a liquid crystal tablet, a touch panel, or the like is used, and a handwritten image can be input by drawing a character or a figure by bringing the tip of a touch pen (an example of a pointing device) into contact with the display surface. . Further, a stamp image such as a star mark or a heart mark prepared in advance is selected, and the stamp image can be input by bringing the tip of the touch pen into contact with the display surface.

  The sound output unit 192 outputs sounds such as sounds and game sounds.

  The portable information storage device 194 stores user personal data, save data for editing, and the like.

  The printing unit 195 performs processing for printing the captured image on a print medium (seal paper, photographic paper, plastic plate, or recording layer). In this case, there are various printing methods such as a sublimation type, a thermal transfer type, an ink jet method, and a laser printing method. As the printer for printing, an ink jet printer, a laser printer, a sublimation printer, a thermal transfer printer, a melt printer, a thermal printer, a photographic paper printer, an instant film printer, or the like may be used.

  The communication unit 196 performs various controls for performing communication via a network such as the Internet. By using the communication unit 196, the generated image data can be transmitted via the network.

  The processing unit 100 (processor) performs various processes such as a game process, an image generation process, and a sound generation process based on operation data from the operation unit 160, a program, and the like. In this case, the processing unit 100 performs various processes using the main storage unit 172 in the storage unit 170 as a work area. The function of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) or ASIC (gate array, etc.) and a program (game program).

  The processing unit 100 includes an editing processing unit 110, an image generation unit 120, and a sound generation unit 130.

  The image generation unit 120 generates an image based on the results of various editing processes performed by the editing processing unit 110 and outputs the image to the display 190.

  Here, the image generation unit 120 includes a chroma key composition unit 122 and a subject image generation unit 124 with an α channel.

  The chroma key composition unit 122 converts a RGB component of each pixel of the subject image into a luminance component and a hue component, a unit for converting an RGB component of each pixel of a given background image into a luminance component and a hue component, Chroma key composition parameter calculation means for obtaining a chroma key composition parameter of each pixel based on each pixel value of the image and each pixel value of the extracted color, and a hue component of the subject image and a hue component of a given background image based on the chroma key composition parameter The hue component synthesis means for calculating the hue component of the synthesized image by linearly synthesizing each pixel, and the luminance component of the subject image and the luminance component of the given background image based on the chroma key synthesis parameter are nonlinear for each pixel. A luminance component combining means for combining and calculating the luminance component of the combined image, and converting the calculated hue component and luminance component of the combined image into RGB components And functions as a device.

  The chroma key composition unit 122 includes a chroma key composition parameter calculation unit that obtains a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color, and a subject based on the chroma key composition parameter for each pixel. The chroma key composition parameter computing means defines a background area in the hue plane by two predetermined straight lines, and combines the hue of each pixel of the subject image. A pixel for which it is determined whether or not the value belongs to the background area, and for which it is determined that the value does not belong to the background area, is a first value indicating that the chroma key composition parameter is a foreground image, and a pixel that is determined to belong to the background area For the second value or the first value indicating that the chroma key composition parameter is the background image and the first value. Performs processing for any of the values lying between the values.

  Here, based on the hue component of each pixel of the subject image and the hue component of the extracted color, a process for obtaining a chroma key synthesis parameter of each pixel may be performed.

  In addition, the luminance component of the composite image using the chroma key composition parameter corrected so that the rate of change of the chroma key composition parameter becomes smaller near the first value indicating that the chroma key composition parameter is a foreground image. A process for performing a non-linear synthesis operation may be performed.

  Further, in the vicinity of the second value indicating that the chroma key composition parameter is a background image, the luminance component of the composite image is obtained using the chroma key composition parameter corrected so that the rate of change of the chroma key composition parameter becomes smaller. May be subjected to nonlinear synthesis calculation.

  Also, it is assumed that the luminance component of the composite image is nonlinearly combined, assuming that the luminance component of the subject image, the luminance component of the given background image, the luminance component of the sampling color, and the luminance component of each pixel are linear. May be.

  Further, a background area in the hue plane is defined by two predetermined straight lines, it is determined whether or not the hue value of each pixel of the subject image belongs to the background area, and for the pixels determined not to belong to the background area, the chroma key composition parameter Is a first value indicating that the image is a foreground image, and for pixels determined to belong to the background area, the second value or the first value and the second value indicating that the chroma key composition parameter is a background image. Any value positioned between the values may be used.

  On the hue plane, for the pixel having the hue value that is the background center set based on the extracted color and the hue value that belongs to the predetermined area around it, the chroma key composition parameter is the second value, and the pixel belongs to the background area. For a pixel having a hue value located outside the predetermined area, a chroma key composition parameter is obtained based on a distance relationship between the position of the pixel on the hue plane, the extension of the predetermined area, and one of the two predetermined straight lines. It may be.

  Further, at least one of the two predetermined straight lines may be defined as a straight line that does not pass through the origin on the hue plane.

  The α-channel subject image generation unit 124 obtains the chroma key composition parameter of each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color, and corresponds to each pixel of the subject image based on the chroma key composition parameter. It functions as an α value calculating means for calculating an α value and a sampling color removing means for removing a sampling color reflected in the subject image. The α value calculating means indicates that the chroma key composition parameter is a foreground image. In the vicinity of the value of 1, the α value of each pixel of the subject image is determined so as to have a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small.

  Further, the α value calculation means has a functional relationship such that a change rate of the α value with respect to the chroma key composition parameter is small in the vicinity of the second value indicating that the chroma key composition parameter is a background image. The α value of each pixel of the subject image may be determined.

  The sampling color removing means defines a background area on the hue plane by two predetermined straight lines, determines whether or not the hue value of each pixel of the subject image belongs to the background area, and for pixels determined to belong to the background area A point where a line connecting the hue position of each pixel on the hue plane and the background center set based on the sampling color intersects a straight line that is closer to the hue position of each pixel among the two predetermined straight lines, or each pixel The extracted color is removed based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel of the two straight lines from the hue position intersects the straight line. The hue value of the subject image may be obtained.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, or sounds, and outputs the game sounds to the sound output unit 192.

  The photo printing apparatus includes a communication unit 196. The communication unit 196 performs processing for transmitting or receiving data via a network such as the Internet. More specifically, the communication unit 196 transmits data generated from the captured image of the camera to an external server or the like via the network. In this way, the user (subject) can download image data of the subject himself / herself from the server to the personal computer of his / her home. Based on the downloaded image data, it is possible to print and output an image on paper or a sticker using a printer at home. It is also possible to store images taken by the user on a server, download them to a photo printing apparatus, print them, and output them.

  The function of the communication unit 196 can be realized by hardware such as a communication device (IC), a communication program, or the like. Note that either the printing unit 195 or the communication unit 196 may be omitted.

  Note that the photo printing apparatus according to the present embodiment is not limited to the one that shoots the entire body of the subject, and may shoot only the upper body of the subject.

  The subject photographed by the photo printing apparatus of the present embodiment is not limited to a human being. For example, the present embodiment can be applied to an apparatus that takes a photograph of a product to be exhibited at an auction or the like. In this case, if data transmission via the Internet using the communication unit 196 is linked to the auction listing, a photo printing apparatus convenient for the exhibitor can be provided.

  The photo printing apparatus of this embodiment can also be used for a game apparatus of a type that uses a photo image of a player in a game. That is, the photo printing apparatus of the present embodiment can be made to function as an image capturing device of a game device.

2. Features of the First Embodiment In this embodiment, when a given background image is synthesized with an image of a subject taken with a sampling color (single color background) as a background, the RGB components of each pixel of the subject image are used. Converts luminance component (Y) and hue component (IQ), converts RGB component of each pixel of a given background image into luminance component (Y) and hue component (IQ), extracts each pixel value of subject image Based on each pixel value of the color, a chroma key composition parameter of each pixel is obtained, and based on the chroma key composition parameter, the hue component of the subject image and the hue component of the given background image are linearly synthesized for each pixel, and the hue component of the composite image And calculating the luminance component of the synthesized image by nonlinearly synthesizing the luminance component of the subject image and the luminance component of the given background image for each pixel based on the chroma key synthesis parameter, and calculating the hue component of the calculated synthesized image. The luminance component is converted into RGB components.

  The conversion of the RGB components of each pixel of the subject image and the RGB components of the given background image into luminance components (Y) and hue components (IQ) will be described later in “5.2. Conversion from RBG values to luminance components and hue components”. It can be performed by the method described in the above.

  Here, the chroma key composition parameter is the RGB value of the subject image and the extracted color, or any component thereof, the pixel value obtained by converting the RGB value, or any component thereof (for example, the YIQ value or any component thereof), etc. You may make it obtain | require by.

  The linear composition of the hue component of the subject image and the hue component of the given background image based on the chroma key composition parameter k can be performed by the method described in “5.3 Hue component conversion”.

  Here, the linear composition is a composition of the hue component of the subject image and the hue component of the background image using, for example, a linear function (when f (x + y) = f (x) + f (y) holds, f is called a linear function). If you do.

  The nonlinear composition of the luminance component of the subject image and the luminance component of the given background image based on the chroma key composition parameter k can be performed by the method described in “5.4 Conversion of the luminance component”.

  Here, the non-linear composition refers to a case where the hue component of the subject image and the hue component of the background image are synthesized using, for example, a non-linear function (function in which f (x + y) = f (x) + f (y) does not hold). .

  The RGB component conversion of the hue component and the luminance component of the composite image can be performed by the method described in “5.5 Conversion from YIQ component to RGB component” described later.

  According to the present embodiment, the hue component is linearly synthesized, and the luminance component is nonlinearly synthesized. When combining pixel values (for example, RGB values) assuming linearity, there has been a situation where the combining is not successful when the background is dark. Conventionally, for example, such a situation has been dealt with by a method in which parameters are added and individually corrected in accordance with the photographing situation.

  On the other hand, in the present embodiment, nonlinear composition is performed on the luminance component, so that the composition can be performed accurately even when the background is dark without individually adjusting parameters. In other words, it can always be accurately synthesized regardless of the brightness of the background color.

  In general, the photographing situation of the photographic printing apparatus varies depending on the illumination state and the location where it is installed. However, according to the present embodiment, it is possible to perform image composition with high accuracy regardless of these variations.

  When applied to a photographic printing apparatus, it is difficult to individually adjust parameters, but according to the present embodiment, there is a remarkable effect that individual adjustment of parameters is unnecessary.

  Further, the chroma key synthesis parameter of each pixel may be obtained based on the hue component of each pixel of the subject image and the hue component of the extracted color.

  Here, the chroma key composition parameter k can be obtained by the method described in “6. Method for calculating chroma key composition parameter k”.

  Further, in the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the luminance component of the composite image is corrected using the chroma key composition parameter corrected so that the change rate of the chroma key composition parameter becomes smaller. May be subjected to nonlinear synthesis calculation.

  The first value indicating that the chroma key composition parameter is a foreground image is 1, for example.

  The chroma key composition parameter corrected so that the rate of change of the chroma key composition parameter becomes smaller near the first value indicating that the chroma key composition parameter is a foreground image is, for example, 710 in FIG. It is a parameter that has been corrected to have a change rate as shown.

  In addition, correction is performed so that the change rate of the chroma key composition parameter is smaller in the vicinity of the first value indicating that the chroma key composition parameter is a foreground image. For example, the chroma key composition parameter is set in the vicinity of the vicinity. This is a case where correction is performed so as to approach the first value.

  This has the same effect as the change rate of the chroma key composition parameter becomes gentle in a portion where the distance from the background center on the hue plane is outside (far) a predetermined range.

  When the chroma key composition parameter is in the vicinity of the first value indicating that it is a foreground image, the background color is likely to appear in the subject image (foreground image) during shooting. For example, when shooting with a green background, a phenomenon in which green of the background color appears near the boundary of the subject image (foreground image) with the background appears. In this case, when a new background (given background) is combined, it is natural to reflect the color of the new background (given background). However, with regard to the brightness, in the vicinity of the boundary between the foreground and the background, the foreground image is more beautiful when it is less affected by the brightness of the old background.

  By correcting the chroma key composition parameter as in the present invention, the foreground image can be controlled to be less affected by the luminance of the old background near the boundary between the foreground and the background by nonlinear composition.

  Further, in the vicinity of the second value indicating that the chroma key composition parameter is a background image, the luminance component of the composite image is obtained using the chroma key composition parameter corrected so that the rate of change of the chroma key composition parameter becomes smaller. May be subjected to nonlinear synthesis calculation.

  The second value indicating that the chroma key composition parameter is a background image is 0, for example.

  In the vicinity of the second value indicating that the chroma key composition parameter is a background image, correction is performed so that the rate of change of the chroma key composition parameter becomes smaller. In this case, correction is performed so that the value approaches 2.

  This has the same effect as the change rate of the chroma key composition parameter becomes gentle at a portion where the distance from the center of the background in the hue plane is within a predetermined range (near).

  By doing so, it is possible to absorb variations in the brightness of the background image.

  Also, it is assumed that the luminance component of the composite image is nonlinearly combined, assuming that the luminance component of the subject image, the luminance component of the given background image, the luminance component of the sampling color, and the luminance component of each pixel are linear. May be. The nonlinear composition calculation assuming that the logarithmic value of the luminance component is linear can be performed by the method described in “5.4 Conversion of the luminance component”.

  A background area on the hue plane is defined by two predetermined straight lines, and it is determined whether or not the hue value of each pixel of the subject image belongs to the background area. For pixels that are determined not to belong to the background area, the chroma key composition parameter is For a pixel that has been determined to belong to the background area as the first value representing the foreground image, the second value or the first value and the second value representing that the chroma key composition parameter is the background image. You may make it be either value located between.

  The hue component may be, for example, an IQ plane in the YIQ color space or a UV plane in the YUV color space. Alternatively, the CrCb plane of the YCrCb color space may be used. Any plane that is perpendicular to the Y axis defined by Y = aR + bG + cB (a, b, and c are predetermined constants) for R, G, and B components (obtained by linear conversion from the RGB color space) may be used.

  The background area in the hue plane is defined by two predetermined straight lines, and the determination as to whether the hue value of each pixel of the subject image belongs to the background area can be made by the method described with reference to FIG.

  The chroma key composition parameter is, for example, a first point on a hue plane where a straight line connecting a background center and a position of the pixel in the hue plane intersects an extension of the predetermined area (an outer periphery that specifies the predetermined area), and the straight line is the predetermined plane. A second point that intersects one of the two straight lines is obtained, and is obtained based on a distance between the position on the hue plane of the pixel and the distance between the first point and a distance ratio between the position on the hue plane of the pixel and the second point. It may be.

  On the hue plane, for the pixel having the hue value that is the background center set based on the extracted color and the hue value that belongs to the predetermined area around it, the chroma key composition parameter is the second value, and the pixel belongs to the background area. For a pixel having a hue value located outside the predetermined area, a chroma key composition parameter is obtained based on a distance relationship between the position of the pixel on the hue plane, the extension of the predetermined area, and one of the two predetermined straight lines. It may be.

  For example, as shown in FIG. 8, for example, in the hue plane, a first point 250 where a straight line connecting the center of the background and the position of the pixel in the hue plane intersects the outer extension (identifying the outer periphery) of the predetermined area, and the straight line Finds a second point 260 that intersects one of the two predetermined straight lines, and determines the distance between the position 270 and the first point 250 on the hue plane of the pixel and the position 270 and the second point on the hue plane of the pixel. The chroma key composition parameter k may be obtained based on the distance 260.

  The chroma key composition parameter calculation means may define at least one of the two predetermined straight lines as a straight line that does not pass through the origin on the hue plane. Such definition may be performed, for example, according to FIG. 11 or equation (19).

3. Features of Second Embodiment In the present embodiment, the hue component of each pixel of a subject image when chroma key composition is performed on the subject image captured with the extracted color (single color background) and the given background image. Then, the chroma key composition parameter of each pixel is obtained based on the hue component of the extracted color, and the subject image and a given background image are synthesized for each pixel based on the chroma key composition parameter. Pixels for which a background area in the hue plane is defined by predetermined two straight lines when calculating the chroma key composition parameter, and whether or not the hue value of each pixel of the subject image belongs to the background area, is determined not to belong to the background area Is a first value indicating that the chroma key composition parameter is a foreground image, and for a pixel determined to belong to the background area, a second value or a second value indicating that the chroma key composition parameter is a background image. Any one of the values located between the value of 1 and the second value is used.

  The hue component may be, for example, an IQ plane in the YIQ color space or a UV plane in the YUV color space. Alternatively, the CrCb plane of the YCrCb color space may be used. Any plane that is perpendicular to the Y axis defined by Y = aR + bG + cB (a, b, and c are predetermined constants) for R, G, and B components (obtained by linear conversion from the RGB color space) may be used.

  The background area in the hue plane is defined by two predetermined straight lines, and the determination as to whether the hue value of each pixel of the subject image belongs to the background area can be made by the method described with reference to FIG.

  The value of the chroma key composition parameter of the pixel belonging to the background region may be determined according to a distance ratio obtained by, for example, obtaining a point where a straight line connecting the background center and the pixel on the hue plane intersects one of the two straight lines.

  According to the present embodiment, since the chroma key composition parameter is obtained in the hue component (hue plane), the chroma key composition can be performed with a simple algorithm and fewer operations compared to the case of obtaining the chroma key composition parameter based on the three RGB components. it can.

  For a pixel having a hue value that is the center of the background and a hue value that belongs to a predetermined area around it, the chroma key composition parameter is the second value, and a pixel that has a hue value that belongs to the background area and is outside the predetermined area For the above, the chroma key composition parameter may be obtained based on the distance relationship between the position of the pixel in the hue plane, the extension of the predetermined area, and one of the two straight lines. For example, as shown in FIG. 8, on the hue plane, a first point where a straight line connecting the center of the background and the position of the pixel intersects with the extension of the predetermined area (the outer periphery that specifies), and the straight line is the two straight lines. A second point that intersects either one may be obtained and obtained based on the distance between the position on the hue plane of the pixel and the first point and the distance between the position on the hue plane of the pixel and the second point.

  By doing this, the chroma key composition parameter is obtained based on one of the two straight lines from the hue center, and the chroma key composition parameter is set to zero around the background center. Conversion can be performed.

  Further, the foreground area and the background area may be separated by two straight lines that do not pass through the origin on the hue plane, and it may be determined to which area the hue value of each pixel of the subject image belongs. Two straight lines that do not pass through the origin on the hue plane can be defined using, for example, Expression (19).

  Since the vicinity of the origin of the hue plane is close to gray, calculation as a background region may result in an unnatural composition. According to the present invention, since the origin region can be excluded from the background region, natural composition can be realized.

4). Features of the Third Embodiment In this embodiment, when generating a subject image with an α value from a subject image taken with a sampling color as a background, the hue component of each pixel of the subject image and the hue component of the sampling color Then, the chroma key composition parameter of each pixel is obtained, the α value corresponding to each pixel of the subject image is calculated based on the chroma key composition parameter, and the extracted color reflected on the subject image is removed. Here, when calculating the α value, there is a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small in the vicinity of the first value indicating that the chroma key composition parameter is a foreground image. Further, the α value of each pixel of the subject image is determined.

  The first value indicating that the chroma key composition parameter is a foreground image is 1, for example.

  Here, when calculating the α value, there is a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small in the vicinity of the first value indicating that the chroma key composition parameter is a foreground image. Determination of the α value of each pixel of a subject image can be realized by performing conversion having a functional relationship as shown in FIG.

  In FIG. 27, this can be realized by performing a transformation having a functional relationship where the horizontal axis is k (0 to 255 is regarded as 0 to 1) and the vertical axis is α. Here, the conversion may be performed using a function formula prepared in advance, or a conversion table having a functional relationship as shown in FIG. 28 is prepared, and the α value corresponding to the chroma key synthesis parameter using the conversion table is prepared. May be calculated.

  In the vicinity of the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, correction is performed so that the rate of change of the α value with respect to the chroma key composition parameter is smaller. Is corrected so as to be close to the first value.

  The subject image with an α value generated according to the present invention is used for performing a translucent composition (for example, α blending process) with a given background (new background) based on the α value of each pixel. In this case, it has the same effect as the change rate of the chroma key composition parameter becomes gentle at a portion (near the boundary between the subject image and the background) that is far from the background center on the hue plane.

  When the chroma key composition parameter is in the vicinity of the first value indicating that it is a foreground image, there is a high possibility that a background color is reflected.

  By setting the α value as in the present invention, it is possible to control so that the foreground image is not significantly affected by the new background in the vicinity of the boundary between the foreground and the background when translucent synthesis or the like is performed later.

  Further, when calculating the α value, in the vicinity of the second value indicating that the chroma key composition parameter is a background image, a functional relationship is set such that the rate of change of the α value with respect to the chroma key composition parameter is small. The α value of each pixel of the subject image is determined.

  The second value indicating that the chroma key composition parameter is a background image is 0, for example.

  Here, when calculating the α value, there is a functional relationship in which the rate of change of the α value with respect to the chroma key composition parameter is small in the vicinity of the second value indicating that the chroma key composition parameter is a background image. The determination of the α value of each pixel of a subject image can be realized, for example, by performing transformation having a functional relationship in which the horizontal axis is k (0 to 255 is regarded as 0 to 1) and the vertical axis is α in FIG. . Here, the conversion may be performed using a function formula prepared in advance, or a conversion table having a functional relationship as shown in FIG. 28 is prepared, and the α value corresponding to the chroma key synthesis parameter using the conversion table is prepared. May be calculated.

  In the vicinity of the vicinity of the second value indicating that the chroma key composition parameter is a background image, the correction is performed so that the rate of change of the α value with respect to the chroma key composition parameter becomes smaller. This is a case where correction is performed so as to approach the value.

  The subject image with an α value generated according to the present invention is used for performing a translucent composition (for example, α blending process) with a given background (new background) based on the α value of each pixel. In this case, it has the same effect as the change rate of the chroma key composition parameter becomes gentle in the portion (background portion) where the distance from the background center is short on the hue plane.

  When the chroma key composition parameter is in the vicinity of the second value indicating that it is a background image, the pixel is likely to be a background image.

  By setting the α value as in the present invention, it is possible to control so as not to be subject to fluctuations in the hue component of the background when performing translucent synthesis or the like later. Therefore, even when there is color unevenness or color misregistration in the curtain or the like as the background, it is possible to provide a system that can absorb these differences and generate a clean image and is resistant to color unevenness or color misregistration in the background.

  Further, when removing the extracted color from the subject image, a background area on the hue plane is defined by two predetermined straight lines, and it is determined whether or not the hue value of each pixel of the subject image belongs to the background area. For the pixel determined to be, a line connecting the hue position of each pixel on the hue plane and the background center set based on the sampling color is a straight line having a shorter distance from the hue position of each pixel of the two predetermined lines. The hue value specified by one of the intersecting points or the perpendicular line of the two straight lines that are closer to the hue position of each pixel from the hue position of each pixel intersects the straight line. Based on this, the hue value of the subject image from which the extracted color is removed is obtained.

  In chroma key composition, a pixel value (color, etc.) in a state where there is no background color mixture is estimated from the pixel value (color, etc.) of a given pixel, and that pixel value (color, etc.) is used for the new background (given image). The combined pixel value (color, etc.) is calculated from the pixel value (color, etc.). As in the present invention, it is important to obtain a pixel value (color, etc.) in a state where there is no background color mixing in a subject image with an α value.

  For example, as shown in FIG. 16, if linearity is assumed in the hue plane, a straight line connecting the hue position of each pixel in the hue plane and the background center set based on the sampling color is the hue of each pixel out of the two predetermined straight lines. It is preferable to obtain the pixel value of the subject image from which the extracted color is removed based on the hue value specified by the point that intersects the straight line that is closer to the position. However, depending on the hue position of each pixel, the distance to the intersection may be too large and exceed the upper limit of the hue plane. According to the present invention, in such a case, the hue value specified by the point at which the perpendicular line of the two straight lines closer to the hue position of each pixel from the hue position of each pixel intersects the straight line. Based on this, the pixel value of the subject image from which the extracted color has been removed can be approximated.

  Therefore, the pixel value of the subject image from which the extracted color is removed can be obtained regardless of the hue position of each pixel.

5. 5.1 Non-linear chroma key composition 5.1 Problems of linear chroma key composition Foreground color vector is FG vector, background color vector is BG vector, intermediate region MD vector such as contour, hair tip is
If the new background is a BG ′ vector, the converted background MD ′ vector is
The conventional method is to devise a method for obtaining k.

The relational expression (1) is optically valid, but the data handled by computers and TV signals is
Gamma correction is applied and the physical color information is not linear. In addition, since the camera has nonlinearity until the light is converted into a signal by the CCD and the image data is generated, the relational expression (1) is not satisfied.

  Nevertheless, (1) holds in a bright area of the image, and it can withstand practical use when combined with a bright background image.

  However, when combined with a dark background or when the subject is moving rapidly, the results of the expressions (1) and (2) are unnatural.

  In the first embodiment, the hue component and the luminance component are calculated separately. At that time, the hue component is linearly synthesized, and the luminance component is non-linearly calculated to realize natural synthesis.

5.2 Conversion from RBG value to luminance component and hue component A computer handles color image data as ternary data of R, G, and B per pixel. In the present embodiment, the subject image captured by the imaging unit is received as RGB ternary data, and this RGB data is converted into the YIQ color space by the following conversion formula.

5.3 Hue Component Conversion FIG. 10 is a diagram for explaining the hue component conversion.

  The RBG value of the subject image is converted into the YIQ color space using equation (4). Then, the hue data after the new background composition is converted on the IQ plane. For the IQ component, the linearity of equations (1) and (2) is assumed.

  The parameter k may be calculated according to “7. Method for calculating the chroma key composition parameter k” or may be calculated by another method.

  X vector is the hue value 310 of the pixel to be converted, BC vector is the background center (old background (sampled color)) 320 that can be placed on the hue plane, and BC ″ is the hue value of the new background (given background image). The vector X ′ is the hue (IQ) value after conversion (composite image), the FG vector is the hue value of the foreground, and in this embodiment, the hue value 310 of the X vector and the background center 320 in the hue plane. It is assumed that a point 350 where a straight line 330 connecting the two intersects a straight line L that specifies the boundary between the foreground region and the background region is an FG vector.

  From FIG. 10, the following expression is established.

From (33) -1 and (33) -2

If the IQ value vector X of the reference point (pixel), the old background (sampling color) BC vector, the parameter k, and the new background (given background image) BC ″ vector are given from the equation (13), the converted (composite image) ) IQ value vector X ′ can be calculated.

5.4 Conversion of luminance component Non-linear conversion is performed for the luminance component.

  First, β is calculated from the above equation (14). γ is an arbitrarily determined parameter.

Next, when Y is greater than Y _ther, correction is performed according to the following equation.

This is because when Y is large, IQ is small, and an unintended region is determined as a BG region.

  Make corrections to reduce the application of bright areas.

  Next, Y is calculated from β.

When leaving a shadow on the background caused by the subject, assuming that the luminance before conversion is Y _X , the luminance of the old background is Y _BC , and the luminance of the new background is Y _{BC "} , the luminance Y _{X ′} after conversion is calculate.

Calculate with the following formula.

When erasing the shadow on the background caused by the subject, assuming that the luminance before conversion is Y _X and the luminance of the new background is Y _{BC ″} , the luminance Y _{X ′} after conversion is calculated by the following equation.

5.5 Conversion from YIQ component to RGB component YIQ after conversion is calculated from (13), (16), and (17) and converted from YIQ to RGB by the following equation to obtain a new pixel value.

5.6 Non-linear Chroma Key Composition Process Flow FIG. 6 is a flowchart for explaining an example of a chroma key composition process flow for performing non-linear composition for the luminance component of the present embodiment.

  First, a background region is defined based on the definitions of A1 vector, A2 vector, BC vector, and r (step S210).

  The following processing is performed for each pixel until the end of the image data comes (step S220).

  First, the RGB value of the reference pixel is acquired (step S230).

  The RGB value is converted into YIQ (step S240).

  Vector X = (I, Q) is set (step S250). Here, the vector X is the I and Q components of the reference image.

  It is determined whether or not the vector X belongs to the background area (step S260). For example, it can be determined whether or not the vector X belongs to the background region by examining which of the expressions (7) -1 to (7) -4 is satisfied. In this case, if (7) -4 is satisfied, it can be determined that it belongs to the background area, and otherwise, it belongs to the foreground area.

  If it is determined that the pixel belongs to the foreground area, the process returns to step S220 without replacing the pixel value (step S270).

  If it is determined that it belongs to the background area, it is determined whether the vector X is closer to the straight line L1 or L2 (step S280).

  When it is close to L1, the A vector is set as the A1 vector (step S290), and when close to L2, the A vector is set as the A2 vector (step S300).

  Then, the IQ value after conversion is calculated from the IQ value vector X, the old background BC vector, the parameter k, and the new background BC vector (step S310). For example, the converted IQ value can be calculated by the equation (13).

Next, non-linear conversion is performed from the luminance Y _X before conversion, the luminance Y _{BC ″} of the new background, and the parameter k, and the converted luminance Yx ′ is calculated (step S320). For example, conversion from equations (14) and (15) is performed. The parameter β may be obtained, and the converted luminance Yx ′ may be calculated according to the equation (16) or the equation (17).

  Then, the YIQ value obtained in steps S310 and S320 is converted into an RGB value (step S330). The conversion from the YIQ value to the RGB value can be performed by, for example, coordinate conversion of Expression (18).

5.7 Example of Non-Linear Synthesis FIG. 13 is a photograph of a hair tip image, and FIG. 14 shows a QY distribution of the photograph of the hair tip image. As shown in FIG. 14, in the region where the luminance of the image is low, the portion where the hair and the background intersect is not distributed on a straight line. This is a result of nonlinearity of signal conversion caused by γ correction and various image processing results after the light signal conversion by CCD.
In the chroma key algorithm, when converting to the new background, it is converted to the new background by assuming what process the intermediate area between the background and the foreground is, but in the conventional method, the linearity is assumed. Since the conversion of the area did not go well, and a method for adjusting by adding parameters was taken for that purpose, the number of parameters increased and it was difficult to adjust automatically.

  FIG. 15 is a diagram showing the logarithm of luminance Y and the distribution of Q. When the logarithm of luminance Y is taken as shown in the figure, the color distribution is almost on a straight line. In the present embodiment, attention is paid to this, and the process of generating the intermediate region is assumed to be linear on the logarithmic axis, not linear, and converted to a new background.

Then, a new Y is calculated by the following formula, assuming that the converted luminance is Y _new , the old background is Y _{BC ′ and the} new background is Y _{BC ”} .

  When this formula is arranged, the following formula is obtained.

If β = 1 in the equation (24), the following equation is obtained.

That is, in the background area of β = 1, the brightness is converted to the brightness of the new background when Yx = YBC, and the others are converted while maintaining the ratio of Y _X / Y _{BC and} the ratio of the brightness information is stored. In other words, it means that the shadow is kept.
When YBC in the equation (24) is Y _X , the following equation is obtained.

  When β = 1, it becomes the following formula and is converted to a new background.

  In this case, all the luminance information is converted to the new background, which means that the shadow is erased.

6). Calculation method of chroma key composition parameter k A calculation method of chroma key composition parameter k used for chroma key composition is shown below.

  FIG. 5 is a diagram for explaining the relationship between the subject and the background region.

  The subject is the foreground area 220, and the portion captured with a single color is the background area 210.

In normal chroma key composition, a subject is photographed with a single color background such as green or blue, and the background of the photographed image is replaced with another image based on the background color information.
Therefore, it is necessary to define a background color area to be replaced with another image. Here, the color range is determined by the IQ plane orthogonal to the Y axis, which is the brightness (luminance component).
The IQ plane represents the hue. The foreground region FG and the background region BG are separated by two straight lines passing through the origin on the IQ plane.

FIG. 7 is a diagram for explaining the relationship between two straight lines, the foreground region FG, and the background region BG.
A straight line L passing through the origin is expressed by using a vector A vector orthogonal to the straight line,

It can be expressed.
Therefore, if the vector orthogonal to the straight line L1 is A1, and the vector orthogonal to the straight line L2 is A2, the two straight lines are

An area surrounded by two straight lines can be expressed by the following four patterns.

  Therefore, if the vectors A1 and A2 and the areas (1) to (4) are defined, the background area BG and the foreground area FG can be defined.

FIG. 8 is a diagram for explaining a method for calculating the parameter k.
After the background area is defined, a background center BC vector is defined. An IQ value of a single background color is designated for the BC vector.
Now, when a vector X in the IQ plane is given, k of the vector X is calculated.
An intersection of a straight line passing through the vector X and the BC vector and the straight line L is defined as an FG vector.
A point at a distance r from a BC vector on a straight line passing through the vector X and the BC vector is defined as a BC ′ vector.

  It is preferable that the IQ value of the background color is constant, but variations always occur due to physical factors during shooting. In the present embodiment, in consideration of the variation, a circle with a radius r from the BC vector is set to k = 0, and the other k is calculated by the following equation.

  Specifically, when a vector orthogonal to the straight line L is an A vector, the straight line L is expressed by the following expression.

The BC vector is
It shows. Therefore, the straight line passing through vector X and BC 'vector is

It shows.
(9) k can be calculated by the following equation from (11).

  When the vector X is close to the BC vector, k <0 may be satisfied. In this case, k = 0.

  FIG. 9 is a flowchart for explaining an example of processing for obtaining the chroma key composition parameter k in the present embodiment.

  First, a background region is set based on the definitions of BC vector, A1 vector, A2 vector, BC vector, and r (step S10).

  The following processing is performed for each pixel until the end of the image data comes (step S20).

  First, the RGB value of the reference pixel is acquired (step S30).

  The RGB value is converted into YIQ (step S40).

  Vector X = (I, Q) is set (step S50). Here, the vector X is the I and Q components of the reference image.

  It is determined whether or not the vector X belongs to the background area (step S60). For example, it can be determined whether or not the vector X belongs to the background region by examining which of the expressions (7) -1 to (7) -4 is satisfied. In this case, if (7) -4 is satisfied, it can be determined that it belongs to the background area, and otherwise, it belongs to the foreground area.

  If it is determined that it belongs to the foreground area, k = 1 is set and the process returns to step S20 (step S70).

  If it is determined that it belongs to the background area, it is determined whether the vector X is closer to the straight line L1 or L2 (step S80).

  If close to L1, the A vector is set to A1 vector (step S90), and if close to L2, the A vector is set to A2 vector (step S100), and k is calculated from the A vector, r, and BC vectors (step S110). . For example, it can be calculated from equation (12).

  If k <0, k = 0 and the process returns to step S20 (steps S120 and S130).

  In the above example, the case where the RGB color space is converted to the YIQ color space and the calculation is performed on the IQ plane has been described as an example, but the present invention is not limited thereto. All planes that are perpendicular to the Y axis (obtained by linear transformation from the RGB color space) are the same calculation.

  For example, the same calculation is performed in the UV plane of the YUV color space. The same calculation is performed in the CrCb plane of the YCrCb color space.

  In any case, the straight line that distinguishes the foreground region and the background region can be extended to a line other than the straight line passing through the origin by extending the expression (9) to the following expression.

  At that time, the chroma key composition parameter k can be calculated by the following equation.

  When expanded in this way, a region that does not pass through the origin can be defined as shown in FIG.

  Since the vicinity of the origin of the hue plane is close to gray, calculation as a background region may result in an unnatural composition. At that time, the origin area can be excluded from the background area by defining it as shown in FIG.

Further, the color removal region MG can be defined by newly adding straight lines L3 and L4 as shown in FIG.
The color removal area is an area in which hue conversion and luminance conversion of the following expression are performed, an α value is set to 1, and no new background is combined.

In this case, in the BG region, the A3 vector and the A4 vector are used for calculating the expression (22), and the A1 vector and the A2 vector are used for calculating k.
This method can achieve two chroma key issues: the synthesis of a region (BG) in which the background region and the foreground region are mixed, and the synthesis of a region (MG) in which the background color is reflected in the foreground region.

7). Generation method of layer with α channel The layer with α channel is an image in which an α value is added to the RGB value of each pixel.
When this layer FG is combined with the background BG, a composite image is calculated by the following equation.

  Equation (35) is a linear composition with respect to α. Holding the data in the form of a layer with an α channel facilitates image processing such as color adjustment. Therefore, in practical use, it is necessary to create a layer with an α channel with high accuracy.

  FIG. 16 is a diagram for explaining the creation of a foreground image with the background color removed.

  In chroma key composition, an FG vector with no background color mixture is estimated from the vector X, and a synthesized vector X ′ is calculated from the FG vector and the new background BC ″ vector. The calculation of the vector X ′ is performed according to (24). What is important is the FG vector.

  Calculation of the FG vector on the IQ plane is performed by the following equation.

  This represents the projection from the vector X to the straight line L. Originally, as shown in FIG. 16, the intersection of the line X connecting the vector X and the BC vector and L should be the FG vector. However, the FG vector becomes very large and often exceeds the upper limit of IQ.

  For example, assuming that the vector X2 is at the position 410 in FIG. 16, the intersection of the straight line connecting the vector X and the BC vector and L is 420, which exceeds the upper limit of IQ. Therefore, in such a case, a point 430 where a perpendicular 440 extending from the point 410 of the vector X2 to the straight line L intersects the straight line L is set as a vector FG. That is, as an approximation, the projection of the vector X onto L is adopted. However, the parameter k is calculated on the assumption that 420 has an FG vector.

  The calculation of Y of the FG vector is performed as follows.

  Assuming that the luminance component of the FG vector is YFG, the luminance component of the vector X is Yx, and the luminance of the BC vector is YBC, the following equation is obtained if linearity is assumed.

Due to the non-linearity of the input device such as a camera, this equation is lost in the region where Y _X is small.

Therefore, with respect to Y _BC applying the following approximate expression. First, β is calculated by the following equation.

  Here, γ is a parameter defined by the user, and γ = 2 is adopted in the photo printing apparatus.

When γ <2, when Y is greater than the correction boundary value Y _thre , correction is performed using the following equation.

  This is because, when Y is large, IQ becomes small, so an unintended region is determined as a BG region. Make corrections to reduce the application of bright areas.

  Next, Y is calculated from β.

If you want high speed,
Even so, some results can be obtained.
Finally, the α value of the image is calculated by the following formula

  FIG. 17 is a flowchart for explaining an example of chroma key composition processing for performing nonlinear composition for generating a layer with an α channel according to the present embodiment.

First, a background region is set based on the definitions of the A1 vector, A2 vector, BC vector, r, and the corrected boundary value Y _thre (step S410).

  The following processing is performed for each pixel until the end of the image data comes (step S420).

  First, the RGB value of the reference pixel is acquired (step S430).

  The RGB value is converted into YIQ (step S440).

  Vector X = (I, Q) is set (step S450). Here, the vector X is the I and Q components of the reference image.

  It is determined whether or not the vector X belongs to the background area (step S460). For example, it can be determined whether or not the vector X belongs to the background region by examining which of the expressions (7) -1 to (7) -4 is satisfied. In this case, if (7) -4 is satisfied, it can be determined that it belongs to the background area, and otherwise, it belongs to the foreground area.

  If it is determined that the image belongs to the foreground area, FG vector = vector X and α = αmax are set, and the process proceeds to step S530 (step S470).

  If it is determined that the vector belongs to the background area, it is determined whether the vector X is closer to the straight line L1 or L2 (step S480).

  If close to L1, the A vector is set as the A1 vector (step S490), and if close to L2, the A vector is set as the A2 vector (step S500).

  Then, an FG vector is calculated from the A vector and the vector X (step S510). For example, it can be calculated using the equation (36).

Then, Y _FG and α are calculated from Y, Y _BC and k (step S520). For example, it can be calculated using equations (38), (27) to (31).

  Then, the YIQ value obtained in steps S510 and S520 is converted into an RGB value (step S530). The conversion from the YIQ value to the RGB value can be performed by, for example, coordinate conversion of Expression (18).

  In creating the layer with the α channel, the point is that the region is defined by a straight line on the hue plane, and the point where nonlinear calculation is used for the α value calculation method.

  Divide the foreground area from the background area by a 1 or 2 straight line passing through the origin (I = Q = 0) or a 1 or 2 straight line passing through other than the origin, and all the color elements in the background area are located anywhere on the straight line. The point is to move to. This is because the human eye is sensitive to hue differences but insensitive to saturation differences.

  Hue here refers to the slope of a straight line passing through the origin, and saturation corresponds to the distance from the origin.

  As a method of moving to some point on the straight line, for example, projection to a straight line may be taken as described in FIG. 16, but it may be moved to some point on the straight line by another method. Good.

  The challenges of chroma key composition are (1) where the background of the hair ends and the foreground are mixed, and (2) how the background color transfer to the clothes is naturally synthesized. Regarding (2), it is necessary to replace the color with a single color instead of combining with the background image.

  The photograph of FIG. 18 shows a state 610 in which the background color green is reflected on the subject due to the effect of shooting with the green back.

  In the photograph of FIG. 19, the green color is converted to orange (orange reflection 620). Since the background reflection changes to the new background color, the image is more natural.

  In many chroma key software, in order to remove this reflection, processing is divided into a region to be combined and a region from which the background color is removed. Here, in the background color removal area, the background color is simply removed, and the process of newly synthesizing orange as in the example of FIG. 19 is not performed.

  In this embodiment, for example, α can be set by the following expression, and a new background color can be reflected.

  FIG. 20 is a diagram showing the relationship between k and α when α is proportional to k on the IQ plane.

  On the other hand, FIG. 21 is a diagram showing the relationship between k and α when α is nonlinear with respect to k on the IQ plane.

  For example, by providing nonlinearity as in Expression (32), the change rate of α can be reduced when the distance (for example, chroma key composition parameter k) in the hue plane is within a predetermined range (portion close to k) 710.

  This means that an effect similar to that obtained by adding a colored region near the straight line as shown in FIG. 22 is produced.

  In addition, unlike the case of processing in the normal color removal area, the background image is also combined slightly, so that the effect is as if the new background color has been transferred. Realistic synthesis is possible.

Further, when the distance on the hue plane is outside the predetermined range (when the distance on the hue plane is large, or where α is close to 0) 620, the reduction rate of α can be reduced.
By doing so, it is possible to generate an image that is not affected by variations in the brightness of the background.

  Here, if the degree of synthesis with the background image is large, the background is transparent. However, by using a curve as shown in FIG. 21, it is possible to maintain a balance that is not transparent.

Increasing γ means widening the area corresponding to color removal.
In this way, by using a nonlinear expression such as the expression (32) in the calculation of α, the process of the synthesis area and the process of the color removal area, which have been separated so far, can be handled by the same process.

  When γ is 2 or more, the vicinity of the origin is a color removal region, so that correction of equation (28) is unnecessary. Therefore, a layer with an α channel can be created by a simple process.

  It should be noted that the α value may be obtained by conversion as shown in equation (32) using the chroma key composition parameter k described above, or may be obtained by any conventional technique as shown in equations (38) to (40), for example. Alternatively, it may be obtained by correcting the k value (α value) or the linearity obtained.

  A method for obtaining the α ′ value of the present embodiment by correcting the α value obtained by a given method will be described below.

  FIG. 27 is a diagram for explaining the relationship between the α value obtained by a given method and the corrected α value (α value in this embodiment).

  Here, the α value obtained by a given method may be, for example, an α value obtained based on k assuming linearity as shown in Equation (39), or a calculation method of k in the present embodiment ( For example, it may be an α value obtained based on the equation (12).

  Reference numeral 680 denotes a correction function that satisfies α ′ = f (α). The α value takes a value from 0 to 255. In the area where the α value is the first area (the area where the α value is close to 0) 650, the rate of change of f is reduced (for example, the inclination of f in the area is smaller than 1), and the α value is the third area. (Area where α value is close to 256) In 670, the rate of change of f is reduced (for example, the slope of f in the area is made smaller than 1). In the second area between the first area and the third area, the α value may be linearly converted to α ′ (for example, f is a straight line and the inclination is about 1).

  In this way, even if α changes slightly in the vicinity of the first area 650, it is possible to prevent α ′ from being affected. Therefore, it is possible to extract a foreground image that is resistant to variations in the brightness of the background color.

  Even in the vicinity of the third area 650, even if α slightly changes, α ′ is not affected, so that the reflection of the background can be removed naturally.

  For example, the α value obtained by a given method may be corrected using a predetermined conversion formula as shown in the following formula and converted to the α ′ value of the present embodiment.

  Further, for example, a conversion table from α to α ′ as shown in FIG. 28 may be prepared, and correction from α to α ′ may be performed using the table.

  The present invention is not limited to the one described in the above embodiment, and various modifications can be made.

  The present invention is not limited to that described in the above embodiment, and various modifications can be made.

  In the invention according to the dependent claims of the present invention, a part of the constituent features of the dependent claims can be omitted. Moreover, the principal part of the invention according to one independent claim of the present invention can be made dependent on another independent claim.

It is a right view of the photographic printing apparatus of this embodiment. It is a front view of the photo printing apparatus of this embodiment. It is a rear view of the photo printing apparatus of this embodiment. It is an example of the block diagram of the photo printing apparatus of this embodiment. It is a figure for demonstrating the relationship between a to-be-photographed object and a background area | region. It is a flowchart for demonstrating an example of the flow of the chroma key synthetic | combination process which performs nonlinear composition about the luminance component of embodiment. It is a figure for demonstrating the background area | region and foreground area | region in a hue plane. It is a figure for demonstrating the calculation method of the parameter k. It is a flowchart for demonstrating an example of the process which calculates | requires the chroma key synthetic | combination parameter k in this Embodiment. It is a figure for demonstrating conversion of a hue component. It is a figure for demonstrating the definition of the background area | region by the straight line which does not pass through an origin. It is a figure for demonstrating the definition method of a color removal area | region. It is a photograph of a hair tip image. The QY distribution of the photograph of a hair end image is shown. It is the figure which showed the logarithm of the brightness | luminance Y, and Q distribution of the photograph of a hair-end image. It is a figure for demonstrating preparation of the foreground image which removed the background color. It is a flowchart for demonstrating an example of the chroma key synthetic | combination process which performs nonlinear synthetic | combination about the production | generation of the layer with an alpha channel of embodiment. It shows how the background color of green is reflected in the subject due to the effect of shooting with green back. It shows how the green color has been converted to orange (orange reflection). It is the figure shown about the relationship between k and (alpha) when (alpha) is proportional to k on IQ plane. It is the figure shown about the relationship of k and (alpha) at the time of giving non-linearity to (alpha) with respect to IQ plane. It is a figure at the time of adding the color removal area | region near the straight line. It is a figure for demonstrating chroma key composition. It is the image produced | generated by the conventional system. The part of the hair end is shown. The skirt is shown. It is a figure for demonstrating the relationship between (alpha) value obtained by the given method, and (alpha) value after correction | amendment (alpha value of this Embodiment). It is a figure for demonstrating the correction | amendment using the conversion table from (alpha) to (alpha) '.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Photo printing apparatus 10, 12 Camera 20 Display 22, 24 Editing display 40 Photo receiving port 100 Processing part 110 Editing processing part 120 Image generation part 122 Chroma key composition part 124 Subject image generation part 130 with alpha channel Sound generation part 140 Photographing Unit 160 operation unit 170 storage unit 174 drawing buffer 180 information storage medium 190 display 192 sound output unit,
194 Portable information storage device 195 Printing unit 196 Communication unit

Claims (16)

A program for generating a subject image with an α value from an image of a subject photographed with a sampling color as a background,
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. A program characterized by determining. A program for generating a subject image with an α value from an image of a subject photographed with a sampling color as a background,
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. A program characterized by determining. In any one of Claims 1 thru | or 2.
The sampling color removing means includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. A program characterized by that. A program for generating a subject image with an α value from an image of a subject photographed with a sampling color as a background,
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The sampling color removing means includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. A program characterized by that. In claim 4,
The α value calculation means includes
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. A program characterized by determining. In any one of Claims 4 thru | or 5.
The α value calculation means includes
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. A program characterized by determining.   An information storage medium readable by a computer, wherein the program according to any one of claims 1 to 6 is stored. A photo printing device that captures, edits, and prints an image of a photographed subject,
Subject image capturing means for capturing an image of a subject by capturing an image of the subject using an extraction unit as a background with an extraction color; and
Subject image generation means with α value for generating a subject image with α value based on the captured subject image;
a composite image means for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generating means
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. A photographic printing apparatus characterized by determining A photo printing device that captures, edits, and prints an image of a photographed subject,
Subject image capturing means for capturing an image of a subject by capturing an image of the subject using an extraction unit as a background with an extraction color; and
Subject image generation means with α value for generating a subject image with α value based on the captured subject image;
a composite image means for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generating means
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The α value calculation means includes
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. A photographic printing apparatus characterized by determining In any one of Claims 8 thru | or 9.
The sampling color removing means includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. A photographic printing apparatus characterized by that. A photo printing device that captures, edits, and prints an image of a photographed subject,
Subject image capturing means for capturing an image of a subject by capturing an image of the subject using an extraction unit as a background with an extraction color; and
Subject image generation means with α value for generating a subject image with α value based on the captured subject image;
a composite image means for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generating means
Α value calculation means for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal means for removing the sampling color reflected in the subject image,
The sampling color removing means includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The point where the straight line connecting the hue position and the background center set based on the sampling color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. A photographic printing apparatus characterized by that. In claim 11,
The α value calculating means is
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. A photographic printing apparatus characterized by determining In any of claims 11 to 12,
The α value calculating means is
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. A photographic printing apparatus characterized by determining A photo printing method of a photo printing apparatus for capturing, editing, and printing a photographed subject image,
A subject image capturing step of capturing an image of a subject by capturing an image of the subject using an extraction unit with a sampling color as a background; and
A subject image generation step with an α value that generates a subject image with an α value based on the captured subject image;
a composite image step for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generation step includes:
An α value calculation step for obtaining a chroma key composition parameter for each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color, and computing an α value corresponding to each pixel of the subject image based on the chroma key composition parameter; ,
A sampling color removal step for removing the sampling color reflected in the subject image,
The α value calculating step includes:
In the vicinity of the first value indicating that the chroma key composition parameter is a foreground image, the α value of each pixel of the subject image has a functional relationship such that the rate of change of the α value with respect to the chroma key composition parameter is small. A photographic printing method characterized in that A photo printing method of a photo printing apparatus for capturing, editing, and printing a photographed subject image,
A subject image capturing step of capturing an image of a subject by capturing an image of the subject using an extraction unit with a sampling color as a background; and
A subject image generation step with an α value that generates a subject image with an α value based on the captured subject image;
a composite image step for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generation step includes:
An α value calculating step for obtaining a chroma key synthesis parameter of each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and calculating an α value corresponding to each pixel of the subject image based on the chroma key synthesis parameter; ,
A sampling color removal step for removing the sampling color reflected in the subject image,
The α value calculating step includes:
In the vicinity of the second value indicating that the chroma key composition parameter is a background image, the α value of each pixel of the subject image has a functional relationship such that the change rate of the α value with respect to the chroma key composition parameter is small. A photographic printing method characterized in that A photo printing method of a photo printing apparatus for capturing, editing, and printing a photographed subject image,
A subject image capturing step of capturing an image of a subject by capturing an image of the subject using an extraction unit with a sampling color as a background; and
A subject image generation step with an α value that generates a subject image with an α value based on the captured subject image;
a composite image step for generating a composite image by translucently combining a subject image with an α value and a given background image;
Generating a print image based on the composite image,
The α-valued subject image generation step includes:
An α value calculating step for obtaining a chroma key synthesis parameter of each pixel based on the hue component of each pixel of the subject image and the hue component of the extracted color and calculating an α value corresponding to each pixel of the subject image based on the chroma key synthesis parameter; ,
A sampling color removal step for removing the sampling color reflected in the subject image,
The sampling color removal step includes
A background area on the hue plane is defined by two predetermined straight lines, whether or not the hue value of each pixel of the subject image belongs to the background area, and for each pixel determined to belong to the background area, The straight line connecting the hue position and the background center set based on the extracted color intersects the straight line that is closer to the hue position of each pixel of the two predetermined straight lines, or the two straight lines from the hue position of each pixel. The hue value of the subject image from which the extracted color is removed is obtained based on the hue value specified by one of the points where the perpendicular line that is closer to the hue position of each pixel intersects the straight line. A photographic printing method characterized by the above.