JP5545316B2 - Print production apparatus and print production method - Google Patents

Description

  The present invention relates to a printed material production apparatus and a printed material production method for producing a printed material on which a face image is printed.

  2. Description of the Related Art Conventionally, there is known a box-type photography apparatus for taking an identification photograph or the like to be attached to a license, passport, resume, or the like. A photographic device shoots a person and prints and outputs photographs of various sizes according to usage.

  There is also known an apparatus that synthesizes a background image and prints out a person image by processing using chroma key composition (see, for example, Patent Document 1). In chroma key composition, a background color (wallpaper color) in a photographed image is determined, a subject portion (person image) is cut out, and a person image and a background image are superimposed.

  However, in the chroma key processing of the conventional photography apparatus, the detection accuracy of the boundary (subject contour) between the subject's face, hair, clothes, etc. and the background wallpaper is low, and the composite image of the person image and the background image is unnatural There was a problem of becoming.

Japanese Patent No. 4217066

  The present invention has been made in consideration of such points, and has a chroma key processing accuracy high, and a print production apparatus for printing a composite image in which a person image and a background image are synthesized in a natural state on a print, and It is an object of the present invention to provide a printed material production method.

  A printed matter manufacturing apparatus according to an aspect of the present invention includes a photographing apparatus that photographs a photographed person and generates a photographed image, a reception unit that receives person position information regarding a person position in the photographed image, and a background color in the photographed image. A chroma key processing unit that discriminates a person part from a photographed image by discriminating a part and a person part, combines the person image and a background image to create a composite image, and resizes the photographed image to generate a preview image. A resizing unit that generates a print image by resizing the composite image, a display unit that displays the preview image, and a printer that prints the print image on a print and outputs the print image. The chroma key processing unit is configured to, based on the person position information, for the captured image, a first area corresponding to a person, a second area corresponding to a background, and a circle of persons Classified into a third region corresponding to the determined color gamut as the background color portion in said third region, in which narrow than determining color range as the background color portion in said second region.

  In the printed material production apparatus according to one aspect of the present invention, the person position information includes information on a position of at least one of the top, chin, shoulder, eye, mouth, ear, and nose of the subject. preferable.

  In the printed material production apparatus according to one aspect of the present invention, it is preferable that the reception unit and the display unit include a touch panel, and the person position information is received using a preview image displayed on the touch panel.

  The printed matter production apparatus according to one aspect of the present invention further includes a storage unit that stores a plurality of background images, the display unit displays a plurality of background images, and the reception unit receives an instruction to select a background image. The chroma key processing unit preferably generates a composite image by combining the background image selected and instructed via the receiving unit and the person image.

  In the printed material production apparatus according to one aspect of the present invention, it is preferable that the resizing unit performs a reduction process of the captured image, and the chroma key processing unit cuts out a person image from the reduced captured image.

  In the printed material production apparatus according to one aspect of the present invention, it is preferable that the chroma key processing unit performs color conversion processing for increasing the brightness of the person image, and synthesizes the person image after color conversion and the background image. .

  In the printed material production apparatus according to one aspect of the present invention, it is preferable that the printed image production apparatus further includes a skin beautifying unit that performs skin beautification on the person image.

  In the printed matter producing apparatus according to one aspect of the present invention, it is preferable that the apparatus further includes a plurality of light irradiation units that irradiate light to the subject when the photographing device photographs the subject.

  According to an embodiment of the present invention, there is provided a printed matter manufacturing method, which includes a step of photographing a subject and generating a captured image, a step of generating a preview image by resizing the captured image, and displaying the preview image. A step of using the displayed preview image to receive person position information relating to a person position, a step of discriminating a background color part and a person part in the photographed image and cutting out the person image from the photographed image, A step of combining the person image and a background image to create a composite image; a step of resizing the composite image to generate a print image; and a step of printing the print image on a print and outputting the print image. In the step of cutting out the person image, based on the person position information, the photographed image has a first area corresponding to the person, a second area corresponding to the background, and Classified into a third region corresponding to the contour of the object, determining color range as the background color portion in said third region, in which narrow than determining color range as the background color portion in said second region.

  According to the present invention, it is possible to improve chroma key processing accuracy and print a composite image in which a person image and a background image are combined in a natural state on a print.

It is a schematic block diagram of the printed material preparation apparatus which concerns on embodiment of this invention. It is a figure which shows the example of input of person position information. It is a schematic block diagram of the arithmetic and control unit concerning the embodiment. FIG. 3 is a functional block diagram realized by executing an image processing program according to the embodiment. It is a figure which shows an example of an area | region classification. It is a flowchart explaining the printed matter preparation method which concerns on the same embodiment. It is a figure which shows an example of a display screen. It is a graph which shows the example of the brightness distribution of the person image before and after a color conversion process. It is a figure which shows color space. It is a figure which shows the example of arrangement | positioning of a strobe.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a schematic configuration of a print production apparatus according to the present embodiment. The printed material producing apparatus photographs the subject P and generates the captured image data, the arithmetic control device 1 that performs image processing on the captured image data, and prints the printed material (photograph). A printer 5 and a strobe 6 that irradiates the subject P with light when the photographing apparatus 2 photographs the subject P are provided. This print production apparatus prints and outputs a composite image obtained by synthesizing a person image and a background image on a print. In addition, the wallpaper on the back side of the subject P in the print production apparatus has a color suitable for chroma key composition, for example, blue or yellow-green.

  The photographing apparatus 2 is a digital camera, for example, and includes a lens, a shutter, a CMOS sensor, an A / D converter, and the like. When the imaging device 2 captures the subject P, the CMOS sensor receives the imaging light converged by the lens through the shutter, and photoelectrically converts the optical image formed on the light receiving surface, Output as an image signal. Then, the A / D converter performs A / D conversion on the image signal output from the CMOS sensor, and generates captured image data. The photographing device 2 outputs the photographed image data to the arithmetic and control device 1.

  The print production apparatus includes a touch panel (an instruction receiving unit and a display unit) 3 that receives various instructions from the subject P and displays a preview image.

  The touch panel 3 displays an operation button, and when the operation button is pressed, receives an operation instruction corresponding to the operation button. For example, the touch panel 3 receives an instruction on the use of the printed material from the user (photographer P). The use of the printed matter corresponds to the image size (photo size) that the printer 5 prints on the printed matter, and is, for example, a driver's license, passport, resume, and the like. The touch panel 3 can display at least one background image candidate and can accept a background image selection instruction from the user. The touch panel 3 can accept a print start instruction for the printer 5 from the user.

  In addition, the touch panel 3 displays an image photographed by the photographing device 2 and can accept an instruction on the position of the subject's head, chin, shoulder, eye, mouth, ear, nose, etc. on the display screen. In other words, the print production apparatus can accept input of information (person position information) related to a person position such as the crown, chin, shoulder, eyes, mouth, ears, and nose via the touch panel 3.

  For example, as shown in FIG. 2, a horizontal line L for indicating the position of the top of the head is displayed on the screen of the touch panel 3, and the user presses the decision button B with the position of the horizontal line L aligned with the top of the head, Person position information about is input. The user can adjust his / her position to the center in the horizontal direction by sitting in front of the photographing apparatus 2. Further, the touch panel 3 may display a vertical line for indicating the center of the face on the screen, and the user may align the center of the face with the vertical line.

  Further, the print production apparatus is provided with a billing unit (not shown) for accepting money paid by the photographed person P as the price of the print, or paying out change.

  The arithmetic control device 1 is connected to the photographing device 2, the touch panel 3, the printer 5, the strobe 6, and the accounting unit, and controls each unit and transfers data.

  FIG. 3 shows a hardware configuration of the arithmetic control device 1. The arithmetic control device 1 includes a CPU (central processing unit) 11, a main memory 12, a disk device 13, and an input / output unit 14. Each part of the arithmetic and control unit 1 is connected via a bus 15.

  The disk device 13 stores an image processing program 16 executed by the CPU 11 and a background image database 17 to be combined with a person image. The database 17 stores a plurality of background image data having different colors and patterns.

  The disk device 13 is, for example, a hard disk drive. The image processing program 16 may be stored not in the disk device 13 but in a ROM or a magnetic tape (both not shown).

  The CPU 11 loads the image processing program 16 in the disk device 13 into the main memory 12 and executes the image processing program 16.

  As the image processing program 16 is executed, an area for storing captured image data, person image data, background image data, and composite image data is secured on the main memory 12.

  FIG. 4 shows a functional block diagram realized by the CPU 11 executing the image processing program 16. By executing the image processing program 16, a selection unit 21, a chroma key processing unit 22, and a resizing unit 23 are realized.

  The selection unit 21 extracts data on a plurality of background images from the database 17 of the disk device 13 and outputs the data as background image candidate data to the touch panel 3. When the selection unit 21 receives a background image selection instruction from the user via the touch panel 3, the selection unit 21 passes the background image data selected by the user to the chroma key processing unit 22.

  When the chroma key processing unit 22 receives the photographed image data generated by the photographing device 2, the chroma key processing unit 22 cuts out the person image from the photographed image based on the person position information received via the touch panel 3.

  Specifically, first, the chroma key processing unit 22 uses the person position information to convert the captured image into a person corresponding area corresponding to the person, a background corresponding area corresponding to the background wallpaper, a person corresponding area, and a background corresponding area. To the contour corresponding region corresponding to the contour of the person between the two. For example, the chroma key processing unit 22 calculates the position of the shoulder or the like from the position of the crown or chin input as the person position information, and estimates the outline of the person.

  FIG. 5 shows an example of classification of each region. Since the person position information is given from the user via the touch panel 3, the chroma key processing unit 22 can accurately classify the person corresponding area A1, the background corresponding area A2, and the contour corresponding area A3. In FIG. 5, the contour corresponding area A3 is indicated by a hatched area.

  Next, the chroma key processing unit 22 performs a process of making the background color portion transparent with respect to the background corresponding region A2 and the contour corresponding region A3. Since the background color does not become a complete single color due to the difference in the amount of light irradiated from the strobe 6, the color range is widened and a color similar to the background color is also regarded as the background. Since the background corresponding area A2 is unlikely to contain a person, the color range is expanded and the background color portion is made transparent. On the other hand, the outline corresponding area A3 is an area corresponding to the outline of the person, and it is necessary to make a detailed discrimination between the background and the person. Therefore, the color range is set narrower than the background corresponding area A2, and The color difference between the person and the background color is determined, and the background color portion is made transparent. The color difference determined here is a hue difference, a saturation difference, or a combination of a hue difference and a saturation difference.

  Since the person corresponding area A1 is considered not to include the background color portion, the process as described above may not be performed. When the above-described processing is performed on the person corresponding area A1, the color range is set to be equal to or smaller than the outline corresponding area A3.

  By such processing, the background color portion in the photographed image can be made transparent and the person image can be cut out.

  The chroma key processing unit 22 combines the person image cut out from the photographed image and the background image received from the selection unit 21 to create a composite image. The background portion of the person image is made transparent, and image synthesis is performed by superimposing the background image received from the selection unit 21 on the transparent portion.

  The resizing unit 23 reduces the photographed image generated by the photographing device 2 or the composite image created by the chroma key processing unit 22 to a size corresponding to the preview display on the touch panel 3 and generates a preview image. The resizing unit 23 reduces the composite image created by the chroma key processing unit 22 to a size corresponding to the photo size to be printed by the printer 5, and generates a print image. For example, the image can be reduced by evenly thinning out vertical and horizontal pixels. The photo size printed by the printer 5 corresponds to the use instructed via the touch panel 3.

  When a print start instruction for the printer 5 is received from the user via the touch panel 3, print image data is output from the arithmetic control device 1 to the printer 5.

  The printer 5 prints the print image received from the arithmetic and control unit 1 on paper and outputs it. The printing method of the printer 5 is not particularly limited, and an ink jet method, a sublimation type thermal transfer method, a melt type thermal transfer method, or the like can be used.

  Next, a print production method using such a print production apparatus will be described with reference to the flowchart shown in FIG.

  (Step S <b> 101) The touch panel 3 receives an instruction for the purpose of a photograph to be printed.

  (Step S102) The person P to be photographed performs a deposit process.

  (Step S103) The imaging device 2 captures the subject P and generates captured image data. When the photographing device 2 performs photographing, the strobe 6 irradiates the person P with light.

  (Step S104) The resizing unit 23 resizes the captured image data generated in step S103 to generate preview image data. Then, the touch panel 3 displays a preview image. The photographed person P presses a determination button on the touch panel 3 when accepting the image displayed on the touch panel 3. Accordingly, the process proceeds to step S105.

  On the other hand, the subject P pushes a re-photographing button on the touch panel 3 when re-photographing is desired. Thereby, the process returns to step S103.

  Note that a plurality of images may be taken in step S103, a plurality of preview images may be displayed on the touch panel 3, and an image most liked by the subject P may be selected.

  (Step S <b> 105) The person P to be photographed instructs the positions of the crown and chin in the photographed image displayed on the touch panel 3 and inputs person position information.

  (Step S106) Using the person position information input in step S105, the chroma key processing unit 22 classifies the captured image into a person corresponding area, a background corresponding area, and a contour corresponding area.

  (Step S107) The chroma key processing unit 22 cuts out a person image from the captured image. For example, the background color portion is made transparent by expanding the color range similar to the background color with respect to the background corresponding region. Further, the background color portion is made transparent by narrowing the range of colors similar to the background color with respect to the contour corresponding region. The person corresponding area is included in the person image as it is.

  (Step S108) The selection unit 21 extracts data on a plurality of background images from the database 17 of the disk device 13 and displays them on the touch panel 3 as background image candidates.

  (Step S109) The chroma key processing unit 22 combines the person image cut out from the photographed image and the background image to create a combined image. Further, the resizing unit 23 reduces the composite image and creates a preview image. Here, the background image used for the composite image is any one of the background images displayed on the touch panel 3 as a background image candidate.

  Then, the touch panel 3 displays a composite image. For example, as illustrated in FIG. 7, the composite image 31 and the background image candidate 32 are displayed on the touch panel 3.

  (Step S <b> 110) When the subject P accepts the composite image displayed on the touch panel 3, he presses a determination button on the touch panel 3. Accordingly, the process proceeds to step S113. If the background image is to be changed, the process proceeds to step S111.

  (Step S111) A background image is selected from the background image candidates displayed on the touch panel 3.

  (Step S112) The resizing unit 23 synthesizes the person image generated in step S107 and the background image selected in step S111 to create a composite image. Then, the newly created composite image is displayed on the touch panel 3.

  (Step S113) The chroma key processing unit 22 creates print image data from the composite image data. Then, the printer 5 receives the print image data from the arithmetic and control unit 1, prints the composite image on paper, and outputs it.

  As described above, according to this embodiment, using the person position information instructed by the user, the photographed image is classified into the person corresponding area, the background corresponding area, and the contour corresponding area, and the background color portion and the person portion are classified. At the time of separation, by changing the color range regarded as the background color for each region, the person image can be cut out with high accuracy, and the chroma key processing accuracy can be improved. Further, by using the human image cut out in this way, a composite image in which the background image is synthesized in a natural state can be printed on the print.

  In the above embodiment, in the contour corresponding region, the background color portion located at the boundary between the person's skin and hair may be made translucent instead of transparent. By such a translucent process, the person image and the background image selected by the user can be synthesized in a more natural state.

  In the above-described embodiment, the chroma key processing unit 22 may perform color conversion processing on the person image cut out from the captured image so that the brightness is suitable for the ID photo. For example, the chroma key processing unit 22 performs brightness conversion as color conversion processing on a person image whose brightness distribution is as shown in FIG. 8A, and the brightness distribution as shown in FIG. 8B. A color-converted person image is generated. Here, in the graphs of FIGS. 8A and 8B, the vertical axis indicates the number of pixels (data amount), and the horizontal axis indicates the brightness. In general, images with high brightness are preferred for ID photographs. However, as can be seen from the color space shown in FIG. 9, the color difference decreases as the brightness increases. Since the person image is cut out by chroma key composition by determining the color difference between the person and the background color, it is difficult to cut out the person image if the brightness of the photographed image is high. Therefore, as shown in FIG. 8A and FIG. 9, the photographing apparatus 2 performs photographing so that the amount of lightness data that can increase the color difference is large, and then the lightness conversion of the clipped person image is performed. As shown in FIG. 8B, it is preferable to obtain an image with high brightness.

  Further, a skin beautification process may be performed on a human image to reduce the fine unevenness of the face (skin) and the rough feeling and process it into a smooth texture. In skin-beautifying treatment, for example, while maintaining the sharpness of the contours of the face and the contours of hair, eyes, nose, mouth, etc., it is possible to remove and reduce spots and wrinkles on the skin of the face, and to reduce unevenness. Then, smoothing processing that makes it look smooth is performed. For example, by executing the image processing program 16, a skin beautifying unit that performs the skin beautifying process as described above is realized. The skin beautification processing unit performs skin beautification processing on the person image before or after the color conversion processing by the chroma key processing unit 22. If the color conversion process and the skin beautification process can be performed simultaneously, they may be performed simultaneously.

  The chroma key processing unit 22 performs composition of the person image and the background image after such color conversion processing and skin beautification processing are performed on the person image. By performing color conversion processing or the like before synthesis with the background image, it is possible to prevent the color of the background image from changing.

  In the above embodiment, it is preferable to provide a plurality of strobes 6. For example, as shown in FIG. 10, it is preferable to provide strobes 6 not only on the front side of the subject P, but also on the left front side and the right front side. By arranging the strobe 6 in this way, the shadow of the subject P can be erased when the subject P is irradiated with light. Further, when the strobe 6 is disposed only on the front, the color of the wallpaper on the back side of the subject P may be reflected on the cheek of the subject P and reflected. Since the color of the wallpaper becomes a transparent part when the person image is cut out, it is difficult to cut out the person image accurately when the color of the wallpaper is reflected and overlaps the subject P. However, as shown in FIG. 10, by providing a plurality of strobes 6, it is possible to prevent the color of the wallpaper from being reflected and overlapping the subject P.

  For example, when the front of the subject P is 90 °, the strobes 6 obliquely left front and right forward of the subject P are installed in a range of 30 ° to 60 ° and 120 ° to 150 °. Further, instead of directly irradiating the subject P with the light from the strobe 6, reflected light from the inner wall or entrance curtain of the print production apparatus may be irradiated.

  Further, in the above embodiment, after the resize processing (reduction processing) of the captured image is performed, the captured image reduced by the chroma key processing unit 22 is classified into a person corresponding region, a background corresponding region, and a contour corresponding region. You may cut out. When the imaging device 2 generates a captured image with a high pixel count, it takes time to perform image processing on the captured image. Image processing can be speeded up by reducing the captured image. This resizing process can be performed by the resizing unit 23.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 Arithmetic control apparatus 2 Imaging device 3 Touch panel 5 Printer 6 Strobe 11 CPU
12 Main memory 13 Disk device 14 Input / output unit 15 Bus 16 Image processing program 17 Database 21 Selection unit 22 Chroma key processing unit 23 Resize unit

Claims (9)

A photographing device for photographing a subject and generating a photographed image;
A reception unit for receiving person position information related to a person position in the captured image;
A chroma key processing unit that discriminates a background color part and a person part in the photographed image, cuts out a person image from the photographed image, and synthesizes the person image and the background image to create a composite image;
Resizing the captured image to generate a preview image, resizing the composite image to generate a print image; and
A display unit for displaying the preview image;
A printer that prints and outputs the print image on a print;
With
The chroma key processing unit classifies the captured image into a first area corresponding to a person, a second area corresponding to a background, and a third area corresponding to a contour of a person based on the person position information, and A print production apparatus characterized in that a color range determined as a background color portion in three areas is narrower than a color range determined as a background color portion in the second area.   2. The print production apparatus according to claim 1, wherein the person position information includes information on a position of at least one of the top, chin, shoulders, eyes, mouth, ears, and nose of the subject. . The reception unit and the display unit are touch panels,
3. The print production apparatus according to claim 1, wherein the person position information is received using a preview image displayed on the touch panel. 4. A storage unit for storing a plurality of background images;
The display unit displays a plurality of background images,
The reception unit receives an instruction to select a background image,
4. The print according to claim 1, wherein the chroma key processing unit generates a composite image by combining the background image selected and instructed via the reception unit and the person image. 5. Product making device. The resizing unit performs a reduction process of the captured image,
5. The print production apparatus according to claim 1, wherein the chroma key processing unit cuts out a person image from the reduced photographed image. 6.   The said chroma key process part performs the color conversion process which makes the brightness of the said person image high, and synthesize | combines the person image after a color conversion, and the said background image. Print production device.   The printed material production apparatus according to claim 1, further comprising a skin beautification processing unit that performs skin beautification processing on the person image.   The printed material production apparatus according to claim 1, further comprising a plurality of light irradiation units configured to irradiate the subject with light when the photographing device photographs the subject. Photographing the subject and generating a photographed image;
Resizing the captured image to generate a preview image;
Displaying the preview image;
Using the displayed preview image to receive person position information related to the person position;
Discriminating a background color part and a person part in the photographed image and cutting out a person image from the photographed image;
Creating a composite image by combining the person image and the background image;
Resizing the composite image to generate a print image;
Printing the image for printing on a printed matter and outputting it;
With
In the step of cutting out the person image, the photographed image is classified into a first area corresponding to the person, a second area corresponding to the background, and a third area corresponding to the contour of the person based on the person position information. A printed matter producing method, wherein a color range determined as a background color portion in the third region is narrower than a color range determined as a background color portion in the second region.