JP2006072506A - Photographic processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To realize the automatic trimming processing function of a face image and a changing function for changing an automatically set trimming region in a photographic processor. <P>SOLUTION: In this photographic processor, a processing means is provided with a face image recognizing means for automatically recognizing the region of a face image when a face image in a predetermined size or more is included in a fetched picture image and a region setting means for automatically setting a trimming region with a predetermined shape including the region recognized by the face image recognizing means, wherein processing based on the trimming region set by the region setting means is executed. Furthermore, this image processor is also provided with a region correcting means for performing any processing of the enlargement, reduction and movement of the trimming region set by the region setting means according to conditions designated by a touch panel unit. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a trimming technique for automatically recognizing a face image from a photographic image including a human face image and automatically setting a trimming region for the face image.

  A trimming technique for automatically recognizing a face image included in the photographic image from a photographic image such as a snapshot and automatically setting a trimming region for the face image is disclosed in Patent Documents 1 and 2, for example. No. 3 is disclosed.

JP-A-8-63597 JP 10-334213 A JP 2003-92726 A

In Patent Document 1, in order to extract a human face from a color original image such as a negative film or a positive film completely and accurately without human intervention, a face candidate area corresponding to the shape of a human face is provided. A face extraction method for extracting a human face from a color original image by determining and determining a face area from a feature amount in the face candidate area is disclosed.
In Patent Document 2, in order to automatically recognize a face image of a target person image from color image data including a person image without being affected by a shooting background and illuminance, and to cut out an area according to the size of the face image, An image acquisition CPU for acquiring a color image including a human image, a color liquid crystal display unit for displaying the acquired color image and the like, and a plurality of face recognition color data for recognizing a human facial image from the color image. In response to a pre-stored face recognition color memory, a recognition instruction unit for instructing face image recognition processing, and an instruction for the image recognition processing, the color data of the entire area of the color image is compared with the face recognition color data. A face image recognition CPU for recognizing an area of color data matching the face recognition color data of the face as a face image, an area instruction unit for instructing a cutout area of the recognized face image, and receiving an instruction for the cutout area, Image A frame creation CPU to create a frame of a region corresponding to the size, configuration image processing apparatus and personal computer programs have been disclosed from the face image extraction CPU for cutting out a face image of a region surrounded by the frame.
In Japanese Patent Laid-Open No. 2004-260260, a face image whose size and inclination are automatically corrected by recognizing and discriminating the face image is cut out and saved as another image file. An image memory for storing a portion of the image, an image capturing unit for importing the memory into another memory or a register in a predetermined unit, a control unit for controlling the entire control, a face feature storage unit for storing a plurality of facial features, and an image A recognition / discrimination unit that recognizes a face from data from the capture unit and data from the face feature storage unit and discriminates each part, a face image cutout unit that cuts out a predetermined face image from the result data, and a final determination An imaging device (digital camera) configured from an output unit that outputs results to the outside is disclosed.

  As described in the patent document shown above, in a personal computer or digital camera, automatic trimming of a face image is possible, but this is not realized in a photo processing apparatus and is automatically set. Since the function to change the trimming area is not realized, when a medium photographed with a general digital camera or a photo print is read from a reception apparatus at a lab store, the facial image is automatically There is a problem that trimming cannot be performed, and even if automatic trimming is enabled, there is a problem that trimming that captures not only a face image but also an image other than a face image cannot be performed.

  Therefore, the present invention has been made in order to realize an automatic trimming processing function for a photographic image including a face image and a change function for changing a trimming area automatically set in a photographic processing apparatus. Is.

The photographic processing apparatus of claim 1 according to the present invention comprises:
In a photographic processing apparatus comprising a capturing means for capturing a photographic image from an input medium, a processing means for processing the photographic image captured by the capturing means, and an output means for outputting the photographic image processed by the processing means,
The processing means includes
Face image recognition means for automatically recognizing a region of the face image when the captured photographic image includes a face image having a predetermined size or more;
Area setting means for automatically setting a trimming area having a predetermined shape including the area recognized by the face image recognition means,
The present invention is characterized in that the processing is performed based on the trimming area set by the area setting means.
In claim 2,
The face image recognition means automatically recognizes the areas of the plurality of face images when the captured photographic image includes a plurality of face images having a predetermined size or more;
The area setting means automatically sets a trimming area having a predetermined shape including all areas of a plurality of face images recognized by the face image recognition means.
In claim 3,
The trimming area set by the area setting means is added with area correction means for performing at least one of enlargement, reduction, and movement in accordance with a designated condition.
In claim 4,
The area correction means includes a trimming area set by the area setting means, an area including only a specified face image of a plurality of face images, or a specified face image of a plurality of face images. The feature is that the area is not included.
In claim 5,
The region correction means is configured to perform a trimming region correction process according to a condition designated by a touch panel unit disposed on a screen of a display device.

According to the present invention, when a face image having a predetermined size or more is included in a photographic image, the face image area is automatically recognized, so that the trimming operation is easy.
The face image recognizing means automatically recognizes the areas of the plurality of face images when the captured photo image includes a plurality of face images having a predetermined size or more, and the area setting means The trimming area having a predetermined shape including all the areas of the plurality of face images recognized by the face image recognition means is automatically set, so that the trimming operation is easy even when a plurality of persons are captured.
Further, since the trimming area set by the area setting means can be subjected to at least one of enlargement, reduction, and movement according to the designated condition, further effective trimming work can be performed. Can do.
In addition, the area correction unit may include the trimming area set by the area setting unit as an area including only a specified face image of a plurality of face images, or a specified face of a plurality of face images. Since the image can be corrected to an area not including the image, the intended trimming operation can be easily performed.
Further, since the correction content is designated by the touch panel unit arranged on the screen of the display device, the trimming area correction work is easy.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
In the printing system whose block diagram is shown in FIG.
Reference numeral 1 denotes a digital image receiving apparatus (hereinafter abbreviated as a receiving apparatus), which mainly reads photographic image information from various types of recording media (input media) brought by ordinary customers, A reading device RW capable of writing photographic image information depending on the type, a touch-panel type liquid crystal display device 2 that can be operated by the customer, a receipt issuing device 3, and a control device 4 are provided. Yes.
The control device 4 has a function of systematically controlling the devices and outputting photographic image information and order information via a network.
Reference numeral 5 denotes a digital photographic printing apparatus which prints image information on the photographic paper 5 (so-called print image formation). One or a plurality of the receiving devices 1 are connected to the photo printing device 3 via a network to constitute a printing system.
A scanner may be connected to the receiving device 1.

Below, the structure of the reception apparatus 1 is demonstrated. The liquid crystal display device 2 having a touch panel on the display surface is provided on the top surface of the housing 10 of the receiving device 1, and the reading device RW is provided on the front surface of the liquid crystal display device 2 on the top surface of the housing 10.
The reading device RW includes various recording media such as a multimedia card, a memory stick, a smart media, a compact flash (registered trademark), a CD-ROM, a CD-R, a CD-RW, a DVD-R, an MO, and a ZIP. A drive unit for reading and writing is arranged, and a USB connection port and an infrared communication device are also provided.
Further, a receipt issuing device 3 for issuing a receipt is provided on the front side of the housing 10.

A block configuration of the accepting apparatus 1 will be described with reference to FIG.
In FIG.
The touch panel type liquid crystal display device 2 includes a liquid crystal unit 21 and a touch panel unit 22 formed to overlap the screen of the liquid crystal unit 21. When the surface of the touch panel unit 22 is touched with a human finger or the like, touch information including the touched state and the touched position information is output.

The control unit 4 recognizes touch information input from the touch panel unit 22 and converts it into instruction information, and processes photographic image information input from the reading device RW to automatically process a face image. The face image recognition unit 42 that recognizes the image, the region setting unit 43 that automatically sets a rectangular trimming region including the face image, and the trimming region is corrected based on the instruction information output from the touch panel recognition unit 41. And an image generation unit 45 that generates a frame image indicating the corrected trimming region and displays the frame image superimposed on the input photographic image information.
The control unit 4 is generally composed of a CPU, a semiconductor memory, a hard disk device, and an input / output interface. The touch panel recognition unit 41, face image recognition unit 42, region setting unit 43, region correction The unit 44 and the image generation unit 45 are realized by the CPU that operates according to a dedicated program.
The reading device RW corresponds to a capturing unit in the claims, the control unit corresponds to a processing unit and an output unit in the claims, and the face image recognition unit 42 is a facial image in the claims. The region setting unit 43 corresponds to a recognition unit, the region setting unit 43 corresponds to a region setting unit in claims, the region correction unit 44 corresponds to a region correction unit in claims, and the image generation unit 45 is claimed. It corresponds to the output means of the range.

  In the above configuration, the touch information is input to the control device 4 and converted into instruction information in the touch panel recognition unit 41. That is, the touch panel recognition unit 41 interprets the touch information in association with the display information displayed on the liquid crystal unit 21, for example, “Yes” instruction, “No” instruction, position designation, range designation, etc. It is converted into instruction information for the control device 4.

  On the other hand, the photographic image information recorded on the recording medium set in the reading device RW is input to the control device 4, and a face area larger than a predetermined size is detected in the face image recognition unit 42. Judged automatically. In the area setting unit 43, a rectangular area having a predetermined aspect ratio including the face area is automatically set. The rectangular area is set to a predetermined aspect ratio and is set to a predetermined dimensional ratio with respect to the face area. For example, the ratio of the vertical length of the rectangular area to the vertical length of the face area is set to 2: 1 or the like. Of course, both the aspect ratio and the dimensional ratio can be set freely.

  The area correction unit 44 enlarges, reduces, or moves the rectangular area automatically set by the area setting unit 43 based on the instruction information output from the touch panel recognition unit 41.

The CPU of the control device 4 incorporates a program that operates as shown in the flowchart of FIG.
In FIG.
In step S1, a message such as “Please install the recording medium” is output on the screen of the liquid crystal display device to prompt the customer to install the recording medium and monitor whether or not the recording medium is installed. If the recording medium is securely loaded, the process proceeds to step S2. In step S2, photographic image information recorded on the recording medium is read and displayed as a thumbnail.
In step S3, it is instructed on the touch panel whether to correct or print as it is. If there is no need for correction, the “OK” portion is touched and the process proceeds to step S5. In the case of correction, a frame to be corrected and processing such as “trimming function”, “image adjustment”, “sharpness adjustment”, “rotation function”, and color tone conversion are selected.
When processing such as “image adjustment”, “sharpness adjustment”, “rotation function”, tone conversion ”is selected, the correction processing is performed in step S4, and the process proceeds to step S5.

If "Trimming function" is selected, the process proceeds to step S6.
In step S6, the face image is automatically recognized, the trimming area is automatically set, and displayed on the screen.
In step S7, if “OK” is touched, the process proceeds to step S5, and if “correction” is touched, the process proceeds to step S8.
In step S8, the touch panel is touched to enlarge, reduce, or move the trimming area.
In step S9, if the trimming area displayed on the screen is satisfactory, "OK" is touched and the process proceeds to step S10. If not satisfied, the process returns to step S8 and further correction is performed.
In step S10, the image data of the set trimming area is cut out and enlarged and displayed. In step S11, if the displayed trimming area is satisfied, “OK” is touched and the process proceeds to step S5. If not satisfied, the process returns to step S8. Further corrections.
In step S5, it is instructed whether to continue the correction. If it continues, the process returns to step S3 to display a thumbnail. If not, the process ends. In step S11, the content received from the receipt issuing device is displayed. A recorded receipt is issued.

Using the receiving device 1 described above, the customer can wear various types of recording media storing image information captured by a digital camera or the like while watching the screen of the touch panel display device 2. By appropriately operating, image information to be ordered for print output is designated, and order information such as the number of prints related to this print output is input.
Then, the customer presents the receipt issued from the receipt issuing device 3 of the reception device 1 to the person in charge at the counter of the DP store, so that the person in charge takes a photo based on the reception information recorded on the receipt The print information consisting of the order information including the corresponding image information and trimming information stored in the receiving device 1 by the operation from the print device 5 is taken in via the network, and the photo print device 5 prints based on this print information. And hand over the finished print P to the customer to settle the fee.

Next, operation examples of the face image recognition unit 42, the region setting unit 43, the region correction unit 44, and the image generation unit 45 will be described with reference to FIG.
In FIG. 4, for example, out of photographic image information read from a recording medium set by a general customer himself / herself, one frame selected by the customer himself / herself is indicated by D1, and a plurality of face images are indicated by F1 and F2. , F3, and a specific image other than the face image is indicated by G.
First, the face image recognition unit 42 automatically recognizes a plurality of face images F1, F2, and F3, and the region setting unit 43 includes the plurality of face images F1, F2, and F3. The rectangular area W1 is automatically set so that the horizontal width is 80% of the total horizontal width and the aspect ratio is, for example, 2: 3.
In the initial state, since the instruction information is not input, the rectangular region W1 is not corrected in the region correcting unit 44 but is input to the image generating unit 45. In the image generating unit 45, the rectangular region W1 corresponds to the rectangular region W1. A frame image to be generated is generated, superimposed and output on the original photographic image information D1, and displayed on the display surface of the liquid crystal display device 2.

Here, for example, when the customer wants to trim the image excluding the face image F3, he touches the portion of the face image F3 and designates position information of an area to be excluded on the touch panel unit.
Then, the area correction unit 44 includes only the plurality of face images F1 and F2 and does not include the face image F3, and the width of these face images F1 and F2 is, for example, 80% of the entire width. And a new rectangular area W2 having an aspect ratio of 2: 3, for example, is automatically set. Therefore, the previous rectangular area W1 disappears on the display surface, and a new rectangular area W2 is displayed together with the original photographic image information.

Here, for example, when the customer wants to further trim an area including the specific image G, the part of the specific image G is touched, and position information of the area where the specific image desired to be included in the touch panel unit is present. specify.
Then, the area correction unit 44 is an area that includes the plurality of face images F1 and F2 and the specific image and does not include the face image F3, and the width of this area is, for example, 80% of the entire width. And a new rectangular area W3 having an aspect ratio of, for example, 2: 3 is automatically set. Accordingly, the previous rectangular area W2 disappears and a new rectangular area W3 is displayed together with the original photographic image information on the display surface.

  Furthermore, when it is desired to slightly shift the rectangular area W3 as a whole, if the finger is moved on the touch panel while touching a part of the vertical or horizontal side of the frame image, the frame image is shifted by the amount of the finger. Moves to display a new rectangular area W4. (See Figure 5.)

  In addition, when it is desired to slightly enlarge or reduce the rectangular area W3 as a whole, if the finger is moved on the touch panel while touching the corner portion of the frame image, the frame is shifted in the direction in which the finger is shifted. The image is enlarged or reduced to display a new rectangular area W5. (See FIG. 5.) In this case also, the aspect ratio of the rectangular area is maintained.

In this way, the trimming area indicated by the rectangular area can be enlarged, reduced, or moved by touching the touch panel, so if you are not satisfied with the automatically set trimming area, you can freely Changes can be corrected.
In addition, the ratio of the horizontal width or vertical width of the rectangular area to the vertical width or horizontal width of the included face image, the aspect ratio of the rectangular area, etc. are not fixed to the above-mentioned ratios, and can be set freely. It is.
Finally, if you are satisfied with the displayed trimming area, touch the displayed “OK” or “Yes” part to end the trimming operation. For example, the correction process for the photo image of the next frame Or, trimming processing or the like is performed.
Finally, a print based on the trimming conditions designated as described above is obtained from the photographic printing apparatus 5.

As described above, according to the receiving apparatus 1, since the rectangular area including the face image included in the photographic image information is automatically set as the trimming area, the time required for the trimming operation can be saved. At this time, it is possible to automatically recognize the inclination and size of the face, and to automatically rotate the rectangular area or to enlarge / reduce it.
In addition, the automatically set trimming area can be easily corrected by simply touching the touch panel.

The means for supporting the correction of the trimming area is not limited to the touch panel unit, and it goes without saying that various information input means such as a mouse, a touch pen, a keyboard, and a tablet can be used. Absent.

The function of correcting a trimming area according to the present invention can be widely applied not only to a reception apparatus for photographic processing but also to a processing apparatus that handles a photographic image including a face image.

1 is a configuration diagram showing a configuration of an embodiment of a photographic processing apparatus according to the present invention. It is a block diagram of the principal part of the said photo processing apparatus. It is a flowchart explaining the process sequence of the principal part of the said photo processing apparatus. It is explanatory drawing explaining an example of the trimming process in the said photo processing apparatus. It is explanatory drawing explaining the other example of the trimming process in the said photo processing apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Reception apparatus, Photo processing apparatus 2 Touch panel type liquid crystal display device 21 Liquid crystal unit 22 Touch panel unit 4 Control unit 41 Touch panel recognition unit 42 Face image recognition unit, face image recognition unit 43 Area setting unit, area setting unit 44 Area correction unit, Area correction means 45 Image generation unit RW Reading means, capturing means

Claims (5)

In a photographic processing apparatus comprising a capturing means for capturing a photographic image from an input medium, a processing means for processing the photographic image captured by the capturing means, and an output means for outputting the photographic image processed by the processing means,
The processing means includes
Face image recognition means for automatically recognizing a region of the face image when the captured photographic image includes a face image having a predetermined size or more;
Area setting means for automatically setting a trimming area having a predetermined shape including the area recognized by the face image recognition means,
A photographic processing apparatus configured to perform processing based on a trimming region set by the region setting means.
The face image recognition means automatically recognizes the areas of the plurality of face images when the captured photographic image includes a plurality of face images having a predetermined size or more;
2. The photo processing apparatus according to claim 1, wherein the region setting unit automatically sets a trimming region having a predetermined shape including all the regions of the plurality of face images recognized by the face image recognition unit. .
The area correction means for performing at least one of enlargement, reduction, and movement of the trimming area set by the area setting means according to a specified condition is added. The photographic processing apparatus according to any one of the above.
The area correction means includes a trimming area set by the area setting means, an area including only a specified face image of a plurality of face images, or a specified face image of a plurality of face images. The photographic processing apparatus according to claim 3, wherein correction is made to an area that does not include.
The area correction unit is configured to perform a correction process of a trimming area according to a condition specified by a touch panel unit disposed on a screen of a display device. The photo processing apparatus according to 1.

Images