JP2010267278A - Image processor, digital camera, image data structure, printer with automatic color correction function, method for creating photographic image with face object information, and method for correcting color - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To create a photographic image with face object information such that a photographic image with improper exposure can be color-corrected at high speed on a printer side. <P>SOLUTION: An image processor includes: an original photographic image obtaining means 11 for obtaining an original photographic image; a face object recognition means 12 for recognizing face objects in the original photographic image obtained by the original photographic image obtaining means; a face object information extracting means 13 for extracting the position information or the color information of the face objects on the original photographic image as face object information; and a photographic image creating means 14 for creating a photographic image with the face object information such that the face object information is added to or embedded in the original photographic image. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

The present invention provides an image processing apparatus having means for recognizing a face object in a captured image, a digital camera equipped with the image processing apparatus, an image data structure of an image with face object information, and color correction according to face object information. In particular, the present invention relates to an image processing apparatus to be performed, a printing apparatus with an automatic color correction function equipped with the image processing apparatus, a method for generating a captured image with face object information, and a color correction method for performing color correction according to face object information. The present invention relates to a technique for performing color correction and printing an image taken by appropriate exposure in a short time.

In recent years, printing apparatuses that can directly capture a captured image from an external device and print the captured image specified by the user without using a computer have come to be marketed.
This type of printing apparatus includes a port that can be mounted with a detachable memory mounted on a digital camera, and can capture and print a captured image stored in a memory mounted on the port. There is also a communication port that can receive a photographed image from a communication port of a digital camera, and can directly capture and print an image photographed by the digital camera.

By the way, when a person or the like is photographed with a digital camera, exposure is inappropriate (typically overexposure or underexposure) if, for example, the photographing region (the subject or the non-subject region) is irradiated with direct sunlight or strong illumination. It may become. When an image shot with such an inappropriate exposure is printed by the above-described printing apparatus (a printing apparatus that can directly capture a captured image), the color of the entire captured image becomes unnatural.

Of course, it is also possible to print an image that has been shot with an inappropriate exposure into a computer and perform color correction, but such color correction is generally adept at photo retouching. It can only be done by a person. For this reason, even in the case of an image that is known to have been shot with inappropriate exposure, it is almost always necessary to print the image as it is without being processed by a computer.

For this reason, when a photographed image is captured by the above-described printing apparatus, a face object (a person's face in the photographed image) is extracted from the photographed image, and the color of this face object is a suitable face color. Therefore, a printing apparatus with a color correction function for correcting the color of the entire photographed image has been proposed (Patent Document 1).

However, in order to extract a face object from a captured image, a heavy (a large amount of calculation) calculation process is required. Usually, a CPU mounted on a printing apparatus does not have a performance capable of recognizing a face object in a captured image at high speed. For this reason, when a series of processes such as recognizing a face object in a captured image and correcting the color of the captured image so that the color of the face object matches a suitable face color are performed by a conventional printing apparatus with a color correction function. In some cases, it takes a long time (a time longer than the time that the user can accept) from the print start instruction to the start of printing.

The object of the present invention is such that a photographed image with inappropriate exposure can be color-corrected at high speed on the printing apparatus side,
An object of the present invention is to provide an image processing apparatus for generating a captured image with face object information and a digital camera equipped with the image processing apparatus.

The object of the present invention is such that a photographed image with inappropriate exposure can be color-corrected at high speed on the printing apparatus side,
The object is to provide a data structure of a photographed image with face object information.

An object of the present invention is to provide an image processing apparatus capable of performing color correction on a captured image at high speed when a captured image with face object information is received, and a printing apparatus with an automatic color correction function equipped with the image processing apparatus. is there.

The object of the present invention is such that a photographed image with inappropriate exposure can be color-corrected at high speed on the printing apparatus side,
It is to provide a method for generating a photographed image with face object information.

An object of the present invention is to provide a color correction method for performing color correction on a captured image with face object information at high speed.

The gist of an image processing apparatus for generating a photographed image with face object information according to the present invention is (1) and (2).
(1) “An image processing apparatus for generating a captured image with face object information,
Original captured image acquisition means for acquiring an original captured image;
Face object recognition means for recognizing a face object in the original photographed image obtained by the original photographed image obtaining means;
Face object information extracting means for extracting position information or color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generating means for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
An image processing apparatus comprising: "

(2) “An image processing apparatus for generating a captured image with face object information,
Original captured image acquisition means for acquiring an original captured image;
Face object recognition means for recognizing a face object in the original photographed image obtained by the original photographed image obtaining means;
Face object information extracting means for extracting position information and color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generating means for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
An image processing apparatus comprising: "

The gist of the digital camera of the present invention is (3).
(3) "A digital camera equipped with the image processing apparatus according to (1) or (2),
A digital camera comprising a memory mounting means for attaching / detaching a memory for storing the photographed image and / or a communication means for outputting the photographed image data. "

The gist of the image data structure of the present invention is (4) and (5).
(4) “A data structure of a captured image with face object information, in which position information or color information of the face object in the original captured image is attached to the captured image with face object information or An image data structure characterized by being embedded. "

(5) “A data structure of a captured image with face object information, in which position information and color information of the face object in the original captured image are attached to the captured image with face object information or An image data structure characterized by being embedded. "

The gist of the image processing apparatus for performing color correction of the present invention is (6) to (8).
(6) “An image processing apparatus for performing color correction,
Image acquisition means for acquiring an image to be processed;
Comparison color information storage means for storing the comparison color information of the face;
Determination means for determining whether or not position information of a face object is attached or embedded in the image acquired by the image acquisition means;
Color information extraction means for extracting color information of an area indicated by the position information of the face object from the image when the determination means determines that the position information is attached or embedded in the image;
Color correction means for correcting the color of the image based on the color information extracted by the color information extraction means and the comparison color information;
An image processing apparatus comprising: "

(7) “An image processing apparatus for performing color correction,
Image acquisition means for acquiring an image to be processed;
Comparison color information storage means for storing the comparison color information of the face;
Determination means for determining whether color information of a face object is attached or embedded in the image;
When the determination unit determines that the color information is attached or embedded in the image, a color correction unit that performs color correction of the image based on the color information and the comparison color information;
An image processing apparatus comprising: "

(8) An image processing apparatus for performing color correction,
Image acquisition means for acquiring an image to be processed;
Comparison color information storage means for storing the comparison color information of the face;
Determining means for determining whether position information and color information of a face object are attached or embedded in the image acquired by the image acquiring means;
When it is determined that the position information and color information are attached or embedded in the image, the determination unit determines whether the position information and the comparison color information are extracted from the image based on the color information extracted by the color information extraction unit. Color correction means for performing color correction of the face object;
An image processing apparatus comprising: "

The gist of the printing apparatus of the present invention is (9).
(9) “A printing apparatus including the image processing apparatus according to any one of (6) to (8),
A printing apparatus comprising: a memory mounting unit that can attach and detach a memory that stores the captured image; and / or a communication unit that outputs data of the captured image. "
The gist of the method for generating a captured image with face object information according to the present invention is (10) and (11).

(10) “Original captured image acquisition step of acquiring an original captured image;
A face object recognition step for recognizing a face object in the original captured image acquired in the original captured image acquisition step;
A face object information extraction step of extracting position information or color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generation step with face object information for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
A method for generating a photographic image with face object information. "

(11) “Original captured image acquisition step of acquiring an original captured image;
A face object recognition step for recognizing a face object in the original captured image acquired in the original captured image acquisition step;
A face object information extraction step of extracting position information and color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generation step with face object information for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
A method for generating a photographic image with face object information. "

The color correction method of the present invention is summarized from (12) to (14).
(12) “Image acquisition step of acquiring an image to be processed;
A comparison color information storage step storing the comparison color information of the face;
A determination step of determining whether or not position information of a face object is attached or embedded in the image acquired in the image acquisition step;
When it is determined in the determination step that the position information is attached or embedded in the image, a color information extraction step of extracting color information of an area indicated by the position information of the face object from the image;
A color correction step for performing color correction of the image based on the color information extracted in the color information extraction step and the comparison color information;
A color correction method comprising: "

(13) “Image acquisition step of acquiring an image to be processed;
A comparison color information storage step storing the comparison color information of the face;
A determination step of determining whether color information of a face object is attached or embedded in the image;
When it is determined that the color information is attached or embedded in the image in the determination step, a color correction step for performing color correction of the image based on the color information and the comparison color information;
A color correction method comprising: "

(14) “Image acquisition step of acquiring an image to be processed;
A comparison color information storage step storing the comparison color information of the face;
A determination step of determining whether position information and color information of a face object are attached or embedded in the image acquired in the image acquisition step;
When it is determined in the determination step that the position information and color information are attached or embedded in the image, color correction of the face object in the image is performed based on the color information and the comparison color information. Color correction steps to be performed;
A color correction method comprising: "

According to the image processing apparatus for generating a photographic image with face object information and a digital camera equipped with the image processing apparatus of the present invention, a photographic image with inappropriate exposure can be color-corrected at high speed on the printing apparatus side.
By adopting the data structure of the photographed image with face object information according to the present invention, color correction can be performed at high speed on the printing apparatus side even if exposure is inappropriate during photographing.
According to the image processing apparatus for performing color correction of the present invention and the printing apparatus with an automatic color correction function equipped with the image processing apparatus, when a captured image with face object information is received,
Color correction of captured images is possible at high speed.
According to the method for generating a photographed image with face object information of the present invention, a photographed image with inappropriate exposure can be color-corrected at high speed on the printing apparatus side.
According to the color correction method of the present invention, a captured image with face object information can be color-corrected at high speed.

<< First Embodiment >>
FIG. 1A is a functional block diagram showing an image processing apparatus for generating a captured image with face object information according to the present invention.
1A, the image processing apparatus 1 includes an original captured image acquisition unit 11, a face object recognition unit 12, a face object information extraction unit 13, and a captured image generation unit 14.

For example, when the image processing apparatus 1 is mounted on a digital camera, the original captured image acquisition unit 11 can acquire the original captured image from the imaging unit 21 of the digital camera 2A (FIG. 1).
(See (B)).
The face object recognition unit 12 can recognize a human face object 911 in the original photographed image 91.

The face object information extracting unit 13 can extract position information (F (xf, yf) in the present embodiment) of the face object 911 in the original captured image 91 on the original captured image 91.
When there are a plurality of face objects in the original photographed image 91, the position information F (xf, yf) may be plural, and only the center coordinates of the face object having the largest area are used as the position information F (xf
, Yf).

Further, the position information is the center coordinates F (xf,
yf), block information including a rectangular block group on the face object, or a figure (rectangle, circle, ellipse, triangle, polygon, etc.) centered on the center coordinates of the face object It may be information. Further, as described in the third embodiment, it may be face object outline information G (xg, yg).

The captured image generation means 14 can generate a captured image 92 with face object information in which position information F (xf, yf) is attached to or embedded in the original captured image 91.

As shown in FIG. 1B, the image processing apparatus 1 can be mounted on a digital camera 2A. In FIG. 1B, the digital camera 2A includes an imaging unit 21, a captured image processing unit 22, an automatic focusing unit 23, an operation unit 24, a display unit 25, a memory mounting unit 26,
And communication means 27.

The imaging means 21 is an imaging device such as a CCD, and can generate an original captured image 91.
The captured image processing means 22 includes the image processing apparatus 1 of FIG. 1A. From the original captured image 91 generated by the imaging means 21, a captured image 92 with face object information, such as a JPEG format image, or a normal image is displayed. A captured image 93 can be created.

The automatic focusing means 23 can recognize a person's face object from the original photographed image 91 and focus on the person. In order to recognize a face object, the layout sample of the characteristic part such as eyes, eyebrows, nose, mouth, and the contour sample of the face are stored in a database, the original image is scanned in real time, the face position and Since the technique for measuring the distance to the face is well known, a description thereof will be omitted.

The operation unit 24 includes a power switch, a save key, a mode setting key, and the like in addition to the shutter. The shooting mode, editing mode, and the like can be set with a mode setting key.
On the display means 25, in the photographing mode, an image (captured image) taken by the imaging means 21 is shown in real time.

A memory 261 for storing the original captured image 91 is attached to the memory attachment means 26. The captured images 92 and 93 may be configured by writing additional information such as the shooting date and time in the header of the original captured image 91 or the like.
The communication unit 27 can output the captured image 92 as data. In this embodiment, the digital camera 2A includes both the memory mounting unit 26 and the communication unit 27, but may include either one.

The captured image 92 with face object information can constitute the image data structure of the present invention by writing position information (coordinates F (xf, yf)) in the header of the captured image 92 with face object information. The position information F (xf, yf) is coordinates on the original captured image 91 of the face object 911. The photographed image 92 with face object information is an original photographed image 91.
The position information F (xf, yf) is embedded as a digital watermark in the image data structure of the present invention.

FIG. 2A is a functional block diagram showing the image processing apparatus 3 for color correction according to the present invention. FIG.
In (A), the image processing apparatus 3 includes an image acquisition unit 31, a comparative color information storage unit 32,
The determination means 33, the color information extraction means 34, and the color correction means 35 are provided.

The image acquisition unit 31 can acquire the image 95 to be processed. The comparison color information storage means 32 stores face comparison color information SC.

The determination means 33 adds the position information of the face object (position information F on the image 95 (
It is possible to determine whether xf, yf)) is written or embedded. When the position information of the face object is written or embedded in the image 95, the image 9
Reference numeral 5 denotes an image 92 with face object information having the above-described image data structure.

When the determination unit 33 determines that the position information of the face object (position information F (xf, yf) on the image 95) has been written or embedded, the color information extraction unit 34 determines that the face information from the image 95 The color information EC of the region indicated by the position information F (xf, yf) of the object can be extracted.

When there are a plurality of pieces of position information F (xf, yf), for example, color information EC corresponding to each of them
Can be extracted and the average of these values can usually be used for color correction.
The color correction unit 35 includes the color information EC extracted by the color information extraction unit 34 and the comparison color information storage unit 3.
2, color correction of the image 95 (that is, the image 92 with face object information) can be performed to generate a color correction image 96. In this case, the color correction unit 35 can perform color correction when the color information EC and the comparison color information SC are close to each other in the color space and perform color correction when they are far away.

As shown in FIG. 2B, the image processing apparatus 3 for color correction can be mounted on the printing apparatus 4A. In FIG. 2B, the printing apparatus 4A includes a memory mounting means 41, a communication means 42, a print data generation means 43, a printing means 44, and an image storage means 45 in addition to the image processing apparatus 3. Yes.

The memory mounting means 41 is mounted with a memory 411 storing images. Typically, this memory is a memory 261 mounted on the memory mounting means 26 of the digital camera 2A shown in FIG. 1B as shown in FIG. 2B, but is not limited to this. (For example, it may be memory installed in a memory slot of a computer).

The image stored in the memory 411 may be a captured image having the above-described image data structure (captured image 92 with face object information) or an image not having the above-described image data structure ( For example, when the memory 411 is a memory mounted in a memory slot of a computer, it is not limited to a captured image but may be a document, a figure, or a picture).

The communication unit 42 can communicate the image of FIG. 1B with the communication unit 27 of the digital camera 2A and the like, and can receive the image. This image may also be a captured image having the above-described image data structure (captured image 92 with face object information), or may be an image not having the above-described image data structure. This image is stored in the image storage means 45.

In FIG. 2B, the image processing apparatus 3 includes both the memory mounting unit 41 and the communication unit 42, but may include either one.
The image processing apparatus 3 acquires the image 95 from the memory mounting means 41 and the communication means 42, and FIG.
The process described in A) is executed.
When the image processing apparatus 3 determines that the acquired image 95 is the face object information-added image 92 having the above-described image data structure, the print data generating unit 43 performs the color correction unit 3.
5 generates print data of the color corrected image 96 corrected in color, and the printing unit 44 prints the print data.

A method of generating the image 92 with face object information in the digital camera 2A shown in FIG. 1B will be described with reference to the flowchart of FIG.
In the present embodiment, it is assumed that the digital camera 2A is set to the shooting mode and the image processing apparatus 1 is in an operable state (active).

The imaging unit 21 displays the original captured image 91 that changes in real time on the display unit 25, and the captured original captured image acquisition unit 11 acquires the original captured image 91 from the imaging unit 21 (captured original image acquisition step). : S101).
The face object recognition means 12 scans the original photographed image 91 and recognizes a face object in the original photographed image 91 (face object recognition step: S102). In the present embodiment, the face object extraction function of the automatic focusing means 23 is used as it is as the face object recognition means 12.

When the face object recognition unit 12 does not recognize the face object in the original captured image 91 (“NO” in S103), the process returns to S102, but when the face object 911 is recognized in the original captured image 91 (S103). “YES”) indicates that the face object information extraction unit 13 uses the position information F (xf) of the face object 911 in the original captured image 91 on the original captured image 91.
, Yf) are extracted (face object information extraction step: S104).

When the shutter of the operation unit 24 is pressed and the save key for saving the original captured image 91 is pressed (“YES” in the captured image storage determination step: S105), the captured image processing unit 22 selects the original captured image 91, The image is converted into a predetermined format (JPEG in this embodiment) image (format conversion step: S106). The photographed image generating means 14 with face object information is
The position information F (xf, yf) is written in the header of the JPEG image or the position information F (xf, yf) is embedded in the JPEG image with a digital watermark to generate a captured image 92 with face object information (face object Captured image generation step with information: S107).

The photographed image 92 with face object information is stored (saved) in a memory 261 attached to the memory attachment means 26.
Note that the memory 261 storing the captured image 92 with face object information is removed from the memory mounting means 26 and mounted on the memory mounting means 41 of the printing apparatus 4A (the memory mounted on the memory mounting means 41 is denoted by reference numeral 411). Indicated). The captured image 92 with face object information stored in the memory 261 is stored in the image storage unit 45 of the printing apparatus 4A via the communication unit 27 and the communication unit 42 of the printing apparatus 4A.

A color correction method of the image 92 with face object information by the printing apparatus 4A shown in FIG.
In the present embodiment, it is assumed that the printing apparatus 4A is set in the color correction mode, and the image processing apparatus 3 is waiting for a print instruction in an operable state (active) (standby step: S20).
1).

When there is no print instruction (“NO” in S201), the image acquisition unit 31 continues the standby state. When a print instruction is given for the image 95 stored in the memory 411 attached to the memory attachment means 41, or a print instruction is given for an image stored in the image storage means 45 via the communication means 42 ("S201" YES ”), the image acquisition means 31 acquires an image for which printing has been instructed (image 95 to be processed) (image acquisition step: S202).

The determination unit 33 determines whether or not the image 95 is an image of a predetermined format (for example, a JPEG image) (format determination step: S203), and when it is not a JPEG image (S
203 "NO") stops the color correction process (color correction process stop step: S208).
Then, the print data generation unit 43 generates print data of the image 95 (S209), and the printing unit 44 performs a print process (that is, printing of the image 95) of this print data (S210).
.
An image that is not the color correction image 96 is shown as a normal image 97 in FIG.

Further, when the determination unit 33 determines that the image 95 is a JPEG image ("S203"
YES ”), the position information of the face object (position information F (xf
, Yf)) is written or embedded (position information presence / absence determination step: S204), and the position information of the face object (position information F (xf, yf) on the image 95)
) Is not written or embedded ("NO" in S204),
The color correction process is stopped (S208). Then, the print data generation unit 43 generates print data of the image 95 (S209), and the printing unit 44 performs a print process (that is, printing of the image 95) of this print data (S210).

In the position information presence / absence determination step S204, when the determination unit 33 determines that the position information of the face object (position information F (xf, yf) on the image 95) is written or embedded in the image 95 ( (“YES” in S204), the color information extracting means 34 displays the image 95.
The color information EC of the area indicated by the position information F (xf, yf) of the face object is extracted from (S2).
05).

Next, the color correction unit 35 compares the color information EC extracted by the color information extraction unit 34 with the comparison color information SC stored in the comparison color information storage unit 32 and performs color correction.
It can be performed in the B space, in the L ^* , a ^* , b ^* space, or in the YMC or YMCK space. In the present embodiment, color correction is performed in the RGB space.

The color ec (Rec, Gec, Bec) indicated by the color information EC is the color sc indicated by the comparison color information SC.
It is determined whether or not it is included in a predetermined region in the RGB color space centered on (Rsc, Gsc, Bsc) (color comparison step: S206).

For example, the following conditions are determined for the color ec (Rec, Gec, Bec) indicated by the color information EC.
Rsc−δR <Rec ≦ Rsc + δR (1a)
Gsc−δG <Gec ≦ Gsc + δG (1b)
Bsc−δB <Bec ≦ Bsc + δB (1c)
When the color ec (Rec, Gec, Bec) satisfies the above equation, the color ec (Rec, Gec, Bec) indicated by the color information EC is the color sc indicated by the comparative color information SC
If it is included in a predetermined area in the RGB color space centered on (Rsc, Gsc, Bsc) (“YES” in S206), the color correction process is stopped (S208).
The color ec (Rec, Gec, Bec) indicated by the color information EC is the color sc indicated by the comparison color information SC.
When it is not included in the predetermined region in the RGB color space centered on (Rsc, Gsc, Bsc) (“NO” in S206), the entire image 95 is appropriately corrected using tone curve correction, level correction, and the like. And a color corrected image 96 is generated (S207).

The color correction image 96 is transferred to the print data generation unit 43. As described above, the print data generation unit 43 generates print data from the color correction image 96 (S209), and sends the print data to the printing unit 44 for printing. The image 95 is printed by the means 44 (S210).

<< Second Embodiment >>
FIG. 5A is a functional block diagram showing an image processing apparatus for generating a captured image with face object information according to the present invention.
5A, the image processing apparatus 5 includes an original captured image acquisition unit 51, a face object recognition unit 52, a face object information extraction unit 53, and a captured image generation unit 54.

For example, when the image processing apparatus 5 is mounted on a digital camera, the original captured image acquisition unit 51 can acquire the original captured image from the imaging unit 21 of the digital camera 2B (FIG. 9).
(See (B)).

The face object recognition means 52 can recognize a human face object 911 in the original photographed image 91.
The face object information extraction unit 53 can extract the color information EC of the face object 911 in the original captured image 91 on the original captured image 91.
The captured image generation means 54 can generate a captured image 92 with face object information in which the color information EC is attached to or embedded in the original captured image 91.

As shown in FIG. 5B, the image processing device 5 can be mounted on the digital camera 2B. The configuration of the digital camera 2B shown in FIG. 5B is substantially the same as the configuration of the digital camera 2A shown in FIG.

FIG. 6A is a functional block diagram showing the image processing device 6 for color correction. 6A, the image processing apparatus 6 includes an image acquisition unit 61, a comparison color information storage unit 62, a determination unit 63, and a color correction unit 65.
The image acquisition unit 61 can acquire the image 95 to be processed.

The comparison color information storage means 62 stores face comparison color information SC.
The determination unit 63 can determine whether or not the color information EC is written or embedded in the image 95. When the face object color information EC is written or embedded in the image 95, the image 95 is the image 92 with face object information having the image data structure described above.

The color correction unit 65 performs color correction of the image 95 (that is, the image 92 with face object information) based on the color information EC and the comparison color information SC stored in the comparison color information storage unit 62, and displays the color correction image 96. Can be generated. In this case, the color correction unit 65 can perform color correction when the color information EC and the comparison color information SC are close to each other in the color space and perform color correction when they are far away.

As shown in FIG. 6B, the image processing apparatus 6 for color correction can be mounted on the printing apparatus 4B. The configuration of the printing apparatus 4B shown in FIG. 6B is the same as that of the printing apparatus 4A shown in FIG.
The configuration is almost the same.

A method for generating the image 92 with face object information in the digital camera 2B shown in FIG.
In the present embodiment, it is assumed that the digital camera 2B is set to the shooting mode and the image processing apparatus 5 is in an operable state (active).

The imaging unit 21 displays the original captured image 91 that changes in real time on the display unit 25, and the original captured image acquisition unit 51 acquires the original captured image 91 from the imaging unit 21 (captured original image acquisition step: S301).

The face object recognition means 52 scans the original photographed image 91 and recognizes a face object in the original photographed image 91 (face object recognition step: S302). In the present embodiment, the face object extraction function of the automatic focusing means 23 is used as it is as the face object recognition means 52.

When the face object recognition means 52 does not recognize the face object in the original photographed image 91 (“NO” in S303), the process returns to S302, but when the face object 911 is recognized in the original photographed image 91 (S303). “YES”) indicates that the face object information extraction unit 53 uses the position information F (xf) of the face object 911 in the original captured image 91 on the original captured image 91.
, Yf) are extracted (position information extraction step: S304).

When the shutter of the operation means 24 is pressed and the save key for saving the original captured image 91 is pressed ("YES" in the captured image storage determination step: S305), the captured image processing means 22 captures the original captured image 91, The image is converted into a predetermined format (JPEG in this embodiment) image, and the color information of the face object is extracted (color information extraction step: S306). The photographed image generating means with face object information 54 writes color information in the header of this JPEG image or this JPEG image.
By embedding color information with a digital watermark in the PEG image, the captured image 9 with face object information is provided.
2 is generated (step S307). In this embodiment, the face object information is color information, and the color information extraction step S306 corresponds to the face object information extraction step in the present invention.

The photographed image 92 with face object information is stored (saved) in a memory 261 attached to the memory attachment means 26.
The memory 261 in which the captured image 92 with face object information is stored is removed from the memory mounting means 26 and mounted on the memory mounting means 41 of the printing apparatus 4B (the memory mounted on the memory mounting means 41 is denoted by reference numeral 411). Indicated). The captured image 92 with face object information stored in the memory 261 is stored in the image storage unit 45 of the printing apparatus 4B via the communication unit 27 and the communication unit 42 of the printing apparatus 4B.

The color correction method for the image 92 with face object information by the printing apparatus 4B shown in FIG. 9B will be described with reference to the flowchart of FIG.
In the present embodiment, it is assumed that the printing apparatus 4B is set in the color correction mode, and the image processing apparatus 6 is in an operable state (active) and in a standby state (standby step: S401).

If there is no print instruction (“NO” in S401), the image acquisition unit 61 continues the standby state. When a print instruction is given for the image 95 stored in the memory 411 attached to the memory attachment means 41, or a print instruction is given for an image stored in the image storage means 45 via the communication means 42 ("S401"). YES ”), the image acquisition means 61 acquires the image instructed to be printed (image 95 to be processed) (image acquisition step: S402).

The determination means 63 determines whether or not the image 95 is an image of a predetermined format (in this embodiment, a JPEG image) (format determination step: S403), and when it is not a JPEG image (“NO” in S403), Cancel the color correction process (color correction process stop step: S4)
08). Then, the print data generation unit 43 is instructed to generate the print data of the image 95 (S4
08) When the print data generating unit 43 is instructed to generate the print data of the image 95, the print unit 44 performs a print process of the print data (that is, printing of the image 95) (S409).

An image that is not the color correction image 96 is shown as a normal image 97 in FIG.
Further, the determination unit 63 determines that the image 95 is a JPEG image (“S403”
YES ”) determines whether or not the color information EC of the face object is written or embedded in the image 95 (color information presence / absence determining step: S404), and the color information E of the face object is determined.
When C is not written or embedded (“NO” in S404), the color correction process is stopped (S408). Then, the print data generation unit 43 is instructed to generate the print data of the image 95 (S408), and the print data generation unit 43 generates the print data of the image 95 (S4).
08), the printing unit 44 performs a printing process of the print data (that is, printing of the image 95) (S409).

When the determination unit 63 determines that the color information EC of the face object is written or embedded in the image 95 (“YES” in S404), the color information EC extracted by the color information extraction unit 34 and the comparison color information The comparison color information SC stored in the storage means 62 is compared and color correction is performed.

As in the first embodiment, color correction can be performed in the RGB space, in the L ^* , a ^* , b ^* space, or in the YMC or YMCK space. Also in the present embodiment, the color ec (Rec, Gec, Bec) indicated by the color information EC is included in a predetermined region in the RGB color space centered on the color sc (Rsc, Gsc, Bsc) indicated by the comparative color information SC. It is determined whether or not (color comparison step: S405).

For example, the following conditions are determined for the color ec (Rec, Gec, Bec) indicated by the color information EC.
Rsc−δR <Rec ≦ Rsc + δR (1a)
Gsc−δG <Gec ≦ Gsc + δG (1b)
Bsc−δB <Bec ≦ Bsc + δB (1c)

When the color ec (Rec, Gec, Bec) satisfies the above equation, the color ec (Rec, Gec, Bec) indicated by the color information EC is the color sc indicated by the comparative color information SC
When it is not included in the predetermined area in the RGB color space centered on (Rsc, Gsc, Bsc) (“NO” in S405), a process of canceling the color correction process is performed (S408).

The color ec (Rec, Gec, Bec) indicated by the color information EC is the color sc indicated by the comparison color information SC.
When included in a predetermined region in the RGB color space centered on (Rsc, Gsc, Bsc) (“YES” in S405), the entire image 95 is appropriately corrected using tone curve correction, level correction, and the like. And a color corrected image 96 is generated (S406).

The color correction image 96 is transferred to the print data generation unit 43. As described above, the print data generation unit 43 generates print data from the color correction image 96 (S408), and sends the print data to the printing unit 44 for printing. The image 95 is printed by the means 44 (S409).
<< Third Embodiment >>

FIG. 9A is a functional block diagram showing an image processing apparatus for generating a photographed image with face object information according to the present invention.
In FIG. 9A, the image processing apparatus 7 includes an original captured image acquisition unit 71, a face object recognition unit 72, a face object information extraction unit 73, and a captured image generation unit 74.

For example, when the image processing apparatus 7 is mounted on a digital camera, the original captured image acquisition unit 71 can acquire an original captured image from the imaging unit 21 (see FIG. 9B) of the digital camera 2C.

The face object recognizing means 72 can recognize a human face object 911 in the original photographed image 91.
The face object information extraction unit 73 can extract the outline information G (xg, yg) and color information EC of the face object 911 in the original captured image 91 on the original captured image 91.

The photographed image generating means 74 uses the original photographed image 91 based on the outline information G (xg, yg) and the color information EC.
A captured image 92 with face object information attached to or embedded in can be generated.
As shown in FIG. 9B, the image processing device 7 can be mounted on the digital camera 2C. The configuration of the digital camera 2C shown in FIG. 9B is substantially the same as the configuration of the digital camera 2A shown in FIG.

FIG. 10A is a functional block diagram showing the image processing device 8 for color correction. FIG.
), The image processing apparatus 8 includes an image acquisition unit 81, a comparison color information storage unit 82, a determination unit 83, and a color correction unit 85.
The image acquisition unit 81 can acquire the image 95 to be processed.
The comparison color information storage means 82 stores face comparison color information SC.

The determination means 83 includes face information outline information G (xg, yg) and color information E on the image 95.
It can be determined whether C is written or embedded. When the contour information G (xg, yg) and the color information EC are written or embedded in the image 95, the image 95 is the image 92 with face object information having the above-described image data structure.

The color correction unit 85 can generate a color correction image 96 in which the color correction of the face object is performed based on the color information EC and the comparison color information SC stored in the comparison color information storage unit 82. In this case, the color correcting unit 85 can perform color correction when the color information EC and the comparison color information SC are close to each other in the color space, and perform color correction when they are far away.

As shown in FIG. 10B, the image processing apparatus 8 for color correction can be mounted on the printing apparatus 4C. The configuration of the printing apparatus 4C illustrated in FIG. 10B is substantially the same as the configuration of the printing apparatus 4A illustrated in FIG.
A method of generating the image 92 with face object information in the digital camera 2C shown in FIG.

In the present embodiment, it is assumed that the digital camera 2C is set to the shooting mode and the image processing apparatus 7 is in an operable state (active).
The imaging unit 21 displays the original captured image 91 that changes in real time on the display unit 25, and the original captured image acquisition unit 71 acquires the original captured image 91 from the imaging unit 21 (captured original image acquisition step: S501).

The face object recognition means 72 scans the original photographed image 91 and recognizes a face object in the original photographed image 91 (face object recognition step: S502). In the present embodiment, the face object extraction function of the automatic focusing means 23 is used as it is as the face object recognition means 72.

When the face object recognition unit 72 does not recognize the face object in the original photographed image 91 (“NO” in S503), the process returns to S502, but when the face object 911 is recognized in the original photographed image 91 (S503). “YES”) indicates that the face object information extracting means 73 has the contour information G (xg) of the face object 911 in the original photographed image 91 on the original photographed image 91.
, Yg) is extracted (contour information extraction step: S504).

When the shutter of the operation unit 24 is pressed and the save key for saving the original captured image 91 is pressed (“YES” in the captured image storage determination step: S505), the captured image processing unit 22 selects the original captured image 91, The image is converted into a predetermined format (JPEG in this embodiment) image, and the color information of the face object is extracted (color information extraction step: S506). The photographed image generating means 74 with face object information writes color information in the header of this JPEG image or
By embedding color information with a digital watermark in the PEG image, the captured image 9 with face object information is provided.
2 is generated (photographed image generation step with face object information: S507). In this embodiment, the face object information is contour information G (xg, yg) and color information EC, and the face object color information extraction step S506 corresponds to the face object information extraction step in the present invention.

The photographed image 92 with face object information is stored (saved) in a memory 261 attached to the memory attachment means 26.
The memory 261 in which the captured image 92 with face object information is stored is removed from the memory mounting means 26 and mounted on the memory mounting means 41 of the printing apparatus 4C (the memory mounted on the memory mounting means 41 is denoted by reference numeral 411). Indicated). The captured image 92 with face object information stored in the memory 261 is stored in the image storage unit 45 of the printing apparatus 4C via the communication unit 27 and the communication unit 42 of the printing apparatus 4C.

The color correction method for the image 92 with face object information by the printing apparatus 4C shown in FIG.
In the present embodiment, it is assumed that the printing apparatus 4C is set in the color correction mode, and the image processing apparatus 8 is in an operable state (active) and in a standby state (standby step: S601).

If there is no print instruction (“NO” in S601), the image acquisition unit 81 continues the standby state. When a print instruction is given for the image 95 stored in the memory 411 attached to the memory attachment means 41, or a print instruction is given for an image stored in the image storage means 45 via the communication means 42 ("S601"). YES ”), the image acquisition means 81 acquires an image for which printing is instructed (image 95 to be processed) (image acquisition step: S602).

The determination unit 83 determines whether or not the image 95 is an image of a predetermined format (in this embodiment, a JPEG image) (format determination step: S603), and when it is not a JPEG image (“NO” in S603), Stop color correction processing (color correction processing stop step: S6)
07). Then, the print data generation unit 43 is instructed to generate print data of the image 95 (S6).
08) When the print data generating unit 43 is instructed to generate the print data of the image 95, the print unit 44 performs a print process of the print data (that is, printing of the image 95) (S609).

An image that is not the color correction image 96 is shown as a normal image 97 in FIG.
Also, when the determination unit 83 determines that the image 95 is a JPEG image (“S602”)
YES ”) determines whether or not the contour information G (xg, yg) and the color information EC of the face object are written or embedded in the image 95 (contour information / color information presence / absence determination step: S604). When the outline information G (xg, yg) color information EC of the object is not written or embedded (“NO” in S604), the color correction process is stopped (S607).
. Then, the print data generation unit 43 is instructed to generate print data of the image 95 (S608).
The print data generation unit 43 generates print data of the image 95, and the printing unit 44 performs a print process of the print data (that is, printing of the image 95) (S609).

The judging means 83 includes the face object outline information G (xg, yg) and color information E on the image 95.
When it is determined that C is written or embedded (“YES” in S604), the color information EC is compared with the comparison color information SC stored in the comparison color information storage unit 82, and color correction is performed. .

As in the first and second embodiments, color correction can be performed in the RGB space, or L ^* , a ^* ,
It can be performed in the b ^* space, or in the YMC or YMCK space. Also in the present embodiment, the color ec (Rec, Gec, Bec) indicated by the color information EC is the comparison color information S.
It is determined whether or not it is included in a predetermined area in the RGB color space centered on the color sc (Rsc, Gsc, Bsc) indicated by C (color comparison step: S605).

For example, the following conditions are determined for the color ec (Rec, Gec, Bec) indicated by the color information EC.
Rsc−δR <Rec ≦ Rsc + δR (1a)
Gsc−δG <Gec ≦ Gsc + δG (1b)
Bsc−δB <Bec ≦ Bsc + δB (1c)

When the color ec (Rec, Gec, Bec) satisfies the above equation, the color ec (Rec, Gec, Bec) indicated by the color information EC is the color sc indicated by the comparative color information SC
If it is not included in the predetermined region in the RGB color space centered on (Rsc, Gsc, Bsc) (“NO” in S605), the color correction process is stopped (S607).
The color ec (Rec, Gec, Bec) indicated by the color information EC is the color sc indicated by the comparison color information SC.
When included in a predetermined region in the RGB color space centered on (Rsc, Gsc, Bsc) (“YES” in S605), the region indicated by the contour information G (xg, yg) is subjected to tone curve correction. And a color correction image 96 is generated by correcting the image by an appropriate correction method such as level correction (S60).
6).

The color correction image 96 is transferred to the print data generation unit 43. As described above, the print data generation unit 43 generates print data from the color correction image 96 (S608), and sends the print data to the printing unit 44 for printing. The image 95 is printed by the means 44 (S609).

It should be noted that the image processing apparatus of the present invention and the digital camera of the present invention can be equipped with a function that can determine the race related to the face object. For example, if white, yellow, or black races are determined based on facial contours, facial component layout, facial color, or facial skeleton, and color correction is performed, The color tendency can be extracted, and the facial color can be determined in consideration of this tendency in color correction. In addition, the digital camera can be provided with a function capable of setting the race. The face comparison color information can be set according to each country. For example, the comparison color of the face of a person in a Nordic country can be different from the comparison color of the face of a person in a country close to the equator. The digital camera may be provided with a function of selecting comparison color information according to race or the like so that the user can select a comparison color as appropriate.

(A) is a functional block diagram showing a first embodiment of an image processing apparatus for generating a photographed image with face object information of the present invention, and (B) shows a digital camera equipped with the image processing apparatus of (A). It is a functional block diagram. (A) is a functional block diagram showing a first embodiment of an image processing apparatus for color correction according to the present invention, and (B) is a functional block diagram showing a printing apparatus on which the image processing apparatus of (A) is mounted. . It is a flowchart which shows 1st Embodiment of the production | generation method of the image with face object information of this invention, and is a figure which shows the process in the digital camera shown to FIG. 1 (B). FIG. 4 is a flowchart showing a first embodiment of a color correction method for an image with face object information according to the present invention, and shows processing by the printing apparatus shown in FIG. (A) is a functional block diagram showing a second embodiment of an image processing apparatus for generating a photographed image with face object information of the present invention, and (B) shows a digital camera equipped with the image processing apparatus of (A). It is a functional block diagram. (A) is a functional block diagram showing a second embodiment of the image processing apparatus for color correction of the present invention, (B) is a functional block diagram showing a printing apparatus equipped with the image processing apparatus of (A). . It is a flowchart which shows 2nd Embodiment of the production | generation method of the image with face object information of this invention, and is a figure which shows the process in the digital camera shown to FIG. 5 (B). It is a flowchart which shows 2nd Embodiment of the color correction method of the image with face object information of this invention, and is a figure which shows the process by the printing apparatus shown to FIG. 6 (B). (A) is a functional block diagram showing a third embodiment of an image processing apparatus for generating a captured image with face object information of the present invention, and (B) shows a digital camera equipped with the image processing apparatus of (A). It is a functional block diagram. (A) is a functional block diagram showing a third embodiment of the image processing apparatus for color correction of the present invention, (B) is a functional block diagram showing a printing apparatus equipped with the image processing apparatus of (A). . It is a flowchart which shows 3rd Embodiment of the production | generation method of the image with face object information of this invention, and is a figure which shows the process in the digital camera shown to FIG. 9 (B). It is a flowchart which shows 3rd Embodiment of the color correction method of the image with face object information of this invention, and is a figure which shows the process by the printing apparatus shown to FIG. 10 (B).

1, 3, 5, 6, 7, 8 Image processing device 2A, 2B, 2C Digital camera 4A, 4B, 4C Printing device 11, 51, 71 Original captured image acquisition means 12, 52, 72 Face object recognition means 13, 53 73 Face object information extraction means 14, 54, 74 Photographed image generation means 21 Imaging means 22 Photographed image processing means 23 Automatic focusing means 24 Operation means 25 Display means 26 Memory mounting means 27 Communication means 31, 61, 81 Image acquisition means 32, 62, 82 Comparison color information storage means 33, 63, 83 Determination means 34 Color information extraction means 41 Memory mounting means 42 Communication means 43 Print data generation means 44 Printing means 45 Image storage means 35, 65, 85 Color correction means 91 Original photographed image 92 Photographed image with face object information 95 Image 261, 411 Memory 9 1 face object

Claims (14)

An image processing apparatus for generating a captured image with face object information,
Original captured image acquisition means for acquiring an original captured image;
Face object recognition means for recognizing a face object in the original photographed image obtained by the original photographed image obtaining means;
Face object information extracting means for extracting position information or color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generating means for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
An image processing apparatus comprising: An image processing apparatus for generating a captured image with face object information,
Original captured image acquisition means for acquiring an original captured image;
Face object recognition means for recognizing a face object in the original photographed image obtained by the original photographed image obtaining means;
Face object information extracting means for extracting position information and color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generating means for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
An image processing apparatus comprising: A digital camera equipped with the image processing apparatus according to claim 1 or 2,
A digital camera comprising a memory mounting means for attaching / detaching a memory for storing the photographed image and / or a communication means for outputting the photographed image data. A data structure of a captured image with face object information, in which position information or color information on the original captured image of a face object in the original captured image is attached or embedded in the captured image with face object information An image data structure characterized by that. A data structure of a captured image with face object information, in which position information and color information on the original captured image of a face object in the original captured image are attached or embedded in the captured image with face object information An image data structure characterized by that. An image processing apparatus for performing color correction,
Image acquisition means for acquiring an image to be processed;
Comparison color information storage means for storing the comparison color information of the face;
Determination means for determining whether or not position information of a face object is attached or embedded in the image acquired by the image acquisition means;
Color information extraction means for extracting color information of an area indicated by the position information of the face object from the image when the determination means determines that the position information is attached or embedded in the image;
Color correction means for correcting the color of the image based on the color information extracted by the color information extraction means and the comparison color information;
An image processing apparatus comprising: An image processing apparatus for performing color correction,
Image acquisition means for acquiring an image to be processed;
Comparison color information storage means for storing the comparison color information of the face;
Determination means for determining whether color information of a face object is attached or embedded in the image;
When the determination unit determines that the color information is attached or embedded in the image, a color correction unit that performs color correction of the image based on the color information and the comparison color information;
An image processing apparatus comprising: An image processing apparatus for performing color correction,
Image acquisition means for acquiring an image to be processed;
Comparison color information storage means for storing the comparison color information of the face;
Determining means for determining whether position information and color information of a face object are attached or embedded in the image acquired by the image acquiring means;
When it is determined that the position information and color information are attached or embedded in the image, the determination unit determines whether the position information and the comparison color information are extracted from the image based on the color information extracted by the color information extraction unit. Color correction means for performing color correction of the face object;
An image processing apparatus comprising: A printing apparatus equipped with the image processing apparatus according to claim 6,
A printing apparatus comprising: a memory mounting unit that can attach and detach a memory that stores the captured image; and / or a communication unit that outputs data of the captured image. An original captured image acquisition step for acquiring an original captured image;
A face object recognition step for recognizing a face object in the original captured image acquired in the original captured image acquisition step;
A face object information extraction step of extracting position information or color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generation step with face object information for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
A method for generating a photographic image with face object information. An original captured image acquisition step for acquiring an original captured image;
A face object recognition step for recognizing a face object in the original captured image acquired in the original captured image acquisition step;
A face object information extraction step of extracting position information and color information of the face object in the original photographed image on the original photographed image as face object information;
A captured image generation step with face object information for generating a captured image with face object information in which the face object information is attached or embedded in the original captured image;
A method for generating a photographic image with face object information. An image acquisition step for acquiring an image to be processed;
A comparison color information storage step storing the comparison color information of the face;
A determination step of determining whether or not position information of a face object is attached or embedded in the image acquired in the image acquisition step;
When it is determined in the determination step that the position information is attached or embedded in the image, a color information extraction step of extracting color information of an area indicated by the position information of the face object from the image;
A color correction step for performing color correction of the image based on the color information extracted in the color information extraction step and the comparison color information;
A color correction method comprising: An image acquisition step for acquiring an image to be processed;
A comparison color information storage step storing the comparison color information of the face;
A determination step of determining whether color information of a face object is attached or embedded in the image;
When it is determined that the color information is attached or embedded in the image in the determination step, a color correction step for performing color correction of the image based on the color information and the comparison color information;
A color correction method comprising: An image acquisition step for acquiring an image to be processed;
A comparison color information storage step storing the comparison color information of the face;
A determination step of determining whether position information and color information of a face object are attached or embedded in the image acquired in the image acquisition step;
When it is determined in the determination step that the position information and color information are attached or embedded in the image, color correction of the face object in the image is performed based on the color information and the comparison color information. Color correction steps to be performed;
A color correction method comprising:

Images