JP2002218315A - Image photographing apparatus, image output device and image processing system having both - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable suitable correction processing of image data, when recorded image is output. SOLUTION: An image processing system comprises an imaging apparatus and an image output device. The system sets information regarding image decision, including the state regarding a subject and information regarding a correcting process executed for the image data as image information data by an image information setting unit 33, forms recording data by relating to the image data representing the image of the subject imaged by an imaging unit 21 by an image data compositing unit 34 and records the recording data in an external memory 8 by a record controller 27.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image having a function of judging a state relating to a subject, correcting image data obtained by imaging the subject based on the result of the judgment, and storing the judgment information and the correction information. The present invention relates to a photographing device, an image output device that performs a correction process on image data using the stored information, and outputs the image data, and an image processing system including both devices.

[0002]

2. Description of the Related Art Among image capturing apparatuses such as cameras,
As a digital still camera using an image pickup device such as a CCD or a CMOS, a touch-panel-operated camera that enables photographing, reproduction, and printing with emphasis on a main subject intended by a photographer has been proposed (Japanese Patent Laid-Open No. Hei 11 (1999)). −
JP-A-136568).

In this publication, the position of a main subject is set on a touch panel at the time of photographing with a camera, and during printing or reproduction, brightness correction and skin color correction are performed using position information set as the main subject. Points are noted.

[0004]

However, in the camera described in the above-mentioned conventional publication, the position designated by the touch panel is simply set as the main subject, and the position information is stored. As processing, information on what correction processing has been performed is not stored.

Therefore, in the printing apparatus described in the publication,
Since it is determined whether or not the main subject is a person by detecting the skin color around the point indicated by the position information of the main subject, it takes time to print. In addition, as described in the same publication, when a plurality of persons are designated as main subjects, it is necessary to perform a touch operation at each position. Operability decreases.

[0006] The present invention has been made in view of the above,
When recording an image of a captured subject, by saving information about image determination including a state related to the subject and information about correction processing performed on image data, when outputting a recorded image, It is an object of the present invention to provide an image photographing apparatus capable of performing appropriate correction processing on image data.

Another object of the present invention is to provide an image output apparatus capable of outputting an image having been subjected to an appropriate correction process using information relating to image determination and correction processing stored by an image capturing apparatus. With the goal.

Another object of the present invention is to provide an image processing system provided with the above-mentioned image photographing device and the above-mentioned image output device.

[0009]

According to a first aspect of the present invention, there is provided an image pickup means for picking up an image of a subject and outputting image data of the subject, and judging a state of the subject using the image data output from the image pickup means. State determining means for performing image processing, image data correcting means for performing correction processing on the image data in accordance with the determination result by the state determining means, correction processing information setting means for setting information relating to the correction processing, Data creating means for creating recording data by associating the image data subjected to the correction processing by the correction means with information on the correction processing set by the correction processing information setting means, and recording the created recording data Recording control means for storing in the means.

According to this configuration, the state of the subject is determined by the state determination unit using the image data output from the imaging unit, and the image data is subjected to correction processing according to the determination result. Information about processing is set. Then, recording data is created by associating the corrected image data with the information on the set correction processing, and the recording data is stored in the recording unit.

As described above, since not only the image data but also the information on the correction processing is stored in the recording means, for example, when the image output device takes in the image data from the recording means and reproduces and outputs the image or prints out the image. In addition, by performing the correction process on the image data using the stored information on the correction process, a more appropriate correction process can be performed, thereby enabling a suitable image output.

As the recording means, a recording medium built in the apparatus or an external recording medium detachable from the apparatus can be adopted.

According to a second aspect of the present invention, in the image photographing apparatus according to the first aspect, the information on the correction processing set by the correction processing information setting means includes an exposure characteristic, a color balance characteristic, a γ characteristic, and an edge enhancement. It is characterized by including correction information on at least one of the characteristics.

According to this configuration, the correction information on at least one of the exposure characteristic, the color balance characteristic, the γ characteristic, and the edge enhancement characteristic is included in the information on the correction processing stored in the recording unit. Therefore, for example, when the image output device takes in the image data from the recording unit and reproduces and outputs the image or prints out the image, the image output device uses the correction information on the characteristics included in the stored information on the correction process. By performing a correction process on the characteristics for the image data, a more appropriate correction process can be performed, and thereby a suitable image output can be performed.

According to a third aspect of the present invention, there is provided an image pickup means for picking up an image of an object and outputting image data of the object, and a state determining means for judging a state relating to the object using the image data output from the image pickup means. Image data correction means for performing a correction process on the image data according to the determination result by the state determination means; and image determination information for setting the state relating to the subject determined by the state determination means as information relating to image determination. Setting means, and data creating means for creating recording data by associating the image data corrected by the image data correcting means with the information related to the image determination set by the image determination information setting means. Recording control means for storing the recording data in the recording means.

According to this configuration, the state of the subject is determined by the state determination unit using the image data output from the imaging unit, and correction processing is performed on the image data in accordance with the determination result. The state relating to the subject is set as information relating to image determination. And
Recording data is created by associating the corrected image data with the set information on the image determination, and the recording data is stored in the recording unit.

As described above, since not only the image data but also the information relating to the image determination is stored in the recording means, for example, when the image output device takes in the image data from the recording means and reproduces and outputs the image or prints out the image. In addition, by performing the correction process on the image data using the stored information regarding the image determination, a more appropriate correction process can be performed, and thereby a suitable image output can be performed.

As the recording means, a recording medium built in the apparatus or an external recording medium detachable from the apparatus can be adopted.

According to a fourth aspect of the present invention, in the image capturing apparatus according to the third aspect, the information relating to the image determination stored by the recording control means includes at least one of information relating to a photographic scene and a person. It is characterized by containing.

According to this configuration, at least one of the information on the photographing scene and the person is included in the information on the image determination stored in the recording means. When importing image data and reproducing / outputting or printing out the image,
Utilizing one or both of the information on the shooting scene and the person included in the stored information on the image determination, the image data can be corrected according to the shooting scene, By performing the above-described correction processing, more appropriate correction processing can be performed, and thereby a suitable image output can be performed.

The information on a person may include the presence or absence of a person, the number of persons, the size of a person in an image, and the like.

According to a fifth aspect of the present invention, there is provided a data capturing means for capturing, from an external device, recording data including information related to the image in addition to the image data representing the image;
Image data correction means for performing correction processing on the image data using the relevant information included in the captured recording data, image output means for outputting an image, and correction processing by the image data correction means. Output control means for outputting an image to the image output means based on the applied image data, wherein the image data correction means performs a correction process on the image data in accordance with an output characteristic of the image output means. It is characterized by being applied.

According to this configuration, in addition to the image data representing the image, recording data including information related to the image is fetched from the external device, and the related information included in the fetched recording data is read. Using, the correction processing according to the output characteristics of the image output means is performed on the image data,
An image is output to the image output means based on the image data on which the correction processing has been performed.

As the external device, for example, a recording medium built in the image photographing device or an external recording medium in which recording data is recorded by the image photographing device is used. Then, as the information related to the image, for example, information on the image determination determined by the image capturing apparatus such as information on a shooting scene or a person, and information on correction processing performed by the image capturing apparatus such as an exposure characteristic or a γ characteristic. etc,
It is included in the recording data.

Therefore, by performing a correction process on the image data according to the output characteristics of the image output means using the information related to the image, a suitable image is output to the image output means.

As the image output means, a display means such as a CRT or LCD for reproducing and outputting an image on a screen, a printing means such as a printer for printing and outputting an image on a recording sheet, and the like can be employed.

According to a sixth aspect of the present invention, in the image output device according to the fifth aspect, the data fetching means is provided for recording by the recording control means of the image photographing apparatus according to any one of the first to fourth aspects. It is characterized in that the recording data is taken in from recording means in which the data is stored.

According to this configuration, the recording means stores the recording data created by associating the image data with the information on the image determination, or the recording data created by associating the image data with the information on the correction processing. Has been saved. Therefore, by performing the correction processing according to the output characteristics of the image output means on the image data using the information regarding the image determination or the information regarding the correction processing, a suitable image is output to the image output means. Become.

According to a seventh aspect of the present invention, there is provided an image photographing apparatus according to any one of the first to fourth aspects, and an image output apparatus according to the sixth aspect.

According to this configuration, the image photographing device can
Recording data created in association with image data and information on image determination, or recording data created in association with image data and information on correction processing is stored in the recording means, while the image output device, Capture the recording data stored in this recording means, using information about image determination or information about correction processing,
Correction processing according to the output characteristics of the image output unit is performed on the image data, and a suitable image is output to the image output unit, so that a suitable image processing system is configured.

[0031]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First, a digital still camera as an embodiment of an image photographing apparatus according to the present invention will be described. FIG. 1 is a perspective view showing an appearance of the digital still camera, and FIG. 2 is a block diagram showing functional blocks of the digital still camera.

As shown in FIG. 1, the digital still camera 1 includes a camera body 2 and a lens barrel 3. On the back side of the camera body 2, an image display unit 4 composed of, for example, an LCD and an external memory 8 such as a card type memory are provided.
A memory mounting section 5 to which (FIG. 2) can be mounted is provided, and a shutter button 6 is provided on the upper surface thereof. Further, inside the lens barrel 3, a photographing optical system 7 composed of a lens group is provided.
Are arranged.

The digital still camera 1 has a function of capturing an image of a subject, taking in image data representing the image of the subject, performing correction processing such as color balance and contrast on the image data, and recording the image data.

As a correction process for image data, a standard correction process is performed in consideration of the existence of various image output devices, for example, a CRT, an LCD, a printer, and the like.

The shutter button 6 is, as shown in FIG.
A lock switch 11 and a release switch 12 are provided. The lock switch 11 is turned on when the shutter button 6 is half-pressed.
When 1 is turned on, the state shifts to the shooting preparation state. The release switch 12 is turned on when the shutter button 6 is further depressed from a half-pressed state and is fully depressed. When the release switch 12 is turned on, shooting (image recording) is performed.

The image display section 4 functions as an electronic viewfinder for displaying image data being picked up by the image pickup section 21 in real time in a shooting preparation state, and displays an image to be recorded when shooting is performed. It has become so.

In FIG. 2, a photographing optical system 7 focuses and zooms on a subject, and forms an image of the subject on a light receiving surface of the image pickup unit 21. The external memory 8 is a removable external recording medium, and may be, for example, a known card-type memory having an EEPROM such as a flash memory, a flexible disk (FD), or the like.

The imaging unit 21 has, for example, R, G, and B color filters disposed in front of a plurality of two-dimensionally arranged photoelectric conversion elements (for example, a CCD in the present embodiment, hereinafter also referred to as “pixels”). A color area sensor, an analog signal processing circuit, an A / D converter, and the like are provided to output a color image of a subject and output image data. The output image data is temporarily stored in an image data temporary storage unit 22. Is stored. The photoelectric conversion element is not limited to the CCD, but may be a CMOS or the like.

The imaging control unit 23 determines the imaging conditions such as the exposure time and gain in the imaging unit 21 at the time of the next capturing of the imaging data based on the information stored in the imaging data temporary storage unit 22 and the like. 21 for setting the image reading mode.

The image data processing unit 24 includes the respective function blocks 31 to 34 and has the following functions.

A function of performing predetermined processing on image data output from the image pickup section 21 and then determining a state of a subject including a photographic scene. Here, a predetermined process (for example, a thinning rate of image data, etc.) performed on image data output from the imaging unit 21 is different between the time of the shooting preparation state and the time of executing shooting.

A function of performing correction processing on image data so that the image becomes an appropriate image for the determined state relating to the subject.

The scene determination section 31 of the image data processing section 24
Has the following functions; a function of dividing image data output from the imaging unit 21 into a plurality of blocks, and determining a color cast state of the image based on color information of each block; A function of detecting the presence or absence of a person in an image; a function of creating a color histogram for each block for color cast determination and determining a main subject and a shooting scene based on the information of the color histogram and information on the presence or absence of a person.

The image data correction section 32 includes a scene determination section 3
The image data is subjected to correction processing with respect to various characteristics in accordance with the result of the determination made by step 1, for example, the color cast state, the main subject, the shooting scene, and the like. The characteristics include, for example, an exposure value, a color balance, a γ characteristic, and an edge enhancement process.

The image information setting section 33 sets, as image information, information relating to image determination such as a shooting scene and information relating to image correction such as a correction amount of image data. The image data synthesizing unit 34 associates the corrected image data corrected by the image data correcting unit 32 with the image information set by the image information setting unit 33 to create one recording data. .

The sequence control unit 25 controls a photographing sequence such as photographing and data acquisition. For example, when the lock switch 11 is turned on, a transition is made to a photographing preparation state, and when the release switch 12 is turned on, a photographing operation is executed. In response to the completion of the image pickup, the operation of the image data correction unit 32 is started.

The display control unit 26 includes an image data correction unit 32
The image is displayed on the image display unit 4 based on the image data subjected to the correction processing according to (1). In the shooting preparation state, the image corrected at high speed is displayed in real time, and the image to be recorded when the shooting is executed Is displayed. Recording control unit 27
Is for recording the recording data created by the image data synthesizing unit 34 in the external memory 8.

The functional blocks 21 to 27 in FIG.
One or more CPU, EEPROM, RAM, RO
It is composed of a memory such as M and various electronic circuits. The detailed operation of each of the functional blocks 21 to 27 will be described later.

Next, the image data output from the image pickup section 21 will be described with reference to FIGS. FIGS. 3 and 4 are views showing the arrangement of CCDs in the imaging unit 21.

In FIG. 3, the area sensor of the image pickup section 21 has an all-pixel mode and a thinning-out mode as an image reading mode. When the area sensor is set to the all-pixel mode, it outputs data of all pixels, while the mode is set to the thinning-out mode. Then
It outputs data thinned out at a predetermined pixel pitch in the Y direction.
Note that data of all pixels is output in the X direction. When the thinning mode is set to the three-pixel pitch, data of the pixel row indicated by the arrow shown in FIG. 3 is output.

Therefore, in the thinning mode, the image data processing unit 24 performs a process of thinning out the pixel data in the X direction at the same pixel pitch as the Y direction on the image data output from the image pickup unit 21. The processing described later is performed using the data thus obtained. Thus, in the thinning mode, the size ratios of the images in the X and Y directions are the same.

That is, in the thinning mode, the image data is reduced only in the Y direction when the pixel data of the area sensor is output, and the image data is reduced in the X direction during data processing, thereby reducing the image data in both the X and Y directions. I am trying to do it.

In general, as shown in FIG. 3, the color area sensor has a color filter of any one of R, G, and B disposed in front of each pixel. You can only get information. Therefore, in the present embodiment, color information of two colors that do not exist for each pixel is
It is obtained by performing data interpolation using information on the surrounding color.

In FIG. 4, for example, for the color information R ₂₂ and G ₂₂ of the pixel to which the color information B ₂₂ is output, for example, R ₂₂ = (R ₁₁ + R ₃₁ + R ₁₃ + R ₃₃ ) / 4 G ₂₂ = (G ₂₁ by _{+ G 12 + G 32 + G} 23) / 4 performs data interpolation using the data of four pixels around. In this way, R, G, and B color information is obtained for all pixels.

Next, the determination of the color cast will be described with reference to FIGS. FIG. 5 is a diagram illustrating an example of a divided block, and FIG. 6 is a diagram illustrating an example of a color cast determination result.

The color cast is determined for each block by dividing the area sensor of the imaging section 21 into a plurality of blocks. Therefore, if there is a color cast in all the blocks, it is determined as "color cast of the light source", and if only some of the blocks have a color cast, it is determined as "bias of a specific color". This makes it possible to correct only the color cast of the light source.

In the photographing preparation state, as shown by the solid line in FIG. 5, the image is divided into three blocks in the X direction and two blocks in the Y direction.
As shown by a solid line and a broken line in FIG. 5, the data is divided into a total of 24 blocks of 6 blocks in the X direction and 4 blocks in the Y direction.

That is, in the shooting preparation state, the image is divided into blocks coarser than when the shooting is executed. This is because it is necessary to display an image on the image display unit 4 in real time in the shooting preparation state, and it is not necessary to record the image. Therefore, a higher processing time than accuracy is required.

In the present embodiment, the color cast is determined using the average value of each color of the image data. When using this average value, if there is no color cast, Is used. However, Rave
(n), Gave (n) and Bave (n) are R,
This is the average value of the G and B data. In addition, n is a block number, and n = 1 to 6 in a shooting preparation state, and n = 1 to 24 in a shooting execution.

Since the sensitivity difference between the colors is corrected in hardware by an analog signal processing circuit provided in the image pickup unit 21, when the image pickup unit 21 picks up a white or gray test chart, the above equation (1) is obtained. , (2) from the imaging unit 21.

Then, the value BL (n) = (Kr (n), Kb (n)) (3) of each block is plotted on the two-dimensional coordinates composed of the axes Kr and Kb as shown in FIG. It is determined whether or not the color is cast based on the bias of the plotted points.

In FIG. 6, when there are many plot points on the lower right side of the boundary line L, it is determined that there is a reddish color cast, and when there are many plot points on the upper left side of the boundary line L, there is a bluedish color cast. Is determined, and when the plot points are substantially uniformly distributed on both sides of the boundary line L, it is determined that there is no color cast.

The color cast correction amount is calculated based on the center of gravity of the points plotted in the same color cast area. In the case of FIG. 6, the color cast correction amount is obtained based on the barycentric values of BL (1), BL (2), BL (3), BL (5), and BL (6).

For example, when the center of gravity value is (Kr, Kb) = (0.5, 0.2) (4), a correction coefficient for correcting a state without color fogging is Δr = 0.3 / 0.5 = 0.6. (5) Δg = 1 (6) Δb = 0.3 / 0.2 = 1.5 (7)

Here, since the color casts of red (R) and blue (B) located at both ends on the color spectrum are determined and corrected, the green (G) is determined as shown in the above equation (6). Correction coefficient Δg
= 1. Also, as shown in the above equations (5) and (7),
1/3 = 0.3.

If it is determined that there is no color cast, Δr = 1 Δg = 1 Δb = 1.

As described above, the image data output from the image pickup unit 21 is divided into a plurality of blocks, and the presence or absence of color cast is determined by obtaining the average color value of the pixel for each block. If a color cast of a light source or the like has occurred, the color cast is corrected. By correcting the color cast of the light source, a person, that is, a skin color can be accurately detected.

Next, an operation procedure of the digital still camera 1 will be described with reference to a flowchart. FIG.
9 is a flowchart of a main routine of the operation procedure.

When the power is turned on, first, the photoelectric conversion element (CCD in this embodiment) of the image pickup section 21 and the image display section 4
(Step # 100), and then the shutter button 6 is half-pressed and the lock switch 11 is turned on (NO in # 105). ),stand by.

Then, when the lock switch 11 is turned on (YES in # 105), the camera enters a shooting preparation state, shifts to a first shooting condition setting subroutine, and sets the shooting conditions in the shooting preparation state ( # 110).

FIG. 8 is a flowchart of the first imaging condition setting subroutine. In the figure, first, the imaging unit 21
Is set to the thinning mode (# 2)
00) Then, the CCD gain of the imaging unit 21 is set to high sensitivity (for example, 8 times in the present embodiment) (# 20).
5), is returned.

In the photographing preparation state, high-speed processing is required to display an image on the image display unit 4 in real time. Therefore, by setting the thinning mode, the reading time of the image data can be shortened, and by setting the CCD gain to high sensitivity, the exposure time of the CCD can be shortened, thereby realizing high-speed processing. are doing.

Returning to FIG. 7, image data captured by the image capturing section 21 under the set image capturing conditions is captured and stored in the image capturing data temporary storage section 22 (# 115).

Next, as described with reference to FIGS. 5 and 6, the image data is thinned out in the X direction (# 120).
The R, G, B data of each pixel is obtained by pixel data interpolation (# 125).

Next, the process proceeds to a first scene determination processing subroutine, and a shooting scene determination in a shooting preparation state is performed (# 130).

FIG. 9 is a flowchart of the first scene determination processing subroutine. In the figure, first, image data is thinned out at a predetermined pixel pitch (for example, 8 in the present embodiment) and taken in (# 220). Accordingly, in the present embodiment, since the data is thinned out at a three-pixel pitch at the time of reading, the image data thinned out at a 24-pixel pitch is used among the image data captured by the imaging unit 21.

Next, as described with reference to FIG. 5, the image data is divided into a total of six blocks, three blocks in the X direction and two blocks in the Y direction (# 225).
Based on (1) to (3), the value of each block is determined to determine the color cast of the image (# 230), and the correction coefficients Δr, Δg, Δb are determined (# 235).

Next, using this correction coefficient, R = Δr · R ′ (8) G = Δg · G ′ (9) B = Δb · B ′ (10) Is performed (# 24)
0). Here, R ', G', B 'are image data before correction, R,
G and B are image data after correction.

Subsequently, the corrected image data R, G, B
Using, , The image data based on the R, G, B signals is converted into image data based on the hue H and the corrected saturation Q (# 24)
5). Here, the range of each value is 0 ≦ H ≦ (maximum value of R, G, B) and 0 ° ≦ Q ≦ 360 °.

Since the hue H is not affected by the change in luminance, it is effective for detecting an object whose luminance change is expected. The modified saturation Q has a feature that the saturation value increases in proportion to the lightness, and it can emphasize the skin of a person more than the saturation required from the Munsell color system, so the brightness is relatively high Suitable for detecting human skin.

Next, the range of the skin color is set to 0 ≦ H ≦ 0.4 (13) 50 ° ≦ Q ≦ 120 ° (14), and it is detected whether or not the value of each pixel is within the range of the skin color. As a result, the presence or absence of a person is detected (# 25
0).

Next, the continuity of the pixel data of the flesh-colored pixels is determined, and flesh-colored pixels that can be determined to be continuous are connected (# 255). Here, the connection of pixels refers to creating a skin color area by connecting pixels that can be determined to be continuous in flesh color in the horizontal direction in order to check the continuity of pixels in the horizontal direction.

In this case, when a plurality of pixels equal to or more than a predetermined value are continuous, and when it is determined that only a pixel equal to or less than a predetermined value (for example, one) is not a flesh color, the entire pixel including the one pixel is included. May be determined to be continuous.

Subsequently, in the flesh-color area composed of the linked flesh-color pixels, a predetermined-size, predetermined-shape area is set as a candidate area where a human face is present (# 260), and the distribution and size of the flesh-color area are set. The main subject is provisionally determined based on the information such as the shape and the shape (# 265), and the process returns.

For example, when a plurality of skin color regions are arranged in the horizontal direction, it is determined that a plurality of human faces are arranged, and a plurality of main subjects may be set. Also, for example, 3
If the individual skin color areas form a vertically long isosceles triangle, it may be determined that the face and both hands are the same person, and the upper skin color area may be set as the main subject.

Returning to FIG. 7, the process then proceeds to a first image data correction subroutine, in which the image data is subjected to correction processing so that the provisionally determined main subject is suitably displayed on the image display unit 4. (# 135).

FIG. 10 is a flowchart of the first image data correction subroutine. In the figure, first, information such as the position of the tentatively determined main subject is taken in (# 28).
0) Then, exposure correction of the tentatively determined main subject is performed (# 285), and subsequently, correction of suppressed color cast is performed (# 290), and the process returns.

That is, although the correction relating to the color cast is performed, depending on the photographing scene such as a sunset scene, if the color cast is excessively corrected, an unnatural image may be obtained. Specifically, the correction coefficients Δr, Δg, and Δb may be set to values close to 1. For example, when the obtained correction coefficient is less than 0.7, the correction coefficient is set to 0.7.

Further, the obtained correction coefficients Δr and Δb are 1.1
When the correction coefficient Δr and Δb are less than 0.9, the correction is performed by using the result obtained by multiplying by the predetermined coefficient α (for example, α = 0.95) when the value exceeds 0.9. Is also good.

Returning to FIG. 7, an image is displayed on the image display section 4 based on the corrected image data (# 140). Then, until the release switch 12 is turned on (# 1
45, NO), the shooting preparation state is continued, and
Step 140 is repeated.

As described above, since the main subject is provisionally determined and the image data is subjected to the correction processing so that the provisionally determined main subject becomes an appropriate image, an image display functioning as an electronic viewfinder is provided. A suitable image can be displayed on the unit 4.

When the release switch 12 is turned on in this photographing preparation state (YES in # 145), the process proceeds to the second photographing condition setting subroutine of # 150 to execute photographing (image recording).

FIG. 11 is a flowchart of the second imaging condition setting subroutine. In the figure, first, the imaging unit 2
The image reading mode of the area sensor No. 1 is set to the all pixel mode (# 300).
The gain is set to the optimum level (# 305), and the process returns.

The optimum level of the CCD gain is determined based on the light receiving level of the CCD in the shooting preparation state.
3 is a level at which the CCD having the maximum light receiving level does not overflow, for example.

The photographing is not performed frequently but only when the release switch 12 is turned on.
Since image recording is performed, high accuracy is required rather than high speed. Therefore, by setting the all-pixel mode to improve the resolution of the image, the subsequent correction processing can be performed with high accuracy, and a high-resolution image can be obtained. Images can be obtained.

Returning to FIG. 7, the image data output from the imaging unit 21 under the set imaging conditions is fetched and stored in the imaging data temporary storage unit 22. As described above, the R of each pixel is interpolated by pixel data interpolation. , G, B data are obtained (# 155).

Next, the process proceeds to a second scene determination processing subroutine, and a shooting scene determination is performed (# 160).

FIG. 12 is a flowchart of the second scene determination processing subroutine. In the figure, first, image data obtained by thinning out image data at a predetermined pixel pitch (for example, 4 in the present embodiment) is captured (# 320). Accordingly, since the all-pixel reading mode is set, the image data thinned out at a 4-pixel pitch is used among the image data output from the imaging unit 21. That is, at the time of shooting, image data having a finer pixel pitch than in the shooting preparation state is used.

Next, as described with reference to FIG. 5, a total of 24 blocks of 6 blocks in the X direction and 4 blocks in the Y direction are used.
The image data is divided into blocks (# 325), and equation (1)
The color cast of the image is determined based on (3) (# 33)
0), and the correction coefficients Δr, Δg, and Δb are obtained (# 33).
5) Using this correction coefficient, the color cast of the image data is corrected by the above equations (8) to (10) (# 34).
0).

The determination of the color cast and the calculation of the correction coefficient are as follows.
This is performed in the same manner as the first scene determination processing subroutine (see FIG. 9) in the shooting preparation state, but can be performed with higher precision because the number of image data and the number of divided blocks are large.

Subsequently, the corrected image data R, G, B
Is used to convert the image data based on the R, G, and B signals into image data based on the hue H and the corrected saturation Q (# 345), and then, for each pixel, The presence or absence of a person is detected by detecting whether or not the value is within the range of the skin color set by the above equations (13) and (14) (# 3)
50).

Next, flesh color pixels are connected around the candidate area of the person set in the first scene determination processing subroutine (# 355). Next, the shape of the flesh-color area composed of the connected flesh-color pixels is determined (# 360), and the colors around and inside the flesh-color area are further determined (# 3).
65), the face of the person is detected (# 370).

For example, since hair exists around the face of a person, a continuous area such as black, brown, gold, or white exists. Since the color cast has already been corrected for the image data, the hair can be easily determined by using the corrected image data.

Next, a color histogram is created for each of the blocks divided in # 325 (# 375), and a photographic scene is determined based on information on the presence or absence of a person and information on the color histogram (# 380), and the process returns. .

Here, with reference to Table 1, an example of the photographic scene determination for the information on the presence or absence of a person and the information of the color histogram will be described.

[0106]

[Table 1]

[0107] As shown in Table 1,
In the present embodiment, for example, scene S1: snapshot, scene S2: portrait scene S3: commemorative photography scene S4: landscape photography scene S5: evening scene scene S6: night scene scene S7: Night view portrait, scene S8: sea, scene S9: fluorescent light source, scene S10: tungsten light source.

The snapshot of the scene S1 is determined when a general shooting scene is not determined as the following scenes S2 to S10.

The portrait of the scene S2 is for photographing a person large and beautifully, and is determined when a person's face exists in a large size and there is no color cast.

The commemorative photographing of the scene S3 is performed when a commemorative building or the like exists in the background of the person, and the person's face is present in a medium to small size and there is no color cast.

The landscape photographing of the scene S4 is for photographing a landscape at a long distance, and is determined when there is no face of a person and no fog of a specific color exists on the entire screen.

[0112] The sunset scene S5 is for photographing a red-stained landscape or a person at sunset, and is determined when the ratio of red in a part of the image is high regardless of the presence or absence of the person.

The night view of the scene S6 is for photographing a light source or a building illuminated by the light source in a dark situation, and is determined when no person exists and a black portion and a white portion are mixed. .

The night view portrait of the scene S7 is for photographing a person with the night view as a background, and is determined when the face of the person exists in a medium to large size and a black portion and a white portion are mixed. .

The sea of the scene S8 has the sea as a background and may include a person. The judgment is made when the blue ratio is high in a part of the image regardless of the presence or absence of the person.

The fluorescent lamp light source of the scene S9 is photographed under a fluorescent lamp, and is determined when the ratio of blue-green to the entire image is high due to the blue cast by the fluorescent lamp regardless of the presence or absence of a person.

The tungsten light source in the scene S10 is photographed under the tungsten light source, and is determined when the ratio of red in the entire image is high due to the red cast by the tungsten light source regardless of the presence or absence of a person.

Although not shown in Table 1, the photographic scene may be determined in consideration of information other than image data such as distance information to the subject and photographic magnification information.
As a result, scene determination can be performed with higher accuracy.

Returning to FIG. 7, following the second scene determination processing subroutine of # 160, the process proceeds to a second image data correction subroutine, in which a main subject is determined based on the determined photographic scene. Is applied to the image data (# 165).

FIG. 13 is a flowchart of the second image data correction subroutine. In the figure, first, information on the determined shooting scene is taken in (# 40).
0), information about the person is taken in (# 405),
The main subject is determined based on the information (# 41
0).

Next, the exposure value is corrected so that the determined exposure of the main subject is optimized (# 415). Here, the optimum exposure value is, for example, a value in which the average luminance Y of the main subject satisfies 100 ≦ Y ≦ 150 when the digital value is represented by 8 bits (0 to 255). The average luminance Y is obtained by the following equation (15), where R, G, and B are the image data of each color: Y = 0.299 · R + 0.587 · G + 0.114 · B (15)

Subsequently, an appropriate color cast is corrected for the determined photographic scene (# 420), and γ corresponding to the photographic scene determined from a plurality (for example, four in this embodiment) of γ correction curves. A correction curve is selected (# 425), and γ correction is performed based on the selected γ correction curve (# 4).
30), an edge enhancement process is performed using a filter corresponding to the determined shooting scene (# 435), and the process returns.

Here, with reference to FIGS. 14 and 15, an example of the correction processing performed on each determined photographic scene according to Table 2 will be described.

FIG. 14 is a diagram showing a γ correction curve. In this embodiment, for example, γ = 1.2 shown in FIG.
5, four types of γ = 1.3 shown in (c) and γ = 1.1 shown in (d) are stored in the memory in advance in a look-up table format. In addition, you may make it store with a mathematical formula instead of a table format.

FIGS. 15A and 15B show filters used in the edge enhancement processing. FIG. 15A shows a filter having a strong edge enhancement degree, FIG. 15B shows a filter having a medium edge enhancement degree, and FIG. This shows a filter having a weak edge enhancement degree.

[0126]

[Table 2]

As shown in Table 2, in the case of the snapshot of the scene S1, R, G, B
The normal white balance (WB) correction for performing the gain adjustment is performed, the standard correction (FIG. 14 (a)) having a medium contrast is performed as the γ correction, and the edge enhancement degree is set to the middle as the edge enhancement processing. Filter (Fig. 15)
Standard processing using (b)) is performed.

In the case of the portrait of the scene S2, skin color-priority WB correction for adjusting R, G, and B gains is performed as color balance correction so that the skin color of the face of the person is not impaired. In addition, in order to obtain an effect close to soft focus, a correction (FIG. 14 (d)) for weak contrast is performed as γ correction. The used processing is performed.

In the case of the commemorative photographing of the scene S3, skin color priority WB correction for adjusting R, G, and B gains is performed as color balance correction so that the skin color of the face of the person is not impaired. In addition, since it is preferable to perform standard correction in terms of clarity of the image, a correction (FIG. 14A) that provides a moderate contrast is performed as the γ correction, and the edge enhancement degree is determined as the edge enhancement processing. Processing using a medium filter (FIG. 15B) is performed.

In the case of landscape photography of scene S4, since the entire screen is used as a subject instead of portrait photography, color balance correction is not performed to give priority to color reproducibility.
Further, since the angle of view is wide, the contrast and the edge cannot be seen clearly unless they are strengthened. Therefore, a correction (FIG. 14C) for obtaining a strong contrast is performed as the γ correction, and the edge is enhanced as the edge enhancement processing. Processing using a filter with a high degree (FIG. 15A) is performed.

In the case of the evening scene of scene S5, no color balance correction is performed so as not to impair the color reproduction of the evening scene. Further, assuming an angle of view as in commemorative photography (scene S3), a standard correction is preferable. Therefore, a correction (FIG. 14A) that provides a medium contrast is performed as the γ correction, and an edge enhancement process is performed. Processing using a filter having a medium emphasis degree (FIG. 15B) is performed.

In the case of the night scene of the scene S6, the gain adjustment amount is reduced as compared with a normal color balance correction (gain correction coefficient is close to 1) so as not to impair the atmosphere of the night scene.
The weak WB correction is performed, and a correction (FIG. 14 (b)) that provides a relatively weak contrast is performed as the γ correction, and a filter having a medium edge enhancement degree (FIG. 15 (b)) is performed as the edge enhancement processing. The used processing is performed.

In the case of the night view portrait of the scene S7, since the person is photographed in a night view, the exposure value of the person portion is corrected so as to be optimal. Further, in order not to spoil the atmosphere of the night view, weak WB correction is performed as color balance correction. In addition, since the photographing is performed by a person, a correction with a relatively low contrast (FIG. 14B) is performed as the γ correction, and a filter having a medium edge enhancement degree (FIG. 15B) is used as the edge enhancement processing. Is performed.

In the case of the sea in scene S8, summer is assumed,
In order not to impair the atmosphere of strong sunlight, color balance correction is not performed, and a correction (FIG. 14C) that provides a strong contrast is performed as the γ correction, and a filter with a strong edge enhancement degree is used as the edge enhancement processing ( FIG.
Processing using (a)) is performed.

In the case of the fluorescent lamp light source of scene S9, the color cast by the fluorescent lamp is corrected, the normal WB correction is performed as the color balance correction, and the standard correction that provides a moderate contrast as the γ correction is performed. (FIG. 14A) is performed, and a standard process using a filter having a medium edge enhancement degree (FIG. 15B) is performed as the edge enhancement process.

In the case of the tungsten light source in the scene S10, the color cast is weakly corrected (the correction coefficient is close to 1, for example, 0.9) to leave a reddish atmosphere of tungsten light, and the WB is weak as color balance correction. Correction is performed. In addition, a standard correction (FIG. 14A) that provides a medium contrast is performed as the γ correction, and a filter having a medium edge enhancement degree (FIG. 15A) is used as the edge enhancement processing.
Standard processing using (b)) is performed.

Returning to FIG. 7, following the second image data correction subroutine of # 165, an image based on the corrected image data is displayed on the image display unit 4 (# 170). The process proceeds to set information on image determination and information on correction processing (# 175).

FIG. 16 is a flowchart of the image information data setting subroutine. In the figure, first, correction coefficients Δr, Δg, and Δb of each color are set (# 500), and then, a table R of a γ correction curve used for γ correction of each color is set.
t, Gt, and Bt are set (# 505), and data relating to the used edge emphasis filter is set (# 50).
8) Information about the determined shooting scene is set (# 510), information about the presence or absence of a person is set (# 515), and the number of persons is set (# 520).
The position and size of the person are set (# 525), the image information data end flag is set (# 530),
Is returned.

Returning to FIG. 7, following the image information data setting subroutine at # 175, at # 180, one piece of recording image data is created by associating the set image information data with the raw image data. .

FIG. 17 shows an example of the recording data.
FIG. 17 shows an example in which there are three persons. FIG.
The γ-correction curve set in # 505 of No. 6 may be set by a mathematical expression instead of a table format. Also,
The image information data end flag set in # 530 of FIG. 16 may be a predetermined code (for example, 1 of four consecutive bits). Further, data on the filter shown in FIG. 15 may be stored.

Returning to FIG. 7, when the recording data is recorded in the external memory 8 at # 185, the state shifts to the standby state. When # 185 ends, # 1
05.

As described above, according to the present embodiment, information relating to image determination of a photographed scene, a person, and the like, and information relating to correction processing such as color correction are stored. When an image is output by another device, such as a monitor display, a suitable image output can be made possible by using the stored information as described later.

In particular, it is very difficult to detect information about a person effective for performing a suitable image output based on only image data. On the other hand, when shooting, in addition to image data, distance information to the subject, shooting magnification information,
Since moving object information and the like can be obtained, person detection can be performed relatively easily by effectively using such information. Therefore, in the digital still camera 1, it is preferable to store information about a person and the like.

Here, an example of detection of moving object information and detection of a person using the moving object information will be described.

A moving object is detected by comparing the current image with an image before a predetermined time (for example, one second), and based on the amount of change in the average luminance Y during that time. The average luminance Y is obtained by the above equation (15), where each value of the color image signal is R, G, B.

First, the average value of the amount of change in the luminance Y in the predetermined areas at the four corners of the imaging range is detected as the camera shake amount (B _X , B _Y ). Next, X, X
After shifting in the Y direction by the blur amounts B _X and _BY respectively,
The difference between the luminance Y and the current image is compared with the image before the predetermined time. Then, an area where the obtained difference is not zero is detected as a moving object.

When the area detected as a moving object is flesh color, it is determined as a person. In addition, the shape of the area is determined. When the area is substantially circular, it is detected as a face, and when it is elongated, it is detected as a hand or a foot.

In the above embodiment, the color cast is determined using the average color value of the pixel data for each block. Instead, a color histogram is created to determine the color cast. You may. In this case, the above equation
In (1) and (2), if Rave (n), Gave (n) and Bave (n) are frequencies of a predetermined gradation width centered on R, G and B data instead of the average value, Good.

In the above embodiment, the thinning rate of the image data is changed between the time of the shooting preparation state and the time of executing the shooting. However, instead of this, or in addition to this,
The resolution of the image data may be changed. For example, the A / D converter of the photographing unit 21 may convert the digital value into a 6-bit digital value when the photographing is ready, and convert the digital value into a 10-bit digital value when performing the photographing. In this embodiment, as in the above embodiment, high-speed processing can be performed in the shooting preparation state, and a high-quality image can be obtained when shooting is performed.

In the above embodiment, the detection of the flesh color is
Converts image data based on R, G, B signals to hue H and corrected saturation
The image data is converted into image data based on Q, but is not limited to this. For example, the image data may be converted into values in the u ′, v ′ color space.
In this case, u '= (11.1 · R + 7.0 · G + 4.5 · B) / (17.8 · R + 70.8 · G + 18.8 · B) ... (16) v' = (9.0 · R + 41.3 · G + 0.54 (B) / (17.8.R + 70.8.G + 18.8.B) (17) converts image data based on the R, G, B signals into image data based on the u ', v' color space.

Then, the range of the skin color is set to 0.225 ≦ u ′ ≦ 0.270 (18) 0.470 ≦ v ′ ≦ 0.505 (19), and it is determined whether or not the value of each pixel is within the range of the skin color. What is necessary is just to detect.

The image data based on the u ′, v ′ color space is not affected by the change in luminance, so that the skin color can be suitably detected.

Next, a printer as an embodiment of the image output apparatus according to the present invention will be described. FIG. 18 is a perspective view showing the appearance of the printer, and FIG. 19 is a block diagram showing functional blocks of the printer.

In FIG. 18, a printer 40 is a self-type printer that prints out an image recorded by the digital still camera 1, and has external recording medium loading ports 42, 43, 44 at appropriate positions in the apparatus main body 41. A discharge port 45 from which the recording paper is discharged and an operation display unit 46 are provided.

The external recording medium loading ports 42 to 44 are for loading a detachable external recording medium 47 (FIG. 19) used for a digital still camera. For example, the external recording medium loading port 42 has an EEPROM or the like. Card-type memory equipped with an external recording medium loading port 43
A card type memory of a different standard from the memory loaded in the external recording medium loading port 42 is loaded into the external recording medium loading port 42, and the FD is loaded into the external recording medium loading port 44. Therefore, the external memory 8 (FIG. 2) stores the external recording medium loading port 42.
What is necessary is just to load in the suitable loading port among -44.

The operation display section 46 has a touch panel laminated on a liquid crystal display section.
In addition to displaying images and the like recorded in memories loaded in the memory devices 2 to 44, an instruction to select an image to be printed out can be given.

In FIG. 19, a data fetching section 51 fetches data recorded on the external recording medium 47 loaded in the external recording medium loading ports 42 to 44, and sends the data to the image processing section 52. . Here, of the captured data, data representing an image is transmitted as color image data 51R, 51G, and 51B.

The image processing section 52 uses the image information data when the data fetched by the data fetching section 51 includes image information data together with image data representing an image as shown in FIG. And performs a correction process on the image data, and has the following functions:

The color image signal 51 is set so that the luminance of the position of the person indicated by the image information data becomes an appropriate value.
Function to correct output values of R, 51G, 51B.

Here, in the present embodiment, an appropriate value of the luminance means that, for example, when the digital value is represented by 8 bits (0 to 255), the average luminance Y of the partial area satisfies 100 ≦ Y ≦ 150. It is a thing.

The average luminance Y is equal to the color image signal 51.
Assuming that the respective values of R, 51G, and 51B are R, G, and B, they can be obtained by the above equation (15).

The color image signals 51R and 51R are set so that the color data at the position of the person indicated by the image information data is included in the appropriate range represented by the above equations (13) and (14).
A function for performing a color balance correction process for correcting the ratio of G and 51B. As a result, the person's skin color is printed in an appropriate color.

Note that the appropriate range may be set in advance and stored in the memory of the control unit 54. Instead of this, the user may be able to input settings by using the operation display unit 46.

As shown in Table 2 above, similarly to the image data correction unit 32 (FIG. 2) of the digital still camera 1,
The degree of enhancement of the edge enhancement processing is changed according to the shooting scene of the image information data. As a result, it is possible to print an image that has been subjected to appropriate contour correction according to the shooting scene.

A function in which a plurality of gamma correction curves are stored in advance in the memory of the control unit 54 in correspondence with a plurality of shooting scenes, and a gamma correction curve corresponding to the shooting scene included in the image information data is selected. Γ stored in the memory of the control unit 54
As the correction curve, a curve suitable for the reflectance characteristic determined by the printing method of the printing unit 53 and the ink used is created in advance.

The printing section 53 prints an image based on the image data corrected by the image processing section 52 on recording paper. The control unit 54 includes a memory and the like,
For example, the operation of each of the functional blocks 46, 51, 52, and 53 is controlled such that the image based on the image data corrected by the image processing unit 52 is printed on recording paper by the printing unit 53.

FIG. 20 is a flowchart showing the operation of the printer 40. In the figure, first, data is read from the external recording medium 47 loaded in the external recording medium loading ports 42 to 44 (# 600).

Next, the read data is expanded (# 605), and it is determined whether or not image data exists in the read data (# 610). If the image information data does not exist (NO in # 610), the image data is taken in (# 615), and the scene of the image is determined from the image data (# 620), and the scene of the determined image is determined. The image data is subjected to a correction process in response to (# 625), and the process proceeds to # 660.

If only image data is used, it is difficult to determine the scene of an image. To avoid the risk of improper correction due to erroneous determination and consequently deteriorating the image quality, a large correction process is required. Not done. On the other hand, when image information data exists, it is possible to perform a high-performance correction process as described below.

That is, if image information data exists in # 610 (YES in # 610), information on the photographic scene is fetched (# 630). For example, evening scene,
In the case of night scenes, sea scenes, etc., as described in Table 2 above, appropriate corrections such as color balance and exposure value depending on the shooting scene, such as not performing standard corrections so as not to impair the characteristics of the image. Since the amounts are different, an appropriate correction is performed using this information in # 655 described later.

Next, information about the person, such as the presence or absence of the person, the number of people, and the position, is taken in (# 635). By capturing and effectively utilizing information about a person who is difficult to distinguish from image data alone,
At 55, the exposure value, the color balance, etc. are corrected to appropriate values for the person.

Next, information relating to correction processing such as color balance and γ correction is fetched (# 640). By taking in information on the correction processing performed by the digital still camera, the correction performed by the camera is not wasted and the correction that cannot be considered in practice is not performed in # 655 described below.

Next, the maximum correction amount is determined so as not to perform excessive correction (# 645). The maximum correction amount is determined, for example, as follows. When the values of the correction coefficients Δr and Δb recorded as the image information data are respectively Δr = 0.6 and Δb = 1.5, the maximum widths of the correction coefficients that can be generated by the color cast by the actual light source are 0.5 ≦ Δr ≦ Since 2.0 0.5 ≦ Δb ≦ 2.0, the range in which color correction can be performed during printing is 0.5 / 0.6 ≦ Δrp ≦ 2.0 / 0.6 0.5 / 1.5 ≦ Δbp ≦ 2.0 / 1.5 That is, 0.83 ≦ Δrp ≦ 3.33 0.33 ≦ Δbp ≦ 1.33 Becomes Here, Δrp is a red correction coefficient at the time of printing, Δ
bp is a blue correction coefficient at the time of printing.

As described above, the range that can be corrected during printing is determined as the maximum correction amount based on the correction information recorded as image information data and the maximum width determined by the characteristics.

Next, the raw image data is captured (#
650), a correction process is performed on the image data (# 65)
5). This correction processing is performed by the information fetched in # 630 to # 640, the maximum correction amount determined in # 645, the printing unit 5
3 is performed based on data such as characteristics (for example, a color reproduction range, a reflectance characteristic, a γ correction curve, and a filter for edge enhancement) of the image forming apparatus 3. The data relating to the characteristics of the printer 40 is stored in the memory of the control unit 54.

Then, the image is printed based on the corrected image data (# 660), and the process ends.

As described above, according to the present embodiment, in particular,
By appropriately performing a correction process such as an exposure value or a color balance for a person having a predetermined size or more, it is possible to finish printing a very beautiful image.

[0178] Further, with respect to a photographic scene of only a landscape where no person exists, by using information on the photographic scene, a correction process can be performed so that the image is more beautifully finished, and the color reproduction of the flesh color of the person is taken into consideration. It is possible to make corrections so that the landscape color becomes more vivid without performing.

Although the above embodiment has been described by applying the present invention to the self-type printer 40, the present invention is not limited to this.

For example, the block diagram shown in FIG. 19 may be modified from a personal computer having a data acquisition unit 51, an image processing unit 52, and a control unit 54, an operation display unit 46 having a keyboard, a mouse, and a CRT (or LCD), and a personal computer. Printing unit 5 consisting of a printer connected by a cable to
3 may be provided as a personal computer system 40.

According to this embodiment, it is possible to constitute an image output device for printing and outputting an image on a recording sheet by the printing unit 53,
An image output device that displays and outputs an image on a screen such as T can be configured.

As one embodiment of the image processing system according to the present invention, the digital still camera 1 shown in FIG.
And a printer (or personal computer system) 40 shown in FIG.

In this embodiment, on the camera 1 side, image information data composed of information relating to image determination such as a photographed scene or a person and information relating to correction processing applied to image data is stored as recording data in association with the image data. Keep it. On the other hand, the printer 40 prints out an appropriate image by effectively utilizing the image information data stored in association with the image data. According to this embodiment, it is possible to realize an image processing system that can appropriately perform image capturing and output.

Here, an image output using digital values will be described with reference to FIG. FIG. 21 is a diagram showing the concept of digital image output.

First, as shown in the lower right quadrant of FIG. 21, when a subject is imaged using, for example, a digital still camera, it is photoelectrically converted as a digital value 61 corresponding to the brightness of the subject.

On the other hand, in a general digital still camera, a tone reproduction curve 62 (a desired image characteristic when displayed and output on a standard monitor, taking into account the reflectance characteristic M1 of the standard monitor (shown in the upper left quadrant of FIG. 21)) is taken into consideration. As shown in the upper right quadrant of FIG. 21, the γ-LUT 63 (Look Up
A table, a correction curve, and a lower left quadrant in FIG. 21 are created in advance, and are stored in a memory or the like.

Then, the photoelectrically converted digital value 61
Is characteristic-converted by the γ-LUT 63.

When the digital value subjected to the characteristic conversion is observed on a standard monitor of the reflectance characteristic M1, a γ-LUT is created in consideration of the reflectance characteristic M1.
An image is displayed and output with characteristics according to the tone reproduction curve 62.

As described above, in a digital still camera, correction processing is generally performed on image data so that an appropriate image can be obtained when observed on a standard monitor. Here, since the optimum tone reproduction curve differs depending on the shooting scene, a plurality of γ-LUTs
Is stored, and γ corresponding to the determined shooting scene is stored.
-LUT is selected.

On the other hand, when an image is printed out, reflectance characteristics and color reproduction characteristics are determined by a printing method such as an ink jet method, a fusion type thermal transfer method, a sublimation type thermal transfer method, and inks such as dyes and pigments. There is a high possibility that image output characteristics such as a color reproduction area are significantly different from those of a standard monitor. In the upper left quadrant of FIG. 21, as an example, a reflectance characteristic P1 of the ink jet system and a reflectance characteristic P2 of the sublimation thermal transfer system are shown, which are different from the reflectance characteristics M1 of the standard monitor.

Since a printer is required to output a beautiful image as a device for printing and outputting an image, the printer not only performs conversion for correcting the reflectance characteristic of the printer itself with respect to a standard monitor, but also performs conversion for each printer. Performs unique color conversion according to the model characteristics of.

At this time, in the image output apparatus according to the present invention, as described with reference to FIG.
In step # 655, image data is subjected to a correction process using information about a person, information about a shooting scene, information about a correction, and the like, and an image is output based on the image data on which the correction process has been performed.

Thus, each printer, CRT, LC
An image output appropriate for each characteristic such as D can be output.

[0194]

As described above, according to the first aspect of the present invention, the state relating to the subject is determined using the image data output from the imaging means, and the image data is corrected in accordance with the determination result. Processing, setting information regarding the correction processing, associating the corrected image data with the information regarding the set correction processing to create recording data, and storing the recording data in the recording unit. For example, when the image output device captures the image data from the recording unit and reproduces and outputs the image or prints out the image data, the image output device uses the stored information regarding the correction processing, and By performing the correction process, more appropriate correction process can be performed.
More suitable image output can be made possible.

According to the second aspect of the present invention, the correction information on at least one of the exposure characteristic, the color balance characteristic, the γ characteristic, and the edge enhancement characteristic is stored in the recording unit. For example, when the image output device captures image data from the recording unit and reproduces and outputs an image or prints out the image data, the image output device corrects the characteristics included in the information about the stored correction processing. By using the information to perform a correction process on the characteristics with respect to the image data, it is possible to perform a more appropriate correction process, thereby enabling a more suitable image output.

According to the third aspect of the present invention, the state of the subject is determined by using the image data output from the imaging means, and the image data is subjected to a correction process according to the determination result. The state relating to the subject is set as information relating to the image determination, and the image data subjected to the correction processing is associated with the set information relating to the image determination to create recording data, and the recording data is stored in the recording unit. For example, when the image output device captures the image data from the recording unit and reproduces and outputs the image or prints out the image data, the image output device uses the stored information regarding the image determination to process the image data. By performing the correction process, more appropriate correction process becomes possible,
Thereby, more suitable image output can be made possible.

According to the fourth aspect of the present invention, at least one of the information on the photographic scene and the person is included in the information on the image determination stored in the recording means. When fetching image data from the recording means and reproducing and outputting an image or printing out, using information on one or both of information on a shooting scene and a person included in information on image determination, By performing a correction process according to a shooting scene or a correction process according to person information on image data, a more appropriate correction process can be performed, thereby enabling more suitable image output. .

According to the fifth aspect of the present invention, in addition to image data representing an image, recording data containing information related to the image is taken in from an external device, and is included in the taken recording data. The image data is subjected to a correction process according to the output characteristics of the image output unit using the relevant information, and an image is output to the image output unit based on the image data subjected to the correction process. Therefore, a suitable image can be output to the image output means.

According to the invention of claim 6, according to claim 1,
The recording control means of the image photographing apparatus according to any one of the above-mentioned items is adapted to take in the recording data from the recording means in which the recording data is stored, so that information relating to image determination or information relating to correction processing is used. By applying a correction process to the image data in accordance with the output characteristics of the image output means, it is possible to output a suitable image to the image output means.

Further, according to the invention of claim 7, according to claim 1,
Since the image capturing apparatus according to any one of claims 1 to 4, and the image output apparatus according to claim 6, the recording data created by the image capturing apparatus in association with the image data and the information regarding the image determination. Or, while recording data created by associating image data with information relating to correction processing is stored in the recording means, the image output device captures the recording data stored in the recording means, and outputs information relating to image determination. Or by applying a correction process to the image data in accordance with the output characteristics of the image output unit using the information on the correction process, so that a suitable image can be output to the image output unit. Can be configured.

[Brief description of the drawings]

FIG. 1 is a perspective view showing the appearance of a digital still camera which is an embodiment of an image photographing apparatus according to the present invention.

FIG. 2 is a block diagram showing functional blocks of the digital still camera.

FIG. 3 is a diagram illustrating an arrangement state of CCDs in an imaging unit.

FIG. 4 is a diagram illustrating an arrangement state of CCDs in an imaging unit.

FIG. 5 is a diagram showing an example of block division.

FIG. 6 is a diagram showing an example of a color cast determination result.

FIG. 7 is a flowchart showing a main routine of the digital still camera.

FIG. 8 is a flowchart of a first imaging condition setting subroutine.

FIG. 9 is a flowchart of a first scene determination processing subroutine.

FIG. 10 is a flowchart of a first image data correction subroutine.

FIG. 11 is a flowchart of a second imaging condition setting subroutine.

FIG. 12 is a flowchart of a second scene determination processing subroutine.

FIG. 13 is a flowchart of a second image data correction subroutine.

FIGS. 14A to 14D are diagrams showing γ correction curves.

FIG. 15 is a diagram showing a filter used for edge enhancement processing, where (a) shows a filter having a high degree of edge enhancement;
(b) shows a filter with a medium edge enhancement degree,
(c) shows a filter having a weak edge enhancement degree.

FIG. 16 is a flowchart of an image information data setting subroutine.

FIG. 17 is a diagram illustrating an example of recording data.

FIG. 18 is a perspective view showing the appearance of a printer which is an embodiment of the image output device according to the present invention.

FIG. 19 is a block diagram showing functional blocks of the printer.

FIG. 20 is a flowchart illustrating an operation of the printer.

FIG. 21 is a diagram illustrating the concept of digital image output.

[Explanation of symbols]

Reference Signs List 1 digital still camera 4 image display unit 6 shutter button 8 external memory (recording unit) 21 imaging unit (imaging unit) 22 imaging data temporary storage unit 23 imaging control unit 24 image data processing unit 25 sequence control unit 26 display control unit 27 recording Control unit (recording control unit) 31 Scene determination unit (state determination unit) 32 Image data correction unit (image data correction unit) 33 Image information setting unit (correction processing information setting unit, image determination information setting unit) 34 Image data synthesis unit (Data creation means) 40 Printer, personal computer system 42-44 External recording medium loading port 46 Operation display unit (image output means) 47 External recording medium (external device, recording means) 51 Data acquisition unit (image data acquisition means) 52) Image processing unit (output image data correction means) 53 Printing unit (image output means) 54) control unit (output control means)

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 9/68 103 H04N 9/68 103A 9/69 9/69 9/73 9/73 A 9/79 101 : 00 // H04N 101: 00 9/79 G F term (reference) 2H054 AA01 5C022 AA13 AB19 AC01 AC42 AC69 AC78 5C055 BA06 CA03 EA05 EA16 GA09 HA17 HA19 HA31 HA36 HA37 5C065 AA03 BB01 BB10 BB12 BB16 CC01 CC05 DD02 DD17 FF03 GG03 GG21 GG30 GG32 GG44 GG49 HH02 5C066 AA01 AA05 AA11 CA17 EA13 EC02 EE01 GA33 HA01 KC07 KD06 KE02 KE07 KE17 KM01 KM05

Claims (7)

[Claims] An imaging unit configured to image a subject and output image data of the subject; a state determination unit configured to determine a state related to the subject using the image data output from the imaging unit; Image data correction means for performing correction processing on the image data according to the determination result; correction processing information setting means for setting information relating to the correction processing; and image data subjected to correction processing by the image data correction means. Data creating means for creating recording data by associating the information with the correction processing set by the correction processing information setting means, and recording control means for storing the created recording data in the recording means. An image photographing apparatus characterized by the above-mentioned. 2. The image photographing apparatus according to claim 1, wherein
The information on the correction processing set by the correction processing information setting means includes correction information on at least one of an exposure characteristic, a color balance characteristic, a γ characteristic, and an edge enhancement characteristic. Shooting equipment. 3. An image capturing means for capturing an image of a subject and outputting image data of the subject, a state determining means for determining a state related to the subject using the image data output from the image capturing means, Image data correction means for performing a correction process on the image data in accordance with the determination result; image determination information setting means for setting the state of the subject determined by the state determination means as information relating to image determination; Data creating means for creating data for recording by associating the image data corrected by the correcting means with the information on the image determination set by the image determination information setting means, and recording the created recording data An image photographing apparatus comprising: a recording control unit for storing the image in the unit. 4. The image photographing apparatus according to claim 3, wherein
An image photographing apparatus characterized in that the information on image determination stored by the recording control means includes at least one of information on a photographed scene and a person. 5. A data fetching means for fetching, from an external device, recording data containing information related to the image in addition to image data representing the image, and the related information contained in the fetched recording data. Image data correcting means for performing correction processing on the image data using the image data, image output means for outputting an image, and outputting the image based on the image data corrected by the image data correcting means. Output control means for outputting the image data to the image data, wherein the image data correction means performs a correction process on the image data in accordance with an output characteristic of the image output means. 6. The image output device according to claim 5, wherein
The data capturing means captures the recording data from the recording means in which the recording data is stored by the recording control means of the image photographing apparatus according to any one of claims 1 to 4. Image output device. 7. An image processing system comprising: the image photographing device according to claim 1; and the image output device according to claim 6.