JP2003259138A - Image correction device and method thereof, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily make a change to a color that an operator intends. <P>SOLUTION: A sky area in an image represented by source image data is selected. The sky area is replaced with an image of sky image data specified with a file name inputted through a dialog box DB1 for weather conversion. Colors of areas other than the sky are corrected according to colors of an image of the sky image data. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for correcting an image represented by image data.

[0002]

2. Description of the Related Art Conventionally, in a computer, if image processing software is used, the captured image data can be processed and processed.
Easy to edit. Color correction is one of these processing processes. For example, if the photographic image taken with a digital camera is a color that is different from the actual one, such as the skin color is yellowish, you can change the color tone and other color elements to make the overall tone bluish, It can be reddish. As a result, the color of the image can be easily corrected to a natural color.

[0003]

In the above conventional technique, the operator adjusts the "color" lever displayed on the screen by using the mouse, and the operator adjusts the bluish tint. I had to enter into the computer instructions to change the color elements, such as increasing or reducing redness. Therefore, there is a problem that it is difficult to adjust the color and it is difficult to correct the color intended by the operator.

The present invention has been made in view of the above problems, and an object thereof is to make it easy to correct a color intended by an operator.

[0005]

[Means for Solving the Problem and Its Action / Effect] As a means for solving at least a part of the above-mentioned problems, the following constitution is adopted.

The image correction apparatus of the present invention is an image correction apparatus for correcting an image represented by image data, and by selecting a certain range in the image, the image is selected as a selected area or a non-selected area. A region specifying unit that divides the image into a region, a merged image specifying unit that specifies an image for insertion based on an operator's operation command, and an image of the selected region by the region specifying unit, the specified image for inserting. And the color of at least one of the selected area and the non-selected area that have been replaced is corrected based on the color of the other image, so that the image represented by the image data and the insertion And an image synthesizing unit for synthesizing the image for use with.

According to the image correction apparatus having this structure, the selected area divided by the area specifying means is replaced with the image for insertion specified based on the operator's operation command, and then the selection is made. Area and non-selected area
At least one is color-corrected based on the color of the image on the other side. Therefore, the image of the selected area is converted into the image intended by the operator, and the selected area and the non-selected area are adjusted to have a balanced color. Therefore,
This image correcting device has an effect that the entire image including the part where the image is replaced can be easily corrected to the one intended by the operator.

In the above image correction device, the image synthesizing means may include a non-selected area correction means for correcting the color of the image of the non-selected area based on the color of the image for insertion. .

According to this structure, the non-selected area is corrected to a color balanced with the color of the image of the selected area replaced with the image intended by the operator. Therefore, the color tone of the entire image can be easily unified.

In the image correction apparatus, the selection range may be an empty range, and the insertion image may be an image representing the sky.

According to this structure, the sky region in the image can be changed to a desired one by the operator, and the color of the region other than the sky is corrected according to the sky state. Therefore,
The entire image including the sky can be easily corrected to a color suitable for the weather.

In the image correction apparatus, the non-selected area correction means may at least correct the color tone. According to this configuration, since the color tone of the non-selected area is corrected, it is possible to deal with the case where the color tone of the sky changes greatly and the color tone of the sky changes.

In the image correction apparatus, the first designating means for designating the degree of brightness of the selected area based on the operator's operation command, and the non-selected area based on the operator's operation command. Second designating means for designating the degree of brightness of the image, and first the brightness of the image of the selected area in the image synthesized by the image synthesizing means according to the degree designated by the first designating means. It may be configured to include an intensity changing unit and a second intensity changing unit that changes the brightness of the image of the non-selected area in the combined image according to the degree designated by the second designating unit. .

With this configuration, the operator can individually change the brightness of a selected range and a non-selected range in the image represented by the image data.

In the image correction device, the insertion image designating means stores a plurality of candidate images as the images for insertion, an image adding means for adding the candidate images to the storage means, and an operator. The image selection means for selecting one image from the plurality of candidate images stored in the storage means on the basis of the operation command of 1.

According to this structure, the operator can freely add an image for insertion for replacing the image in the selected area.

The image correction method of the present invention is an image correction method for correcting an image represented by image data,
(A) By selecting a range in the image,
Dividing the image into a selected area and a non-selected area; (b) specifying an image for insertion based on an operation command from an operator; and (c) the step (a).
Replacing the image of the selected area with the specified image for insertion and correcting the color of the image of the non-selected area according to step (a) based on the color of the specified image for insertion. According to the above, the step of synthesizing the image represented by the image data and the image for insertion is provided.

The computer program of the present invention is a computer program for causing a computer to execute a process of correcting an image represented by image data, and (a) by selecting a certain range in the image. , A function of dividing the image into a selection area and a non-selection area, (b) a function of designating an image for insertion based on an operator's operation command, and (c) a selection area by the function (a). By replacing the image with the specified image for insertion and correcting the color of the image of the non-selected area by the function (a) based on the color of the specified image for insertion, the image It is characterized in that it realizes a function of synthesizing an image represented by data and the image for insertion.

The image correction method and the computer program having the above-described configuration have the same operation and effect as the above-described image correction apparatus, and the operator intends the entire image including the part where the image is replaced. Can be easily modified.

The recording medium of the present invention is characterized by a computer-readable recording medium recording the computer program of the present invention. This recording medium has the same operations and effects as the computer programs of the present invention.

[0021]

Other Embodiments of the Invention The present invention also includes the following other embodiments. A first aspect thereof is an aspect as a program supply device for supplying the computer program of the present invention via a communication path. In the first aspect, the computer program is placed in a server or the like on a computer network, the necessary program is downloaded to a computer via a communication path, and the computer is executed to realize the above-described device or method. You can

A second aspect of the present invention is an image correction device for correcting an image represented by image data, wherein a certain area in the image is selected to select the image as a selected area and a non-selected area. The area specifying means for dividing the image into the area and the insertion image specifying means for specifying the image for insertion based on the operator's operation command, and the image of the selected area by the area specifying means to the specified image for insertion. The image represented by the image data and the image for insertion are replaced by correcting the color of the image of the replaced selected area based on the color of the image of the non-selected area by the area designating means. And an image synthesizing means for synthesizing the image.

According to the second aspect, the original image and the image for insertion can be combined finely.
A third aspect is an image correction method corresponding to the second aspect. A fourth aspect is an aspect as a computer program corresponding to the second aspect. A fifth aspect is an aspect as a computer-readable recording medium in which the computer program of the fourth aspect is recorded.

[0024]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described based on examples. This embodiment will be described in the following order. A. Device Configuration: B. Computer processing: B-1. Overall processing: B-2. Correction process B-3. Weather conversion: C. Action / Effect D. Other embodiments:

A. Device Configuration: FIG. 1 is a block diagram showing a schematic configuration of hardware of a computer system 10 to which an embodiment of the present invention is applied. The computer system 10 mainly includes a so-called personal computer (hereinafter, simply referred to as a computer), and has a CRT display 12, a printer 13 and a digital camera 14 in the periphery thereof. The computer includes a computer main body 16, a keyboard 18, and a mouse 20.
The computer main body 16 includes a CD-ROM 2
A CD drive 24 for reading the contents of No. 2 is mounted.

The computer main body 16 has a CPU 31, which is a central processing unit, as a center, and a ROM 31, a RAM 32, a display image memory 33, a mouse interface 34, and a keyboard interface 3 which are interconnected by a bus.
5, a CDC 36, a HDC 37, a CRTC 38, a printer interface 39, an input / output device interface 40, and an I / O port 41. The ROM 31 is a read-only memory that stores therein various programs and the like. The RAM 32 is a readable / writable memory that stores various data and the like. Display image memory 3
Reference numeral 3 is a memory for storing image data of an image displayed on the CRT display 12.

The mouse interface 34 is used for the mouse 20.
It is an interface that controls the exchange of data and so on.
The keyboard interface 35 is an interface that controls key input from the keyboard 18. CDC36
Is a CD controller that controls the CD drive (CDD) 24. The HDC 37 is a hard disk controller that controls a hard disk drive (HDD) 42. A computer program, which will be described later, and the like are stored in the HDD 42 in advance.

The CRTC 38 is a CRT controller that controls the display of an image on the CRT display 12 based on the display image data stored in the display image memory 33. The printer interface 39 is the printer 13
Is an interface that controls the input and output of data to and from.
The input / output device interface 40 is an interface for controlling input / output of data to / from an externally connected input / output device, in this embodiment, the digital camera 14. The I / O port 41 has a serial output port, is connected to a modem 44, and is connected to a public telephone line 46 via the modem 44. Computer body 1
6 is connected to an external network via a modem 44 and can be connected to a specific server 47.

In this computer system 10, the operating system is stored in the HDD 42,
When the computer main body 16 is powered on, the HDD 42
RAM according to the loader written in the boot block of
It is loaded into 32 predetermined areas. Photoretouching software (computer program) for processing a photographic image (color photographic image) taken by the digital camera 14 is stored in the CD-ROM 22 in advance, and a CD drive is started by activating a predetermined installation program. It is installed in the computer main body 16 from 24. The installed computer program is stored in the HDD 42 and is loaded into a predetermined area of the RAM 32 when a predetermined start command is received.

Various constituents of the present invention are realized by the CPU 30 executing some modules (described later) of this computer program. As described above, this computer program is stored in the CD-ROM 22, but instead of this, another portable recording medium (portable recording medium) such as a floppy disk, a magneto-optical disk, or an IC card. It may be configured to be stored in. Further, the computer program described above can be obtained by downloading program data provided via a network from a specific server 47 connected to an external network and transferring the program data to the RAM 32 or the HDD 42. . The network may be the Internet or a computer program downloaded from a specific home page. Alternatively, it may be a computer program supplied in the form of an email attachment.

A state of control processing according to the photo retouching software by the computer system 10 having the above-described hardware configuration will be described below. FIG. 2 is a block diagram showing a state of control processing according to the photo retouching software 50 executed by the computer main body 16.

As shown in FIG. 2, the computer main body 16
Software for photo retouching running inside
According to 0, first, the input module 51 performs a process of taking in image data Dpi representing a photographic image from the digital camera 14. Next, the correction module 52 processes the image data (hereinafter referred to as original image data) Dpi captured by the input module 51. By this correction module 52, it is possible to correct the image including the color of the photographic image represented by the original image data Dpi. The function of performing this correction is the area designating unit 52a provided in the correction module 52.
This is due to the functions of the inserting image designating section 52b and the image synthesizing section 52c. The image data Dpo corrected by the correction module 52 is CR via the display driver 60.
It is sent to the T display 12 and displayed.

Further, the photo retouching software 50
According to the print module 53, the corrected image data Dpo is sent to the printer 1 via the printer driver 62.
It is sent to 3 and displayed. Further, the output module 54
Thus, the corrected image data Dpo is sent to the external device.

B. Computer processing: B-1. Overall processing: The CPU 30 of the computer main body 16 executes the photo retouching software 50 to execute the above-described input module 51, correction module 52, and print module 53.
And the output module 54. Regarding the control processing according to the photo retouching software 50,
The details will be described below. FIG. 3 is a flowchart showing a routine of this control processing. This routine is started when an instruction to execute the photo retouching software 50 is given.

As shown, when the process is started, C
The PU 30 first performs a process of displaying the application window WD on the CRT display 12 (step S100). FIG. 4 is an explanatory diagram showing the initial state of the application window WD. As shown in the figure, in the application window WD, "input",
4 types of button BT: "Modify", "Print", "Output"
1, BT2, BT3, BT4 are prepared, and the operator sequentially clicks these buttons BT1 to BT4 with the mouse 20 to photograph images taken by the digital camera 14 on the screen of the CRT display 12. Can be processed and output. That is, as shown in FIG.
After execution of, the operation command for the buttons BT1 to BT4 to be clicked by the mouse 20 is captured, and the input process, the correction process, the print process, and the output process corresponding to the operation command are sequentially executed (steps S200, S300, S400, S
500).

The input process executed in step S200 is to take in image data (original image data) Dpi representing a photographic image from the digital camera 14, and corresponds to the above-mentioned input module 51 (FIG. 2). The operation of fetching the original image data Dpi is performed in response to an operation command of clicking the "file" button BT5 provided on the toolbar BR of the application window WD shown in FIG. In detail,
"External device input" provided in a pull-down menu (not shown) opened from the "File" button BT5 is selected, then the digital camera 14 is selected as an input device, and then a file name is selected. This is performed in response to a series of operation commands from the mouse 20. The original image data Dpi captured in this way is RA
It is stored in a predetermined area of M32, but with it,
Work field FD of application window WD
It is displayed on W (see FIG. 6).

Note that the image data of a photographic image taken by the digital camera 14 is previously stored in the HDD 4 instead of the configuration in which the original image data Dpi is directly fetched from the digital camera 14.
Alternatively, the image data in the HDD 42 may be stored in the HDD 2 and read out. That is, the image data representing a photographic image may be read each time using a digital camera, or may be prepared in advance in a storage unit such as the HDD 42 and read from the storage unit. Further, the image data of the photographic image may be taken in from the outside via the network.

The correction process executed in step S300 is to process the original image data Dpi, and various requirements of the present invention are realized here. The details will be described later. The corrected image data Dp that has been processed here
o is stored in a predetermined holder prepared in the HDD 42. This correction process corresponds to the correction module 52 (FIG. 2) described above.

The printing process executed in step S400 is the modified image data D created in step S300.
It outputs po to the printer driver as a print command. This printing process has a well-known configuration,
Although not described in detail here, the processed photographic image is printed by the printer 13. This printing process corresponds to the printing module 53 (FIG. 2) described above.

The output process executed in step S500 is the modified image data D created in step S300.
It outputs po to an external device. As a result, the corrected image data Dpo representing the processed photographic image is output to the desired external device. This output process corresponds to the output module 54 (FIG. 2) described above.

B-2. The correction processing executed in the correction processing step S300 will be described in detail below. With this software for photo retouching, a function that gives the image the effect of changing the environment in which the picture was taken (shooting environment function), a function that changes the brightness and contrast of the image (tool function), effects such as unsharp mask and blur To give images to images (filter function)
There are various functions such as, but these functions are realized by this correction processing. FIG. 5 is a flowchart showing the routine of this correction processing. When the processing shifts to this routine, as shown in the figure, the CPU 30 first performs processing for changing the application window WD displayed on the CRT display 12 for correction processing (step S302).

FIG. 6 is an explanatory diagram showing an application window WD for modification processing. As shown in the figure, in the toolbar BR of the application window WD for this correction processing, a “shooting environment” button BT21, a “tool” button BT22, and a “filter” button BT2 are provided.
3 etc. have been added, and the "output" button BT4
A button BT25 for "selection of effect range" and the like are provided below. Other configurations are the same as those of the application window WD for input processing shown in FIG. The “shooting environment” button BT21, the “tool” button BT22, and the “filter” button BT23 correspond to the shooting environment function, the tool function, and the filter function, and are used to input work instructions for performing each function. belongs to.

Returning to FIG. 5, the CPU 30 then advances the process to step S304 to give a special effect of the correction process (the range on the image represented by the original image data Dpi. Is called a "special effect range"). This process is performed by a mouse operation by the operator using the mouse 20.
First, when the “select effect range” button BT25 of the application window WD is clicked by the mouse 20, the process of designating this special effect range is started.

FIG. 7 is an explanatory diagram showing the appearance of an image during the special effect range designation processing. As shown in the figure, the operator looks at the image of the original image data Dpi displayed in the work field FDW of the application window WD, and clicks an appropriate point on the contour that is to be the special effect range (this point). Is set as the starting point SP), and then the contour line is drawn using the mouse 20 over the entire circumference of the contour. FIG. 7 shows a state in which the special effect range is an empty range and the outline of the sky is drawn halfway. After making a round around the contour with the mouse, the operator clicks the mouse button at the starting point SP to end the work of drawing the contour line LN. As a result, the CPU 30
Contour line L over the entire circumference of the part you want to make the special effect range
N can be drawn, and the inside of this contour line LN can be defined as the special effect range.

It is preferable that the thickness of the contour line LN can be freely changed by another operation, and then the edge of the image included in the contour line LN is automatically detected. . With this configuration, the special effect range desired by the operator can be extracted with high accuracy. Figure 5
Returning to step S304, after executing step S304, CPU 30 performs a process of inputting a work instruction with mouse 20 from toolbar BR of application window WD (step S310).

Then, the CPU 30 executes step S310.
It is determined whether or not the work instruction input in step 3 is a work instruction for performing the shooting time zone changing function of the shooting environment functions (step S320). With this photo retouching software, as shooting environment functions, the shooting time zone change function that gives the effect of changing the shooting time zone to the image, the seasonal change function that gives the effect of changing the shooting season to the image, and the shooting weather A weather conversion function for providing the image with the changed effect is prepared, and in this step S320, it is judged whether or not a work instruction for performing the photographing time zone changing function is given. Specifically, as shown in FIG. 6, this work instruction is a work instruction in which an operation with the mouse 20 such as [shooting environment]-[shooting time zone change] on the tool bar BR provides a shooting time zone changing function. If it is determined in step S320 that such a mouse operation has been input, a shooting time zone changing process is executed (step S33).
0). Since this photographing time zone changing process is not directly related to the present invention, detailed description thereof will be omitted here.

On the other hand, if a negative determination is made in step S320, the CPU 30 advances the process to step S340, and the work instruction input in step S310 is the work instruction for performing the seasonal changing function of the above-mentioned photographing environment functions. Or not. [Shooting environment] on the toolbar BR in the application window WD shown in FIG.
An operation using the mouse 20, such as [Change Season], is a work instruction for performing the seasonal change function. In step S340, it is determined whether such a mouse operation has been input. Here, if the determination is affirmative, the season changing process is executed (step S350). Since this season changing process is not directly related to the present invention, detailed description thereof will be omitted here.

On the other hand, when a negative determination is made in step S340, the CPU 30 advances the processing to step S360, and the work instruction input in step S310 is the work instruction for applying the weather conversion function of the photographing environment functions. Or not. [Shooting environment] on the toolbar BR in the application window WD shown in FIG.
An operation using the mouse 20, such as [weather conversion], is a work instruction for performing the weather conversion function. In step S360, it is determined whether such a mouse operation has been input. Here, if the determination is affirmative, the CPU 30
A weather conversion process described later is executed (step S37).
0).

If a negative determination is made also in step S360, the CPU 30 advances the process to step S380, and executes the process corresponding to the work instruction input in step S310, that is, the other function other than the photographing environment function ( The above-described tool function, filter function, etc.) is performed. When the processing of step S330, S350, S370 or S380 is completed, the process returns to "return" and the routine of this correction processing is once ended.

B-3. Weather conversion processing: FIG. 8 and FIG.
6 is a flowchart showing details of weather conversion processing executed in step S330. As shown in the figure, when the processing shifts to this weather conversion processing routine, the CPU 30
First performs a process of displaying a dialog box for weather conversion on the CRT display 12 (step S4).
10). This dialog box is for setting various kinds of information necessary for executing the work that gives the effect of weather conversion to the computer main body 16.
FIG. 9 is an explanatory diagram showing an example of the dialog box DB1 for weather conversion. As shown in the figure, in this dialog box DB1, the field FD1 for displaying the original image is displayed.
And a field FD2 for displaying a sky image and a field FD3 for displaying a composite image.

The original image display field FD1 is for displaying the original image data Dpi to be corrected. The sky image display field FD2 is for displaying sky image data Dsky showing a blank image for insertion. The term "for insertion" as used herein refers to rewriting an area (empty area in this embodiment) of the original image data Dpi. In this weather conversion process, a process of rewriting the sky area of the original image data Dpi with a sky image represented by the sky image data Dsky is performed. The composite image display field FD3 is for displaying the corrected image data Dpo in which the empty area is rewritten.

Fields FD1 and FD for displaying the image
2, below the FD 3, input fields and buttons for various operation systems are provided. The lower left side is an area provided with an operation system for switching a blank image, and includes a "file name" input field IF1, a "folder" input field IF2, a "sky image switching" button group BT11, and The button BT12 for "Return to standard blank image" is provided. "File name" input field IF1 and "Folder" input field IF2
Is for entering the file name and folder name. The "blank image switching" button group BT11 is a button group for selecting one file from the folders having the folder name input in the "folder" input field IF2, and advances the selection destination by one file. ">" Button, ">>" button that advances the selection destination by only a large number of files (for example, 10), "<" button which returns the selection destination by only one file, and a large number of selection destinations (for example, 10) There is a "<<" button to return only the file.

[Return to standard blank image] button BT12
Is for selecting blank image data having a predetermined file name. Input field IF for these "file names"
1, "Folder" input field IF2, "Sky image switching"
The operator operates the button group BT11 of No. 3 and the button BT12 of “Return to standard blank image” by using the mouse 20 and the keyboard 18 to specify the blank image data Dsky to be used for insertion. That is,
A large number of blank image data that can be used for insertion are prepared in advance in the HDD 42 of the computer main body 16, and the input fields IF1 and IF2 and the buttons BT11 and B are provided.
By manipulating T12, desired sky image data Dsky can be designated from those many sky images. It should be noted that as the large number of images of the sky, a large number of images such as “sunny”, “cloudy”, “rainy”, and “snowy” that are changed depending on the weather are prepared. FIG. 11 is an explanatory diagram showing an example of an image represented by the sky image data Dsky. As shown in the figure, the sky image data Dsky represents an image showing clear weather.

Returning to FIG. 10, this dialog box D
The right side below B1 is an area where an operation system for adjusting the brightness is provided, and a "sky" slider bar SB1 and a "non-sky area" slider bar SB2 are provided. With the two slider bars SB1 and SB2, it is possible to individually adjust the brightness for the sky area and the area other than the sky. It should be noted that the slider bars SB1 and SB2 are provided with a scale that divides the adjustment range from the minimum (dark) to the maximum (bright) into 10 equal parts, with "0" that does not change the brightness as the center.

Returning to FIG. 8, after the execution of step S410,
The image represented by the original image data Dpi is displayed in the original image display field FD1 of the dialog box DB1 (step S420). Next, the image represented by the original image data Dpi is divided into an empty area (empty area) A1 and a non-empty area (non-empty area) A2 (step S430). This process is step S
Assuming that the special effect range designated by 304 is the sky area A1, the image is divided into this special effect range and the other areas. Before instructing the work of weather conversion by mouse operation such as [shooting environment]-[weather conversion], the worker performs the work of previously designating the special effect range in step S304. At this time, as the special effect range, By specifying the sky range as described above, the sky area A1 and the non-sky area A in step S430 described above are
The process of classification with 2 becomes appropriate. The dialog box DB1 for weather conversion and the process of step S430 correspond to the above-described area designation unit 52a (FIG. 2).

Subsequently, the CPU 30 inputs the instruction information (for example, file name) of the image data for insertion from the field FD41 for switching the sky image in the dialog box DB1 for weather conversion, and the empty space according to the instruction information. A process of reading the image data Dsky from the HDD 42 is performed (step S440). The dialog box DB1 for weather conversion and the process of step S440 correspond to the above-described insertion image designation unit 52b (FIG. 2).

After that, the CPU 30 executes step S430.
The sky area A1 defined in step S440 is replaced with the image of the sky image data Dsky read in step S440 (step S450). Specifically, an area having the same shape and size as the sky area A1 is extracted from the image of the sky image data Dsky, and the extracted area is overwritten on the sky area A1. Note that the extraction position can be determined by a predetermined rule, for example, above the image as much as possible and in the lateral direction as close to the center as possible. When the image of the sky image data Dsky is smaller than the sky area A1, the sky image data Dsky
The configuration may be such that the sky image is enlarged and extracted. In step S450, the original image data Dpi
Instead of directly changing the image data, the original image data Dpi is separately stored as a temporary file, and an empty area A1 and a non-empty area A2 are defined on the image of the file, and the image of the empty area A1 It is preferable to rewrite.

After executing step S450, the CPU 30
On the basis of the color tone of the sky image data Dsky for insertion read out in step S440, step S430
Color correction processing for correcting the color tone of the area A2 other than the sky obtained in step S460 is performed (step S460).

FIG. 12 is a flow chart showing details of the color correction processing of the area other than the sky which is executed in step S460. As shown in the figure, when the processing shifts to the color correction processing routine for the area other than the sky, the CPU 30 firstly determines the R, G, and B values of each pixel data forming the sky image data Dsky for insertion. Average value Rav
1, Bav1, Gav1 are calculated (step S61)
0). Next, the CPU 30 sets R, G, and R of each pixel data forming the non-empty area A2 obtained in step S430.
The respective average values Rav2, Bav2, for the B value
Gav2 is calculated (step S620).

After that, the CPU 30 averages Rav1 and Bav for the sky image data Dsky for insertion.
Based on 1, Gav1, standard correction values HR1, HB1, HG1 for sky image data are calculated (step S630). The standard correction values HR1, HB1, HG1 are values for keeping the average values Rav1, Bav1, Gav1 within the reference ranges, and are obtained as follows.

(1) When the average value Rav1 exceeds the reference range [a, b], HR1 = b-Rav1 (2) The average value Rav1 is within the reference range [a, b]. HR1 = 0 (3) When the average value Rav1 falls below the reference range [a, b], HR1 = a−Rav1

In the above (1) to (3), the average value Rav1 for red is representatively described.
Similarly, the average values Bav1 and Gav1 for green are obtained by the deviation from the reference range. It should be noted that the reference range of each color does not necessarily have to be the same value range, but is a unique value.

Then, the CPU 30 uses the average values Rav2, Bav2, Gav2 for the non-sky region A2 as the standard correction values HR2, HB2, HG2 for the non-sky region.
Are calculated respectively (step S640). The standard correction values HR2, HB2, HG2 are the average values Rav2, Bav.
2, Gav2 is a value for fitting each within a reference range, and is obtained based on the same rules as the above (1) to (3).

Subsequently, the CPU 30 executes step S640.
From the standard correction values HR2, HB2, HG2 obtained in step S630, the standard correction values HR1, HB1, HG obtained in step S630
1 is subtracted from each to obtain control amounts VR, VB, VG of each color.
Is calculated (step S650). After that, CPU30
Is the non-empty area A2 according to the control amounts VR, VB, and VG.
The R, B, and G values of each pixel data constituting the above are corrected (step S660). In the correction processing of step S660, the original image data Dpi is not directly changed, but the original image data Dpi is separately stored as a temporary file, and the non-empty area A2 provided on the original image data Dpi is stored. And perform correction processing. Step S66
After the execution of 0, the process returns to "return", and the routine of the color correction processing of the area other than the sky is temporarily ended. Then the CPU
The process proceeds to step S470 of FIG.

In this color correction processing for the area other than the sky, the sky image data Ds for insertion read out in step S440.
The color correction was performed based on the color tone of ky. This is because the replaced new image of the sky area A1 is cut out from the sky image data Dsky for insertion. The color correction may be performed based on the color tone of the image of the new sky region A1 replaced in step S450. That is, as in this embodiment, the color correction may be performed based on the hue of the sky image data Dsky for insertion that has the same hue as the replaced selected area, or as in this modification, the replacement is performed. The color correction may be performed based on the color tone of the image of the selected area itself.

The CPU 30 receives the "sky" slider bar S input from the weather conversion dialog box DB1.
The designated value C1 of B1 and the designated value C2 of the slider bar SB2 of the "region other than the sky" are respectively fetched (step S
470, S480).

Then, as shown in FIG. 9, the CPU 30
Performs a process of changing the brightness of the sky region A1 replaced in step S450 according to the instruction value C1 acquired in step S470 (step S490). Specifically, "brightness" and "contrast" are adjusted according to the instruction value C1. When the indicated value C1 is 0,
The "brightness" and "contrast" remain unchanged, and in the case of negative values, the "brightness" and "contrast" are lowered by an amount according to the absolute value of the indicated value, and the positive value In this case, the "brightness" and the "contrast" are adjusted by increasing the amount according to the absolute value of the indicated value. In step S490, it is preferable to change the color tone of the temporary file described above rather than directly changing the brightness of the original image data Dpi.

Next, the CPU 30 proceeds to step S480.
In accordance with the instruction value C2 captured in step S460, a process of changing the brightness of the non-sky region A2 subjected to the color correction in the non-sky region color correction process of step S460 is performed. Specifically, "brightness" and "contrast" are adjusted according to the instruction value C2. When the indicated value C2 is 0, the "brightness" and the "contrast" are left unchanged as the hue is changed,
If the value is negative, "brightness" and "contrast" are lowered by an amount according to the absolute value of the indicated value, and if the value is positive, "brightness" and "contrast" are indicated by the value. Make adjustments such as increasing the amount according to the absolute value.

After that, the CPU 30 executes step S450.
The image conversion (replacement) of the sky area A1 is performed in step S490, the brightness of the sky area A1 is changed in step S490, and the color and brightness of the area A2 other than the sky is changed in steps S460 and S500. File) is displayed in the corrected image display field FD2 of the dialog box DB1 (step S510). Next, a process of determining whether the image conversion and the color correction of the images so far are appropriate is performed based on the operation instruction from the operator (step S52).
0). Specifically, the dialog box D for weather conversion
[Execute] button BT13 provided in B1 (FIG. 10)
However, the above determination is made based on whether or not the mouse is clicked by the operator.

If the "execute" button BT13 is clicked and an affirmative decision is made, the process advances to step S530. On the other hand, in step S520, a negative determination,
That is, without clicking the [Execute] button BT13, the operation system for switching the sky image, the slider bar SB1 of "sky", the slider bar SB of "area other than sky"
When at least any one of 2 is operated again, the process is returned to step S440, and step S44 is performed.
The processing from 0 to S520 is repeatedly executed.

In step S530, the CPU 30 stores the image data (temporary file) of the image displayed in step S510 as corrected image data Dpo in a predetermined holder prepared in the HDD 42. To do. After that, the procedure returns to "return" to end the weather conversion processing routine once. The processes of steps S450 and S460 correspond to the above-described image synthesizing unit 52c (FIG. 2).

FIG. 13 is an explanatory diagram showing a dialog box DB2 for adding a sky image. This dialog box DB2 has a "File" button BT5 provided on the toolbar BR of the application window WD.
(See FIG. 4) is displayed in response to an operation command clicked by the mouse 20. More specifically, "Add sky image for weather conversion" provided in a pull-down menu (not shown) opened from the "File" button BT5 is selected and displayed.

In this embodiment, as described above, the HDD
A large number of blank image data that can be used for insertion are prepared in advance in the holder of 42, but by inputting the file name from the dialog box DB2, it is specified in the holder by the file name. New blank image data can be added. The image data in the holder can be read as the sky image data Dsky in step S440 described above.

C. According to the computer system of the present embodiment configured as described above, the file name input from the weather conversion dialog box DB1 is used for the sky area A1 in the image represented by the original image data Dpi. The image of the sky image data Dsky designated by is replaced. Regarding the area A2 other than the sky, the hue is corrected in accordance with the hue of the image of the sky image data Dsky. For this reason, for example, if the image of the sky image data Dsky is sunny, the image of the area A2 other than the sky will have a bright hue,
If the image of the sky image data Dsky is rainy, the image of the area A2 other than the sky has a dark hue. Therefore, this computer system has an effect that the entire image including the part where the image is replaced can be easily corrected to the one intended by the operator.

Further, in this computer system, the brightness can be individually changed in the sky area A1 and the non-sky area A2 in the image by the slider bars SB1 and SB2 provided in the weather conversion dialog box DB1. You can Therefore, it is possible to more finely change the color intended by the operator.

Further, in this computer system,
By using the dialog box DB2 for adding a blank image, the operator can freely add a merge image for replacing the image in the selected area.

D. Other Embodiments: Other embodiments of the present invention will be described next.

(1) In the above embodiment, the hue of the non-sky area A2 is corrected based on the hue of the replaced image of the sky image data Dsky, but instead of this, the hue of the non-sky area A2 is corrected. Instead of performing the color correction, the color tone of the image of the replaced sky region A1 may be corrected based on the color tone of the image of the region A2 other than the sky. Specifically, the color correction processing of the area other than the sky in step S460 of FIG. 12 is assumed to be the color correction processing of the sky area. This color correction processing for the sky area is almost the same as the processing in FIG. 12, and the processing in step S660 in FIG.
The processing is switched to the processing for correcting the R, B, and G values of each pixel data forming the empty area A1 according to VG. Also with this configuration, the original image and the image for insertion can be combined finely.

(2) In the above embodiment, the hue of the area other than the sky A2 is corrected based on the hue of the replaced image of the sky image data Dsky, but instead of this, the area other than the sky A2 is corrected. In addition to the color tone correction, the color tone of the replaced image of the sky region A1 may be corrected. Specifically, in the above-described embodiment, the color correction processing of the sky area described in (1) above is performed.
The configuration is added after the color correction processing of the area other than the sky in step S460. In this embodiment, since the colors are matched from both the sky area and the non-sky area,
The correction amount in each area (that is, the correction amount in the correction processing in step S660) is half the size of the embodiment and the mode of (1). With this configuration, it is possible to combine the original image and the image for insertion in a more beautiful manner.

(3) In the above embodiment, the empty area A1 is created by the special effect range drawn by the operator operating the mouse.
The area A2 other than the sky and the area A2 other than the sky are clearly divided. However, instead of this, the boundary between the sky area A1 and the area A2 other than the sky may be blurred and defined. Specifically, the information that "is a sky region" is provided with a gradation (that is, the value of each pixel in the mask is provided with a gradation), and based on the value, the color of the sky image and the non-sky image The color ratio is adjusted to combine both colors. That is, in the image correction device of the present invention, the area designating unit is configured to blur and define the boundary between the selected area and the non-selected area, and the image synthesizing unit is configured to color the boundary according to the degree of blurring. This is an aspect including a color correction unit that performs correction. According to this configuration,
The effect that the image for insertion can be more beautifully combined with the original image is achieved.

(4) In the above embodiment, the special effect range drawn by the operator's mouse operation is defined as the empty area A1.
Although the area other than the special effect range is set as the non-empty area A2, the special effect range may be set as the non-empty area A2 and the area other than the special effect range may be set as the empty area A1.

(5) In the above-mentioned embodiment, the special effect range drawn by the operator's mouse operation is defined as an empty area. It is also possible to adopt a configuration in which an empty area is automatically extracted.

(6) In the above-described embodiment, the color change according to the season is first performed for the entire image, and then the color change is individually performed for the vegetation area A3 in the image subjected to the color change. However, instead of this, the color change of the plants is performed on the plant region extracted from the image of the original image data Dpi, and It is also possible to adopt a configuration in which the entire image whose color has been changed is overwritten.

(7) In the above embodiment, a blank image is prepared as an image for insertion, but instead of this, an image whose color greatly changes depending on the weather such as the sea or the season is prepared. You can also Furthermore, the image is not limited to the image whose color greatly changes depending on the weather and the season, and another image such as an automobile can be used as the image for insertion. The point is that any image can be applied as long as it is an image that reflects light rays and exerts a color influence on other portions, and thus any image can be inserted.

(8) In the above embodiment, the image data to which the weather conversion effect is applied is taken by a digital camera, but instead of this, a silver salt photograph or a color gravure obtained by using a color scanner or the like is used. It may be image data such as. Further, the image data need not necessarily be color image data, and can be applied to monochrome image data.

The embodiments of the present invention have been described in detail above.
The present invention is not limited to these embodiments at all, and it goes without saying that the present invention can be carried out in various modes without departing from the scope of the present invention.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of hardware of a computer system 10 to which an embodiment of the present invention is applied.

FIG. 2 is a block diagram showing a state of control processing according to the photo retouching software 50 executed by the computer main body 16.

FIG. 3 is a flowchart showing a control processing routine.

FIG. 4 is an explanatory diagram showing an initial state of an application window WD.

FIG. 5 is a flowchart showing a routine of a correction process.

FIG. 6 is an application window WD for correction processing
FIG.

FIG. 7 is an explanatory diagram showing a state of an image during a special effect range designation process.

FIG. 8 is a flowchart showing the first half of the weather conversion process.

FIG. 9 is a flowchart showing the latter half of the weather conversion process.

FIG. 10 is an explanatory diagram showing an example of a dialog box DB1 for weather conversion.

FIG. 11 is an explanatory diagram showing an example of an image represented by sky image data Dsky.

FIG. 12 is a flowchart showing details of color correction processing for a region other than the sky.

FIG. 13 is an explanatory diagram showing an example of a dialog box DB2 for sky image addition.

[Explanation of symbols]

10 ... Computer system 13 ... Printer 14 ... Digital camera 16 ... Computer body 18 ... Keyboard 20 ... Mouse 33 ... Display image memory 34 ... Mouse interface 35 ... Keyboard interface 39 ... Printer interface 40 ... I / O interface 42 ... Hard disk drive 44 ... Modem 46 ... Public telephone line 47 ... server 50 ... Photo retouching software 51 ... Input module 52 ... Correction module 52a ... Shooting time designation section (season designation section) 52b ... Color changing section 53 ... Printing module 54 ... Output module 60 ... Display driver 62 ... Printer driver A1 ... empty area A2 ... Area other than the sky Dpi ... Original image data Dpo ... corrected image data DB1 ... Dialog box for weather conversion DB2 ... Dialog box for adding empty images

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 1/387 H04N 1/40 D 5C079 1/46 1/46 Z F term (reference) 5B021 AA01 BB02 LE05 LG07 5B050 AA09 BA15 CA07 DA04 EA06 EA09 EA19 FA02 FA03 FA05 FA09 FA13 5B057 AA20 BA24 BA25 CA01 CA08 CA12 CA16 CB01 CB08 CB12 CB16 CC03 CE08 CE09 CE11 CE17 CE18 PP08 DA17 DB02 DB06 DB09 DC25 DC36 5C076 PP06 CA067606A06A06 AA13 A02 PQ08 PQ22 RR11 SS05 SS07 TT09 5C079 HB01 LA02 LA10 LA23 LA31 LA40 LB12 MA01 MA17 MA20 NA17 PA03

Claims (16)

[Claims] 1. An image correction device for correcting an image represented by image data, wherein an area is designated by selecting a certain area in the image to divide the image into a selected area and a non-selected area. Means, an insertion image designating means for designating an image for insertion based on an operator's operation command, and the image of the selected area by the area designating means is replaced with the specified image for insertion and the replacement The image represented by the image data and the image for insertion are combined by correcting the color of the image of at least one of the selected area and the non-selected area based on the color of the other image. And an image correction device for performing image synthesizing. 2. The image correction apparatus according to claim 1, wherein the image synthesizing unit includes a non-selected area correction unit that corrects the color of the image in the non-selected area based on the color of the image for insertion. 3. The image correction device according to claim 1, wherein the selected range is an empty range, and the image for insertion is an image representing the sky. 4. The image correction apparatus according to claim 1, wherein the non-selected area correction unit is configured to correct at least a color tone. 5. The image correction apparatus according to claim 1, further comprising a first designating unit that designates a degree of brightness of the selected area based on an operation command from an operator. Second designating means for designating the degree of brightness of the non-selected area based on an operator's operation command, and the image synthesizing means has completed composition according to the degree specified by the first designating means. First intensity changing means for changing the brightness of the image of the selected area in the image, and changing the brightness of the image of the non-selected area in the combined image according to the degree specified by the second specifying means. An image correction device comprising a second intensity changing unit. 6. The image correction device according to claim 1, wherein the insertion image designating unit stores a plurality of candidate images as the images for insertion, and the storage unit. Image correction apparatus including image adding means for adding a candidate image to the means, and image selecting means for selecting one image from a plurality of candidate images stored in the storage means based on an operation command from an operator. . 7. An image correction method for correcting an image represented by image data, comprising: (a) selecting a range in the image to convert the image into a selected region and a non-selected region. A step of dividing, and (b) a step of designating an image for insertion based on an operation command of the operator,
(C) Replace the image of the selected area in step (a) with the specified image for insertion, and
The image represented by the image data and the image for insertion are corrected by correcting the color of at least one image of the replaced selected area and the non-selected area based on the color of the other image. And a step of synthesizing the image. 8. The image correction according to claim 7, wherein the step (c) includes a step (c-1) of correcting the color of the image of the non-selected area based on the color of the image for insertion. Method. 9. The image correction method according to claim 7, wherein the selected range is an empty range, and the image for insertion is an image representing the sky. 10. A computer program for causing a computer to execute a process of correcting an image represented by image data, comprising: (a) selecting a range in the image to select the image. The function of dividing into a region and a non-selected region, (b) the function of designating an image for insertion based on the operator's operation command, and (c) the image of the selected region by the function (a) Represented by the image data by replacing the color of the image of at least one of the selected area and the non-selected area that has been replaced based on the color of the other image. A computer program that realizes a function of synthesizing the created image and the image for insertion. 11. The computer program according to claim 10, wherein the function (c) has a function of (c-1) correcting the color of the image in the non-selected area based on the color of the image for insertion. . 12. The selection range is an empty range, and the image for insertion is an image representing the sky.
The computer program according to 0 or 11. 13. The computer program according to claim 10, wherein the function (c-1) is configured to correct at least color tone. 14. The computer program according to claim 10, further comprising: (d) a function of designating a degree of brightness of the selected area based on an operator's operation command. e) a function for designating the degree of brightness of the non-selected area based on an operator's operation command, and (f) the function (c) according to the degree designated by the function (d). A function of changing the brightness of the image of the selected area in the combined image, and (g) brightness of the image of the non-selected area of the combined image according to the degree specified by the function (e). A computer program that realizes the function of changing. 15. The computer program according to claim 10, wherein the function (b) is a function of (b-1) pre-storing a plurality of candidate images as the images for insertion. And (b-
2) A function of adding a new image as the candidate image,
(B-3) A computer program having a function of selecting one image from the plurality of candidate images based on an operator's operation command. 16. A computer-readable recording medium in which the computer program according to claim 10 is recorded.