JP2007295593A - Image data processor, computer-readable recording medium with image data processing program recorded thereon and image data processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image data processor, capable of easily referring to an image processing result while ensuring image data originality, a medium with a set of image data recorded thereon, and provide a medium with an image data processing program recorded thereon, and to provide an image data processing method. <P>SOLUTION: A database of photographic data 30b corresponding to image data is prepared, while storing the image data in a folder managed as a film metaphor. When desired image processing is selected for desired image data, the selected image processing is updated as modification information in a structure of the database; and when it becomes necessary to perform actual display, outputting or printing, since the modification information is referenced only on a work area, while keeping the original image data so as to execute various kinds of image processings, image modification or the like can be enjoyed, while keeping image data as originals. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image data processing apparatus capable of appropriately modifying and using image data, a medium on which an image data set is recorded, a medium on which an image data processing program is recorded, and an image data processing method.

  In recent years, digital still cameras have begun to be used rapidly. When taking a picture with a digital still camera, it is possible to manage the image as data, and the correction and the like can be easily performed. For example, if the image is dark, the image data can easily be corrected brightly, or the sky color can be made more blue and beautiful.

  Such processing is widely used as image processing. However, if input image data is processed, it becomes new image data, which is overwritten in the original storage area.

The above-described conventional image data processing apparatus has the following problems.
First, the original image data is changed, but it is difficult to use for those who place importance on the original image data. Of course, it is possible to save the original image data and save it under a different name, but it is cumbersome and increases the required storage area. In such a case, managing the original and the modified image data individually is extremely complicated.

In addition, in some image formats, image quality deteriorates every time rewriting is performed. In this sense, even if slight modification is made, the image quality deteriorates.
The present invention has been made in view of the above problems, and an image data processing apparatus capable of easily referring to the result of image processing while ensuring the originality of the image data, and a medium on which an image data set is recorded Another object is to provide a medium on which an image data processing program is recorded and an image data processing method.

  In order to achieve the above object, the invention according to claim 1 saves parameter setting means for setting parameters representing the contents of predetermined image processing to be performed on image data, and the image data and the parameters together with association information. Data storage means, data acquisition means for acquiring the image data and the parameters with reference to the association information, and image data subjected to the specified image processing based on the acquired image data and the parameters And image processing reproduction means for obtaining the above.

  According to a second aspect of the present invention, there is provided parameter setting means for setting parameters representing the contents of predetermined image processing performed on image data, and data storage means for storing the image data and the parameters together with association information. In the invention according to claim 3, the parameter representing the content of the predetermined image processing performed on the image data and the image data are stored together with the mutual association information, and the above-mentioned association information is referred to. Data acquisition means for acquiring the image data and the parameters, and image processing reproduction means for obtaining image data subjected to the specified image processing based on the acquired image data and the parameters. As a configuration.

  In the invention according to claim 1 configured as described above, when the parameter setting unit sets a parameter representing the content of predetermined image processing to be performed on the image data, the data storage unit stores the image data and the parameter. Save with association information. Then, when the data acquisition means refers to the association information and acquires the image data and the parameters, the image processing reproduction means performs the designated image processing based on the acquired image data and the parameters. Obtained image data is obtained.

That is, a parameter representing the image processing content is stored in association with the image data. For example, even when image processing is performed, the original image data is managed as a parameter without being changed, and image data obtained by image processing based on the parameter is obtained when necessary. The original image data is left as it is while the result of such image processing can be used.
The invention according to claim 2 and the invention according to claim 3 partially implement the entire invention.

In the fourth aspect configured as described above, the type or degree of image processing is represented by the parameter. Thereby, the content of the image processing is shown more specifically. Of course, it also indicates the degree of image processing.
Furthermore, in the invention according to claim 5 configured as described above, a plurality of the parameters are prepared for each type of image processing. It becomes possible to leave. For example, assuming that one image process is for adjusting sharpness, a parameter representing a sharpness enhancement degree and a parameter representing a weak enhancement degree are stored, and either one is selected during reproduction. When the reproduced image data is printed, the optimum sharpness enhancement degree may change depending on the resolution of the printing apparatus, and a plurality of parameters can be left corresponding to such a case.

  Furthermore, in the invention according to claim 6 configured as described above, it can be selectively executed from a plurality of parameters that can be stored. As a result, for example, when sufficient time is required for image processing and when processing must be performed in a very short time, the same image quality is not necessarily required, so the latter can be realized with low load. It is possible to perform image processing. Accordingly, in the case of a slide show, image processing corresponding to the parameters corresponding to the execution of the slide show is executed, and when executing printing, the image processing is executed corresponding to the parameters corresponding to this. Of course, this selection may be executed by determining execution conditions and selecting and executing those that meet the conditions at the time of execution.

  Furthermore, in the invention according to claim 7 configured as described above, when it is assumed that there are a plurality of parameters and also includes parameter execution order information, image processing is performed according to the execution order information. Corresponding to the image processing being performed in time series, if a parameter is left for each operation, the parameter represents a plurality of time series history. Therefore, the image processing process on the way is reproduced faithfully. Of course, it is not always necessary to execute all of them, and it is possible to reproduce the reproduction process by stopping halfway.

Furthermore, in the invention according to claim 8 configured as described above, the parameters are divided into a plurality of groups, each of which can be arbitrarily selected, and the parameters of the group selected according to the situation at the time of execution. Based on the above, image processing is performed.
That is, it is possible to select not only a single image processing result but also a plurality of image processing results. For example, there are many differences between image processing that is beautifully displayed when displayed on a display and image processing that is beautifully printed during printing. In such a case, it is convenient if the parameters for display on the display and the parameters for printing can be stored together. In addition, it is preferable that a set of parameters can be prepared for each size or for each user when not only the output destination but also the output size or a plurality of users share one image data.

  Furthermore, in the invention according to claim 9 configured as described above, the parameters are divided into a plurality of sets, and image processing corresponding to the situation of the pixels is applied. In other words, the present invention is applied uniformly to image data, and for example, a set of parameters is used depending on the position of a pixel or the color of a pixel. The pixel position is divided into areas such as the central part of the image, a specific range designated in advance, or the upper half and the lower half, and different sets of parameters are applied to each. In addition, if the pixel color is divided into a flesh-colored region, a sky-blue region, or a sunset region, an optimum parameter can be applied according to the subject.

  Furthermore, in the invention according to claim 10 configured as described above, the storage area is partitioned as a hierarchical structure, and the image data and parameters are partitioned by this hierarchical structure, and the partitioned partition itself represents the association. It will be. Further, associating the image data with the parameters, the parameters may be stored in the same section, or the corresponding parameters may be stored by providing a corresponding hierarchical structure in another area.

Furthermore, in the invention according to claim 11 configured as described above, a small-capacity thumbnail is associated in advance at the same level as that associated with the parameter, and the thumbnail data is processed in parallel with the parameter management. Can also manage.
Furthermore, in the invention according to claim 12 configured as described above, the image data and the parameters are managed on different storage devices. For example, image data may be managed in a plurality of detachable storage areas, and in this case, writing is not always possible depending on the storage area. Therefore, it can be said that the above parameters are managed in a writable storage area for a non-writable storage area.

  There are also storage areas that are not impossible to write but are inappropriate for writing. For example, it is often shared by several people over a network, and someone should avoid rewriting shared image data without permission. In such a case, the image data is managed in a writable storage area together with a shared area as a writable storage area, and the above parameters are managed in the writable storage area for image data in the storage area inappropriate for writing. The configuration. Of course, the same problem may occur in areas other than the network and the shared area. In any case, the above parameters are managed in a storage area suitable for writing.

Further, in the invention according to claim 13 configured as described above, the content of the image processing represented by the parameter is set based on the result of the statistical analysis of the image data by the parameter setting means. That is, it corresponds to automatic processing.
Furthermore, in the invention according to claim 14 configured as described above, the image processing performed when reproducing the image processing result is performed by the image processing reproduction unit selecting a corresponding image processing unit based on the parameter. The means for realizing the image processing can be selected from various methods even if the example is realized on a computer, and can be realized by selecting the inside / outside without questioning. More specifically, an image processing unit corresponding to a different version of image processing is selected, an image processing unit provided by a computer operating system or the like is selected and started, or a necessary image processing unit is searched from a network or the like. Can come up and start.

In this way, a method for associating and storing parameters representing the contents of image processing without executing image processing on the image data and changing the image data is not necessarily limited to a substantial apparatus. Can easily be understood. That is, it is not necessarily limited to a substantial apparatus, and there is no difference that the method is also effective.
In addition, such an image data processing apparatus may exist alone, or may be used in a state of being incorporated in a certain device, but the idea of the invention is not limited to this and includes various aspects. It is a waste. Therefore, it can be changed as appropriate, such as software or hardware.

When the software of the image data processing apparatus is embodied as an embodiment of the idea of the invention, it naturally exists on a recording medium on which such software is recorded and must be used. The invention is valid. Accordingly, each invention as a medium described in the present invention has a one-to-one correspondence with the recorded program itself.
Of course, the recording medium may be a magnetic recording medium, a magneto-optical recording medium, or any recording medium that will be developed in the future. In addition, the duplication stages such as the primary duplication product and the secondary duplication product are equivalent without any question. In addition, even when the communication method is used as a supply method, the present invention is not changed.

Further, even when a part is software and a part is realized by hardware, the idea of the invention is not completely different, and a part is stored on a recording medium and is appropriately changed as necessary. It may be in the form of being read.
In addition, in order to be able to reproduce image data in this way, a medium on which such an image data set is recorded is indispensable, and the present invention can be realized in such a form.

As described above, the present invention can provide an image data processing apparatus that can easily use the image processing result while leaving the original image data when performing image processing on the image data.
According to the invention of claim 2, an image data set in which at least a parameter is associated with the image data can be created in order to realize this, and according to the invention of claim 3, the image data If the set exists, the set desired image processing result can be reproduced.

Furthermore, according to the invention of claim 4, the contents of the image processing can be expressed more specifically. This also makes it easier to ensure reproducibility.
Furthermore, according to the fifth aspect of the present invention, a plurality of corresponding reproduction results can be prepared substantially, and a reproduction result corresponding to the situation can be selected.
Further, according to the sixth aspect of the present invention, an optimum image processing result can be provided in consideration of execution conditions and the like.

Furthermore, according to the seventh aspect of the present invention, it is possible to increase variations due to irreversible image processing or to reproduce the image processing process by reproducing the execution order.
Furthermore, according to the eighth aspect of the present invention, since a plurality of image processing results can be obtained with only individually prepared parameters, a plurality of image data can be provided without increasing the file capacity. .
Furthermore, according to the invention concerning Claim 9, it becomes possible to apply more suitable image processing according to the condition of a pixel.

Furthermore, according to the tenth aspect of the present invention, it is possible to easily perform association using a hierarchical structure.
Furthermore, according to the invention concerning Claim 11, the burden of a process can be reduced using thumbnail data.
Furthermore, according to the invention of claim 12, it is possible to optimally cope with the storage state of the image data, and it is possible to realize the association between the parameters that are not writable or the image data that is not preferable for writing and the parameters. It becomes like this.

Furthermore, according to the invention of claim 13, parameter setting can be automated.
Furthermore, according to the fourteenth aspect of the present invention, image reproduction processing can be easily realized by preparing an image processing unit corresponding to image processing, and an image processing unit existing outside can be easily performed. Can be implemented.
Furthermore, according to the invention according to claim 15, it is possible to provide a medium on which an image data set capable of exhibiting the same effect can be provided, and according to the invention according to claims 16 to 29, the same effect can be provided. A medium in which an image data processing program that can be played is recorded can be provided. According to the inventions according to claims 30 to 36, an image data processing method can be provided.

<First embodiment>
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic diagram showing a configuration of an image data processing apparatus according to an embodiment of the present invention.
Image data captured by a digital still camera or the like is managed using an external storage device such as a computer. The data storage means A1 corresponding to such an external storage device stores these plural pieces of image data in association with the corresponding parameters, and performs management such as change, addition, deletion, etc. as appropriate by database management by a computer.

  In order to perform such management, the data storage unit A1 has an image data storage area A11, a parameter storage area A12, and an association information storage area A13. Image data is stored in the image data storage area A11, but it may have a collective database structure or an area for storing individual files. The parameter storage area A12 is information indicating an image processing instruction for individual image data, and has a relatively small capacity compared to the image data. In this case as well, the database structure may be a batch, or individual files may be generated. In the association information storage area A13, association information for associating the parameters stored in the parameter storage area A12 with the image data stored in the image data storage area A11 is recorded. There are various methods for relating them as described above, and as an example, the parameter storage area A12 and the association information storage area A13 are inseparably integrated if they are configured as index information while forming a parameter database structure. Note that the image data storage area A11 naturally includes a removable recording medium, and the image data storage area A11, the parameter storage area A12, and the association information storage area A13 are physically the same device. There is no need. Further, the image data storage area A11 may be a shared area accessed from a plurality of devices.

  Further, when a parameter representing image processing contents is set by image data management operation or calculation by the input / output device in the computer itself and the parameter setting means A2 realized by the calculation result of the computer itself, the data storage means A1 is a database Management processing is executed by associating corresponding parameters with image data through management, and association information is generated at this time. This parameter setting means A2 generates parameters as a result. The parameter setting means A2 accepts an image processing instruction from the user via the GUI and sets the parameters, or the image data is independently inspected for a predetermined purpose. This includes the case of setting parameters for realizing the accompanying image processing. A variety of association information can be used, and a correspondence table may be prepared, a file name may be associated, or a storage area may be associated to be associated.

  In this way, the data storage means A1 stores the image data and the parameters representing the contents of the image processing to be performed on the image data in association with the association information. Then, the data acquisition means A4 acquires the corresponding image data and parameters from the image data storage area A11 and the parameter storage area A12 based on the information in the association information storage area A13, and reproduces the image processing. Output to means A3. The data acquisition unit A4 also generally specifies image data to be acquired by receiving an image selection instruction from the user via the GUI, but the method of specifying is not limited thereto. For example, in a computer or the like, a predetermined argument is given from an external application to specify target image data, and the image data can be specified and acquired by this to be transferred to the image processing reproduction unit A3. The manner in which the image data is acquired varies depending on the specific hardware, and can be regarded as acquired even when the image data is simply set as a variable in a state where it is expanded on the memory.

  The image processing reproduction means A3 realizes a modification process corresponding to the parameter, and includes a plurality of modification engines A31 to A3n. When each modification engine A3x is provided with image data and parameters, the modification engine A3x represented by the parameters is subjected to modification corresponding to each modification engine A3x to newly generate modified image data and output it. Here, the image data is treated as an original, and the modified image data is newly generated. Of course, it is free to overwrite the original image data with the newly generated image data, and it may be overwritten and stored in the image data storage area A11 in the data storage means A1. The modification engines A31 to A3n are displayed so that there are a plurality of conversion results in the sense that several conversion results can be obtained. However, the modification engines A31 to A3n are substantially one modification engine and can obtain several conversion results depending on parameters. Alternatively, individual modification engines may be prepared and conversion results may be obtained separately. Further, the modification engines A31 to A3n are not limited to those provided in the application itself, but may be those that select the modification engines A31 to A3n existing outside.

  The data storage means A1, parameter setting means A2, image processing reproduction means A3, and data acquisition means A4 are not realizable only by a single hardware, but can be realized by using a general-purpose computer system 10. In the case where the above-described configuration is realized by software, the data storage step A1, the parameter setting step A2, the data acquisition step A4, and the image reproduction processing step A3 are realized.

  In the present embodiment, a computer system 10 is employed as an example of hardware that realizes such an image data processing apparatus. FIG. 2 is a block diagram showing the computer system 10. The computer system 10 includes a scanner 11 a, a digital still camera 11 b, and a video camera 11 c as image input devices for directly inputting image data, and is connected to a computer main body 12. Each input device can generate image data in which an image is expressed by a dot matrix pixel and output the image data to the computer main body 12. Here, the image data is displayed in 256 gradations for each of the three primary colors of RGB. About 16.7 million colors can be expressed.

A floppy disk drive 13a, a hard disk 13b, and a CD-ROM drive 13c as external auxiliary storage devices are connected to the computer main body 12, and main programs related to the system are recorded on the hard disk 13b. Necessary programs and the like can be read from a CD-ROM or the like as appropriate.
In addition, a modem 14a is connected as a communication device for connecting the computer main body 12 to an external network or the like, and it can be connected to an external network via the public communication line, and can be installed by downloading software and data. It has become. In this example, the modem 14a accesses the outside via a telephone line, but it is also possible to adopt a configuration where the network is accessed via a LAN adapter.

  Here, among the external auxiliary storage devices, the floppy disk drive 13a and the CD-ROM drive 13c can be replaced by the recording medium itself, and supplied with the image data recorded on the recording medium. It can also be a means of an image input device. Further, when a network is accessed via the modem 14a or the LAN adapter, image data may be supplied from this network. In such a case, it can be a means of an image input device. The access to the network is not limited to acquiring data, but a part of the program or another program that can be started externally may be acquired. As a result, part or all of the modification engine can be acquired from the outside, or execution can be entrusted to the outside.

In addition, a keyboard 15a and a mouse 15b as a pointing device are connected for operating the computer main body 12, and a speaker 18a and a microphone 18b are provided for multimedia support.
Furthermore, a display 17a and a color printer 17b are provided as image output devices. The display 17a has a display area of 800 pixels in the horizontal direction and 600 pixels in the vertical direction, and the above-described display of 16.7 million colors can be performed for each pixel. Of course, this resolution is only an example, and can be changed as appropriate, such as 640 × 480 pixels or 1024 × 768 pixels.

  A color printer 17b as a printing apparatus is an ink jet printer, and can print an image by adding dots on a printing paper as a recording medium using four color inks of CMYK. The image density is capable of high-density printing such as 360 × 360 dpi or 720 × 720 dpi, but the gradation table has a two-gradation expression such as whether or not color ink is applied. The color ink is not limited to such four colors, and it is possible to reduce the conspicuousness of dots by adding light cyan and light magenta, which are light in color, and not only the ink jet method but also color toner is used. It is also possible to employ an electrostatic photographic method. The printing apparatus is not necessarily a color printer, and may be a monochrome printer. As will be described later, in black-and-white reproduction, there can be optimum image processing corresponding to the reproduction, and if such image processing is applied to the image data, inconvenience occurs when it is desired to reproduce in color again. However, in the present invention, the original image data is left, and such image processing can be easily executed.

  On the other hand, in order to display or output to the image output device while inputting an image using such an image input device, a predetermined program is executed in the computer main body 12. Among them, an operating system (OS) 12a is operating as a basic program, and the operating system 12a performs a print output to a display driver (DSP DRV) 12b for displaying on the display 17a and a color printer 17b. A printer driver (PRT DRV) 12c is installed. These types of drivers 12b and 12c depend on the models of the display 17a and the color printer 17b, and can be added to and changed from the operating system 12a according to the respective models. In addition, depending on the model, additional functions beyond standard processing can be realized. That is, various additional processes within an allowable range can be realized while maintaining a common processing system on the standard system called the operating system 12a.

  Of course, the computer main body 12 is provided with a CPU 12e, a RAM 12f, a ROM 12g, an I / O 12h, etc. as a premise for executing such a program, and the CPU 12e for executing arithmetic processing sets the RAM 12f in a temporary work area or setting. A basic program written in the ROM 12g is appropriately executed while being used as a storage area or a program area, and external devices and internal devices connected via the I / O 12h are controlled.

  The application 12d is executed on the operating system 12a as the basic program. The processing contents of the application 12d are various. The operation of the keyboard 15a and the mouse 15b as operation devices is monitored, and when operated, various external devices are appropriately controlled to execute corresponding arithmetic processing, Furthermore, the processing result is displayed on the display 17a or output to the color printer 17b.

  The computer system 10 can acquire image data by reading a photograph or the like with a scanner 11a as an image input device, and can also acquire image data captured with a digital still camera 11b or a video camera 11c. Image data as a moving image can be acquired. In addition, various types of pre-photographed image data are often provided as CD-ROM software, and the image data is stored in a single storage area before being accessed by multiple people over the network. There are many things to do.

  Image data taken with the digital still camera 11b is often stored together on the hard disk 13b, and such image data is not only enjoyed on the display 17a but also output on the color printer 17b. There are many. As an advantage of image data, there is a point that it can be easily corrected even if the image is poor. That is, when printing with the color printer 17b, correction is performed by photo retouching or the like such that the original image data is not captured as it is. In this way, there is a need for an image data processing apparatus that manages image data and corrects an image, and the application 12d and the computer system 10 are organically integrated to realize an image data processing apparatus.

  In this sense, the application 12d, which is image data processing software, stores and manages image data captured by the digital still camera 11b in the hard disk 13b, or is supplied by the CD-ROM via the CD-ROM drive 13c. While managing image data so that it can be input as appropriate, it also manages parameters as will be described later. Therefore, the data storage means A1 is constituted by software and hardware related in this sense.

Further, the image data stored in this way is subjected to image processing by an internal image processing routine together with the corresponding parameters as described above after specifying the processing target by the application 12d. The image processing reproduction means A3 is configured by software and hardware.
Then, the application 12d generates a predetermined corresponding screen while inputting the operation of the keyboard 15a and the mouse 15b via the operating system 12a and displays them on the display 17a. The target image is obtained through such GUI processing. The parameter setting means A2 is configured by related software and hardware in the sense of selecting data and specifying image processing to be executed. Furthermore, the data acquisition means A4 is configured by related software and hardware in order to read parameters so that image processing specified in advance when image data that has already been stored is read can be executed.

Such software is stored in the hard disk 13b and is read and operated by the computer main body 12. At the time of introduction, it is recorded on a medium such as the CD-ROM 13c-1 or the floppy disk 13a-1 and installed. Therefore, these media constitute a medium on which an image data processing program is recorded.
FIG. 3 shows the contents of control by the image data processing software in a block form. The main control unit 60 performs various comprehensive controls, the common function unit 20 performs various common controls, and the image data. It comprises a film data management unit 30 that performs management, an image modification control unit 40 that performs image modification for each image data, and a DPE print control unit 50 that performs a series of printing processes.

  The main control unit 60 appropriately selects and executes various flows to be described later, and also executes various other functions not classified elsewhere. One of them is an environment setting unit 60a, which records common settings and the like in the image data processing software on the hard disk 13b as a setting information file 60b and can be read out from other functional units as appropriate. This setting information file 60b has various default designations, such as designation of a new image data import source, or a page parameter to be carried over to the next time in print processing as will be described later. Will be recorded.

  Detailed blocks of the common function unit 20 are shown in FIG. 4, and some of them can be called from other function units in common. For example, the image selection unit 20a displays a plurality of thumbnail images on the display 17a on the image display unit 20m while generating thumbnails for each image data in the thumbnail generation unit 20i, and in this state, a selection operation using the keyboard 15a and the mouse 15b. To accept whether or not each image is selected. Of course, when the display is changed in accordance with the selection operation, the display is appropriately changed by the image display unit 20m, and the selection result is transferred to another function unit. The display designation unit 20b designates display on the screen, and appropriately designates display of an image corresponding to a change in the size of the window area or the like according to the GUI operation.

  The file editing unit 20c executes an operation for appropriately changing the storage area of the image data, and the search unit 20d executes a search based on a parameter, a comment, or a date based on parameters managed together with the image file. . The batch comment unit 20e processes commenting for a plurality of image data at once, and the batch organization unit 20f processes image data and parameters at the same time.

  The image processing unit 20g and the image editing unit 20h are portions that actually execute image processing, whereas the image modification control unit 40 mainly generates various parameters when performing automatic image processing. Manual image processing is also executed. In principle, this processing result is treated as temporary data, and if the original image data is specified to be changed during actual processing, it is reflected in the original image data. For convenience of display and processing time, it is not always necessary to execute the process based on the original image data. During the operation, the image processing unit 20g and the image editing unit 20h execute various processes based on the thumbnail image data.

When the image data storage area is already registered by the file editing unit 20c, the image input unit 20j performs processing for reading the image data during image processing and printing processing, and various kinds of image data are also included. In response to the existence of the data format, the image output unit 20k executes a process of converting the format and outputting it.
Next, the film data management unit 30 will be described. FIG. 5 is a block diagram showing a management structure of an image file 30a which is image data managed by the film data management unit 30, photographic data 30b including parameters, and film data 30c used for grouping image data. Yes. Here, the image data is handled as a file in the computer system 10 and thus shown as an image file, and the parameters are shown as photographic data 30b together with various information corresponding to each image data. The film data 30c is information for grouping and managing image data, and is shown as a film metaphor in FIG. Here, the database of the photographic data 30b is stored in a rewritable storage area on the computer system 10, and is stored in a fixed area regardless of a plurality of film metaphors. Of course, it is possible to physically create a plurality of databases, but the point is that the image data need not necessarily be formed on a medium in which image data is actually stored.

  In the figure, the physical recording form of the image file is shown on the left side of the figure, and a hierarchical structure is formed in folder units by the operating system 12a, and the image file is stored in each folder. . The grouping of image data in the present embodiment physically uses this hierarchical structure in units of folders, and is managed by adding information in units of folders. That is, the minimum information constituting the film data 30c includes a film name that can be arbitrarily assigned, a link destination indicating an actual storage area as physical arrangement information of the folder, a created date, a comment, and a medium attribute. Media label, film attribute, number of stored image files, and the like. Also, as shown in the figure, each folder is administratively equated with a film patrone, and from a different perspective, the actual storage area is identified as a patrone without being individually conscious of it. Is also close. Note that a mark indicating whether the physical storage area is a replaceable medium is displayed on the cartridge for easy understanding by the user. That is, if the image file is supplied by a CD-ROM, it can be exchanged. In this case, the CD-ROM may be exchanged so that it is not attached to the actual CD-ROM drive 13c. . In such a case, if the CD-ROM is not mounted, the display is not hidden but the display is performed based on the same data as registered as the film data 30c. In this case, the replaceable mark is displayed. Therefore, the operator can easily understand that it cannot be referred to unless the CD-ROM is set.

  In this example, only replaceable marks are shown, but information may be displayed by appropriately changing such marks. For example, the mark may be changed depending on whether the CD-ROM is attached or not attached as an exchangeable storage area. Also, if image data is stored in a storage area shared by multiple people on the network, it will not be able to be picked up if it is rewritten by each person, so a mark representing the network drive may be displayed. good. Of course, if it is a network drive, it may be treated as being writable but not writable. Instead of changing the mark, the shape of the cartridge itself may be changed.

  A specific configuration of the photographic data 30b is shown in FIGS. Here, the index information includes a file name, a file date and time, a file size, and a shooting date and time, and thumbnail data obtained by reducing the scale of the image file is displayed as a thumbnail. The comment can be attached to each image file. The photo data 30b is arranged together with the arrangement information indicating the display order, the position information indicating the actual storage area, and the audio information added via the microphone 18b. Is configured.

  Furthermore, the photo data 30b also includes modification information, feature information, and color matching information. As described above, in this image data processing software, image data management and image modification are performed, but the original image data is not directly changed by image modification, but only guidelines for modification by these parameters. It is managed as modification information, and feature information and color matching information can be managed together. FIG. 7 shows a specific variable declaration example for managing the modification information. The trimming start X coordinate (m_x1), the trimming start Y coordinate (m_y1), and the trimming end X coordinate (m_x2) representing the modification information related to trimming. , Trimming end Y coordinate (m_y2), rotation angle (m_nRotation) when performing rotation processing, automatic image correction (m_nApf), red component enhancement level (m_nRed), and green component enhancement level (m_nGreen) And a blue component enhancement degree (m_Blue), a brightness component enhancement degree (m_nBrightness), and a contrast enhancement degree (m_nContrast).

  Here, image processing that can be executed by the image data processing software, particularly automatic image correction, will be described. The core of the automatic image modification is the image modification control unit 40 shown in FIG. 8, and when the image feature extraction unit 40a extracts image features based on the image data, the modification information creation unit 40b has parameters necessary for the modification. The modification designating unit 40c causes the image processing unit 20g described above to execute actual processing using the same parameter.

FIG. 9 schematically shows a flow of a schematic procedure executed by the image modification control unit 40, and automatic image modification processing will be described below with reference to this flow.
In procedure 1, image data is input. The image data is read via the operating system 12a and stored in a predetermined work area. However, if thumbnail data has already been created, the thumbnail data is read from the photo data 30b and used as image data. Since the feature extraction is an aggregation process for each pixel of the image data, the calculation time varies depending on the amount of pixels. The use of the thumbnail data is in consideration of such an overwhelming difference in the amount of pixels, and the processing time can be shortened compared to the case of using the original image data. Note that the image data itself is one file, and as shown in FIG. 10, the head portion is provided with profile data such as the image size and the number of colors, and thereafter, each pixel is expressed in RGB 256 gradations. Therefore, a 3-byte area is reserved for the number of pixels.

  When the image data is read into the work area, the processing is performed on the image data of the target pixel while moving the target pixel as shown in FIG. The contents of the tabulation process vary depending on the feature amount of the image. In this embodiment, five feature amounts of “contrast”, “brightness”, “color balance”, “saturation”, and “sharpness” are included. Perform aggregation processing to obtain. In addition, when the aggregation process is completed for all the pixels, in step 5, a feature amount is calculated based on the aggregation result. Hereinafter, the feature amount derived based on these aggregation processes will be described.

Contrast indicates the width of the brightness of the entire image, and when it is desired to correct the contrast, there is mainly a desire to increase the width of the contrast. The brightness distribution in each pixel of an image is tabulated as a histogram and is shown by a solid line in FIG. When the distribution shown by the solid line is taken, the difference between the brightness of the bright pixel and the brightness of the dark pixel is small, but if the brightness distribution is widened as shown by the dashed line, the difference between the brightness of the bright pixel and the brightness of the dark pixel is large. As a result, the range of contrast is widened. Here, FIG. 13 shows luminance conversion for increasing the contrast. Between the luminance y after conversion and the luminance Y after conversion,
Y = ay + b
Therefore, the difference between the pixels of the maximum luminance Ymax and the minimum luminance Ymin of the conversion source becomes large after the conversion when a> 1, and the luminance distribution is widened as shown in FIG. Therefore, in order to create such a histogram, it is necessary to tabulate the interval from the maximum luminance value to the minimum luminance value as the contrast width. However, in this case, it is only luminance conversion, and if the image data has luminance as an element, it can be directly counted. It does not have a luminance value directly. In order to obtain the luminance, it is necessary to perform color conversion to the Luv color space. However, since this is not a solution because of problems such as the amount of computation, conversion of the following equation that directly obtains the luminance from RGB used in the case of a television or the like Use an expression.
y = 0.30R + 0.59G + 0.11B
That is, 3 bytes, which are image data of each pixel, are read while moving the target pixel, and the luminance y is calculated based on the same equation. In this case, the luminance y is also expressed by 256 gradations, and the frequency for the calculated luminance y is added one by one. The conversion to black and white may be performed by using this luminance, and is realized by matching the obtained luminance gradation value with each component value of RGB. For a monochromatic color such as a sepia tone, after obtaining the luminance gradation value, the RGB component values may be obtained in accordance with the RGB component ratio.

  In this way, the histogram of the luminance distribution is obtained in the image data totaling process of the procedure 2. In the feature amount extraction process of the procedure 5, both ends of the luminance distribution are obtained based on this histogram. The luminance distribution of a photographic image appears generally in a mountain shape as shown in FIG. Of course, there are various positions and shapes. The width of the luminance distribution is determined by where the both ends are determined. However, the point where the base is simply extended and the number of distributions becomes “0” cannot be the both ends. This is because the number of distributions may change around “0” in the base portion, and if it is statistically viewed, it changes while approaching “0” as much as possible.

  For this reason, in the distribution range, portions that are closer to the inside by a certain distribution ratio from the side with the highest luminance and the side with the lowest luminance are defined as both ends of the distribution. In the present embodiment, as shown in the figure, this distribution ratio is set to 0.5%. Of course, this ratio can be appropriately changed. In this way, by cutting the upper end and the lower end by a certain distribution ratio, it is possible to ignore white spots and black spots caused by noise or the like. That is, if such a process is not performed, if there is even a single white point or black point, it becomes the both ends of the luminance distribution. Therefore, in the case of a luminance value of 255 gradations, in many cases, the lowest end is the gradation “0”. The uppermost end has a gradation of “255”. However, such a problem can be eliminated by setting the portion that is inward by 0.5% of the number of pixels from the upper end portion as an end portion. Then, 0.5% of the number of pixels is calculated based on the actually obtained histogram, and the number of distributions is accumulated inwardly starting from the luminance value at the upper end and the luminance value at the lower end in the reproducible luminance distribution. Then, the luminance value having a value of 0.5% becomes the maximum luminance Ymax and the minimum luminance Ymin.

The width Ydif of the luminance distribution is the difference between the maximum luminance Ymax and the minimum luminance Ymin.
Ydif = Ymax−Ymin
It becomes.
As image processing for enlarging the contrast, the inclination a and the offset b may be determined according to the luminance distribution. For example,
a = 255 / (Ymax−Ymin)
b = −a · Ymin or 255−a · Ymax
If this is the case, the luminance distribution with a narrow width can be expanded to a reproducible range. However, when the luminance distribution is expanded by making the maximum use of the reproducible range, the highlight portion may be white and the high shadow portion may be black. In order to prevent this, it is only necessary to leave “5” as a luminance value as a range that does not expand to the upper end and the lower end of the reproducible range. As a result, the parameters of the conversion equation are as follows:
a = 245 / (Ymax−Ymin)
b = 5-a · Ymin or 250-a · Ymax
In this case, it is preferable not to perform conversion in the range of Y <Ymin and Y> Ymax.

Moreover, it is not necessary to calculate every time in this conversion. If the luminance range takes values “0” to “255”, a conversion result is previously set for each luminance value, and a conversion table is formed as shown in FIG. However, in this case, it is merely a luminance conversion, and it seems that it is necessary to consider separately the application of image data of RGB 256 gradations. However, in practice, the same conversion relationship as luminance can be applied between the image data before conversion (R0, G0, B0) and the image data after conversion (R1, G1, B1).
R1 = aR0 + b
G1 = aG0 + b
B1 = aB0 + b
As a result, it is understood that the conversion should be performed using the conversion table shown in FIG.

  In other words, the feature extraction operation in step 5 corresponds to the above-described operation for obtaining the maximum luminance Ymax and the minimum luminance Ymin. In the modification information creation processing in step 6, the parameters of the conversion formula are obtained while obtaining the width Ydif of the luminance distribution from these. This corresponds to the process of obtaining a and b and creating a conversion table. In the modification designating process of the procedure 7, such a conversion table is designated, and the image data (R1, G1, B1) after conversion is generated from the image data (R0, G0, B0) before conversion.

Next, brightness will be described. The lightness as the feature amount of the image here means an index of lightness and darkness of the entire image, and the median value (median) Ymed of the distribution obtained from the above-described histogram is used. Accordingly, the aggregation process in this case is performed simultaneously with the aggregation process for contrast in the procedure 2.
On the other hand, when analyzing the feature value in the procedure 5, the difference (Ymed_target-Ymed) from Ymed_target, which is an ideal value of lightness, may be calculated. The actual value of the ideal value Ymed_target uses “106”, but is not fixed. Further, it may be changed to reflect the preference.

  When correcting the brightness by using this feature amount, the following is performed. Whether the image is bright or not can be evaluated based on whether the median value Ymed is larger or smaller than the ideal value Ymed_target. For example, if the median value Ymed is “85”, it is smaller than the ideal value Ymed_target “106”. Therefore, the median value Ymed is first evaluated as “dark”, and secondarily the degree of darkness is It is expressed numerically as “106-85”.

  FIG. 16 shows a luminance histogram. When the peaks of the luminance distribution are on the dark side as shown by the solid line, the peaks are moved to the bright side as shown by the wavy line. On the contrary, when the peak of the luminance distribution is on the whole bright side as shown by the solid line in FIG. 17, it is preferable to move the mountain to the whole dark side as shown by the wavy line. In such a case, instead of performing linear luminance conversion as shown in FIG. 13, luminance conversion using a so-called γ curve as shown in FIG. 18 may be performed.

  In the correction using the γ curve, the entire image becomes bright when γ <1, and the entire image becomes dark when γ> 1. In the above example, if the median value Ymed increases by “21”, it will coincide with the ideal value Ymed_target. However, it is not easy to increase “21” exactly by using the γ curve. For this reason, as shown in FIG. 19, the value of γ corresponding to every increment of “5” should be set for the evaluation value (Ymed_target−Ymed). In this example, the value of γ is varied by “0.05” corresponding to the variation amount “5” of the evaluation value, but it goes without saying that the correspondence between the two can be changed as appropriate.

It is also possible to automatically set the value of γ as in the case of contrast correction. For example,
γ = Ymed / 106
Or
γ = (Ymed / 106) ** (1/2)
The value of γ may be obtained as Of course, it is sufficient to form a conversion table as shown in FIG.
That is, the work for extracting the feature in the procedure 5 corresponds to the work for obtaining the median Ymed, and the modification information creation process in the procedure 6 corresponds to the process for creating the conversion table while obtaining the γ correction value. Then, in the modification designation process of step 7, such a conversion table is designated to generate post-conversion image data (R1, G1, B1) from the pre-conversion image data (R0, G0, B0) of each pixel. become.

  Next, color balance will be described. Here, the color balance indicates whether or not there is a certain unbalance tendency between the R component, the G component, and the B component constituting the image data. For example, if a photograph looks reddish, it does not matter as long as it represents the real situation at the time of shooting, but if it is not, it can be said that some adverse effect appears. However, it can be said that such an imbalance cannot be understood unless it is actually compared with the real situation, so it is considered impossible to evaluate it after the fact.

  In the present embodiment, this is evaluated from the uniformity of the frequency distribution for each color. Depending on the situation at the time of shooting, it may be natural that the frequency distribution of each color component becomes non-uniform, and in such a case, the color should not be corrected. However, if the results are reversed, the frequency distribution should be uniform when the frequency distribution of each color component is somewhat similar, and it should not be uniform if the frequency distribution is not similar. it can.

  For this reason, in the image data totaling process of procedure 2, a histogram for each color component is created in order to check the similarity of the frequency distribution for each color component later. At this time, instead of obtaining the frequency distribution for all the gradation values, the 256 gradation region is divided into 8 to 16 (n divisions), and the frequencies belonging to each region are tabulated. In the case of dividing into eight, as shown in FIG. 20, the frequency distribution is obtained for eight regions of “0 to 31”, “32 to 63”... “224 to 255”.

On the other hand, when the above-described histogram is created for each color component for all the pixels, the number of pixels belonging to each region (r1, r2... Rn), (g1, g2. , (B1, b2... Bn) (here, n = 8) are vectorized as components. For each of RGB, the feature vectors VR, VG, VB are expressed as follows:
VR = (r1, r2... Rn) Σri = 1
VG = (g1, g2... Gn) Σgi = 1
VB = (b1, b2... Bn) Σbi = 1
The cross correlation between these feature vectors is obtained. The cross-correlation is calculated as an inner product: corr_rg = (VR · VG) / | VR | · | VG |
corr_gb = (VG · VB) / | VG | · | VB |
corr_br = (VB · VR) / | VB | · | VR |
It can be said that the inner product of the vectors itself represents the similarity of both vectors, and the values are “0” to “1”. Here, the color balance is evaluated based on the minimum value corr_x.

The color balance adjustment may be performed for each of the divided n regions, but generally, it can be dealt with by making each color component brighter or darker as a whole, so a γ curve is used. The RGB value may be corrected.
That is, the feature extraction operation in step 5 corresponds to the operation for obtaining the minimum value corr_x. In the modification information creation process in procedure 6, a conversion table is created while obtaining a γ correction value for modifying the balance based on this. This process is applicable. Then, in the modification designation process of step 7, such a conversion table is designated to generate image data (R1, G1, B1) after conversion from the image data (R0, G0, B0) before conversion of each pixel. become.

Next, saturation will be described. The saturation here refers to the vividness of the entire image. For example, it is an evaluation of whether the primary color is vividly or grayish. Although the saturation itself is represented by the size from the reference axis in the uv plane in the Luv color space, the amount of calculation for converting the color space is large as described above, so the pixel saturation is simplified. I will ask for it. For this purpose, a saturation substitution value X is calculated as follows.
X = | G + B-2 × R |
Originally, the saturation is “0” when R = G = B, and becomes the maximum value when mixing with a predetermined ratio of one or two colors of RGB. Although it is possible to express the saturation appropriately from this property, even if it is yellow, which is a single color of red and a mixed color of green and blue, even according to the simplified formula, the maximum saturation is obtained. Becomes “0” when is uniform. In addition, green and blue single colors reach about half of the maximum value. Of course,
X ′ = | R + B−2 × G |
X ″ = | G + R−2 × B |
It is also possible to substitute for this formula.

In the image data totaling process in the procedure 2, the distribution of the histogram for the alternative value X of saturation is obtained. If the distribution of the histogram for the alternative value X of saturation is obtained, the saturation is distributed in the range from the minimum value “0” to the maximum value “511”, and thus the distribution is roughly as shown in FIG. .
On the other hand, when the feature amount is analyzed in step 5, it is performed based on this histogram. That is, a saturation index for this image is determined based on the aggregated histogram. The range occupied by the upper “16%” is obtained from the distribution of the substitution value X of the saturation, and the lowest saturation “S” within this range represents the saturation of the image.

If the saturation “S” is low, saturation enhancement is desired, but in the case of automatic correction, the following is performed.
When each component is a component value of a hue component in which the respective components are roughly equivalent as in the RGB color space, if R = G = B, the color is gray and achromatic. Assuming that the minimum component in each component of RGB is merely reducing the saturation without affecting the hue of each pixel, the minimum value in each component is subtracted from all component values. It can be said that the saturation can be enhanced by enlarging the difference value. Now, assuming that the component value of blue (B) in each component (R, G, B) of the image data is the minimum value, it can be converted as follows using this saturation emphasis parameter Sratio.
R ′ = B + (R−B) × Sratio
G ′ = B + (GB) × Sratio
B '= B
This example is a method of simply subtracting the minimum value component from the other component values for the achromatic component, but other methods can also be employed for subtracting the achromatic component. In particular, when this conversion is performed, there is a tendency that when the saturation is emphasized, the luminance is improved and the entire image becomes brighter. Therefore, the conversion is performed on the difference value obtained by subtracting the luminance equivalent value from each component value.
Saturation enhancement
R ′ = R + ΔR
G '= G + △ G
B ′ = B + ΔB
Then, the addition / subtraction values ΔR, ΔG, and ΔB are obtained as follows based on the difference value from the luminance. That is,
ΔR = (R−Y) × Sratio
ΔG = (G−Y) × Sratio
ΔB = (BY) × Sratio
And as a result,
R ′ = R + (R−Y) × Sratio
G ′ = G + (G−Y) × Sratio
B ′ = B + (BY) × Sratio
Can be converted as In addition, the preservation | save of a brightness | luminance is clear from following Formula.
Y '= Y + △ Y
ΔY = 0.30ΔR + 0.59ΔG + 0.11ΔB
= Sratio {(0.30R + 0.59G + 0.11B) -Y}
= 0
That is, the luminance is preserved before and after the conversion, and even if the saturation is emphasized, it does not become bright overall. Further, when the input is gray (R = G = B), the luminance Y = R = G = B, so the addition / subtraction value ΔR = ΔG = ΔB = 0, and the achromatic color is not colored. .

Here, the saturation emphasis parameter Sratio only needs to be increased when the evaluation value Psatur becomes smaller. If S <92 in relation to the above-described minimum saturation “S”, S ′ = − S × (10/92) +50
If 92 ≦ S <184, S ′ = − S × (10/46) +60
If 184 ≦ S <230, S ′ = − S × (10/23) +100
If 230 ≦ S, S ′ = 0
Thus, the saturation emphasis index S ′ is determined, and the conversion from the saturation index S ′ to the saturation emphasis index Sratio is performed.
Sratio = (S + 100) / 100
As long as you ask. In this case, when the saturation enhancement index S = 0, the saturation enhancement parameter Sratio = 1 and the saturation is not enhanced. FIG. 22 shows the relationship between the saturation “S” and the saturation enhancement index S ′.

  That is, the feature extracting operation in step 5 corresponds to the operation for obtaining the saturation “S”, and the modification information creation processing in step 6 corresponds to the processing for obtaining the saturation emphasis index Sratio through the saturation index S ′. . Then, in the modification specifying process of step 7, the image data (R1, G1 after conversion) is obtained while obtaining the luminance from the image data (R0, G0, B0) before conversion of each pixel using such a saturation emphasis index Sratio. , B1).

Finally, sharpness will be described. Sharpness as an image feature is evaluated by the edge degree described below. If the image data is composed of pixels in a dot matrix shape, the difference in image data between adjacent pixels becomes large at the edge portion of the image. This difference is a luminance gradient, which is referred to as an edge degree. When considering the XY orthogonal coordinates as shown in FIG. 23, the vector of the degree of change of the image can be calculated by obtaining the X-axis direction component and the Y-axis direction component, respectively. In a digital image composed of dot matrix pixels, as shown in FIG. 24, the pixels are adjacent to each other in the vertical axis direction and the horizontal axis direction, and the brightness is represented by f (x, y). In this case, f (x, y) may be luminance Y (x, y), or R (x, y), G (x, y), B (x, y), which are the luminances of RGB. It may be. In the example shown in FIG. 24, the difference value fx in the X direction and the difference value fy in the Y direction are: fx = f (x + 1, y) −f (x, y)
fy = f (x, y + 1) −f (x, y)
It is expressed as Accordingly, the magnitude Ddif of the vector g (x, y) having these as components is
Ddif = | g (x, y) | = (fx ** 2 + fy ** 2) ** (1/2)
It is expressed as The edge degree is represented by Ddif. Note that the pixels are originally arranged in a grid pattern as shown in FIG. 25, and there are eight adjacent pixels when attention is paid to the center pixel. Accordingly, similarly, the difference between the image data of each adjacent pixel may be represented by a vector, and the sum of the vectors may be determined as the degree of image change. Further, simply comparing the horizontal arrangements between them is effective in reducing the amount of calculation.

  Even if the edge degree is obtained for each pixel as described above, the sharpness of the image cannot be obtained only by obtaining the edge degree of all the pixels and averaging them. FIG. 26 shows a photograph of an airplane flying in the sky, and it can be easily understood that the degree of change in the image is not large in the background sky. In such a case, assuming a situation in which the sky part is trimmed, the average value decreases and the image is not sharp when the number of sky pixels increases, even though the image data of the airplane as the center subject does not change. When the number of empty pixels decreases, the average value increases and the image is sharp. In such a case, since it is normal to determine the sharpness of the image based on the sharpness of the airplane that is the original subject, it can be said that averaging is not suitable.

  Therefore, instead of averaging the edge degree of all the images, the edge degree of only the contour portion is averaged in order to determine how sharp the contour portion in the image is. More specifically, when the image data is aggregated in step 2 while moving the target pixel, the pixel value is compared with the threshold value Th1 obtained by calculating the edge degree as described above. Whether or not it is an edge portion is determined, and only when it is an edge portion, the same edge degree Ddif is integrated (ΣDdif) and the number of pixels of the edge portion is integrated (ΣEdge_Pixel).

On the other hand, when feature extraction is performed in step 5, the edge degree (ΣDdif) accumulated in step 2 is divided by the number of pixels (ΣEdge_Pixel), and an average value Ddif_ave of the edge degree in the edge portion is calculated. Of course, the larger the average value Ddif_ave of the edge degree, the sharper the image. If the average value Ddif_ave of the edge degree is small, edge enhancement is desired. In the present embodiment, the following is performed. First, the edge enhancement degree Eenhance is obtained from the average value Ddif_ave of the edge degree. As an example,
Eenhance = 4 × Ddif_ave / 100
An arithmetic expression such as

The edge enhancement process itself uses an unsharp mask as shown in FIG.
When the edge enhancement degree Eenhance is obtained, an edge enhancement process is executed for all pixels using an unsharp mask as shown in FIG. The luminance Y ′ after enhancement with respect to the luminance Y of each pixel before enhancement is
Y '= Y + Eenhance (Y-Yunsharp)
Is calculated as Here, Yunsharp is obtained by performing unsharp mask processing on the image data of each pixel. The unsharp mask uses a central value of “100” as a processing target pixel Y (x, x, The weighting of y) is used for weighting and integrating the peripheral pixels corresponding to the numerical values in the cells of the same mask. If the unsharp mask shown in FIG. 27 is used,

なる演算式に基づいて積算する。同式において、「３９６」とあるは重み付け係数の合計値である。また、Ｍｉｊはアンシャープマスクの升目に記載されている重み係数であり、Ｙ（ｘ，ｙ）は各画素の画像データであり、ｉｊについてはアンシャープマスクにおける横列と縦列の座標値で示している。

Is integrated based on the following equation. In the equation, “396” is the total value of the weighting coefficients. Mij is a weighting factor written in the grid of the unsharp mask, Y (x, y) is image data of each pixel, and ij is indicated by the coordinate values of the horizontal and vertical columns in the unsharp mask. Yes.

  The meaning of the edge enhancement calculation calculated using the unsharp mask is as follows. Yunsharp (x, y) is obtained by lowering the weight of the peripheral pixel with respect to the target pixel and adding it, so that it is so-called “unsharp” image data. What is smoothed in this way has the same meaning as that obtained by applying a so-called low-pass filter. Therefore, “Y (x, y) −Yunsharp (x, y)” has the same meaning as that obtained by applying the high-pass filter by subtracting the low frequency component from the original all components. When the high frequency component that has passed through the high-pass filter is multiplied by the edge enhancement degree Eenhance and added to “Y (x, y)”, the high frequency component is increased in proportion to the edge enhancement degree Eenhance. The result is an enhanced edge.

  Note that the degree of edge enhancement also changes depending on the size of the unsharp mask. Therefore, classify the edge enhancement level Eenhance and prepare an unsharp mask of the corresponding size. It may be used. In addition, since it is a matter of course that edge enhancement is necessary at the edge portion of the image, as described above, calculation may be performed only at a place where image data greatly differs between adjacent pixels. In this way, it is not necessary to perform an unsharp mask operation on image data portions that are not almost edge portions, and the processing is drastically reduced.

  As described above, when the sharpness is summarized, the work of extracting features in the procedure 5 corresponds to the operation of obtaining the average value Ddif_ave of the edge degree, and the modification information creation process of the procedure 6 corresponds to the process of obtaining the edge enhancement degree Eenhance. Then, in the modification designation processing in the procedure 7, the converted image data (R1, G1, R1, G1, B1) of which brightness is enhanced from the image data (R0, G0, B0) before conversion of each pixel while using the edge enhancement degree Eenhance. B1) is generated.

  The above is a schematic description of the processing in the image modification control unit 40 in the present embodiment. However, even in the same modification process, the modification result changes by changing the target value. Therefore, in addition to standard automatic image modification processing, automatic image modification processing that makes colors look more “clean” by bringing them closer to the memory color, and “DPE” -style automatic image modification that enhances sharpness enhancement and saturation enhancement. It may be possible to select a process. In the automatic image adjustment to match the memory color, the user's preference can be set as a standard value, so that it is possible to perform the automatic image correction so that each person feels “beautiful”.

  The image modification control unit 40 is used as a so-called image modification engine. In the present image data processing software, the main control unit 60 comprehensively performs the image modification process according to the flowcharts of FIGS. 28 to 33 while using the image modification engine. I have control. Note that the image quality of the JPEG data format deteriorates every time rewriting is performed. This is because the process is based on an 8 × 8 block unique to JPEG, and a process for reducing distortion caused by this block is also performed. More specifically, a smoothing filter is applied, but the edge portion is not smoothed. By applying such edge preserving smoothing processing weakly, the edge portion is emphasized, while 8 × 8 block distortion and noise are smoothed and smoothed. Even if the folding angle and 8 × 8 block distortion are reduced, the image is stored again with a degrading method such as JPEG and then distorted again, and the recording size is increased with a non-degrading method such as BMP (bitmap). . On the other hand, in the method of managing parameters as in the present embodiment, since reduction processing is performed at the time of output such as display or printing, image representation with the best image quality is possible.

There is a simultaneous print process as a series of image data management processes performed by the main control unit 60. FIG. 34 shows a screen display in the simultaneous printing process. In this case, the main control unit 60 appropriately outputs commands to the display designation unit 20b of the common function unit 20 to display the same screen on the display 17a, and accepts operation inputs of the keyboard 15a and the mouse 15b. .
In the simultaneous print processing screen, the left-hand portion on the screen is an operation display area, and tabs are displayed along a series of data processing flows. In this example, tabs of “photo input”, “photo correction”, “print designation”, and “print” are displayed, and a downward “Δ” mark is displayed therebetween. Of course, the desired image data can be printed neatly through the sequence of “photo input” processing, “photo modification” processing, “print designation” processing, and “printing” processing. In the past, it was naturally possible to execute the same processing, but in that case, it is necessary to proceed by assuming the flow of the procedure.

  That is, 1: Open the image data from the file menu, 2: Specify the image modification operation from the tool menu, display the necessary palette, etc., perform the desired modification, save, and 3: The format to be printed is designated by the print layout in the file menu, 4: the print preview in the file menu is confirmed, and finally, the printing in the file menu is executed. Of course, when printing a plurality of image data, it is necessary to determine the print target from the file menu in this process.

On the other hand, printing a photograph taken with the digital still camera 11b corresponds to designating simultaneous printing at the DPE as compared with the case of normal photography, and a series of data processing is performed. A series of data processing can be executed even if the user is not familiar with the application by proceeding with the simultaneous printing work.
In the simultaneous print processing screen of FIG. 34, the display of “photo input” is displayed, but the image data management by the film data management unit 30 is practically performed. The left part of the display area is the operation display area dp1, the remaining display area is the main display area dp2, and the left part of the display area is a group display area dp3 for grouping and displaying image data. The remaining portion is an image display area dp4 for displaying image data belonging to a group in a thumbnail when a group is selected.

  The group display area dp3 is an area for displaying a film metaphor corresponding to the folder unit as described above, and displays a film cartridge as a frame, and includes a film name, a comment, a date, and the number of accommodated image files. Is displayed. Of course, if the properties of each film metaphor are displayed, all information such as film name, link destination, date, comment, medium attribute, medium label, film attribute, and number of stored image files are displayed. In addition, the group display area dp3 can be appropriately increased or decreased using a GUI, and if it cannot be displayed in the display area, a scroll display is added or a reduced display is performed. Of course, by selecting and operating one of the displayed film metaphors, the image display area dp4 displays thumbnails of the image files 30a stored in the folder corresponding to the selected film metaphor. Will be.

  In this embodiment, since the image data is managed using the hierarchical structure of the folder adopted by the operating system 12a, the operator directly operates the computer system 10 to store the image file 30a in the folder. In this case, there may be a difference between the presence / absence of the image file 30a in the folder and the photo data 30b. In this case, priority is given to the presence / absence of the image file 30a in the folder. The photographic data 30b is increased or decreased as appropriate.

  In this sense as well, it is determined whether or not the corresponding photo data 30b exists based on the image file 30a existing in the folder corresponding to the film metaphor. If there is the photo data 30b, the thumbnail data is used for display. If there is no photo data 30b, thumbnail data is created by the thumbnail creation unit 20i and then displayed. The photo itself is vertically long or horizontally long, and one thumbnail display area is a square that can accommodate both, and a serial number and an actual file name are displayed outside the frame.

  In addition, when selecting simultaneous printing, not only the case where data management has already been performed, there are times when image data just taken is taken in for printing and the image data itself is stored in a certain amount in advance. It can be considered that the data management is newly started in the area. The method of capturing image data that has just been photographed may be, for example, the case of capturing by connecting a cable from the digital still camera 11b, or the case of using a predetermined exchangeable recording medium. In any case, a “new film” prepared as a command button on the upper part of the main display area on the screen shown in FIG. 34 is executed. Then, as shown in FIG. 35, two command buttons “ordinary input” and “select input method” can be executed, and a command button “setting input” can be executed together. If a general operator has a single digital still camera 11b, it is considered that the capture of the image data is constant, and the image data transfer method selected in advance in the “input setting” is executed. It will be. Of course, there may be cases where a plurality of digital still cameras 11b are owned, or it may be necessary to take in by another method. The method will be displayed and selected. In these cases, it may be necessary to execute an external application, but these are executed as appropriate by setting them in the input settings. Needless to say, the input designation method can be appropriately changed.

  In this state, the operator looks at the display in the cartridge displayed in the group display area, determines the group, displays the image data in the image display area, and further selects image data to be printed. This selection operation is accepted by the image selection unit 20a. About the selected image data, the presence or absence of selection can be easily determined by changing the color of the frame portion of the thumbnail display area. Then, the selection result is reflected as an output target in the “printing” process through “print designation” as well as “photo modification” thereafter. In these cases, the physical arrangement information is referred to in each process, and the actual process is not performed by moving the image data to be selected to the temporary area.

  If image data to be printed is selected in “photo input”, it is obvious that the next process is “photo modification” according to the display in the operation display area. In this “photo correction”, image correction can be executed only for selected image data. FIG. 36 shows the display in the main display area when automatic image correction is performed. In the figure, the image before modification of the selected image data is displayed in the upper part as a thumbnail, and the image after modification subjected to the automatic modification described above is displayed in the lower part as a thumbnail. The operator looks at both and compares them, and selects which is better. Of course, the selection can be made by clicking on the thumbnail on the desired side with the mouse 15b, and the display designation unit 20b can make the determination by highlighting the frame portion on the clicked side. Note that the default is to select the state before modification and select the modified state only for the side clicked with the mouse. In most cases, it is assumed that the image quality will be selected. Under these conditions, the default may be selected.

  In this scene, a command button for "execute" and a command button for "cancel" are prepared at the bottom, and if the command button for "execute" is clicked with the mouse, a photo prepared for each image data The modification information of the data 30b is updated. As shown in FIG. 7, management parameters for automatic image modification (m_nApf) are prepared. When the image data after modification is selected and the “execute” command button is clicked, the management parameters for the automatic image modification (m_nApf) are set. Set the flag. That is, even if the modified image data is selected, it is not replaced with the original image data and the modified image data is overwritten, but only a management parameter flag is set. However, in the subsequent processing, this management parameter is referred to, and it can be determined that the processing should be executed for the automatically corrected image data for the main image data. Of course, in this case, it may be necessary to read the image data and automatically modify the image by the image modification control unit 40. However, the thumbnail data in the photo data 30b is updated to the thumbnail data based on the modified image data. The thumbnail data may be displayed only if the display level is sufficient. A check box “Reflect to original data” is prepared at the bottom of the screen. When this check box is checked, the original image data is overwritten with the corrected image data.

In this example, although automatic image modification is selectively performed, there is no hand that does not use such a function, and in particular, when there is such an inexperienced user, the selection operation cannot be known. There is also. Therefore, it is convenient to automatically correct the image at the time of inputting the photograph, and not to display the process of correcting the photograph.
FIG. 37 shows an example of the screen display in such a case. In the figure, as the operation, a “film selection” process is added before “photo input”, and a “print designation” process is executed after “photo input”. As shown in FIG. 34, it is possible to select a photo while allowing a new film to be selected in the “photo input” process, but in the case shown in FIG. 37, the “film selection” screen is displayed first. By displaying, it is easy to understand by selecting the photographic data in the cartridge unit or selecting a new film first. Also, in this screen display, command buttons called “Previous Step” and “Next Step” are prepared on the upper right part of the screen in order to give instructions to advance or return processing, and “Previous Step” is displayed. When it is executed, the process is returned, and when the “next step” is executed, the process is advanced. Furthermore, a simple explanation of the process at each stage can be displayed on the upper part of the screen. For example, in the “Film Selection” stage, “Select a film and go to the next. A new film can be created by“ Add Film ”” is displayed.

  On the other hand, manual image modification can also be selected, and the degree of modification is instructed using the GUI. That is, the result of manual correction is reflected by operating the GUI display with the mouse 15b. In this embodiment, the image processing unit 20g can execute stepwise enhancement processing for brightness and contrast, and parameters representing the degree of enhancement are prepared based on the premise, and the selected modification result is represented. The parameters are reflected in the management parameter of the brightness component enhancement level (m_nBrightness) and the management parameter of the contrast enhancement level (m_nContrast).

Manual image retouching is not limited to brightness and contrast, and it is possible to execute enhancement processing for each of the red component, the green component, and the blue component, and the parameter representing the degree of enhancement is a red component enhancement degree (m_nRed). Management parameter, green component enhancement level (m_nGreen) management parameter, and blue component enhancement level (m_Blue) management parameter.
Image modification includes various processes reflected in the display of image data in a broad sense, and includes image trimming and rotation in a broad sense. When the trimming is executed with the image data selected, the image data based on the current management parameter is displayed in a frame of a predetermined size as shown in FIG. Here, the mouse 15b is operated to specify the trimming start position and trimming end position, and when the “execute” command button is clicked, the area other than the rectangular area whose diagonal is the start position and end position is removed and displayed. Of course, in this case, a part of the original image data is not deleted, but the trimming start X coordinate (m_x1), the trimming start Y coordinate (m_y1), the trimming end X coordinate (m_x2), and the trimming end Y coordinate (m_y2). Only the coordinate value is set to the management parameter of the image data, and the thumbnail creation unit 20i newly creates a thumbnail based on the coordinate value and updates it only in the photo data 30b.

  On the other hand, screen rotation is also called image modification in a broad sense, and is used when a portrait photograph taken with the camera lying horizontally is displayed vertically. FIG. 39 shows a display screen of the main display area in the case of such rotation processing, in which the original image data is displayed as a thumbnail in the upper left part, and three rotation angles every 90 degrees are displayed below the arbitrary image data. Operation input buttons for selecting the rotation angle are provided. Further, a thumbnail rotated by a selected rotation angle can be displayed in the right center portion. Of course, the selected rotation angle is set in the management parameter of the rotation angle (m_nRotation).

  40 and 41 show menu operations when designating these image modifications. FIG. 40 shows an example of menu operation when automatic image correction is performed. When image correction is clicked on the menu bar, a drop-down menu is displayed, and when automatic image correction is selected, more detailed options are displayed. . Of course, if you click "clean" at this time, automatic image modification will be activated with the "clean" option. In this case, all the selected image data are displayed as shown in FIG. FIG. 41 shows an example of a menu operation when manual image correction is performed. When manual image correction is selected from the drop-down menu while clicking image correction, correction of “brightness / contrast” or “color enhancement” is selected. It becomes possible to select whether to modify. Regarding manual image modification, it is considered that there are many cases where individual image correction is not yet improved even if automatic image modification is performed, and it is activated after selecting image data to be manually modified. You can only run them if you do.

  In addition, image processing is selected from the drop-down menu and executed for trimming, rotation, monochrome conversion, and sepia conversion after image data is selected. Note that even if black-and-white conversion and sepia tone conversion are performed individually, the conversion results are uniform and do not have to be adjusted by the operator's subjectivity like manual image correction. Therefore, in practice, management parameters for automatic image modification (m_nApf) are set for black and white conversion and sepia tone conversion.

So far, the situation has been described in which parameters are set in the process of performing various modifications to the image data when the simultaneous printing process is selected. Next, processing in the computer system 10 for actually realizing such an operation will be described.
FIG. 28 to FIG. 31 show each processing in a flowchart. FIG. 28 shows a process in the case of executing automatic image modification. When image data to be subjected to automatic image modification is read, the modification information is read in step 100 by referring to the database structure of the photographic data 30b. This modification information means the various parameters described above, and if these parameters specify that automatic image modification or manual image modification should be executed, the process ends without performing the following automatic image modification. To do. This is because there is no point in executing automatic image correction repeatedly, and it cannot be automatically corrected as long as the preference is reflected by manual image correction.

  Next, in step 110, the image data is read, the feature of the image is extracted in step 115, the feature information is stored in step 120, the correction information for automatic correction is created in step 125, and the process goes to step 130. To perform automatic retouching image processing. Of course, these correspond to the procedures 1 to 6 as described in FIG. On the other hand, if the trimming position information is set in the management parameters of the trimming start X coordinate (m_x1), the trimming start Y coordinate (m_y1), the trimming end X coordinate (m_x2), and the trimming end Y coordinate (m_y2). After the determination of 135, the image processing for trimming is executed in step 140, and when the rotation correction information is set in the management parameter of the rotation angle (m_nRotation), the image is determined in step 150 after the determination of step 145. Rotation image processing for rotating is performed.

  Since the image after the automatic image modification can be obtained through the above processing, the thumbnails before and after the modification are displayed at step 155 as shown in FIG. 36, and the automatic image modification process is performed. It waits for the input of whether to adopt the result. That is, if the image after automatic image modification is desired, it is selected, and the “execute” command button is clicked. In this case, in step 170, the selection status in the check box “Reflect to original data” is fetched, and if it is determined that it is checked, the image data is overwritten and saved in step 175.

  When the original is rewritten, it is not necessary to refer to the modification information, and the modification information is stored at step 180 only when the original is not rewritten. On the other hand, if the “standard” automatic image processing is not satisfactory, as shown in FIG. 40, when “clean” or “DPE tone” is selected, automatic image correction according to the setting is executed. In step 165, the operation condition value for automatic image processing is changed in advance, and in step 115, the above-described processing is repeated. When the “Cancel” command button is clicked, it is determined to be “Cancel” and the present process is terminated.

  Of course, the automatic image correction can cope with various other conditions. Accordingly, in addition to the selection of “DPE tone” prepared in advance, the above operating condition value is changed according to the user's designation such as “brighter around here” or “whole yellow”. It is also possible to repeat the above-described processing. This operating condition value is not only set later in step 165, but is naturally reflected at the time when the correction information for automatic image correction is first created in step 125.

  Next, processing when manual image correction is executed will be described. FIG. 29 shows manual image modification processing. When manual image modification is executed, modification information is read in step 200 before image data to be processed is read. Read image data. Subsequently, in step 210, the management parameter of automatic image modification (m_nApf) is referred to. When the management parameter is set, the image processing of automatic image modification is executed in step 215 after the determination in step 210.

Thereafter, in step 220, the management parameters for manual image modification that have already been set are read and image processing is performed as specified. Thereafter, the processing for trimming and the processing for rotation are performed based on the management parameters, respectively. Executed at 225-240.
Since the image after the manual image adjustment that has already been set can be obtained through the above processing, if the manual adjustment operation is further executed as described above in step 245, the image is corrected in step 255. The information is changed, and image correction is executed through the processing of steps 220 to 240.

  If the “execute” command button is clicked, it is determined that it means “confirm”, and the original image data is rewritten in step 265 according to the selection status in the “reflect to original data” check box or step In 270, the management parameter representing the final modification information is rewritten. When the “Cancel” command button is clicked, it is determined to be “Cancel” and the present process is terminated.

  Next, processing when trimming is executed will be described. FIG. 30 shows the trimming process. Before the image data to be processed is read, the modification information is read in step 300, and then the image data is read in step 305. Subsequently, in step 310, the management parameter for automatic image modification (m_nApf) is referred to. If the management parameter is set, image processing for automatic image modification is executed in step 315. Also, various management parameters for manual image modification already set in step 320 are referred to, and if the management parameters are set, corresponding image processing is executed in step 325.

Thereafter, in step 330, the management parameter for trimming that has already been set is referred to, image processing for trimming is executed in step 335, and in step 340, the management parameter for rotation that has already been set is referred to. In step 345, rotation image processing is executed.
By performing the above processing, it becomes possible to obtain all the images that have already been set, so that in step 355, a trimming operation is accepted on the screen display shown in FIG. 38, and a new trimming operation is performed. In step 360, the modification information is changed, and the image modification is executed through the process in step 335. In this case, although reference is made to the management parameter for rotation in step 340, it is determined whether or not the rotation is duplicated, and is not executed redundantly.

  Also in this case, if the “execute” command button is clicked, it is determined to mean “confirm”, and the original image data is rewritten in step 365 according to the selection status in the “reflect to original data” check box. In step 370, the management parameter representing the final modification information is rewritten. When the “Cancel” command button is clicked, it is determined to be “Cancel” and the present process is terminated.

  Finally, a process for executing rotation will be described. FIG. 31 shows a rotation process. Before the image data to be processed is read, the modification information is read in step 400, and then the image data is read in step 405. Subsequently, in step 410, the management parameter for automatic image modification (m_nApf) is referred to. If the management parameter is set, image processing for automatic image modification is executed in step 415. Also, various management parameters for manual image modification already set in step 420 are referred to, and if each management parameter is set, corresponding image processing is executed in step 425.

Thereafter, in step 430, the management parameter for trimming that has already been set is referred to, and image processing for trimming is executed in step 435. In step 440, the management parameter for the rotation angle (m_nRotation) that has already been set. In step 445, rotation image processing is executed.
Through the above processing, it becomes possible to obtain all the images that have already been set, and in step 455, a rotation operation is accepted on the screen display shown in FIG. 39, and a new rotation operation is performed. In step 460, the modification information is changed, and the image modification is executed through the processing in step 445.

  Also in this case, if the “execute” command button is clicked, it is determined to mean “confirm”, and the original image data is rewritten in step 465 according to the selection status in the “reflect to original data” check box. In step 470, the management parameter of the rotation angle (m_nRotation) representing the final modification information is rewritten. When the “Cancel” command button is clicked, it is determined to be “Cancel” and the present process is terminated.

One advantage of using the management parameters in this way is that it is not necessary to change the original image data, and it is necessary to modify the management parameters in order to make use of the original image data.
As shown in FIGS. 40 and 41, in the drop-down menu displayed when image modification is selected from the file menu, an image modification cancellation command is prepared at the bottom, and this command is selected and executed. The process is executed according to the flowchart of FIG.

  Also in this case, it is assumed that the image modification / cancellation is executed with the image data selected, the modification information of the photo data 30b for the image data is read in step 500, and the operation menu shown in FIG. 42 is displayed in the main display area in step 505. Display and wait for operation input. In this operation menu, check boxes in front of each item as well as the items to be canceled, such as “Automatic image correction”, “Manual image adjustment”, “Rotation”, “Trimming”, “Monochrome”, “Sepia”. it's shown. Here, when the operator clicks the check box in front of the image modification item to be canceled with the mouse 15b, a check mark is toggled and the presence / absence of each check mark is internally stored as a flag. . In the lower row, an “execute” command button and a “cancel” command button are prepared, and the operator clicks the “execute” command button after checking the necessary check boxes.

  Then, in step 510 and subsequent steps, the corresponding modification information is deleted while determining whether or not each check box is checked. Of course, the deletion of the modification information here is nothing but the modification of the management parameters, and it is not necessary to process the original image data. More specifically, in step 510, it is determined whether or not a check mark is added to the item “automatic image correction”. If it is added, correction information of “automatic image correction” is determined in step 515. Is deleted. Next, in step 520, it is determined whether or not a check mark is added to the item “black and white”. If it is added, correction information of “black and white” is deleted in step 525. Next, in step 530, it is determined whether or not a check mark is added to the item “sepia”, and if it is attached, the modification information of “sepia” is deleted in step 535. Next, in step 540, it is determined whether or not a check mark is added to the item “manual image adjustment”. If it is added, correction information of “manual image adjustment” is deleted in step 545. Manual image adjustment includes things such as brightness, contrast, and color enhancement. In this example, all are canceled, but they may be canceled individually.

Next, in step 550, it is determined whether or not a check mark is added to the item “trimming”. If it is added, correction information of “trimming” is deleted in step 555. Next, in step 560, it is determined whether or not a check mark is added to the item “rotation”. If it is added, correction information of “rotation” is deleted in step 565.
In a state where some modification information has been deleted through the above results, the modification information is stored in step 570. The storage operation here means updating of the photo data 30b, and the database structure of the photo data 30b shown in FIG. 5 is accessed and updated to the latest modification information. When the “Cancel” command button in the operation menu shown in FIG. 42 is clicked, all the check marks are deleted and the above processing is executed internally, so that eventually no modification information is deleted. This process ends. In addition, in this example, a method of restoring the original information by deleting the once created correction information is adopted, but by adding date and time information to the correction information itself, a plurality of time series corresponding to one image data are added. The modification information may be managed. In this way, it is possible not only to restore the original by simply deleting the correction information, but also to delete the correction information retroactively to the correction information at any stage, and the correction result that was good at the intermediate stage It is also possible to restore.

Up to now, the management parameter prepared for each image data has been set or canceled, but the processing to make it possible to use the actually modified image data while using this management parameter Will be described with reference to the flowchart of FIG.
The scene where the modified image data is used is a case where the thumbnail creating unit 20i updates the thumbnail and displays it on the screen according to an instruction from the display designating unit 20b, or the image output unit 20k converts the data format of the image data. Or the case where the original print data is created when printing is executed by the DPE print control unit 50, as will be described later. Therefore, although there is a fine processing difference in each case, it generally matches the flowchart of FIG.

  In step 600, the modification information of the target image data is read. In step 605, the image data is read. In the following processing, the image modification is performed based on the image data while following the modification information, and the image data is rewritten. New image data will be created. In step 610, it is determined whether there is correction information for automatic image correction, and if there is, automatic image correction is performed in step 615. In this case, the management parameter of the automatic image modification (m_nApf) is not only the information that the automatic image modification is performed, but it is determined which automatic image modification such as “standard”, “beautiful”, “DPE tone” is performed. Proceed with the process. Also, since conversion to black and white or sepia tone has only one modification result, it can be expressed by the management parameters of this automatic image modification, and is performed simultaneously or alternatively.

  Subsequently, in step 620, it is determined whether there is manual adjustment correction information. If there is manual adjustment image processing, in step 625, manual adjustment image processing is executed. As described above, the correction information of the manual adjustment includes the brightness component enhancement level (m_nBrightness), the contrast enhancement level (m_nContrast), the red component enhancement level (m_nRed), and the green component enhancement level (m_nGreen). And the blue component enhancement level (m_Blue), and if any one of the correction information is present, the corresponding image processing is executed, the correction information on brightness and contrast, the correction information on color enhancement, If there is, the latter is modified after the former is modified. Of course, when a result reflecting such a modification order is obtained, it is also possible to perform the modification once.

Thereafter, in step 630, it is determined whether there is trimming modification information. If there is, trimming image processing is executed in step 635. In the image processing for trimming, the surrounding image data is deleted leaving an area surrounded by the trimming start X coordinate (m_x1), trimming start Y coordinate (m_y1), trimming end X coordinate (m_x2), and trimming end Y coordinate (m_y2). Will do.
In step 640, it is determined whether there is rotation correction information. If there is rotation correction information, rotation image processing is executed in step 645. In the rotation image processing, the rotation angle is referred to based on the management parameter of the rotation angle (m_nRotation), and processing for rotating the image data is executed.

In the above image processing, the original image data is first saved in the work area, and the image data on the work area is changed. Accordingly, no change is made to the original image data.
The above is optional image processing that may or may not be executed according to the selection operation of the operator. In Step 650 and Step 655, essential image processing is executed based on the difference in hardware environment. . In step 650, image processing for color reproduction according to the output device is executed. It cannot be denied that there is a deviation from the standard in color output reproduction equipment. That is, there are many cases where the output results are different while inputting the same image data. In addition, it is impossible for the cost and cost to be uniform because the image data and the output result must be consistent with the standard state by unifying this displacement. It is a good idea to use information.

  In the case of the image data described above, it can be said that there is no large color shift in the output result if there is color shift information on the photographing side and color shift information on the output side. In the present embodiment, the former color misregistration information is managed as color matching information in the database structure of the photographic data 30b, and is managed in the setting information as color misregistration information generated in the computer system 10 and the color printer 17b. In step 650, the image data on the work area is corrected based on both color misregistration information.

  In step 655, image processing with a resolution corresponding to the output device is executed, and corresponding resolution conversion is performed by comparing the resolution of the image data with the resolution at the time of output. For example, when the display on the color display 17a is 70 dpi and printing is performed according to the size, if the resolution of the color printer 17b is 720 dpi, 10-times resolution conversion is required in the vertical and horizontal directions.

Returning to the description of the simultaneous printing process shown in FIG. 34, the "print designation" process is performed after the photo correction. Already through “photo input” and “photo correction”, selection of image data to be printed and image processing to be performed on it are selected. This “print designation” designates in what format the selected image data is to be printed.
FIG. 43 shows the display in the main display area in the “print designation”. A display pattern that can be scrolled in the horizontal direction is arranged in the upper portion so that a layout pattern can be displayed. In the drawing, layouts of “layout for every four sheets”, “album print”, and “sticker print” are displayed. Of course, other layout patterns can be implemented. In addition, as an option, a check box is provided so that a register mark that is a guide for the position when cutting, a date, or a title can be selected. Furthermore, the paper corresponds to “A4”, “B5”, “seal”, and the like, and for these, a radio button that can exclusively select any one is provided.

When printing, since it is necessary to generate print data according to the model of the color printer 17b, a printer device selection display area is provided on the left side of the lower stage. Here, by selecting a printer device, setting information corresponding to each is read, and the above-described color misregistration is corrected or output resolutions are matched.
The layout of “album print” is prepared in the layout, and when the “album details” command button is clicked, an operation screen shown in FIG. 44 is displayed in the main display area. Also in this display screen, an album pattern can be displayed by arranging a display area that can be scrolled horizontally in the upper part. In this example, A4 paper is arranged in two horizontal rows and four vertical rows. In the figure, an image is printed, an image is printed in four columns on the left half, and an image is printed in two stages on the top and bottom. Also, as an option for album printing, check boxes are provided so that you can choose to print comments, print the date, or print the page title. Therefore, a page number designation list is also provided so that a continuous page number can be printed. This page number may be automatically set to the subsequent page number of the previous album printing. Then, if the display is acceptable, the “OK” command button may be clicked. If the user does not like the display, the “Cancel” command button may be clicked.

  The last process of the simultaneous printing shown in FIG. 34 is “printing”, but in this main display area, as shown in FIG. 45, the model of the currently designated printer device, the size of the paper to be printed, and the necessary A confirmation message including the number of copies is displayed, and an “execute” command button and a “cancel” command button for starting printing are prepared. Of course, if you click the "execute" command button in this state, printing will start. Depending on the color printer 17b, it often takes time to print. Therefore, if all the operations that should be specified in advance are completed and this "execute" button is clicked, all the printing is completed after the bath is finished. It becomes easy.

  Incidentally, FIG. 46 shows a specific configuration of the DPE print control unit 50 which executes such “print designation” and “print” processing. The print image designation unit 50a inherits the designation of the image data selected as described above. The print designation unit 50d executes the “print designation” process by the frame designation unit 50b and the layout designation unit 50c. Under the control, the print style creation unit 50e and the print image processing unit 50f generate actual print data. In general, image data is represented by RGB multi-gradation display, but printing is often CMYK two-gradation display. For this reason, the print image processing unit 50f executes the image processing according to the above-described designation, and also executes the multi-tone → two-tone gradation conversion processing together with the change of the RGB → CMYK color space.

If you want to save multiple modification information for one image data in time series, display the history when deleting modifications, and delete them one by one. That's fine. Of course, if there is modification data in the case sequence, the image data to be used is reproduced by performing image processing in order from the oldest. In addition, when it is desired to add corrections, new correction information is generated and stored with the previous correction information remaining.

<Second Example>
On the other hand, FIG. 47 shows more specifically the above-described hierarchical structure of folder units. First, regarding the film data 30c, the database file ai_dpe .. of the “main” folder 31 in which the main program of the image data processing apparatus is stored. Stored as db0. Since it is the same folder as the main program, which patrone corresponds to which folder is important information at the core, and it will be dissipated as a result of changing the location according to the user's arbitrary designation To prevent. Next, regarding the image file 30a stored in the exchangeable storage area such as the CD-ROM 13c-1, the photo data 30b is managed in the cartridge unit, and the photo data 30b is stored in the “main” folder 31. In the formed “removable” folder 32, the database file photo1. db1, photo1. db2, photo2. db1, photo2. Stored as db2. Here, two files having the extensions db1 and db2 are generated while the names photo1 and photo2 are assigned to one cartridge. Of these two database files, the one with the extension db2 is a thumbnail-specific file in the photo data 30b, and the remaining photo data 30b is stored in the file with the extension db1. . Therefore, in this example, a set of database files photo1. db1, photo1. Photo data 30b is composed of db2.

  On the other hand, when the image file 30 a is stored on the hard disk 13 b, it is stored in the “films” folder 33 formed in the “main” folder 31. Here, one folder is formed for each cartridge in the “films” folder 33, and when “sea bathing” is set as the name of the cartridge, it becomes the “sea bathing” folder 34, and the name of the cartridge is “ When “hiking” is set, the “hiking” folder 35 is displayed. In each folder, the database file ai_dpe. db1, ai_dpe. db2 is created, and an individual image file 30a is stored with a unique name. As with the previous two database files, thumbnail data is stored in the extension db2 and the remaining photo data is stored in the extension db1. In addition, this database file stores information on only the image file 30a stored in the same directory. Of course, the same applies to the “hiking” folder 35.

  In addition, for the convenience of processing, it is convenient to have a cartridge that temporarily stores information that cannot be separated, and a cartridge named “Other” is prepared. The image file 30 a classified as the “others” cartridge is stored in the same row as the “sea bathing” folder 34 and the “hiking” folder 35 described above immediately below the “films” folder 33. Here again, the database file ai_dpe. db1, ai_dpe. db2 has been created.

  As described above, the location of the image file 30a is on a replaceable recording medium or the hard disk 13b, and is managed on a cartridge basis, and the location is stored in the database file ai_dpe. Centralized management is performed with db0. Then, the database file ai_dpe. The information is stored as a link destination in db0. If the link destination is on the hard disk 13b, the image file 30a is stored with one directory secured together with the photo data 30b. If the link destination is on an exchangeable recording medium, only the photo data 30b is concentrated in one directory. Saved. If the photo data 30b and the image file 30a are not in the same directory, that is, if they are on an exchangeable recording medium, the database file photo1. db1, photo1. The file name of db2 is also stored in the film data 30c. This is because a plurality of cartridge photo data 30b are stored in one directory. On the other hand, when the photo data 30b and the image file 30a are in the same directory, ai_dpe. db1, ai_dpe. The name of db2 is not particularly important. This is because one directory is reserved for each cartridge, and a set of database files ai_dpe. db1, ai_dpe. This is because only db2 exists. Of course, since the name of the directory corresponds to the name of the cartridge, the location is also specified by the name of the cartridge.

  By the way, there are various methods for linking the image file 30a and the photo data 30b. In the above example, a set of database files is formed for a plurality of image files 30a, but it is also possible to distribute them in file units. In FIG. 48, one attribute file “0616000x.ATB” including the above-described modification information, feature information, color matching information, and the like is generated as photographic data 30b for one image file “0616000x.jpg”. In this case, one directory is generated for one cartridge, and the image file 30a group and the attribute file 30d group are stored in each directory. When handling the image file 30a, first, it is determined whether the attribute file 30d and the image file 30a in each directory have a one-to-one correspondence. If they match, the thumbnail data in the attribute file 30d is used for simple processing. Execute typical display and various operations. In this case, since the attribute file 30d is specified by the directory location written in the film data 30c and the name of each image file 30a, these pieces of information constitute the information of the link between the image file 30a and the modification information. .

  As another example in which a database file is not generated, a file in which an image file 30a and photo data 30b are integrated can be generated. FIG. 49A shows an example of the directory structure in that case, and one file “0616000x.PHT” including the photo data 30b is generated on the assumption that one image file “0616000x.jpg” exists. Yes. In this case, since the correspondence is such that the photo data 30b is attached on the assumption that the image file 30a exists, the correspondence does not become different as in the case of separate files.

  In addition, the upgrade process of the modification process is foreseen, and preliminary information is required to cope with other unforeseeable changes. FIG. 49B shows an example in which information indicating the version of the image modification engine is included corresponding to the upgrade of the modification process. Here, in addition to the image file “xxxx.jpg” and the photo data “xxxx.ATB”, an information file “xxxx.ENG” indicating the version of the image modification engine is integrated into one integrated file “xxxx.PHT”. Is generated.

  FIG. 50 shows a specific process when such a folder structure is adopted. As described above, the normal modification processing result is reflected only in the thumbnail, and the original image file 30a is not modified. Therefore, it is necessary to apply a modification process to the actual image file 30a in the case of the same size display, enlarged display, or printing. Of course, the modification result is temporary work image data 30a.

  The work image file generation process of FIG. 50 will be described on the premise of the file configuration as described above. When the simultaneous printing process of FIG. 34 is being executed, it is necessary to display the image file at the same magnification or enlarged size in order to check the modification result. Further, when printing is finally executed, an image file reflecting the modification result is necessary. The work image file generation process shown in FIG. 50 is a process for generating a work image file in such a case.

  Note that this process is realized as a single module, and it is assumed that an image file is specified under a selected cartridge when calling the module. Therefore, as shown in FIG. 51, the cartridge selection information is provided in a variable PATRONE, and a variable f_PICT indicating whether or not each image file 30a held in each cartridge is selected. The variable f_PICT is a character area of 1000 bytes, but each byte is selection information for each image file 30a, and it is possible to designate whether or not 1000 image files 30a are selected for convenience. ing. Then, it is possible to refer to one byte at an arbitrary place by giving an argument, and determine whether or not each image file 30a is selected based on the information.

  First, in step 700, the patrone film data 30c selected from the variable PATRONE is stored in the database file ai_dpe. Refer to it by db0. The corresponding film data 30c includes the medium attribute and the link destination for the cartridge. Therefore, in step 700, the link destination is acquired, and in step 705, it is determined whether or not the recording medium can be exchanged from the medium attribute, that is, the removable recording medium, and the process is branched. In the case of removable, first, in step 707, a removable recording medium to be supported is loaded. Specifically, it obtains the path name and media label that is the link destination of the removable recording medium, shows it to the user, prompts the user to set the drive, checks if it is correct, and if it is incorrect, starts again. Make it. When this is completed, the corresponding database file is referred to in the “removable” folder 32 in step 710. Database file photo1. db1, photo1. If it is db2, the modification information of each image file designated based on the designation information in the variable f_PICT is acquired from the database file.

If it is not removable based on the medium attribute, a folder with the name of the cartridge is searched in the films folder 33 in step 715, and the database file ai_dpe. db1, ai_dpe. Refer to db2. Then, the modification information of each image file designated based on the designation information in the variable f_PICT is acquired from the database file.
In this way, the location of the image file 30a and the modification information corresponding to the location can be acquired. In step 720, the modification process is executed by the corresponding image modification engine based on the designated modification information, and further in step 725. The original / enlarged display or printing process is executed. Note that step 725 may be executed from the module, or the process may be returned to the upper module and executed.

  On the other hand, a thumbnail image is displayed in the image display area dp4 in a state where the cartridge is selected. In this case, a thumbnail display process shown in FIG. 52 is executed. Also in this case, first, in step 730, the patrone film data 30c selected based on the variable PATRONE is stored in the database file ai_dpe. With reference to db0, the media attribute and link destination for the cartridge are acquired from the corresponding film data 30c. Then, it is determined from the medium attribute whether the recording medium can be exchanged, that is, removable, and if it is removable, in step 740, the database file photo1.jpg in the “removable” folder 32 is determined. Thumbnail data is acquired from db2. If it is not removable based on the medium attribute, the folder with the name of the cartridge is searched in the films folder 33 in step 745, and the database file ai_dpe. Thumbnail data is acquired from db2. In step 750, the obtained thumbnail data is displayed in the image display area dp4.

  Next, processing for enabling the image processing order to be arbitrarily changed will be described. FIG. 53 shows the contents of the modification information in the photo data 30b in this case. The contents of the processing are “automatic image correction”, “brightness”, “contrast”, “red (emphasized)”, “green (emphasized)”, and “blue (emphasized)” as shown in the leftmost column. In addition, for each process, individual designation information to be set is “modified engine version”, “order (execution order information)”, and “processing strength” as shown in the top list.

  Here, since the execution order of each processing content is fixed in “automatic image modification”, the order is effective between other processes only when not selected. FIG. 5A shows that “1” is set in the order of automatic image modification, and that other processing is “0” and is not selected. On the other hand, in FIG. 5B, the order of automatic image modification is “0” and is not selected. In the other processes, the order of “1” to “5” is set.

  FIG. 54 shows a flowchart for executing image modification processing when such processing order is assigned. First, in step 760, sorting by processing order is executed. As described above, when no process is selected, “0” is added, and as a result of ascending order sorting, a process that is not selected comes first. In step 765, “0” is added to the order column and the process arranged at the head is excluded. For example, in the case shown in FIG. 53 (a), only the automatic image processing remains, and in the case shown in FIG. 53 (b), only the automatic image processing is excluded, and red enhancement and green enhancement are processed. , Blue enhancement, brightness, contrast.

  Step 770 is a loop end determination, and when there is no more thing to be processed, this retouching process is ended. If there is anything to be processed, the process is executed in steps 775 and 780. In step 775, the image data and the processing strength parameter are delivered to the processing engine of the highest priority processing, and the correction processing is executed. The highest-priority processing is processing that has been sorted and rearranged to the top, and in the example of FIG. 53B, the processing is initially red-emphasized.

After this process, in step 780, the unprocessed one is moved up. First, the red emphasis process is the highest priority process. When the process is completed, the red emphasis process is eliminated and the second blue emphasis is set as the highest priority process, and so on. By such advance processing, the processing is executed in order until the last processing is completed, the processing to be executed last is lost, and the loop processing is finished.
FIG. 55 conceptually shows the process of step 775. The image modification control unit 40 incorporates a plurality of image modification engines on the assumption that it is used as a so-called image modification engine. In the figure, there are version 1 (41) and version 2 (42) as retouching engines for automatic image retouching, and similarly there are version 1 (43) and version 2 (44) as retouching engines for brightness retouching. Version 1 (45) is available as a contrast correction engine, and the other is provided in the same manner. In step 775, when the processing engine, the version, the image data, and the processing strength are designated as parameters to the image modification control unit 40 as shown in the manner of operation in the figure, the image modification control unit 40 performs the image modification as designated. Execute on image data and output modified image data.

That is, the image modification control unit 40 selects the modification engines 41 to 45... According to the contents of the parameters, and gives the parameters to these to perform image modification. Of course, the image modification control unit 40 itself is configured as an assembly of a large number of modules, and a module of a specific modification engine is executed through branch processing.
As described above, by setting the order element as one parameter of the modification information and executing the sort, the modification process can be executed in the desired order without executing an unnecessary process.

  On the other hand, the processes “automatic image correction”, “brightness”, “contrast”, “red (emphasized)”, “green (emphasized)”, and “blue (emphasized)” can be grouped and used separately. For example, a first group of only “automatic image correction”, a second group of “brightness” and “contrast”, and a first group of “red (emphasized)”, “green (emphasized)”, and “blue (emphasized)”. Three groups can be made, such as three groups. The first group requires a feature extraction process, a modification information creation process, and a modification designation process, and must be realized as a series of processes. In addition, the second group focuses on luminance conversion as the content of processing and has commonality. Further, the third group is an emphasis process for each color component, and the process contents are common.

  Therefore, while there is room in the execution environment, such as when the processing capacity of the CPU is high, the designation of all groups can be performed, but the third group can be realized depending on the execution environment. It is possible to prevent the second group from being realized. This determines whether or not the first to third groups can be executed by environment setting or the like, and the execution determination unit 46 of the image correction control unit 40 determines whether or not each of the modification engines 41 to 45. refer. Then, although the modification engine is executed for the executable group process, the non-executable group process is terminated in the same manner as the completed process without causing the modification engine to execute the process.

By the way, the description has been mainly given of the photo data 30b having a set, but a configuration having a plurality of sets such as the history information described above is also possible. FIG. 56 shows an example of the contents of the photo data 30b in the case of having a plurality of sets of such modification information. In terms of content, a plurality of sets shown in FIGS. 53 (a) and 53 (b) are provided.
Assuming that each set is called one group, FIG. 57 is a flowchart showing processing when the photograph data 30b includes a plurality of groups. First, since there is only one modification designation so far, it is necessary to save as a plurality of groups.

When the image data to be modified is selected in step 800, the modification to be specifically executed is instructed in step 805, and the modification instructed in step 810 is executed. Of course, the image modification in step 810 is performed on the thumbnail data representing the original image file 30a. The method of giving the above instructions is the same as described above.
Next, in step 815, the user is inquired whether to save the modification instruction given in step 805. The inquiry is displayed on the display 17a using the GUI, and responded with the mouse 15b or the keyboard 15a. In the case of saving, the designation of the saving group is input in step 820. Five storage groups can be selected in advance, and any one of them is input via the GUI. Of course, the number of storage groups is arbitrary, and it is possible to add them in order without deciding a fixed upper limit.

  When the storage group is determined, the modification information is written in step 830. As one aspect of determining the number of groups in advance, a predetermined case may be associated with each group. For example, group 1 is a modification process in the case of a slide show, and group 2 is a modification process in the case of printing. In addition, when selecting each group, it may be possible to individually specify that the group is for a slide show or for printing. Step 825 represents a process for associating a group with a condition for executing the group as described above, and is not essential.

After the modification information is written, the thumbnail data is also written in step 840. Thumbnail data is required for each group, and is added to the database file of the above-described photo data 30b with an extension of db2.
FIG. 58 shows the modification processing when a plurality of groups are registered as described above. Here, as a premise of the modification process shown in FIG. 54, it is determined in step 850 whether or not modification information of a plurality of groups is stored, and if there are a plurality of groups, one of the groups is selected in step 855. Let If there are not a plurality of groups, an existing group is designated by default in step 860. Since one group is designated as the modification information at step 855 or step 860, the following processing from step 800 shown in FIG. 57 is executed.

  In this example, a plurality of sets of all parameters are prepared, and one of the groups is selected. However, it is not always necessary to prepare a plurality of sets as a whole, and it is naturally possible to prepare a plurality of processing patterns for some image processing. For example, a plurality of processing intensity fields are prepared in the ones shown in FIGS. 53 and 56, and the field to be set is designated in the same manner as the storage group is designated in step 820. When reading, if a plurality of values are set in a plurality of columns in step 850, the setting for reading in step 855 is selected.

  On the other hand, as described above, a group may be stored with a condition for executing it. In this case, the modification process is executed according to the flowchart shown in FIG. That is, it is determined in step 870 whether there are a plurality of groups. If there are a plurality of groups, the current environment is acquired in step 875. This environment corresponds to the above-described conditions. That is, it is determined with reference to a predetermined variable or flag whether the slide show is currently being executed or the printing process is being executed. Any variable can be referenced. For example, the global variable JOKEN may be set. If the current condition is acquired, a group corresponding to this condition is selected in step 880. In the following, the processing after step 800 shown in FIG. 57 is executed.

  In this way, if the execution conditions are set when the retouching process is executed, the environment is automatically determined when a process such as display or printing is started, and If the retouching process is set in, the corresponding retouching process is automatically performed. For example, in the case of a slide show, it is necessary not to pass the original display interval during image modification. Therefore, shortening of processing time is desired, and simplification of processing is essential. On the other hand, in the case of printing, even if it takes time, a beautiful image quality is desired. Therefore, it is possible to execute a desired correction process.

In the case of a slide show from such a background, a group that corrects only the brightness and contrast that is relatively easy to process is registered instead of automatic image correction, and in the case of printing, it is registered as a group to execute automatic image correction. It is effective to keep it.
Next, FIG. 60 shows a flowchart in the case of using such a plurality of groups for the history. In steps 900 to 910, as in the case of steps 800 to 810 described above, predetermined image data is selected and correction is executed. Thereafter, in step 915, it is selected whether or not to save the modification instruction, and if it is to be saved, a group of the latest modification information is added in step 920. For example, if there are three existing groups, the fourth group is stored. At this time, the date and time of modification may be added as one piece of information. In step 925, corresponding thumbnail data is added to a predetermined database file in the same manner as in step 840 or the like.

  As long as it is a history, new modifications must be performed on top of past modifications. FIG. 61 shows a flowchart of the modification process when there is history modification information. First, in step 930, sorting is performed in the order of group execution. Usually, the group with the larger number is new modification information and is not essential. However, there is a possibility that the specification is changed, and there is a case where the information on the modification date is stored as described above, so that it is meaningful to enable sorting.

  When the sorting is completed, the number of groups is set to the variable g_total in step 935, and “1” is set to the loop pointer i in step 940. In step 945, the modification process is executed based on the modification information of the group i indicated by the loop pointer i. Since the loop pointer i is incremented by “1” at step 950, the modification processing is executed in ascending order of the group number, and the history is reproduced in the oldest order. In step 955, it is determined whether or not the loop pointer i exceeds the number of existing groups. Unless the number of groups exceeds the number of groups, the loop is repeated assuming that there is an unprocessed modification process.

On the other hand, up to now, it is not assumed that the modification processing is executed only on a part of the image data, but it is executed not only on the whole image but also on the part. It is also possible. Here, the “part” may be a partial region of the image, or may be only a part of the layer if it is composed of a plurality of layers.
FIG. 62 shows a flowchart in a case where image modification is realized by designating such a modification area. When image data to be processed is selected in step 960, a modification area is designated in step 965, a modification instruction is given in step 970, and the image is modified in step 975. Since the contents of area designation and modification often repeat trial and error as appropriate, the order of processing in steps 965 to 975 represents only a relative execution order.

In step 980, an inquiry is made as to whether or not the modification instruction is to be stored.
However, it can be said that the modified area stored in this way is only one parameter for the modified engine. Therefore, as shown in FIG. 55, the modification engine side partially modifies corresponding to the region and layer and outputs it as modified image data.
When specifying a specific area by specifying a specific area, for example, in the case of a rectangular area, specify the coordinate values of two diagonal corners, specify for each object, or use a desired curve. It is possible to indicate the area of Also, it may be specified as the entire central region, the upper half, or the lower half.

  On the other hand, it is also possible to associate image processing by designating the color of the image. For example, image processing can be associated by specifying chromaticity that is not easily affected by brightness. If it is a skin-colored region, it is considered that the object is mostly a human face, and if it is a human face, it looks slightly more blurry than sharpening. Therefore, the skin color chromaticity is specified instead of the area information, and an instruction to reduce (blur) sharpness is given as a correction instruction. Then, the modification engine side identifies the chromaticity of the processing target pixel, and if the chromaticity is the target, the specified processing intensity is unsharpened.

As another example for each chromaticity, it is also preferable to specify the chromaticity of the blue sky to make it unsharp. It is also preferable to designate a process for enhancing redness in consideration of the sunset.
Here, if the image data of each pixel is represented by (R, G, B), the chromaticity is
r = R / (R + G + B)
b = B / (R + G + B)
Represented as: Chromaticity is not affected much when human skin appears dark or bright, shows a constant distribution, and more specifically,
0.33 <r <0.51
| 0.74r + b−0.57 | <0.1
It can be judged by the relational expression. If this condition is applied to each pixel, it can be said that it belongs to the skin color region. Considering that this is a blue sky, the fluctuation range is larger than the skin color,
0.17 <r <0.30
| 1.11r + b−0.70 | <0.2
It is sufficient that the following relational expression holds.

In order to perform optimal image processing according to the pixel status such as the pixel position and pixel color in this way, parameters corresponding to the pixel status are stored in association with each other, and the parameters are acquired. Sometimes image processing is performed according to pixel conditions to reproduce an image.
As described above, when image data is stored in a folder managed as a film metaphor, a database of photographic data 30b corresponding to each image data is prepared, and desired image processing is selected for desired image data. The selected image processing is updated as modification information in the above database structure, and when it is necessary to actually display, output, or print, the modification information is referred to only in the work area while leaving the original image data. Therefore, it is possible to easily perform image modification while leaving the original image data.

1 is a schematic configuration diagram corresponding to a claim of an image data processing apparatus according to an embodiment of the present invention; It is a block diagram of specific hardware of the image data processing apparatus. It is a functional block diagram of the image data processing apparatus. It is a block diagram of a common function part. It is a functional block diagram of a film data management part. It is a schematic explanatory drawing which shows the data structure which the film data management part manages. It is a figure which shows the variable declaration of a management parameter. It is a functional block diagram of an image modification control unit. It is a figure which shows the flow of the procedure for demonstrating image modification control. It is a figure which shows the structure of an image file. It is a figure which shows the state which moves a process target pixel. It is a figure which shows the distribution range in the case of expanding luminance distribution. It is a figure which shows the conversion relationship for expanding luminance distribution. It is a figure which shows the edge part obtained by the edge part process and edge part process of luminance distribution. It is a figure which shows the conversion table at the time of enlarging luminance distribution. It is a figure which shows the concept brightened by (gamma) correction. It is a figure which shows the concept darkened by (gamma) correction. It is a figure which shows the correspondence of the brightness | luminance changed by (gamma) correction. It is a figure which shows the correspondence of brightness evaluation and (gamma). It is a figure which shows the extraction method of the element for setting it as the feature vector for every color component. It is the schematic of the total state of saturation distribution. It is a figure which shows the relationship between saturation and a saturation emphasis index | exponent. It is explanatory drawing in the case of representing the change degree of an image with each component value of a rectangular coordinate. It is explanatory drawing in the case of calculating | requiring the change degree of an image with the difference value in the adjacent pixel of a vertical axis | shaft direction and a horizontal axis direction. It is explanatory drawing in the case of calculating | requiring the change degree of an image between all the adjacent pixels. It is a figure which shows an example of image data. It is a figure which shows a 5x5 pixel unsharp mask. It is a flowchart at the time of designating automatic image adjustment. It is a flowchart at the time of designating manual image adjustment. It is a flowchart at the time of designating trimming. It is a flowchart at the time of designating rotation. It is a flowchart at the time of designating correction cancellation. It is a flowchart of the process which makes it possible to use the corrected image data. It is a figure which shows the operation screen of the process of simultaneous printing. It is a figure which shows the operation screen at the time of newly taking in image data. It is a figure which shows the operation screen in the case of performing the process of automatic image correction. It is a figure which shows the operation screen at the time of making it perform automatic image correction by default. It is a figure which shows the operation screen in the case of performing the process of trimming. It is a figure which shows the operation screen in the case of performing the process of rotation. It is a figure which shows the operation screen in the case of performing the process of automatic image adjustment. It is a figure which shows the operation screen in the case of performing the process of manual image adjustment. It is a figure which shows the operation screen in the case of performing correction cancellation process. FIG. 10 is a diagram illustrating an operation screen when performing print designation processing. It is a figure which shows the operation screen in the case of performing the album printing process. It is a figure which shows the operation screen in the case of performing a printing process. It is a functional block diagram of a DPE printing control unit. It is a figure which shows a directory structure. It is a figure which shows the modification of a file structure. It is a figure which shows the other modification of a file structure. It is a flowchart of a production | generation process of a work image file. It is a figure which shows the example of a definition of the variable used by the production | generation process of a work image file. It is a flowchart of a thumbnail display process. It is a figure which shows the content of modification information. It is a flowchart of an example of a correction process. It is a conceptual diagram which shows a correction process. It is a figure which shows the content in the case of having several modification information. It is a flowchart of retouching operation in a case where a plurality of groups have retouching information. It is a part of flowchart of the modification process in the case of having modification information in a plurality of groups. It is a part of flowchart of the correction process at the time of making a group respond | correspond to an environment. It is a flowchart of the correction operation when there is history correction information in a plurality of groups. It is a flowchart of the correction process in the case of implement | achieving the log | history of correction in a some group. It is a flowchart of retouching operation when retouching a part of an image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Computer system 11a ... Scanner 11b ... Digital still camera 11c ... Video camera 12 ... Computer main body 12a ... Operating system 12b ... Display driver 12c ... Printer driver 12d ... Application 13a ... Floppy disk drive 13b ... Hard disk 13c ... CD-ROM drive 14a ... Modem 15a ... Keyboard 15b ... Mouse 17a ... Display 17b ... Color printer 18a ... Speaker 18b ... Microphone 20 ... Common function part 20a ... Image selection part 20b ... Display designation part 20c ... File editing part 20d ... Search part 20e ... Batch comment part 20f ... Batch organization unit 20g ... Image processing unit 20h ... Image editing unit 20i ... Thumbnail creation unit 20j ... Image input unit 20k ... Image output unit 20m ... Image display unit 3 ... film data management unit 30a ... image file 30b ... photo data 30c ... film data 40 ... image modification control unit 40a ... image feature extraction unit 40b ... modification information creation unit 40c ... modification designation unit 50 ... DPE print control unit 50a ... print image Designation unit 50b ... Frame designation unit 50c ... Layout designation unit 50d ... Print designation unit 50e ... Print style creation unit 50f ... Print image processing unit 60 ... Main control unit 60a ... Environment setting unit 60b ... Setting information file

Claims (36)

Parameter setting means for setting parameters representing the contents of predetermined image processing performed on the image data;
Data storage means for storing the image data and the parameters together with association information;
Data acquisition means for acquiring the image data and the parameters with reference to the association information;
An image data processing apparatus comprising: image processing reproduction means for obtaining image data subjected to the specified image processing based on the acquired image data and the parameter. Parameter setting means for setting parameters representing the contents of predetermined image processing performed on the image data;
An image data processing apparatus comprising: data storage means for storing the image data and the parameters together with association information. Parameters representing the content of predetermined image processing performed on the image data and the image data are stored together with the correlation information,
Data acquisition means for acquiring the image data and the parameters with reference to the association information;
An image data processing apparatus comprising: image processing reproduction means for obtaining image data subjected to the specified image processing based on the acquired image data and the parameter.   4. The image data processing apparatus according to claim 1, wherein the parameter represents a type or degree of image processing.   4. The image data processing apparatus according to claim 1, wherein there are a plurality of parameters for each type of image processing.   4. The image data processing apparatus according to claim 1, wherein a plurality of parameters can be stored and can be selectively executed from a plurality of parameters.   The image data processing apparatus according to any one of claims 1 to 3, 5, and 6, wherein the parameter includes execution order information for performing image processing in a predetermined order. An image data processing device.   The image data processing apparatus according to any one of claims 1 to 3, wherein the parameters are divided into a plurality of selectable groups, and image processing is performed based on the parameters of the group selected at the time of execution. An image data processing device.   4. The image data processing apparatus according to claim 1, wherein the parameter is divided into a plurality of sets, and a set of parameters corresponding to a pixel state is selectively used. apparatus.   4. The image data processing apparatus according to claim 1, wherein the data storage means can partition the storage area as a hierarchical structure, and divides the image data and parameters according to the hierarchical structure. An image data processing apparatus.   4. The image data processing apparatus according to claim 1, wherein the data storage unit stores thumbnail data of the image data in association with the parameters.   4. The image data processing apparatus according to claim 1, wherein the image data is managed on a storage device different from the parameters.   4. The image data processing apparatus according to claim 1, wherein the parameter setting means sets image processing contents based on a result of statistical analysis of the image data. Image data processing device.   4. The image data processing apparatus according to claim 1, wherein the image processing reproduction unit selects and executes an image processing unit that performs image processing represented by the parameter. Image data processing device. Image data,
A parameter representing the content of the image processing so that predetermined image processing can be performed on the corresponding image data;
A medium on which an image data set in which the image data and association information for associating the parameters are recorded is recorded so that the image processing content represented by the parameters can be applied to the image data. A medium having recorded thereon an image data processing program for performing image processing on image data by a computer,
A parameter setting step for setting parameters representing the contents of predetermined image processing performed on the image data;
A data storage step for storing the image data and the parameters together with association information;
A data acquisition step of acquiring the image data and the parameter with reference to the association information;
A medium on which an image data processing program is recorded, comprising: an image processing reproduction step for obtaining image data subjected to the specified image processing based on the acquired image data and the parameter. A medium having recorded thereon an image data processing program for performing image processing on image data by a computer,
A parameter setting step for setting parameters representing the contents of predetermined image processing performed on the image data;
A medium storing an image data processing program, comprising: a data storage step for storing the image data and the parameters together with association information. A medium having recorded thereon an image data processing program for performing image processing on image data by a computer,
Parameters representing the content of predetermined image processing performed on the image data and the image data are stored together with the correlation information,
A data acquisition step of acquiring the image data and the parameter with reference to the association information;
A medium on which an image data processing program is recorded, comprising: an image processing reproduction step for obtaining image data subjected to the specified image processing based on the acquired image data and the parameter.   19. A medium on which the image data processing program according to any one of claims 16 to 18 is recorded, wherein the parameter represents a type or degree of image processing. Medium.   19. A medium on which the image data processing program according to claim 16 is recorded, wherein there are a plurality of parameters for each type of image processing.   An image on which the image data processing program according to claim 16 or 18 is recorded, wherein a plurality of the parameters can be stored and can be selectively executed from a plurality of parameters. A medium on which a data processing program is recorded.   In the medium on which the image data processing program according to any one of claims 16 to 18, 20 and 21 is recorded, the parameter is execution order information for performing image processing in a predetermined order. A medium on which an image data processing program is recorded.   In the medium on which the image data processing program according to any one of claims 16 to 18 is recorded, the parameters are divided into a plurality of selectable groups, and the image is based on a set of parameters according to execution conditions. A medium having recorded thereon an image data processing program for performing processing.   The medium in which the image data processing program according to any one of claims 16 to 18 is recorded, wherein the parameters are divided into a plurality of groups, and the parameter groups corresponding to the pixel conditions are selectively used. A medium on which an image data processing program is recorded.   In the medium on which the image data processing program according to any one of claims 16 to 18 is recorded, the data storage step uses a storage area that can be partitioned as a hierarchical structure, and the image data and parameters are A medium on which an image data processing program is recorded, characterized by being classified by a hierarchical structure.   19. A medium on which the image data processing program according to any one of claims 16 to 18 is recorded, wherein in the data storage step, thumbnail data of the image data is stored in association with the parameters. A medium on which a data processing program is recorded.   19. In a medium on which the image data processing program according to claim 16 is recorded, the image data is read and written on a storage device different from the parameters in the data storage step and the data acquisition step. A medium on which an image data processing program is recorded.   19. In the medium on which the image data processing program according to claim 16 is recorded, in the parameter setting step, the image data is statistically analyzed, and the image processing content is set based on the result. A medium having recorded thereon an image data processing program.   In the medium on which the image data processing program according to claim 16 or 18 is recorded, in the image processing reproduction step, an image processing program for performing the image processing represented by the parameter is selected and executed. A medium on which an image data processing program is recorded. While setting parameters representing the content of predetermined image processing to be performed on the image data, and storing the image data and the parameters together with the association information,
The image data and the parameters are acquired with reference to the association information, and the image data subjected to the specified image processing is obtained based on the acquired image data and the parameters. A featured image data processing method.   An image data processing method, wherein a parameter representing the content of predetermined image processing to be performed on image data is set, and the image data and the parameter are stored together with association information.   The parameter representing the content of the predetermined image processing to be performed on the image data and the image data are stored together with the correlation information. The image data and the parameter are acquired by referring to the correlation information, and acquired. An image data processing method characterized by obtaining image data subjected to the specified image processing based on the image data and the parameter.   31. The image data processing method according to claim 30, wherein thumbnail data of the image data is stored in association with the parameter.   33. The image data processing method according to any one of claims 30 to 32, wherein the image data is managed on a storage device different from the parameters.   The image data processing method according to any one of claims 30 to 32, wherein the image data is statistically analyzed, and the image processing content is set based on the result. Method.   33. The image data processing method according to claim 30, wherein an image processing unit that performs image processing represented by the parameter is selected and executed.

Images