JP2007189426A - Image output apparatus and image output method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow easy specification of a development condition in which finish of an interested region such as a main subject is close to the finish which a user wants. <P>SOLUTION: Cut-out data of a region containing a main subject are generated by cutting out from an image based on a raw image data. The cut-out data are applied with an image process under a plurality of different process conditions for a plurality of image process items contained in a digital development process. Thus, a plurality of reference images 50 are generated for confirming a finish when developed with changes in process conditions. The reference images 50 are arrayed in a single screen as an index image, which is printed to generate a parameter index print 16. By selecting a frame with a desired finish among a plurality of reference images 50, a parameter is specified. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image output apparatus and an image output method for outputting image data.

  Image data taken by an imaging device such as a digital still camera is converted into digital data from an analog imaging signal output from an imaging device such as a CCD image sensor or a CMOS image sensor, and stored in a storage medium. A standard format for storing the image data in the storage medium is a format (for example, EXIF format) in which image processing is performed on the imaging signal and data compression processing is performed in the JPEG format. For example, a format for storing raw image data without performing image processing (hereinafter referred to as a RAW format) is known, and a digital still camera that can store captured image data in the RAW format has become widespread. (For example, refer to Patent Document 1).

  Since the image sensor can only detect brightness, by applying R, G, and B filters to the image sensor, an image signal is extracted as color information of three colors R, G, and B. The color information of each color of R, G, B is called raw image data (hereinafter referred to as RAW data). The digital still camera incorporates an image processor that performs so-called digital development processing, which develops the RAW data by performing various image processing such as color conversion processing, white balance processing, and exposure processing. In the EXIF format, such digital development processing is performed on the RAW data and the digitally developed image data is saved. On the other hand, in the RAW format, the image data is saved as the RAW data.

  Parameters for determining processing conditions for the various image processing items are set in advance in an image processing processor built in the digital still camera. These parameters influence the finish of the image. When digital development processing is performed by the image processor, the finished image finish is directed to some extent, and image data that has been subjected to digital development processing once is processed. Even if image correction processing is performed, it is difficult to greatly change the finish. Among camera users, there are many users who want to finish an image to their liking regardless of digital development processing unique to a digital still camera, and the RAW format is supported by such users.

Patent Document 1 describes a print system that performs printing based on RAW data. In this print system, digital development processing is performed on a single frame of RAW data with a plurality of parameters that determine processing conditions for each image processing item, and a plurality of reference images with different parameters are displayed as reduced images. The user can specify desired parameters by selecting a desired reference image from a plurality of displayed reference images. Such parameter designation is performed for each image processing item so that a user-finished image can be easily obtained.
JP 2002-330388 A

  However, when a reduced image obtained by reducing the image size of a reference image corresponding to a plurality of processing conditions is collectively displayed in the RAW data, the above-described printing system is effective when the region of interest is the entire image. However, depending on the user, when the region of interest is a partial region of the image (main subject, etc.), the finished image of the region actually noticed by the user is the user's favorite finish when displaying the reduced image There is a drawback that it is difficult to confirm.

  SUMMARY OF THE INVENTION An object of the present invention is to make it easy to specify development conditions in which the degree of finish in a region of interest such as a main subject is close to the finish desired by a user when RAW data is printed.

  The image output device of the present invention is an image output device that outputs an image using image data, an image capturing unit that captures raw image data that has been captured by an imaging device and stored without being subjected to digital development processing, and the image A data generation unit that creates cut-out image data by cutting out a region of a main subject from an image based on raw image data captured by the capture unit, and the cut-out image data generated by the data generation unit Image processing is performed under a plurality of different processing conditions in which at least one of a plurality of image processing items included in the digital development processing is changed, and the reference image of the main subject obtained by performing the image processing is displayed in a plurality of screens. And an image processing means for creating an index image arranged on the screen.

  Further, the data generation means comprises: display means for displaying an image based on the raw image data; and an operation unit operated when designating the area of the main subject from the image displayed by the display means. Is characterized in that cut-out image data for an area designated by the operation unit is generated from the raw image data.

  Further, the display unit displays an index image created by the image processing unit in addition to displaying an image based on the raw image data.

  Further, the printing apparatus includes a print output unit that prints out the index image.

  Further, a designation unit for designating one target image from a plurality of reference images in the index image and a processing condition for the reference image designated by the designation unit are determined as digital development processing conditions for the raw image data. And a determining means.

  Further, as an image output method of the present invention, in an image output method for performing image output using image data, a step of capturing raw image data that has been captured by an imaging device and stored without being subjected to digital development processing; A step of creating cut-out image data by cutting out a region of a main subject from an image based on the raw image data captured by the image capture unit; and the digital image for the cut-out image data generated by the data generation unit Image processing is performed under a plurality of different processing conditions in which at least one of a plurality of image processing items included in the development processing is changed, and the reference image of the main subject obtained by performing the image processing is displayed in a plurality of one screen. Creating an arranged index image.

  According to the image output device of the present invention, in the image output device that performs image output using the image data, an image capturing unit that captures raw image data that has been captured by the imaging device and stored without being subjected to digital development processing; A data generation unit that generates cut-out image data by cutting out a region of a main subject from an image based on raw image data captured by the image capture unit, and a cut-out image data generated by the data generation unit , A plurality of reference images of the main subject obtained by performing image processing under a plurality of different processing conditions in which at least one of a plurality of image processing items included in the digital development processing is changed, and performing the image processing; Image processing means for creating an index image arranged in the screen. The when printing, because becomes easy to see the actual finish condition of the area of interest, it is easy to specify the parameters of image processing items.

  Further, the data generation means comprises: display means for displaying an image based on the raw image data; and an operation unit operated when designating the area of the main subject from the image displayed by the display means. Since the cut-out data for the area specified by the operation unit is created from the raw image data, the user can easily confirm the finish of the area of interest when the user himself / herself determines the area of interest.

  In addition to displaying an image based on the raw image data, the display unit displays an index image created by the image processing unit. Therefore, it is preferable for the user to compare reference images with different processing conditions. It becomes easy to find the finish.

  In addition, since the print output means for printing out the index image is provided, it is easy to find the finish that the user likes by comparing the reference images with different processing conditions.

  A print order accepting apparatus 10 shown in FIG. 1 accepts a print order for a frame image that is captured by a digital still camera and recorded as digital image data. The print order receiving apparatus 10 is installed, for example, in a print service store 11 that provides a photo print service, and is operated by an operator. The image data is stored in a storage medium such as a memory card 13 and is brought into the print service store 11 by the customer 12. The print order receiving apparatus 10 supports not only image data stored in the EXIF format but also print orders of RAW data stored in the RAW format.

  When the RAW data print order is received, the parameter order print 16 is created by the print order receiving apparatus 10 and provided to the customer 12. The parameter index print 16 creates an index image in which a plurality of reference images developed with a plurality of different parameters are arranged on one screen so that the customer 12 can easily specify digital development processing parameters to be applied to the RAW data. These are printed on recording paper, and are also called round prints. Each reference image is developed by changing parameters, and the customer 12 can find a desired finish through these reference images. Then, the parameter is designated by selecting a desired reference image. One frame obtained by developing the RAW data with the specified parameters is printed on the photographic paper and provided to the customer 12 as the main print 17.

  The print order receiving apparatus 10 includes a system controller 21, a card reader 22, an image processing unit 23, a data storage device 24, a network interface 26, a console 27, a recording media drive 32, and a photo printer 33. The console 27 includes a display 28 and an operation unit 29. The system controller 21 includes a CPU, a ROM, a RAM, and the like, and comprehensively controls each unit of the print order receiving apparatus 10 based on an instruction from the operation unit 29.

  The operation unit 29 is an input device that includes a mouse, a keyboard, and the like and inputs operation commands to the system controller 21. Further, the operation unit 29 is operated when manually selecting a region to be noted in image processing from the basic image displayed on the display. On the other hand, the display 28 displays an operation screen and a captured image. In addition, you may use the touchscreen type display which combines an operation part and a display. The card reader 22 accesses the memory card 13 and reads image data stored in the EXIF format or the RAW format.

  The image processing unit 23 creates a parameter index image based on the read RAW data. The image processing unit 23 includes a format conversion unit 35, a subject detection unit 36, an image cutout unit 37, a development condition setting unit 38, a digital development processing unit 39, and an index image creation unit 40. The RAW format has different file formats because the file format is not uniform among camera manufacturers as in the EXIF format. The format conversion unit 35 converts these various file formats into predetermined file formats, and delivers the converted RAW data to the digital development processing unit 35. Thus, by providing the format conversion unit 35, for example, when an existing file format is changed or a new file format is added, the digital development processing unit 23b can be flexibly handled without changing. Is possible.

  The subject detection unit 36 is provided to automatically detect a main subject from a basic image obtained by digitally developing RAW data based on a shooting condition attached to the RAW data. An example of a method for detecting the main subject is face detection. Since this face detection is well known, the details thereof are not described here. For example, the above-described basic image is compared with a face pattern image prepared in advance, and an area similar to the face pattern image is basically set. Detect from image. Whether or not it is similar to the face pattern image is determined based on the feature information of the image such as density data, and area information of a rectangular area including a part similar to the face pattern image is detected as a main subject. In addition to this, the face image is detected by an appropriate method such as dividing the basic image into a plurality of areas, and detecting an area including many skin-colored pixels as a face area from each of the divided areas. A rectangular area including the area can be detected as the area of the main subject.

  The image cutout unit 37 performs automatic detection of the main subject in the subject detection unit 36, or refers to the region information obtained by designating the region to be the main subject by using the operation unit 29, Data corresponding to the area information is cut out from the RAW data, and the cut out data (hereinafter, cut out data) is stored in the image data storage area 43 of the data storage drive 24.

  The development condition setting unit 38 is provided for setting processing conditions in digital development processing. The digital development processing includes processing such as white balance (hereinafter referred to as WB) adjustment, exposure adjustment, and tint adjustment, and the development condition setting unit 38 sets parameters for these image processing items. These parameters are stored in the parameter storage area 42 of the data storage device 24, and these parameters are appropriately read out by the system controller 21. The digital development processing unit 39 executes digital development processing of RAW data or cut-out data based on the processing conditions set by the development processing setting unit 38.

  For example, in the case of generating a basic image that is a basis for cutting out a main subject, digital development processing for RAW data is performed under development processing conditions based on incidental information attached to the RAW data. Since the RAW data includes the shooting conditions at the time of shooting as incidental information, the processing conditions based on the incidental information are set by the development condition setting unit 38, and the digital development processing for the RAW data is executed. The Note that image data (hereinafter referred to as basic image data) subjected to image processing by this digital development processing is stored in the image data storage area 43 of the data storage device 24.

  Further, when the cutout data is generated by the image cutout unit 37, the development condition setting unit 38 uses a plurality of image processing items that are changed in stages based on the shooting conditions at the time of shooting. A processing condition is set as a processing condition for cut-out data. Then, digital development processing based on the plurality of processing conditions is performed on the cut out data. Hereinafter, the cut-out data that has been subjected to the digital development processing is referred to as attention image data. This attention image data is stored in the image data storage area 43 of the data storage device 24. Further, when a parameter preferred by the customer is specified from the parameter index print 16, the specified parameter is set as a processing condition, and digital development processing based on the processing condition is performed on the RAW data.

  The index image creation unit 40 performs resize processing on a target image based on a plurality of target image data, reduces the image size, and arranges the plurality of reduced target images on one screen to generate a parameter index image. . As a result, a plurality of images of interest are arranged on the parameter index print 16 as the reference image 50 (see FIG. 2).

  The data storage device 24 is, for example, a hard disk drive, stores an operating system and various programs, and is used to store image data captured by the card reader 22. Further, the data storage device 24 is set with a parameter storage area 42 for storing the parameter data referred to by the image processing unit 23 and an image data storage area 43 for storing a reference image before the resizing process is executed. Yes.

  The network interface 26 is a communication interface for connecting to the photographic printer 33 that creates the main print 17 so that data communication is possible, and the index image data and finally selected parameters are used via the network interface 26. Thus, the image data subjected to the digital development processing is transferred.

  The recording media drive 32 accesses a data recording medium such as a CD (compact disc) and writes image data. The print service store 11 provides a service for writing image data to a recording medium in addition to the print service. The recordable media drive 32 is used to perform such a service. The recordable media drive 32 writes designated image data on the record medium to create a so-called photo CD.

  The photographic printer 33 forms a latent image by irradiating a photographic paper with laser light based on image data designated for printing, and then performs development processing to output a high-definition photographic print. The photo printer 33 is transferred with the index image data generated by the image processing unit 23 and the image data digitally developed using the finally selected parameters, and the transferred image data is used. A parameter index print 16 and a main print 17 are created. It should be noted that the parameter index print 16 and the main print 17 are created by the photographic printer 33, so that the difference in color density between the image of the parameter index print 17 and the image of the main print 17 can be eliminated. The difference in color density between the image selected on the print 16 and the image on the main print 17 can be eliminated. In this embodiment, the parameter index print and the main print are created in the photo printer. For example, an index printer is provided separately from the photo printer, and the index printer has the same color density as the photo printer. After performing color matching processing and color mapping processing so that is printed, a parameter index print may be created.

  Further, as the image data transferred to the photographic printer 33, the digitally developed image data generated when the parameter index image is generated and stored in the image data storage area 37 is used. There is no need for development processing, and the processing time required to create the actual print 17 is shortened. Further, if the digitally developed image data is stored for a predetermined period and used when a reprint order is made, the reprint process can be performed quickly.

  FIG. 2 shows an example of the parameter index print 16. The parameter index print 16 is an array of a plurality of reference images 50 in which parameters in exposure adjustment are changed among image processing items when performing digital development processing. The plurality of reference images 50 are arranged in, for example, a matrix of 2 rows and 3 columns, and for example, a value set at the time of photographing is set as a reference, that is, 0 EV, and a plurality of reference images 50 are changed by ½ EV between −1 EV and +3/2 EV. The reference images developed under the processing conditions are arranged. By changing the parameters in this exposure adjustment, it is possible to list the degree of image finish.

  The parameter is specified by selecting a reference image 50 preferred by the customer 12 from the parameter index print 16 and informing the operator of this. For example, the same image as the index image of the parameter index print 16 is displayed on the display 28 of the console 27. The operator confirms the reference image 50 designated by the customer 12 on the screen of the display 28 and designates the corresponding reference image 50, thereby inputting the designated parameter to the print order receiving apparatus 10. In the present embodiment, the interval for changing the parameter of exposure adjustment is 1/2 EV. However, the interval can be appropriately changed by changing it by 1/3 EV. In the present embodiment, the case where the exposure adjustment parameter is changed among the image processing items is described. However, the present invention is not limited to this. It is also possible to change in stages. Further, the interval and type for changing the parameters described above may be set in advance, or may be set or changed from the console 27.

  The operation of the above configuration will be described below with reference to the flowchart of FIG. When the RAW data print order is received, the operator sets the memory card 13 brought in by the customer 12 in the card reader 22, reads out the RAW data, and loads it into the print order receiving apparatus 10. The print order receiving apparatus 10 performs digital development processing on the RAW data based on the image processing condition based on the additional information attached to the RAW data, and generates basic image data. When the basic image data is generated, a basic image using the basic image data is displayed on the display 28, and then the attention image creation process is executed.

  For example, when an attention image is automatically created, the main subject detection unit 36 detects a range that is a main subject of the basic image. For example, in the case of a basic image in which a person is a subject image, for example, a face image region is detected as a main subject. Based on the detected range, the image cutout unit 37 cuts out data in the corresponding range from the RAW data, and saves the cut out data in the image data storage area 43 of the data storage device 24 as cutout data. On the other hand, when the attention image is created by manually specifying the main subject from the basic image, the area of the main subject is specified from the basic image displayed on the display 28 using the operation unit 29. The image cutout unit 37 cuts out data corresponding to the range of the main subject area designated using the operation unit 28 from the RAW data, and saves the cutout data as cutout data in the image storage device 24. Save in area 43.

  When the cut out data is created, a plurality of processing conditions for the cut out data are set by the development condition setting unit 38. The digital development processing unit 39 performs digital development processing on the cut-out data, and generates a plurality of target image data having different processing conditions. Thereafter, a resize process is performed on the target image based on the target image data, and then a parameter index image is created. The index image data based on the parameter index image is transferred to the photographic printer 33 and printed out as the parameter index print 16. At the same time, a parameter index image is displayed on the display 28.

  This parameter index print 16 is provided to the customer 12. While looking at the parameter index print 16, the customer 12 selects a reference image 50 having a desired finish, selects it, and designates the parameter. If there is no reference image 50 of the desired finish, the parameter is changed and the parameter index print 16 is created again and provided to the customer 12. Such a process is repeated until a reference image 50 having a desired finish is found. When parameters are designated in this way, digital development processing is performed on RAW data using the designated parameters. The image data that has been subjected to the digital development processing is transferred to the photographic printer 33, and the main print 17 is printed out. The printed print 17 is provided to the customer 12.

  In the present embodiment, after the main subject area for the basic image is automatically detected or manually specified, the data for the area is cut out from the RAW data, and the digital development processing is performed on the cut out data under a plurality of processing conditions. However, the present invention is not limited to this. For example, after digital development processing is performed on RAW data under a plurality of processing conditions, an area including the main subject is cut out to create an index image. Is also possible. In this case, for example, the same area as the area automatically detected from the basic image or manually designated is cut out from a plurality of images digitally developed under different processing conditions, and the cut out images are used. Further, the image data digitally developed under a plurality of different processing conditions is stored in the image data storage area of the data storage device, and when the parameter desired by the customer is specified from the parameter index print, the selected parameter is Since it is not necessary to newly execute the used digital development processing, it is possible to shorten the processing time required for creating the actual print.

  In the present embodiment, the case of a basic image in which a person is a main subject has been described. However, for example, the main subject in the basic image may be composed of animals or landmarks. In this case, sample images such as animals and landmarks are prepared in advance, and a region to be noticed can be detected depending on whether or not the sample images fit. Further, instead of detecting the main subject, it is possible to automatically detect a region of interest from the basic image. In this case, the basic image is divided into a plurality of areas, and a notable area is detected from the ratio of colors included in the divided areas.

  In the above example, the print order receiving apparatus installed in a print service store or the like has been described as an example. However, like the print order receiving server 71 shown in FIG. The print order from a customer's PC (personal computer) 73 may be received. In this case, a print order reception site is established on the web of the Internet 72, and the customer's PC 73 accesses the print order reception site to place a print order. The print 17 created by performing image processing with the specified parameters is provided to the customer at a later date.

  In the above example, a print order receiving apparatus having an index image creating function for creating a parameter index image has been described as an example. However, the present invention may be applied to an apparatus dedicated to creating an index image that does not have a print order receiving function. Good. The scope of the present invention naturally includes a case where an index image creating function for creating a parameter index image and a print order receiving function using the parameter image are realized in the form of a program for causing a computer to execute the function.

It is a block diagram of a print order reception apparatus. It is explanatory drawing of parameter index printing. It is a flowchart which shows a print order reception procedure. It is explanatory drawing of the print order reception via a network.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Print order reception apparatus 11 Print service store 12 Customer 13 Memory card 16 Parameter index print 23 Image processing part 24 Data storage device 27 Console 28 Display 29 Operation part 33 Photo printer 35 Format conversion part 36 Attention image detection part 37 Image clipping part 38 Development condition setting section 39 Digital development processing section 40 Index image creation section 50 Reference image

Claims (6)

In an image output device that performs image output using image data,
Image capturing means for capturing raw image data captured without being subjected to digital development processing and photographed by an imaging device;
Data generating means for creating cut-out image data by cutting out a region of a main subject from an image based on raw image data captured by the image capturing means;
The cut-out image data generated by the data generation means is subjected to image processing under a plurality of different processing conditions in which at least one of a plurality of image processing items included in the digital development processing is changed, and image processing is performed. An image output device comprising: an image processing unit that creates an index image in which a plurality of reference images of the main subject obtained by applying the reference image are arranged in one screen.   A display unit that displays an image based on the raw image data; and an operation unit that is operated when designating a region of the main subject from the image displayed by the display unit. The image output apparatus according to claim 1, wherein cut-out image data for an area designated by the operation unit is generated from the raw image data.   3. The image output apparatus according to claim 2, wherein the display unit displays an index image created by the image processing unit in addition to displaying an image based on the raw image data.   The image output apparatus according to claim 1, further comprising a print output unit that prints out the index image. Designation means for designating one reference image from a plurality of reference images in the index image;
5. The image output according to claim 1, further comprising: a determining unit that determines a processing condition of the reference image specified by the specifying unit as a digital development processing condition of the raw image data. apparatus. In an image output method for outputting an image using image data,
Capturing raw image data captured by an imaging device and stored without being subjected to digital development processing;
Creating cut-out image data by cutting out a region of a main subject from an image based on raw image data captured by the image capturing means;
The cut-out image data generated by the data generation means is subjected to image processing under a plurality of different processing conditions in which at least one of a plurality of image processing items included in the digital development processing is changed, and image processing is performed. Creating an index image in which a plurality of reference images of the main subject obtained by applying are arranged in one screen.

Images