JP2007129442A - Image processor and image processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor in which image information can be searched and selected more easily by selecting image information according to a user's purpose through analysis of photography information or image information in case of direct print, and making its index data. <P>SOLUTION: As opposed to regular index print where all thumbnail images are printed for an image file in an imaging apparatus, image conditions for index print are selected among photography conditions. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and an image processing system when index printing is performed on image information captured by an image capturing apparatus capable of storing image capturing information at the time of capturing in association with image information.

  In recent years, with the widespread use of digital cameras and mobile terminals with an imaging function, it has become possible to easily acquire digitized image information. In addition, there are increasing opportunities to print these captured image information using a printing apparatus. Conventionally, when printing image information, image information taken with a digital camera or the like is transferred to a personal computer (hereinafter simply referred to as “PC” or “computer”), and image processing is performed using a dedicated application on the PC. The printing process is performed by creating print data by transferring the created print data to the printing apparatus. On the other hand, recently, direct printing in which image information is directly printed by directly connecting an imaging device and a printing device has been actively performed.

  In this case, image information in the imaging device is arbitrarily selected using a display device or the like in the imaging device, the selected image information is transferred to the printing device, and print processing is performed by performing image processing in the printing device. It was generated and printed. However, in conventional direct printing, when selecting an image for printing, the display device in the imaging device is often poor in display function, and it is difficult to select a necessary image from a large number of images at once. It was.

  Furthermore, direct printing is also performed in which a storage medium holding image information is inserted into the printing device and the image read by the printing device is printed. In this case, in order to confirm which image information is selected. In some cases, the display function was not provided.

  Therefore, in the conventional direct print, in order to check the image information in the imaging device or the storage medium, individual thumbnail information is created for all the image information stored once, and index data is created based on the thumbnail information. The user selects the image information by creating and outputting the index data on paper.

  Note that when image information is stored in a predetermined storage medium with a digital camera or the like, in recent years, various shooting information related to the image information can be stored in association with the image information separately from the image information. An example of such a technique is Exif (EXchangeable Image File format). Exif is a file format that includes shooting information along with captured image information, and is used in digital cameras around the world in combination with the file system standard DCF (Design rule for Camera File system). Yes.

Therefore, it has also been proposed to generate index data by acquiring shooting information from Exif or the like and laying out shooting date / time and image information update date / time together with image information at the time of index printing for confirming image information in the imaging apparatus . (See Patent Document 1)
Japanese Patent Registration No. 3045154 JP 2004-254100 A

  However, the conventional index print creates and prints index data for all image information stored in the imaging device or storage medium, so if there is a large number of stored image information, the index data It took a lot of time to create and print. Also, since a large amount of image information is printed when printing is performed, the recording agent and paper are wasted.

  On the other hand, Patent Document 2 has an album registration function as a function of the digital camera, and only those registered in the album can perform index printing. As a result, when index printing is performed, only what is registered in advance by the user is printed, so that the above-described problem can be avoided. However, the album registration must be performed individually for the image information in the imaging apparatus by the user, and cannot be used for selecting image information in the imaging apparatus in accordance with various purposes.

  The present invention has been made in view of the above-described problems. In direct printing, image information corresponding to a user's purpose is selected by analyzing shooting information and image information, and index data is created. It is an object of the present invention to provide an image processing apparatus that can more easily search and select image information.

  In order to achieve the above object, an image processing apparatus according to the present invention mainly includes the following configuration.

That is, an image processing apparatus capable of index printing that creates thumbnail data of a plurality of photographed image information and prints a list of thumbnail data, the photographed image information, and photographing information related to the image information An input means for inputting an image file having
Shooting information acquisition means for detecting a feature relating to the shooting status of the image information from shooting information included in the image file;
Condition input means for acquiring a condition for specifying the image information from the feature value based on the photographing information, and a specific image file is selected from the input image file according to the condition input from the condition input means Image selection means;
Image processing means for creating index data of a plurality of pieces of image information selected by the image selection means;
Output means for outputting the index data.

  Further, the feature relating to the photographing situation detected by the photographing information acquisition means is a set value set in advance as a photographing method suitable for the subject to be photographed.

  In addition, as a feature relating to the shooting state detected by the shooting information acquisition means, the shooting target includes a whiteboard.

  Further, the image processing means changes a set value at the time of image processing according to the condition input by the condition input means.

An image processing apparatus capable of index printing that creates thumbnail data of a plurality of photographed image information and prints a list of thumbnail data, the photographed image information, and photographing information related to the image information. Input means for inputting an image file having;
Image feature acquisition means for detecting an image feature from image information included in the image file;
Condition input means for acquiring a condition for specifying the image information from a feature value based on the image feature, and a specific image file is selected from the input image file according to the condition input from the condition input means Image selection means;
Image processing means for creating index data of a plurality of pieces of image information selected by the image selection means;
Output means for outputting the index data.

  The image feature detected from the image information is a human face feature, and the condition input by the condition input means is a person image.

  According to the present invention, at the time of direct printing, image information corresponding to the user's purpose is selected by analyzing shooting information and image information, and by creating index data thereof, it is possible to more easily search for image information, Selection becomes possible.

  Embodiments according to the present invention will be described below with reference to the drawings.

  As an embodiment of the present invention, a case where the present invention is applied to a multifunction printer (MFP) will be described below. However, the present invention is not limited to this, and an arbitrary inkjet printer can be used without departing from the gist thereof. And other types of image processing apparatuses such as a laser beam printer (LBP).

  FIG. 1 is a system block diagram showing a basic configuration of an MFP which is an image processing apparatus according to the first embodiment of the present invention. The MFP according to the first embodiment of the present invention includes a CPU 101, a ROM 102, a RAM 103, an external storage device 104, a display unit 105, an operation unit 106, an engine interface 107, a network interface 108, an external interface 109, and a system bus 110. Yes.

  In detail, the CPU 101 is a central processing unit that controls the entire apparatus, performs arithmetic processing, and the like, and executes each process described below based on a program stored in the ROM 102. The ROM 102 is a read-only memory, and is a storage area for a system activation program, a program for controlling the printer engine, character data, character code information, and the like. The RAM 103 is a random access memory, and is a data storage area with no usage restrictions. In the RAM 103, font data additionally registered by downloading is stored, and programs and data are loaded and executed for various processes. The RAM 103 can also be used as a data storage area for received image files. The external storage device 104 is composed of, for example, a hard disk or the like, and spools data, stores programs, information files, image data, and the like, and is used as a work area. The display unit 105 performs display using, for example, a liquid crystal display, and is used to display the setting state of the apparatus, the current internal processing of the apparatus, and an error state. The operation unit 106 is used to change or reset the settings, and can be operated from the UI screen displayed on the display unit 105 when inputting conditions for narrowing the image as described later. To do. The engine interface 107 is a part that exchanges commands and the like that actually control the printer engine. The network interface 108 is for connecting the apparatus to a network via the network interface 108. The external interface 109 is connected to a digital camera, which is an imaging device, via an interface such as a parallel (or serial) interface, or connected to a reader for reading image data from a storage medium. The system bus 210 should be a data path between the above-described components.

  FIG. 2 is a block diagram showing a schematic configuration of MFP controller software according to the first embodiment of the present invention.

  In the figure, 201 is an image file input unit, and an image file comprising image information to be printed and shooting information associated with the image information is input through the external interface 109 and held in the RAM 103.

  Here, the input method of the image file is assumed to be a method of sending from an imaging device such as a digital camera connected to the image processing device according to the present invention, but the shooting information is associated with the image information. As long as it is an image file, the transmission source of the image file is not particularly limited to the imaging device, and even a method of transmitting through a PC, a method of storing an image file on a storage medium, and inputting from the storage medium The gist of the present invention is not limited.

  FIG. 3 is a diagram illustrating an example of an image file input to the image file input unit 201. As illustrated in FIG. The image file 301 input to the image file input unit includes captured image information 302 and shooting information 303 indicating shooting conditions when shooting the image information. Here, the image information 302 is composed of high-resolution image data, and in many cases is composed of image data compressed in the JPEG format. In the image information 302, for example, image data obtained by photographing a building or a landscape is stored. The shooting information 303 is shooting information when the image information is shot. Information such as the shooting date and time 304, the type of the image pickup device 305, the aperture value 306 at the time of shooting, the shutter speed 307, and the like is held, and the setting of the shooting mode 308 Is included.

  Reference numeral 202 in the figure denotes a shooting information acquisition unit that acquires shooting information from the image file input by the image file input unit 201.

  On the other hand, reference numeral 203 in the figure denotes an image condition input unit, which inputs conditions for selecting image information for which index data is to be created among image information included in the imaging apparatus. As a method for inputting the selection condition, there is a method of using the display function provided in the image pickup apparatus or using the display device 105 in the image processing apparatus or the like using the GUI.

  FIG. 4 shows an input method example of the image condition input unit. In FIG. 4, a case is considered in which a shooting mode function provided in a digital camera is used when narrowing down the conditions of images to be index printed. The shooting mode is a mode in which a user selects a shooting method suitable for a shooting target when shooting with a digital camera. For example, in the case of a Canon digital camera, auto mode, landscape mode, portrait mode, night view mode, etc. There are shooting modes. These shooting mode settings are included as shooting information in the image file, and information included in such shooting information is input as options in the image condition input unit. In other words, shooting information such as the shooting date and time, the type of lens used for shooting, shutter speed priority, etc. can be selected as conditions, and if the shooting mode is selected here, each setting in the shooting mode must be entered as a condition. Is possible.

  In the figure, reference numeral 204 denotes an image information selection unit, which compares the image information input by the image information input unit 203 with the image information 303 acquired by the image information acquisition unit 202 for the image file input from the image file input unit. By doing this, image information is selected only for the input image file that satisfies the conditions.

  For example, when “night scene mode” is selected as the image selection condition, only those whose “shooting mode” of the shooting information is “night scene” are extracted. An image taken in the night view mode in the image pickup apparatus, that is, in many cases, a night view is taken, and as a result, an image taken with a night view is selected.

  In the previous image condition input unit, only the shooting mode can be selected as a selection condition. However, it is possible to set a plurality of conditions as long as the information is included in the shooting information. For example, “night view mode” and “date and time” Condition setting such as “designation” is also possible.

  In the figure, reference numeral 205 denotes an image processing unit, which generates a thumbnail image by performing resolution conversion on an image selected according to an input image condition, performs layout processing for arranging a plurality of thumbnail images, and then performs color correction processing. Then, print data that can be transferred to the image output unit 206 is created by performing color conversion processing and pseudo intermediate processing.

  In index printing, there are cases in which shooting information is printed together with image information. In this case, print data is created by converting shooting information such as a file name and shooting date / time into image information and combining it with image information shot during layout processing.

  FIG. 5 is a block diagram showing a detailed configuration of the image processing unit.

  In the figure, reference numeral 501 denotes a resolution conversion unit, which creates a thumbnail image of image information by performing resolution conversion processing on the image information in the input image file. On the other hand, when performing index printing, when shooting information such as a file name and shooting date / time is printed, the shooting information is converted into image information by the image conversion unit 502. The shooting information converted into the thumbnail image and the image data is subjected to layout processing according to the arrangement at the time of printing on the paper by the image composition unit 503.

  The image data laid out in this way is subjected to image processing in a color correction processing unit 504, a color conversion processing unit 505, and a pseudo halftone processing unit 506 to generate print data. In other words, if the input image information is general RGB multi-tone image data, and the print data to be output is CMYK low-tone image data that matches the color material of the printing device, first the color The correction processing unit 504 performs RGB → R′G′B ′ conversion so as to obtain RGB data suitable for the printing apparatus. Next, the color conversion processing unit 505 converts the RGB space to the CMYK space, and the pseudo halftone processing unit 506 converts the multi-gradation image data to low gradation data.

  In the color correction processing unit 504, the color conversion processing unit 505, and the pseudo halftone 506, parameters are set so that optimum printing is possible according to the image condition selected by the image condition input unit 203. That is, the parameters used in each processing unit are set in the parameter setting unit 507 according to the conditions selected by the image condition input unit. For example, when the night view mode is selected, since the brightness is generally dark as a whole, there is a possibility that a process for increasing the brightness may be entered. On the other hand, such processing tends not to be preferred for an image of a night view because the atmosphere at the time of shooting changes. Accordingly, the parameter setting unit 507 sets parameters so that the output result is optimized based on the shooting information such as the night view mode.

  In addition, when a shooting mode such as “Whiteboard mode” is selected as the image condition, the image processing unit applies geometric conversion processing to correct tilt and distortion and color conversion processing to skip the background. It is possible to do.

  In the figure, 206 is an image output unit, and by receiving the print data created by the image processing unit 205, it becomes possible to print the index data for the image information selected under the image condition on the paper.

  FIG. 6 shows a flowchart for executing index printing according to the first embodiment of the present invention.

  First, in step S601, an image file in the imaging apparatus is captured. Here, it is assumed that all image files have the data structure shown in FIG. The captured image file is stored on the RAM 103 in FIG. Next, when starting index printing, it is determined in S602 whether or not an image included in the index print is selected under some condition. In this embodiment, the determination material used in this step is a set value for the image condition input by the user through the UI shown in FIG. This UI may appear interactively when index print execution is selected, or may always hold a set value as one of the print environment setting items regardless of the index print execution timing. In any case, this set value is designated by the user. If the image condition is not input or is not valid (No), the image selection is not performed and all images are to be subjected to index printing, so the process proceeds to S607 and resolution conversion processing is performed on all images. Image processing necessary for index printing, such as layout processing, color correction processing, color conversion processing, and pseudo halftone processing, is performed to create index data. The index print is executed by outputting the index data in S608.

  On the other hand, if it is determined in S602 that image conditions are set for the index print, in S603, if setting information is acquired via the operation unit 106 in FIG. 1 or is set from the UI on the host, The setting value of the image condition is acquired as print environment information via the external I / F 109.

  If a plurality of image conditions can be selected, the process is repeatedly executed between S604 and S602 until all the input image conditions are acquired.

  For example, when “type of image pickup device” is selected as the image condition, the image selection condition at the time of index printing is set to “image pickup device”. Using this selection condition, in S605, look at the value of “Imager type” 305 included in the shooting information 303 (FIG. 3) of all the image files captured in S601, and save the file for each imager of the same type. Categorize. At this time, it is possible to use a means such as generating a file ID list, having one file ID list for one imaging device, and adding the ID of the input image file from the same imaging device to the corresponding ID list. Is possible.

  Next, when selecting image information in S607, if a specific image pickup device is selected in the image condition input, specify the file ID list in which the file corresponding to the image pickup device obtained from this condition information is listed. Only the image information of the image files in the list is processed as index print data in S607 and S608. When a specific image pickup device is not selected, index data is output in the order of the file ID list created for each image pickup device. In this case, an index print is created for each imaging device.

  In addition to this, all the data included as shooting information can be used for the image condition, and a UI that allows the user to arbitrarily set the image condition can also be used.

  As described above, normal index printing prints all thumbnail images for image files in the image capture device, but by selecting the image conditions for index printing from the shooting conditions, it matches the purpose. Index printing is possible, and image information can be searched and selected more easily.

  In the first embodiment of the present invention, the input image file is temporarily stored on the RAM 103, and shooting data is acquired and compared with image conditions to create index data.

  On the other hand, in recent image processing apparatuses, there are cases where a storage device having a large capacity is held and image files can be stored in the storage device. In Embodiment 2 of the present invention, when direct printing is performed, the data is once stored in the storage device in the image device, and at the same time, a database relating to shooting information is created, thereby changing the image conditions when performing index printing. In this case, a description will be given of an index data that can be created at high speed without re-analyzing photographing information.

  FIG. 7 is a flowchart when index printing is executed according to the second embodiment of the present invention.

  First, in step S701, all image files in the imaging device are captured, and the image files are stored in the external storage device 104 in the image device. Next, in S702, index information is created according to the image information of the captured image file by analyzing the image information, and a database for the image file in the external storage device 104 is generated. That is, when there is “shooting date / time”, “type of imaging device”, “shooting mode”, etc. as shooting information, the image file is categorized for each piece of information. At this time, it is possible to use means such as creating a file ID list for each piece of information.

  In S703, it is determined whether or not to select an image included in the index print under some conditions when performing index printing. If the image conditions are not entered or not valid (No), the image selection is not performed and all images are subject to index printing, so the process proceeds to S708, and resolution conversion processing is performed on all images. Image processing necessary for index printing, such as layout processing, color correction processing, color conversion processing, and pseudo halftone processing, is performed to create index data. The index print is executed by outputting the index data in S709.

  On the other hand, if it is determined in S703 that image conditions have been set for the index print, if setting information is acquired via the operation unit 106 in FIG. 1 or is set from the UI on the host in S704 The setting value of the image condition is acquired as print environment information via the external I / F 109.

  If a plurality of image conditions can be selected, the process is repeatedly executed between S705 and S703 until all the input image conditions are acquired.

  Next, when selecting image information in S707, the condition information input in the image condition input is compared with the file ID list that is the index information of the database, and only the image information of the image files in the list that matches the condition information is indexed. An image file is selected as print data.

  After performing composition processing on image data to be index printed in S708, print data is created by performing image processing, and index printing is completed by performing output processing in S709.

  In the second embodiment of the present invention, a database is constructed for the image file in the image pickup apparatus that has been once connected to the image processing apparatus, so even if the conditions for index printing are changed, the database can be operated at high speed. An image can be selected.

  As described above, normal index printing prints all thumbnail images for image files in the image capture device, but by selecting the image conditions for index printing from the shooting conditions, it matches the purpose. Index printing is possible, and image information can be searched and selected more easily.

  In the first and second embodiments, image conditions for performing index printing based on information at the time of shooting associated with image information represented by Exif have been shown. On the other hand, it is also possible to analyze image information that is not included in the shooting information and to narrow down the shooting object based on the characteristics of the image information. The third embodiment of the present invention is characterized in that the conditions for index printing of images can be further narrowed down by analyzing image information and extracting feature values from the image information.

  In the third embodiment, when an image condition based on analysis of image information is input for the input image file, the image information selection unit performs image analysis. For example, when “portrait photograph” or the like is given as an image condition, a human face extraction process is performed in the image information selection unit. A known technique may be used for the face extraction processing method. As a result of image analysis, when a human face is extracted, the image information is selected.

  FIG. 8 is a flowchart when index printing is executed according to the third embodiment of the present invention.

  First, in step S801, all image files in the imaging apparatus are captured and stored in the RAM 1103 in the image apparatus. Next, when performing index printing in S802, it is determined whether or not to select an image included in the index print under some condition. If the image condition is not input or is not valid (No), the image selection is not performed and all images are subject to index printing, so the process proceeds to S809 and resolution conversion processing is performed on all images. Image processing necessary for index printing, such as layout processing, color correction processing, color conversion processing, and pseudo halftone processing, is performed to create index data. The index print is executed by outputting the index data in S810.

  On the other hand, if it is determined in S802 that image conditions have been set for the index print, in S803, if setting information is acquired via the operation unit 106 in FIG. 1 or is set from the UI on the host The setting value of the image condition is acquired as print environment information via the external I / F 109.

  Here, it is determined whether or not the image condition input in S804 is a condition based on the shooting information. When the input condition is information based on shooting information, that is, information held in shooting information such as a shooting device and a shooting mode (S804 / Yes), shooting information is analyzed and image files are categorized for each information. (S805). If the input condition is not information based on the shooting information, that is, if it is information related to the characteristics of image information such as a person image (No in S804), image analysis is performed (S806). The image analysis here is to extract image features such as person image extraction.

  If a plurality of image conditions can be selected, the process is repeatedly executed between S807 and S802 until all the input image conditions are acquired.

  An image file to be index printed is selected by comparing all conditions with feature extraction from the shooting information / image information (S808). After performing composition processing on the image data to be index printed in S809, print data is created by performing image processing, and index printing is completed by performing output processing in S810.

  In the third embodiment of the present invention, it is possible to select image information selection conditions by analyzing image information other than information associated with image information as shooting information. It becomes possible.

  As described above, normal index printing prints all thumbnail images for image files in the image capture device, while selecting the image conditions at the time of index printing from the shooting conditions and image features. Therefore, it is possible to perform index printing according to the above, and to search and select image information more easily.

1 is a system block diagram illustrating a basic configuration of an MFP that is an image processing apparatus according to an embodiment of the present invention. It is a block diagram which shows schematic structure of the controller software of MFP which concerns on the Example of this invention. It is a figure which shows an example of the image file input into the image processing apparatus which concerns on the Example of this invention. It is the figure which showed the example of the input method of the image condition input part which concerns on the Example of this invention. It is the block diagram which showed the detailed structure of the image process part which concerns on the Example of this invention. 6 is a flowchart when index printing is executed according to Embodiment 1 of the present invention. 10 is a flowchart when index printing is executed according to Embodiment 2 of the present invention. 10 is a flowchart when index printing is executed according to Embodiment 3 of the present invention.

Claims (6)

An image processing apparatus capable of index printing that creates thumbnail data of a plurality of photographed image information and prints a list of thumbnail data. The photographed image information and photographing information related to the image information Input means for inputting an image file having;
Shooting information acquisition means for detecting a feature relating to the shooting status of the image information from shooting information included in the image file;
Condition input means for acquiring a condition for specifying the image information from the feature value based on the photographing information, and a specific image file is selected from the input image file according to the condition input from the condition input means Image selection means;
Image processing means for creating index data of a plurality of pieces of image information selected by the image selection means;
An image processing apparatus comprising: output means for outputting the index data.   The image processing apparatus according to claim 1, wherein the feature relating to the shooting situation detected by the shooting information acquisition unit is a preset value set as a shooting method suitable for a shooting target.   The image processing apparatus according to claim 1, wherein the shooting target is a whiteboard as a feature related to a shooting situation detected by the shooting information acquisition unit.   The image processing apparatus according to claim 1, wherein the image processing unit changes a setting value at the time of image processing according to a condition input by the condition input unit. An image processing apparatus capable of index printing that creates thumbnail data of a plurality of photographed image information and prints a list of thumbnail data, the photographed image information, and photographing information related to the image information. Input means for inputting an image file having;
Image feature acquisition means for detecting an image feature from image information included in the image file;
Condition input means for acquiring a condition for specifying the image information from a feature value based on the image feature, and a specific image file is selected from the input image file according to the condition input from the condition input means Image selection means;
Image processing means for creating index data of a plurality of pieces of image information selected by the image selection means;
An image processing apparatus comprising: output means for outputting the index data.   6. The image processing apparatus according to claim 5, wherein the image feature detected from the image information is a human face feature, and the condition input by the condition input unit is a person image.

Images