JP5109182B2 - Image processing system and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, an image management apparatus, an image management method, a program, and an image order form. In particular, the present invention relates to an image processing apparatus and an image processing method for processing an image, an image management apparatus and an image management method for managing an image, a program for the image processing apparatus and the image management apparatus, and an orderer to order an image. Regarding the image order form.

In a print order receiving apparatus capable of reading customer image data and inputting information for creating a print based on the image data, the image based on the image data is displayed on the display frame unit, and the display frame unit A frame indicating which part of the image displayed on the display frame part corresponds to the part of the image displayed on the display frame part. A print order receiving apparatus that displays on a display frame unit is known (for example, see Patent Document 1). Further, a phase mask that makes the optical transfer function essentially constant within a certain range from the focal position is known (for example, see Patent Document 2).
JP 2001-215626 A US Pat. No. 5,748,371

  When a customer places an order for printing an image, it is desirable that the customer can determine whether the image can be printed neatly before ordering. For example, images with red eyes or images with poor contrast are not suitable for printing. However, index prints that select images to be printed from many thumbnail images are not suitable for printing with small index images. In some cases, it is difficult for the customer to easily determine whether or not the presence or absence of contrast is properly expressed. Thus, it is desirable that at least the main region of the image has high image quality. Further, according to the technique described in Patent Document 2, a blurred image is obtained by taking a picture using a phase mask to increase the depth of focus, and an image that is in focus over a wide range is obtained by restoring the blur. Can do. However, since the restoration process requires a strong calculation power and takes time, it is not practical to perform the restoration process in each imaging device. If restoration processing is performed, artifacts are likely to occur, and it is necessary to make appropriate corrections according to the subject. However, there are cases where the customer cannot determine whether restoration processing is appropriate from the thumbnail images in the index print.

  Accordingly, an object of the present invention is to provide an image processing apparatus, an image processing method, an image management apparatus, an image management method, a program, and an image order form that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above-described problem, the image processing apparatus according to the first embodiment of the present invention includes an original image acquisition unit that acquires an original image and a characteristic area in the original image acquired by the original image acquisition unit. A characteristic area determination unit that determines whether or not a characteristic area in the original image acquired by the original image acquisition unit An image correction unit that performs correction based on the optical characteristics of the imaging device that captured the image, and an image obtained by correcting the image correction unit when the characteristic region determination unit determines that a characteristic region exists. And an image output unit that outputs the original image acquired by the original image acquisition unit when the characteristic region determination unit determines that the characteristic region does not exist.

  The image processing method according to the second aspect of the present invention includes an original image acquisition stage for acquiring an original image, and a feature area for determining whether or not there is a characteristic area in the original image acquired in the original image acquisition stage. When it is determined in the determination stage and the characteristic area determination stage that a characteristic area exists, an image of the characteristic area in the original image acquired in the original image acquisition stage is captured by capturing the original image. When it is determined that there is a characteristic area in the image correction stage for correcting based on the optical characteristics of the apparatus and in the characteristic area determination stage, an image obtained by correcting in the image correction stage is output, An image output step of outputting the original image acquired in the original image acquisition step when it is determined in the region determination step that there is no characteristic region.

  According to the third aspect of the present invention, there is provided a program for an image processing device, wherein the image processing device includes an original image acquisition unit that acquires an original image, and a characteristic area in the original image acquired by the original image acquisition unit. When the characteristic region determination unit that determines whether or not the characteristic region determination unit determines that the characteristic region exists, the image of the characteristic region in the original image acquired by the original image acquisition unit is An image obtained by the image correcting unit correcting when the image correcting unit correcting the image based on the optical characteristics of the imaging apparatus that captured the original image and the characteristic region determining unit determine that the characteristic region exists. When the characteristic region determination unit determines that there is no characteristic region, the original image acquisition unit functions as an image output unit that outputs the original image.

  An image management apparatus according to a fourth aspect of the present invention includes an original image acquisition unit that acquires an original image and information indicating the optical characteristics of the imaging device that has captured the original image in association with each other, and an original image acquired by the original image acquisition unit A low data amount image generation unit that generates a low data amount image with a reduced data amount, and an optical indicated by the information acquired by the original image acquisition unit in association with the original image acquired by the original image acquisition unit An image correction unit that performs correction based on characteristics, a feature portion detection unit that detects a characteristic portion in an image obtained by the correction by the image correction unit, and an image obtained by the correction by the image correction unit. A partial image extraction unit for extracting a partial image including a characteristic portion therein, a partial image enlargement unit for enlarging the partial image extracted by the partial image extraction unit, and a low data amount image generated by the low data amount image generation unit Along with the enlarged part of the partial image And an image output unit for outputting an image.

  The low data amount image generation unit includes a thumbnail image generation unit that generates a thumbnail image in which the data amount of the original image acquired by the original image acquisition unit is reduced, and the image output unit includes a thumbnail image generated by the thumbnail image generation unit. At the same time, the partial image enlarged by the partial image enlargement unit may be output. The image processing apparatus further includes an extraction condition storage unit that stores in advance the extraction conditions of the partial images extracted by the partial image extraction unit, and the feature portion detection unit obtains an original image of a portion that matches the extraction conditions stored in the extraction condition storage unit The image may be detected from the original image acquired by the unit.

  The original image acquisition unit acquires the plurality of original images and information indicating the respective optical characteristics of the imaging device that captured each of the plurality of original images in association with each other, and the thumbnail image generation unit is acquired by the original image acquisition unit Each of the plurality of original images is generated, and the image correction unit associates each of the plurality of original images acquired by the original image acquisition unit with each of the plurality of original images. Correction is performed based on the optical characteristics indicated by the acquired information, and the characteristic portion detection unit detects characteristic portions in each of the plurality of images obtained by the image correction unit correcting each of the plurality of original images. The partial image extraction unit extracts a partial image including a characteristic portion in each of the plurality of images obtained by the image correction unit correcting each of the plurality of original images, and the partial image enlargement unit The partial image extraction unit Expanding the plurality of partial images out, the image output unit, together with each of the plurality of thumbnail images thumbnail image generating unit has generated, may output a plurality of partial images partial image enlargement portion is expanded.

  The image output unit further includes a print order accepting unit that accepts an order for printing original images corresponding to the plurality of thumbnail images output by the image output unit, and the image output unit includes a plurality of thumbnail images generated by the thumbnail image generating unit. An order form in which each of a plurality of partial images enlarged by the partial image enlargement unit is displayed may be displayed in the vicinity.

  The image output unit may print an order form in which each of the plurality of partial images enlarged by the partial image enlargement unit is printed in the vicinity of each of the plurality of thumbnail images generated by the thumbnail image generation unit. The image output unit associates each of the plurality of thumbnail images generated by the thumbnail image generation unit with each of the plurality of partial images enlarged by the partial image enlargement unit in association with each other and outputs them to the recording medium. You may output and record.

  The feature portion detection unit detects a main subject in the image obtained by the correction by the image correction unit, and the partial image extraction unit includes the main subject in the image obtained by the correction by the image correction unit. A partial image may be extracted. For example, the feature portion detection unit detects a person in the image obtained by the correction by the image correction unit, and the partial image extraction unit includes the person in the image obtained by the correction by the image correction unit. A partial image may be extracted. The feature portion detection unit detects a human face in the image obtained by the image correction unit and the partial image extraction unit detects the person in the image obtained by the image correction unit. A partial image including the face may be extracted. The feature portion detection unit detects the eyes of a person in the image obtained by the correction by the image correction unit, and the partial image extraction unit detects the eyes of the person in the image obtained by the correction by the image correction unit. May be extracted.

  The image correction unit further includes a luminance distribution calculation unit that calculates a luminance distribution in the image obtained by the correction, and the feature portion detection unit is obtained by the image correction unit correcting based on the calculation result of the luminance distribution calculation unit. A portion having a high maximum luminance or minimum luminance density in the obtained image is detected, and the partial image extraction unit is a portion having a high maximum luminance or minimum luminance density in the image obtained by the correction by the image correction unit. May be extracted.

  The original image acquisition unit associates an original image captured by an imaging device that makes the optical transfer function substantially constant over a predetermined range of an object distance in the optical axis direction with information indicating the optical transfer function. The image correction unit may acquire the original image acquired by the original image acquisition unit based on the optical transfer function indicated by the information acquired by the original image acquisition unit.

  An image management method according to a fifth aspect of the present invention includes an original image acquisition stage that acquires an original image and information indicating an optical characteristic of an imaging device that has captured the original image in association with each other, and an original image acquired in the original image acquisition stage. A thumbnail image generation stage for generating a thumbnail image of the image, and the original image acquired in the original image acquisition stage are corrected based on the optical characteristics indicated by the information acquired in the original image acquisition stage in association with the original image. An image correction stage, a characteristic part detection stage for detecting a characteristic part in the image obtained by correction in the image correction stage, and a characteristic part in the image obtained by correction in the image correction stage A partial image extraction stage for extracting a partial image including the partial image extraction stage for enlarging the partial image extracted in the partial image extraction stage, and a thumbnail image generation stage. Together with the generated thumbnail image, and an image output step of outputting an enlarged partial image in the partial image expansion stage.

  According to the sixth aspect of the present invention, there is provided a program for an image management apparatus that manages images, and acquires the image management apparatus in association with information indicating the optical characteristics of the imaging apparatus that captured the original image and the original image. The original image acquisition unit, the thumbnail image generation unit that generates a thumbnail image of the original image acquired by the original image acquisition unit, and the original image acquisition unit that acquires the original image acquired by the original image acquisition unit in association with the original image Obtained by correcting by an image correcting unit for correcting based on the optical characteristics indicated by the information, a characteristic part detecting unit for detecting a characteristic part in the image obtained by correction by the image correcting unit, and an image correcting unit. A partial image extraction unit for extracting a partial image including a characteristic portion in the image, a partial image enlargement unit for enlarging the partial image extracted by the partial image extraction unit, and a thumbnail image generated by the thumbnail image generation unit Together to function as an image output unit that outputs the partial image the partial image enlarged portion is expanded.

  The image order form according to the seventh aspect of the present invention includes an entire image printing unit on which the entire original image is printed, and an image in which the original image is corrected based on the optical characteristics of the imaging device that captured the original image. A partial image printing part in which a partial image including the characteristic part is enlarged and printed, and an entire image order entry part in which information to order an original image is entered.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, the user can easily know the quality of an important part image that is difficult to distinguish from a thumbnail image by using the image management apparatus.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows an example of a use environment of an image processing system 800 according to an embodiment of the present invention. The image processing system 800 includes an imaging device 830, an image display device 815, an image processing device 810a, and an image processing device 810b (hereinafter collectively referred to as an image processing device 810). The image processing apparatus 810 acquires a captured image captured by the imaging apparatus 830 through the communication line 850 or the recording medium 860.

  The image processing device 810 detects a characteristic region of an image such as a human face or a human eye included in the captured image acquired from the imaging device 830. When a characteristic area is detected, the image processing apparatus 810 restores only an image of the characteristic area based on the optical characteristics of the optical system of the imaging apparatus 830 and supplies the image to the image display apparatus 815. Also, the image processing device 810 supplies the captured image to the image display device 815 when a characteristic region is not detected. Note that the image processing apparatus 810a may be an information processing apparatus such as a personal computer. Then, the image display device 815 connected to the image processing device 810a may display a restored image obtained by restoring the image of the feature region by the image processing device 810a. The image processing device 810b may be an image processing server that receives an image from the imaging device 830, processes the image, and provides the restored image to the image display device 815 through the communication line 850.

  As will be described later, the imaging device 830 has an optical system that uniformly blurs light from the subject, and images the subject through the optical system. Therefore, the captured image obtained by the imaging device 830 includes a blurred subject image. The imaging device 830 may record the imaging device on the recording medium 860 and provide the captured image to the image processing device 810a via the recording medium 860. Further, the imaging device 830 may supply a captured image to the image processing device 810 through the communication line 850. Note that the imaging device 830 transmits the optical characteristic information of the optical system to the image processing device 810 by recording the optical characteristics of the optical system on the recording medium 860 or attaching it to the captured image. Note that the imaging device 830 may transmit the device ID to the image processing device 810 by recording the device ID that can identify the imaging device 830 on the recording medium 860 or attaching it to the captured image. In this case, the image processing apparatus 810 may acquire optical characteristics associated with the device ID from the transmitted device ID.

  According to the image processing system 800 described above, only the characteristic region of the captured image is restored, so that a restored image can be generated more quickly than when the entire image is restored. Since the restored image output from the image processing device 810 has a high quality characteristic area, the subject can be easily identified from the image content of the restored area. Further, it is possible to make a characteristic area stand out from an area that has not been restored. Note that examples of the imaging device 830 include a digital camera, a microscope, and an endoscope.

  FIG. 2 shows an example of a block configuration of the image processing apparatus 810. The image processing apparatus 810 includes an original image acquisition unit 930, a feature region determination unit 960, a feature region specification unit 970, an image correction unit 910, and an image output unit 990. The original image acquisition unit 930 acquires an original image. As an original image, a captured image generated by capturing a subject can be exemplified. For example, the original image acquisition unit 930 acquires a captured image captured by the imaging device 830. Then, the feature area determination unit 960 determines whether or not there is a characteristic area in the original image acquired by the original image acquisition unit 930.

  The feature area specifying unit 970 specifies a characteristic area in the original image when the feature area determining unit 960 determines that a characteristic area exists. Then, when the characteristic region determination unit 960 determines that a characteristic region exists, the image correction unit 910 converts the image of the characteristic region in the original image acquired by the original image acquisition unit 930 into the original image. Is corrected based on the optical characteristics of the imaging device 830 that captured the image. The image output unit 990 outputs an image obtained by the image correction unit 910 correcting when the feature region determination unit 960 determines that a characteristic region exists, and the feature region determination unit 960 When it is determined that there is no characteristic area, the original image acquired by the original image acquisition unit 930 is output.

  As will be described later, the imaging device 830 has an optical system in which an optical transfer function with respect to light from an object is substantially constant over a range of a predetermined object distance in the optical axis direction. In this case, the image correction unit 910 captures an image of a characteristic area in the original image acquired by the original image acquisition unit 930 when the characteristic area determination unit 960 determines that a characteristic area exists. Correction is performed based on the optical transfer function of the optical system 830. Specifically, the image correction unit 910 applies an inverse filter of the optical response indicated by the optical transfer function of the optical system of the imaging device 830 to the image of the characteristic region in the original image, thereby performing the characteristic in the original image. The image in the correct area.

  The original image acquisition unit 930 acquires a plurality of original images included in the moving image captured by the imaging device 830. In this case, a frame image or a field image can be exemplified as the original image. In this case, the feature area determination unit 960 determines whether a characteristic area exists in each of the plurality of original images. Then, the image correction unit 910 converts the image of the characteristic area in the original image determined to have a characteristic area by the characteristic area determination unit 960 based on the optical transfer function of the optical system of the imaging device 830. To correct. Then, the image output unit 990 includes an image obtained by correcting the original image determined by the feature region determination unit 960 that the characteristic region exists, corrected by the image correction unit 910, and a characteristic region by the feature region determination unit 960. An original image for which it is determined that no area exists is output.

  Note that the feature area determination unit 960 determines whether or not a characteristic area exists in each of the plurality of original images based on the motion vector included in the moving image. For example, the feature area determination unit 960 determines whether there is a moving object in each of the plurality of original images based on the motion vector included in the moving image.

  For example, the feature region determination unit 960 identifies macroblocks having substantially the same motion vectors. For example, the feature region determination unit 960 moves a macroblock having a motion vector whose motion vector direction difference is smaller than a predetermined value and whose motion vector size difference is smaller than a predetermined value. It is specified as a macroblock with substantially equal vectors. The feature region determination unit 960 determines that there is a moving object when there is a region where the density of macroblocks having substantially the same motion vector is greater than a predetermined value.

  When the feature region determination unit 960 determines that there is a moving object, the image correction unit 910 displays an image of the region where the moving object exists in the original image that is determined by the feature region determination unit 960 to have a moving object. Is corrected based on the optical transfer function of the optical system of the imaging device 830.

  The feature area determination unit 960 may determine whether or not there is a temporally changing area in each of the plurality of original images based on the motion vector included in the moving image. For example, the feature region determination unit 960 determines whether or not there is a region where the temporal change amount of the motion vector is larger than a predetermined value. When the characteristic region determination unit 960 determines that there is a temporally changing region, the image correction unit 910 corrects the image of the region based on the optical transfer function of the optical system of the imaging device 830. .

  In addition, the feature area determination unit 960 may determine whether or not a characteristic area exists in each of the plurality of original images based on the colors included in the plurality of original images. For example, the feature area determination unit 960 may determine whether or not an area in which the number of pixels of a color included in a predetermined color area is greater than or equal to a predetermined value exists in the original image.

  FIG. 3 shows an example of a block configuration of the imaging device 830. Note that this block configuration is intended to explain the optical characteristics of the imaging device 830, and details of other configurations are omitted. The imaging device 830 includes an optical system 1010, a light receiving unit 1020 having a plurality of light receiving elements that receive light that has passed through the optical system 1010, and an image generation unit 1030 that generates a captured image of a subject from light received by the light receiving unit 1020. Have.

  The optical system 1010 has an optical characteristic that an optical transfer function with respect to light from an object is substantially constant over a range of a predetermined object distance in the optical axis direction. That is, the optical transfer function hardly depends on the object distance. Such optical characteristics are brought about by aberrations of the optical system 1010. For example, according to the optical system 1010, the image formation point of light from a certain object point on the optical axis extends in the range from z1 to z2 on the optical axis according to the incident height of the pupil plane of the optical system 1010. According to the optical system 1010 having such an aberration, if the light receiving unit 1020 is approximately in the range from z1 to z2, the point spread of light from the object point substantially depends on the position of the light receiving unit 1020. No longer.

  With such an optical system 1010, when the range in the optical axis direction where the point spread becomes uniform becomes long, the position of the light receiving unit 1020 where the size of the point image spread becomes almost constant regardless of the distance to the object point exists. Can do. When the light receiving unit 1020 is provided at such a position, the optical transfer function for light from the subject can be substantially constant over a predetermined range of the object distance. The point spread is preferably at least twice the pixel pitch of the light receiving unit 1020. Note that when the point spread becomes twice or more the pixel pitch of the light receiving unit 1020, a blurred subject image is obtained. However, if the optical transfer function is substantially constant over a predetermined range of the object distance, the subject image of the subject existing in the distance range can be restored to a clear subject image by the same inverse filter. Therefore, the blurred subject image can be restored to a clear subject image by the image processing by the inverse filter corresponding to the optical transfer function by the image correction unit 910 as described above.

  The image generation unit 1030 generates a captured image based on the amount of light received by the light receiving element included in the light receiving unit 1020. At this time, it is desirable that the image generation unit 1030 does not perform processing for converting the spatial frequency characteristics of the image, such as edge enhancement processing. The captured image generated by the image generation unit 1030 is recorded on the recording medium 860 and supplied to the image processing apparatus 810 or transmitted to the image processing apparatus 810 through the communication line 850. Thereafter, in the image processing device 810, the subject image is restored by image processing such as an inverse filter by the image correction unit 910 as described above.

  FIG. 4 shows an example of an output moving image output from the image output unit 990. The original image acquisition unit 930 acquires frame images 1111 to 1116 included in the moving image captured by the imaging device 830. The feature area determination unit 960 determines that there is no moving object in the frame image 1111 and the frame image 1112. Also, the feature area determination unit 960 determines that there is a moving object in the frame images 1113-1116. Then, the feature area specifying unit 970 specifies the areas 1133, 1134, 1135, and 1136 of the moving object based on the motion vector included in the moving image in the frame image 1113-1116. Then, the image correction unit 910 generates a restored image 1123-1126 by restoring the images of the moving object regions 1133, 1134, 1135, and 1136 in the frame images 1113 to 1116 using an inverse filter or the like.

  The image output unit 990 outputs a moving image in which the frame image 1111, the frame image 1112, the restored image 1123, the restored image 1124, the restored image 1125, and the restored image 1126 are reproduced continuously. The image correction unit 910 only needs to generate the restored image 1123, the restored image 1124, the restored image 1125, and the restored image 1126 by restoring only the image of the moving object area, so that the restoration processing is performed as compared with the case of restoring the entire image. It is possible to reduce the time it takes. As a result, the image output unit 990 can quickly output a moving image. In addition, the moving image output from the image output unit 990 has high image quality in a characteristic area such as a moving object, so that a viewer of the moving image can observe the characteristic area carefully.

  FIG. 5 shows an example of the usage environment of the image management system 100 according to another embodiment of the present invention. The image management system 100 includes an imaging device 130, an image management device 110, and an order server 120. The image management apparatus 110 is provided in a store 170 such as a photo shop or a convenience store, a home 171 of the user 190, or the like. The image management apparatus 110 receives a captured image from the imaging apparatus 130, and is a characteristic partial image of an image such as a human face or a human eye included in an image obtained by restoring the captured image based on the optical characteristics of the imaging apparatus 130. Is enlarged and presented to the user 190 together with the captured image, and a print order from the user 190 is accepted. The image management apparatus 110 may be an information terminal such as a personal computer or a kiosk terminal.

  Specifically, the imaging device 130 images a subject with a phase mask that makes the optical transfer function substantially constant over a range of a predetermined object distance in the optical axis direction, and the obtained captured image and the imaging device 130. Is recorded on the recording medium 160a. The optical system included in the imaging device 130 has an optical characteristic that modulates and blurs light from the subject. The captured image captured by the imaging device 130 is blurred, but the depth of focus is increased. Note that the imaging device 130 may include an optical system having the same optical characteristics as the optical system 1010 included in the imaging device 830. Then, the image management apparatus 110 reads the captured image from the recording medium 160a and generates a thumbnail image. In addition, the image management apparatus 110 performs a restoration process corresponding to the optical transfer function of the imaging device 130 identified by the device ID on the captured image read from the recording medium 160a to generate a restored image. Then, the image management apparatus 110 records, on the recording medium 160b, an enlarged image obtained by enlarging a characteristic portion of the image such as a person's face or a person's eye included in the restored image together with the captured image and the thumbnail image.

  When ordering by the user 190, the image management apparatus 110 displays the enlarged image read from the recording medium 160b received from the user 190 on the display together with the thumbnail image. The user 190 confirms the enlarged image displayed together with the thumbnail image, and selects a captured image to be ordered for printing to the image management apparatus 110. Then, the image management apparatus 110 transmits a print order including a restored image obtained by restoring the captured image selected by the user 190 to the order server 120 via the communication line 150. Then, the order server 120 prints the restored image from the output device 180 such as a printing machine according to the print order, and provides it to the user 190. Note that the user 190 may instruct the image management apparatus 110 whether or not to perform the restoration process while viewing the enlarged image, or the strength of the restoration process. Then, the image management apparatus 110 may generate a restored image by performing restoration processing of intensity according to an instruction from the user 190 on the captured image. Further, the image management apparatus 110 may create an image order form 165 in which an enlarged image is printed together with a captured image or a thumbnail image of the captured image and provide the image order form 165 to the user 190.

  According to the image management system 100 or the image order form 165 provided from the image management system 100 described above, the user 190 confirms the enlarged image, and whether or not the presence / absence of red eyes and the facial expression of the person are well captured. It is possible to appropriately determine whether or not the restored image is suitable for printing, such as whether or not the restoration process is appropriate. Further, at the time of ordering, the image management apparatus 110 only needs to display the thumbnail image and the enlarged image recorded on the recording medium 160a on the display, so that the order screen can be displayed at a higher speed than when the captured image itself is read and displayed. Can be displayed.

  Note that the imaging device 130 may record an enlarged image of a characteristic part of the image on the recording medium 160a together with the captured image. Then, the image management apparatus 110 may perform restoration processing on the enlarged image read from the recording medium 160a, and display the captured image and the restored enlarged image on the display. The output device 180 may be provided in the store 170 or the home 171 so as to be communicably connected to the image management device 110. The output device 180 prints a restored image according to a print order from the image management device 110 and provides the user 190 with the restored image. May be. Further, the output device 180 may receive the print data of the image order form 165 from the image management apparatus 110 and print the image order form 165. The image management apparatus 110 records the restored image on the recording medium 160 and transmits the print order including the restored image in the recording medium 160 on which the captured image designated by the user 190 is restored to the order server 120. May be. An image restoration device different from the image management device 110 may generate the restored image. Further, the image management apparatus 110 transmits a print order including the captured image and the apparatus ID to the order server 120, and the image restoration apparatus determines whether the image restoration apparatus corresponds to the optical characteristics of the image capture apparatus 130 identified by the apparatus ID included in the print order. The restored image may be generated by restoring the captured image. Then, the order server 120 may receive and print the restored image.

  FIG. 6 shows an example of a block configuration of the image management apparatus 110. The image management apparatus 110 includes an image correction unit 210, an original image acquisition unit 230, a feature portion detection unit 240, a luminance distribution calculation unit 242, an extraction condition storage unit 244, a partial image extraction unit 250, a partial image enlargement unit 252, a low data amount. An image generation unit 285, an image output unit 290, and a print order reception unit 292 are provided. The thumbnail image generation unit 280 includes a low data amount image generation unit 285. The image management apparatus 110 according to the present embodiment is an apparatus that records thumbnail images and enlarged images on the recording medium 160b, an apparatus that creates thumbnails and enlarged images by reading the thumbnail images and enlarged images from the recording medium 160b, and a thumbnail image from the recording medium 160b. It functions as a device that reads the enlarged image and receives an order from the user 190. In the following description, the recording medium 160a and the recording medium 160b are collectively referred to as the recording medium 160.

  The original image acquisition unit 230 acquires the original image and information indicating the optical characteristics of the imaging device 130 that captured the original image in association with each other. Specifically, the original image acquisition unit 230 reads the captured image and the device ID captured by the imaging device 130 and recorded on the recording medium 160 from the recording medium 160 and acquires them as an original image. Then, the low data amount image generation unit 285 generates a low data amount image in which the data amount of the original image acquired by the original image acquisition unit 230 is reduced. Specifically, the thumbnail image generation unit 280 generates a thumbnail image of the original image acquired by the original image acquisition unit 230. The image correction unit 210 corrects the original image acquired by the original image acquisition unit 230 based on the optical characteristics indicated by the information acquired by the original image acquisition unit 230 in association with the original image. The original image acquisition unit 230 is an information indicating the optical transfer function of the original image captured by the imaging device 130 that makes the optical transfer function substantially constant over a predetermined range of the object distance in the optical axis direction. It may be obtained in association with. Then, the image correction unit 210 corrects the original image acquired by the original image acquisition unit 230 based on the optical transfer function indicated by the information acquired by the original image acquisition unit 230. The device ID is an example of information indicating the optical transfer function.

  The extraction condition storage unit 244 stores in advance the extraction conditions for partial images extracted by the partial image extraction unit 250. For example, the extraction condition storage unit 244 may store a characteristic contour pattern of a subject. For example, the extraction condition storage unit 244 uses a pattern of a main subject to be a main subject (for example, a shape pattern, a luminance pattern, and a color pattern of a person, a person's face, a person's eyes, an animal, etc.) as an extraction condition. Store. In addition, the extraction condition storage unit 244 may store an extraction condition indicating that the subject included in the center position in the image should be extracted. The extraction condition storage unit 244 may store a reference ratio of the number of pixels having the minimum luminance value or the maximum luminance value in the luminance frequency distribution in the captured image as the extraction condition. In addition, the extraction condition storage unit 244 may store, as an extraction condition, a reference value of a frequency component that is a reference ratio that should include a higher frequency component than a predetermined frequency component in the captured image.

  Then, the feature portion detection unit 240 may refer to an image obtained by correcting the portion that matches the extraction condition stored in the extraction condition storage unit 244 by the image correction unit 210 (hereinafter simply referred to as a restored image). )). Then, the partial image extraction unit 250 extracts a partial image including a characteristic portion in the image obtained by the correction by the image correction unit 210. The partial image extraction unit 250 may extract a plurality of partial images in the original image.

  Then, the partial image enlargement unit 252 enlarges the partial image extracted by the partial image extraction unit 250. Then, the image output unit 290 outputs the partial image enlarged by the partial image enlargement unit 252 together with the low data amount image generated by the low data amount image generation unit 285. Specifically, the image output unit 290 outputs the partial image enlarged by the partial image enlargement unit 252 together with the thumbnail image generated by the thumbnail image generation unit 280. As described above, the image management apparatus 110 detects the characteristic part in the restored image by the characteristic part detection unit 240, enlarges the image including the characteristic part, and associates the image with the thumbnail to the user 190. Can be presented. Therefore, the user 190 can order a print after the image management apparatus 110 determines whether the captured image is suitable for printing.

  Specifically, the feature portion detection unit 240 is corrected by the image correction unit 210 by pattern matching between the contour of the subject included in the restored image and the pattern of the main subject stored in the extraction condition storage unit 244. A main subject is detected in the obtained image. Then, the partial image extraction unit 250 extracts a partial image including the main subject in the image obtained by the correction by the image correction unit 210.

  In addition, the feature portion detection unit 240 is an image obtained by the image correction unit 210 correcting the pattern by, for example, pattern matching between the contour of the subject included in the restored image and the person pattern stored in the extraction condition storage unit 244. Detect people in Then, the partial image extraction unit 250 extracts a partial image including a person in the image obtained by the correction by the image correction unit 210.

  Also, the feature portion detection unit 240 is obtained by the image correction unit 210 correcting the pattern by, for example, pattern matching between the contour of the subject included in the restored image and the human face pattern stored in the extraction condition storage unit 244. The face of a person in the captured image. Then, the partial image extraction unit 250 extracts a partial image including a human face in the image obtained by the correction by the image correction unit 210.

  Further, the feature portion detection unit 240 is obtained by the image correction unit 210 correcting the pattern by, for example, pattern matching between the contour of the subject included in the restored image and the human eye pattern stored in the extraction condition storage unit 244. The eyes of a person in the captured image. Then, the partial image extraction unit 250 extracts a partial image including the eyes of a person in the image obtained by the correction by the image correction unit 210.

  The luminance distribution calculation unit 242 calculates the luminance distribution in the image obtained by the correction by the image correction unit 210. Based on the calculation result of the luminance distribution calculation unit 242, the feature portion detection unit 240 detects a portion where the density of the maximum luminance or the minimum luminance is large in the image obtained by the correction by the image correction unit 210. Specifically, the feature portion detection unit 240 determines that the minimum luminance value stored in the extraction condition storage unit 244 is the ratio of the number of pixels included in the minimum luminance value or the maximum luminance value in the luminance distribution calculated by the luminance distribution calculation unit 242. Alternatively, a portion larger than the reference ratio for the maximum luminance value is detected as a portion having a maximum density or minimum luminance density in the original image. Then, the partial image extraction unit 250 extracts a partial image of a portion where the density of the maximum luminance or the minimum luminance is large in the image obtained by the correction by the image correction unit 210.

  Note that the original image acquisition unit 230 may acquire the plurality of original images and information indicating the respective optical characteristics of the imaging device that has captured each of the plurality of original images in association with each other. In this case, the thumbnail image generation unit 280 generates thumbnail images of the plurality of original images acquired by the original image acquisition unit 230. Then, the image correction unit 210 associates each of the plurality of original images acquired by the original image acquisition unit 230 with each of the plurality of original images based on the optical characteristics indicated by the information acquired by the original image acquisition unit 230. To correct. The feature portion detection unit 240 detects a characteristic portion in each of the plurality of images obtained by the image correction unit 210 correcting each of the plurality of original images. Then, the partial image extraction unit 250 extracts a partial image including a characteristic portion in each of the plurality of images obtained by the image correction unit 210 correcting each of the plurality of original images. Then, the partial image enlargement unit 252 enlarges the plurality of partial images extracted by the partial image extraction unit 250. Then, the image output unit 290 outputs each of the plurality of partial images enlarged by the partial image enlargement unit 252 together with each of the plurality of thumbnail images generated by the thumbnail image generation unit 280.

  Then, the image output unit 290 displays an order form in which each of the plurality of partial images enlarged by the partial image enlargement unit 252 is displayed in the vicinity of each of the plurality of thumbnail images generated by the thumbnail image generation unit 280. Then, the print order receiving unit 292 receives an order for printing the restored image corresponding to the plurality of thumbnail images output by the image output unit 290. For this reason, even if the thumbnail image displayed on the display of the image management apparatus 110 is so small that the presence or absence of red eyes cannot be confirmed, the user 190 can confirm the presence or absence of red eyes from the enlarged image. Therefore, the user 190 can easily select a restored image suitable for printing from the order screen of the image management apparatus 110 on which many images are displayed.

  The image output unit 290 associates each of the plurality of thumbnail images generated by the thumbnail image generation unit 280 with each of the plurality of partial images enlarged by the partial image enlargement unit 252 so as to be output in association with each other. Output to the recording medium 160 and record. Specifically, the image management apparatus 110 describes, on the recording medium 160, the correspondence between the file name in which the thumbnail image is recorded and the file name in which the enlarged image of the restored image indicated by the thumbnail image is recorded. The corresponding image file is recorded on the recording medium 160.

  The image output unit 290 prints an image order form 165 in which each of the plurality of partial images enlarged by the partial image enlargement unit 252 is printed in the vicinity of each of the plurality of thumbnail images generated by the thumbnail image generation unit 280. To do. For example, the image output unit 290 transmits the print data of the image order form 165 to the output device 180 and causes the output device 180 to print the image order form 165. Specifically, the entire original image is printed in the entire image printing unit of the image order slip 165. In addition, the partial image printing unit of the image order form 165 includes a partial image including a characteristic portion in an image (restored image) in which the original image is corrected based on the optical characteristics of the imaging device 130 that captured the original image. Is enlarged and printed. For example, on the image order form 165, an entire image printing unit and a partial image printing unit are printed side by side. Further, the image order form 165 includes a plurality of whole image printing units in which a plurality of original images are printed, and a plurality of partial image printing units in which a partial image including a characteristic portion in the restored image is enlarged. And may be printed side by side. Further, the whole image order entry part of the image order form 165 is provided adjacent to the whole image printing part, and the fact that the restored image is ordered is entered.

  FIG. 7 shows an example of an extraction method in which the characteristic part detection unit 240 detects characteristic parts. The luminance distribution calculation unit 242 calculates a luminance distribution for each partial region (3 × 5 15 partial regions in this example) obtained by dividing the captured image 300. In this figure, the luminance distributions 312 and 322 calculated for the partial areas 310 and 320 by the luminance distribution calculation unit 242 are illustrated. The luminance distribution here may be a frequency distribution indicating a distribution of the number of pixels having the luminance value with respect to the luminance value. Note that the luminance value may be a luminance value for each color component.

  Then, the feature portion detection unit 240 calculates the ratio of the number of pixels having the minimum luminance value or the maximum luminance value to the total number of pixels. And the characteristic part detection part 240 detects the partial area | region where the calculated ratio is larger than a predetermined ratio as a part with the density of maximum brightness | luminance or minimum brightness | luminance being large. In the example of this figure, the ratio of the number of pixels having the minimum luminance value or the maximum luminance value in the luminance distribution 312 is larger than the ratio of the number of pixels having the minimum luminance value or the maximum luminance value in the luminance distribution 322, and Is selected preferentially over the partial area 320 as a characteristic part.

  A luminance distribution having a shape in which the end of the frequency distribution is cut as in the luminance distribution 312 is obtained when there is a subject with a luminance range exceeding the dynamic range of the imaging apparatus. That is, it can be said that the partial region 312 is a region where there is a strong possibility that the contrast cannot be expressed sufficiently. Since the image management apparatus 110 can extract such an area as a characteristic area, expand it, and present it to the user 190, the user 190 checks whether the contrast is sufficiently expressed. You can order restored images from

  FIG. 8 shows an example of an arrangement example of files recorded by the image output unit 290 on the recording medium 160b. The image output unit 290 arranges a captured image directory 410, a thumbnail image directory 420, a partial image directory 430, and an image corresponding file 440 under the root directory 400. The image output unit 290 arranges the plurality of captured image files 412 received from the recording medium 160 a immediately below the captured image directory 410. Further, the image output unit 290 arranges a plurality of thumbnail image files 422 that are the respective thumbnail images of the captured image, immediately below the thumbnail image directory 420. Also, the image output unit 290 places the partial image file 432 generated by the partial image enlargement unit 252 enlarged immediately below the partial image directory 430.

  Then, the image output unit 290 records the image correspondence file 440 in which the correspondence relationship between the captured image file 412, the thumbnail image file 422, and the partial image file 432 is described immediately below the root directory. Specifically, the image output unit 290 records the captured image file 412, the thumbnail image file 422, and the partial image file 432 in the image corresponding file 440 in association with each other. In the image correspondence file 440, the device ID of the imaging device 130 that captured the captured image is also recorded. Note that the image output unit 290 describes the file name including the path name of each file in the image correspondence file 440. Note that the image output unit 290 may describe the contents of the image correspondence file 440 in XML format. For example, the image output unit 290 sets the file names of the captured image file 412, the thumbnail image file 422, and the partial image file 432 as attributes of a tag indicating that the captured image file, the thumbnail image file, and the partial image file are included. May be generated.

  Note that the image output unit 290 displays information indicating the order in which the captured image or thumbnail image to be displayed to the user 190 is displayed when the restored image is ordered, or information indicating the position at which the captured image or thumbnail image is displayed. The correspondence file 440 may be described. As a result, the image management apparatus 110 can display captured images or thumbnail images in the order or position described in the image correspondence file 440 arranged in the root directory. Note that the image output unit 290 may record an HTML file that defines the display position of the captured image or thumbnail image on the screen at the time of print order or the like in the image correspondence file 440. For example, the image output unit 290 records, in the recording medium 160, an HTML file that defines an order screen to be displayed at the time of ordering. Thereby, the user 190 can confirm a captured image and an enlarged image as long as the image management apparatus 110 operates a WEB browser regardless of the type of terminal such as a personal computer, a mobile phone, and a PDA. The image correspondence file 440 may be the HTML file.

  Note that the captured image file 412, the thumbnail image file 422, the partial image file 432, and the image correspondence file 440 are not limited to the directory configuration shown in the example of this figure, and may be arranged in various directory configurations. Note that the image output unit 290 may arrange the image correspondence file 440 directly under a directory (a root directory 400 in this example) defined between a plurality of types of image management apparatuses 110. In this case, even if the captured image file 412, the thumbnail image file 422, and the partial image file 432 are arranged in a different directory configuration for each image management apparatus 110, the image corresponding file 440 directly under the specified directory can be read. The location of each file can be specified.

  As described above, the image management apparatus 110 records on the recording medium 160 the image correspondence file 440 in which each thumbnail image file is associated with each partial image file. Therefore, the image management apparatus 110 can promptly display the order screen by reading the image correspondence file 440 from the recording medium 160 recorded by another image management apparatus 110.

  FIG. 9 shows an example of an order screen 500 when the image management apparatus 110 accepts an order for a captured image. The image management apparatus 110 displays a plurality of order image areas 590a to 590f that allow the user 190 to order one captured image on the order screen 500. The order image areas 590a to 590f include the whole image display areas 510a to f, the partial image display areas 520a to f and 530a to f, the print number selection buttons 540a to f, and the order buttons 550a to f as display elements. It should be noted that the display elements of the order image areas 590a to 590f are identified by adding the signs a to f at the end of the signs of the display elements of the order image areas 590a to 590f.

  The image management apparatus 110 reads the file indicated by the file name indicating the thumbnail image described in the image correspondence file 440 from the recording medium 160 and displays it in the entire image display areas 510a to 510f. Then, the image management apparatus 110 reads the file indicated by the file name indicating the partial image from the recording medium 160, and the partial image display areas 520a to 530a to 530a to the respective positions in the vicinity of the entire image display areas 510a to 510f. Display on f. Note that the image management apparatus 110 may read a file having a file name indicating a captured image from the recording medium 160 and display the file in the entire image display areas 510a to 510f.

  The print order receiving unit 292 receives an instruction for the number of prints from the user 190 by using the print number selection buttons 540a to 540f displayed at the positions associated with the entire image display areas 510a to 510f, and images by pressing the order buttons 550a to 550f. The print order instruction is accepted. Then, the image management apparatus 110 associates the file name of the captured image file 412 for which the print order is instructed, the file name of the partial image file 432 related to the instructed captured image, and the specified number of prints. Stored in memory as print order data. Then, when order confirmation is instructed by the order confirmation button 560, the print order receiving unit 292 sequentially displays the captured image file 412 indicated by the captured image file name stored in the memory as a slide show and the number of printed sheets. Are displayed at the same time. Then, when an order for printing is instructed by the order execution button 570, the print order receiving unit 292, the contents of the captured image file 412 stored in the memory, the device ID of the image capturing device 130 that captured the captured image file 412, and A print order including the number of prints of each image is transmitted to the order server 120. The display 500 is provided with a touch panel function, and the print order receiving unit 292 may receive a print order and an instruction for the number of copies by operating the touch panel by the user 190.

  FIG. 10 shows an example of an image order form 165 printed by the image management apparatus 110. The image management apparatus 110 prints a plurality of order image print areas 690a to 690i that allow the user 190 to order one captured image on the image order slip 165. The order image printing areas 690a to 690i are collectively referred to as an entire image printing unit 610 (ai to hereinafter, collectively referred to as an entire image printing unit 610) and a partial image printing unit 620 (a to i, hereinafter to be referred to as a partial image printing unit 620). And the partial image printing unit 630 (ai) (hereinafter collectively referred to as the partial image printing unit 630), and the entire image order entry unit 660 (ai, hereinafter collectively referred to as the entire image order entry unit 660). Each has a printing element. It should be noted that the order image print areas 690a to 690i are identified by attaching the signs a to i to the end of the codes of the print elements included in the order image print areas 690a to i, respectively.

  The image management apparatus 110 reads a file having a file name indicating a thumbnail image described in the image correspondence file 440 from the recording medium 160 and prints it on a plurality of whole image printing units 610. Then, the image management apparatus 110 reads a file having a file name indicating a partial image from the recording medium 160, and sends it to the plurality of partial image printing units 620 and partial image printing units 630 at positions in the vicinity of the entire image printing unit 610. indicate. Note that the image management apparatus 110 may read a file having a file name indicating a captured image from the recording medium 160 and display the file on each of the entire image printing unit 610. In addition, the image management apparatus 110 prints the entire image order entry units 660a to 660i that order the image of the entire image printing unit 610 adjacent to the entire image printing units 610a to 610i. For example, the image management apparatus 110 prints the entire image order entry unit 660 indicating a frame for allowing the user 190 to enter the number of prints of the captured image printed on the entire image printing unit 610.

  The size of the partial image printing unit 620 and the partial image printing unit 630 may be different. Further, the partial image printing unit 620 and the partial image printing unit 630 may be the same size as the entire image printing unit 610. Further, the partial image printing unit 620 and the partial image printing unit 630 may be larger than the entire image printing unit 610.

  FIG. 11 shows an example of an order confirmation screen 700 when the image management apparatus 110 accepts an order for a captured image. The image management apparatus 110 displays an order confirmation screen 700 having a confirmation image area 710, partial image display areas 740 and 750, and an order form area 730. Specifically, the image management apparatus 110 sequentially displays captured images identified by file names stored in the memory as print order data in the confirmation image area 710 in a slide show format.

  At this time, the image management apparatus 110 displays a thumbnail image in the order form area 730 at one corner of the display 500 with a layout substantially the same as the layout of the captured image in the image order form 165. Then, the image management apparatus 110 highlights and displays the thumbnail image indicating the captured image being displayed in the confirmation image area 710. For example, the image management apparatus 110 displays a thumbnail image indicating the captured image being displayed larger than other thumbnail images, or the image frame of the thumbnail image indicating the captured image being displayed is thicker than the image frames of the other thumbnail images. It may be displayed or brightly displayed. For this reason, the user 190 can easily check which captured image has been ordered by checking it against the image order slip 165 at hand.

  Note that the image management apparatus 110 reads the number of prints associated with the captured image being displayed in the confirmation image area 710 from the print order data stored in the memory, and displays it in the vicinity of the confirmation image area 710. Further, the image management apparatus 110 reads a file indicated by the file name of the partial image stored in the memory in association with the captured image displayed in the confirmation image area 710 as print order data, and reads the read partial image. Are displayed in the partial image display areas 740 and 750.

  FIG. 12 shows an exemplary hardware configuration of the image processing apparatus 810 and the image management apparatus 110. The image processing apparatus 810 and the image management apparatus 110 include a CPU peripheral unit including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and a host controller 1582 by an input / output controller 1584. I / O unit having a communication interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560 connected to the I / O controller, and a legacy input having a ROM 1510, a flexible disk drive 1550, and an I / O chip 1570 connected to the I / O controller 1584. And an output unit.

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505. The communication interface 1530 is connected to the network communication device 1598 to transmit / receive programs or data. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program that the image management apparatus 110 and the image management apparatus 110 execute at startup, a program that depends on the hardware of the image management apparatus 110 and the image management apparatus 110, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program executed by the CPU 1505 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is installed in the hard disk drive 1540 from the recording medium, read into the RAM 1520, and executed by the CPU 1505.

  The program executed by the CPU 1505 causes the image processing apparatus 810 to perform the original image acquisition unit 930, the feature region determination unit 960, the feature region specification unit 970, the image correction unit 910, and the image output unit 990 described with reference to FIGS. To function as. Also, the program executed by the CPU 1505 causes the image management apparatus 110 to execute the image correction unit 210, the original image acquisition unit 230, the feature portion detection unit 240, the luminance distribution calculation unit 242, and the extraction condition storage described with reference to FIGS. Function as a unit 244, a partial image extraction unit 250, a partial image enlargement unit 252, a low data amount image generation unit 285, an image output unit 290, and a print order reception unit 292.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and a program may be provided to the image processing device 810 and the image management device 110 via the network. Good.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

It is a figure which shows an example of the utilization environment of the image processing system 800 which concerns on one Embodiment of this invention. 2 is a diagram illustrating an example of a block configuration of an image processing apparatus 810. FIG. FIG. 25 is a diagram illustrating an example of a block configuration of an imaging device 830. It is a figure which shows an example of the image output by the image output part 990. FIG. 1 is a diagram illustrating an example of a usage environment of an image management system 100. FIG. It is a figure which shows an example of the block configuration of the image management apparatus 110 and the imaging device 130. It is a figure which shows an example of the imaging condition data which the imaging device 130 stores. It is a figure which shows an example of the recommended condition data which the image management apparatus 110 records. 6 is a diagram illustrating an example of an order screen in the image management apparatus 110. FIG. 6 is a diagram illustrating an example of an image order form in the image management apparatus 110. FIG. It is a figure which shows an example of the order confirmation screen of the image management apparatus. 2 is a block diagram illustrating a hardware configuration of an image processing apparatus 810 and an image management apparatus 110. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Image management system 110 Image management apparatus 120 Order server 130 Imaging apparatus 150 Communication line 160 Recording medium 165 Image order form 180 Output apparatus 190 User 210 Image correction part 230 Original image acquisition part 240 Characteristic part detection part 242 Luminance distribution calculation part 244 Extraction Condition storage unit 250 Partial image extraction unit 252 Partial image enlargement unit 280 Thumbnail image generation unit 285 Low data amount image generation unit 290 Image output unit 292 Print order reception unit 410 Captured image directory 420 Thumbnail image directory 430 Partial image directory 440 Image corresponding file 510 Whole image display region 520 Partial image display region 610 Whole image printing unit 620 Partial image printing unit 630 Partial image printing unit 660 Whole image order entry unit 800 Image processing system 810 Image processing device 815 Display device 830 imaging device 850 communication line 860 recording medium 910 image correcting unit 930 the original image obtaining unit 960, wherein the area determination section 970 feature region specifying section 990 image output section

Claims (14)

Spreading of the point image of the object point over a range of a predetermined object distance in the optical axis direction have a optical system having a substantially constant optical transfer function in more than twice the pixel pitch, the light from the object through the optical system An imaging device for receiving an image with a light receiving element and capturing an original image having blur in a subject image;
An image processing apparatus that acquires the original image captured by the imaging apparatus and a device ID that identifies the imaging apparatus from the imaging apparatus;
With
The imaging device generates the original image based on the amount of light received by the light receiving element without performing image processing for converting spatial frequency characteristics including edge enhancement processing, and generates the original image and the device ID. To the image processing apparatus,
The image processing apparatus includes:
An original image acquisition unit for acquiring the original image from the imaging device ;
A characteristic region determination unit that determines whether or not there is a characteristic region in the original image acquired by the original image acquisition unit;
When the characteristic area determination unit determines that the characteristic area exists, the device ID acquired from the imaging apparatus for the image of the characteristic area in the original image acquired by the original image acquisition unit An image correction unit restored by an inverse filter of the optical transfer function corresponding to
When the characteristic area determination unit determines that the characteristic area exists, the image correction unit outputs an image in which the image of the characteristic area is restored to the image display device, and the characteristic area determination An image processing system comprising: an image output unit that outputs an original image acquired by the original image acquisition unit to the image display device when the unit determines that the characteristic region does not exist. 2. The image according to claim 1, wherein the optical system has an aberration that expands an imaging point of light from an object point on the optical axis to a predetermined range on the optical axis in accordance with an incident height on the pupil plane. Processing system . The imaging device captures a moving image including a plurality of the original images,
It said original image acquiring unit acquires the plurality of original images included in the moving image captured by the imaging device,
The characteristic area determination unit determines whether or not the characteristic area exists in each of the plurality of original images;
The image correction unit restores the image of the characteristic area in the original image determined by the characteristic area determination unit that the characteristic area exists by using the one inverse filter,
The image output unit is an image obtained by restoring an image of the characteristic region by the image correction unit, an original image determined by the characteristic region determination unit that the characteristic region exists, and the feature the image processing system according to claim 1 or 2 original images the characteristic region is that there is no is determined, to output to the image display device by the area determination unit. The image processing system according to claim 3 , wherein the characteristic area determination unit determines whether or not the characteristic area exists in each of a plurality of original images based on a motion vector included in the moving image. The feature region determination unit determines whether there is a moving object in each of a plurality of original images based on a motion vector included in the video,
5. The image according to claim 4 , wherein the image correction unit restores an image of an area where a moving object exists in the original image determined that the moving object exists by the feature area determination unit using the one inverse filter. Processing system . The feature region determination unit determines whether or not there is a temporally changing region in each of a plurality of original images based on a motion vector included in the moving image;
The image correction section, an image of the area that the said characteristic region determining unit time varying region by the presence changes with time in the determined original image, according to claim 4, restored by the one of the inverse filter The image processing system described in 1. The image according to any one of claims 1 to 6 , wherein the characteristic area determination unit determines whether the characteristic area exists in the original image based on a color included in the original image. Processing system . An imaging apparatus having an optical system having an optical transfer function having a substantially constant optical transfer function in which the spread of a point image of an object point is not less than twice the pixel pitch over a range of a predetermined object distance in the optical axis direction. The original image is generated based on the amount of light received by the light receiving element without performing image processing for converting spatial frequency characteristics, including edge enhancement processing, by receiving the light from the light receiving element, thereby blurring the subject image. An imaging stage for capturing an original image having
A step of providing the image processing device with an image processing device providing the original image taken by the imaging device and a device ID for identifying the imaging device;
The image processing apparatus, a device ID for identifying the image capturing apparatus capturing the original image and the original image captured by the imaging step, the original image acquisition step of acquiring from the imaging device,
A characteristic region determination step in which the image processing device determines whether or not there is a characteristic region in the original image acquired in the original image acquisition step;
When the image processing apparatus determines that the characteristic region exists in the characteristic region determination step, the image of the characteristic region in the original image acquired in the original image acquisition step is An image correction step of restoring by one inverse filter of the optical transfer function corresponding to the device ID acquired from the imaging device;
When the image processing apparatus determines that the characteristic area exists in the characteristic area determination stage, the image display apparatus displays an image in which the image of the characteristic area is restored in the image correction stage. And outputting an original image acquired in the original image acquisition step to the image display device when it is determined in the characteristic region determination step that the characteristic region does not exist. Image processing method. The image according to claim 8 , wherein the optical system has an aberration that expands an imaging point of light from an object point on the optical axis to a predetermined range on the optical axis according to an incident height on the pupil plane. Processing method. In the imaging step, the imaging device captures a moving image including a plurality of the original images,
It said original image acquisition step acquires the plurality of original images included in the moving image captured by the imaging device,
The feature region determination step determines whether or not the characteristic region exists in each of the plurality of original images;
In the image correction step, the image of the characteristic region in the original image in which it is determined in the characteristic region determination step that the characteristic region exists is restored by the one inverse filter,
In the image output step, the original image determined that the characteristic region exists in the feature region determination step is an image obtained by restoring the image of the characteristic region in the image correction step, and the feature The image processing method according to claim 8 or 9 , wherein an original image for which it is determined that the characteristic region does not exist in the region determination step is output to the image display device . The image processing method according to claim 10 , wherein the characteristic region determination step determines whether the characteristic region exists in each of a plurality of original images based on a motion vector included in the moving image. The feature region determination step determines whether there is a moving object in each of a plurality of original images based on a motion vector included in the moving image;
12. The image according to claim 11 , wherein in the image correction step, an image of a region where a moving object exists in the original image determined that a moving object exists in the feature region determination step is restored by the one inverse filter. Processing method. The feature region determination step determines whether or not there is a temporally changing region in each of a plurality of original images, based on a motion vector included in the moving image,
The image correction step, according to claim 11, that the said characteristic region determining step time varying region in is present an image of a region temporally change in original image determination is restored by the one of the inverse filter An image processing method described in 1. The image according to any one of claims 8 to 13 , wherein the characteristic region determination step determines whether or not the characteristic region exists in the original image based on a color included in the original image. Processing method.

Images