JP2010136092A - Image processor, image formation device, and method and program for processing image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor capable of improving processing speed, an image formation device, and a method and program for processing an image. <P>SOLUTION: When selecting predetermined photograph image data from among a plurality of photograph image data by an image data selection part 18, the photograph image data are automatically selected based on an element extracted from thumbnail image data related to the respective photograph image data instead of an element extracted from the respective photograph image data. The thumbnail image data are included in Exif data stored being related to the respective photograph image data. By thus selecting the predetermined photograph image data based on the thumbnail image data low in resolution relative to photograph image data, the processing speed can be improved. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image forming apparatus, an image processing method, and an image processing program for performing processing for selecting predetermined photographic image data from a plurality of photographic image data.

  In recent years, as an example of services related to photographic prints, multiple photographic prints are generated based on photographic image data read from each frame image of developed photographic film and photographic image data obtained by taking a picture with a digital camera. In addition, a service for creating an album by filing or binding them is known (see, for example, Patent Document 1).

JP 2002-178588 A

  When the customer who is the user of the service selects photo image data to be assigned to each page of the album as described above, the selection takes time and the work is complicated. For example, when the above-described work is performed at an orderer's reception terminal installed in a store such as a photo shop, there is a problem that the occupied time of the orderer's reception terminal becomes longer and the turnover rate of the customer becomes worse. is there. In addition, the problem of simplifying the work of selecting photo image data is not only when ordering using the orderer's reception terminal as described above, but also when the customer is installed at home via an Internet line, for example. This is also a problem that occurs when placing an order using a personal computer.

  Therefore, the applicant of the present application scores each photographic image data in the previous application (Japanese Patent Application No. 2008-232378) based on the elements extracted from each photographic image data (album image data). Based on the above, we proposed a technology that can automatically select photo image data to be assigned to each page of an album.

  However, the technique as described above has a problem that processing takes time because various elements are extracted from photographic image data having a relatively high resolution and scored. In particular, when the number of target photographic image data is large, the time required for processing all photographic image data becomes very long. When such processing is performed at the orderer's reception terminal, the customer The turnover rate will be very poor.

  The above problems may occur not only when an album is produced, but also when a print other than an album is produced. For example, when a plurality of photo image data is selected and printed on a single sheet of paper, such as a collage photo, when the above scoring process is used for each photo image data In addition, there is a problem that the processing takes time. Note that the size of each image based on a plurality of photographic image data printed on one sheet in a collage photo is the size that is normally printed as one photographic print based on each photographic image data (such as L size). Smaller than).

  In the case of a collage photo, since a large number of photographic image data is printed on one sheet, there is a tendency that details other than several pleasing photographic image data are not regarded as important. Therefore, the collage photo has a feature that it is not necessary to make a highly accurate determination for each photo image data.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an image processing apparatus, an image forming apparatus, an image processing method, and an image processing program capable of improving the processing speed.

  An image processing apparatus according to a first aspect of the present invention is an image processing apparatus that performs processing for selecting predetermined photographic image data from among a plurality of photographic image data, and a thumbnail associated with each photographic image data. An image data selection means for selecting the predetermined photographic image data based on an element extracted from the image data is provided.

  According to such a configuration, when predetermined photographic image data is selected from a plurality of photographic image data, the thumbnail image data associated with each photographic image data is not an element extracted from each photographic image data. The photographic image data is automatically selected based on the elements extracted from. As described above, the processing speed can be improved by selecting the predetermined photographic image data based on the thumbnail image data having a lower resolution than the photographic image data.

  An image processing apparatus according to a second aspect of the present invention comprises image determining means for determining each photographic image data based on elements extracted from the thumbnail image data, and the image data selecting means includes the image determining means. The predetermined photographic image data is selected on the basis of the determination result of the above.

  According to such a configuration, the determination is performed based on the elements extracted from the thumbnail image data associated with each photographic image data, and the predetermined photographic image data is selected based on the determination result. Therefore, even when a complicated determination process is performed, the processing speed can be effectively improved by performing the determination based on thumbnail image data having a relatively low resolution.

  In the image processing apparatus according to the third aspect of the present invention, the element extracted from the thumbnail image data includes an element extracted from a person image included in the thumbnail image data.

  According to such a configuration, by selecting photographic image data based on the elements extracted from the human image included in the thumbnail image data, it is possible to select the photographic image data by paying attention to the captured human image. it can.

  In the image processing apparatus according to the fourth aspect of the present invention, the element extracted from the person image includes at least one of an element related to the size of the photographed person's face and an element related to the number of photographed persons. Is included.

  According to such a configuration, by selecting the photographic image data based on each element, the photographic image data can be suitably selected by paying attention to the photographed person image.

  An image forming apparatus according to a fifth aspect of the present invention is an image forming apparatus that generates a photographic print by selecting predetermined photographic image data from a plurality of photographic image data, and is associated with each photographic image data. Based on the elements extracted from the thumbnail image data, an image data selection means for selecting the predetermined photographic image data, and a photographic print is generated based on the predetermined photographic image data selected by the image data selection means. And an image forming unit.

  According to such a configuration, it is possible to provide an image forming apparatus that exhibits the same effect as the image processing apparatus.

  In an image forming apparatus according to a sixth aspect of the present invention, the image forming unit prints the predetermined photographic image data selected by the image data selecting unit on a sheet of paper.

  According to such a configuration, a collage photo can be produced by printing the selected predetermined photo image data on one sheet. In the case of a collage photo, a large number of photographic image data is printed on one sheet, and therefore, there is a tendency that details other than several pleasing photographic image data are not regarded as important. Therefore, selecting photo image data based on the elements extracted from the thumbnail image data, even if the selection accuracy is lower than when selecting based on the elements extracted from the photo image data, the collage photo Problems such as worsening the appearance of Also, by selecting photographic image data based on elements extracted from thumbnail image data, it looks good even if the selection accuracy is lower than when selecting based on elements extracted from photographic image data. Photo image data can be selected reliably. That is, it can be said that the present invention is particularly suitable for collage photography.

  An image processing method according to a seventh aspect of the present invention is an image processing method for performing processing for selecting predetermined photographic image data from among a plurality of photographic image data, wherein the thumbnails associated with each photographic image data An image data selection step for selecting the predetermined photographic image data based on an element extracted from the image data is provided.

  According to such a configuration, it is possible to provide an image processing method having the same effects as those of the image processing apparatus.

  An image processing program according to an eighth aspect of the present invention is an image processing program for causing a computer to perform processing for selecting predetermined photographic image data from among a plurality of photographic image data. It is made to function as an image data selection means for selecting the predetermined photographic image data based on elements extracted from thumbnail image data associated with the data.

  According to such a configuration, it is possible to provide an image processing program that exhibits the same effect as the image processing apparatus.

  According to the present invention, the processing speed can be improved by selecting predetermined photo image data based on thumbnail image data having a lower resolution than that of the photo image data.

  FIG. 1 is a schematic cross-sectional view showing a configuration example of an image forming apparatus 3 according to an embodiment of the present invention. The image forming apparatus 3 is composed of, for example, an ink jet printer, and can print an image based on the image data on one side or both sides of the paper P. Note that the image forming apparatus 3 is not limited to an ink jet printer, and may be a thermal transfer printer, a laser printer, or a silver salt printer.

  The printing process by the image forming apparatus 3 is as follows. In this configuration, a sheet of paper P (inkjet paper) is stocked in the paper stock section 30, and the paper P is conveyed downstream by a paper feed mechanism. The conveyed paper P is sucked by the suction unit 32 of the image forming unit 37 and is primarily held. The image forming unit 37 includes print heads 31 for C (cyan), M (magenta), Y (yellow), and K (black). The print head 31 performs one scan in the main scanning direction with respect to the paper P that is intermittently transported, and ink is ejected from the ink ejection nozzles of each color during this scanning and is attached to the surface of the paper P. By repeating this intermittent conveyance, main scanning operation, and ink ejection operation, an image is formed in the print area of the paper P.

  Next, the sheet P on which the image is formed is conveyed to the cutting unit 33. In the case of single-sided printing, the cutting unit 33 (for example, a rotating blade) cuts unnecessary portions in the paper P by moving in the paper width direction. In the case of double-sided printing, the cutting process may be executed after completion of double-sided printing. Next, in the case of single-sided printing, information such as an identification number, a frame number, and a date is printed on the back side of the paper P by back printing means (not shown). This back printing process is an arbitrary process. Next, the image forming surface of the paper P is dried by the drying unit 34 on the downstream side of the conveyance. The dried paper P is turned upside down in the process of being conveyed upward, and is discharged to the discharge unit 36. In the case of duplex printing, the rear end of the paper P is held by the reverse mechanism 35, and the reverse mechanism 35 is displaced so as to transport the paper P from the rear end to the upstream side of the image forming unit 37. In the image forming unit 37, the back side is subjected to print processing, then cut as necessary, then dried, and the paper P2 printed on both sides is discharged to the discharge unit 36.

  In the image forming apparatus 3, a photographic print can be obtained by printing an image on a sheet based on image data obtained by photographing a subject (hereinafter referred to as “photo image data”). By using such an image forming apparatus 3 and printing a large number of photographic image data on one sheet, a so-called collage photograph can be produced. Further, if a plurality of photographic image data assigned to a plurality of pages are printed for each page and the plurality of photographic prints are filed or bound, an album consisting of a plurality of pages can be produced.

  In this embodiment, since printing is possible on both sides of the paper P, if a photographic print in which images are formed on both sides is generated and then filed or bound, the image is arranged on a page in a spread state (spread page). Can make an album. In an album in which images are arranged on such a spread page, more images can be browsed simultaneously. However, the present invention can be applied not only to the image forming apparatus 3 capable of double-sided printing as described above but also to an image forming apparatus capable of only single-sided printing.

  2 and 3 are block diagrams showing a configuration example of the image processing apparatus 1 according to the embodiment of the present invention. The image processing apparatus 1 is provided in the image forming apparatus 3 and performs processing for selecting predetermined photographic image data from a plurality of photographic image data. The image processing apparatus 1 includes a control unit including, for example, a CPU (Central Processing Unit), and functions as various functional blocks when the control unit executes a computer program. Specifically, the control unit functions as a group classification unit 11, a group determination unit 12, an image edit determination unit 13, an image data extraction unit 14, a collage processing unit 15, an album processing unit 16, and the like. .

  In addition, the image processing apparatus 1 includes a memory, and various storage units are assigned to the storage area of the memory. Specifically, an image data storage unit 21, a group data storage unit 22, an extracted image data storage unit 23, a representative image data storage unit 24, and the like are allocated to the memory. However, each said memory | storage part may be comprised by a separate memory. Each storage unit is not limited to a configuration built in the image processing apparatus 1 and may be configured by an external memory.

  The image data storage unit 21 can store a plurality of photographic image data. The image data storage unit 21 receives photographic image data read by a scanner device, photographic image data input to an orderer's reception terminal installed in a store, etc., received from a user terminal via the Internet by a network reception terminal Photo image data and the like can be stored. Examples of the photographic image data stored in the image data storage unit 21 include photographic image data read from each frame image of a developed photographic film, and photographic image data obtained by photographing with a digital camera.

  Each photographic image data is stored in association with so-called Exif data. The Exif data includes, for example, the shooting date / time of each photographic image data, the editing date / time for each photographic image data, thumbnail image data obtained by the reduction process for each photographic image data, and the like. The shooting date and time is an example of time information, and may be automatically given by the function of the camera at the time of shooting, or may be given by the user's operation as long as the information represents time. Also good.

  The group classification unit 11 classifies the plurality of photographic image data stored in the image data storage unit 21 into different groups at predetermined time intervals based on the shooting date and time associated with each photographic image data. The predetermined time interval can be set in an arbitrary unit such as a day unit, an hour unit, a minute unit, or a second unit. For example, the configuration may be such that photographic image data taken on the same day is classified into the same group, and the shooting interval is very short (for example, within 1 minute) as in the case of continuous photography or re-taking. The configuration may be such that the photographic image data is classified into the same group. The information of the photographic image data classified by the group classification unit 11 is stored in the group data storage unit 22 as group data.

  The group determination unit 12 is a group determination unit for determining the type of group into which each photographic image data is classified. In this example, a group consisting of photographic image data taken within a very short predetermined time (for example, within one minute) is a continuous photo group consisting of photographic image data obtained by continuous photography, or shooting within a predetermined time. It is possible to determine which of the re-shooting groups is made up of the photographic image data shot by the correction.

  More specifically, when the shooting interval of each photographic image data is determined to be constant based on the shooting date and time associated with each photographic image data, by shooting at a fixed interval by the function of the camera It can be determined as photographic image data of the obtained continuous photograph. On the other hand, when it is determined that the shooting interval of each photographic image data is not constant based on the shooting date and time associated with each photographic image data, the photographic image obtained by the photographer manually re-taking It can be determined as data.

  The image edit determination unit 13 is an image edit determination unit that determines whether each photo image data is edited. In this example, the image edit determination unit 13 performs determination based on Exif data associated with each photo image data. Can be done. That is, when photographic image data is edited using editing software or the like, the editing date is stored as Exif data. Therefore, if the editing date is stored, the edited photo is stored. It can be determined as image data. However, the present invention is not limited to such a configuration. For example, a configuration in which edited photo image data is determined by identifying a specific file name attached to the edited photo image data may be employed. It is.

  The image data extraction unit 14 is an image data extraction unit that extracts only some photographic image data from each group into which photographic image data is classified. As processing, processing for reducing the number of photographic image data is performed. Photo image data extracted from each group by the image data extraction unit 14 is stored in the extracted image data storage unit 23 as extracted image data.

  Each group includes a plurality of pieces of photographic image data taken within a predetermined time. In this example, based on the shooting date and time, which is time information associated with each photographic image data, Photo image data can be extracted from the image. More specifically, for the group determined as the re-taken group by the group determination unit 12, only the photographic image data with the latest shooting date and time is extracted.

  The image data extraction unit 14 always extracts photographic image data determined to be edited by the image editing determination unit 13 when extracting photographic image data from each group. In other words, the photographic image data removed by the image data extraction unit 14 does not include the photographic image data determined to be edited by the image editing determination unit 13.

  The collage processing unit 15 determines representative image data representing each group by selecting a predetermined number of photographic image data from the extracted image data stored in the extracted image data storage unit 23, and A process (collage process) of assigning a plurality of selected representative image data to one sheet is performed. A plurality of representative image data assigned in this manner is printed on one sheet by the image forming unit 37, so that a collage photo is produced.

  The album processing unit 16 determines representative image data representing each group by selecting a predetermined number of photographic image data from the extracted image data stored in the extracted image data storage unit 23, and A process (album process) of assigning the selected representative image data to each page of the album is performed. A plurality of representative image data assigned in this way is printed on a plurality of sheets in the image forming section 37, and an album is produced by filing or binding these photo prints.

  In the present embodiment, the configuration in which the image processing apparatus 1 includes both the collage processing unit 15 and the album processing unit 16 will be described. However, the configuration is not limited to such a configuration, and either the collage processing unit 15 or the album processing unit 16 is used. The structure provided only with one side may be sufficient.

  The configurations of the collage processing unit 15 and the album processing unit 16 are as shown in FIG. 3, and each includes an image determination unit 17, an image data selection unit 18, an image data number adjustment unit 19, and an image data arrangement unit 20. .

  The image determination unit 17 is an image determination unit that determines each piece of photographic image data extracted as extracted image data. The above determination is to determine more suitable photographic image data as photographic image data to be assigned to each page of a collage photo or album, and is hereinafter referred to as “best shot determination”. In the present embodiment, the best shot determination is performed based on the elements extracted from the thumbnail image data included in the Exif data of each photo image data, and based on the determination result, the image data selection unit 18 selects a predetermined shot from each group. The photographic image data is selected. That is, the image data selection unit 18 constitutes image data selection means for selecting predetermined photographic image data based on elements extracted from thumbnail image data associated with each photographic image data.

  More specifically, based on the elements extracted from the thumbnail image data, only the photographic image data determined to satisfy a predetermined condition is selected by the image data selection unit 18. Photo image data selected from each group by the image data selection unit 18 is stored in the representative image data storage unit 24 as representative image data of each group. However, the present invention is not limited to the configuration in which the photographic image data is selected based on the elements extracted from the thumbnail image data as in the present embodiment, and the photographic image is based on the elements extracted from the photographic image data (original image data). It is also possible to adopt a configuration for selecting data.

  The elements extracted from the thumbnail image data can include elements extracted from a person image included in the thumbnail image data, but are not limited to such elements, and other elements such as elements extracted from a background image can be used. The various elements of can be extracted. The elements extracted from the person image include, for example, an element related to the size of the face of the photographed person and an element related to the number of photographed persons. However, the configuration is not limited to extracting both of the two elements, and may be configured to extract only one of the two elements.

  The above two elements are elements that can be extracted with relatively high accuracy even if the thumbnail image data has a lower resolution than that of the photographic image data. Elements relating to the age of the photographed person, elements relating to opening and closing the eyes of the photographed person, elements relating to exposure of the face of the photographed person, elements relating to the focus on the photographed person, and elements of the photographed person The configuration may be such that at least one of other various elements such as an element relating to composition on the photographic image data is extracted.

  The image data number adjusting unit 19 is an image data number adjusting unit that adjusts so that the prescribed number of photographic image data is selected when the number of selected photographic image data by the image data selecting unit 18 is not the prescribed number. That is, when creating a collage photo or album, there is a suitable value for the number of photographic image data to be allocated, but when that value is a specified number, only photographic image data determined to satisfy a predetermined condition May be selected by the image data selection unit 18, the number of selected photographic image data may be larger than the prescribed number or less than the prescribed number. In such a case, a collage photo or album can be suitably created by adjusting the number of selected photo image data by the image data number adjusting unit 19.

  In the present embodiment, the image data number adjusting unit 19 adjusts the number of selected photographic image data based on the shooting date and time as time information included in the Exif data of each photographic image data. A selection canceling unit 191 that cancels the selection of data and an addition selecting unit 192 that additionally selects photo image data are provided. In this embodiment, the case where the specified number is set in a range that is greater than or equal to the minimum number of images and less than the maximum number of images will be described. However, the present invention is not limited to such a configuration, and the specified number is set to one constant. Such a configuration may be used.

  When the number of photographic image data selected by the image data selection unit 18 and stored in the representative image data storage unit 24 is greater than the maximum number of images, the selection canceling unit 191 determines the difference between the selected number and the maximum number of images. The number of photographic image data corresponding to the number is deleted from the representative image data storage unit 24, so that the selection of the photographic image data is canceled and the selection number of the photographic image data is adjusted within the prescribed number range. It is. More specifically, based on the shooting date and time associated with each piece of photographic image data selected by the image data selection unit 18, a photographic image is obtained for each predetermined number of these photographic image data in time series. A process for deselecting data is performed. That is, when the photographic image data selected by the image data selection unit 18 are arranged in time series, the selection of the photographic image data is released at equal intervals for each predetermined number.

The predetermined number (deselection interval) is based on a value obtained by dividing the number of photographic image data selected by the image data selection unit 18 by a number (excess number) corresponding to the difference between the selected number and the maximum number of images. Is calculated. For example, the excess number can be calculated by the following formula (1), and the selection cancellation interval can be calculated by the following formula (2). The value calculated as the deselection interval may not be an integer. In this case, the selection of the photo image data is canceled at each deselection interval, using the value rounded to the nearest decimal point as the deselection interval. The
(Excess number) = (number of selections) − (maximum number of images) (1)
(Deselection interval) = {(Number of selections) / (Number of excess)} + 0.5 (2)

  In the present embodiment, as described above, the selection canceling unit 191 cancels the selection of photo image data for each predetermined number from the photo image data selected by the image data selecting unit 18 in time series. However, the present invention is not limited to such a configuration, and a configuration in which the selection canceling unit 191 cancels the selection of photographic image data in another manner may be used. For example, the selection canceling unit 191 may be configured to cancel the selection of photo image data at predetermined time intervals in time series from the photo image data selected by the image data selecting unit 18. . That is, when the photographic image data selected by the image data selection unit 18 are arranged in time series, the selection of the photographic image data with the closest shooting date / time is canceled at each predetermined time interval. Such a configuration may be used.

  When the number of photographic image data selected by the image data selection unit 18 and stored in the representative image data storage unit 24 is less than the minimum number of images, the additional selection unit 192 calculates the difference between the selection number and the minimum number of images. It is an additional selection means for adjusting the number of selected photographic image data within the range of the prescribed number by additionally selecting and storing the number of photographic image data corresponding to the number in the representative image data storage unit 24. More specifically, each photographic image data that does not satisfy the predetermined condition, that is, each photographic image data that is not selected by the image data selection unit 18 among the photographic image data stored in the extracted image data storage unit 23. Based on the associated shooting date and time, a process of additionally selecting photographic image data for each predetermined number of these photographic image data in a time series is performed. That is, when the pieces of photographic image data not selected by the image data selection unit 18 among the photographic image data stored in the extracted image data storage unit 23 are arranged in chronological order, photographs are taken at equal intervals for each predetermined number. Image data is additionally selected.

The predetermined number (additional selection interval) is the number of photographic image data not selected by the image data selection unit 18 among the photographic image data stored in the extracted image data storage unit 23 (unselected number). It is calculated based on a value obtained by dividing by the number (shortage number) corresponding to the difference between the number and the minimum image number. For example, the shortage number can be calculated by the following mathematical formula (3), and the additional selection interval can be calculated by the following mathematical formula (4). The value calculated as the additional selection interval may not be an integer. In this case, the photographic image data is additionally selected for each additional selection interval, using the value rounded to the nearest decimal point as the additional selection interval. .
(Insufficient number) = (Minimum number of images) − (Number of selections) (3)
(Additional selection interval) = {(Number of unselected) / (Number of shortage)} + 0.5 (4)

  In the present embodiment, as described above, a configuration is described in which the additional selection unit 192 additionally selects photographic image data for each predetermined number according to a time series from each photographic image data that does not satisfy the predetermined condition. However, the configuration is not limited to such a configuration, and a configuration in which the additional selection unit 192 additionally selects photographic image data in another manner may be employed. For example, the configuration may be such that the additional selection unit 192 additionally selects photographic image data at predetermined time intervals in time series from the photographic image data not satisfying the predetermined condition. In other words, when the photographic image data not satisfying the predetermined condition is arranged in time series, the photographic image data having the closest associated shooting date and time is additionally selected at each predetermined time interval. It may be.

  The number of selections is adjusted by the image data number adjustment unit 19, and a plurality of photographic image data stored in the representative image data storage unit 24 as representative image data is read by the image data arrangement unit 20. Then, it is assigned to one sheet by the image data placement unit 20 of the collage processing unit 15 or assigned to each page of the album by the image data placement unit 20 of the album processing unit 16. If photographic image data assigned by the image data placement unit 20 of the collage processing unit 15 is printed by the image forming unit 37, a collage photo can be produced. On the other hand, if the photographic image data assigned by the image data arrangement unit 20 of the album processing unit 16 is printed by the image forming unit 37 and those plural photographic prints are filed or bound, an album can be produced.

  Various modes can be adopted as the mode of photographic image data assignment by the image data placement unit 20, but a configuration in which the photographic image data is assigned according to time series, for example, may be employed. Further, at the time of the best shot determination by the image determination unit 17, points are assigned to each photographic image data based on the elements extracted from the thumbnail image data associated with each photographic image data, and in order according to the points. The structure which allocates may be sufficient. In this case, for example, the configuration may be such that each photographic image data is assigned in the order of increasing or decreasing points, or the photographic image data once arranged in the order of increasing or decreasing points is shuffled and assigned. There may be.

  FIG. 4 is a flowchart showing an example of processing when the image data extraction unit 14 extracts photographic image data. Extraction of photographic image data by the image data extraction unit 14 is performed for each group classified in advance by the group classification unit 11. First, when the photo image data classified into each group includes photo image data determined to be edited by the image editing determination unit 13 (Yes in step S101), the photo Image data is extracted from the group and stored in the extracted image data storage unit 23 (step S102).

  Also, for photographic image data that has not been determined to be edited by the image editing determination unit 13, if the shooting interval is within one minute (Yes in step S104), some photographic images are processed according to the following processing. Only data is extracted. That is, when each photographic image data is arranged in chronological order based on the photographing date and time, two photographic image data whose adjacent photographing image data has a photographing date interval (the photographing interval) within one minute are continuously 2 pieces. When there are two or more, only a part of the continuous photographic image data is extracted. However, the threshold of the photographing interval is not limited to “1 minute”, and may be another value.

  When there are three or more consecutive photographic image data whose shooting intervals are within one minute (Yes in step S104), it is determined whether the shooting intervals between the adjacent photographic image data are constant. (Step S105). As a result, if the shooting interval between adjacent photographic image data is constant (Yes in step S105), it is determined as photographic image data of a continuous photo obtained by shooting at a fixed interval by the function of the camera (step S105). S106). For a plurality of consecutive photographic image data determined as photographic image data of continuous photographs in this way, only the photographic image data determined to be most suitable by the above-described best shot determination is extracted, and the extracted image data storage unit 23 (Step S107).

  When there are only two photographic image data whose shooting intervals are within one minute (No in step S104), or there are three or more photographic image data whose shooting intervals are within one minute. (Yes in step S104) If the shooting interval between the adjacent photographic image data is not constant (No in step S105), it is determined as photographic image data obtained by the photographer manually re-taking. (Step S108). With regard to a plurality of consecutive photographic image data determined as retaken photographic image data in this way, only photographic image data with the latest photographing date and time is extracted and stored in the extracted image data storage unit 23 (step S109). ).

  In the present embodiment, when only a part of the photographic image data is automatically extracted from the plurality of photographic image data, the photographic image data determined to be edited is always extracted. Since the edited photographic image data can be presumed to be preferable photographic image data for the customer, the photographic image data can be suitably extracted by a simple process such as necessarily extracting the edited photographic image data.

  In particular, in this embodiment, since it is possible to easily determine whether or not the photo image data is edited based on the Exif data associated with each photo image data, it is preferable to use a simpler process to suitably take a photo. Image data can be extracted.

  Further, in the present embodiment, time information (shooting date and time) associated with each piece of photographic image data from a group of a plurality of photographic image data shot in a predetermined time (in this example, a retake group). Based on the above, only a part of the photographic image data can be automatically extracted. In this way, by extracting photographic image data based on the time information associated with each photographic image data, compared to a configuration that performs complex determination processing etc. on each photographic image data, more Photographic image data can be suitably extracted by simple processing.

  In particular, in the present embodiment, a photographic image is preferably obtained by a simple process of extracting photographic image data having the latest associated time information for a re-taking group composed of photographic image data taken by re-taking. Data can be extracted. When re-taking is performed, it can be estimated that among the plurality of photographic image data taken within the re-taking time, the photographic image data taken last is the most preferable photographic image data for the photographer. In such a case, by extracting the last photographed image data, that is, the image image data with the latest associated time information, the image image data can be suitably extracted with simpler processing. it can.

  However, as in the present embodiment, not only the configuration for extracting the photographic image data with the slowest associated time information, only for the re-taking group consisting of the photographic image data taken by re-taking, For example, a configuration may be adopted in which photographic image data with the latest associated time information is extracted for a continuous photo group made up of photographic image data obtained from continuous photos. Further, a configuration may be adopted in which photographic image data determined to be the most suitable by the best shot determination is extracted for a re-shooting group composed of photographic image data taken by re-shooting.

  In addition, when extracting photographic image data using the best shot determination, it is not limited to the configuration in which only the photographic image data determined to be most suitable by the best shot determination is extracted, for example, determined to be preferable. The configuration may be such that the upper predetermined number of photographic image data is extracted. Further, not only the best shot determination but also a configuration in which photographic image data other than the photographic image data having the slowest time information in each group is extracted using another method. Further, the mode of extracting the photographic image data by the image data extraction unit 14 is not limited to the above-described configuration, and the degree of exposure is determined based on, for example, an element related to the exposure of the face of the photographed person. A configuration may be adopted in which photographic image data that is equal to or less than the threshold is not extracted.

  FIG. 5 is a flowchart illustrating an example of processing when the image determination unit 17 performs best shot determination. The best shot determination in the present embodiment is performed based on the elements extracted from the thumbnail image data as described above.

  More specifically, whether or not there are four or more photographed persons is determined based on an element relating to the number of photographed persons extracted from the thumbnail image data (step S201), and the thumbnail image. Based on an element relating to the size of the face of the photographed person extracted from the data, it is determined whether the ratio of the face image of the photographed person in the entire photographic image data is 40% or more (step S202). ). Since an algorithm for detecting a human face image from image data is well known, a detailed description thereof will be omitted.

  The determination based on the element relating to the number of photographed persons is performed, for example, by counting the number of face images included in the photographic image data. In addition, when the size of the face image is equal to or smaller than a predetermined size, a configuration that does not count as the number of people may be employed.

  The determination based on the element related to the size of the photographed person's face is performed, for example, by quantifying the ratio of the face image to the entire photographic image data. If the face image of a plurality of persons is included in the photo image data, the ratio of the face image to the entire photo image data is quantified based on the largest face image among the face images. The determination may be made according to the above.

  When the number of photographed persons is four or more (Yes in Step S201), or when the ratio of the photographed person's face image in the entire photographic image data is 40% or more (Yes in Step S202), The photograph image data is selected as representative image data and stored in the representative image data storage unit 24. On the other hand, when the number of photographed persons is less than four (No in step S201), or when the ratio of photographed person face images in the entire photographic image data is less than 40% (No in step S202). ), The photographic image data is not selected as representative image data.

  The processing as described above is performed for each group for all the photographic image data stored in the extracted image data storage unit 23 (Yes in step S204), whereby representative image data for each group is selected. As described above, by selecting predetermined photo image data from a plurality of photo image data extracted from a plurality of groups, a variety of albums and collage photos can be produced. In particular, by making a determination only for a plurality of photographic image data extracted from a plurality of groups, the processing speed can be improved as compared with a case where determination is made for all the photographic image data of each group. .

  In this embodiment, when selecting predetermined photographic image data from a plurality of photographic image data, it is extracted from thumbnail image data associated with each photographic image data, not elements extracted from each photographic image data. The photographic image data is automatically selected based on the elements to be selected. As described above, the processing speed can be improved by selecting the predetermined photographic image data based on the thumbnail image data having a lower resolution than the photographic image data.

  In particular, in the present embodiment, determination (best shot determination) is performed based on elements extracted from thumbnail image data associated with each photographic image data, and the predetermined photographic image data is determined based on the determination result. Selected. Therefore, even when a complicated determination process is performed, the processing speed can be effectively improved by performing the determination based on thumbnail image data having a relatively low resolution.

  Further, in this embodiment, by selecting photographic image data based on elements extracted from human images included in thumbnail image data, it is possible to select photographic image data by focusing on the captured human images. . In particular, by selecting photographic image data based on an element relating to the size of the face of the photographed person or an element relating to the number of photographed persons, the photographic image data is preferably focused on the photographed person image. Can be selected.

  In the case of a collage photo, a large number of photographic image data is printed on one sheet, and therefore, there is a tendency that details other than several pleasing photographic image data are not regarded as important. Therefore, selecting photo image data based on the elements extracted from the thumbnail image data, even if the selection accuracy is lower than when selecting based on the elements extracted from the photo image data, the collage photo Problems such as worsening the appearance of Also, by selecting photographic image data based on elements extracted from thumbnail image data, it looks good even if the selection accuracy is lower than when selecting based on elements extracted from photographic image data. Photo image data can be selected reliably. That is, this embodiment can be said to be a form particularly suitable for collage photography.

  FIG. 6 is a flowchart showing an example of processing for adjusting the number of photographic image data selected by the image data number adjusting unit 19. After the best shot determination is performed in the manner described with reference to FIG. 5, after photographic image data satisfying a predetermined condition is selected (step S <b> 301), the number of selected photographic image data is the minimum number of images. It is determined whether or not it is in a range less than the maximum number of images (steps S302 and S303).

  If the selected number of photographic image data is larger than the maximum number of images (Yes in step S302), a process of canceling the selection of the number of photographic image data according to the difference between the selected number and the maximum number of images is performed. (Step S304). On the other hand, when the selected number of photographic image data is less than the minimum number of images (Yes in step S303), a process of additionally selecting the number of photographic image data according to the difference between the selected number and the minimum number of images is performed. (Step S305).

  As described above, the processing for adjusting the number of selections by canceling the selection of photographic image data or making additional selection is performed based on time information associated with each photographic image data. However, even when the number of selected photo image data is adjusted according to the above-described mode, the number of selected photo image data after the adjustment is not a specified number (a range that is greater than the minimum number of images and less than the maximum number of images). There is. In this case (No in step S306), the processes in steps S302 to S305 are executed again, and the process ends when the selected number of photographic image data reaches the specified number (Yes in step S306).

  In this embodiment, when photographic image data satisfying a predetermined condition is selected, even if the number of selections is not a stipulated number, the above stipulations are made based on the time information associated with each photographic image data. The number of photographic image data can be adjusted to be selected. In this way, by adjusting the number of photographic image data based on the time information associated with each photographic image data, compared to a configuration that performs complex determination processing etc. on each photographic image data The specified number of photographic image data can be selected by simpler processing.

  In particular, in this embodiment, when the number of selected photographic image data is larger than the specified number, the selection of the number of photographic image data corresponding to the difference between the selected number and the specified number is canceled, and the photographic image data If the selected number is less than the specified number, the specified number of photographic image data is selected by a simple process such as additionally selecting the number of photographic image data according to the difference between the selected number and the specified number. Can be adjusted.

  Further, in the present embodiment, the selected photographic image data is deselected in a predetermined time from the selected photographic image data by deselecting the photographic image data every predetermined number in time series. Since the selection can be canceled more uniformly from the plurality of photographic image data within the predetermined time, a specified number of photographic image data can be selected more suitably. On the other hand, photographic image data that does not satisfy the predetermined condition is taken within a predetermined time by additionally selecting photographic image data for each predetermined number of photographic image data that does not satisfy the predetermined condition in time series. Since a plurality of photographic image data can be additionally selected evenly within the predetermined time, a prescribed number of photographic image data can be selected more suitably.

  In the above embodiment, the configuration in which the image processing apparatus 1 is provided in the image forming apparatus 3 has been described. However, the present invention is not limited to such a configuration, and the image processing apparatus 1 is provided separately from the image forming apparatus 3. It may be a simple configuration.

1 is a schematic cross-sectional view illustrating a configuration example of an image forming apparatus according to an embodiment of the present invention. 1 is a block diagram illustrating a configuration example of an image processing apparatus according to an embodiment of the present invention. It is the block diagram which showed one structural example of the collage process part and the album process part. It is the flowchart which showed an example of the process at the time of extracting photographic image data by an image data extraction part. It is the flowchart which showed an example of the process at the time of performing best shot determination by an image determination part. It is the flowchart which showed an example of the process at the time of adjusting the number of the photographic image data selected by the image data number adjustment part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 3 Image forming apparatus 11 Group classification | category part 12 Group determination part 13 Image edit determination part 14 Image data extraction part 15 Collage process part 16 Album process part 17 Image determination part 18 Image data selection part 19 Image data number adjustment part 20 Image data placement unit 21 Image data storage unit 22 Group data storage unit 23 Extracted image data storage unit 24 Representative image data storage unit 37 Image forming unit 191 Selection canceling unit 192 Additional selection unit

Claims (8)

An image processing apparatus that performs processing for selecting predetermined photographic image data from a plurality of photographic image data,
An image processing apparatus comprising image data selection means for selecting the predetermined photographic image data based on elements extracted from thumbnail image data associated with each photographic image data. Image determining means for determining each photo image data based on the elements extracted from the thumbnail image data,
The image processing apparatus according to claim 1, wherein the image data selection unit selects the predetermined photographic image data based on a determination result by the image determination unit.   The image processing apparatus according to claim 1, wherein the elements extracted from the thumbnail image data include elements extracted from a person image included in the thumbnail image data.   The element extracted from the person image includes at least one of an element related to the size of the face of the photographed person and an element related to the number of photographed persons. The image processing apparatus described. An image forming apparatus for generating a photo print by selecting predetermined photo image data from a plurality of photo image data,
Image data selection means for selecting the predetermined photographic image data based on the elements extracted from the thumbnail image data associated with each photographic image data;
An image forming apparatus comprising: image forming means for generating a photographic print based on the predetermined photographic image data selected by the image data selecting means.   6. The image forming apparatus according to claim 5, wherein the image forming unit prints the predetermined photographic image data selected by the image data selecting unit on a sheet of paper. An image processing method for performing processing for selecting predetermined photographic image data from a plurality of photographic image data,
An image processing method comprising an image data selection step of selecting the predetermined photographic image data based on an element extracted from thumbnail image data associated with each photographic image data. An image processing program for causing a computer to perform processing for selecting predetermined photographic image data from a plurality of photographic image data,
The above computer
An image processing program that functions as image data selection means for selecting the predetermined photographic image data based on elements extracted from thumbnail image data associated with each photographic image data.

Images