JP2010146201A - Image processor, image forming apparatus, image processing method, and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor, an image forming apparatus, an image processing method, and an image processing program, by which a print rich in variety as whole configurations is created. <P>SOLUTION: This image processor is configured to read GPS information included in Exif data associated with each photographic image data, and to classify photographic image data whose GPS information is within a prescribed distance range into the same group (steps S101 to S103), and to select only a part of photographic image data from each group classified as above so that many photographic image data is prevented from being selected from among photographic image data within the prescribed distance range. Thus, the well balanced selection of the photographic image data photographed at various places is performed, and the print rich in variety as whole configurations is created. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image forming apparatus, an image processing method, and an image processing program for performing processing for selecting predetermined photographic image data from a plurality of photographic image data.

  In recent years, as an example of services related to photographic prints, multiple photographic prints are generated based on photographic image data read from each frame image of developed photographic film and photographic image data obtained by taking a picture with a digital camera. In addition, a service for creating an album by filing or binding them is known (see, for example, Patent Document 1).

JP 2002-178588 A

  When the customer who is the user of the service selects photo image data to be assigned to each page of the album as described above, the selection takes time and the work is complicated. For example, when the above-described work is performed at an orderer's reception terminal installed in a store such as a photo shop, there is a problem that the occupied time of the orderer's reception terminal becomes longer and the turnover rate of the customer becomes worse. is there. In addition, the problem of simplifying the work of selecting photo image data is not only when ordering using the orderer's reception terminal as described above, but also when the customer is installed at home via an Internet line, for example. This is also a problem that occurs when placing an order using a personal computer.

  Therefore, the applicant of the present application scores each photographic image data in the previous application (Japanese Patent Application No. 2008-232378) based on the elements extracted from each photographic image data (album image data). Based on the above, we proposed a technology that can automatically select photo image data to be assigned to each page of an album.

  However, in the technique as described above, for example, when moving to a plurality of places and shooting, most of the photographic image data selected based on the scoring result is photographic image data shot at a certain place, There is a possibility that photographic image data taken in other places is hardly selected. In such a case, photographic image data taken at various places cannot be selected in a balanced manner, and there is a possibility that the album will have a poor variety.

  The above problems may occur not only when an album is produced, but also when a print other than an album is produced. For example, even when multiple image data are selected and printed on a single sheet of paper, such as a collage photo, it is rich in variety by selecting the photo image data taken in various places in a balanced manner. It is preferable to produce a print. Note that the size of each image based on a plurality of photographic image data printed on one sheet in a collage photo is the size that is normally printed as one photographic print based on each photographic image data (such as L size). Smaller than).

  SUMMARY An advantage of some aspects of the invention is that it provides an image processing apparatus, an image forming apparatus, an image processing method, and an image processing program capable of producing a variety of prints as an overall configuration. And

  An image processing apparatus according to a first aspect of the present invention is an image processing apparatus that performs processing for selecting predetermined photographic image data from among a plurality of photographic image data, and a position associated with each photographic image data Group classification means for classifying photographic image data whose position information is within a predetermined distance range into the same group based on the information, and image data selection means for selecting only a part of the photographic image data from the group It is provided with.

  According to such a configuration, the photographic image data whose position information is within a predetermined distance range is classified into the same group, and only a part of the photographic image data is selected from the group, thereby the predetermined distance. It is possible to prevent a large amount of photographic image data from being selected from photographic image data within the range. As a result, photographic image data taken at various places can be selected in a well-balanced manner, and a variety of prints can be produced as an overall configuration.

  The image processing apparatus according to the second aspect of the present invention is characterized in that the position information is GPS information included in Exif data associated with each photographic image data.

  According to such a configuration, the GPS information included in the Exif data associated with each photographic image data is used to easily classify the photographic image data whose GPS information is within a predetermined distance range into the same group. be able to.

  An image processing apparatus according to a third aspect of the present invention includes image determination means for determining the plurality of photographic image data, and the image data selection means is based on a determination result by the image determination means. 3. The image processing apparatus according to claim 1, wherein only a part of the photographic image data is selected.

  According to such a configuration, a plurality of photo image data is determined, and a variety of albums, collage photos, and the like using a part of the photo image data selected from the group based on the determination result Can be produced.

  An image forming apparatus according to a fourth aspect of the present invention is an image forming apparatus that generates a photographic print by selecting predetermined photographic image data from a plurality of photographic image data, and is associated with each photographic image data. Group classification means for classifying photographic image data whose position information is within a predetermined distance range into the same group based on the position information, and image data selection means for selecting only a part of the photographic image data from the group And image forming means for generating a photographic print based on the photographic image data selected by the image data selecting means.

  According to such a configuration, it is possible to provide an image forming apparatus that exhibits the same effect as the image processing apparatus.

  An image processing method according to a fifth aspect of the present invention is an image processing method for performing processing for selecting predetermined photographic image data from among a plurality of photographic image data, and a position associated with each photographic image data A group classification step for classifying photographic image data whose position information is within a predetermined distance range into the same group based on the information, and an image data selection step for selecting only a part of the photographic image data from the group, It is provided with.

  According to such a configuration, it is possible to provide an image processing method having the same effects as those of the image processing apparatus.

  An image processing program according to a sixth aspect of the present invention is an image processing program for causing a computer to perform processing for selecting predetermined photographic image data from a plurality of photographic image data. Based on the position information associated with the data, group classification means for classifying the photographic image data whose position information is within a predetermined distance range into the same group, and only a part of the photographic image data from the group It functions as an image data selection means to select.

  According to such a configuration, it is possible to provide an image processing program that exhibits the same effect as the image processing apparatus.

  According to the present invention, since it is possible to prevent a large amount of photographic image data from being selected from among photographic image data whose position information is within a predetermined distance range, photographic image data taken at various locations. Can be selected in a well-balanced manner, and a variety of prints can be produced as an overall configuration.

  FIG. 1 is a schematic cross-sectional view showing a configuration example of an image forming apparatus 3 according to an embodiment of the present invention. The image forming apparatus 3 is composed of, for example, an ink jet printer, and can print an image based on the image data on one side or both sides of the paper P. Note that the image forming apparatus 3 is not limited to an ink jet printer, and may be a thermal transfer printer, a laser printer, or a silver salt printer.

  The printing process by the image forming apparatus 3 is as follows. In this configuration, a sheet of paper P (inkjet paper) is stocked in the paper stock section 30, and the paper P is conveyed downstream by a paper feed mechanism. The conveyed paper P is sucked by the suction unit 32 of the image forming unit 37 and is primarily held. The image forming unit 37 includes print heads 31 for C (cyan), M (magenta), Y (yellow), and K (black). The print head 31 performs one scan in the main scanning direction with respect to the paper P that is intermittently transported, and ink is ejected from the ink ejection nozzles of each color during this scanning and is attached to the surface of the paper P. By repeating this intermittent conveyance, main scanning operation, and ink ejection operation, an image is formed in the print area of the paper P.

  Next, the sheet P on which the image is formed is conveyed to the cutting unit 33. In the case of single-sided printing, the cutting unit 33 (for example, a rotating blade) cuts unnecessary portions in the paper P by moving in the paper width direction. In the case of double-sided printing, the cutting process may be executed after completion of double-sided printing. Next, in the case of single-sided printing, information such as an identification number, a frame number, and a date is printed on the back side of the paper P by back printing means (not shown). This back printing process is an arbitrary process. Next, the image forming surface of the paper P is dried by the drying unit 34 on the downstream side of the conveyance. The dried paper P is turned upside down in the process of being conveyed upward, and is discharged to the discharge unit 36. In the case of duplex printing, the rear end of the paper P is held by the reverse mechanism 35, and the reverse mechanism 35 is displaced so as to transport the paper P from the rear end to the upstream side of the image forming unit 37. In the image forming unit 37, the back side is subjected to print processing, then cut as necessary, then dried, and the paper P2 printed on both sides is discharged to the discharge unit 36.

  In the image forming apparatus 3, a photographic print can be obtained by printing an image on a sheet based on image data obtained by photographing a subject (hereinafter referred to as “photo image data”). By using such an image forming apparatus 3 and printing a large number of photographic image data on one sheet, a so-called collage photograph can be produced. Further, if a plurality of photographic image data assigned to a plurality of pages are printed for each page and the plurality of photographic prints are filed or bound, an album consisting of a plurality of pages can be produced.

  In this embodiment, since printing is possible on both sides of the paper P, if a photographic print in which images are formed on both sides is generated and then filed or bound, the image is arranged on a page in a spread state (spread page). Can make an album. In an album in which images are arranged on such a spread page, more images can be browsed simultaneously. However, the present invention can be applied not only to the image forming apparatus 3 capable of double-sided printing as described above but also to an image forming apparatus capable of only single-sided printing.

  FIG. 2 is a block diagram illustrating a configuration example of the image processing apparatus 1 according to an embodiment of the present invention. The image processing apparatus 1 is provided in the image forming apparatus 3 and performs processing for selecting predetermined photographic image data from a plurality of photographic image data. The image processing apparatus 1 includes a control unit including, for example, a CPU (Central Processing Unit), and functions as various functional blocks when the control unit executes a computer program. Specifically, the control unit functions as a group classification unit 11, an image determination unit 17, an image data selection unit 18, an image data arrangement unit 20, and the like.

  In addition, the image processing apparatus 1 includes a memory, and various storage units are assigned to the storage area of the memory. Specifically, an image data storage unit 21, a group data storage unit 22, a representative image data storage unit 24, and the like are allocated to the memory. However, each said memory | storage part may be comprised by a separate memory. Each storage unit is not limited to a configuration built in the image processing apparatus 1 and may be configured by an external memory.

  The image data storage unit 21 can store a plurality of photographic image data. The image data storage unit 21 receives photographic image data read by a scanner device, photographic image data input to an orderer's reception terminal installed in a store, etc., received from a user terminal via the Internet by a network reception terminal Photo image data and the like can be stored. Examples of the photographic image data stored in the image data storage unit 21 include photographic image data read from each frame image of a developed photographic film, and photographic image data obtained by photographing with a digital camera.

  Each photographic image data is stored in association with so-called Exif data. The Exif data includes, for example, the shooting date and time of each photographic image data, GPS (Global Positioning System) information that is an example of position information acquired at the time of shooting each photographic image data, the editing date and time for each photographic image data, and each photographic image Thumbnail image data obtained by the reduction process on the data is included. The shooting date and time is an example of time information, and may be automatically given by the function of the camera at the time of shooting, or may be given by the user's operation as long as the information represents time. Also good.

  The group classification unit 11 is a group classification unit that classifies a plurality of photographic image data stored in the image data storage unit 21 based on GPS information associated with each photographic image data. Photo image data within the range is classified into the same group. For this classification, for example, GPS information associated with each photographic image data stored in the image data storage unit 21 is sequentially used as a reference, and GPS information within the predetermined distance range is associated with the GPS information. This is done by classifying the obtained photographic image data into the same group. At this time, based on the latitude and longitude information specified by the GPS information associated with each photographic image data, the distance between the shooting locations of each photographic image data can be calculated. The information of the photographic image data classified by the group classification unit 11 is stored in the group data storage unit 22 as group data.

  However, the position information associated with each piece of photographic image data is not limited to GPS information, but may be other information that can specify the shooting location of each piece of photographic image data. In addition, the present invention is not limited to the configuration for calculating the distance between the shooting locations of each photographic image data. For example, the location name of the shooting location (prefecture name, city name, etc.) is specified based on position information such as GPS information. If the place names match, it may be determined that the position information is within a predetermined distance range and the corresponding photographic image data is classified into the same group.

  The image determination unit 17 is an image determination unit that determines each piece of photographic image data stored in the image data storage unit 21. The above determination is to determine more suitable photographic image data as photographic image data to be assigned to each page of a collage photo or album, and is hereinafter referred to as “best shot determination”. In the present embodiment, best shot determination is performed based on elements extracted from each photographic image data, and a predetermined number of photographic image data is selected from each group by the image data selection unit 18 based on the determination result. It is like that.

  That is, the image data selection unit 18 constitutes an image data selection unit that selects a predetermined number of photographic image data from each group based on the determination result by the image determination unit 17. The image data selection unit 18 may select all the photographic image data in any group depending on the result of the best shot determination, or only a part of the photographic image data from any group. You may choose. However, the configuration may be such that the number of photographic image data selected from each group can be set in advance.

  The image data selection unit 18 selects only photographic image data determined to satisfy a predetermined condition based on elements extracted from the photographic image data. Photo image data selected from each group by the image data selection unit 18 is stored in the representative image data storage unit 24 as representative image data of each group. However, the present invention is not limited to the configuration in which the photographic image data is selected based on the elements extracted from the photographic image data as in the present embodiment, but the elements extracted from the thumbnail image data included in the Exif data of each photographic image data. It is also possible to adopt a configuration in which photographic image data is selected based on the above.

  The elements extracted from the photographic image data can include elements extracted from a person image included in the photographic image data, but are not limited to such elements, for example, elements extracted from a background image, etc. The various elements of can be extracted. Elements extracted from the person image include, for example, an element related to the face size of the photographed person, an element related to the number of photographed persons, an element related to the smile level of the photographed person, and the age of the photographed person Elements related to the opening and closing of the eyes of the photographed person, elements related to the exposure of the face of the photographed person, elements related to the focus on the photographed person, elements related to composition of the photographed person on the image data, etc. Is included. However, the configuration is not limited to extracting all of the above elements, but may be configured to extract at least one of the above elements, or may be configured to extract other elements. Good.

  Of the above elements, the elements related to the size of the photographed person's face and the elements related to the number of photographed persons are relatively accurate even when the thumbnail image data has a lower resolution than the photograph image data. This is an extractable element. Therefore, in the case of a configuration in which photographic image data is selected based on elements extracted from thumbnail image data, a configuration in which only the two elements are extracted may be used.

  The plurality of photographic image data stored in the representative image data storage unit 24 as the representative image data is read by the image data arrangement unit 20. When creating a collage photo, each photo image data is assigned to one sheet by the image data placement unit 20, and when creating an album, each photo image data is sent to the album by the image data placement unit 20. Assigned to each page. The plurality of representative image data assigned in this way is printed on paper in the image forming unit 37.

  Various modes can be adopted as the mode of photographic image data assignment by the image data placement unit 20, but a configuration in which the photographic image data is assigned according to time series, for example, may be employed. Further, at the time of the best shot determination by the image determination unit 17, points are assigned to each photographic image data based on the elements extracted from the photographic image data associated with each photographic image data, and in the order corresponding to the points. The structure which allocates may be sufficient. In this case, for example, the configuration may be such that each photographic image data is assigned in the order of increasing or decreasing points, or the photographic image data once arranged in the order of increasing or decreasing points is shuffled and assigned. There may be.

  In this embodiment, the case where the image processing apparatus 1 functions as a collage processing unit that performs processing for creating a collage photo and an album processing unit that performs processing for creating an album will be described. However, the image processing apparatus 1 may function as either one of the collage processing unit or the album processing unit.

  FIG. 3 is a flowchart showing an example of processing when classifying photographic image data by the group classification unit 11. When classifying a plurality of photographic image data stored in the image data storage unit 21, GPS information included in Exif data associated with each photographic image data is sequentially read (step S101). Then, the GPS information associated with each photographic image data is sequentially used as a reference, and it is determined whether there is other photographic image data associated with GPS information within a predetermined distance range with respect to the GPS information. (Step S102).

  As a result of the determination, if there is photographic image data in which the GPS information within the predetermined distance range is associated with the reference GPS information (Yes in step S102), the photographic image data is set as the reference. The photographic image data is classified into the same group (step S103). By executing such processing for all the photographic image data (Yes in step S104), the plurality of photographic image data stored in the image data storage unit 21 are classified into a plurality of groups.

  FIG. 4 is a flowchart showing an example of processing when the image data selection unit 18 selects representative image data of each group. When representative image data of each group is selected, processing as described below is executed for each group.

  First, by extracting a face image from a person image included in each photographic image data, a process for detecting various information based on each organ constituting the face image is performed (step S201). Specifically, processing for estimating the orientation, gender, age, smile level, line of sight, etc. of the face, and detecting the opening and closing of each organ such as the eyes and mouth is performed. Since an algorithm for executing these processes is well known, detailed description thereof will be omitted.

  Thereafter, by using the result of face organ detection (step S201) as necessary, a process of scoring each element extracted from the photographic image data is performed (steps S202 to S209). After such processing has been performed on all the photographic image data included in each group (Yes in step S210), the upper predetermined number (one or more) of photographic image data having a high score is assigned to the group. It is determined as representative photographic image data (step S211). However, it is not limited to the configuration in which the top predetermined number of photographic image data with a high score is selected as the representative image data as described above. For example, photographic image data higher than a predetermined reference point is based on the scoring result. The configuration may be selected as representative image data.

  The face size scoring (step S202) is a process for scoring the elements related to the face size of the photographed person, and is performed, for example, by quantifying the ratio of the face image to the entire photographic image data. If the face image of a plurality of persons is included in the photo image data, the ratio of the face image to the entire photo image data is quantified based on the largest face image among the face images. The scoring may be performed by.

  The scoring of the number of people (step S203) is a process of scoring the elements related to the number of photographed persons, and is performed by counting the number of face images included in the photographic image data, for example. In addition, when the size of the face image is a predetermined size or less, a configuration in which the number of people is not counted, or a configuration in which points are added or subtracted according to the size of the face image may be employed.

  The smile degree scoring (step S204) is a process for scoring an element related to the smile degree of the photographed person. For example, a process of adding or subtracting points according to the smile degree measured based on the degree of opening / closing of the mouth or the like is performed. . In addition, when the size of the face image is equal to or smaller than the predetermined size, or when the angle of the face image is tilted by a predetermined angle or more with respect to the front, a configuration in which points are deducted or not scored may be employed. . It is also possible to adopt a configuration in which points are added or subtracted according to the number of face images included in the photographic image data.

  The age scoring (step S205) is a process of scoring about the age-related elements of the photographed person. For example, when a face image of a predetermined age is detected, a process of scoring or subtracting is performed. A configuration in which points are added or subtracted according to the size of the face image, or a configuration in which points are deducted or not scored when the angle of the face image is inclined by a predetermined angle or more with respect to the front, may be adopted. Good.

  The eye opening / closing scoring (step S206) is a process of scoring about the elements related to the opening / closing of the photographed person's eyes. For example, a process of adding or subtracting points according to the degree of eye opening / closing in the face image included in the photographic image data is performed. Is called. In addition, when the size of the face image is equal to or smaller than the predetermined size, or when the angle of the face image is tilted by a predetermined angle or more with respect to the front, a configuration in which points are deducted or not scored may be employed. . Further, in the case where face images of a plurality of persons are included in the photographic image data, the eye open / closed degree in these face images may be averaged for scoring.

  The face exposure scoring (step S207) is a process of scoring elements related to the exposure of the face of the photographed person. For example, the degree of the exposed part (the part being photographed) of the entire face in the face image included in the photographic image data. Depending on, a process of adding or subtracting points is performed. When face images of a plurality of persons are included in the photographic image data, the degree of exposure of these face images may be averaged for scoring.

  Focus scoring (step S208) is a process of scoring elements related to the focus of a photographed person. For example, a process of adding or subtracting points is performed according to the degree of focus matching with a face image included in photographic image data. However, the processing is not limited to focusing on a face image in photographic image data, and processing for adding or subtracting points according to the degree of focus on a portion other than the face in a human image or the focus on a portion other than a human image such as a background image is performed. It may be a simple configuration.

  Composition scoring (step S209) is a process of scoring elements related to composition on photographed image data of a photographed person. For example, according to the position of the person image included in the photograph image data in the photograph image data, A deduction process is performed. For example, the configuration may be such that the person image included in the photographic image data has a higher score as the person image is closer to the center of the photographic image data. It should be noted that it is possible to adopt a configuration in which scoring is performed in a different manner depending on whether one or more person images are included in the photographic image data.

  In the present embodiment, photographic image data whose GPS information is within a predetermined distance range is classified into the same group, and only a part of the photographic image data is selected from the group, so that the predetermined distance range is within the above-mentioned range. It is possible to prevent a large amount of photographic image data from being selected from certain photographic image data. As a result, photographic image data taken at various places can be selected in a well-balanced manner, and a variety of prints can be produced as an overall configuration.

  In particular, in this embodiment, using GPS information included in Exif data associated with each photographic image data, photographic image data in which each GPS information is within a predetermined distance range is easily classified into the same group. Can do.

  Further, in the present embodiment, a plurality of photo image data is determined, and a variety of albums, collage photos, and the like are used using a part of the photo image data selected from the group based on the determination result. Can be produced.

  In the above embodiment, the configuration in which the image processing apparatus 1 is provided in the image forming apparatus 3 has been described. However, the present invention is not limited to such a configuration, and the image processing apparatus 1 is provided separately from the image forming apparatus 3. It may be a simple configuration.

1 is a schematic cross-sectional view illustrating a configuration example of an image forming apparatus according to an embodiment of the present invention. 1 is a block diagram illustrating a configuration example of an image processing apparatus according to an embodiment of the present invention. It is the flowchart which showed an example of the process at the time of classifying photographic image data by a group classification part. It is the flowchart which showed an example of the process at the time of selecting the representative image data of each group by an image data selection part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 3 Image forming apparatus 11 Group classification | category part 17 Image determination part 18 Image data selection part 20 Image data arrangement | positioning part 21 Image data storage part 22 Group data storage part 24 Representative image data storage part 37 Image formation part

Claims (6)

An image processing apparatus that performs processing for selecting predetermined photographic image data from a plurality of photographic image data,
Group classification means for classifying the photo image data in which each position information is within a predetermined distance range into the same group based on the position information associated with each photo image data;
An image processing apparatus comprising: image data selection means for selecting only a part of photographic image data from the group.   The image processing apparatus according to claim 1, wherein the position information is GPS information included in Exif data associated with each photographic image data. Image determining means for determining the plurality of photographic image data,
The image processing apparatus according to claim 1, wherein the image data selection unit selects only a part of the photographic image data from the group based on a determination result by the image determination unit. An image forming apparatus for generating a photo print by selecting predetermined photo image data from a plurality of photo image data,
Group classification means for classifying the photo image data in which each position information is within a predetermined distance range into the same group based on the position information associated with each photo image data;
Image data selection means for selecting only a part of the photographic image data from the group;
An image forming apparatus comprising: image forming means for generating a photographic print based on the photographic image data selected by the image data selecting means. An image processing method for performing processing for selecting predetermined photographic image data from a plurality of photographic image data,
A group classification step for classifying the photo image data in which each position information is within a predetermined distance range into the same group based on the position information associated with each photo image data;
An image processing method comprising: an image data selection step for selecting only some photographic image data from the group. An image processing program for causing a computer to perform processing for selecting predetermined photographic image data from a plurality of photographic image data,
The above computer
Group classification means for classifying the photo image data in which each position information is within a predetermined distance range into the same group based on the position information associated with each photo image data;
An image processing program that functions as image data selection means for selecting only a part of photographic image data from the group.

Images