JP2009237703A - Image output method, device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mechanism for enabling a user to efficiently create a group image. <P>SOLUTION: The narrowing-down processing of images to be displayed in a list is carried out from read images. As narrowing-down conditions, a user turns active (on) buttons or icons corresponding to the photographic dates or folders or group pictures of necessary images through a selecting operation from an operation part 26, and narrows down the images to be displayed in a list by giving a limit to the images on the photographic date or folder, or narrows down the images to be displayed in the list by giving a limit to the images using a common specific parameter. The images narrowed-down for each condition are grouped, and the prescribed number of samples are selected from the group, and the display data of the list of samples categorized by the narrowing-down conditions are generated by classifying the thumb nails of the samples (or character strings in which the file names or tiles of the images are described) for each group, and output to a display 50. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a combination of images that convey a specific theme.

  Patent Document 1 discloses a photographing system that conveys a pose suitable for group photography to a user in an easy-to-understand manner.

Patent Document 2 discloses a system that uses face information when laying out a plurality of images on a single mount.
JP 2007-221409 A JP 2007-180651 A

  The group photo illustrated in FIG. 8 can represent a common theme by combining images. FIG. 8 (a) is a group photo in which 24 pictures of children taken every month are arranged, and can follow the growth process of a child for one year. FIG. 8B is a group photo in which images of continuously shooting children are arranged in chronological order and can convey the movement of the children. FIG. 8C is a group photo in which photographs of various expressions of the same child are arranged, and can convey that the same person takes various expressions. FIG. 8D is a group photo in which photographs taken of each person who attended the same event (sea bathing) are arranged, and can convey the attendees of the event and the flow of the event. FIG. 8 (e) is a group photo in which only photographs of the same system (white, red, pink, green, etc.) are arranged, or a group photo in which seven color photographs are arranged. it can. FIG. 8F is a combined photograph of the same person taken with various compositions. FIG. 8 (g) is a group photo in which photographs taken from inside and outside of Tokyo Tower are arranged, and it can be said that the same Tokyo Tower brings out different sparkles depending on the viewpoint.

  In order to create a group photo that conveys such a theme, it is important how to determine the combination of images. However, if the user does not have a combination of images, it takes time and is difficult to create. Is expected to accompany. Further, as the number of images increases, it is extremely difficult to select an image to be used for the group image.

  Before bringing an image to the store where image printing is performed, it is sufficient if the user has enough time to take time to select the images of the group photo one by one at home. The operation of selecting images with the same composition or images with the same date from the inside is very troublesome. Also, if you frequently categorize images into folders by theme every time you shoot, there is not much difficulty in creating group photos with the same theme, but without thinking so much, all images are in the same folder. The stored user must select a group photo image while checking the contents of the image one by one.

  An object of the present invention is to provide a mechanism by which a user can efficiently create a combined image.

  An image output method according to the present invention includes a step of acquiring a plurality of images, a step of acquiring image attributes, a step of classifying the images into groups according to the image attributes, and a group according to the image attributes. A step of displaying a representative image or character string corresponding to the image to which the image belongs, and a step of receiving a selection of the representative image or character string corresponding to the image used for generating output data of the group image from the displayed representative image or character string And generating output data of a combined image based on the selected representative image or image corresponding to the character string.

  Preferably, the step of setting the first extraction condition of the image and the first group corresponding to the first extraction condition, and the image having an attribute that matches the set first extraction condition correspond to the extraction condition. Categorizing into a first group.

  Preferably, a step of setting a desired second extraction condition to be combined with the set first extraction condition and a second group corresponding to the desired second extraction condition, and the set first extraction condition A step of classifying an image having an attribute conforming to the second extraction condition from the images classified into the corresponding group into the second group, and a representative image or a character string corresponding to the image belonging to the second group is displayed. A step of accepting selection of a representative image or character string corresponding to an image used for generating output data of a group image from the displayed representative image or character string, and corresponding to the selected representative image or character string Generating output data of a combined image based on the image to be performed.

  Preferably, the first extraction condition includes at least one of shooting date / time, color, composition, and subject.

  Preferably, the second extraction condition includes at least one of shooting date / time, color, composition, and subject.

  Preferably, the attributes of the representative image corresponding to each classification are different from each other for attributes other than the attributes that match the first extraction condition corresponding to each classification.

  In this way, the difference in the basis of classification of each representative image becomes clear.

  An image output apparatus according to the present invention includes a unit for acquiring a plurality of images, a unit for acquiring image attributes, a unit for classifying images into groups according to image attributes, and a group according to image attributes. Means for displaying a representative image or character string corresponding to an image to which the image belongs, and means for receiving a selection of a representative image or character string corresponding to an image used for generating output data of a group image from the displayed representative image or character string And means for creating output data of a combined image based on the selected representative image or image corresponding to the character string.

  A program for causing a computer to execute the above-described image output method is also included in the present invention.

  According to the present invention, images are classified based on attributes acquired from images, representative images of group images corresponding to the classification or character strings indicating the samples are displayed as samples, and a desired category is selected from among them. It can be set as a combined image, and the user can efficiently create a combined image.

<First Embodiment>
FIG. 1 is a block diagram showing a schematic configuration of an image print creation apparatus 10 to which the present invention is applied. The image print creating apparatus 10 reads, for example, moving image data and still image data (including still images obtained by capturing moving images) stored in various recording media 40 such as a CD and a DVD, a memory card 42, and the like. As an image print (data for displaying an image on a display device with a predetermined layout and design, or a print medium such as paper on which an image is printed with a predetermined layout and design). The image print creating apparatus 10 is operated by an operation unit 26 including a pointing device capable of instructing movement of a pointer (cursor) such as a mouse, a touch pad, and a trackball, and various operation devices such as a touch panel. The touch panel is stacked on the display 50, and by pressing a button display part of the display 50, it is possible to input characters corresponding to the part or activate various functions.

  The image print creating apparatus 10 includes a CPU 12 that controls the entire image print creating apparatus 10, a drive 11 that reads / writes data from / to the recording medium 40, a card slot 16 that reads / writes data from / to the memory card 42, and the image print creating apparatus 10. A hard disk drive (storage medium) 18 (hereinafter referred to as HDD 18) in which programs to be controlled, moving images and still images are stored, a RAM 20 that functions as a working memory when the CPU 12 performs various processes, a RAM 20 and the like A list of stored images and other graphical user interfaces related to image editing, and a video signal of a pointer moving on the window in accordance with an input operation including an instruction of a moving direction and a moving speed from the operation unit 26 are output to the display 50. Video display It comprises a coder 22, a communication I / F 28 for connecting to various electronic devices such as the Internet and other networks and the digital camera 15, and a data recording unit (operation history recording means) 30 each responsible for specialized processing. Yes. These units are connected to each other via a bus 36, and the CPU 12 controls the respective units of the apparatus according to an operation program stored in the HDD 18.

  The image print creating apparatus 10 is connected to a printer 44 that prints a designated still image on a mount made of a paper medium such as plain paper or photographic paper in a predetermined arrangement via a printer driver 38. Yes. Alternatively, still images arranged in a predetermined arrangement can be output as electronic media such as “PDF” of Adobe Systems Inc. to a display 50, a recording medium 40, a personal computer connected via the Internet, and the like. In short, the output destination of the created image print is not limited to a specific one such as the display 50, the recording medium 40, the printer 44, and the Internet. In the following, for the sake of simplicity, the output destination of the image print is the display 50, but it is assumed that other output is possible. Further, in this specification, an electronic medium creation form in which a desired image can be arranged at a desired position is also called a mount.

  The card slot 16 detachably holds, for example, a memory card 42 such as a compact flash (registered trademark), an SD card, and smart media, and reads or writes still image data recorded on the memory card 42. Thereby, still image data captured by a digital still camera or the like can be read. In addition to the multi-drive 14 and the card slot 16, for example, a communication port such as USB or IEEE1394 may be provided so that direct communication with an electronic device such as a digital still camera or a PDA can be performed.

  In addition to one or a plurality of still image data as image print materials, the HDD 18 stores decoration image data combined with these still image data when an image print is generated. The decorative image includes character data that constitutes characters (kanji, katakana, hiragana, alphabets, symbols, pictograms, and other meaningful readable codes or combinations thereof), and text that includes the characters. These are graphic data of objects suitable for placing boxes, balloons, bills, bulletin boards and other characters, mask images covering unnecessary portions of the target image, and illustrations. These decorative images add color to the image print, such as decorating the background of the still image as the material or adding a one-point decoration. In the following, for simplicity of explanation, the graphic data is assumed to be a character or a text box, but may naturally be other than that.

  Each still image data is stored in the HDD 18 in the form of an image file such as JPEG, TIFF, or EXIF standardized for a digital still camera. These image files are provided with a data area for storing still image data and a tag area for storing metadata (typically EXIF tag information) indicating the contents of the data. Hereinafter, still image data is simply referred to as “image”.

  The moving image data corresponds to a compression recording standard such as motion JPEG or MPEG4.

  The communication I / F 28 connects the image print creation apparatus 10 to the Internet, displays a home page on the Internet on the display 50, and transmits and receives image data via electronic mail (hereinafter referred to as mail). The communication I / F 28 is a broadband compatible modem or the like. The communication I / F 28 may be connected to the Internet via an optical communication network or a cable network. Note that the data for outputting the image print generated by the image print generation unit 34 can be distributed to a specific terminal via the Internet. The distribution-side terminal can output the image print to a monitor or printer and use it freely. The communication I / F 28 can be used not only as a network adapter but also as a general-purpose interface for connecting peripheral devices such as USB.

  The data recording unit 30 and the image print generating unit 34 are so-called coprocessors, and each assists the processing operation of the CPU 12 by taking charge of specialized processing. The data recording unit 30 records history information of operation input to the operation unit 26 such as a staying area, staying position coordinates, staying time of a pointer, time and number of input operations, and the like.

  When the image print creation apparatus 10 is a storefront print terminal, the image print created by the image print generation unit 34 is output to the display 50 and displayed as a preview. If the content is confirmed, the printer 44 is set according to a user instruction. Can be output to a print medium, or the image print such as a DVD can be transferred to a recording medium 40 that can be recorded as video data. Alternatively, the completed image print may be displayed as one of the image print display functions of various electronic devices such as a mobile phone and a digital camera without being premised on outputting to a recording medium or a print medium. Alternatively, it may be used for mere image classification without assuming display or printing in the first place. For example, a folder corresponding to a set image is individually generated in the HDD 18, and the set image selected by the user is temporarily stored in the corresponding folder, and a set image print is created with an image group classified in the folder later. May be.

  Note that the system configuration in FIG. 1 is an example, and the present invention can be implemented as long as it is another electronic device (for example, a PDA) having the same configuration. Further, the individual blocks shown in the figure are not necessarily configured integrally with one electronic device, and each block is a part of the configuration of another electronic device, and they are connected by some communication means such as a network. As long as information transmission / reception between the electronic devices is ensured, the present invention can be implemented and is not performed depending on a specific device configuration.

  The flow of image print creation processing will be described below with reference to the flowchart of FIG. This process is executed by the image print generation unit 34 (or the CPU 12). A program that causes the image print generation unit 34 (or the CPU 12) to execute this processing is recorded on a computer-readable recording medium such as the HDD 18 or the RAM 20. Such a program may be imported from the outside via the Internet.

  In S <b> 1, images to be arranged in the photo album are read from the recording medium 40, the memory card 42, or a terminal connected to the communication I / F 28 from the outside via the Internet and stored in the HDD 18. The image includes a captured image of a moving image file in addition to a still image file such as JPEG.

  In S2, a process of narrowing down the images to be displayed as a list among the read images is performed. Details of this processing will be described later. The narrowing condition is that the user activates (turns on) a button and an icon corresponding to a shooting date, a folder, and a group photo of a necessary image through a selection operation from the operation unit 26 to display the shooting date or an image in the folder. The images to be displayed as a list are narrowed down, or the images to be displayed as a list are limited to images that share a specific parameter. Images filtered according to each condition are grouped, a predetermined number of samples are selected from the group, and thumbnails of the samples (or character strings describing the file name, title, etc.) are classified into groups. Display data of the sample list for each refined condition is generated and output to the display 50.

  In S3, the sample list for each narrowing condition generated in S2 is displayed on the display 50.

  In S4, selection of images to be output to the album is received from the images displayed in a list. The method of selection is arbitrary. For example, a desired image can be selected by checking a check box corresponding to each image.

  In S5, selection of the type (product) of the image print is accepted. As described above, an image print is a print medium such as data on which an image is displayed on a display device with a predetermined layout and design, or paper on which an image is printed with a predetermined layout and design. For example, a shuffle print, a calendar, Includes photo books. Each type of image print also has an individual template. For example, in the case of shuffle print, a medium type such as postcard, A4, or four-size wide size can be further selected. Alternatively, if a photo book is selected as the service type, the template is a cover design (white, black, ivory, check, etc.), an image composition (vertical and horizontal), and the like.

  In S6, an image print is created based on the selected image and merchandise.

  Next, a specific mode of image narrowing and an example of sample list display will be described.

  As a first aspect, first, an extraction condition table defining one or several patterns of narrowing conditions is stored in the HDD 17 and images are classified according to the conditions defined in the extraction condition table. The narrowing condition itself may be set by inputting from the operation unit 26.

  FIG. 3 shows an example of the extraction condition table. Here, there are four extraction condition classification patterns (first classification): “time series” G1, “color” G2, “composition” G3, and “person” G4. The image extraction condition (second classification) corresponding to the “time series” G1 is “image group photographed at a certain interval” G1-1, and the image extraction condition (second) corresponding to “color” is selected. The classification) is “the entire image is the same color” G2-1, “the image group in which the color used in a part of the image is a similar color” G2-2, or “a combination of different colors” G2-3, The image extraction condition (second classification) corresponding to “composition” is “an image group of similar composition (eg, vertical composition, horizontal composition)” G 3-1, and the image extraction condition (second 2 classification) is “same person combination” G4-1 or “related person combination” G4-2.

  The “time series” extraction condition includes, for example, a high-speed continuous shooting interval of 1/30 s or a relatively long interval such as every 30 minutes, every hour, every day, every half month, or every month. . Since a shooting interval equal to or less than the number of comma seconds is not included in the shooting date and time, it may be determined whether the images are continuously shot with other identification information (such as serial numbers of file names).

  The “color” extraction condition is classified according to whether the average color of the entire image region or a specific portion (for example, the central portion) corresponds to red, blue, or the like.

  In “composition”, images having the same or similar composition evaluation values are classified into the same classification.

  “Person” identifies the same person and classifies them into the same classification. The person can be identified by a known technique (for example, Japanese Patent Application Laid-Open No. 2007-316809).

  Note that “date” and “folder” are the same as the extraction conditions if they are read as “images having a specific shooting date” or “images stored in a specific folder”, and are stored in the extraction condition table. You can also keep it. In this case, it is not necessary to provide “date” and “folder” which are distinguished from the “set photo” button icon, and a group equivalent to the above “color” and “composition” is displayed.

  In FIG. 4, according to the activation of any of the “date”, “folder”, and “group photo” button icons, the read image is classified into the classification conditions of the activated button icon and classified. The example which displayed the thumbnail of the selected image is shown.

  In FIG. 4A, since the “date” button icon is activated, the images are classified according to the shooting date of each image, and thumbnails of the images classified according to the shooting date are displayed. Here, as an example, thumbnails I1 and I2 of images shot on “12/12” and thumbnails I3 of images shot on “12/16” are displayed separately in separate groups.

  Here, when the “group photo” button icon is activated, images are classified according to the extraction conditions defined in the extraction condition table.

  In FIG. 4B, in response to the activation of the “group photo” button icon, the images are classified according to the extraction conditions defined in the extraction condition table, and thumbnail samples of the classified images ( The thumbnails of about three images arbitrarily extracted from the images belonging to the category are listed for each category. Each classification list includes character strings “time series-1”, “color-1”, “color-2”, “color-3”, “composition-1”, “person-1” indicating the second classification. "," Person-2 ". However, if the second classification is too subdivided and difficult to understand, the character strings “time series”, “color”, “composition”, “ "Person" may be written together.

  Furthermore, by designating any one of the categories, all images (including samples) belonging to the category may be displayed. For example, when the “time series-1” portion is selected, all images belonging to “time series-1” are displayed on the display 50.

  The user can easily check what types of images can be created from the loaded images by looking at the samples of each category, and how the images can be combined to produce a print that meets his or her wishes. . For this reason, it is possible to save time and effort to confirm a large number of images one by one and create and compare sets of images.

Second Embodiment
In the first embodiment, the sample of each classification is arbitrarily selected. However, in order to show the image classification conditions more easily, samples are selected as follows.

  For example, in the first classification of “time series” G1, among the images belonging to the classification, the first image (the image with the oldest shooting date), the last image (the image with the latest shooting date), Select thumbnails corresponding to three images in the middle between the beginning and the end as samples. Conversely, the top three images (the image with the newest shooting date), the last image (the image with the oldest shooting date), and the middle image between the beginning and end are selected as samples. A thumbnail corresponding to the sample may be displayed.

  Alternatively, in the first classification of “composition” G3, composition evaluation values are calculated for each of the images belonging to the classification by a known method (for example, Japanese Patent Publication No. 2007-306464), and the highest composition evaluation value is ranked higher. Select thumbnails corresponding to the three images as samples.

  Also, for example, when a group photo is created by grouping together images of persons, if three images with the same background as the person are used as samples, it can be distinguished whether it corresponds to the first classification of time series or the first classification of persons. Not stick.

  Therefore, in order to clarify the difference between the classifications, the image samples are selected so that the extraction conditions other than the extraction conditions corresponding to the classification are different. For example, for the sample of the first classification of a person, the time series, color, and composition that are extraction conditions other than the extraction condition corresponding to the person are different, but the person selects the same image. In this way, since the time series, color, and composition of the sample of the first classification of the person are different from each other, these attributes are not used as the extraction conditions for the first classification, but the person is extracted as the extraction condition for the first classification. It becomes clear that it is a sample.

<Third Embodiment>
In the first or second embodiment, there are three sample images. However, if there are only three images, it may be difficult to know what extraction condition the first classification or the second classification corresponds to.

  For this reason, by designating any one of the categories, all the images belonging to the category (including the previously displayed sample) may be displayed.

  For example, when the “group photo” portion is selected as shown in FIG. 5A, image samples belonging to the second category such as “time series-1” are displayed on the display 50 as in FIG.

  Further, if extraction conditions (third classification) lower than the second classification, for example, “athletic meet” and “children's movement” are set in association with the second classification “time series-1”, FIG. As shown in FIG. 5B, the images existing in “time series-1” can be further classified according to the extraction condition of the third classification, and the samples of the images belonging to the images can be individually displayed as a list.

  The extraction conditions for the third classification may be anything, and the same contents as the first classification and the second classification may be used. The image titles “Athletic meet” and “Children's movement” stored in the metadata may be the same or the shooting dates may be the same.

  Here, if a sample list of images classified into the third category “athletic meet” or “children's movement” is selected, a list of all images classified there is displayed, from which an image print is displayed. A desired image to be output can be selected (S4).

<Fourth embodiment>
In the third embodiment, when there are a large number of images belonging to one second category, it is very troublesome for the user to select necessary images one by one.

  For example, as shown in FIG. 6A, when the second category of “time series-1” is selected, images belonging to “time series-1” as shown in FIG. It is further classified and displayed for each sub-category such as “san” and “san”. At this time, as shown in FIG. 6C, for example, when there are a large number of images of “Mr. A”, it is very troublesome for the user to select necessary images one by one.

  Therefore, in this case, it is possible to set the third classification, which is a classification according to the lower extraction conditions than the second classification, and extract thumbnails of images satisfying all of them or a predetermined number of samples extracted from them. Display a list.

  For example, the extraction condition of the second classification lower than the first classification “time series-1” is set to “same person”, and the extraction condition of the third classification lower than “same person” is set to “same color”. To do. It should be noted that it is possible for the user to arbitrarily set with the operation unit 26 what lower classification conditions are set for which classification extraction conditions.

  In FIG. 7A, a list of image samples classified according to the first classification is displayed. For example, if “time series-1” is selected, as shown in FIG. 7B, images belonging to “time series-1” are classified according to the second classification (the extraction condition is the same person). A list of image samples such as “Mr. A” and “Mr. B” is displayed.

  Therefore, for example, when “Mr. A” in the second category is selected, as shown in FIG. 7C, images belonging to “Time Series-1” and “Mr. A” follow the third category (same color). A list of image samples such as “Color-1”, “Color-2”, “Color-3”, and “Color-4” is displayed.

  In this way, by narrowing down images step by step with different attributes, it is possible to easily find a set of images that suits the user's preference even if there are many images.

Schematic configuration diagram of image print creation device The figure which shows an example of an extraction condition table The figure which shows an example of the image classified according to a photography date The figure which shows an example of the image classified according to the attribute of an image The figure which shows an example of the low-order image classification at the time of selecting the classification of "time series-1" The figure which shows an example of the image classification at the time of selecting the classification of "person" The figure which shows an example of the image classification by the extraction condition "same color" of the 3rd classification with respect to "the same person" of "time series-1" Figure showing an example of a group photo

Explanation of symbols

10: Image print creation device, 18: HDD, 34: Image print generation unit

Claims (8)

Acquiring a plurality of images;
Obtaining attributes of the image;
Classifying the images into groups according to the attributes of the images;
Displaying a representative image or a character string corresponding to an image belonging to a group according to the image attribute;
Receiving a selection of a representative image or character string corresponding to an image used for creating output data of a group image from the displayed representative image or character string;
Creating output data of a combined image based on the selected representative image or an image corresponding to a character string;
An image output method including: Setting a first extraction condition of an image and a first group corresponding to the first extraction condition;
Classifying images having attributes that match the set first extraction condition into a first group corresponding to the extraction condition;
The image output method according to claim 1, comprising: Setting a desired second extraction condition to be combined with the set first extraction condition and a second group corresponding to the desired second extraction condition;
Classifying images having attributes matching the second extraction condition into the second group from images classified into the group corresponding to the set first extraction condition;
Displaying a representative image or character string corresponding to an image belonging to the second group;
Receiving a selection of a representative image or character string corresponding to an image used for creating output data of a group image from the displayed representative image or character string;
Creating output data of a combined image based on the selected representative image or an image corresponding to a character string;
The image output method according to claim 2, comprising:   The image output method according to claim 1, wherein the first extraction condition includes at least one of a shooting date / time, a color, a composition, and a subject.   The image output method according to claim 3, wherein the second extraction condition includes at least one of a shooting date / time, a color, a composition, and a subject.   The image output method according to any one of claims 1 to 5, wherein attributes of the representative image corresponding to each category are different from each other with respect to attributes other than the attribute that matches the first extraction condition corresponding to each category. Means for acquiring a plurality of images;
Means for obtaining an attribute of the image;
Means for classifying the images into groups according to the attributes of the images;
Means for displaying a representative image or a character string corresponding to an image belonging to a group according to the attribute of the image;
Means for accepting selection of a representative image or character string corresponding to an image used for generating output data of a group image from the displayed representative image or character string;
Means for generating output data of a combined image based on the selected representative image or an image corresponding to a character string;
An image output device.   The program which makes a computer perform the image output method in any one of Claims 1-6.

Images