JP5587446B2 - Image processing apparatus and control method thereof - Google Patents

Description

  The present invention relates to an image processing apparatus that rearranges the order of displaying a plurality of images and a control method thereof.

  In recent years, with the increase in capacity of hard disks and memory cards of digital cameras, it has become easy to hold a large amount of images. When selecting an image for an album from a large number of images, it takes a great deal of effort to select an image so that all people have an unbiased impression.

  In Patent Document 1, when selecting an image according to an intention from a large number of image candidates, an image displayed once is recorded in the history, and the display of the image displayed once is limited, thereby efficiently. A method for performing a simple image search is described.

  Also, in Patent Document 2, person information of a subject shown in an image is registered, and associated with a second person who is strongly related to the first person. Accordingly, it is described that an album is created without biasing the number and area of the first person and the second person included in the same page.

JP 2000-276484 A JP 2006-295889 A

  According to the technique disclosed in Patent Document 1, a restriction is imposed on an image once displayed on the selection candidate screen as a search result. Even if the number of sheets increases, the same restriction is added depending on whether or not the number is displayed, so it is not known which is preferentially displayed.

According to the technique disclosed in Patent Literature 2, it is possible to make an impression without bias between persons determined to be related. However, a specific person is selected even when the images of all people must be equally included in the album as in the school album.
The present invention has been made in view of such problems, and an object of the present invention is to facilitate an operation in which a user selects an image without bias when selecting an image.

In order to achieve the above object, an image processing apparatus according to an aspect of the present invention has the following arrangement. That is, a display control unit that displays a plurality of unselected images on a display screen according to a predetermined order, and a selection unit that selects an image from the plurality of unselected images displayed on the display screen according to a user input. and, wherein the display control unit, when the image is selected by the selecting means, an image having an attribute that does not match the attribute information included in the selected selected image by the selection means, the attribute information the is selected image having The remaining unselected images other than the selected image are rearranged in order of priority over images having attributes that match .

  In addition, a method for controlling an image processing apparatus according to an aspect of the present invention for achieving the above object includes: a display control step for displaying a plurality of unselected images on a display screen according to a predetermined order by a display control unit; In accordance with user input, a selection step of selecting an image from a plurality of unselected images displayed on the display screen, and in response to selection of an image in the selection step, the display control unit An image having the attribute information that does not match the attribute information of the selected image selected in the selection step is arranged in a priority order over an image having the attribute information that matches the attribute information of the selected image. A rearrangement step of rearranging the plurality of unselected images.

According to the present invention, among the plurality of unselected images displayed according to a predetermined order , the rest excluding the image selected by the user is rearranged in an order of priority in which an image having attribute information different from the image selected by the user is prioritized. Thus, an effect that the user can easily perform an operation of selecting an image having no bias is obtained.

It is a figure which shows the hardware constitutions of the image display apparatus of Embodiment 1 of this invention. It is a functional block diagram of the image display apparatus of Embodiment 1 of this invention. It is a flowchart which shows the image selection process of the image display apparatus of Embodiment 1 of this invention. It is a flowchart which shows the presentation priority determination process of the image display apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows the list of each information of the image selection apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows a process when the image which concerns on Embodiment 1 of this invention is selected. It is a flowchart which shows the image selection process of the image selection apparatus which concerns on Embodiment 2 of this invention. It is a flowchart showing the presentation priority determination process of the image selection apparatus which concerns on Embodiment 2 of this invention. It is a figure which shows the list of each information of the image selection apparatus which concerns on Embodiment 2 of this invention. It is a figure which shows a process when the image which concerns on Embodiment 2 of this invention is selected. It is a flowchart which shows the image selection process of the image selection apparatus which concerns on Embodiment 3 of this invention. It is a figure which shows the list of each information which concerns on Embodiment 3 of this invention. It is a figure which shows a process when the image which concerns on Embodiment 3 of this invention is selected. It is a flowchart which shows the image selection process of the image selection apparatus which concerns on Embodiment 4 of this invention. It is a figure which shows the list of each information which concerns on Embodiment 4 of this invention. It is a figure which shows a process when the image which concerns on Embodiment 4 of this invention is selected. It is a flowchart which shows the image selection process of the image selection apparatus which concerns on Embodiment 5 of this invention. It is a flowchart showing the presentation priority determination process which concerns on Embodiment 5 of this invention. It is a figure which shows the list of each information which concerns on Embodiment 5 of this invention. It is a figure which shows the process when the image which concerns on Embodiment 5 of this invention is selected. It is a figure which shows the mode of the display screen which concerns on Embodiment 6 of this invention, and a presentation priority.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

<Embodiment 1>
FIG. 1 is a block diagram illustrating an example of a hardware configuration of an image selection apparatus according to the present embodiment. Reference numeral 2102 denotes a CPU (Central Processing Unit), which performs calculations and logic determinations for various processes, and controls each component connected to the bus 2101.

  The image selection apparatus is equipped with a memory including a program memory and a data memory. The program memory stores a program for control by the CPU including various processing procedures described later with reference to flowcharts. This memory may be a ROM (Read-Only Memory) 2103 or a RAM (Random Access Memory) 2104 into which a program is loaded from an external storage device or the like. Or you may implement | achieve with these combination.

  Reference numeral 2105 denotes a storage device such as a hard disk for storing data and programs according to the present embodiment. In the present embodiment, it is also used to hold an image. Note that a content holding device connected to an external connection or a network may be used as a device for holding an image. Further, the external storage device 2106 may be used as one that plays the same role as the storage device 2105. Here, the external storage device 2106 can be realized by, for example, a medium (recording medium) and an external storage drive for realizing access to the medium. As such media, for example, a flexible disk (FD), a CD-ROM, a DVD, a USB memory, an MO, a flash memory, and the like are known.

  Reference numeral 2107 denotes an input device for inputting an instruction from the user. The user gives an instruction to the information processing apparatus via the input device 2107. The input device 2107 can be realized by a keyboard or a pointing device, for example.

Reference numeral 2108 denotes an output device as display means for displaying and outputting the processing result of the content management device 2100. The output device 2108 can be realized by a display device such as a CRT (Cathode-Ray Tube) including a circuit for output and a liquid crystal display, for example. In this embodiment, an image is displayed on the output device (display device) 2108.
FIG. 2 is an example of a functional configuration diagram of an image selection apparatus to which the present invention can be applied. Each function is controlled by the CPU 2102 in FIG.

  The input image 101 is one or more input images. Reference numeral 101 may hold subject information as metadata. The subject information referred to here is attribute information indicating information on the image such as information for identifying the subject in the image, the area of the subject, the orientation of the face, the expression, whether the eyes are closed or open. Hereinafter, the attribute information is referred to as subject information in the description. In addition to the above information, any information regarding the subject may be handled as subject information. Moreover, it may be an animal, a landscape, an object, etc., not a person.

  The unselected image storage unit 102 holds an image that has not been selected among the input images 101. It is composed of a hard disk drive device for storing images, a storage medium such as a CD-ROM or DVD-ROM for providing various information to the information processing device, and the like.

  The image selection unit 103 is a selection unit that selects an image from the unselected image storage unit 102. The selection operation is performed through the input device 111. The input device 111 is a button group, a keyboard, a mouse, a touch panel, a pen, a tablet, a digitizer, or the like, and functions as an input interface for inputting an image selection instruction to the present device.

  The subject information extraction unit 104 for unselected images performs processing for extracting subject information related to images in the unselected image storage unit 102. A method of providing an image recognition unit and automatically extracting the recognition result may be used, or a method of automatically extracting from the held metadata or the like may be used. Further, the user may manually input subject information by looking at the image. Moreover, you may extract combining automatic extraction and manual extraction.

  The subject information extraction unit 105 of the selected image performs a process of extracting subject information of the image selected in 103. A method of providing an image recognition unit and automatically extracting the recognition result may be used, or a method of automatically extracting from the held metadata or the like may be used. Further, the user may manually input subject information by looking at the image. Moreover, you may extract combining automatic extraction and manual extraction.

  The subject evaluation value determination unit 106 performs processing for determining an evaluation value for each value of the subject information based on the subject information regarding the selected image extracted in 105. The evaluation value storage unit 107 is a storage unit that stores the evaluation value determined in 106. It is composed of a hard disk drive device for storing various information, a storage medium such as a CD-ROM or DVD-ROM for providing various information to the information processing device, and the like.

  The presentation priority determination unit 108 performs processing for determining the presentation priority of the unselected image from the subject information of the unselected image extracted in 104 and the evaluation value stored in 107. The rearrangement unit 109 rearranges the unselected images held in the unselected image storage unit 102 according to the presentation priority determined by the presentation priority determination unit 108. The output device 110 is 108 shown in FIG. 1, and is composed of a display device such as a CRT or a liquid crystal display, and displays rearranged unselected images. An image 112 is an output image selected by the image selection device 100.

  Next, the presentation priority determination process according to the first embodiment will be described with reference to FIGS. FIG. 3 is a flowchart of the presentation priority determination process of the image display apparatus according to the first embodiment of the present invention. FIG. 5 shows a state before the selection process by the image selection unit 103 is performed on the image held in the unselected image storage unit 102.

  In step S <b> 201, subject information extraction processing for images held in the unselected image storage unit 102 is performed. In the present embodiment, four images of image 1 to image 4 shown as 401 in FIG. 5 are used as input images. Reference numeral 401 denotes a correspondence relationship between subject information of all extracted images and an ID that uniquely identifies the image. In the present embodiment, only information (hereinafter also referred to as a subject) that identifies a subject that appears in the image is used as subject information. Here, the user may designate which information is the subject information, or may be set in advance. Further, it is assumed that personal names A, B, C,... Are assigned as values of information for identifying the subject as metadata for each image. Not exclusively. It is assumed that the presentation order before applying the rearrangement of the present invention is arranged in ascending order of image IDs.

  In S202, an initial value of an evaluation value is set for each value of information specifying a subject. FIG. 6 shows a list of evaluation values for each value of information specifying 402 subjects in FIG. Here, the initial value of the evaluation value for each value of information specifying the subject before image selection is shown. In this embodiment, the initial value of all subjects is set to 0, and each time an image is selected, an evaluation value 1 is assigned to the value of information that identifies the subject that the image has.

  In S203, a process for determining the presentation priority based on the subject information extracted in S201 and the evaluation values set in S202 and S208 is performed.

  FIG. 4 is a flowchart showing details of the presentation priority determination processing in S203. In S301, it is determined whether there is an information value that identifies a subject having the same evaluation value. If there is no information value that identifies the subject with the same evaluation value (S302), the presentation priority is assigned from the image having the information value that identifies the subject with the lowest evaluation value. In S301, when there are a plurality of information values specifying the subject having the same evaluation value, the information values specifying the subject having the same evaluation value are handled as a group (S303). In S304, presentation priority is assigned from an image having information values that specify subjects belonging to the group having the lowest evaluation value. When the presentation priority is assigned to the image having the information value specifying the subject belonging to the group having the lowest evaluation value, the presentation priority is given to the image having the information value specifying the subject belonging to the next lowest group. The process proceeds with this flow. In the present embodiment, any presentation prioritization may be performed for presentation prioritization within a group of the same evaluation value. In the present embodiment, when it becomes necessary to give a presentation priority within a group, the priority is simply determined according to the presentation order before the rearrangement process is performed.

  403 in FIG. 5 is a list of presentation priorities assigned in the presentation priority determination process S203 using the subject information extracted in S201 and the initial value of the evaluation value set in S202. This represents the presentation priority prior to image selection processing.

  In S204, the images held in the holding unit for unselected images are rearranged according to the presentation priority determined in S203 and displayed on the output device 110. Moreover, you may restrict | limit a display with presentation priority, without displaying all. Only images with the highest presentation priority may be displayed, or only images with a certain or higher presentation priority may be displayed. In addition, when the image does not fit on one screen, the image may be displayed as much as it can be accommodated in descending order of presentation priority. The result of rearrangement by the presentation priority determined in S203 is as indicated by 404 in FIG. Presentations are presented in order from the image with the lowest presentation priority number.

  Every time an image is selected, the processing flow from S203 to S208 is repeated until there is no selection candidate image in S205 or until it is determined whether or not to end the image selection. When the process proceeds to YES in S205 and the image selection is completed, the process ends. If NO, the process proceeds to S206.

  In S206, processing is performed when an image is selected by the image selection unit 103. FIG. 6 is a diagram showing processing when an image is selected. In this embodiment, as shown by 501 in FIG. 6, a case (502) in which image 1 is selected as one album will be described. Specifically, as the processing performed here, when an image in the selected unselected image list is arranged in the selected image list or album, the original image is deleted and copied to the arrangement destination.

  In S207, the subject information of the image selected in S206 is specified. The subject information specified in the present embodiment is information for specifying a subject. Therefore, from the subject information extracted from the image 1, information A is extracted as the value of information specifying the subject. In S208, an evaluation value is assigned based on the information extracted in S207. In FIG. 6 503, the evaluation value after image selection is shown for each value of information specifying the subject. Since the image 1 including the subject A is selected in 502, 1 is assigned to the subject A as an evaluation value.

  Returning to S203 again, processing for determining the presentation priority of the image from the subject information extracted in S201 and the evaluation value set in S208 is performed. Since there are two subjects, subject B and subject C, as shown in 505, the two subjects are grouped together as a group having an evaluation value of zero. Therefore, priority is given to the image in which the subject B or the subject C is photographed without distinction. As indicated by reference numeral 506, in the group having the same evaluation value, the presentation order prior to the rearrangement process is given priority, so image 3 has presentation priority 1 and image 4 has presentation priority 2 (508). Next, an image 2 that is an image of A having an evaluation value of 1 as in 504 has a presentation priority 3 (507). When performing the presentation priority determination process S203, subject information about images in the unselected image list is used. The subject information of the unselected image may be prepared by storing the subject information extraction result of the unselected image in S201 by preparing a storage unit, or may be extracted every time it is selected.

  In S204, the unselected images are rearranged as in 509 by rearranging the images with the presentation priority indicated by 506. Further, a restriction may be added so that only an image having the highest presentation priority is displayed as in 510. Here, only the image 3 having the highest presentation priority is displayed, and the display of the images 4 and 2 is limited.

  As described above, in the first embodiment, display is performed using the presentation priority determined each time selection is performed, so that it is possible to reduce the user's operation while realizing display close to the user's preference.

<Embodiment 2>
In the first embodiment, only information for specifying a subject is used as subject information. In the second embodiment, as an example of combining a plurality of subject information, the area of the subject's face is further used as subject information. In other words, in the second embodiment, by taking into consideration the appearance area in the album, one person has two images that are large, whereas another person has two images that are small. It is possible to make the impression of each subject uniform without selecting an unbalanced image. An example in which presentation priority is determined using a plurality of subject information will be described.

  FIG. 7 is a flowchart showing the overall flow of the second embodiment. FIG. 8 is a flowchart showing details of the presentation priority determination processing in S603. In the present embodiment, four images from image 1 to image 4 indicated by reference numeral 801 in FIG. 9 are used as input images. Also in the present embodiment, the basic configuration of the image selection apparatus is the same as that described in the first embodiment with reference to FIGS.

  In step S601, as in the first embodiment, the subject information of all images held in the unselected image storage unit 102 is extracted. In the first embodiment, only the information for specifying the subject is used. In the second embodiment, information on the area of the face that is the subject is also used as the subject information. In the present embodiment, it is assumed that an individual name and a face area are assigned to metadata as values of subject information, and subject information is acquired from the metadata. The extraction means is not limited to extracting from metadata, but may be acquired by other means such as image recognition.

  Reference numeral 801 in FIG. 9 represents a correspondence relationship between subject information of all extracted images and image IDs. In this embodiment, as shown by 802 in FIG. 9, the face area is classified and processed in three stages of relatively large, medium, and small. However, the value of the area itself may be used, and the number of stages is classified. You can handle it. As in the first embodiment, the arrangement order before using the present invention is arranged in ascending order of image IDs.

  In S602, the initial value of the evaluation value is set for each value of the information specifying the subject as in S203 of the first embodiment. Also in this embodiment, the initial value is set to 0 in the state before the image is selected. In the presentation priority determination process S603, a process for determining the presentation priority based on the subject information extracted in S601 and the evaluation value set in S602 or S608 is performed.

  In step S603, it is determined in step S701 in FIG. 8 whether there is a subject with the same evaluation value. If there is no information value that identifies the subject with the same evaluation value (S702), the presentation priority is assigned from the image showing the subject with the lowest evaluation value.

  When there are a plurality of images showing the same subject, presentation priority is determined using the area of the face. In this case, presentation priorities are assigned in descending order of face area. If there are subjects with the same evaluation value in S703, the subjects with the same evaluation value are grouped together.

  In step S704, presentation priority is assigned from an image in which subjects belonging to the group having the lowest evaluation value are captured. After assigning the presentation priority to the image that includes the subject belonging to the group with the lowest evaluation value, the processing is performed in the flow of assigning the presentation priority to the image that includes the subject belonging to the group with the lowest evaluation value. Proceed.

  804 in FIG. 9 shows a list of presentation priorities determined in S603 using the evaluation value 803. In the case where it is not possible to provide a difference in the presentation priority even in the above flow as in the case of the image 1 and the image 4, the presentation priority is given from the presentation order before the rearrangement process is performed. In this example, image 1 has presentation priority 1 and image 4 has presentation priority 2.

  In S604, the rearrangement processing of the images held in the unselected image storage unit is performed according to the presentation priority determined in S603. The result of rearrangement using the presentation priority of 804 in FIG. Presentations are presented in order from the image with the lowest presentation priority number. Prior to selecting an image, it is not possible to prioritize presentations based on evaluation values, so it can be seen that the images are arranged in order of face size.

  In S605, as in the first embodiment, the process flow from S603 to S608 is repeated each time an image is selected until there is no selection candidate image or it is determined whether or not to end the selection of the image. When the image selection is completed in S605, the process is terminated. If NO, the process proceeds to S606.

  In S606, as in S206 of the first embodiment, the image selection unit 103 performs an image selection process suitable for the present embodiment. In the present embodiment, a case will be described in which the image 4 is selected for one album as indicated by reference numeral 901 in FIG.

  In S607, subject information of the image selected in S606 is extracted. The subject information extracted in the present embodiment is information specifying the subject and the area of the face of the subject. Here, the information specifying the subject is C and the face area is large. In S608, an evaluation value is assigned to the subject based on the information extracted in S607.

  In FIG. 10 902, the evaluation value after image selection is shown for each value of information specifying the subject. The weighting of the evaluation value by area is performed by changing the evaluation value according to the size of the face, with 3 being large, 2 being medium, and 1 being small. Therefore, 3 is assigned as an evaluation value to C as in 904.

  The process returns to S603 again, and the process of determining the presentation priority of the image is performed again. 905 in FIG. 10 is a list of presentation priorities determined using the subject information 902. Since there are two subjects A and B as shown in 903, the two subjects are grouped together as a group having the evaluation value 0. Therefore, priority is given to the image in which A or B is reflected. Further, within the group having the same evaluation value, the presentation priority is given in the order of the size of the face that is shown. Therefore, image 1 has presentation priority 1 and image 3 has presentation priority 2. Furthermore, an image 2 in which a subject C having an evaluation value of 3 as shown in 904 has a presentation priority 3 (906).

  Also in the presentation priority determination process S603, the subject information of the unselected image is used. As in the first embodiment, the subject information extraction result of the unselected image in S601 may be stored, or may be extracted again each time an image is selected.

  In S <b> 604, the unselected images are rearranged as in 907 by rearranging the images with the presentation priority indicated by 905.

  In this embodiment, information specifying the subject and the size of the display area of the face are used as the subject information. However, the information on the number of people including the display area of the whole body, the degree of smile, and the number of people in one image. May be used. Further, it may be non-quantitative information such as the direction of the face and whether or not it is blinking. If it is a face orientation, it can be handled by classifying it into several stages such as front, diagonal, and horizontal.

  In S702, when there are a plurality of the same subjects, the presentation priority may be determined in more detail using the plurality of subject information. Also in S705, when the presentation priority is determined in more detail within the group of the same evaluation value, the presentation priority may be determined in more detail using the plurality of subject information.

  As described above, it is possible to make the impression of each subject uniform by determining the presentation priority by using a plurality of subject information.

<Embodiment 3>
In the first embodiment and the second embodiment, the presentation priority determination method and sorting according to the presentation priority when one image is selected have been described. However, the present invention can also be applied when returning an already selected image to the unselected image storage unit. The third embodiment shows an example in which when a selected image is returned to the unselected image storage unit, the presentation priority is changed according to the returned image.

  Also in the present embodiment, the basic configuration of the image selection apparatus is the same as that described in the first embodiment with reference to FIGS.

  FIG. 11 is a flowchart showing the overall processing flow of the third embodiment. The details of the presentation priority determination process in S1003 are the same as those in the flowchart of FIG. In this embodiment, five images from image 1 to image 5 shown as 1101 in FIG. 12 are used as input images. In S1001, subject information is extracted as in S201 of the first embodiment. Reference numeral 1101 in FIG. 12 represents an image ID and subject information for all images. Similarly to the first embodiment, this embodiment uses only information for specifying a subject as subject information.

  In S1002, an initial value suitable for the present embodiment is set as in S202 of the first embodiment. Also in this embodiment, the initial value for all is 0. In S1003, as in S203 of the first embodiment, the subject information of the unselected image extracted in S1001 and the evaluation values set in S1002, S1009, and S1012 are presented according to the flowchart of FIG. Determine the priority.

  In S1004, as in S204 of the first embodiment, rearrangement is performed in the order of presentation suitable for the present embodiment in accordance with the presentation priority determined in S1003. In S1005, as in S205 of the first embodiment, it is determined whether to continue or end the image selection operation. If NO, the process proceeds to S1006. If YES, the process ends.

  In S1006, as an image selection operation, it is determined whether to select an image from the unselected image list or to return from the selected image to the unselected image. If YES, the process proceeds to S1007. If NO, the process proceeds to S1010. In S1007, as in S206 of the first embodiment, an image selection process suitable for the present embodiment is performed. In this embodiment, the image 1 is selected first, and the image 3 is selected at the second selection. In S1008, the subject information of the selected image is specified as in S207 of the first embodiment.

  In S1009, as in S208 of the first embodiment, an evaluation value suitable for the present embodiment is assigned to each subject. The subject information list 1102 and the presentation priority list 1103 are obtained when the processing of the first embodiment is applied to all the images indicated by 1101, and images are selected for the album in the order of image 1 and image 2. Value. As shown in 1105, since the image 1 showing the subject A and the image 3 showing the subject B are already selected, 1 is assigned to each of the subjects A and B as 1102, respectively. ing. Further, among the unselected images, only the image 5 includes the subject having the evaluation value 0, and therefore the image 5 has the presentation priority 1. For images 2 and 3 in which A and B, which are subjects with an evaluation value of 1, are given priority in the default order, image 2 has presentation priority 2 and image 3 has presentation priority 3. The order of presentation of 1104 is determined by the above flow.

  In step S1010, one image is returned from the selected state to the unselected state. As indicated by 1201, in this embodiment, an example in which the image 1 is returned to the unselected image list will be described. As a specific process, when the selected image that is currently selected is arranged in the unselected image list, the selected image is deleted from the selected image list, and the image is copied to the unselected image list.

  In S1011, subject information of the image returned to the unselected image list is extracted. In the present embodiment, the information value specifying the subject in the returned image is A. In step S1012, a process of reducing the evaluation value of the subject in the image returned to the unselected image list is performed. In this embodiment, if an image is selected, the evaluation value of the subject in the image is incremented by 1, and if the image is deselected, the evaluation value of the subject in the image is decremented by 1. To do. Therefore, a process of reducing the evaluation value of the subject A by 1 is performed. A list of evaluation values changed in S1012 is shown in 1202. Compared to 1102, it can be seen that the evaluation value of A has changed from 1 to 0. Based on the evaluation value shown at 1202, the presentation priority is determined as in 1203 by performing the presentation priority determination process of S1003. Further, by rearranging 1004 using the presentation priority determined in 1203, an image is presented as in 1204. The process of selecting and deselecting an image is repeated each time one image is selected or deselected until the image selection operation is completed in S1005.

  As described above, even when the selected image is returned, it is possible to realize display close to the user's preference.

<Embodiment 4>
In the first and second embodiments, the example in which the image is selected from all the unselected images so that the number of appearances and the appearance area are uniform has been described. In the present embodiment, an example in which only images satisfying a specific condition can be preferentially selected will be described. In the example of a school album, there is a page in the album where you want to select only photos for each class in the form of class pages. By applying this embodiment, only images of people belonging to a specific class can be presented with priority. As an example, a case where a set of class images of a school album is selected will be described here. Also in the present embodiment, the basic configuration of the image selection apparatus is the same as that described in the first embodiment with reference to FIGS.

  FIG. 14 is a flowchart showing the overall processing flow of the fourth embodiment. The details of the presentation priority determination processing in S1303 are the same as those in the flowchart of FIG. In the present embodiment, images 1 to 5 shown as 1401 in FIG. 15 are used as input images. In step S1301, subject information is extracted as in step S201 of the first embodiment. In the fourth embodiment, information for specifying a subject and a class to which the subject belongs are used as subject information to be extracted.

  In S1302, an initial evaluation value is set. If more evaluation values are assigned to the non-purpose image than the target image, the presentation priority of the non-purpose image is lowered. Therefore, when selecting one set of class images, evaluation values are assigned only to classes other than one set. In this embodiment, as shown in the initial value list of evaluation values 1402, 5 is assigned as the evaluation value (1403).

  In S1303, similarly to S203 of the first embodiment, a presentation priority determination process suitable for the present embodiment is performed based on the evaluation values set in S1302 and S1308. The presentation priority determined using the initial value of the evaluation value is 1404. In S1304, as in S204 of the first embodiment, rearrangement appropriate for the present embodiment is performed according to the presentation priority determined in S1303. A list 1405 of unselected images rearranged using the list 1404 of presentation priorities is shown. As indicated by 1404, images 3 and 4 in which B and C are shown have lower presentation priority, and are therefore arranged at the end of the unselected image list.

  The image selection process is repeated each time the image selection process is selected until the image selection operation is completed in step S1305. In S1305, when the image selection is completed with YES, the process is terminated. If NO, the process proceeds to S1306. In S1306, as in S206 of the first embodiment, an image selection process suitable for the present embodiment is performed. In the present embodiment, a case where an image 1 is selected as indicated by 1501 will be described.

  In S1307, the subject information of the selected image is extracted as in S207 of the first embodiment. The information extracted here is information that the subject shown in the image 1 is A and information that belongs to one set. In step S1308, a process for assigning an evaluation value to the subject in the selected image is performed as in step S208 of the first embodiment. Here, 1 is assigned to the subject A as the evaluation value. A list of evaluation values for each subject is as indicated by 1503. Since the subject A belongs to one set as in 1504 and an image is selected, the evaluation value is 1. As in 1505, the images of subjects B and C are not selected, but do not belong to one set, so the evaluation value is 5. The subject D belongs to one set like 1506 and has not yet been selected, so the evaluation value is 0.

  Using the evaluation value list 1503 set in S1308, a presentation priority list determined in the presentation priority determination process in S1303 is shown in 1507. A result of the rearrangement in S1304 using the presentation priority list of 1507 is shown in 1508. An image 5 showing the subject D has a presentation priority 1, and an image 2 showing the subject A has a presentation priority 2. In the images 3 and 4 in which the subjects B and C are shown, since the evaluation value is given to an image that is not one set first, the presentation priority is low even though none of the images has been selected yet. Become.

  From the above, it is possible to preferentially select only images that satisfy the specific condition.

<Embodiment 5>
In Embodiments 1 to 4, after the presentation priority is determined, all the images are rearranged and presented one by one according to the determined presentation priority. In the present embodiment, a case where a plurality of images are handled together when rearranging the images will be described. By handling a plurality of images together (for example, handling a single horizontal row of images to be presented as a group), it is possible to provide a presentation that is easier to see than when the presentation order is updated one by one.

  Also in the present embodiment, the basic configuration of the image selection apparatus is the same as that described in the first embodiment with reference to FIGS. FIG. 17 is a flowchart showing the overall processing flow of the fifth embodiment. FIG. 18 is a flowchart illustrating processing for determining the presentation priority of a group. The flowchart of FIG. 18 shows the details of the presentation priority determination processing in S1604. In the present embodiment, images 1 to 6 indicated by 1801 in FIG. 19 are used as input images.

  In step S1601, the subject information is extracted as in step S201 of the first embodiment. In the fifth embodiment, information for specifying a subject and information on a group to which the subject belongs are used as subject information to be extracted. In S1602, the initial value of the evaluation value is set as in S202 of the first embodiment. The initial value of the evaluation value is 1802.

  In S1603, the evaluation value of the group to which the subject belongs is calculated from the evaluation value for each subject set in S1602. Evaluation price assignment to a group is performed by adding the evaluation value of each subject as the evaluation value of the group to which the subject belongs. When B belongs to two groups as in B, the evaluation value of B is added to both group 1 and group 2. When the evaluation value of each subject is the initial value as in 1803, the initial value of the group evaluation value is also zero.

  In step S1604, the group presentation priority is determined according to the flowchart of FIG. In S1701, it is determined whether a group with the same evaluation value exists. If YES, the process proceeds to S1703, and if NO, the process proceeds to S1702. In S1702, presentation priorities are assigned in order from the group with the lowest evaluation value.

  In S1703, groups having the same evaluation value are grouped as a group group. In S1704, presentation priorities are assigned from groups belonging to a group having a low evaluation value. The presentation priority in the group of the same evaluation value is given with priority given to the arrangement before the sorting process. The presentation priority determined from the evaluation value of 1803 is 1804.

  In step S1605, rearrangement is performed in units of groups. At this time, rearrangement within the group is not performed. It is 1805 that the presentation priority of 1804 is determined and rearranged.

  In S1606, the processing flow from S1603 to S1609 is repeated every time an image is selected until there is no selection candidate image or whether it is determined whether to end the selection of the image as in S205 of the first embodiment. When the image selection is completed in S1606, the process is terminated. If NO, the process proceeds to S1607.

  In S1607, an image selection process suitable for the present embodiment is performed as in S206 of the first embodiment. In this embodiment, as shown by 1901 in FIG. 20, a case where image 1 is selected as one album will be described (1902).

  In step S1608, the subject information suitable for the present embodiment is specified as in step S207 of the first embodiment. Therefore, information that the subject A is captured from the image 1 and that the subject A belongs to the group 1 is extracted. In S1609, an evaluation value is assigned to the subject based on the information extracted in S1608, as in S208 of the first embodiment.

  In FIG. 20, 1903 shows the evaluation value after selecting the image for each subject. Since the image 1 is selected, 1 is assigned to the subject A as the evaluation value. The process returns to S1603 again, and processing for determining the group presentation priority from the subject information extracted in S1601 and the evaluation value set in S1609 is performed. Since the group to which A belongs is only group 1, only 1 is added to the evaluation value. The presentation priority of the group determined from the evaluation value of the group of 1904 in S1604 is 1905. The result of rearranging for each group according to the presentation priority of 1905 is 1906. As in 1907 and 1908, the order of group 1 and group 2 is switched.

<Embodiment 6>
In the sixth embodiment, a method of updating when displaying an unselected image will be described. In the first to fifth embodiments, processing for rearranging all images is performed according to the presentation priority. In this embodiment, the troublesomeness of rearranging all the images in front is eliminated by rearranging only images that are not visible in the image list when selecting an image. The processes described in the first to fifth embodiments are applied until the presentation priority is determined. Also in the present embodiment, the basic configuration of the image selection apparatus is the same as that described in the first embodiment with reference to FIGS.

  FIG. 21 is a diagram showing the display screen and the presentation priority according to the sixth embodiment. Reference numeral 2001 denotes an unselected image group 1 displayed on the display screen of the display. Reference numeral 2002 denotes a scroll bar. Reference numeral 2003 denotes an unselected image group 2 that is displayed when the scroll bar is scrolled downward in the state of 2001. 2004 is the presentation priority of an unselected image that is determined when image A is selected from 2001. Reference numeral 2005 denotes an unselected image group 2 after the rearrangement process.

  A case where the image A is selected from the 2001 unselected image group 1 will be described. In this case, the images A to D shown in 2001 are displayed on the display. Images E to H shown in the unselected image group 2 of 2003 are not displayed on the display. When an image A is selected from the unselected image group 1 of 2001, it is assumed that the presentation priority of the unselected image is determined as indicated by 2004. In the above-described embodiment, an example in which all images are rearranged according to the presentation priority has been described. However, in this embodiment, the rearrangement process is performed while maintaining the display state for the unselected image group 1 in 2001. Absent. Here, the space where the image A was displayed becomes empty. Further, the images may be shifted by one while maintaining the arrangement order so as to fill the space where the image A was displayed.

  On the other hand, the rearrangement process is performed on the unselected image group 2 that is not displayed on the display when the image A is selected. Since the display of the unselected image 2 after the rearrangement process is performed according to the presentation priority shown in 2004, it is as in 2005.

<Other embodiments>
Although the embodiment has been described in detail above, the present invention can take an embodiment as a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

  In the present invention, the functions of the above-described embodiments are achieved by supplying a software program directly or remotely to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program code. Including the case. In this case, the supplied program is a computer program corresponding to the flowchart shown in the drawings in the embodiment.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  Examples of the computer-readable storage medium for supplying the computer program include the following. For example, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD- R).

  As another program supply method, a client computer browser is used to connect to a homepage on the Internet, and the computer program of the present invention is downloaded from the homepage to a recording medium such as a hard disk. In this case, the downloaded program may be a compressed file including an automatic installation function. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  Further, the program of the present invention may be encrypted, stored in a storage medium such as a CD-ROM, and distributed to users. In this case, a user who has cleared a predetermined condition is allowed to download key information for decryption from a homepage via the Internet, execute an encrypted program using the key information, and install the program on the computer. You can also.

  In addition to the functions of the above-described embodiment being realized by the computer executing the read program, the embodiment of the embodiment is implemented in cooperation with an OS or the like running on the computer based on an instruction of the program. A function may be realized. In this case, the OS or the like performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

  Furthermore, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, so that part or all of the functions of the above-described embodiments are realized. May be. In this case, after a program is written in the function expansion board or function expansion unit, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program.

DESCRIPTION OF SYMBOLS 100 Image selection apparatus 101 Input image 102 Unselected image storage part 103 Image selection part 104 Subject information extraction part 105 Subject information extraction part 106 Evaluation value determination part 107 Evaluation value memory | storage part 108 Presentation priority determination part 109 Rearrangement part 110 Output device 111 input device 112 images

Claims (14)

Display control means for displaying a plurality of unselected images on a display screen according to a predetermined order;
Selecting means for selecting an image from a plurality of unselected images displayed on the display screen in response to a user input;
The display control means, when an image is selected by the selection means,
The selected images in the order of arrangement in which images having attribute information that does not match the attribute information of the selected image selected by the selection unit are given priority over images having attribute information that matches the attribute information of the selected image. An image processing apparatus characterized by rearranging the remaining unselected images except for .   The display control means causes the plurality of unselected images to be displayed partly on the display screen, and changes a part displayed on the display screen according to the arrangement order in response to a scroll operation on the display screen. The image processing apparatus according to claim 1, wherein: The selection unit selects the image in response to a user input with respect to the image displayed on the display screen among the plurality of unselected images.
The display control means rearranges the unselected images that are not displayed on the display screen among the plurality of unselected images, and the rearranged unselected images according to the scroll operation of the display screen. The image processing apparatus according to claim 2, wherein the images are displayed part by part. The image processing apparatus according to claim 1, wherein the display control unit rearranges the plurality of unselected images within a range that satisfies a predetermined priority condition. The attribute information is information specifying an object included in the image and information indicating a group to which the object included in the image belongs,
The preset priority condition is that an image of an object belonging to the same group as an object included in the selected image selected by the selecting unit is an object included in the selected image selected by the selecting unit. The information processing apparatus according to claim 4, wherein priority is given to an image of an object belonging to a different group. The display control means includes the plurality of unselected images.
More than an image of an object belonging to a group different from the object included in the selected image selected by the selection unit, and having an attribute that does not match the attribute information of the selected image selected by the selection unit ,
Priority is given to an image of an object belonging to the same group as the object included in the selected image selected by the selection unit and having an attribute that matches the attribute information of the selected image selected by the selection unit The information processing apparatus according to claim 5, wherein the remaining unselected images other than the selected image are rearranged in the order in which the images are selected. Display control means for displaying a plurality of unselected images on a display screen according to a predetermined order;
Selecting means for selecting an image from a plurality of unselected images displayed on the display screen in response to a user input;
The display control means, when an image is selected by the selection means,
The image of a subject different from the subject of the selected image selected by the selection unit is arranged in the order of priority over the image of the same subject as the subject of the selected image selected by the selection unit . An image processing apparatus characterized by rearranging unselected images. Further, each of the plurality of unselected images has information indicating a group to which the subject of the image belongs,
The display control means, when an image is selected by the selection means,
An image of a subject belonging to the same group as the subject of the selected image selected by the selection means is arranged in a priority order over an image of a subject belonging to a group different from the subject of the selected image selected by the selection means, The image processing apparatus according to claim 7, wherein the plurality of unselected images are rearranged. A display control step of displaying a plurality of unselected images on the display screen according to a predetermined order by the display control means;
A selection step of selecting an image from a plurality of unselected images displayed on the display screen according to a user input by a selection unit;
In response to the image being selected in the selection step,
By the display control means, an image having an attribute that does not match the attribute information of the selected image selected in the selection step is arranged in a priority order over an image having an attribute that matches the attribute information of the selected image. And a rearrangement step of rearranging the remaining unselected images excluding the selected image.   A program for causing a computer to execute the control method of the image selection device according to claim 9.   A computer-readable storage medium storing a program for causing a computer to execute the control method of the image selection device according to claim 10. A display control step of displaying a plurality of unselected images on the display screen according to a predetermined order by the display control means;
A selection step of selecting an image from a plurality of unselected images displayed on the display screen according to a user input by a selection unit;
In response to the image being selected in the selection step,
Wherein the display control means, the image of the object is different from the subject of the selected selected image by the selection step, sorted in priority than the image of the same subject as the subject of the selected selected image by the selection means, the selection And a rearrangement step of rearranging the remaining unselected images excluding the completed images .   A program for causing a computer to execute the control method of the image selection device according to claim 12.   A computer-readable storage medium storing a program for causing a computer to execute the control method of the image selection device according to claim 13.

Images