JP5295510B2 - Image display device, image display method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device, an image display method, and a program by which images, such as, family history capable of typically reminding nostalgia are surely selected and displayed. <P>SOLUTION: When image data are input in a server 400, the face part and the background part in the image data are divided and priority and degrees of nostalgia are calculated from facial expressions in the facial part and the kind of subject in the background part. When reproducing the image that reminds nostalgia, the image data are selected according to the degrees of nostalgia by each piece of image data, and the image selected is reproduced in a PC 500. When there are a plurality of the face parts within the image, the degrees of nostalgia are also set from the size of each face and positional relations. <P>COPYRIGHT: (C)2008,JPO&amp;INPIT

Description

  The present invention relates to an image display device, an image display method, and a program for displaying a plurality of images including face images in a predetermined priority order.

  In recent years, with the increase in capacity of recording media, a large amount of photographs are taken compared to the film photography age. Moreover, since such a photograph is obtained as a digital image, it can be easily sent to various places via a network or the like.

  In addition, past film photographs are digitized using a scanner or the like, so that it is possible to view images of chaotic chaos anywhere.

  As described above, in recent years, it has become possible to acquire a large amount of images, but it has become a great effort to select an image to be viewed from among them. As before, in the era when photographs were taken only on occasions such as commemorative photos, it is relatively easy to organize the photos, and because they are organized, selection is easy, but as in recent years When a large number of photos are taken on a daily basis, something that was taken in commemoration of something as usual (a family gathering during a holiday, a gathering for a celebration, a portrait photo of a family gathering, etc.) It's hard to find where there are nostalgic images (here, mainly those that show family unity), which can be combined with images instead of everyday memos.

In relation to such an image selection technique, Patent Document 1 selects an image that feels nostalgia according to meta information by registering a photo and meta information in association with each other when the image is stored in a computer. A memory video with video effects is created according to the selected image.
JP 2006-287521 A

  There is a movement to manage memories etc. with time as in Patent Document 1, but the old image is not simply a nostalgic image. It can be said that an image that can remember what happened is a nostalgic image. Also, when viewing photos with more than one person, it is often more important to have a picture that allows you to understand the relationship between multiple people in the picture than the picture of personal memories, and to read the emotion of the subject at that time. .

  The present invention has been made in view of the above circumstances, and is an image display device that can definitely select and display an image that can be reminiscent of typical nostalgia such as a family's age history, An object is to provide an image display method and a program.

In order to achieve the above object, an image display device according to a first aspect of the present invention is an image display device for selecting and displaying a smaller number of images from a plurality of images. The face detection unit for detecting a plurality of face parts, and the size and position of the images of the plurality of face parts are determined from the detection results of the face parts, and the size determined by the size and position of the determined face parts A priority setting unit that sets the display priority of the image according to the relationship between the plurality of face parts, and a display control unit that displays the image from the plurality of images in a priority order according to the display priority. It is provided with.

In order to achieve the above object, an image display method according to the second aspect of the present invention is an image display method for selecting and displaying fewer images from a plurality of images. A plurality of face portions are detected from each, and the size and position of the images of the plurality of face portions are determined from the detection result of the face portions, and the plurality of face portions determined by the determined size and position of the face portions are determined. The display priority of the image is set in accordance with the relationship between the face portions, and the image is displayed from among a plurality of priority orders according to the display priority.

In order to achieve the above object, an image display program according to a third aspect of the present invention is an image display program for selecting and displaying fewer images from a plurality of images. A step of detecting a plurality of face portions from each of the steps, a step of determining the size and position of the images of the plurality of face portions from the result of detection of the face portions, and the size and position of the determined face portions. The step of setting the display priority of the image according to the relationship between the plurality of face portions determined, and the step of causing the computer to display the image from the plurality of images in a priority order corresponding to the display priority. Let it run.

  According to the present invention, it is possible to provide an image display device, an image display method, and a program capable of definitely selecting and displaying an image that can be reminiscent of typical nostalgia such as a family history. Can do.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a digital camera 100 as an example of a photographing apparatus including an image display apparatus according to an embodiment of the present invention. A digital camera 100 shown in FIG. 1 includes a microprocessing unit (MPU) 101, an operation unit 102, a photographing lens 103, an autofocus (AF) circuit 104, an aperture mechanism 105, an aperture control circuit 106, and an image sensor. 107, analog front end (AFE) circuit 108, image processing circuit 109, display control circuit 110, display panel 111, shape detection circuit 112, distance detection circuit 113, face detection circuit 114, compression / The expansion unit 115 includes a recording control circuit 116, a recording medium 117, a communication unit 118, and an auxiliary light emitting circuit 119. The digital camera 100 is connected to a server 400 and a PC 500 via a network 300 so as to be able to communicate.

  The MPU 101 sequentially controls each block constituting the digital camera 100 according to the operation of the operation unit 102 from the user. The operation unit 102 is obtained from the server 400, a release switch for causing the digital camera 100 to perform shooting, a changeover switch for switching the operation mode of the digital camera 100 to any one of the shooting mode, the playback mode, and the digest playback mode. The switch etc. which switch on / off of information display are included.

  The MPU 101 also has a timer for measuring the time when the user took a picture. Thereby, the photographing time is associated with the image data obtained by photographing.

  The taking lens 103 forms an image from the subject 200 on the image sensor 107. The photographing lens 103 includes a lens for autofocus (focusing). During autofocus, the MPU 101 controls the AF circuit 104 while switching the lens position of the focusing lens while monitoring the lens position of the focusing lens, and performs focusing of the photographing lens 103. The diaphragm mechanism 105 is a mechanism that is provided in or near the photographing lens 103 and produces the effects of a shutter and a diaphragm. The aperture mechanism 105 is opened to a predetermined aperture by the aperture control circuit 106 at the start of shooting and closed at the end of shooting. By changing the aperture of the aperture mechanism 105 at the time of shooting, the depth of field of the shooting lens 103 changes. Thereby, it is possible to switch the expression such as adjusting the degree of blurring of the background subject to make the main subject appear at the time of shooting or to clearly depict the background subject.

  The image sensor 107 has a light receiving surface configured by arranging a large number of pixels, and converts an image from the subject 200 received through the photographing lens 103 into an electrical signal. In the present embodiment, the image sensor 107 may use either a CCD system or a CMOS system.

  The AFE circuit 108 includes a CDS circuit, a gain adjustment circuit, an AD conversion circuit, and the like, and is obtained by performing analog processing such as correlated double sampling processing and gain adjustment processing on the analog electric signal obtained in the image sensor 107. The obtained image signal is converted into digital data and input to the image processing circuit 109. The AFE circuit 108 is also provided with a function of reading signals from a plurality of pixels constituting the image sensor 107 at a time. For example, the AFE circuit 108 can read out signals of 4 pixels (2 × 2 pixels) and 9 pixels (3 × 3 pixels) all together, and improve the S / N by adding these read-out electrical signals. . By such processing, the apparent sensitivity of the image sensor 107 can be increased.

  Further, the AFE circuit 108 also has a function of selecting an output signal from the image sensor 107, and can extract only signals from pixels in a limited range among all effective pixels of the image sensor 107. In general, the image sensor 107 can read signals at high speed by performing thinning. Using this function, if an image obtained for composition confirmation by the image sensor 107 is read at high speed and processed by the image processing circuit 109 and then displayed on the display panel 111, the user is displayed on the display panel 111. It is possible to perform framing using an image.

  The image processing circuit 109 corrects the color, gradation, sharpness, etc. in the image data input from the AFE circuit 108, or amplifies the level of the image data to a predetermined level to adjust it to the correct shading and the correct gray level. Various image processing is performed.

  Further, in order to display various images such as the framing image as described above, the image processing circuit 109 resizes (reduces) the image data input from the AFE circuit 108 so that the image data can be displayed on the display panel 111. It also has a function to

  The display control circuit 110 converts the image data obtained by the image processing circuit 109 and the image data recorded on the recording medium 117 into a video signal, and displays it on the display panel 111. The display panel 111 is a display panel such as a liquid crystal display panel or an organic EL display panel. The display control circuit 110 also has a multi-screen display function for displaying a plurality of images superimposed on the display panel 111. With this multi-screen display function, it is also possible to superimpose a character display of mode setting and various warning displays on the captured image or the captured image.

  The shape detection circuit 112 detects contour information in the image data obtained by the image processing circuit 109.

  The distance detection circuit 113 detects the contrast of the image obtained by the image processing circuit 109. The contrast detected by the distance detection circuit 113 is used during autofocus. That is, while the AF circuit 104 changes the lens position of the focusing lens of the photographing lens 103, the distance detection circuit 113 sequentially detects the contrast of the image, and stops the focusing lens at the lens position where the detected contrast is maximized. By doing so, the photographing lens 103 can be focused. It is also possible to detect the distance of the main subject, the distance of the background subject, and the like based on the information on the lens position at the time of focusing.

  The face detection circuit 114 obtains an image of a particular face portion of the main subject from the distribution of feature points in the image obtained by the image processing circuit 109 (for example, if the main subject is a person, eyes, nose, mouth, etc.). To detect.

  The shape detection circuit 112, the distance detection circuit 113, and the face detection circuit 114, in the sense of improving the quality of a photograph, determine what kind of photograph the user is going to take at the time of photographing and optimize the photographing control. It is used for the purpose (such as setting to portrait mode). Further, when the image is reproduced, the main subject (the face portion) and the background portion of the image can be separated by the face detection function by the face detection circuit 114. Thereby, the shape of the eyes and mouth can be detected from the face portion, and compared with a database 116a in the recording control circuit 116 described later, it can be determined whether the face is an expressionless face or an expressional face. Further, by determining how many faces are detected in the image by the face detection circuit 114, it is possible to determine whether the image is a group photo.

  The compression / expansion unit 115 compresses the image data processed by the image processing circuit 109 at the time of shooting, and expands the image data read from the recording medium 117 via the recording control circuit 116 at the time of shooting.

  The recording control circuit 116 records the image data compressed by the compression / expansion unit 115 on the recording medium 117 with accompanying data such as a shooting time. The recording control circuit 116 has a database 116a for comparing images such as face portions. The contents of the database 116a may be recorded when the camera is manufactured, but may be rewritable via a network from the server 400 or the like outside the digital camera 100.

  The communication unit 118 transmits image data or the like recorded on the recording medium 117 to a personal computer (hereinafter referred to as a PC) 500 or a server 400 outside the digital camera 100, or receives various information from the server 400 or the like. Communication control when The communication unit 118 can transfer an image captured by the digital camera 100 to another person, or can add information using a service on a network (for example, a service linked with a network-connected site). Can be received.

  The auxiliary light emitting circuit 119 irradiates the subject 200 with auxiliary light according to the situation at the time of shooting. This prevents insufficient brightness and unevenness during shooting.

  In the digital camera 100 having such a configuration, in this embodiment, it is possible to perform digest playback by selecting and displaying an image that easily recalls a memory from among many images. That is, when the user operates the operation unit 102 to set the operation mode of the digital camera 100 to the digest playback mode, there are a plurality of persons in the image recorded on the recording medium 117 and the relationship between the plurality of persons. Therefore, an image that easily recalls nostalgia is selected, and the image is preferentially displayed on the display panel 111.

  Hereinafter, playback in the digest playback mode will be further described. In the following description, an example in which the digest playback mode function is realized on a server outside the digital camera 100 will be described. However, by providing the MPU 101 of the digital camera 100 with a server function to be described later, the digital camera 100 can also perform playback in the digest playback mode.

  FIG. 2 is a diagram showing a configuration of a communication system including an image display device according to an embodiment of the present invention. In the communication system shown in FIG. 2, a server 400, a PC 500, and a PC 600 are connected via a network 300 so that data communication is possible. Further, image data is input to the PC 600 from the digital camera 100 and the scanner 700, and this image data can be transmitted to the server 400 via the network 300. Here, in the example of FIG. 2, a single server 400 has a database and image determination function. These functions can be distributed to a plurality of servers to provide a lighter system.

  Note that the communication system described below can take measures against situations where the amount of image data is too large to examine images one by one, such as when organizing images such as family chronology. It is a system that can. For example, a system can be easily configured to recall the memories of an old family when, for example, independent children have returned home.

  Photo image data taken by the digital camera 100 and photo image data (image data 800) captured by the scanner 700 are transmitted via the PC 600 and the network 300. Here, the image data obtained by the digital camera 100 is attached with accompanying information such as a shooting date and time and a title. However, face position data in an image obtained at the time of shooting may be added. By assigning face position data and the like, the server 400 does not need face detection described later, and the processing amount of the server 400 can be reduced.

  In the network 300, there is a server 400 that performs various services by making full use of information that goes there. In the present embodiment, when the digest playback mode is selected by the user, the server 400 selects the image data 900 that can be remembered from the past from the image data 800 sent from the PC 600. Display control is performed based on the image data 900 so that the image can be viewed on the PC 500. As a result, other users can share a photographic image captured by the digital camera 100 or an image captured by the scanner 700.

  Such a server 400 includes a communication unit 401, a recording unit 402, an access reaction unit 403, a face detection unit 404, a facial expression detection unit 405, a background detection unit 406, an image determination unit 407, a database classified by age. 408, an image selection unit 409, and a display control unit 410. Here, each function of the server 400 may be configured by hardware or may be configured as software.

  The communication unit 401 performs communication control when the server 400 performs communication via the network 300. The recording unit 402 records image data transmitted via the network 300. When an operation instruction is given from the user, the access reaction unit 403 performs control according to the instruction. Specifically, when an instruction to record image data is given from the user, the image data transmitted together with this instruction is recorded in the recording unit 402. On the other hand, when the user gives an instruction to reproduce the image data, the image selection unit 409 is instructed to select an image corresponding to the reproduction mode at that time. Here, the access reaction unit 403 has at least the digest reproduction mode described above as a reproduction mode.

  The face detection unit 404 detects a face part in the image recorded in the recording unit 402. Similar to the face detection circuit 114 of the digital camera 100, the face can be detected from the distribution of feature points in the image (for example, if the main subject is a person or the like, eyes, nose, mouth, etc.). . The facial expression detection unit 405 evaluates the display priority of the image in the digest reproduction mode by detecting the facial expression from the facial image detected by the facial detection unit 404.

  The background detection unit 406 detects a background part in the image recorded in the recording unit 402. Here, the background portion is a portion of the image 800 other than the person shown by the broken line frame 801 in the figure, for example. In order to simplify the processing, a part other than the face part of the person (including the person's body) may be detected as the background part. In order to simplify the description, in the following description, a part other than the face detected by the face detection unit 404 is detected as the background. The image determination unit 407 evaluates the display priority of the image in the digest playback mode by determining the presence or absence of a subject that easily recalls memories such as characters in the background portion detected by the background detection unit 406. The age-specific database 408 records various types of data necessary for determining the subject that easily recalls the memories in the image determination unit 407 by age. For example, in the age-specific database, character fonts and catchphrase data according to age, clothing, vehicle data, and the like are recorded.

  The image selection unit 409 has a function of selecting image data from the recording unit 402 according to an instruction from the access reaction unit 403, and is detected by the facial expression detection unit 405 when the digest reproduction mode is selected by the user. It has a function of selecting image data that easily recalls memories from the facial expression and the subject determined by the image determination unit 407. The display control unit 410 performs display control so that the image data selected by the image selection unit 409 can be viewed on the PC 500.

  Hereinafter, the operation of the communication system shown in FIG. 2 will be described. FIG. 3 is a flowchart showing the operation of the server 400 of FIG.

  When an operation instruction is given by the user, the access reaction unit 403 of the server 400 determines whether the instruction is an instruction to record image data (an instruction to upload image data) or an instruction to reproduce the image data (an instruction to download image data). Is determined (step S1). If it is an image recording instruction in the determination in step S1, the access reaction unit 403 records the image data transmitted together with the image recording instruction from the user in the recording unit 402 (step S2).

  The following processes in steps S3 to S7 are processes for smoothly reproducing the image data in the digest reproduction mode. These processes may be performed in a digest playback mode to be described later. After the image data is recorded in the recording unit 402 in step S2, the background portion of the image data recorded in the recording unit 402 is detected by the face detection unit 404 and the background detection unit 406 (step S3). Details of the processing in step S3 will be described later.

  After the background portion is detected, the image determination unit 407 determines whether there is an image including a subject whose age can be easily specified in the image (step S4). Details of the determination in step S4 will be described later. In the determination in step S4, when there is an image including a subject whose age is easy to specify, the image determination unit 407 uses, for example, the determination in step S4 as a code for identifying an image including a subject easy to specify the age. The “priority” obtained at this time is recorded in the recording unit 402 in association with the image data (step S5). As will be described in detail later, “priority” is an index for quantifying the ease of specifying the age. On the other hand, if it is determined in step S4 that there is no subject whose age can be easily specified, the process in step S5 is skipped.

  Next, the facial expression detection unit 405 of the server 400 determines whether or not the facial image detected by the face detection unit 404 is a facial expression image that invites nostalgia (step S6). Details of the determination in step S6 will be described later. In the determination in step S6, when the facial image is a facial expression image that invites nostalgia, the facial expression detection unit 405 uses, for example, the determination in step S6 as a code for identifying the facial expression image that invites nostalgia. The obtained “nostalgic degree” is recorded in the recording unit 402 in association with the image data (step S7). Thereafter, the processing of FIG. 3 is terminated. Here, “nostalgic degree” is an index for quantifying nostalgia. On the other hand, if it is determined in step S6 that the face image is not a facial expression image that invites nostalgia, the process of step S7 is skipped.

  Further, when it is an instruction to reproduce an image in the determination in step S1, the access reaction unit 403 determines whether or not the reproduction instruction is reproduction in the digest reproduction mode (step S8). If it is determined in step S8 that the reproduction is in the digest reproduction mode, the access reaction unit 403 sends an image selection instruction for the digest reproduction mode to the image selection unit 409. In response to this, the image selection unit 409 extracts image data attached with “priority” and “nostalgic degree” from the image data recorded in the recording unit 402 (step S9). Then, the image selection unit 409 selects one having a high “priority” or “nostalgic degree” from the extracted image data (step S10). This may be such that only image data having the highest “priority” or “nostalgic degree” is selected, or all image data having “priority” or “nostalgic degree” higher than a predetermined threshold value are all selected. You may make it select. After image data with a high “priority” or “nostalgic degree” is selected, the display control unit 410 controls the image data selected by the image selection unit 409 to be displayed on the PC 500 in order of age (steps). S11). Thereafter, the processing of FIG. 3 is terminated. Here, since it is not always possible to specify the exact age, the display order in step S11 may accept a certain degree of freedom. In addition, an enlargement ratio at the time of display may be increased for an image having a higher “priority” or “nostalgic degree” at the time of display.

  If it is determined in step S8 that the playback is not in the digest playback mode, the access reaction unit 403 sends an instruction to the display control unit 410 to display a list display of images recorded in the recording unit 402 on the PC 500. (Step S12). In this case, after the image selected by the user is selected by the image selection unit 409, the image is displayed on the PC 500 under the control of the display control unit 410.

  FIG. 4 is a flowchart illustrating an example of a processing procedure of face detection processing for background portion detection in step S3 of FIG. The face detection process is not necessarily limited to the process shown in FIG. Further, the face detection process shown in FIG. 4 is the same as the process performed in the face detection circuit 114 of the digital camera 100.

  First, the face detection unit 404 reads out image data from the recording unit 402 and emphasizes a shadow in the image (step S101). This is a process for enhancing the contrast of an image. For example, when shadow enhancement processing is performed on the image 800 shown in FIG. 5, an image in the vicinity of the face 802 is an image in which a shadowed part or an outline part is emphasized as indicated by reference numeral 803.

  After emphasizing the shadow of the image, the face detection unit 404 sets the pattern of the eyes and nose (step S102). An example of an eye-nose pattern is indicated by reference numeral 804 in FIG. Face detection is performed by matching the eye-nose pattern 804 with the shadow-enhanced image 803. Usually, the face size and orientation in an image obtained by photographing vary, and therefore the eye-nose pattern 804 is also a face. Prepare a number corresponding to the direction and size of the. The process of step S102 is a process for setting one of a plurality of prepared eye / nose pattern 804.

  Next, the face detection unit 404 performs a matching process between the shadow-enhanced image (actually, other than the vicinity of the face 802 is included) 803 and the eye-nose pattern 804 (step S103). This is a process for obtaining the degree of coincidence between the images by scanning the shadow-enhanced image 803 with the eye-nose pattern 804, for example, by correlation calculation. After this matching process, the face detection unit 404 determines whether there is a position where the eye / nose pattern 804 is matched, that is, a position where the degree of coincidence between the shadow enhanced image 803 and the eye / nose pattern 804 is higher than a predetermined amount. It is determined whether the image exists in the image (step S104). If it is determined in step S104 that a matching position exists, the face detection unit 404 detects the image at that position as a face image (step S105).

  On the other hand, if there is no matching position at the position of step S104, the orientation and size of the face in the image may be different from the eye-nose pattern 804. Further, when there are a plurality of face portions in the image, not all face portions can be detected with one eye-nose portion pattern 804. Therefore, if there is no matching position in the determination in step S104, or after step S105, the face detection unit 404 uses all the eye-nose pattern 804 to determine whether to end the face detection process. It is determined by determining whether or not it has been performed (step S106). If it is determined in step S106 that matching processing has not been performed using all the eye-nose pattern 804, the face detection unit 404 switches to another eye-nose pattern (step S107), and returns to step S103. The matching process is performed again. On the other hand, when the matching process is performed using all the eyes and nose pattern 804, the position information of the face is output to the background detection unit 406, and the face detection process ends. In response to this, the background detection unit 406 detects all images other than the face detected in step S105 as images of the background (step S108). When the background portion is detected in this way, the process proceeds to step S4 in FIG.

  FIG. 6 is a flowchart showing the determination process for determining whether or not there is an easily identifiable subject in step S4 of FIG. Here, in the present embodiment, when a subject that is easy to specify the age exists in the background image, the “priority” is set according to the ease of specifying the age of the subject. . The subject with the higher “priority” is easier to specify the age, and the user who sees it is more likely to recall nostalgia.

  In FIG. 6, the image determination unit 407 first determines whether or not a subject including characters such as a station name and a signboard exists in the background image (step S201). For this purpose, the image determination unit 407 performs a character detection process shown in FIG.

  Here, the character detection process for performing the determination of step S201 will be described with reference to FIGS. FIG. 7 is a flowchart showing an example of character detection processing used in the determination in step S201 of FIG. FIG. 8 is a diagram for explaining the concept of the character detection process of FIG.

  Character detection is performed by detecting the line portion 805 and the blank portion 806 existing between the line portions 805 of the character image shown in FIG.

  First, the image determination unit 407 acquires a contrast-enhanced image I1 by enhancing the contrast of the background image (step S2011). Next, the image determination unit 407 binarizes the background image to obtain a binarized image I2 (step S2012).

  Thereafter, the image determination unit 407 obtains the degree of coincidence between the contrast enhanced image I1 and the binarized image I2 from the difference between the contrast enhanced image I1 and the binarized image I2 (step S2013). Then, the image determination unit 407 determines whether or not there is a portion where the degree of coincidence between the contrast-enhanced image I1 and the binarized image I2 is large (that is, a portion where the difference is small) in the background image (step S2014). If it is determined in step S2014 that there is no portion where the degree of coincidence between the contrast-enhanced image I1 and the binarized image I2 is large, the image determination unit 407 determines that there is no subject including characters in the background image (step S2014). S2017).

  On the other hand, if it is determined in step S2014 that there is a portion where the degree of coincidence between the contrast-enhanced image I1 and the binarized image I2 is large, the image determination unit 407 determines that the portion is configured by a line image. Then, the image determination unit 407 detects an image around a portion with a high degree of coincidence (step S2015). Then, it is determined whether or not many blank portions, that is, low contrast portions occupy the detected portion of the image (step S2016). If it is determined in step S2016 that the number of blank portions is small, the image determination unit 407 determines that the image of that portion does not have character image characteristics and that there is no character image (step S2017). On the other hand, if it is determined in step S2016 that there are many blank portions, the image determination unit 407 determines that the image of the portion has the characteristics of a character image and that a subject including characters exists (step S2018). ).

  Here, it returns to description of FIG. 6 again. If it is determined in step S201 that an object including characters exists in the background image, the image determination unit 407 adds 5 points to the “priority” (step S202). In other words, the character information becomes a clear material for reading the place and the atmosphere at that time, and is considered to be information that is easy to specify the age. Therefore, the “priority” score is increased. After setting “priority”, the image determination unit 407 collates the detected character with the character image recorded in the age-specific database 408 to specify the age (step S211). Then, the process of FIG. 6 is exited and the process proceeds to step S5 of FIG.

  On the other hand, in the determination in step S201, when there is no subject including characters in the background image, the image determination unit 407 determines whether or not the vehicle subject is included in the background image. For example, the determination is made by matching with a vehicle image recorded in the age-specific database 408 (step S203). If it is determined in step S203 that the vehicle subject is included in the background image, the image determination unit 407 adds four points to the “priority” (step S204). In other words, vehicles such as trains and buses, like characters such as signs and signs, are easy to identify places and show transitions according to age, so “priority” is set next to character information. After setting “priority”, the image determination unit 407 identifies the age based on the detected vehicle subject (step S211). Then, the process of FIG. 6 is exited and the process proceeds to step S5 of FIG.

  On the other hand, in the determination in step S203, when the vehicle subject is not included in the background image, the image determination unit 407 includes the subject wearing fashionable clothes in the background image. For example, it is determined by matching with a trendy clothing image recorded in the age-specific database 408 (also using the shape of the collar, sleeve, tie thickness, color, etc.) (step S205). If it is determined in step S205 that a subject wearing fashionable clothes is included in the background image, the image determination unit 407 adds three points to “priority” (step S206). After setting “priority”, the image determination unit 407 identifies the age of the detected fashionable clothes (step S211). Then, the process of FIG. 6 is exited and the process proceeds to step S5 of FIG.

  On the other hand, if it is determined in step S205 that the background image does not include a subject wearing fashionable clothes, the image determination unit 407 includes a building subject in the background image. It is determined whether the image is taken indoors (step S207). In the determination in step S207, if the background image includes a building subject or the image is taken indoors, the image determination unit 407 adds two points to the “priority” (step S208). . That is, even when a building or a room is clearly shown, points are added to the “priority” on the assumption that an element for specifying the location is reflected. After setting “priority”, the image determination unit 407 identifies the age from the detected building subject and indoor image (step S211). Then, the process of FIG. 6 is exited and the process proceeds to step S5 of FIG.

  On the other hand, if it is determined in step S207 that the building subject is not included in the background image or the image is not taken indoors, the image determination unit 407 determines that the ground in the background image is the ground image. It is determined whether or not is paved (step S209). If the ground in the background image is not paved in the determination in step S209, the image determination unit 407 adds 1 point to the “priority” (step S210). That is, an image in which the ground is not paved in an urban area or the like is considered an old image. In this case as well, a score is added to the “priority”. After setting “priority”, the image determination unit 407 identifies the age based on the detected level of pavement on the ground (step S211). Then, the process of FIG. 6 is exited and the process proceeds to step S5 of FIG.

  On the other hand, in the determination of step S209, if the ground in the background image is paved, the process of FIG. In this case, it is determined in step S4 in FIG. 3 that there is no subject whose age can be specified in the background image.

  By determining the “priority” as in the process of FIG. 6, an image including a subject that recalls the age in the background can be displayed with priority. In the process of step S4 in FIG. 3, the “priority” does not increase for an image with a simple wall background, such as an ID photo, or an image with only the sky or mountains in the background. Further, in the process of step S4 in FIG. 3, the “priority” does not increase even in a group photo or the like with nature in front. However, since such a group photo can be an image reminiscent of nostalgia, the determination in step S6 is performed in order to determine such an image, and the “nostalgic degree” is obtained.

  With reference to FIGS. 9-12, the determination process of whether it is the facial expression which invites the nostalgia of FIG.3 S6 is demonstrated. Here, “an expression that invites nostalgia” in the processing described below does not necessarily indicate only an expression such as an individual's laughter, but also includes a relationship with a person who is shown together. Therefore, even if there are no facial expressions, what is reflected in many people is a facial expression appropriate for the place, so that it can also be counted as a nostalgic facial expression.

  FIG. 9 is a flowchart for obtaining “a nostalgic degree corresponding to facial expressions” such as a person's crying and laughing. FIG. 12 is a flowchart for obtaining “a nostalgic degree corresponding to the relationship between the persons” when there are a plurality of persons in the image.

  First, FIG. 9 will be described. The facial expression detection unit 405 detects the facial expression from the facial image detected by the face detection unit 404 (step S301).

  Here, the facial expression detection process will be described with reference to FIGS. FIG. 10 is a flowchart showing an example of facial expression detection processing in step S301 of FIG. FIG. 11 is a diagram for explaining the concept of the facial expression detection process of FIG.

  First, the facial expression detection unit 405 detects an eye part, a nose part, and a mouth part from the shadow distribution of the face image (step S3011). Next, the facial expression detection unit 405 determines whether the face is facing the front from the detected positional relationship between the eyes, nose, and mouth (step S3012). In step S <b> 3012, for example, when both eyes are biased to any face screen, it is determined that the face is facing sideways. Further, when both eyes are evenly arranged in the left-right direction of the face and the nose part is arranged at a substantially central part in the up-down direction of the face, it is determined that the front is facing.

  If it is determined in step S3012, the facial expression detection unit 405 detects the center position L1 of the straight line connecting both ends of the lips in the mouth detected in step S3011 (see FIG. 11A). (Step S3013). Next, the facial expression detection unit 405 detects the upper center position L2 of the lips (see FIG. 11A) (step S3014). Further, the facial expression detection unit 405 detects the lower position N1 (see FIG. 11A) detected in step S3011 (step S3015).

  Next, the facial expression detection unit 405 obtains a difference between the distance between L1 and N1 and the distance between L2 and N1 (step S3016). Then, the facial expression is determined from this difference. For example, in the case of a smile, both ends of the lips are lifted as shown in FIG. 11B, and the distance between L1 and N1, the distance between L2 and N1, and the difference between them are the true faces shown in FIG. It is considered to be smaller than the case of. In the case of a crying face, both ends of the lips are lowered as shown in FIG. 11 (d), and the distance between L1 and N1 and the distance and difference between L2 and N1 are the true faces shown in FIG. 11 (c). It is thought that it becomes larger than the case of. Therefore, the facial expression can be determined by comparing the difference obtained in step S3016 with a predetermined threshold value indicating smile, true face, or crying face.

  Based on the above concept, the facial expression detection unit 405 determines whether or not the difference obtained in step S3016 is greater than a threshold value indicating a crying face (step S3017). If it is determined in step S3017 that the difference is larger than the threshold value indicating a crying face, the facial expression detection unit 405 determines that the facial expression is a crying face (step S3018). Thereafter, the process of FIG. 10 is exited. On the other hand, if it is determined in step S3017 that the difference is smaller than a threshold value indicating a crying face, the facial expression detection unit 405 determines whether the difference is smaller than a threshold value indicating a smile (step S3019). If the difference is smaller than the threshold value indicating smile in step S3019, the facial expression detection unit 405 determines that the facial expression is smiling (step S3020). Thereafter, the process of FIG. 10 is exited. On the other hand, if it is determined in step S3019 that the difference is larger than the threshold value indicating smile, the facial expression detection unit 405 determines that the facial expression is a true face (step S3021). Thereafter, the process of FIG. 10 is exited.

  In the determination in step S3012, if the face is not facing the front, it is difficult to determine the facial expression by the processing in steps S3013 to S3021. Therefore, in this case, the determination is simplified. That is, the facial expression detection unit 405 determines whether teeth (white portions) can be detected at the mouth (step S3022). If it is determined in step S3022 that teeth can be detected, the facial expression detection unit 405 determines that the facial expression is a smile (step S3023). Thereafter, the process of FIG. 10 is exited. On the other hand, if it is determined in step S3022 that teeth cannot be detected, it is determined that facial expression cannot be detected, and the process of FIG.

  Here, it returns to description of FIG. 9 again. In step S301, after detecting a facial expression, the facial expression detection unit 405 determines whether the detected facial expression is a smile of a plurality of persons (step S302). If it is determined in step S302 that the detected facial expression is a smile of a plurality of persons, the facial expression detection unit 405 adds 5 points to the “nostalgic level” (step S303). Then, the process of FIG. 9 is exited and the process of FIG. 12 is started. That is, for a photograph having a plurality of faces and facial expressions of smiling faces, the “nostalgic degree” is set higher because there was a fun at that time.

  On the other hand, if it is determined in step S302 that the detected facial expression is not a smile of a plurality of persons, the facial expression detection unit 405 determines whether or not the detected facial expression is such that a plurality of faces face each other (step S304). If it is determined in step S304 that the detected facial expression is such that a plurality of faces face each other, the facial expression detection unit 405 adds 4 points to the “nostalgic level” (step S305). Then, the process of FIG. 9 is exited and the process of FIG. 12 is started. In such a case as well, it can be considered that the image shows that there was some kind of exchange between the people at that time, so it can be considered as an image that can remember the time including the emotion at that time.

  On the other hand, if it is determined in step S305 that the detected facial expression does not face a plurality of faces, the facial expression detection unit 405 determines whether the detected facial expression is an up smile (step S306). If it is determined in step S306 that the detected facial expression is a smiling face, the facial expression detection unit 405 adds three points to the “nostalgic level” (step S307). Then, the process of FIG. 9 is exited and the process of FIG. 12 is started. In other words, an up smile is considered to be a photograph taken with great care by the photographer even if the subject is not conscious of it.

  On the other hand, if it is determined in step S306 that the detected facial expression is not an up smile, the facial expression detection unit 405 determines whether the detected facial expression is an up crying face (step S308). If it is determined in step S308 that the detected facial expression is an up-crying face, the facial expression detection unit 405 adds two points to the “nostalgic level” (step S309). Then, the process of FIG. 9 is exited and the process of FIG. 12 is started. In other words, the up crying face may not be interesting to the subject himself, but because the emotion is so high, there is a high possibility that some memory remains, and this is also an expression that can recall memories Since it can be considered, add points to the "nostalgic degree".

  On the other hand, if it is determined in step S308 that the detected facial expression is not an up-crying face, the facial expression detection unit 405 determines whether there is a human face that does not exist in the detected facial expression (step S310). . For this determination, an image of a face of a specific person such as a family is recorded in the facial expression detection unit 405, and this image is compared with the facial image input to the facial expression detection unit 405. . In the determination in step S310, if there is another human face that does not exist in the detected facial expression, the facial expression detection unit 405 adds one point to the “nostalgic degree” (step S311). Then, the process of FIG. 12 is started.

  Next, FIG. 12 will be described. Speaking of nostalgia according to the relationship between persons, for example, a photograph taken with parents as a child as shown in FIG. In the processing of FIG. 12, such an image is determined from the sizes and positional relationships of the images of a plurality of face portions. Further, the size of the face of the person in the image changes depending on the subject distance at the time of shooting. That is, when the subject distance is long, the size of the face on the image is relatively small, and conversely, when the subject distance is short, the size of the face on the image is relatively large. Therefore, distance information detected by the distance detection circuit 113 is also used when comparing the sizes of the face portions.

  In the facial image detected by the face detection unit 404, the facial expression detection unit 405 includes a small person (child) 808 below a large male and female (adult male and female) 807, as shown in FIG. It is determined whether or not it exists (step S401). Here, the discrimination between adults and children is made based on the size of the face image detected by the face detection unit 404. In addition, the determination of gender can be made based on differences in hairstyle, body size, clothes, and the like. If it is determined in step S401 that there is a small person under the large number of men and women in the image, the facial expression detection unit 405 adds 10 points to the “nostalgic degree” (step S402). Then, the process of FIG. 12 is exited and the process proceeds to step S7 of FIG. That is, if there are large male and female faces in the image, these are considered to be couples. Also, if there is a person with a small face underneath, it can be considered as a picture of parents and children. Such nostalgia for photos can be considered exceptional, so the “nostalgic level” is set high.

  On the other hand, in the determination of step S401, when there is no small person between the large men and women in the image, the facial expression detection unit 405 has a small person beside the large men and women in the image. It is determined whether or not (step S403). If it is determined in step S403 that there is a small person beside a plurality of large men and women in the image, the facial expression detection unit 405 adds 8 points to the “nostalgic degree” (step S404). Then, the process of FIG. 12 is exited and the process proceeds to step S7 of FIG. In such a case, it can be classified as an image reminiscent of nostalgia because it is thought that a close atmosphere is created following the presence of a small person between men and women.

  On the other hand, in the determination in step S404, when there is no small person next to the large number of men and women in the image, the facial expression detection unit 405 determines that the large person 807 in the image as shown in FIG. It is determined whether or not the small person 808 is in close contact (step S405). If it is determined in step S405 that a large person and a small person are in close contact with each other in the image, the facial expression detection unit 405 adds 6 points to the “nostalgic degree” (step S406). Then, the process of FIG. 12 is exited and the process proceeds to step S7 of FIG. In the case of photos of adults and children, they can be considered as photos of mothers and children, fathers and children, or brothers, cousins, uncles, aunts, great-grandparents, for example, not parents. Therefore, such a photograph can be determined in step S405, and points are added to the “nostalgic degree”.

  On the other hand, if it is determined in step S406 that a large person and a small person are not closely present in the image, the facial expression detection unit 405 determines whether there are a large person and a plurality of small persons in the image. It is determined whether or not (step S407). If it is determined in step S407 that there are a large person and a plurality of small persons in the image, the facial expression detection unit 405 adds 5 points to the “nostalgic degree” (step S408). Then, the process of FIG. 12 is exited and the process proceeds to step S7 of FIG. In this case, for example, an image such as an adult surrounded by children or a grandparent surrounded by grandchildren is assumed. Such an image is also smiley, and it is thought that it is easy to recall nostalgia.

  On the other hand, if it is determined in step S407 that there are neither a large person nor a plurality of small persons in the image, the facial expression detection unit 405 determines whether the ratio between the face part and the body part is small ( Step S409). If it is determined in step S409 that the ratio between the face part and the body part is small, the facial expression detection unit 405 adds one point to the “nostalgic degree” (step S410). Then, the process of FIG. 12 is exited and the process proceeds to step S7 of FIG. As the ratio of face to body size grows as it grows, photos with a small ratio are considered children's photos. For example, in order to obtain the size ratio between the face and the body in the scene as shown in FIG. 14A, the contour component is extracted from the shadow-enhanced image obtained by the face detection unit 404 as shown in FIG. The face sizes (F1 and F2 in the figure) of a plurality of people shown in b) are detected. Further, the waist of each person is detected in the image from which the contour component is extracted, thereby detecting the size from the neck to the waist (B1 and B2 in the drawing). As described above, the ratio F2 / B2 is smaller between the ratio F1 / B1 for adults and the ratio F2 / B2 for children. That is, since the ratio of the face size to the body size is larger for the child, it is possible to discriminate between the adult and the child in the image by making such a determination. However, if the “nostalgic level” based on the ratio of face to body is too high, it will result in only pictures of children, so the score is lower than that of photographs with adults.

  As shown in the process of FIG. 12, the relationship between a plurality of persons is determined from the composition of the image, and the relationship is considered to be intimate or the “nostalgic degree” of what is considered to be a photo with the family is increased. By displaying images preferentially, family members can immerse themselves in nostalgic feelings when they see the images. By combining the processing of FIG. 12 with the processing of FIG. 9, an image in which there is a laughing person and the person is in close contact with the child as shown in FIG. Degree (that is, display priority) ".

  As described above, according to the present embodiment, an image that is considered to be an intimate relationship between a plurality of persons, an image that is considered to be a family photo, an image in which a person in the image is laughing, or the like Since the display is given priority over the image, it is possible to reliably select an image such as the age of the family and display it on the PC 500. As a result, relatives away from each place can appreciate images such as the family's age history in a short time.

  In recent years, many large-screen television apparatuses and the like that have become popular have a network connection function. Therefore, such a television apparatus can be connected to the network 300 in the communication system of FIG. For example, the image can be displayed on a large-screen television device at a party or the like and enjoyed by the whole family.

[Modification]
Hereinafter, modifications of the above-described embodiment will be described.
In the processing of FIG. 6 described above, an image with an easily identifiable age is detected from the background image, the “priority” of the image is increased to increase the display priority, and the acquired age of the image is specified. However, it is not always possible to specify the age. Further, in the above-described embodiment, the display priority is high not only for images that are easy to specify the age, but even if it is difficult to specify the age, images with facial expressions that easily recall nostalgia and relationships between persons are intimate. The image considered to be is also included. Therefore, in the first modification of the present embodiment, an image considered to have been taken in the same age as an image for which age identification can be performed is selected and displayed on the PC 500.

  FIG. 15 is a diagram for explaining the concept of the first modification. FIG. 16 is a flowchart showing the process of the first modification. Here, the process of FIG. 16 is performed after step S10 of FIG. 3, for example.

  In step S <b> 10 of FIG. 3, the image selection unit 409 selects an image with a high “priority” or “nostalgic degree” from the recording unit 402. Thereafter, the processing of FIG. 16 is performed. First, the image selection unit 409 determines whether or not the selected image is an image (first image) whose age can be specified based on the value of “priority” (step S501). For example, as shown in FIG. 15, since the image in which the calendar 809 is shown in the image is a subject including characters, it is determined that the “priority” is added in the processing of FIG. Is done. If it is determined in step S501 that the selected image is an image whose age cannot be specified, the process of FIG. 16 is exited. In this case, only the image selected by the image selection unit 409 is displayed on the PC 500 under the control of the display control unit 410.

  On the other hand, if it is determined in step S501 that the selected image is an image whose age can be specified, the face detection unit 404 detects the face of the person 808 in the image (step S502). After the face is detected by the face detection unit 404, the image selection unit 409 displays an image (second image) 810 including a person having the same face as the face detected by the face detection unit 404 in the recording unit 402. Selection is made from among them (step S503). The determination as to whether or not the face portions are the same can be made, for example, by matching the face image.

  After the selection in step S503, the image selection unit 409 determines whether an image 810 including a person having the same face has been selected (step S504). That is, if the images include persons having the same face, they can be considered to have been acquired in the same age. If it is determined in step S504 that an image 810 including a person having the same face cannot be selected, the process of FIG. 16 is exited. In this case, only the image selected by the image selection unit 409 is displayed on the PC 500 under the control of the display control unit 410.

  On the other hand, if it is determined in step S504 that an image including the person 808a having the same face can be selected, the image selection unit 409 sends the selected image to the display control unit 410 together with the image selected in step S10 in FIG. . The display control unit 410 controls the images sent from the image selection unit 409 to be displayed side by side on the PC 500 (step S505). Thereafter, the process of FIG. 16 is exited and the process of FIG. 3 is terminated.

  According to the first modification described above, by selecting an image of a person having the same face as the person in the image whose age can be specified, the age of the image in which there is no subject for which age can be specified Identification can be performed, which can further remind the user of nostalgia.

  Here, in the process of step S503 in FIG. 16, the same image is selected for the face part, but the same image is selected including the body part in addition to the face part by using the contour extraction process or the like together. You may do it.

  Next, a second modification of the present embodiment will be described. The second modified example does not simply display an image having a high “priority” or “nostalgic degree”, but categorizes the images recorded in the recording unit 402 for each predetermined period. An image having a high “degree” or “nostalgic degree” is displayed.

  FIG. 17 is a flowchart showing the process of the first modified example. Here, the process of FIG. 17 is performed instead of the process after step S8 of FIG. 3, for example.

  First, the access reaction unit 403 determines whether or not the image reproduction instruction from the user is a reproduction instruction in the digest reproduction mode (step S601). If it is determined in step S601 that the playback is not in the digest playback mode, the process of FIG. 17 is skipped and the process of step S12 of FIG. 3 is performed.

  On the other hand, if it is determined in step S601 that the playback is in the digest playback mode, the access reaction unit 403 sends an image selection instruction for the digest playback mode to the image selection unit 409. In response to this, the image selection unit 409 selects an image having a high “priority” or “nostalgic degree”. Prior to this, the image selection unit 409 determines whether there is image data whose age is not specified in the image data recorded in the recording unit 402 (step S602). If there is image data whose age is not specified in the determination of step S602, the acquisition age of the image whose age is not specified is specified by the same process as in step S503 in FIG. (Step S603).

  After the process of step S603, the image selection unit 409 determines whether or not to end the age specification based on whether or not the process of step S603 has been performed on all image data for which no age has been specified (step S604). . If it is determined in step S604 that the process of step S603 has not yet been performed on image data for which all ages have not been specified, the process returns to step S602.

  On the other hand, in the determination of step S604, when the process of step S603 is performed on all image data for which no age has been specified, the image selection unit 409 classifies the image data for which the age has been specified for each acquisition age. (Step S605). This classification is performed, for example, by equally dividing the acquisition age by dividing the acquisition age into the 10th period between the oldest and the latest acquisition age, and classifying each image data into the respective categories. After the classification in step S605, the image selection unit 409 reads out image data having a high display priority (that is, “priority” or “nostalgic degree”) from the recording unit 402 and sends the image data to the display control unit 410. The display controller 410 controls the image sent from the image selector 409 to be displayed on the PC 500 (step S606). Thereafter, the access reaction unit 403 determines whether an instruction to end display / reproduction of an image has been given within a predetermined period (step S607). If it is determined in step S607 that an instruction to end display / reproduction of an image has not been given, the access reaction unit 403 notifies the image selection unit 409 to that effect. In response to this, the image selection unit 409 switches the classification of image data read from the recording unit 402 (step S608). After that, the process returns to step S606, and the display process of the image of another section is performed. On the other hand, if it is determined in step S607 that an instruction to end image display / reproduction is given, the processing in FIG. 17 ends.

According to the 2nd modification demonstrated above, an image can be divided for every acquisition age, and an image can be displayed in order with a high display priority for every division .

  Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention. For example, in the above-described embodiment, one “nostalgic degree” is set for each image data, but when a plurality of conditions overlap, the “nostalgic degree” corresponding to the plurality of conditions is added or multiplied. The final “nostalgic degree” may be obtained. Also, the score of “nostalgic degree” corresponding to the type of background subject and facial expression is an example, and can be determined as appropriate. The score may be set by the user.

  Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

1 is a block diagram illustrating a configuration of a digital camera as an example of a photographing apparatus including an image display device according to an embodiment of the present invention. It is a figure which shows the structure of the communication system containing the image display apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows operation | movement of a server. It is a flowchart shown about the process sequence of an example of the face detection process for a background part detection. It is a figure shown about the concept of a face detection process. It is a flowchart shown about the determination process of whether the subject which recalls nostalgia exists. It is a flowchart which shows an example of a character detection process. It is a figure for demonstrating the concept of a character detection process. It is a flowchart for calculating the “nostalgic degree” according to the facial expression. It is a flowchart which shows an example of a facial expression detection process. It is a figure for demonstrating the concept of a facial expression detection process. It is a flowchart for calculating the “nostalgic degree” according to the relationship between persons. FIG. 13A is a diagram illustrating an example of an image in which a small person exists between large men and women, and FIG. 13B illustrates an example of an image in which a large person and a small person are in close contact with each other. FIG. It is a figure for demonstrating how to obtain | require the ratio of the size of a face and a body. It is a figure for demonstrating the concept of the 1st modification of embodiment of this invention. It is a flowchart shown about the process of the 1st modification of embodiment of this invention. It is a flowchart shown about the process of the 2nd modification of embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Digital camera, 101 ... Micro processing unit (MPU), 102 ... Operation part, 103 ... Shooting lens, 104 ... Auto-focus (AF) circuit, 105 ... Aperture mechanism, 106 ... Aperture control circuit, 107 ... Image sensor, 108 DESCRIPTION OF SYMBOLS ... Analog front end (AFE) circuit, 109 ... Image processing circuit, 110 ... Display control circuit, 111 ... Display panel, 112 ... Shape detection circuit, 113 ... Distance detection circuit, 114 ... Face detection circuit, 115 ... Compression part, 116 ... Recording control circuit, 117 ... Recording medium, 118 ... Communication unit, 119 ... Auxiliary light emitting circuit, 300 ... Network, 400 ... Server, 500,600 ... Personal computer (PC), 700 ... Scanner

Claims (4)

In an image display device for selecting and displaying fewer images from a plurality of images,
A face detector that detects a plurality of face portions from each of a plurality of images;
The size and position of the images of the plurality of face portions are determined from the detection result of the face portions, and the image is determined according to the relationship between the plurality of face portions determined by the determined size and position of the face portions. A priority setting section for setting the display priority of
A display control unit for displaying the image from a plurality of images in a priority order according to the display priority;
An image display device comprising: A background detector for detecting a background portion in the image,
The display control unit identifies the age at which the image was acquired from the background portion detected by the background detection unit, classifies the plurality of images for each identified age, and sets the display priority for each age. 2. The image according to claim 1, wherein the divided image is displayed with a priority according to the display, and then the image is switched to another division and displayed with the priority according to the display priority. Display device. In an image display method for selecting and displaying fewer images from a plurality of images,
Detect multiple face parts from each of multiple images,
From the detection result of the face portion, determine the size and position of the images of the plurality of face portions,
Setting the display priority of the image according to the relationship between the plurality of face portions determined by the size and position of the determined face portion,
Displaying the image from a plurality of priority according to the display priority,
An image display method characterized by the above. In an image display program for selecting and displaying fewer images from a plurality of images,
Detecting a plurality of face portions from each of a plurality of images;
Determining the size and position of the images of the plurality of face portions from the result of detection of the face portions;
Setting the display priority of the image according to the relationship between the plurality of face portions determined by the size and position of the determined face portion;
Displaying the image from a plurality of images in a priority order according to the display priority;
Display program for causing a computer to execute.

Images