JP2011238143A - Image display device, image display method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a display image taking relevance in display objects into consideration.SOLUTION: In an image display device 100, there is provided an image acquisition section 3a for acquiring image data of a first display object, and an image specifying section 3d for specifying, in image data of at least one image recorded at an image recording section 5, image data of an image in which a first display object acquired by the image acquisition section and a second display object highly relevant to the first display object are present as image data of a display image to be displayed on a display section 1.

Description

  The present invention relates to an image display device, an image display method, and a program.

  Conventionally, as an image search device for searching image data stored in a database, a person's name and an image feature amount of a person's face are stored in advance in association with each other, and the name of the person is used as a keyword. An apparatus that searches and displays an image of a person is known (for example, see Patent Document 1).

JP 2007-207031 A

  However, in the technique of the above-mentioned Patent Document 1, only an image of a person who is a search target is searched, and a subject such as a person or an object shown together with the search target is completely considered. Not.

  Therefore, an object of the present invention is to provide an image display device, an image display method, and a program that can display a display image in consideration of the relationship between display objects.

In order to solve the above problems, an image display device according to the present invention provides:
Display means for displaying image data, recording means for recording image data of at least one image, acquisition means for acquiring image data of a first display target, and an image of at least one image recorded in the recording means Among the data, image data of an image including the first display object acquired by the acquiring unit and the second display object highly related to the first display object is displayed on the display image displayed on the display unit. And a first specifying means for specifying the image data.

The image display method of the present invention includes:
An image display method using an image display device comprising a display means for displaying image data and a recording means for recording image data of at least one image, a process for acquiring image data of a first display target; Among the image data of at least one image recorded in the recording means, the image data of the image in which the acquired first display object and the second display object highly related to the first display object are present, And processing for specifying the image data of the display image displayed on the display means.

The program of the present invention is
A computer of an image display device comprising a display means for displaying image data and a recording means for recording image data of at least one image, an acquisition means for acquiring image data of a first display object, and recorded in the recording means Image data of an image in which the first display object acquired by the acquisition means and the second display object highly related to the first display object exist in the image data of the at least one image. It is characterized by functioning as first specifying means for specifying as image data of a display image displayed on the screen.

  According to the present invention, it is possible to display a display image in consideration of the relationship between display objects.

It is a block diagram which shows schematic structure of the image display apparatus of one Embodiment to which this invention is applied. It is a figure which shows typically an example of the counter for image specification memorize | stored in the image display apparatus of FIG. 3 is a flowchart illustrating an example of an operation related to image display processing by the image display apparatus of FIG. 1. It is a block diagram which shows schematic structure of the image display apparatus of the modification 1. It is a block diagram which shows schematic structure of the image display apparatus of the modification 2.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.
FIG. 1 is a block diagram showing a schematic configuration of an image display apparatus 100 according to an embodiment to which the present invention is applied.

The image display device 100 according to the present embodiment acquires the first display target image data, and among the image data of at least one image recorded in the image recording unit 5, The image data of the image in which the second display object highly relevant to the first display object exists is specified as the image data of the display image displayed on the display unit 1.
Specifically, the image display device 100 is, for example, a digital photo frame installed on a table, and as shown in FIG. 1, a display unit 1, an imaging unit 2, an image processing unit 3, and a memory 4. And an image recording unit 5, an operation input unit 6, and a central control unit 7.

The display unit 1 constitutes display means, and includes a display panel 1a and a display control unit 1b.
Examples of the display panel 1a include a liquid crystal display panel and an organic EL display panel, but are not limited thereto.
The display control unit 1b acquires the image data stored in the image recording unit 5, and displays this image data on the display screen of the display panel 1a.

The imaging unit 2 includes a lens unit 2a, an electronic imaging unit 2b, and an image data generation unit 2c.
The lens unit 2a is the same as the display screen of the display unit 1 so that, for example, a viewer (user) of an image displayed on the display unit 1 in an image display process (described later) can be imaged as a first display target. It is preferably exposed in the direction.
The electronic imaging unit 2b includes, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS). Then, the electronic imaging unit 2b converts the optical image that has passed through various lenses and a diaphragm (not shown) of the lens unit 2a into a two-dimensional image signal (RGB image data), and outputs it to the image data generation unit 2c.
The image data generation unit 2c receives an image signal composed of RGB color components corresponding to the optical image of the subject output from the electronic imaging unit 2b, and if necessary, image data corresponding to the YUV color space (YUV image data). ) Or image data corresponding to the HSV color space (HSV image data) and output to the central control unit 7.

In addition, although the viewer who is the user of the image is the first display target, the type of the first display target is not limited to this, and can be arbitrarily changed as appropriate. For example, animals such as pets, flowers, etc. An object such as a plant, a building, or an ornament may be the first display target.
Thus, the imaging unit 2 constitutes an imaging unit that images the first display target.

  The image processing unit 3 receives the image data output from the central control unit 7 at the time of recording the image data output from the imaging unit 2, and performs various image processing, compression, and the like on the image data to create a file Turn into. Then, the image processing unit 3 transfers the filed image data to the image recording unit 5.

  The image processing unit 3 includes an image acquisition unit 3a, a first display target detection unit 3b, an image search unit 3c, and an image specification unit 3d.

The image acquisition unit 3a acquires first display target image data.
Specifically, the image acquisition unit 3a uses, for example, YUV image data of a captured image including a first display target (for example, a person, an object, an animal, a plant, or the like) within a predetermined background imaged by the imaging unit 2. get.
The image acquisition unit 3a acquires the image data of the first display target imaged by the imaging unit 2, but the method of acquiring the image data of the first display target is not limited to this, for example, The image data recorded in the image recording unit 5 may be acquired as the first display target image data.
Here, the image acquisition unit 3a constitutes acquisition means for acquiring image data of the first display target.

The first display target detection unit 3b detects the first display target from the captured image acquired by the image acquisition unit 3a.
That is, the first display target detection unit 3b is a main subject such as a person or an object in the captured image acquired by the image acquisition unit 3a by various image processing such as face detection processing, edge detection processing, and feature extraction processing. Is detected as the first display target. Specifically, for example, the first display target detection unit 3b performs a predetermined face detection process on the captured image acquired by the image acquisition unit 3a to detect a face image, and the feature information of the detected face image That is, feature information of face parts corresponding to eyes, nose, mouth and the like is acquired. Further, as the feature information of the face image, a hue or the like may be detected from the pixel value of the face image.
Note that the face detection process, the edge detection process, and the feature extraction process are known techniques, and thus detailed description thereof is omitted here.

The image search unit 3c searches the image data of the first image having the first specific area corresponding to the first display object from the image data of the plurality of images recorded in the image recording unit 5.
That is, the image search unit 3c includes an image analysis unit c1 that analyzes each of a plurality of image data recorded in the image recording unit 5. For example, the image analysis unit c1 reads each of image data of a plurality of images recorded in the image recording unit 5, and performs face detection processing, edge detection processing, feature extraction processing, and the like on each of the read image data. The specific area corresponding to the main subject such as a person or an object is detected.

Then, the image search unit 3c includes a specific region (first specific region) similar to the face image that is the first display target detected by the first display target detection unit 3b among the specific regions detected by the image analysis unit c1. ) That is, the image search unit 3c uses the feature information of the face image that is the first display target detected by the first display target detection unit 3b, and each specific region and face image (first image detected by the image analysis unit c1). 1) and a specific area (first specific area) in which the similarity is equal to or greater than a predetermined value is searched. Then, the image search unit 3c specifies the image data having the specific area as the image data of the first image. That is, the image search unit 3c specifies all the image data having a specific area in which the similarity with the face image (first display target) is determined to be equal to or greater than a predetermined value as the image of the first image. Note that any recognition algorithm may be applied to the image search method by the image search unit 3c.
In addition, the image search unit 3c adds, for example, first tag information indicating that the first specific area corresponding to the first display target exists as Exif tag information to the image data specified as the image data of the first image. To do. The method of adding the first tag information is an example and is not limited to this, and can be arbitrarily changed as appropriate.
The image search unit 3c performs the above-described processes on each of the image data of the plurality of images recorded in the image recording unit 5, and searches for the image data of the first image.

Although a plurality of pieces of image data are recorded in the image recording unit 5, it is sufficient that at least one piece of image data to be searched by the image searching unit 3c is recorded.
Here, the image search unit 3c performs the first display from the image data of at least one image recorded in the image recording unit 5 based on the first display target image data acquired by the image acquisition unit 3a. Search means for searching for image data of a first image having a first specific area corresponding to the object is configured.

The image specifying unit 3d specifies image data of an image including the first display object and the second display object from the image data of the plurality of images recorded in the image recording unit 5.
Here, the second display object refers to an object that is highly related to the first display object, that is, an object that has the highest ratio of being present simultaneously with the first display object in the image. Note that the second display object may be any object as long as it is present (simultaneously) with the first display object in the image. For example, a person, an animal, a plant, an object, or the like can be applied.
The image specifying unit 3d includes a candidate specifying unit d1 that specifies a second display target candidate from each of the first images searched by the image search unit 3c. The candidate specifying unit d1 specifies a specific region other than the first specific region corresponding to the first display target as a candidate for the second display target from each of the first images searched by the image search unit 3c. That is, the candidate specifying unit d1 adds tag information other than the first tag information, that is, a specific region (for example, “B”, to the image data of each first image searched by the image searching unit 3c. ”And“ C ”and other tag images (for example, second tag information corresponding to“ B ”and third tag information corresponding to“ C ”) are added. It is determined whether or not it has been done. And the image search part 3c specifies another display object as a candidate of a 2nd display object according to the tag information added. Further, the candidate specifying unit d1 stores information for identifying the specified second display target candidate (for example, face images such as “B” and “C”) in the image specifying counter M of the memory 4. .
The tag information other than the first tag information may be automatically added based on, for example, the image search by the image search unit 3c described above, or a predetermined operation of the operation input unit 6 by the user. It may be added manually based on the above.

Then, the image specifying unit 3d converts the image data of the image including the second display target from the image data of the first image having the second display target candidate specified by the candidate specifying unit d1. As specified. That is, the image specifying unit 3d refers to the “face information other than the user A” of the image specifying counter M in the memory 4, and the second display target candidate having the largest number of counts among the second display target candidates. That is, the candidate having the highest ratio existing with the first display object in the first image having the second display object candidate is specified as the second display object. Then, the image specifying unit 3d specifies the image data of the image having the second display target as the image data of the display image from the image data of the first image searched by the image search unit 3c. That is, the image specifying unit 3d specifies all the image data of the image in which the specified second display target exists as the image data of the display image.
As described above, the image specifying unit 3d specifies the image data of the image in which the second display target exists from the image data of the first image searched by the image search unit 3c as the image data of the display image.
The image specifying unit 3d outputs the image data of the specified display image to the display control unit 1b of the display unit 1.

Note that the method of specifying the display image by the image specifying unit 3d is an example and is not limited to this, and can be arbitrarily changed as appropriate.
Here, the image specifying unit 3d includes the first display object acquired by the image acquisition unit 3a and the relevance to the first display object among the image data of at least one image recorded in the image recording unit 5. A first specifying unit that specifies image data of an image having a high second display target as image data of a display image displayed on the display unit 1 is configured.

  The memory 4 is constituted by, for example, a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores data processed by the image processing unit 3 or the central control unit 7.

The memory 4 stores an image specifying counter M (see FIG. 2) used for image display processing.
The image specifying counter M is used for specifying a display image in image display processing. Specifically, as shown in FIG. 2, the image specifying counter M includes an image number “image No.” read from the image recording unit 5 and a user (first display object) “A” for each image. "First tag information for user A" relating to whether or not ",""Face information other than user A" indicating a display target (for example, a person) other than the user "A" on each image, “Result”, which is a result of whether or not to display an image, is associated.

“Image No.” is assigned to each image in the order read from the image recording unit 5, and for example, “No. 1” to “No. 7” are illustrated, but the present invention is not limited to this. .
“First tag information for user A” is checked when a user “A” exists in each image. For example, “No. 1”, “No. 2”, “No. 4” to “No. This indicates that the user “A” exists in the “No. 6” image.
“Face information other than user A” represents information that identifies display objects other than user “A” in each image, for example, face images of “B” to “F”. “B”, “C”, and “D” exist in the image, and “B”, “E”, “F”, and “G” exist in the “No. 2” image. There are three unknown face images in the “No.3” image, and “B”, “D”, and “F” are in the “No.4” image. In the “No.5” image, “G” exists, and in the “No.6” image, “B” and “D” exist, and “No.7” The image shows that there are two unknown face images.
The “result” describes the result of specifying the display image by the image specifying unit 3d. For example, only the image in which “user A” as the first display object and “B” specified as the second display object exist together is present. For example, the images “No. 1”, “No. 2”, “No. 4”, and “No. 6” are displayed images “display”, and the other images are not displayed.
The various information stored in the image specifying counter M is an example and is not limited thereto, and can be arbitrarily changed as appropriate.

The image recording unit 5 is configured by, for example, a nonvolatile memory (flash memory). The image recording unit 5 stores still images and moving images displayed on the display unit 1, and stores still image data encoded in a predetermined compression format and moving image data including a plurality of image frames. Record.
Here, the image recording unit 5 constitutes recording means for recording image data of at least one image.
Note that the image data of the still image may be composed of, for example, an Exif format image file. In this case, the first tag information and other tag information added in the image display process are used as Exif tag information. Accompanying.

  The operation input unit 6 includes, for example, an operation unit configured by data input keys for inputting numerical values, characters, and the like, up / down / left / right movement keys for performing data selection, feeding operation, and various function keys. A predetermined operation signal is output to the central control unit 7 in accordance with the operation of these operation units.

  The central control unit 7 controls each unit of the image display device 100. Specifically, although not shown, the central control unit 7 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory), and includes various processing programs (for the image display device 100). Various control operations are performed according to (not shown).

Next, image display processing will be described with reference to FIG.
FIG. 3 is a flowchart illustrating an example of an operation related to image display processing by the image display apparatus 100.
In the image display processing shown below, the viewer who is the first display target is set as the face image of the user “A”, and the face images of people other than the user “A” (second display target candidates) are used. It is assumed that a face image to be a second display target is specified from the candidates by searching.

  As shown in FIG. 3, first, the imaging unit 2 captures an image in which the user “A” who is the first display target exists in a predetermined background (step S <b> 1). Then, the image acquisition unit 3a of the image processing unit 3 acquires YUV image data of the captured image generated by the image data generation unit 2c of the imaging unit 2, and the first display target detection unit 3b is, for example, a captured image. A predetermined face detection process is performed on the YUV image data of the user to detect the face image of the user “A”, and feature information of face parts corresponding to the eyes, nose, mouth, etc. of the detected face image is acquired as face information (Step S2).

Next, the image processing unit 3 processes reading of image data of a plurality of images recorded in the image recording unit 5 by a loop (loop 1) (steps S3 to S13).
Specifically, the image analysis unit c1 of the image search unit 3c reads each of the image data of the plurality of images recorded in the image recording unit 5 in a predetermined order (step S4), and processes the image data ( For example, face detection processing (image processing) is performed on the first image data having the image number “NO.1” and the like, and a face image (specific region) corresponding to the face of the person who is the main subject is detected. (Step S5). Then, the image analysis unit c1 sets “N” as the number of face images in the image detected by the face detection process (step S6). For example, when the processing target is image data of the image number “NO.1”, face images of four people (for example, users “A”, “B”, “C”, “D”, etc.) are detected. Is done. If a face image is not detected from the image data to be processed, the image processing unit 3 does not perform the processes after step S7, returns the process to step S3, and changes the image data to be processed. Also good.
In addition, since the image analysis unit c1 performs the face detection process as the image processing because the first display object and the second display object are human face images, the first display object and the second display object The type of image processing (for example, edge detection processing or feature extraction processing) may be changed according to the type.

Next, the image search unit 3c processes the search process of the face image of the user “A” with respect to each face image of the image data to be processed in a loop (loop 2) (steps S7 to S10).
Specifically, the image search unit 3c reads the face images detected by the image analysis unit c1 in a predetermined order, and the face information (features) of the user “A” that is the first display target for the face image to be processed. Information) and whether or not the face image to be processed is equal to the face information of the user “A” according to whether or not the similarity is greater than or equal to a predetermined value (step S8). .
If it is determined that the face image to be processed is the same as the face information of the user “A” (step S8; YES), the image search unit 3c uses the image data to be processed as the image data of the first image. After the identification, for example, first tag information indicating that the first specific area corresponding to the face image (first display target) of the user “A” exists as Exif tag information is added (step S9).
On the other hand, if it is determined that the face image to be processed is not equal to the face information of the user “A” (step S8; NO), for example, the face image to be processed is “B” other than the user “A”. If the face image is a face image such as the face information of the user “A”, the image search unit 3c skips the process of step S9.
By repeating the processing of loop 2 for all the face images detected by the image analysis unit c1 (step S10), the image search unit 3c ends the search process for the face image of the user “A”.

Next, the candidate specifying unit d1 of the image specifying unit 3d adds tag information other than the first tag information related to the user “A”, that is, another person (for example, “B”, “ It is determined whether or not tag information indicating that a face image (specific region) of “C” or the like exists is added (step S11).
Here, if it is determined that tag information other than the first tag information is added (step S11; YES), that is, for example, if the processing target is image data of the image number “NO.1”, “ Since the second tag information corresponding to Mr. “B”, the third tag information corresponding to Mr. “C”, the fourth tag information corresponding to Mr. “D”, and the like are added, It is determined that tag information other than the first tag information is added. Then, the candidate specifying unit d1 uses face images other than the user “A” (for example, face images of “B”, “C”, and “D”) as candidates for the second display target, and uses the face images as the second display target candidates. The identification information is stored and stored in the image specifying counter M (step S12).
On the other hand, when it is determined that tag information other than the first tag information is not added (step S11; NO), that is, for example, when the processing target is image data of the image number “NO.3”, The candidate specifying unit d1 determines that no tag information other than the first tag information is added, and skips the process of step S12.
By repeating the processing of the above loop 1 for all the image data recorded in the image recording unit 5 up to the last image data (step S13), the image processing unit 3 reads the image data. Exit.

Subsequently, the image specifying unit 3d refers to the “face information other than the user A” of the image specifying counter M in the memory 4, and the face image having the maximum counter value, that is, the face that is the candidate for the second display target. The face image with the highest count number (for example, the face image of “B”) is specified as the second display target (step S14).
That is, “B” 's face image exists with the user “A” in the image data “No. 1”, “No. 2”, “No. 4”, “No. 6”, for example, While the count number is “4”, the count numbers of face images of other people, that is, “C”, “D”, “E”, and “F” are all “4”. Is smaller than Therefore, the face image with the maximum count that exists with the user “A” is the face image of “B”.

Next, the image specifying unit 3d loops the display of the image data including the face images of the users “A” and “B” from the image data of the plurality of images recorded in the image recording unit 5 (loop). 3) (Steps S15 to S20).
Specifically, the image specifying unit 3d reads each of the image data of a plurality of images recorded in the image recording unit 5 in a predetermined order (step S16), and processes the image data (for example, the image number is It is determined whether or not tag information other than the first tag information related to the user “A” is added to the first image data “NO.1” (step S17).
Here, if it is determined that tag information other than the first tag information is added (step S17; YES), that is, for example, if the processing target is image data of the image number “NO.1”, “ Since the second tag information corresponding to Mr. “B”, the third tag information corresponding to “C”, and the fourth tag information corresponding to “D” are added, the image specifying unit 3d It is determined that tag information other than one tag information is added. Then, the image specifying unit 3d determines whether or not the image data includes a face image of “B”, which is a face image having a maximum counter value (step S18). That is, the image specifying unit 3d determines whether or not the face image of “B” is added depending on whether or not the second tag information corresponding to “B” that is the face image having the maximum counter value is added to the image data. Whether or not is included is determined.

If it is determined in step S18 that the face image of “B” is included (step S18; YES), the image specifying unit 3d specifies the image data as image data of the display image and specifies it. The image data of the displayed image is output to the display control unit 1b of the display unit 1. The display control unit 1b displays the input image data on the display screen of the display panel 1a (step S19).
On the other hand, if it is determined that the face image of “B” is not included (step S18; NO), that is, for example, if the processing target is the image data of the image number “NO. The identification unit d1 determines that the face image of “B” is not included, and skips the process of step S19.
If it is determined in step S17 that no tag information other than the first tag information is added (step S17; NO), that is, for example, the processing target is the image data of the image number “NO.3”. In some cases, the candidate specifying unit d1 determines that no tag information other than the first tag information is added, and skips the processes of steps S18 and S19.
By repeating the processing of the above loop 3 until all image data recorded in the image recording unit 5 reaches the last image data (step S20), the image processing unit 3 performs image data display processing. Exit.

Note that the display time of each image data, that is, the time until switching to the next image data may be set in advance to a predetermined time, and the face image of “B” is included in step S19. The image data may be switched every time it is determined that the image data is determined.
Further, the display order may be determined according to the reading order of the image data, or may be different from the reading order of the image data. That is, the display of the image data may be set at random regardless of the reading order of the image data and the order of determination.

  As described above, according to the image display device 100 of the present embodiment, the first display target (for example, the face image of the user “A”) is selected from the image data of at least one image recorded in the image recording unit 5. Etc.) and the second display object (for example, “B” 's face image etc.) that is highly relevant to the first display object is specified as the image data of the display image. The image data of the image that also has the second display object highly relevant to the first display object can be specified as the image data of the display image. That is, for example, a person who is shown (exists) with a user in one image is a person close to the user, or a person in one organization (for example, a company organization) to which the user belongs simultaneously. The frequency (ratio) increases and relevance increases. Therefore, by specifying the image data of the display image in consideration of the relevance between these display objects, it is possible to display a display image that also has a second display object that is highly related to the first display object.

  An image of a first image having a first specific area corresponding to the first display object out of the image data of at least one image recorded in the image recording unit 5 based on the image data of the first display object. The data is searched, and the image data of the image in which the second display target exists is specified as the image data of the display image from the searched image data of the first image. Thereby, the search object of the image in which the second display object exists among the image data of at least one image recorded in the image recording unit can be limited to the image data of the first image.

  Moreover, since the specific area other than the first specific area corresponding to the first display object is specified as the second display target candidate from each of the first images, the final second display target is selected from the candidates. Identification can be performed quickly and conveniently. Further, among the candidates for the second display object, the candidate having the highest ratio existing with the first display object in the first image having the second display object candidate is specified as the second display object. Among the candidates, the candidate having the highest frequency that is present together with the first display object (for example, the user's face image) in one image can be specified as the final second display object. It is possible to more appropriately identify the second display object that is highly relevant to the object. Thereby, the image data of the display image in which the second display object having high relevance to the first display object also exists can be properly specified.

  In addition, since the first display target is imaged and the image data of the first display target is acquired, only the first display target is imaged. For example, when the first display target is a user, self-portrait is performed. The image data of the display image in which the first display object and the second display object exist can be easily identified simply by performing the above.

  Furthermore, when specifying the image data of the display image, it is not necessary to register keywords in advance for all the images in order to search for a specific image as in the past, and the image data can be specified easily. it can.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
Hereinafter, a modified example of the image display apparatus 100 will be described with reference to FIGS. 4 and 5.

<Modification 1>
The image display device 200 according to the first modification includes image data of a second image having at least a second specific area corresponding to a second display object among image data of at least one image recorded in the image recording unit 5. Is identified.
Note that the image display device 200 according to the first modification has substantially the same configuration as that of the image display device 100 according to the above-described embodiment, and a detailed description thereof will be omitted.

FIG. 4 is a block diagram illustrating a schematic configuration of the image display apparatus 200 according to the first modification.
As illustrated in FIG. 4, the image display device 200 according to the first modification includes an image processing unit 3, an image acquisition unit 3 a, a first display target detection unit 3 b, an image search unit 3 c, and a first image specification unit 203 d. In addition, a second image specifying unit 203e is provided.
The first image specifying unit 203d has the same function as the image specifying unit 3d of the image display device 100 of the above embodiment, and only the name is used for differentiation from the second image specifying unit 203e. Is a change.

The second image specifying unit 203e specifies image data of a second image having at least a second specifying region corresponding to the second display target specified by the first image specifying unit 203d.
That is, the second image specifying unit 203e reads each of the image data of at least one image recorded in the image recording unit 5, and sets the second specific region corresponding to the second display target in the image data to be processed. It is determined whether or not tag information (for example, second tag information corresponding to “B”) indicating that (a face image of “B”) exists is added. Then, as a result of the determination, the second image specifying unit 203e converts the image data determined to have added tag information indicating that the second specific area corresponding to the second display target exists into the second image. Specify as image data. That is, the image data of the second image only needs to have at least a second specific area corresponding to the second display target, and it does not matter whether there is a first display target or other display target.
Note that the method of specifying the second image by the second image specifying unit 203e is an example and is not limited to this, and can be arbitrarily changed as appropriate.
Here, the second image specifying unit 203e, among the image data of at least one image recorded in the image recording unit 5, the image data of the second image having at least a second specific region corresponding to the second display target. The 2nd specific means to specify is comprised.

Then, the second image specifying unit 203e outputs the image data of the specified second image to the display control unit 1b of the display unit 1. The display control unit 1b displays the input image data of the second image on the display screen of the display panel 1a.
Note that the display of the image data of the second image by the display unit 1 may be performed continuously with the display of the image data of the display image specified by the first image specifying unit 203d, or separately from this display. It may be done. The display unit 1 may display the image data of the display image and the image data of the second image at random.

  Therefore, according to the image display device 200 of the first modified example, the second specific area corresponding to the second display target is at least included in the image data of at least one image recorded in the image recording unit 5. Since the image data of the image is specified, it is possible to display the second image in which at least the second display object highly related to the first display object exists. That is, for example, when the user is a photographer and takes an image, there are images in which the user's spouse, children, and the like that are the subject are shown but the user is not shown. Therefore, the second image is specified by specifying the image data of the second image in which the second display object, which is a close person or object highly related to the user image (first display object), is shown (existing). As a result, the convenience of the image display device 200 can be improved.

<Modification 2>
In the image display device 300 according to the second modification, among the image data of at least one image recorded in the image recording unit 5, the second display target and the third display target highly related to the second display target are included. The image data of the existing third image is specified.
In the image display device 300 according to the second modification, configurations other than those described below are substantially the same as those of the image display device 200 according to the first modification, and detailed description thereof is omitted.

FIG. 5 is a block diagram illustrating a schematic configuration of an image display apparatus 300 according to the second modification.
As illustrated in FIG. 5, the image display device 300 according to the second modification includes an image processing unit 3, an image acquisition unit 3 a, a first display target detection unit 3 b, an image search unit 3 c, and a first image specification unit 203 d. In addition to the second image specifying unit 203e, a third image specifying unit 303f is provided.
The first image specifying counter M1 stored in the memory 4 has the same function as the image specifying counter M of the image display device 100 of the above embodiment, and the second image specifying counter M2 Only the name was changed in order to differentiate it.

The third image specifying unit 303f specifies the image data of the third image including the second display target and the third display target specified by the first image specifying unit 203d.
Here, the third display object refers to an object that is highly related to the second display object, that is, an object that has the highest ratio of being present simultaneously with the second display object in the image. Note that the third display object may be any object as long as it exists (simultaneously) with the second display object in the image. For example, a person, an animal, a plant, an object, or the like is applicable.
Specifically, the third image specifying unit 303f performs the second display target by a method substantially equivalent to the method for specifying the image data of the display image in which the first display target and the second display target exist by the first image specifying unit 203d. And the image data of the 3rd image in which a 3rd display object exists is specified. That is, the candidate specifying unit (not shown) of the third image specifying unit 303f includes a first corresponding to each of the first display target and the second display target from each of the second images specified by the second image specifying unit 203e. A specific area other than the one specific area and the second specific area is specified as a candidate for the third display target. For example, the candidate specifying unit of the third image specifying unit 303f adds, to the image data of each second image, tag information other than the first tag information and the second tag information, that is, a specific region corresponding to another display target (for example, , Tag information (for example, third tag information corresponding to “C”, fourth tag information corresponding to “D”, etc.) ) Is added, and another display target is specified as a third display target candidate according to the added tag information. Then, the candidate specifying unit of the third image specifying unit 303f stores information for identifying the specified third display target candidates (for example, face images such as “C” and “D”) in the second memory 4. Stored in the image specifying counter M2.

Here, the second image specifying counter M2 is used for specifying the third image in the image display processing. Specifically, although not shown in the figure, the second image specifying counter M2 is similar to the first image specifying counter M1, and the image number “image No.” read from the image recording unit 5 is displayed. , “Second tag information for“ B ”” relating to whether or not the second display object “B” exists in each image, and display objects other than the users “A” and “B” in each image ( For example, “face information other than users A and“ B ”” indicating a person) is associated with “result” which is a result of whether or not to display an image.
The description of the specific configuration of the second image specifying counter M2 is omitted.

In addition, the third image specifying unit 303f displays the image data of the image including the third display target from the image data of the second image having the third display target candidate specified by the candidate specifying unit. Identify as data. That is, the third image specifying unit 303f refers to “face information other than users A and B” in the second image specifying counter M2 in the memory 4 and counts the most among the candidates for the third display target. The third display target candidate having a large number of candidates, that is, the candidate having the highest ratio existing together with the second display target in the second image having the third display target candidate is specified as the third display target. Then, the third image specifying unit 303f specifies all the image data of the third image in which the third display target exists from the image data of the second image specified by the second image specifying unit 203e.
Note that the third image specifying method by the third image specifying unit 303f is an example, and is not limited thereto, and can be arbitrarily changed as appropriate.
Here, the third image specifying unit 303f includes a second display target and a third display target highly related to the second display target in the image data of at least one image recorded in the image recording unit 5. The third specifying means for specifying the image data of the existing third image is configured.

Then, the third image specifying unit 303f outputs the image data of the specified third image to the display control unit 1b of the display unit 1. The display control unit 1b displays the input image data of the third image on the display screen of the display panel 1a.
Note that the display of the image data of the third image by the display unit 1 may be performed continuously with the display of the image data of the second image specified by the second image specifying unit 203e, or separate from this display. May be done. The display unit 1 may display the image data of the second image and the image data of the third image at random.
Further, the display of the image data of the third image by the display unit 1 may be performed continuously with the display of the image data of the display image specified by the first image specifying unit 203d, and separately from this display. It may be done. The display unit 1 may display the image data of the display image and the image data of the third image at random.

  Therefore, according to the image display device 300 of the second modification, the second display target (for example, “B” 's face image, etc.) is selected from the image data of at least one image recorded in the image recording unit 5. Since the image data of the display image in which the third display object (for example, “C” 's face image etc.) having a high relevance with the second display object exists is specified, not only the specified second display object but also the Image data of an image that also has a third display object highly related to the second display object can be specified as the image data of the display image. In other words, for example, when a user takes a picture as a photographer, there is an image in which a spouse, a child, or the like of the user who is a subject is shown at the same time. Therefore, by specifying the image data of the third image in consideration of the relevance of the second display object and the third display object, which are close persons or objects that are highly related to the user image (first display object). In addition, it is possible to display a display image that also has a third display object highly relevant to the second display object, and the convenience of the image display device 300 can be further improved.

  Further, the processing target image is captured by an image display device different from the image display device 100 (200, 300), the image data of the processing target image transferred from the image display device is acquired, and the image display is performed. An image display device that performs processing may be used.

  Furthermore, in the above embodiment, only the image data of the first image having the first specific area corresponding to the first display target (for example, the user “A”) may be continuously displayed. Subsequently to the continuous display, the image data of the display image including the first display object and the second display object is displayed, the image data of the second image specified in the modification 1 is displayed, You may make it display the image data of the 3rd image specified in the modification 2. FIG.

In addition, in the above-described embodiment, the functions as the acquisition unit and the first specification unit are controlled by the central control unit 7 so that the image acquisition unit 3a and the image specification unit 3d (first specification of the image processing unit 3). The configuration is realized by driving the image specifying unit 203d), but the configuration is not limited to this, and may be realized by executing a predetermined program or the like by the CPU of the central control unit 7. .
That is, a program including an acquisition processing routine and a specific processing routine is stored in a program memory (not shown) that stores the program. Then, the CPU of the central control unit 7 may function as an acquisition unit that acquires the first display target image data by an acquisition process routine. In addition, the CPU of the central control unit 7 by the specific processing routine causes the first display object acquired by the acquiring unit and the relevance to the first display object in the image data of at least one image recorded in the recording unit. The image data of the image having the second display target having a high value may function as first specifying means for specifying the image data of the display image displayed on the display means.

  Similarly, the search means, the second specifying means, and the third specifying means may be realized by executing a predetermined program or the like by the CPU of the central control unit 7.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory and a portable image recording unit such as a CD-ROM are applied in addition to a ROM and a hard disk. It is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

100, 200, 300 Image display device 1 Display unit 2 Imaging unit 3 Image processing unit 3a Image acquisition unit 3c Image search unit 3d Image specifying unit 5 Image recording unit 7 Central control unit

Claims (10)

Display means for displaying image data;
Recording means for recording image data of at least one image;
Obtaining means for obtaining first display target image data;
Among the image data of at least one image recorded in the recording means, an image of an image in which the first display object acquired by the acquiring means and the second display object highly related to the first display object exist First specifying means for specifying data as image data of a display image displayed on the display means;
An image display device comprising: Based on the image data of the first display target acquired by the acquisition unit, the image data of at least one image recorded in the recording unit has a first specific area corresponding to the first display target. A search means for searching for image data of the first image;
The first specifying means includes
The image data of the image in which the second display object exists is specified as image data of the display image from the image data of the first image searched by the search unit. Image display device. The first specifying means includes
A specific area other than the first specific area corresponding to the first display target is specified as a candidate for the second display target from each of the first images searched by the search means, and the second display 3. The image according to claim 2, wherein image data of an image in which the second display target exists is specified as image data of the display image from image data of the first image having a candidate for the target. Display device. The first specifying means includes
Among the candidates for the second display target, the candidate having the highest ratio existing together with the first display target in the first image having the second display target candidate is specified as the second display target, and the second display target is selected. The image display apparatus according to claim 3, wherein image data of an image in which a display target exists is specified as image data of the display image. An image pickup means for picking up an image of the first display object;
The acquisition means further includes:
5. The image display apparatus according to claim 1, wherein the image data of the first display target captured by the imaging unit is acquired.   The image display apparatus according to claim 1, wherein the first display object and the second display object are human face images. A second specifying means for specifying image data of a second image having at least a second specifying area corresponding to the second display object in the image data of at least one image recorded in the recording means;
The display means further includes:
The image display apparatus according to claim 1, wherein the image data of the second image specified by the second specifying unit is displayed. A first image that specifies image data of a third image in which the second display object and a third display object highly related to the second display object exist among the image data of at least one image recorded in the recording means. Further comprising three specifying means,
The display means further includes:
The image display device according to claim 1, wherein the image data of the third image specified by the third specifying unit is displayed. An image display method using an image display device comprising display means for displaying image data and recording means for recording image data of at least one image,
Processing for obtaining image data of a first display target;
Among the image data of at least one image recorded in the recording means, the image data of the image in which the acquired first display object and the second display object highly related to the first display object are present, Processing for specifying the image data of the display image displayed on the display means;
An image display method characterized by: A computer of an image display device comprising: display means for displaying image data; and recording means for recording image data of at least one image.
Acquisition means for acquiring image data of a first display target;
Among the image data of at least one image recorded in the recording means, an image of an image in which the first display object acquired by the acquiring means and the second display object highly related to the first display object exist First specifying means for specifying data as image data of a display image displayed on the display means;
A program characterized by functioning as

Images