JP2010283691A - Image specifying device, display controlling device, image specifying program, and display controlling program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image specifying device for specifying the image in which no subject of the same person of the predetermined user shows up, and to provide a display controlling device, an image specifying program, and a display controlling program. <P>SOLUTION: An image specifying device 1 obtaining photographed image data with the front of the display surface of a displaying part 40 photographed includes: a state detecting means 10b for detecting the state of the subject-photographed of the photographed image by analyzing the obtained photographed image data; and an image specifying means 10a for specifying the image data of the image displayed to the displaying part on the basis of the state of the subject-photographed detected by the state detecting means. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image specifying device, a display control device, an image specifying program, and a display control program.

  As this type of technology, for example, in Patent Document 1, when a person A is touched with a finger on a reproduction display screen, face position information and face information are extracted based on image data corresponding to the person A. A technique is disclosed in which an image including the person A is retrieved from images stored in a memory and recorded on a recording medium based on the face position information and the face information.

  Further, in Patent Document 2, the personal authentication device acquires information about the feature amount of the face X detected from the last image file (last recorded image file) recorded on the recording medium, and records it. Compared with the facial features of other image files in the media, the image file containing the same person's face as the last recorded image file (related image) is identified from the image files recorded on the recording media Techniques to do this are disclosed.

JP 2007-310813 A JP 2007-329679 A

  However, Patent Documents 1 and 2 only disclose a technique for specifying an image in which a subject (for example, a face) of the same person as a predetermined user is captured from a plurality of images.

  In view of the above, the present invention provides an image specifying device, a display control device, an image specifying program, and a display control program that can specify an image in which a subject of the same person as a predetermined user is not captured based on a new standard. For the purpose.

An image specifying device according to a first aspect of the present invention is:
State detection means for acquiring captured image data, which is data of a captured image captured in front of the display surface of the display unit, and analyzing the acquired captured image data to detect a state of a capturing target in the captured image;
Image specifying means for specifying image data of an image to be displayed on the display unit based on the state of the photographing target detected by the state detecting means;
Is provided.

The display control device according to the second aspect of the present invention is:
A display control device for displaying an image on a display unit,
A control unit that displays on the display unit an image of a pre-photographed image data that shows a person or animal in a state that satisfies a certain relationship with the state of the person or animal in front of the display unit; .

The image specifying program according to the third aspect of the present invention is:
On the computer,
A state detection step of acquiring captured image data, which is data of a captured image captured in front of the display surface of the display unit, and analyzing the acquired captured image data to detect a state of a capturing target in the captured image;
An image specifying step for specifying image data of an image to be displayed on the display unit based on the state of the photographing target detected in the state detecting step;
To do.

The display control program according to the fourth aspect of the present invention is:
On the computer that displays the image on the display,
Causing the display unit to display an image of a pre-captured image data in which a person or animal in a state satisfying a certain relationship with the state of the person or animal in front of the display unit is captured. .

  According to the image specifying device, the display control device, the image specifying program, and the display control program according to the present invention, it is possible to specify an image in which a subject of the same person as the predetermined user is not captured based on a new standard.

It is a block diagram which shows the relationship of each part of the image specific device which concerns on one Embodiment of this invention. It is a figure which shows the hardware constitutions of the image specific device which concerns on one Embodiment of this invention. It is the front view which looked at the image specific device concerning one embodiment of the present invention from the front. It is a flowchart which shows the image specification / display process which the image specific device which concerns on one Embodiment of this invention performs. It is a figure for demonstrating the process of the recording image data which the image specific device which concerns on one Embodiment of this invention performs. It is a figure which shows an example of the data content of the object state information which the image specific device which concerns on one Embodiment of this invention produces | generates. It is a figure which shows an example of the data content of the recording image information which the image specific device which concerns on one Embodiment of this invention produces | generates. It is a figure which shows an example of the data content of the recording image information data table which the image specific device which concerns on one Embodiment of this invention produces | generates. It is a figure for demonstrating the process of the picked-up image data which the image specific device which concerns on one Embodiment of this invention performs. It is a figure which shows an example of the data content of the imaging | photography target state information which the image specific device which concerns on one Embodiment of this invention produces | generates. It is a figure which shows an example of the data content of the picked-up image information which the image specific device which concerns on one Embodiment of this invention produces | generates. It is a figure explaining an example of the relationship between the image and imaging | photography object which the image specific device which concerns on one Embodiment of this invention displays. It is a figure explaining the other example of the relationship between the image which the image specific device which concerns on one Embodiment of this invention displays, and imaging | photography object. It is a figure explaining the other example of the relationship between the image which the image specific device which concerns on one Embodiment of this invention displays, and imaging | photography object. It is a figure explaining the other example of the relationship between the image which the image specific device which concerns on one Embodiment of this invention displays, and imaging | photography object. It is a figure which shows the other example of the data content of the recording image information which the image specific device which concerns on one Embodiment of this invention produces | generates. It is a figure which shows the other example of the data content of the picked-up image information which the image specific device which concerns on one Embodiment of this invention produces | generates. It is a figure explaining the other example of the relationship between the image which the image specific device which concerns on one Embodiment of this invention displays, and imaging | photography object. It is a figure explaining the other example of the relationship between the image which the image specific device which concerns on one Embodiment of this invention displays, and imaging | photography object.

  An embodiment of the present invention will be described with reference to the drawings. In addition, this invention is not limited by the following embodiment and drawing. It goes without saying that the following embodiments and drawings can be modified without changing the gist of the present invention. The image specifying apparatus according to the present invention is realized by a computer, for example. The image specifying device according to the present invention may be a display control device.

  The image specifying device 1 according to the present embodiment is a digital photo stand (also referred to as a digital photo frame) (see FIG. 3). The digital photo stand displays and reproduces images (for example, digital photos taken with a digital camera).

  First, the configuration of the image specifying device 1 will be described. As shown in FIG. 1, the image specifying device 1 includes a control unit 10, a storage unit 20, a photographing unit 30, a display unit 40, an input unit 50, and a reading unit 60. Note that at least some of the functions of the respective units may be provided in another device that can communicate with the image specifying device 1 via a network.

  The control unit 10 controls each unit and controls the entire image specifying apparatus 1. The control unit 10 includes an image specifying unit 10a and a state detecting unit 10b, and performs image specifying / display processing described later.

  The storage unit 20 stores data such as recorded image data read from the memory card 100 described later and data generated by image specifying / display processing described later as necessary.

  At least a part of the imaging unit 30 (at least a part of the imaging device 31) is fixed to the frame of the display unit 40 or the like so that the imaging lens faces the front of the display surface of the display unit 40 (see FIG. 3). The imaging unit 30 images the front of the display surface of the display unit 40 under the control of the control unit 10. Here, the front of the display surface is defined as, for example, at least a part of the light emission direction of the display surface or a certain range direction from the normal direction of the display surface. The imaging unit 30 images the front of the display unit 40, generates an imaging signal representing the captured still image, and generates digital still image original data based on the generated imaging signal. The imaging unit 30 sequentially supplies the generated still image original data to the control unit 10. In this way, the imaging unit 30 captures a moving image that is a sequence of still images.

  The display unit 40 displays an image under the control of the control unit 10. In particular, the display unit 40 displays a recorded image expressed by recorded image data.

  The input unit 50 receives a user operation input and supplies operation input data corresponding to the received operation to the control unit 10.

  The memory card 100 stores a plurality of recorded image data. The recorded image data may be image data that is previously captured and recorded on a predetermined storage medium, and the recording medium is not limited to the memory card 100. An image expressed by recorded image data is referred to as a recorded image.

  The reading unit 60 reads predetermined recording image data from the memory card 100 under the control of the control unit 10 and supplies it to the control unit 10.

  Next, an example of the hardware configuration of the image specifying device 1 will be described. As shown in FIG. 2, the image specifying device 1 includes a CPU (Central Processing Unit) 11, a primary storage device 12, a secondary storage device 21, a photographing device 31, a drive circuit 41, a display panel 42, and an input. A device 51 and a reading device 61 are provided.

  The control unit 10 in FIG. 1 includes, for example, a CPU 11 and a primary storage device 12. The primary storage device 12 is configured by a RAM (Random Access Memory) or the like. The control unit 10 may include a CPU 11, an ASIC (Application Specific Integrated Circuit), and the like. In this case, an ASIC or the like performs a part of image specifying / displaying processing (processing of image data and the like) described later by the CPU 11. The ASIC is, for example, a DSP (Digital Signal Processor).

  The storage unit 20 in FIG. 1 includes a secondary storage device 21. The secondary storage device 21 is configured by a flash memory or a hard disk. The secondary storage device 21 records an image specifying program 25. The image specifying program 25 is expanded in the primary storage device 12.

  The CPU 11 performs an image specifying / displaying process, which will be described later, based on a command of the image specifying program 25 developed in the primary storage device 12. The primary storage device 12 records data processed by the CPU 11. Data received by the control unit 10 from other units or supplied to the other units by the control unit 10 is temporarily recorded in the primary storage device 12, for example. The CPU 11 reads out the data recorded in the primary storage device 12 and performs computations, etc., and records the computation result data in the primary storage device 12. The primary storage device 12 is provided with a work area for the CPU 11. The image specifying unit 10a and the state detecting unit 10b included in the control unit 10 are respectively a CPU 11 that performs a part of image specifying / displaying process described later according to the image specifying program 25, and a predetermined storage in the primary storage device 12. Area.

  The primary storage device 12 and the secondary storage device 21 store data such as recording image data read from the memory card 100 described later and data used in image specifying / display processing described later. The data stored in the primary storage device 12 and the secondary storage device 21 is erased or overwritten by other data as necessary by the CPU 11.

  The image specifying program 25 may be recorded on a portable storage medium or the like. The portable storage medium is, for example, a CD-ROM (Compact Disk Read Only Memory) or a DVD-ROM (Digital Versatile Disk Read Only Memory). The image specifying program 25 may be installed in the image specifying apparatus 1 via various reading devices from a portable storage medium. The image specifying program 25 may be downloaded and installed in the image specifying device 1 from various networks such as the Internet via various communication units. The image specifying program 25 may be stored in a storage device such as a server that can communicate with the image specifying device 1 and instruct the CPU 11. A readable storage medium (for example, a RAM, a ROM (Read Only Memory), a CD-R, a DVD-R, a hard disk, or a flash memory) that stores the image specifying program 25 is a program product that can be read by a computer. .

  The imaging unit 30 in FIG. 1 includes an imaging device 31 (see also FIG. 3). In the imaging device 31, at least a part of the imaging device 31 is fixed to a frame or the like of the display unit 40 so that the imaging lens faces the front of the display surface of the display panel 42 (see FIG. 3). The imaging device 31 is configured by a camera or the like including an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The image pickup device sequentially generates image pickup signals by photoelectrically converting the intensity of light of each color of RGB (Red Green Blue) values of an image for every fixed period. The imaging device 31 performs various processes on the imaging signal to sequentially generate digital still image original data. In this way, the imaging device 31 sequentially images the front of the display panel 42 (display unit 40), generates an imaging signal representing the captured still image, and based on the generated imaging signal, a digital still image The original data is generated sequentially. The imaging device 31 sequentially supplies the generated still image original data to, for example, the primary storage device 12. The primary storage device 12 sequentially receives the supplied still image original data and stores the received still image original data. The CPU 11 performs processing described later using the still image original data stored in the primary storage device 12. In addition, as said various processes, for example, correlated double sampling (Correlated Double Sampling), the automatic gain adjustment (Automatic Gain Control) applied to the imaging signal after sampling, and the analog imaging signal after automatic gain adjustment are converted into digital There are analog / digital conversion to convert to signal. The continuous still image original data is the original data of the moving image.

  The display unit 40 in FIG. 1 includes a drive circuit 41 and a display panel 42 (see also FIG. 3). The drive circuit 41 is supplied with reproduction data representing a recorded image of the recorded image data. The drive circuit 41 receives the supplied reproduction data, drives the display panel 42 based on the received reproduction data, and reproduces and displays the recorded image on the display panel 42. The display panel 42 is configured by, for example, a liquid crystal display panel or an organic EL display panel. As described above, the display panel 42 displays the recorded image represented by the recorded image data under the control of the CPU 11.

  The input unit 50 in FIG. 1 includes an input device 51. The input device 51 includes, for example, a reproduction key, a specific key, a stop key, and the like. When the user operates these keys, the input device 51 supplies operation input data corresponding to each key to the primary storage device 12. The primary storage device 12 receives the supplied operation input data and stores the received operation input data. The CPU 11 performs processing described later using the operation input data stored in the primary storage device 12.

  In addition, you may comprise the display part 40 and the input part 50 of FIG. 1 with a touch panel. In this case, the display panel 42 and the input device 51 are configured by a touch panel. The touch panel displays a predetermined input screen and supplies operation input data to the primary storage device 12.

  The memory card 100 is configured by a flash memory type memory card or the like. Examples of the memory card include an SD memory card that records image data (recorded image data) taken by a digital camera.

  The reading unit 60 in FIG. 1 includes a reading device 61. The reading device 61 is configured by an appropriate device that reads recorded image data recorded on the memory card 100. The reading device 61 reads the recorded image data recorded on the memory card 100 and supplies the read recorded image data to the primary storage device 12. The primary storage device 12 receives the supplied recording image data and stores the received recording image data. The CPU 11 performs processing described later using the recorded image data stored in the primary storage device 12.

  The bus 90 is a transmission path for transmitting data and the like exchanged between the components connected to the bus 90.

  Next, image identification / display processing performed by the image identification device 1 will be described with reference to FIGS.

  This image specifying / displaying process is triggered by the operation of the input unit 50 by the user. For example, when the memory card 100 is inserted into the reading unit 60 and the reading unit 60 becomes able to read the recorded image data recorded on the memory card 100, the image specifying device 1 informs the display unit 40 to that effect. Is displayed. Then, when the user operates the reproduction key of the input unit 50, the image specifying device 1 starts the image specifying / displaying process. When the user operates the stop key of the input unit 50 during the process, the image specifying apparatus 1 ends this process even if the process is being processed. Further, it is assumed that a predetermined number of recorded image data is recorded on the memory card 100. The recorded image data here is, for example, still image data taken with a digital camera or the like, and has a file format such as JPEG (Joint Photographic Experts Group). The recorded image data may be moving image data such as AVI (Audio Video Interleave).

  The image specifying unit 10a sets n = 0 (step S101). n indicates the number of recorded image data read from the memory card 100. The image specifying unit 10a sets n = n + 1 (step S102). The image specifying unit 10a reads the recorded image data recorded on the memory card 100 through the reading unit 60 as the nth image data (step S103). At this time, the image specifying unit 10a prevents the same recorded image data from being read repeatedly.

  The image specifying unit 10a analyzes the read nth recorded image data (step S104). Specifically, for example, the image specifying unit 10a analyzes the n-th recorded image data by detecting the state of the subject region including the subject in the recorded image of the recorded image data to be analyzed. Through such analysis, the image specifying unit 10a detects the state of the subject in the recorded image of the nth recorded image data (step S104). The subject area includes the subject. Therefore, the image specifying unit 10a detects the state of the subject, for example, by detecting the state of the subject region.

  When the image specifying unit 10a analyzes the n-th recorded image data, the image specifying unit 10a grasps the ratio of the vertical and horizontal sides of the recorded image of the recorded image data, and the grasped ratio of the vertical and horizontal sides is set in advance. It is judged whether it is the same as the ratio. The preset side ratio is, for example, a ratio of a side of an image displayed by a later-described captured image and a display unit. For example, the ratio of the sides of the captured image is set to be the same as the ratio of the sides of the image displayed by the display unit (that is, the ratio of the sides of the display surface of the display unit 40). When the ratio of both sides is the same, the image specifying unit 10a tries to grasp the state of the subject as it is without editing the recorded image data. If the ratio between the two sides is different, the image specifying unit 10a edits the recorded image data so that the ratio between the vertical and horizontal sides of the recorded image becomes a preset ratio of the sides, and the edited recorded image data And try to grasp the condition of the subject. For example, when the length of the horizontal side of the recorded image with respect to the length of the vertical side of the recorded image is shorter than the preset ratio of the side, the image specifying unit 10a places the recorded image at the center in the horizontal direction. New recorded image data in which an image such as black or a predetermined background image is added to the recorded image in two regions corresponding to the missing portion on both sides in the horizontal direction (side of the missing portion × vertical side region) The recorded image data is edited by generating. In addition, when the length of the horizontal side of the recorded image with respect to the length of the vertical side of the recorded image is longer than the ratio of the preset side, the image specifying unit 10a, for example, The recording image data is edited by generating new recording image data in which two regions corresponding to the long side portion of the part (long side × vertical side region) are deleted. When the recorded image data is edited, the image specifying unit 10a treats it as the recorded image data after being edited, that is, newly generated by editing and recorded and recorded in advance as follows. . That is, the recorded image data may be data edited as appropriate.

  Here, the subject is, for example, a characteristic part of a person or an animal. The characteristic part is, for example, a human face or an animal face. The characteristic part may be at least a part of a person or an animal that allows the image specifying device 1 to grasp the characteristic part on the image. In the following description, it is assumed that the subject is a human face.

  For example, the image specifying unit 10a divides the recorded image represented by the recorded image data into a plurality of divided areas, detects a subject, grasps which divided region the detected subject is located, and identifies the grasped subject. By generating information indicating the position, the state of the subject, which is the position of the subject, is detected. The image specifying unit 10a uses detection of a subject area or the like for grasping the position of the subject. Here, the state of the subject area is directly the state of the subject.

  Each divided area is, for example, four divided areas A1 to A4 shown in FIG. 5 in which the recorded image of the recorded image data is divided into four in the horizontal direction. Each divided area is not limited to this, and may be, for example, each area (upper left, lower left, upper right, and lower right areas) obtained by dividing the image into four parts in the vertical and horizontal directions. Good.

  In the recorded image of FIG. 5, a person 511 and a person 512 are shown. The face 511a of the person 511, which is the first subject, is in the divided area A2. The face 512a of the person 512, which is the second subject, is in the divided area A4. The image specifying unit 10a detects a face area (subject area) 521 including a face (subject) 511a and a face area (subject area) 522 including a face (subject) 512a. Then, the image specifying unit 10a grasps that the detected face area 521 is located in the divided area A2. In addition, the image specifying unit 10a recognizes that the detected face area 522 is located in the divided area A4. For example, the image specifying unit 10a recognizes in which divided area the face area is located based on the position information of the detected face area. Since the positions of these face areas are the positions of the faces, it is understood in which divided area the position of the subject is located based on the position of the face area.

  When the image specifying unit 10a grasps the state of the subject (here, there is a face region in each of the divided regions A1 to A4), it generates subject state information that is information indicating the grasped subject state. Detect the state of the subject. Further, the image specifying unit 10a records the generated subject state information in the storage unit 20 (step S104). At this time, the image specifying unit 10a and the recording image specifying information, which is information for specifying the nth recorded image data, and the nth recorded image data (if edited above, the edited recorded image data Are associated with the subject state information and recorded in the storage unit 20 (step S104). Here, the recorded image specifying information is an image number, and the number n is used as it is. The recorded image specifying information may be information appropriately generated by the image specifying unit 10a. Information including the subject state information, the recorded image specifying information, and the image data is recorded image information. The recorded image information may not include recorded image specifying information.

  Here, FIG. 6 shows the contents of the subject state information generated by analyzing the subject of the recorded image of FIG. FIG. 7 shows the contents of the recorded image information when the recorded image data of the recorded image in FIG. 5 is the second recorded image data. Since the subject (face) is located in the divided area A2 and the divided area A4 in the recorded image of FIG. 5, the object state information includes A1 = x, A2 = O, and A3 = as shown in FIGS. X, position information A4 = ◯ is included. Further, as shown in FIG. 7, the record image specifying information of the record image data of FIG. 5 is “2”. Further, the recorded image data of FIG. 7 is the content of the recorded image data of the recorded image of FIG. 5 (“xxx” in FIG. 7). When no subject exists on the recorded image, the image specifying unit 10a detects the state of the subject that the subject does not exist. In this case, the subject state information is A1 = x, A2 = x, A3 = x, A4 = x.

  When the face area is located across a plurality of divided areas, the image specifying unit 10a is determined in advance, for example, by determining that the face area is located in a divided area including the most pixels constituting the face area. It is determined in which divided area the face area is located by the above method. When the plurality of divided areas include the same number of pixels of the face area, the image specifying unit 10a includes the face area in a randomly determined divided area among the plurality of divided areas including the same number of pixels. It is determined in which divided area the face area is positioned by a predetermined method, such as determining that the face area is located.

  A known method can be adopted for the detection of the photographing target area (particularly the face area) performed in step S104. For example, a face area may be detected by extracting a skin color area from an input image as in the method described in Japanese Patent Application Laid-Open No. 2000-105819, or Japanese Patent Application Laid-Open No. 2006-21111 or Japanese Patent Application Laid-Open No. 2006-72770. The face area may be detected using the method described in the publication.

  For example, the image specifying unit 10a compares the image of the region of interest set in the recorded image with a predetermined template face image to determine the similarity between both images, and the face is located in the region of interest based on the similarity. It is determined whether or not it is included. That is, when the similarity between both images satisfies a certain criterion, the region of interest is a face region. That is, the image specifying unit 10a has detected the face area. The similarity determination is performed by extracting a feature amount effective for identifying whether the face is a face. The feature amount is a horizontal edge, a vertical edge, a right diagonal edge, a left diagonal edge, or the like.

  In the recorded image, the region of interest is shifted in the horizontal direction or the vertical direction pixel by pixel. Then, the image in the region of interest after the shift is compared with the template face image, and the similarity between the two images is determined again. In this way, the region of interest is updated and set while being shifted pixel by pixel from the upper left to the lower right of the recorded image, for example. Alternatively, the recorded image may be reduced at a certain rate, and the same face detection process may be performed on the reduced image. By repeating such processing, a face region of an arbitrary size can be detected from the recorded image.

  Note that when the image of the recorded image data is a moving image, the image specifying unit 10a, for example, in each of the divided areas similar to the above, for a predetermined time or more (a predetermined number or more frame images (still images constituting a moving image Figure out how many facial areas remain). In this way, the image specifying unit 10a can generate data similar to the subject state information.

  In the process when the image data is a moving image, the image specifying unit 10a performs the tracking process of the face area, and within each divided area for a predetermined time or more (a predetermined number or more of frame images (a certain number of moving images). It is good to know whether there is a face area that stays)

  In this case, the image specifying unit 10a tracks the face area on the moving image. Here, a certain frame image is referred to as a reference frame image. The image specifying unit 10a first detects a face area from the reference frame image. The detection method is the same as described above. Then, the image specifying unit 10a specifies the face area in the frame image of the frame next to the reference frame by the tracking process. Here, two frame images that are temporally adjacent to each other are referred to as a previous frame image and a current frame image. The image specifying unit 10a can detect the face area of the current frame image by performing an image matching process in the search area of the current frame image using the vicinity area of the face position in the previous frame image as a search area. In the image matching process, for example, an image in a rectangular area centered on the face position in the previous frame image is used as a template image, and the similarity between the template image and the image in the search area of the current frame image is calculated. The face area is detected from the current frame image. A search area that satisfies a certain condition regarding the similarity is a face area. The image specifying unit 10a repeatedly performs such detection processing to track the face area detected in the reference frame image in the moving image after the reference frame image.

  The image specifying unit 10a determines whether there is recorded image data that has not been read from the memory card 100 (step S105), and if there is recorded image data that has not been read (step S105; YES). Until all the recorded images are read, the processing from step S102 to step S104 is repeated. By this repeated processing, the recording image information is accumulated in the storage unit 20. The stored recorded image information constitutes a recorded image information data table (see FIG. 8). One row of the table of FIG. 8 is the content of the recorded image information.

  In the above description, the image specifying unit 10a analyzes the recorded image data every time the recorded image data is read out. However, it may be analyzed one by one after reading out a plurality of recorded image data.

  In this way, the image specifying unit 10a acquires image data (recorded image data) that has been captured and recorded in advance, analyzes the acquired image data, and detects the state of the subject of the image of the analyzed image data. (Note that this method is not limited to the above method).

  If it is determined in the process of step S105 that there is no recorded image data that has not been read by the image specifying unit 10a (step S105; NO), the image specifying unit 10a outputs the recorded images of the recorded image data read from the memory card 100 in any order. Are sequentially displayed at predetermined intervals (step S106). Specifically, the image specifying unit 10a sequentially reads recorded image data recorded in the storage unit 20 from the storage unit 20 at predetermined intervals. Next, the image specifying unit 10a performs predetermined processing (decoding, inverse quantization, enlargement / reduction of an image to fit the display area of the display unit 40) for each of the sequentially read recording image data. To generate reproduction data for reproduction. The image specifying unit 10a supplies the generated reproduction data to the display unit 40. The display unit 40 receives the reproduction data supplied from the image specifying unit 10a, and displays the recording image represented by the recording image data using the received reproduction data. Such processing is repeatedly performed in an arbitrary order (for example, image number order) for each of the recorded image data. In this way, the display unit 40 switches and displays the recording images of the recording image data for each predetermined period. This display process is repeated until a new display process (a process in step S114 described later) is started, and the display process is performed again even after all the images have been displayed. The same applies to the processing in step S114 described later.

  When the image specifying unit 10a starts the image display process, the state detection unit 10b causes the photographing unit 30 to start photographing in front of the display unit 40 (step S107). For example, under the control of the state detection unit 10b, the photographing unit 30 photographs the front of the display unit 40 to sequentially generate the above-described still image original data, and sequentially generates the generated still image original data to the state detection unit 10b. Supply. Then, the state detection unit 10b sequentially receives the still image original data output from the photographing unit 30, and sequentially performs necessary processes (white balance adjustment, gamma correction, compression processing, etc.) on the received still image original data, The image data is sequentially converted into image data (captured image data) capable of detecting a region. In addition, the state detection unit 10b may perform a process of horizontally inverting the image during the necessary process. The captured image captured by the capturing unit 30 is an image captured from a direction opposite to the direction in which the display unit 40 is viewed. By the left-right reversing process, it is possible to easily compare the positions of the shooting target of the shot image and the subject of the image data image. In this manner, the state detection unit 10b sequentially acquires captured image data that is captured image data captured in front of the display unit 40. When the left / right reversing process is not performed, the image specifying unit 10a and the state detecting unit 10b perform the image specifying / display process on the assumption that the positional relationship between the captured image and the recorded image is reversed. For example, when comparing the position of the subject and the position of the object to be photographed, the process is performed with either position reversed left and right. The captured image data may be data that can represent a captured image from the data, and may be image data of an image obtained by inverting a captured image as described above. A series of images (captured images) of the captured image data is a moving image. For example, the state detection unit 10b stores a predetermined number of captured image data in the storage unit of the state detection unit 10b (for example, a part of the storage area of the primary storage device 12). After the state detection unit 10b stores a predetermined number of photographic image data, when the state detection unit 10b newly acquires photographic image data, the state detection unit 10b records the new photographic image data the oldest in the storage unit. The captured image data is overwritten and stored.

  The state detection unit 10b analyzes the captured image data acquired at the time of performing the process of step S108, and detects the state of the imaging target in the captured image represented by the captured image data (step S108). In this way, the state detection unit 10b analyzes the moving image shot by the shooting unit 30 and detects the state of the shooting target (here, the position of the shooting target). Since the method for detecting the state of the photographing target can be performed in the same manner as the above-described method for detecting the state of the subject, only the main points of detection of the photographing target will be described below, and other detailed explanations will be given for the above subject. According to the description of the state detection method. For the detection of the state of the shooting target, a shooting target region including the shooting target is used as in the above-described method of detecting the state of the subject. The state of the shooting target area can be considered as the shooting target state.

  For example, as described above, the state detection unit 10b divides the photographed image represented by the photographed image data into a plurality of divided regions, detects a photographing target (here, the photographing target region), and detects the photographing target. By grasping which divided region is located and generating information indicating the grasped position of the photographing target, the state of the photographing target is detected as the position of the photographing target.

  As shown in FIG. 9, each divided region is, for example, four divided regions B1 to B4 obtained by dividing the captured image of the captured image data into four in the horizontal direction. Each divided area is not limited to this, and may be, for example, each area (upper left, lower left, upper right, and lower right areas) obtained by dividing the image into four parts in the vertical and horizontal directions. Good. However, it is assumed that the divided areas B1 to B4 in the captured image and the divided areas A1 to A4 of the recorded image correspond to each other having the same number. That is, the shapes of both are the same or similar. Moreover, both have the same position in the image. For example, the ratio of the horizontal side of the divided area B1 to the horizontal side of the entire image is the same as the ratio of the horizontal side of the divided area A1 to the horizontal side of the entire image.

  In the photographed image of FIG. 9, a person 911 is shown. Then, the face 911a of the person 911, which is the subject of photographing, is in the divided area B4. The state detection unit 10b detects a face region (photographing target region) 921 including the face (photographing target) 911a. And the state detection part 10b grasps | ascertains that the detected face area 921 is located in division area B4. The state detection unit 10b grasps in which divided area the detected face area is located from the position of the detected face area. Since the positions of these face areas are the positions of the faces, it is understood in which divided area the position of the subject is located based on the position of the face area. When the state detection unit 10b detects a plurality of shooting target areas, for example, one of them is selected by an arbitrary method (for example, random), and the selected shooting target area is set as the detected shooting target area. . When detecting a plurality of shooting target areas, the state detection unit 10b may grasp a divided area where all the shooting target areas are located.

  When the state detection unit 10b grasps the state of the photographing target (in this case, whether there is a face region in each of the divided regions B1 to B4), the state detection unit 10b generates photographing target state information that is information indicating the grasped state of the photographing target. Thus, the state of the object to be photographed is detected. At this time, the state detection unit 10b takes out the shooting target area image data, which is image data of the detected shooting target area, from the shooting image data, associates it with the shooting target state information, and holds both of them. When the state detection unit 10b detects a plurality of shooting target areas, for example, one of them is selected by an arbitrary method (for example, random), and the image data of the selected shooting target area is selected as the shooting target area image. The data is associated with the shooting target state information, and both of them are stored. The shooting target state information and the shooting target area image data constitute the shooting image information. The state detection unit 10b generates captured image information.

  Here, the contents of the photographing target state information generated by analyzing the photographed image of FIG. 9 are shown in FIG. 10, and the contents of the photographed image information are shown in FIG. In the photographed image of FIG. 9, since the photographing object (face) is located in the divided area B4, the photographing object state information is B1 = x, B2 = x, B3 = x, B4 = O as shown in FIG. Contains location information. When there is no shooting target on the shot image, the image specifying unit 10a detects the state of the subject that the shooting target does not exist. In this case, the photographing target state information includes position information such as B1 = x, B2 = x, B3 = x, and B4 = x. Further, as shown in FIG. 11, photographic image information is configured by the photographic target state information and the photographic target region image data.

  Note that the state detection unit 10b may track the shooting target of the shot image using the same method as described above using sequentially acquired shot image data. In this case, the state detection unit 10b tracks the shooting target by tracking the shooting target region including the shooting target, similarly to the tracking of the subject performed by the image specifying unit 10a (see the description of step S104). When performing the process of step S108, the state detection unit 10b grasps the position of the photographing target based on the position information of the photographing target being tracked, and the photographing target state information from the grasped position of the photographing target. And the state of the object to be imaged is detected. Such processing can reduce the processing load. When there are a plurality of shooting targets to be tracked, one of them is selected by an arbitrary method (for example, random), and the selected shooting target is tracked or each shooting target is tracked. In addition, an imaging target area to be tracked (a plurality of imaging target areas selected by an arbitrary method (for example, random)) is taken out at an arbitrary timing and used as the imaging target area image data.

  In step S108, which is repeatedly performed, the state detection unit 10b records the photographed image information in the storage unit (storage area of the primary storage device 12) of the state detection unit 10b, so that a predetermined number (two or more) of photographed images is obtained. Keep information.

  When detecting the state of the photographing target, the state detection unit 10b determines whether the state of the photographing target has changed (step S109). Specifically, for example, the state detection unit 10b compares the currently generated shooting target state information with the previously generated shooting target state information to determine whether the state of the shooting target has changed. For example, the state detection unit 10b compares the two included in the captured image information, and the divided area where the shooting target is located (one or more divided areas where the shooting target is located when there are a plurality of shooting targets) is changed. In this case, it is determined that the state of the shooting target has changed. For example, the state detection unit 10b compares the two, and if the divided region where the shooting target is located (one or more divided regions where the shooting target is located when there are a plurality of shooting targets) has not changed, Judge that the state has not changed. In the process of step S109 (for example, step S109 performed first) in which there is no previously detected shooting target state information to be compared, the state detection unit 10b determines that the state of the shooting target has changed.

  If the state detection unit 10b determines that the state of the photographing target has not changed (step S109; NO), the state detection unit 10b performs the process of step S108 again. In this way, the state detection unit 10b monitors the state of the shooting target until the state of the shooting target changes.

  When the state detection unit 10b determines that the state of the shooting target has changed (step S109; YES), the image specifying unit 10a acquires recorded image data based on the latest state of the shooting target (step S110). Specifically, for example, the image specifying unit 10a uses the latest shooting target state information held by the state detection unit 10b to record the recorded image data corresponding to the latest shooting target state information in the storage unit 20. Get from data table. More specifically, for example, the image specifying unit 10a includes a subject state that satisfies a certain relationship with the shooting target state information included in the latest captured image information held by the state detection unit 10b from the recorded image information data table. The recorded image information having information is specified from the recorded image information data table. Then, the image specifying unit 10a reads out and acquires the recorded image data included in the specified recorded image information. For example, the image specifying unit 10a is an area in which a divided area where the shooting target is indicated, indicated by the shooting target state information, and a divided area where the subject is indicated, which is indicated by the subject state information included in the recorded image information, are mutually corresponding areas. In some cases (for example, A4 and B4 are corresponding regions), it is assumed that the certain relationship is satisfied. The correspondence may be a partial correspondence or a complete correspondence. “Partial correspondence” means, for example, a case where at least one of one or more divided regions where a subject is located and at least one of one or more divided regions where a photographing target is located correspond to each other. The complete correspondence refers to a case where one or more divided regions where the subject is located and one or more divided regions where the photographing target is located completely correspond. For example, when searching for the corresponding recorded image information in the recorded image information data table of FIG. 8 based on the shooting target state information of FIG. 10, in the case of complete correspondence, the recorded image information with an image number of 4 is specified. In the case of partial correspondence, the recorded image information with image numbers 2, 4, and n is specified. Note that if the relative positions of the divided areas to be compared on the image are the same and the shapes of the divided areas to be compared are the same or similar, it can be said that both divided areas correspond. Then, the image specifying unit 10a reads out and acquires the recording image data included in the specified recording image information from the storage unit 20. The read recorded image data becomes recorded image data corresponding to the latest shooting target information. Note that all of the read recorded image data is recorded in, for example, a storage unit (such as a storage area of the primary storage device 12) in the image specifying unit 10a, whereby the image specifying unit 10a stores the recorded image data. Hold.

  The image specifying unit 10a determines whether one or more recorded image data has been acquired (step S111). If acquisition is not possible (step S111; NO), the image specifying unit 10a changes the state of the shooting target, but there is no recorded image data of the recorded image corresponding to the changed state of the shooting target, so that the display unit For example, a subtitle or the like in the recorded image is displayed in 40 (step S114), and the state detection unit 10b is caused to perform the process of step S108 again. As a result, even if there is no recorded image corresponding to the state to be photographed, the display of the recorded image is not interrupted, and the user can be informed that there is no recorded image specified by the current process.

  When one or more pieces of recorded image data can be acquired (step S111; YES), the image specifying unit 10a determines the display order of the recorded images (step S112). For example, the image specifying unit 10a analyzes each recorded image to detect a subject area (the method is the same as described above). Then, the image specifying unit 10a uses the detected subject region image data (subject region image data) and the shooting target region image data included in the shooting target state information held by the state detection unit 10b to determine the subject region. The degree of similarity with the shooting target area (that is, the degree of similarity between the subject and the shooting target) is detected, and the display order of the recorded images is determined using the detected similarity. The determined display order of the recorded images is, for example, the order in which the recorded images are displayed starting from a recorded image having a subject with a high degree of similarity to the subject to be photographed. Note that the display order of recorded images having the same degree of similarity is determined randomly or in the order of image numbers. Further, when a plurality of subject areas are detected, the image specifying unit 10a determines a subject area to be used for detecting the similarity by an arbitrary method such as random. Further, when the state detection unit 10b extracts the shooting target area image data, information on the extracted position (for example, information for specifying the divided area) is included in the shooting target area image data, and a plurality of subject areas are detected. In this case, the image specifying unit 10a extracts the position information from the shooting target area image data, and selects a subject area at a position within the predetermined range (within a corresponding divided area) from the position indicated by the position information. It may be a subject area used for detection of similarity. When there are a plurality of subject areas used for detecting the similarity, for example, the image specifying unit 10a derives each similarity between each subject area and the imaging target area, and has the highest similarity among the derived similarities. The display order of the recorded images is determined using the similarity as the detected similarity.

  For the detection of the similarity, for example, SAD (Sum of Absolute Difference), SSD (Sum of Squared Difference), or ZNCC (Zero-mean Normalized Cross-Correlation) is used. In the case of SAD and SSD, the smaller the calculated value, the higher the similarity. In the case of ZNCC, the greater the calculated value, the higher the similarity.

  The image specifying unit 10a determines each recorded image of the recorded image data acquired in the process of step S110 (if edited, the recorded image data after editing is desirable) by the process of step S112. The display on the display unit 40 is started in accordance with the display order (step S113). The detailed description of the recorded image display process is the same as that in step S106. When starting the display process of the recorded image, the image specifying unit 10a causes the state detection unit 10b to perform the process of step S108 again.

  The state detection unit 10b captures a moving image when the photographing unit 30 photographs the front of the display surface of the display unit 40. However, in step S108, the state detection unit 10b causes the photographing unit 30 to capture a still image, The above processing may be performed based on the photographed still image. In this case, the processing in step S107 is not necessary, and instead in step S108, the state detection unit 10b causes the photographing unit 30 to perform photographing.

  In the above description, the image identification device 1 identifies the recorded image data of the recorded image to be displayed on the display unit 40 by detecting the positions of the shooting target and the subject using the divided areas. The identification method is not limited to the above specific example, and may be realized by other methods. For example, the image specifying device 1 may specify the recording image data of the recording image displayed on the display unit 40 by comparing the coordinates in the image to be photographed with the coordinates in the image of the subject. In this case, in step S104 and step S108, the image specifying unit 10a and the state detection unit 10b capture the coordinates of the shooting target and the subject (for example, the center of the shooting target region (or upper left and lower right) and the center of the subject region (or The upper left and lower right coordinates) are grasped, and the grasped coordinate information is included in the photographed image information as photographing object state information, and is included in the recorded image information as recorded image state information. In step S110, the state detection unit 10b acquires recorded image information using the coordinate information. For example, the state detection unit 10b acquires recorded image information in which the coordinates of the photographing target and the coordinates of the subject are within a predetermined range. Note that the coordinates at this time may be coordinates indicating a relative position in the entire image, or may be coordinates having an origin at any of the upper left, upper right, lower left, or lower right end points of the image. When using the coordinates with the end point as the origin, the image specifying unit 10a or the state detecting unit 10b converts the resolution of the image so that the other image can be compared with the coordinate in the process of step S104 or the process of step S108. It is preferable to generate new recorded image data or photographed image data that has been processed, and to match the lengths (number of pixels) of the vertical and horizontal sides of both images.

  As described above, the state detection unit 10b acquires captured image data that is data of a captured image captured in front of the display surface of the display unit 40, analyzes the acquired captured image data, and analyzes a captured object in the captured image. The state (here, the position of the object to be photographed) is detected (see step S108, this detection method may be realized by a method other than the above specific example). Further, the image specifying unit 10a specifies the recording image data of the recording image to be displayed on the display unit 40 based on the state of the photographing target detected by the state detecting unit 10b (see step S110. It may be realized by other methods than the example). Here, the recorded image data is image data that is previously captured and recorded in a storage medium or the like. Here, the image specifying unit 10a specifies the recording image data of the recording image to be displayed on the display unit 40 from the plurality of recording image data. Since the recorded image data of the recorded image to be displayed on the display unit 40 is specified based on the state of the photographing target, an image that does not include the face of the same person as the user can be specified based on a new standard. Here, the state of the shooting target is, for example, information indicating the status of the shooting target in the image, not the feature amount of the shooting target for determining the same person or the like.

  In the present embodiment, the image specifying unit 10a particularly records image data of an image displayed on the display unit 40, which is recorded image data of a subject that is in a state that satisfies a certain relationship with the state of the subject to be photographed. Therefore, an image that does not include the face of the same person as the user can be specified based on a new standard. Note that this method of specifying image data may be realized by a method other than the above specific example.

  As described above, in the present embodiment, the state of the photographing target and the state of the subject are the position of the photographing target and the position of the subject, respectively. Further, the image specifying device 1 specifies the recorded image data of the recorded image in which the subject is captured at a position satisfying the first predetermined relationship with the position of the shooting target in the shot image (step S110 and the like). Note that this specifying method may be realized by a method other than the above specific example). Here, the first predetermined relationship is a relationship in which the photographing target and the subject are located in the same divided region on the image or in a region within the predetermined range from the coordinates of the photographing target. . Here, the image specifying apparatus 1 sequentially displays recorded images on the display unit 40 such that the subject and the photographing target are located in a certain area such as the same divided area (see step S113 and the like). Thereby, as shown in FIG. 12, the image specifying apparatus 1 according to the present embodiment displays only the recorded image in which the subject 1211 is captured in front of or in the vicinity of the image viewer (person having the shooting target 1201). The image specifying device 1 can give a new impression to the person to be photographed.

  As described above, in the present embodiment, the image specifying device 1 specifies a plurality of recorded image data, and specifies the display order of the recorded images of the specified recorded image data as a feature to be photographed (here, a facial feature). Identification based on the similarity (here, high degree of similarity) with the characteristics of the subject (here, the facial characteristics) of the recorded image of the recorded image data (see step S112, etc. It may be realized by a method other than the specific example). As a result, the image specifying device 1 sequentially displays the recorded images on the display unit in descending order of the similarity between the photographing target and the subject. As described above, the image specifying apparatus 1 according to the present embodiment, as shown in FIG. 13, records a recorded image in which a subject 1311 similar to the subject is captured in front of or in the vicinity of an image viewer (a person having a shooting target 1301). Since the display is prioritized, the image specifying device 1 can give a new impression to the person to be photographed. Here, in FIG. 13, the subject 1311 has a higher degree of similarity to the subject than the subject 1312. For example, as illustrated in FIG. 13, the image specifying device 1 displays a recorded image in which the subject 1311 is captured, and then displays a recorded image in which the subject 1312 is captured.

  As described above, in the present embodiment, when the state detection unit 10b detects the state of the new photographing target (here, the position of the face), the image specifying device 1 is based on the detected state of the new photographing target. The recording image data of the recording image to be displayed on the display unit 40 is specified (step S109; YES, see step S110, this specifying method may be realized by other methods other than the above specific example). As a result, even if the image specifying apparatus 1 displays a recorded image showing the subject, when the subject is moved, a recorded image showing the subject located in front of or near the subject is displayed as the next image to be displayed. indicate. As shown in FIG. 14, the image specifying device 1 displays a recorded image in which the subject 1411 is positioned in front of or in the vicinity of an image viewer (a person having the shooting target 1401), and this viewer (that is, the shooting target 1401). Is moved, a recorded image in which the subject 1412 is captured is displayed in front of or in the vicinity of the viewer after the movement, so that the image specifying device 1 can give a new impression to the person to be photographed.

  Note that if the shooting target state information indicates the state of the subject that the subject does not exist, the image specifying unit 10a reads and acquires all the recorded image data from the storage unit 20, and performs the process of step S112. In the process of step S113, the same process as in step S106 may be performed. As a result, when the imaging target does not exist in front of the display surface of the display unit 40, the image specifying device 1 can display the recorded image by the initial display method.

  The first predetermined relationship may be, for example, a relationship in which the shooting target and the subject are located in different divided regions on the image or in a region outside the predetermined range from the coordinates of the shooting target. Good. In this case, for example, in step S110, the image specifying unit 10a has the subject positioned in a divided region other than the divided region corresponding to the divided region where the shooting target is indicated, which is indicated by the shooting target state information detected by the state detection unit 10b. (At this time, another subject may be located in the divided area corresponding to the divided area where the shooting target is located.) Recorded image data of the recorded image is acquired. As a result, the image specifying device 1 displays only the recorded image in which the subject is captured in a region that is not in front of or in the vicinity of the image viewer (person who has the shooting target). A new impression can be given to a person. Further, for example, even if there are other viewers behind the viewer whose position has been detected, the other viewers behind the viewer can appreciate the subject (see, for example, FIG. 15). As illustrated in FIG. 15, the image specifying device 1 displays a recorded image in which the subject 1511 is captured in an area that is not in front of or near the person having the shooting target 1501.

  The state of the shooting target and the state of the subject may be, for example, the number of shooting targets in the shot image and the number of subjects in the recorded image, respectively. In this case, for example, in step S110, the image specifying unit 10a grasps the number of subjects by detecting the subject region (the number of subject regions is equal to the number of subjects). The image specifying unit 10a generates recorded image information (see FIG. 16) using the grasped number of subjects as subject state information. In step S108, the state detection unit 10b detects the number of shooting target areas to determine the number of shooting target areas (the number of shooting target areas is equal to the number of shooting targets). The state detection unit 10b generates photographed image information (see FIG. 17) using the grasped number of photographing objects as photographing object state information. In step S110, the image specifying unit 10a acquires recorded image data of subject state information including the number of subjects having a second predetermined relationship with the number of subjects to be photographed included in the photographed image information. In this way, the image specifying unit 10a displays the recorded image data of the recorded image that displays on the display unit 40 the recorded image data of the number of subjects that satisfy the second predetermined relationship with the number of captured objects in the captured image. It is specified as recorded image data. Here, the second predetermined relationship is, for example, a case where the number of both is the same. As shown in FIG. 18, the image specifying device 1 displays a recorded image in which the same number of subjects 1611 to 1612 as the two shooting targets 1601 to 1602 are captured. The image specifying device 1 can give a new impression to a person to be photographed.

  The state of the photographing target may be the line of sight of the photographing target in the photographed image. In step S <b> 108, the state detection unit 10 b detects a shooting target area, and grasps the line of sight of the shooting target by analyzing image data of the detected shooting target area. The state detection unit 10b uses the divided area (any of the divided areas B1 to B4 in the example of FIG. 9) that can be determined as the grasped line of sight as the shooting target state information, and the captured image information (data contents are illustrated in FIG. 11 data contents). According to this configuration, the image specifying unit 10a displays, on the display unit 40, image data of an image in which the subject in a state satisfying the third predetermined relationship with the line of sight of the shooting target in the shot image is displayed in step S110. The recorded image data of the recorded image to be displayed is specified. Here, the state satisfying the third predetermined relationship refers to a state of a recorded image in which the subject is located in a divided region corresponding to a divided region that can be determined to be the tip of the line of sight to be imaged. As shown in FIG. 19, the image specifying device 1 displays a recorded image in which the subject 1911 appears in a divided area that can be determined to be the tip of the line of sight of the subject 1901 (see the broken line arrow). The image specifying device 1 can give a new impression to a person to be photographed. The state detection unit 10b analyzes the inside of the face area and grasps the line of sight of the face in the face area. The line of sight detects the eye area of the face from the face area (detected by pattern matching using the image of interest and the eye template image in the same manner as the detection of the face area), and the detected white area of the eye It can be grasped where the (white eye part) is located in the whole detected eye. Then, the state detection unit 10b refers to the data table that identifies the range of the line of sight and the divided area that is considered to be ahead of the line of sight based on the detected line of sight, and which divided area the line of sight has A divided area that can be determined to be inward, that is, a line-of-sight destination is grasped. For example, if the eye of the subject 911a in FIG. 9 faces inward in the horizontal direction in FIG. 9 and the distribution of white eyes in the entire eye is within a predetermined range, the divided region ahead of this line of sight is B1. Suppose that It should be noted that other known methods can be employed for grasping the line of sight. Note that the divided area may be replaced with information of another area (for example, a predetermined range area using coordinates).

  Note that the state of the shooting target may include at least one of the position of the shooting target, the number of the shooting targets, the line of sight of the shooting target, and the like. In this case, the state of the subject is also at least one of the position of the subject or the number of subjects corresponding to the state of the subject to be photographed (see above). In step S110, the image specifying unit 10a acquires recorded image data of subject state information indicating a state of a subject that satisfies a certain relationship (for example, the predetermined relationship) with the state of the photographing target included in the photographed image information. . Here, the certain relationship that the two satisfy can be selected as appropriate from at least one of or a combination of the first to third predetermined relationships. The first relationship may be either the case where the divided areas correspond or the case where the divided areas are different. In addition, when the state of the shooting target includes the position of the shooting target and the line of sight of the shooting target, the shooting target state information preferably includes position information for the position of the shooting target and position information for the line of sight of the shooting target. .

  The image specifying device 1 in the present embodiment is a display control device, and the image selection program 25 is also a display control program. As described above, the control unit 10 is a recorded image of pre-recorded recording image data, and a person or animal in a state satisfying a certain relationship with the state of the person or animal in front of the display unit 40 is shown. The recorded image is displayed on the display unit 40 (this display method may be realized by a method other than the above specific example). This gives a new impression to the viewer.

DESCRIPTION OF SYMBOLS 1 ... Image identification apparatus, 10 ... Control part, 10a ... Image identification part, 10b ... State detection part, 11 ... CPU, 12 ... Primary storage device, 20 ... Memory | storage , 21 ... secondary storage device, 25 ... image specifying program, 30 ... photographing unit, 31 ... photographing device, 40 ... display unit, 41 ... drive circuit, 42 ... Display panel 50 ... Input unit 51 ... Input device 60 ... Reading unit 61 ... Reading device 100 ... Memory card A1 to A4 ... Divided area 511 ..Person, 511a ... face (subject), 512 ... person, 512a ... face (subject), 521 ... face area (subject area), 522 ... face area (subject area), 911... Person, 911 a... Face (photographing target), 921. Area), 1201... Face (photographing target), 1211... Face (subject), 1301... Face (photographing target), 1311... Face (subject), 1312. 1401... Face (photographing target), 1411... Face (subject), 1412... Face (subject), 1501... Face (photographing target), 1511. Face (shooting target), 1602 ... Face (shooting target), 1611 ... Face (subject), 1612 ... Face (subject), 1901 ... Face (shooting target), 1911 ... Face (subject)

Claims (13)

State detection means for acquiring captured image data, which is data of a captured image captured in front of the display surface of the display unit, and analyzing the acquired captured image data to detect a state of a capturing target in the captured image;
Image specifying means for specifying image data of an image to be displayed on the display unit based on the state of the photographing target detected by the state detecting means;
An image specifying apparatus comprising: The state of the shooting target includes a position of the shooting target in the shot image,
The image specifying means specifies, as the image data of the image to be displayed on the display unit, image data of an image in which a subject is captured at a position satisfying a first predetermined relationship with the position of the shooting target in the shot image. The image specifying device according to claim 1.   The image specifying apparatus according to claim 2, wherein the first predetermined relationship is a relationship in which the photographing target and the subject are located in regions corresponding to each other on the image.   The image specifying apparatus according to claim 2, wherein the first predetermined relationship is a relationship in which the photographing target and the subject are located in different regions on the image. The state of the shooting target in the shot image includes the number of shooting targets in the shot image,
The image specifying means specifies, as the image data of the image to be displayed on the display unit, image data of an image in which a number of subjects satisfying a second predetermined relationship with the number of shooting objects in the captured image is displayed. The image specifying device according to claim 1. The state of the shooting target includes a line of sight of the shooting target in the shot image,
The image specifying means specifies, as the image data of the image to be displayed on the display unit, image data of an image in which a subject satisfying a third predetermined relationship with the line of sight of the shooting target in the shot image is displayed. The image specifying device according to claim 1.   The image specifying unit specifies a plurality of the image data, and sets the display order of the specified image data to a similarity between the characteristics of the photographing target and the characteristics of the subject of the specified image data. The image specifying device according to claim 1, wherein the image specifying device is specified based on the information.   When the state detection unit detects a new state of the shooting target, the image specifying unit displays the image on the display unit from among the plurality of image data based on the detected state of the new shooting target. The image specifying device according to claim 1, wherein the image data of an image is specified. The display unit further includes
The image specifying device according to claim 1, wherein the image specifying unit displays the image of the specified image data on the display unit. It further includes a photographing unit that photographs the photographing object,
The image specifying apparatus according to any one of claims 1 to 9, wherein the state information generation unit acquires the captured image data that is data of the captured image captured by the capturing unit. A display control device for displaying an image on a display unit,
A control unit that displays on the display unit an image of a pre-photographed image data that shows a person or animal in a state that satisfies a certain relationship with the state of the person or animal in front of the display unit; A display control device characterized by that. On the computer,
A state detection step of acquiring captured image data, which is data of a captured image captured in front of the display surface of the display unit, and analyzing the acquired captured image data to detect a state of a capturing target in the captured image;
An image specifying step for specifying image data of an image to be displayed on the display unit based on the state of the photographing target detected in the state detecting step;
An image specifying program characterized in that On the computer that displays the image on the display,
Causing the display unit to display an image of a pre-captured image data in which a person or animal in a state satisfying a certain relationship with the state of the person or animal in front of the display unit is captured. A display control program characterized by that.

Images