JP2015095082A - Image display device, control method therefor, and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To take owner's privacy into consideration and further to reduce restrictions on an object to be browsed as much as possible.SOLUTION: Property information representing properties of an image is recorded on a recording medium 200 incidentally to the image, and a camera part 90 images a user who browses the image. A system control unit 50 extracts a feature quantity of a subject as a subject feature quantity from the image saved in the recording medium and detects a feature quantity as a user feature quantity from the user image obtained through the imaging by camera part imaging means, and obtains a first retrieved image by retrieving an image having the same subject feature quantity as the user feature quantity from the recording medium and also obtains a second retrieved image by retrieving an image having the same property information with the first retrieved image from the recording medium. The system control unit displays the first retrieved image and the second retrieved image at a display unit so that the retrieved images can be browsed.

Description

  The present invention relates to an image display device, a control method thereof, and a control program, and in particular, an image that can be browsed according to a person viewing the image when displaying image data recorded on a recording medium as an image on a display unit. It is related with the technique which restricts.

  In recent years, with the widespread use of imaging devices such as digital cameras, mobile phones, and smartphones, for example, opportunities to share images taken on the road with friends have increased. At this time, if the user who owns the imaging device passes the imaging device to another person such as a friend and shares an image obtained as a result of shooting with a large number of people, all images stored in the recording medium provided in the imaging device May be viewed.

  For such a problem, for example, the face of a person using the imaging device is detected, and the detected face is matched with a face image present in the image recorded on the recording medium, There is an imaging device so that only matched images are viewed (see Patent Document 1).

JP 2006-318352 A

  However, in the field method described in Patent Document 1, only an image in which a person who uses the imaging device is shown is to be browsed. As a result, it is impossible to view an image in which a person using the imaging device is not captured, for example, an image in which friends are photographed, an image in which a landscape or a building is photographed. For this reason, there is a problem that an image that a person using the imaging apparatus wants to browse cannot be browsed.

  Accordingly, it is an object of the present invention to provide an image display apparatus, a control method thereof, and a control program that can reduce the restriction of the browsing object as much as possible in consideration of the privacy of the owner.

  In order to achieve the above object, an image display device according to the present invention is an image display device that reproduces an image stored in a recording medium and displays the image on a display unit, and browses the image displayed on the display unit. An image capturing unit that captures an image of the user and an image stored in the recording medium are searched for an image including the user captured by the image capturing unit and an image having the same attribute information as the image including the user. Display control means for displaying on the display unit.

  A control method according to the present invention is a control method of an image display device that reproduces an image stored in a recording medium and displays the image on a display unit, and captures a user who views the image displayed on the display unit by a camera unit An image including the user obtained in the image capturing step and an image having the same attribute information as the image including the user from the image stored in the recording medium. And a display control step for displaying on the screen.

  A control program according to the present invention is a control program used in an image display device that reproduces an image stored in a recording medium and displays the image on a display unit, and the display unit includes a computer unit included in the image display device. An image capturing step for capturing a user viewing an image displayed on the image, an image including the user obtained in the image capturing step from an image stored in the recording medium, and the same attribute as the image including the user A display control step of searching for an image having information and displaying the image on the display unit.

  According to the present invention, an image including the user and an image having the same attribute information as the image including the user are retrieved from the image stored in the recording medium and displayed on the display unit. Considering the privacy of the owner, it is possible to reduce the restriction of the browsing object as much as possible.

1 is a perspective view showing an appearance of an example of an imaging apparatus including an image display device according to a first embodiment of the present invention. It is a block diagram which shows an example of a structure of the camera shown in FIG. It is a figure for demonstrating the detection of the user in the camera shown in FIG. 3 is a flowchart for explaining a playback mode process performed by the camera shown in FIG. 2. It is a figure which shows the example about the image image recorded on the recording medium shown in FIG. It is a figure which shows the imaging | photography date which each person can browse about the image file shown in FIG. It is a figure which shows the image file which each person can browse about the image file shown in FIG. FIG. 5A is a diagram illustrating an example of a thumbnail image displayed on the display unit when processing related to the playback mode described in FIG. 4 is performed, and FIG. 5A illustrates a thumbnail image when the camera owner is a viewer. FIG. 4B is a diagram showing a thumbnail image when a person other than the camera owner is a viewer. It is a figure which shows the example about the image image recorded on the recording medium in the camera provided with the image display apparatus by the 2nd Embodiment of this invention. It is a figure which shows the example about the image image recorded on the recording medium in the camera provided with the image display apparatus by the 3rd Embodiment of this invention. It is a figure which shows the example about the image image recorded on the recording medium in the camera provided with the image display apparatus by the 4th Embodiment of this invention. It is a flowchart for demonstrating the imaging | photography mode process performed with the camera provided with the image display apparatus by the 5th Embodiment of this invention. It is a figure for demonstrating the thumbnail image displayed at the time of reproduction | regeneration in the camera which concerns on the 5th Embodiment of this invention, and the image displayed on a display part as a result of imaging | photography, (a) is a thumbnail image. FIG. 4B is a diagram illustrating an image obtained as a result of photographing.

  Hereinafter, an example of an imaging apparatus including an image display apparatus according to an embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a perspective view illustrating an appearance of an example of an imaging apparatus including the image display apparatus according to the first embodiment of the present invention.

  The illustrated imaging apparatus is a so-called digital camera (hereinafter simply referred to as a camera), and can capture at least a still image. The display unit 28 is disposed on the back side of the camera 100, and images and various types of information are displayed on the display unit 28.

  On the upper surface of the camera 100, a power switch 72 for switching between power on and power off is disposed, and a shutter button 61 is disposed. On the right side of the display unit 28, a mode dial (also referred to as a mode switch) 60 for switching various modes and an operation unit 70 for receiving various operations from the user are disposed. In addition, a camera unit 90 oriented in the back direction is disposed immediately above the display unit 28.

  The operation unit 70 includes various switches, buttons, a touch panel, and the like for receiving various operations from the user. Further, the operation unit 70 is provided with a controller wheel 73, and the controller wheel 73 sends out a command corresponding to the rotation operation.

  In the illustrated example, the camera 100 is connected with a connection cable 111 for connecting the camera 100 and an external device (not shown). This connection cable 111 is connected to the camera 100 by a connector 112.

  A recording medium slot 201 is formed in the camera 100, and a recording medium 200 such as a memory card or a hard disk is stored in the recording medium slot 201. When storing the recording medium 200 in the recording medium slot 201, the lid 202 provided in the camera 100 is opened, and the recording medium 200 is stored in the recording medium slot 201.

  FIG. 2 is a block diagram showing an example of the configuration of the camera 100 shown in FIG.

  In FIG. 2, the camera 100 includes a photographic lens unit (hereinafter simply referred to as a photographic lens) 103, and the photographic lens 103 includes at least a zoom lens and a focus lens.

  A shutter 101 having an aperture function is disposed at the rear stage of the photographing lens 103. On the rear side of the shutter 101, an imaging unit 22 having a CCD or CMOS element that converts an optical image into an electrical signal (analog signal) is disposed. The analog signal that is the output of the imaging unit 22 is converted into a digital signal (image data) by the A / D converter 23.

  A barrier 102 is disposed on the front side of the photographic lens 103. The barrier 102 covers the photographic lens 103, the shutter 101, the imaging unit 22, and the like to prevent dirt and damage.

  The image processing unit 24 receives the image data that is the output of the A / D converter 23 or the image data from the memory control unit 15 and performs a resizing process such as predetermined pixel interpolation and reduction and a color conversion process. Further, the image processing unit 24 performs a predetermined calculation process using image data obtained as a result of imaging. The system control unit 50 performs exposure control and distance measurement control based on the calculation result. As a result, TTL (through the lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are performed.

  Further, the image processing unit 24 performs predetermined calculation processing using image data obtained as a result of imaging, and performs TTL AWB (auto white balance) processing based on the calculation result.

  The image data output from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15 or directly via the memory control unit 15. The memory 32 has a sufficient storage capacity for storing a predetermined number of still images or moving images and sound for a predetermined time.

  The illustrated memory 32 also serves as an image display memory (video memory). The display image data written in the memory 32 is given to the display unit 28 via the D / A converter 13 and is displayed as an image. Is displayed.

  The display unit 28 is, for example, an LCD. Further, if the image data stored in the memory 32 is D / A converted by the D / A converter 13 and sequentially transferred and displayed on the display unit 28, the display unit 28 functions as an electronic viewfinder and displays a through image display. It can be carried out.

  The system control unit 50 controls the entire camera 100. The nonvolatile memory 56 stores constants, variables, programs, and the like for operating the system control unit 50. This program includes a program for executing various flowcharts to be described later. The nonvolatile memory 56 is an electrically erasable / recordable memory, and for example, an EEPROM is used.

  The system memory 52 is, for example, a RAM, and the system control unit 50 reads operation constants, variables, programs, and the like from the nonvolatile memory 56 and develops them in the system memory 52. The image data written in the memory 32 is filed in the system control unit 50 and recorded on the recording medium 200 via the interface (I / F) 18.

  A system timer 53 is connected to the system control unit 50, and the system timer 52 measures the time used for various controls by the system control unit 50 and gives it to the system control unit 50.

  The above-described mode changeover switch 60 is a switch for switching the operation mode of the system control unit 50 to any one of a still image recording mode, a moving image recording mode, a reproduction mode, and the like, for example.

  The still image recording mode includes, for example, an auto shooting mode, an auto scene discrimination mode, a manual mode, various scene modes for shooting settings for each shooting scene, a program AE mode, and a custom mode. If the mode switch 60 is used, it is possible to directly switch to any of these modes.

  In addition, after the mode changeover switch 60 temporarily switches to the still image recording mode, the operation unit 70 may be used to switch to any of the above modes. Similarly, the moving image recording mode includes a plurality of modes.

  When the shutter button 61 is in the middle of operation (half-pressed: photographing preparation instruction), a first shutter switch (not shown) is turned on, and the first shutter switch signal SW1 is given to the system control unit 50. Accordingly, the system control unit 50 starts operations such as AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and EF (flash preflash) processing.

  When the operation of the shutter button 61 is completed (fully pressed), a second shutter switch (not shown) is turned on and a second shutter switch signal SW2 is given to the system control unit 50. Accordingly, the system control unit 50 starts a series of imaging processing operations from reading the signal of the imaging unit 22 to writing the image data on the recording medium 200.

  When various function icons displayed on the display unit 28 are selected and operated, functions are appropriately assigned to each scene, and the operation unit 70 functions as various function buttons. Examples of the function buttons include an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button.

  When the menu button is operated on the operation unit 70, the system control unit 50 displays a menu screen for performing various settings on the display unit 28. The user can intuitively make various settings using the four-way key and the SET button by looking at the menu screen displayed on the display unit 28.

  The controller wheel 73 shown in FIG. 1 is used when a selection item is designated together with a direction button. When the controller wheel 73 is rotated, an electrical pulse signal corresponding to the operation amount is generated. The system control unit 50 controls the camera 100 based on the pulse signal. The system control unit 50 can know the angle at which the controller wheel 73 is rotated by the pulse signal and the number of rotations thereof.

  The controller wheel 73 may be any operation member that can detect a rotation operation. For example, the controller wheel 73 may be a dial operation member that generates a pulse signal in response to a user's rotation operation. Further, the controller wheel 73 may be an operation member made of a touch sensor without rotating, and may detect a rotation operation of the user's finger (so-called touch wheel).

  The power supply control unit 80 includes a battery detection circuit, a DC-DC converter, and a switch circuit that switches blocks to be energized. Then, the power control unit 80 detects the presence / absence of a battery, the type of battery, and the remaining battery level. Further, the power supply control unit 80 controls the DC-DC converter based on the detection result and the instruction from the system control unit 50, and applies a predetermined voltage to each part of the camera 100 including the recording medium 200 for a necessary period. Supply.

  The power supply unit 30 is connected to the power supply control unit 80. The battery unit 30 includes a primary battery such as an alkaline battery or a lithium battery, or a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and an AC adapter.

  The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk, and image data obtained as a result of photographing is recorded on the recording medium 200. The recording medium 200 is composed of, for example, a semiconductor memory or a magnetic disk.

  By the way, in the camera 100, it is possible to perform photographing using so-called center single point AF and face AF. Central one-point AF is to perform AF on one central position in the shooting screen. Face AF is to perform AF on the face detected by the face detection function.

  Here, the face detection function will be described.

  The system control unit 50 sends the face detection target image data to the image processing unit 24. Under the control of the system control unit 50, the image processing unit 24 performs horizontal bandpass filter processing on the image data. Then, under the control of the system control unit 50, the image processing unit 24 performs vertical bandpass filter processing on the image data that has been subjected to horizontal bandpass filter processing. By these horizontal and vertical band pass filter processes, edge components are detected from the image data.

  Thereafter, the system control unit 50 performs a pattern matching process on the detected edge component to extract a candidate group of eyes, nose, mouth, and ears. Then, the system control unit 50 determines that a candidate that satisfies a preset condition (for example, the distance and inclination of two eyes) from the extracted eye candidate group is an eye pair and has an eye pair. Narrowing is performed as a candidate group of only eyes (candidate group of narrowing eyes).

  The system control unit 50 associates a candidate group for narrowing eyes with other parts (nose, mouth, ears) that form a face corresponding thereto, and performs a preset non-face condition filtering process to perform a face (face region). Is detected. The system control unit 50 outputs face information according to the face detection result and ends the process. At this time, the system control unit 50 stores feature quantities such as the number of faces in the system memory 52.

  In this way, subject image information (here, face information) can be obtained by analyzing the image data displayed in live view or reproduced and extracting the feature amount of the image data. Although the face information has been described as an example here, the subject information includes various information such as a red-eye determination result, an eye detection result, an eyelid detection result, and a smile detection result.

  In addition to the above-described face AF, the camera 100 can perform the face AE, the face FE, and the face WB. The face AE is a process for optimizing the exposure of the entire screen in accordance with the brightness of the detected face. The face FE is a process for performing flash light control around the detected face. Furthermore, the face WB is a process of optimizing the WB of the entire screen according to the detected face color.

FIG. 3 is a diagram for explaining user detection in the camera 100 shown in FIG. 2.
The method will be described.

  When the user selects the playback mode with the mode switch 60, the system control unit 50 reads out the image data from the recording medium 200 and displays it on the display unit 28 as an image. At this time, the system control unit 50 operates the camera unit 90 to image the user 601, that is, the viewer's face here. Although not shown, the camera unit 90 includes at least a photographic lens, an image sensor, and an A / D converter. An image photographed by the camera unit 90 is given to the system control unit 50, and the system control unit 50 detects a face area (that is, user feature amount) for the image as described above.

  Note that when detecting the face area of the image obtained by the camera unit 90, the user 301 confirms the image read from the recording medium 200 on the display unit 28. At this time, if the camera unit 90 is a so-called in-camera, the user 301 does not need to point the camera 100 toward the face in order to detect the face, and can use the camera 100 in a more natural form.

  FIG. 4 is a flowchart for explaining playback mode processing performed by the camera 100 shown in FIG. Note that the processing according to the flowchart shown in the drawing is performed by the system control unit 50 expanding and executing a program stored in the nonvolatile memory 56 in the system memory 52.

  Assume that the image data stored in the recording medium 200 shown in FIG. 2 is added with the shooting date and time when the image was shot as attribute information.

  When the image viewer who is the user switches to the reproduction mode by the mode change switch 60, the system control unit 50 controls the camera unit 90 shown in FIG. (Hereinafter referred to as a viewer image or a user image) is written into the memory 32 via the memory control unit 15 (imaging process: step S101).

  Subsequently, the system control unit 50 performs a face detection process of detecting the viewer's face area (that is, user feature amount) in the viewer image written in the memory 32 (step S102). Then, the system control unit 50 determines whether or not the viewer's face area is detected (step S103).

  If the face area cannot be detected (NO in step S103), the system control unit 50 controls the memory control unit 15 to display a message notifying the viewer that the face has not been detected normally. (Step S104). Then, the system control unit 50 returns to the process of step S102.

  On the other hand, when the viewer's face area is detected (YES in step S103), the system control unit 50 determines whether or not the face area is the owner of the camera 100 (step S105). Then, the system control unit 50 determines whether or not the camera owner is detected by checking whether or not the viewer's face area is a previously registered owner's face area (step S106). The face image indicating the owner's face area is stored in, for example, the nonvolatile memory 56.

  If the camera owner is not detected, that is, if the viewer's face area is not the camera owner (NO in step S106), the system control unit 50 displays the image stored in the recording medium 200 and the viewer's face area. A matching process with the face image shown is performed (step S107).

  When there are a plurality of face areas detected in step S103, the system control unit 50 performs matching processing for all faces. If a plurality of face areas are detected, the system control unit 50 determines in step S106 that the camera owner is not detected.

  Subsequently, as a result of the matching process, the system control unit 50 determines whether any one of the viewer's face areas is detected from the image stored in the recording medium 200 (step S108). Here, the system control unit 50 determines whether or not there is a subject face area (that is, a subject feature amount) that matches the face area of the viewer in the image stored in the recording medium 200. If there is no image matching the face area of the viewer (NO in step S108), the system control unit 50 displays the date (date and time) among the images stored in the recording medium 200 for the viewer. ) Is given viewing authority to browse the new image (step S109).

  On the other hand, if there is an image (that is, the first search image) that matches the viewer's face area (YES in step 108), the system control unit 50 has an image having the same attribute information as the matched image (that is, the first search image). The second search image) is extracted from the recording medium 200 (step S110). Then, the system control unit 50 gives the browsing authority for the extracted images (here, the first search image and the second search image) to the viewer (step S111).

  In step S106, when the camera owner is detected (YES in step S106), the system control unit 50 gives the browsing authority to all images stored in the recording medium 200 to the viewer (step S112).

  Subsequent to step S109, S111, or S112, the system control unit 50 determines whether the viewer (that is, the camera user) who browses the image with the camera 100 has been replaced with another person, that is, the user. It is determined whether or not there has been a change (step S113). Here, the system control unit 50 performs imaging using the camera unit 90 at a predetermined interval, and the user of the camera 100 determines whether there is a change in the face area detected in the viewer image written in the memory 32. It is determined whether or not it has been changed.

  When the user is changed (YES in step S113), the system control unit 50 returns to the process of step S101 and performs an imaging process using the camera unit 90. On the other hand, if the user is not changed (NO in step S113), the system control unit 50 performs the reproduction mode with the current viewing authority, and determines whether or not the reproduction mode is terminated by the operation of the operation unit 70 ( Step S114).

  If the end operation of the playback mode is not performed, that is, if the playback mode is continued (YES in step S114), system control unit 50 returns to the process of step S113. On the other hand, when the end operation of the playback mode is performed (NO in step S114), system control unit 50 ends the playback mode.

  FIG. 5 is a diagram showing an example of the image image recorded on the recording medium 200 shown in FIG.

  In the example illustrated in FIG. 5, the recording medium 200 is accompanied by an image file (that is, image data), a shooting date (that is, shooting date information), a shooting time (that is, shooting time information), and a shooting location (that is, shooting data). , Shooting location information), and the person in the image file are recorded. Here, it is assumed that the person “A”, the person “B”, and the person “C” are shown.

  FIG. 6 is a diagram showing a shooting date that each person can view for the image file shown in FIG. 5.

  FIG. 7 is a diagram illustrating an image file that can be viewed by each person with respect to the image file illustrated in FIG. 5.

  As shown in FIG. 5, the shooting date when the person “B” was shot is “January 1 and January 15” for two days. In the illustrated example, as described above, the shooting date of the image data is considered as the attribute information. The image files IMG0003 and IMG0006 do not show the person “B”, but the image files IMG0003 and IMG0006 have the same shooting date as the image files IMG0001, IMG0002, IMG0005, and IMG0007 that contain the person “B”. is there.

  Therefore, the image files IMG0003 and IMG0006 are image files having the same attribute information as the image files IMG0001, IMG0002, IMG0005, and IMG0007. As a result, since an image matching the face area of the person “B” exists in the recording medium 200 in step S108, the person “B” can browse the image files IMG0003 and IMG0006 in which the person “B” is not captured. .

  For the person “C”, there is January 1 as the shooting date of the image file in which the person “C” is shown. As a result, a total of three image files IMG0001, IMG0002, and IMG0003 having the same attribute information can be viewed by the person “C”.

  As a result, the photographing dates on which the persons “A” to “C” can browse are dates marked with circles in the calendars 300 to 302 shown in FIG. 6, respectively, and each of the persons “A” to “C” browses. Possible image files are the image files shown in FIG.

  FIG. 8 is a diagram illustrating an example of a thumbnail image displayed on the display unit 28 when the process related to the playback mode described in FIG. 4 is performed. FIG. 8A shows a thumbnail image when the camera owner is a viewer, and FIG. 8B shows a thumbnail image when a person other than the camera owner is a viewer. FIG.

  In FIG. 8, for convenience of explanation, each thumbnail image is shown by its shooting date. Here, nine image files are recorded on the recording medium 200, and each of these image files is recorded in each image file. Assume that at least one of the persons “A” to “C” is captured. Here, it is assumed that the owner of the camera 100 is the person “A”.

  When the person “A” is a viewer, the screen 401 displayed on the display unit 28 displays all of the image files recorded on the recording medium 200 (that is, nine images) on the display unit 28. Will be. On the other hand, here, when the person “B” other than the owner is a viewer, the screen 402 displayed on the display unit 28 has six images with viewing authority using the shooting date as attribute information as a key. Only the image is displayed.

  In FIG. 8B, for the person “B”, images that can be browsed are limited by the shooting date that is the attribute information, but the system control unit 50 does not explicitly display the browsing limitation on the display unit 28. As a result, the person “B” browses without noticing that the viewable images are limited, and the person “B” is less likely to feel uncomfortable.

  As described above, in the first embodiment of the present invention, only an image having the same attribute information as that of the image in which the person using the camera 100 is detected can be browsed. Browsing of images can be prevented. As a result, in consideration of the privacy of the owner, it is possible to reduce the restriction of the browsing target as much as possible.

  In the first embodiment, for example, an image related to an event photographed on the day of using the camera 100 can be shared with all the persons who photographed the image, but there are other unrelated images. Will be restricted from viewing.

[Second Embodiment]
Next, a camera including an image display device according to the second embodiment of the present invention will be described. The configuration of the camera according to the second embodiment is the same as that of the camera shown in FIGS. 1 and 2, and the processing in the playback mode is performed according to the flowchart described in FIG. However, in the second embodiment, as attribute information related to image data stored in the recording medium 200, in addition to the date when the image was captured, the location where the image was captured (capturing position) and the current position of the camera Distance information indicating the distance is used.

  FIG. 9 is a diagram illustrating an example of an image image recorded on a recording medium in a camera including an image display device according to the second embodiment of the present invention.

  In the example shown in FIG. 9, the recording medium 200 records a shooting date, a shooting time, a shooting location, and a person shown in the image file in association with the image file. Here, the person “A”, the person “B”, the person “C”, the person “D”, and the person “E” are taken.

  As shown in FIG. 9, there are a total of three image files including the image files IMG0004, IMG0005, and IMG0006 in which the person “D” is shown. As described in the first embodiment, when only the shooting date is considered as attribute information, the shooting dates of the image files IMG0001, IMG0002, and IMG0003 are the same as the shooting dates of the image files IMG0004, IMG0005, and IMG0006. Therefore, the person “D” can view a total of six image files IMG0001, IMG0002, IMG0003, IMG0004, IMG0005, and IMG0006.

  However, as shown in FIG. 9, the person shown in the image taken in Hokkaido and the image taken in Tokyo are completely different persons. Therefore, in order to protect privacy, it is desirable that the number of image files that can be browsed by the person “D” is IMG0004, IMG0005, and IMG0006.

  Therefore, in the second embodiment, although not shown, the system control unit 50 acquires the current position (use location) of the camera 100 by a position information acquisition unit such as a GPS receiver. Then, the system control unit 50 obtains distance information by obtaining the distance between the shooting location of each image file and the usage location of the camera 100. When the distance indicated by the distance information exceeds a predetermined distance threshold, the system control unit 50 restricts browsing of image files related to the same shooting date.

  For example, in the example shown in FIG. 9, if the place where the camera 100 is used is Tokyo and the distance from Tokyo to Hokkaido is not included in the same attribute information, the person “D” browses. The possible image files are limited to three files, IMG0004, IMG0005, and IMG0006.

  As described above, according to the second embodiment of the present invention, the owner of the camera 100 selects an image having a date on which the user (that is, the viewer) of the camera 100 is not detected in the image file stored in the recording medium 200. An image shot at a shooting location that exceeds a predetermined distance from the usage location of the camera 100 is not viewed by another person.

  For example, in the case where the owner of the camera 100 visits a family on a day trip and returns from the trip and meets a friend, if only the shooting date is used as attribute information of the image file, the image of the trip of the family to the friend can be obtained. It may be seen. On the other hand, when distance information is considered as described above, browsing of images that are not relevant to a friend can be restricted.

[Third Embodiment]
Next, a camera provided with an image display device according to a third embodiment of the present invention will be described. The configuration of the camera according to the third embodiment is the same as that of the camera shown in FIGS. 1 and 2, and the processing in the playback mode is performed according to the flowchart described in FIG. However, in the third embodiment, as the attribute information related to the image data stored in the recording medium 200, the time when the image was captured is used in addition to the date when the image was captured.

  FIG. 10 is a diagram illustrating an example of an image image recorded on a recording medium in a camera including an image display device according to the third embodiment of the present invention.

  In the example shown in FIG. 10, the recording medium 200 records the shooting date, the shooting time, the shooting location, and the person shown in the image file in association with the image file. Here, the person “A”, the person “B”, the person “C”, the person “D”, and the person “E” are taken.

  As shown in FIG. 10, there are a total of three image files, MG0004, IMG0005, and IMG0006, in which the person “D” is shown. As described in the first embodiment, when only the shooting date is considered as attribute information, the shooting dates of the image files IMG0001, IMG0002, and IMG0003 are the same as the shooting dates of the image files IMG0004, IMG0005, and IMG0006. Therefore, the person “D” can view a total of six image files IMG0001, IMG0002, IMG0003, IMG0004, IMG0005, and IMG0006.

  However, as shown in FIG. 10, the persons shown in the image files IMG0001, IMG0002, and IMG0003 and the image files IMG0004, IMG0005, and IMG0006 are completely different persons. Therefore, in order to protect privacy, it is desirable that the number of image files that can be browsed by the person “D” is IMG0004, IMG0005, and IMG0006.

  Therefore, in the second embodiment, considering the image shooting time as attribute information, the system control unit 50 sets the image as the same attribute if there is a difference exceeding a predetermined time between the image shooting times. Do not handle. In the illustrated example, since there is a difference exceeding a predetermined time between the image files IMG0001, IMG0002, and IMG0003 and the shooting times of the image files IMG0004, IMG0005, and IMG0006, the system control unit 50 determines that these image files have different attributes. Determine that it has information. As a result, the system control unit 50 limits the number of image files that the person “D” can view to IMG0004, IMG0005, and ING0006.

  As described above, in the third embodiment of the present invention, in an image file stored in the recording medium 200, an image of an image in which the user is not detected and an image in which the user is detected is detected even if the shooting date is the same. If there is a difference in time that exceeds a predetermined time, image browsing is restricted. Therefore, the owner of the camera 100 does not view an image in which there is a difference exceeding a predetermined time in the shooting time by another person.

[Fourth Embodiment]
Next, a camera provided with an image display device according to a fourth embodiment of the present invention will be described. The configuration of the camera according to the fourth embodiment is the same as that of the camera shown in FIGS. 1 and 2, and the processing in the playback mode is performed according to the flowchart described in FIG. However, in the fourth embodiment, it is assumed that a plurality of face regions are detected in step S103 shown in FIG.

  FIG. 11 is a diagram illustrating an example of an image image recorded on a recording medium in a camera including an image display device according to the fourth embodiment of the present invention.

  Here, as described in the first embodiment, if only the shooting date is used as attribute information, the image files that can be viewed by the person “B” are IMG0001, IMG0002, IMG0004, and IMG0006, and the person “B” Image files that can be browsed by C ″ are IMG0001, IMG0003, and IMG0005.

  In step S103 described with reference to FIG. 4, when the system control unit 50 detects a plurality of face areas, it determines that the camera owner is not detected in step S106. As a result, the system control unit 50 performs a matching process in step S107, and enables the browsing of the image files IMG0001, IMG0002, IMG0004, and IMG0006 for the person “B” by the matching process, and the image file IMG0001 for the person “C”. , IMG0003, and IMG0005.

  At this time, since face areas are detected for a plurality of persons “B” and “C”, the system control unit 50 can view a total of six image files IMG0001, IMG0002, IMG0003, IMG0004, IMG0005, and IMG0006. To do.

  As described above, in the fourth embodiment of the present invention, when viewing an image stored in the recording medium 200 with a plurality of persons, the same image as that of a specific person using the camera 100 is shown. An image having the same attribute information as all images in which a person using the camera 100 is captured is displayed without displaying only images having attribute information. As a result, when an image is browsed by a plurality of persons, the plurality of persons can browse an image related to each person.

[Fifth Embodiment]
Next, a camera provided with an image display device according to a fifth embodiment of the present invention will be described. The configuration of the camera according to the fifth embodiment is the same as that of the camera shown in FIGS.

  In the fifth embodiment, a process will be described when a person other than the owner uses the camera 100 and the recording medium 200 runs out of space and an image obtained as a result of shooting cannot be recorded. Here, it is assumed that a user is imaged by the camera unit 90 and an image obtained as a result of the imaging is stored in the memory 32 at the time of shooting.

  FIG. 12 is a flowchart for explaining a shooting mode process performed by a camera including an image display device according to the fifth embodiment of the present invention. Note that the processing according to the flowchart shown in the drawing is performed by the system control unit 50 expanding and executing a program stored in the nonvolatile memory 56 in the system memory 52.

  When the photographer who is the user switches to the photographing mode by the mode change switch 60, the system control unit 50 determines whether or not a person's face area is detected for the image recorded in the memory 32 (that is, the user image). (Step S201). If the face area is not detected (NO in step S201), the system control unit 50 performs the process of step S201 until the face area of the person is detected. In other words, the system control unit 50 does not proceed to the next step until the person's face area is detected, and prevents shooting.

  On the other hand, when a human face area is detected (YES in step S201), the system control unit 50 determines whether or not the shutter button 61 has been operated (step S202). If the shutter button 61 is not operated even after the predetermined time has elapsed (NO in step S202), the system control unit 50 waits until the shutter button is operated. When the shutter button 61 is operated (YES in step S202), the system control unit 50 captures the subject and obtains image data (subject image) as described with reference to FIG. S203).

  Subsequently, the system control unit 50 determines whether or not the recording medium 200 has a free space capable of recording subject image data obtained as a result of imaging (step S204). If there is free space in the recording medium 200 (YES in step S204), the system control unit 50 records subject image data obtained as a result of imaging on the recording medium 200 (step S205). Then, the system control unit 50 determines whether or not the shooting mode is ended by the user's operation (step S206).

  When the shooting mode end operation is performed (YES in step S206), system control unit 50 ends the shooting mode process. On the other hand, if the photographing mode end operation is not performed (NO in step S206), system control unit 50 returns to the process of step S202.

  If there is no free space in recording medium 200 (YES in step S204), system control unit 50 displays on display unit 28 that the free space of recording medium 207 is insufficient (step S207). Then, the system control unit 50 proceeds to the process of step S206.

  FIG. 13 is a diagram for explaining a thumbnail image displayed during playback and an image displayed on the display unit 28 as a result of shooting in the camera according to the fifth embodiment of the present invention. FIG. 13A shows a thumbnail image, and FIG. 13B shows an image obtained as a result of shooting.

  Now, when a user who has taken an image tries to view an image stored in the recording medium 200, the screen 501 is displayed on the display unit 28 by the method described in any of the first to third embodiments. Is displayed and a plurality of thumbnail images are displayed on the screen 501 (only two thumbnail images are shown in FIG. 13B).

  On the other hand, as described with reference to FIG. 12, when the user takes a picture using the camera 100, a confirmation screen 502 is displayed on the display unit 28. The correct number 503 is displayed.

  Here, there may be a mismatch between the number of images that can be viewed on the display unit 28 and the number of images that can be taken. Then, a user who cannot view most of the images stored in the recording medium 200 may have doubts about the inconsistency shown in FIG. For this reason, the system control unit 50 gives priority to the use of the camera 100 without noticing that there are restrictions on the images that can be viewed by the user, and notifies that there are restrictions on the images that can be viewed. do not do.

  As described above, in the fifth embodiment of the present invention, when there is not enough free space for storing image data obtained as a result of shooting, the number of images displayed on the display unit 28 and shooting when the image is reproduced. In this case, it is notified that the free space of the recording medium 200 is insufficient without considering the discrepancy with the number of shootable images displayed on the display unit 28. Thus, the user can use the camera 100 even though the images that can be viewed by the user are limited.

  As is clear from the above description, in the example shown in FIG. 2, the camera unit 90 functions as an imaging unit, and the image processing unit 24, the system control unit 50, and the memory control unit 15 function as display control units. The image processing unit 24 and the system control unit 50 function as an extraction unit and a search unit, and the system control unit 50 and the memory control unit 15 function as a display unit.

  In the example shown in FIG. 1, at least the operation unit 70, the mode changeover switch 60, the system control unit 50, the memory 32, the memory control unit 15, the image processing unit 24, the D / A converter 13, the display unit 28, and the camera The unit 90 constitutes an image display device.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  For example, the function of the above embodiment may be used as a control method, and the control method may be executed by the image display apparatus. Further, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the image display apparatus. The control program is recorded on a computer-readable recording medium, for example.

  Each of the above control method and control program has at least an imaging step and a display control step.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and the computer (or CPU, MPU, etc.) of the system or apparatus reads the program. To be executed.

DESCRIPTION OF SYMBOLS 15 Memory control part 22 Image pick-up part 24 Image processing part 28 Display part 32 Memory 50 System control part 61 Shutter button 70 Operation part 90 Camera part 200 Recording medium

Claims (13)

An image display device that reproduces an image stored in a recording medium and displays the image on a display unit,
Imaging means for imaging a user viewing an image displayed on the display unit;
Display control for retrieving an image including the user photographed by the imaging unit and an image having the same attribute information as the image including the user from the image stored in the recording medium and displaying the retrieved image on the display unit Means,
An image display device comprising: The attribute information is recorded along with the image on the recording medium,
The display control means, extracting means for extracting a feature amount of a subject as a subject feature amount in an image stored in the recording medium;
A feature quantity is detected as a user feature quantity in a user image including the user obtained as a result of imaging by the imaging means, and an image having the same subject feature quantity as the user feature quantity is searched from the recording medium. Then, a first search image that is an image including the user is obtained, and an image having the same attribute information as the first search image is further searched from the recording medium to obtain a second search image. Search means;
The image display apparatus according to claim 1, further comprising: a display unit configured to display the first search image and the second search image on the display unit so as to be browseable.   The image display apparatus according to claim 2, wherein each of the subject feature amount and the user feature amount is information indicating a face area of a person.   The image display apparatus according to claim 1, wherein the attribute information is shooting date information indicating a shooting date when the image stored in the recording medium is shot.   4. The attribute information includes shooting date information indicating a shooting date when an image stored in the recording medium is shot and shooting location information indicating a place where the image is shot. The image display device according to item 1.   The display control means includes the user when the distance between the shooting location and the location where the image display device is used exceeds a predetermined distance even if the shooting date is the same as the image including the user. 6. The image display apparatus according to claim 5, wherein browsing of an image having the same attribute information as the image to be viewed is restricted.   When the image including the user does not exist on the recording medium, the display control unit can view only the image having the latest shooting date among the images stored in the recording medium and display the image on the display unit. The image display device according to claim 5.   The attribute information is shooting date information indicating a shooting date when an image stored in the recording medium is shot, and shooting time information indicating a time when the image is shot. The image display device according to item 1.   The display control means has a difference between a time indicated by the shooting time information and a time when the image is viewed on the image display device exceeds a predetermined time even if the shooting date is the same as the image including the user. The image display apparatus according to claim 8, wherein browsing of an image having the same attribute information as an image including the user is restricted.   The image display according to claim 3, wherein when a plurality of face areas are detected in the user image, the search unit searches for an image recorded on the recording medium for each of the face areas. apparatus.   When the face area detected in the user image is an owner of the image display apparatus registered in advance, the display control means can browse all the images existing on the recording medium. The image display device according to claim 3. A method for controlling an image display device that reproduces an image stored in a recording medium and displays the image on a display unit,
An imaging step of imaging a user viewing an image displayed on the display unit by the camera unit;
Display that searches the image stored in the recording medium for the image including the user obtained in the imaging step and the image having the same attribute information as the image including the user and displays the image on the display unit Control steps;
A control method characterized by comprising: A control program used in an image display device that reproduces an image stored in a recording medium and displays the image on a display unit,
A computer provided in the image display device,
An imaging step of imaging a user viewing an image displayed on the display unit by the camera unit;
Display that searches the image stored in the recording medium for the image including the user obtained in the imaging step and the image having the same attribute information as the image including the user and displays the image on the display unit Control steps;
A control program characterized by causing

Images