JP2013141156A - Image reproducer and camera - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate the search of a desired image in a short time.SOLUTION: An image reproducer 100 includes: setting means 104 for setting a template image on the basis of thumbnail image data corresponding to a first image and focus area information; matching processing means 104 for performing template matching processing through the use of the template image set by the setting means 104 with respect to thumbnail image data corresponding to a second image to be reproduced after the first image; and reproduction control means 104 for avoiding the reproduction of the second image when an area matched with the template image is detected from the second image after the performance of the processing by the matching processing means 104, and reproducing the second image and allowing display means 106 to display the second image when an area matched with the template image is not detected from the second image.

Description

  The present invention relates to an image reproduction device and a camera.

  Conventionally, when a plurality of images are reproduced in a slide show format, when the current image scheduled to be reproduced is compared with the previous image scheduled to be reproduced before the current image, and the current image is similar to the previous image, There is known an image reproducing apparatus that determines that a current image should be skipped and excludes it from slide show reproduction. (For example, patent document 1).

JP 2010-177731 A

  In the above prior art, the similarity of the images is determined based on the luminance value and the color characteristic value of the entire area or the specific area of the image, so the similarity determination does not reflect the intention of the photographer. Therefore, when the background changes without changing the main subject, such as when performing a panning shot in high-speed continuous shooting, it is determined that the current image is not similar to the previous image, and the previous image and the current image There are cases where both are played back. For this reason, since images of the same shooting scene are continuously reproduced, there is a problem that it takes time to reach the desired image when the user searches for the desired image while viewing the reproduced image. It was.

An image reproduction apparatus according to the first aspect of the present invention corresponds to an acquisition unit that acquires a plurality of images, acquires thumbnail image data and focus area information corresponding to the images, and corresponds to the first image acquired by the acquisition unit. A setting unit that sets a template image based on thumbnail image data and focus area information, and thumbnail image data acquired by the acquisition unit and corresponding to the second image to be reproduced after the first image, When a matching processing unit that performs template matching processing using the template image set by the setting unit and a region that matches the template image is detected from the second image as a result of the processing by the matching processing unit, the second Area that matches the template image from the second image without playing the image of There if not detected, characterized in that it comprises a regeneration control means for displaying on the display unit by reproducing the second image.
According to a seventh aspect of the present invention, a camera includes the image reproduction device according to any one of the first to sixth aspects.

  According to the present invention, it is possible to easily find a desired image in a short time.

It is a block diagram explaining the structural example of the camera by one embodiment of this invention. It is a figure explaining an example of the image of reproduction object. It is a figure explaining an example of a focus area. It is a figure explaining an example of a template image. It is a flowchart which shows the flow of an image reproduction process. It is a flowchart which shows the flow of a thumbnail read-out process.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration of an embodiment of a camera according to the present embodiment. The camera 100 includes an operation member 101, an imaging lens 102, an imaging element 103, a control device 104, a memory card slot 105, and a monitor 106. The operation member 101 includes various input members operated by the user, such as a power switch, a release button, a multi-selector, a playback button, and a delete button.

  The imaging lens 102 is disposed so as to form a subject image on the imaging surface of the imaging element 103. The imaging lens 102 is represented by a single lens in FIG. 1 as a representative, but actually includes a plurality of optical lenses. The image sensor 103 is an image sensor such as a CMOS, for example, captures a subject image formed by the imaging lens 102, and outputs an image signal obtained by the imaging to the control device 104.

  The control device 104 includes a CPU, a memory, and other peripheral circuits, and controls the entire camera 100 in addition to the processing of the image signal. Note that the memory constituting the control device 104 includes SDRAM and flash memory. The SDRAM is a volatile memory, and is used as a work memory for developing a program when the CPU executes a program, or as a buffer memory for temporarily recording data. The flash memory is a non-volatile memory in which data of a program executed by the control device 104, various parameters read during program execution, and the like are recorded.

  The memory card slot 105 is a slot for inserting a memory card as a storage medium. The monitor 106 is a liquid crystal monitor (rear monitor) mounted on the back surface of the camera 100.

  When the power switch of the camera 100 is operated, the control device 104 turns on the power, and displays image data for display (through image) obtained by performing image processing for display on the image acquired from the image sensor 103 in time series on the monitor 106. Display.

  When the release button is fully pressed, the control device 104 performs image processing such as white balance adjustment, sharpness adjustment, gamma correction, and gradation adjustment on the image signal (RAW image) input from the image sensor 103. Apply. Further, the control device 104 compresses the image data after the image processing (referred to as main image data) into the JPEG format to generate JPEG image data. The control device 104 reduces the main image data to generate thumbnail image data, and compresses the thumbnail image data into the JPEG format to generate JPEG thumbnail image data.

  Then, the control device 104 generates an Exif format image file that includes the generated JPEG image data and JPEG thumbnail image data, and further includes shooting information (such as shooting date / time information and focus area information). The control device 104 writes and records the generated image file on the memory card inserted in the memory card slot 105.

  Further, when the playback button is operated, the control device 104 plays back the image recorded on the memory card inserted in the memory card slot 105 and displays it on the monitor 106.

<Image playback processing>
The present embodiment is characterized by image reproduction processing that makes it easy to find an image by grouping images having similar main subjects and reproducing only one representative image for each group. The following description will focus on this point. To do. First, as an example, a case where four images P1 to P4 shown in FIG. 2 are recorded on a memory card will be described. The images P1 and P2 are images obtained by continuously shooting the same main subject. In the image P1 and the image P2, since the main subject is moving, the position and background of the main subject are different. The images P3 and P4 are obtained by photographing a main subject different from the images P1 and P2.

  When the playback button is operated, the control device 104 starts an image playback process, sets the first image P1 as a playback target image (hereinafter referred to as a target image), and stores an image file of the image P1 from the memory card. Is read. In the present embodiment, it is assumed that reading of images from the memory card (that is, setting of target images) is sequentially performed in order of shooting date and time. The context of the shooting date and time when reading an image is recognized based on the shooting date and time information in the image file. The target image may be set in the order of file names.

  The control device 104 acquires the thumbnail image data and focus area information of the image P1 from the read image file. The focus area information indicates a focus area at the time of image shooting.

  FIG. 3 schematically shows an example of the focus area of the camera 100. The display screen G is provided with a plurality of (for example, 51 points) focus areas Ar as shown in FIG. In the camera 100, for example, the focus adjustment of the imaging lens 102 is performed so that the subject image is focused in the focus area Ar selected by the photographer. When shooting is performed, information for specifying the focus area Ar on which the focus adjustment of the imaging lens 102 has been performed is added to the image data as focus area information.

  When acquiring the thumbnail image data and the focus area information of the image P1, the control device 104 sets a template image based on these. Specifically, as shown in FIG. 4, a rectangular range Tm having a predetermined size centered on the focus area Ar indicated by the focus area information is cut out and cut out in the thumbnail image TP1 based on the thumbnail image data of the image P1. The set image is set as the template image Tm. That is, the peripheral area of the focus area Ar is set as the template image Tm. The normal focus area Ar is an area that the photographer recognizes as the main subject. Therefore, by setting the template image in this manner, the image of the main subject intended by the photographer can be set as the template image.

  Since the image P1 is the first image after the start of the image reproduction process, the control device 104 generates a group of the images P1. Then, the control device 104 reproduces the image P1 as a representative image of the group and displays it on the monitor 106.

  Thereafter, when the operation signal instructing the reproduction of the next image is input from the operation member 101 by, for example, operating the multi-selector, the control device 104 sets the second image P2 as the target image. Then, the thumbnail image data and focus area information of the image P2 are acquired.

  The control device 104 performs a known template matching process on the thumbnail image data of the image P2 using the template image Tm set based on the focus area information of the image P1. Specifically, the template image Tm is moved pixel by pixel with respect to the thumbnail image of the image P2, and the image information (color information, luminance information, etc.) of these images is calculated, and the image P2 and the template image Tm The area where the difference value of the minimum is detected. And when the difference value (namely, minimum difference value) of the said area is below a predetermined value, it determines with the said area matching with template image Tm.

  Here, although the background is different between the image P1 and the image P2, the same main subject as the main subject included in the template image Tm is shown in the image P2, and therefore an area matching the template image Tm is detected from the image P2. The Then, the control device 104 classifies the image P2 into a group of images P1. Since the control device 104 has already reproduced the image P1 as the representative image of the group, the control device 104 skips the reproduction of the image P2 (that is, does not reproduce the image P2). Further, the control device 104 generates a template image in the same manner as described above based on the thumbnail image data and focus area information of the image P2. The control device 104 sets a template image based on the image P2 as a new template image.

  Next, the control device 104 sets the third image P3 as a target image, and acquires thumbnail image data and focus area information of the image P3. Then, the template matching process is performed on the thumbnail image of the image P3 in the same manner as described above using the template image based on the image P2.

  Here, since the same main subject as the main subject of the image P2 is not shown in the image P3, a region matching the template image based on the image P2 is not detected from the image P3. Then, the control device 104 does not classify the image P3 into the group of the images P1, and newly generates a group of the images P3. Then, the control device 104 reproduces the image P3 as a representative image of the group instead of the image P1 being displayed, and displays it on the monitor 106.

  Further, the control device 104 generates a template image in the same manner as described above based on the thumbnail image data and focus area information of the image P3. The control device 104 sets a template image based on the image P3 as a new template image.

  Thereafter, when an operation signal instructing reproduction of the next image is input from the operation member 101, the control device 104 sets the fourth image P4 as a target image, and the thumbnail image data and focus area information of the image P4. To get. Then, the template matching process is performed on the thumbnail image of the image P4 in the same manner as described above using the template image based on the image P3.

  Here, since the main subject that is the same as the main subject of the image P3 is not shown in the image P4, a region matching the template image based on the image P3 is not detected from the image P4. Then, the control device 104 does not classify the image P4 into the group of the images P3, and newly generates a group of the images P4. Then, instead of the currently displayed image P3, the image P4 is reproduced as a representative image of the group and displayed on the monitor 106.

  As described above, when the image similar to the main subject continues, the control device 104 reproduces only the first image and skips the reproduction of the subsequent images. Images can be easily searched in a short time. Further, since the control device 104 uses the template image set based on the image immediately before the target image, the template matching processing for the main subject is performed even when the background changes frequently, such as during continuous shooting. Can be performed with high accuracy.

  Next, the flow of the above-described image reproduction processing will be described using the flowchart shown in FIG. The processing shown in FIG. 5 is executed by the control device 104 as a program that is activated when an operation signal instructing image reproduction is input from the operation member 101 by operating a reproduction button, for example.

  In step S10, the control device 104 executes a thumbnail read process. The flow of the thumbnail reading process will be described using the flowchart of FIG. In step S101, the control device 104 reads the image file of the target image from the memory card, reads JPEG thumbnail image data and focus area information included in the image file, and proceeds to step S102.

  In step 102, the control device 104 performs JPEG decoding on the JPEG thumbnail image data to obtain thumbnail image data of the target image. Thereafter, the control device 104 ends the thumbnail reading process of FIG. 6, returns to step S10 (FIG. 5), and proceeds to step S20.

  In step S20, the control device 104 determines whether a template image has been set. If the template image has been set, the determination in step S20 is affirmative and the process proceeds to step S70. If the template image is not set, the determination is negative in step S20 and the process proceeds to step S30. The case where the template image is not set is the case where the target image is the first image (first image) after the start of the image reproduction process, and the case where the template image has been set is the target This is the case where the image is the second and subsequent images.

  In step S30, the control device 104 sets a template image as described above based on the thumbnail image data and focus area information read in step S10, and proceeds to step S40.

  In step S40, the control device 104 newly generates a group of target images and proceeds to step S50. In step S50, the control device 104 reproduces the target image as a representative image of the group and displays it on the monitor 106, and proceeds to step S60.

  In step S <b> 60, the control device 104 determines whether or not an operation signal for instructing the reproduction of the next image is input from the operation member 101. When the operation signal is input, control device 104 makes an affirmative decision in step S60 and returns to step S10. On the other hand, if the operation signal is not input, a negative determination is made in step S60, and the determination process is repeated to wait for the operation signal to be input.

  On the other hand, when the template image has been set, in step S70 which proceeds from step S20, the control device 104 performs the above-described template matching process on the thumbnail image data acquired in step S10 using the set template image. Go to step S80.

  In step S80, the control device 104 determines whether or not a region matching the template image is detected from the thumbnail image of the target image as a result of the template matching process in step S70. If a matching area is detected, the control device 104 makes a positive determination in step S80, classifies the target image into a group of images that are the basis of the template image, and does not reproduce the target image, step S90. Proceed to In step S90, the control device 104 sets a new template image based on the thumbnail image data of the target image and the focus area information, and returns to step S10. On the other hand, if no matching area is detected as a result of the template matching process in step S70, the control device 104 makes a negative determination in step S80, proceeds to step S30, and sets the target image in steps S30 to S50. Based on the template image setting and reproduction of the target image.

  The control device 104 ends the image reproduction process when an operation signal instructing the end of image reproduction is input from the operation member 101.

According to the embodiment described above, the following operational effects can be obtained.
(1) The camera 100 acquires a plurality of images, obtains thumbnail image data and focus area information corresponding to the images, and obtains thumbnail image data and focus area information corresponding to the acquired first image. A control device 104 for setting a template image based on the control, and a control for performing a template matching process on the thumbnail image data corresponding to the second image to be reproduced after the first image using the set template image When a region matching the template image is detected from the second image as a result of the processing performed by the device 104, the second image is not reproduced and the region matching the template image is detected from the second image. If not, the control device 10 reproduces the second image and displays it on the monitor 106. Therefore, it is possible to determine the similarity of the main subject reflecting the photographer's intention, and skip playback of the target image when images with similar main subjects continue (for example, in high-speed continuous shooting or panning) Therefore, it is possible to easily find a desired image in a short time. In addition, the image reproduction apparatus of the present embodiment can perform the above reproduction even when group information for specifying a group of images is not included in the image file. Furthermore, since the image reproduction apparatus according to the present embodiment performs the template matching process using the thumbnail image data, it can perform the process at high speed.

(2) In the camera 100 of (1), the control device 104 detects the thumbnail image data corresponding to the second image and the focus area information when a region matching the template image is detected from the second image. A new template image is set based on the second image, and template matching processing is performed on the thumbnail image data corresponding to the third image to be reproduced after the second image using the new template image. The third image is not reproduced when a region matching the template image is detected from the first image, and the third image is reproduced when the region matching the template image is not detected from the third image. Since it is configured to be displayed on the monitor 106, when an image with a similar main subject continues (for example, high-speed continuous shooting or sinking) And reproducing only first image in the case of Rinado) can skip the playback of subsequent images may be easier to find in a short time a desired image.

(3) In the camera 100 of (1) or (2), the control device 104, when no region matching the template image is detected from the second image, the thumbnail image corresponding to the second image. A new template image is set based on the data and focus area information, and template matching processing is performed on the thumbnail image data corresponding to the third image to be reproduced after the second image using the new template image. When the region that matches the new template image is detected from the third image, the third image is not reproduced, and the region that matches the new template image is not detected from the third image Since the third image is reproduced and displayed on the monitor 106, one template image is always displayed. Used may be performed template matching process, it is possible to perform processing at high speed.

(4) In the camera 100 of the above (1) to (3), the control device 104 is configured to set the peripheral area of the focus area indicated by the focus area information as the template image in the thumbnail image data. Compared with the case where is set as a template image, template matching processing can be performed at high speed.

(5) The camera 100 of the above (1) to (4) further includes an operation member 101, and the control device 104 monitors when an operation signal instructing reproduction of the next image is input from the operation member 101. A template matching process is performed on thumbnail image data corresponding to an image to be reproduced after the image currently displayed in 106, and an image in which an area matching the template image is not detected is reproduced instead of the image being displayed. Are displayed on the monitor 106. Since the camera 100 according to the present embodiment can perform high-speed processing as described above, even if the template matching processing and the playback processing are performed after the playback instruction for the next image in this way, the next time without giving the user a feeling of strangeness Can be played and displayed.

(Modification 1)
In the above-described embodiment, the case where images are reproduced one by one and displayed on the monitor 106 has been described. However, the present invention may be applied to a case where a plurality of images are displayed as thumbnails in a list.

  When the playback button is operated, the control device 104 according to the first modification displays a list of representative images of each group (that is, the first image and the image in which the region matching the template image is not detected in step S70). The image reproduction process of FIG. 5 is repeated until the number of sheets is reached. The control device 104 causes the monitor 106 to display a list of thumbnail image data of representative images of each group. Also in the first modification, as in the above-described embodiment, it is possible to easily find a desired image in a short time. In addition, the control device 104 may indicate the number of images included in each group in the vicinity of the representative image with a number or a picture when displaying the list.

(Modification 2)
In the above-described embodiment, the case where focus area information is added to image data in advance has been described. However, the present invention may be applied to a case where focus area information is not added to image data in advance.

  When the operation signal instructing the reproduction in the “no-focus reproduction mode” is input from the operation member 101, the control device 104 according to the second modification reads the image file of the target image from the memory card and adds the focus area information. It is determined whether or not. The control device 104 does not reproduce the target image when the focus area information is added, and reproduces and displays the target image on the monitor 106 when the focus area information is not added.

  After that, when an operation signal instructing reproduction of the next image is input from the operation member 101, the control device 104 reads the image file of the next target image from the memory card and adds the focus area information in the same manner as described above. The target image is reproduced and displayed on the monitor 106 only when it is not.

  If focus adjustment cannot be performed during shooting in the set focus area, focus area information is not added to the image data. Therefore, in the “no-focus reproduction mode”, many images out of focus are reproduced. Therefore, by playing back in the “no focus playback mode”, the user can easily find an image out of focus, and can delete the image by operating the delete button on the operation member 101. Further, when images out of focus are reproduced continuously, the user can operate the operation member 101 to continuously delete images out of focus. Further, the images reproduced in the “no-focus reproduction mode” may be collectively deleted by operating the operation member 101.

  However, there is a case where an image is not in focus even when the image is not added with focus area information. For example, in high-speed continuous shooting, focus area information may not be added to an image in the middle of continuous shooting. Therefore, during reproduction in the “no-focus reproduction mode”, when the user finds an image in focus, the focus area information may be set manually. In this case, the control device 104 adds focus area information corresponding to the operation signal from the operation member 101 to the image data being reproduced. By doing so, even an image to which focus area information has not been added in advance can be reproduced by the above-described image reproduction process (FIG. 5), and similar effects can be obtained.

  The control device 104 may automatically detect the focus area of the target image when the focus area information cannot be acquired from the image file of the target image in step S10 of the image reproduction process. In this case, for example, the control device 104 may perform a known contrast AF process on the target image to automatically detect the focus area. Further, for example, when the target image is an image taken by high-speed continuous shooting, the focus area may be detected with reference to the focus area in the images before and after the target image. Even if it does in this way, the effect similar to embodiment mentioned above can be acquired.

  When the focus area information cannot be acquired from the image file of the target image in step S10 of the image reproduction process, the control device 104 always makes an affirmative determination in step S80 so as not to reproduce the target image. May be. In addition, when a region matching the template image is not detected for the target image, only the target image may be reproduced without setting a template image based on the target image.

(Modification 3)
In the above-described embodiment, when the operation signal for instructing the reproduction of the next image is input from the operation member 101, the control device 104 reads the image file of the next image from the memory card. However, the control device 104 may read a predetermined number of images from the memory card in advance.

(Modification 4)
In the above-described embodiment, the case where a still image is reproduced and displayed has been described. However, the present invention may also be applied to the case where the first frame image (or thumbnail image) of each moving image is reproduced and displayed for a plurality of moving images so that the user can search for a desired moving image. In the case of the modified example 4, it is assumed that each moving image file includes thumbnail image data of each moving image and focus area information. The thumbnail image of each moving image is an image obtained by reducing the first frame image of each moving image, for example.

(Modification 5)
In the above-described embodiment, a case has been described in which a template image is set based on the image immediately before the target image and the template matching process is performed. However, the template matching process may be performed using a template image set based on the representative image of the most recent group (that is, the image currently reproduced) instead of the immediately preceding image. In this case, if a matching region is detected as a result of the template matching process in step S70, the control device 104 makes an affirmative determination in step S80 and then returns to step S10 without performing the process in step S90. . In the template matching process for the next target image, a template image that has already been set based on the representative image of the group is used. By doing so, the processing can be speeded up as much as the processing of step S90 is not performed.

(Modification 6)
In the embodiment described above, the case where the present invention is applied to a camera has been described. However, the present invention can also be applied to, for example, a personal computer or a portable terminal as an image reproducing apparatus that reads and reproduces image data.

  The above description is merely an example, and is not limited to the configuration of the above embodiment. Moreover, you may combine the structure of each modification suitably with the said embodiment.

DESCRIPTION OF SYMBOLS 100 ... Camera 101 ... Operation member 102 ... Imaging lens 103 ... Imaging element 104 ... Control apparatus 105 ... Memory card slot 106 ... Monitor

Claims (7)

Obtaining means for obtaining a plurality of images and obtaining thumbnail image data and focus area information corresponding to the images;
Setting means for setting a template image based on thumbnail image data and focus area information corresponding to the first image acquired by the acquisition means;
Matching for performing template matching processing using the template image set by the setting unit on the thumbnail image data acquired by the acquisition unit and corresponding to the second image to be reproduced after the first image Processing means;
As a result of the processing by the matching processing means, when a region matching the template image is detected from the second image, the second image is not reproduced and the template image and the template image are reproduced. Reproduction control means for reproducing the second image and displaying it on the display means when a matching area is not detected;
An image reproducing apparatus comprising: The image reproduction apparatus according to claim 1,
When a region matching the template image is detected from the second image,
The setting means sets a new template image based on thumbnail image data and focus area information corresponding to the second image,
The matching processing unit performs a template matching process using the new template image on the thumbnail image data corresponding to the third image to be reproduced after the second image acquired by the acquiring unit. Done
The reproduction control means does not reproduce the third image when a region matching the template image is detected from the third image, and detects a region matching the template image from the third image. If not, the third image is reproduced and displayed on the display means. The image reproduction apparatus according to claim 1 or 2,
If no region matching the template image is detected from the second image,
The setting means sets a new template image based on thumbnail image data and focus area information corresponding to the second image,
The matching processing unit performs a template matching process using the new template image on the thumbnail image data corresponding to the third image to be reproduced after the second image acquired by the acquiring unit. Done
The reproduction control means does not reproduce the third image when a region matching the new template image is detected from the third image, and matches the new template image from the third image. An image reproducing apparatus, wherein the third image is reproduced and displayed on a display means when no area to be detected is detected. In the image reproduction device according to any one of claims 1 to 3,
The image reproduction apparatus characterized in that the setting means sets a peripheral area of a focus area indicated by the focus area information as a template image in the thumbnail image data. In the image reproduction device according to any one of claims 1 to 4,
An operation member,
When an operation signal instructing reproduction of the next image is input from the operation member,
The matching processing means performs the template matching processing on thumbnail image data corresponding to an image to be reproduced later than an image being displayed on the display means,
The reproduction control means reproduces an image in which an area matching the template image has not been detected instead of the image being displayed, and displays the reproduced image on the display means. In the image reproduction device according to any one of claims 1 to 4,
The image reproduction apparatus characterized in that the reproduction control means reproduces thumbnail image data of a plurality of images in which an area matching the template image is not detected and displays the thumbnail image data in a list on a display means.   A camera provided with the image reproduction apparatus as described in any one of Claims 1-6.

Images