JP2010177731A - Image reproducing device and imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To minimize boredom felt by a user when a plurality of images are successively reproduced and displayed by the slide show function. <P>SOLUTION: An image reproducing device includes a storage means 31 storing a plurality of images, a display means 32 for displaying the images, a determining means 33 for determining whether or not image display is skipped about the plurality of images stored in the storage means 31, and a control means 34 that allows the display means 32 to successively reproduce and display the plurality of images while preventing images determined to be skipped by the determining means 33 out of the plurality of images stored in the storage means 31 from to be displayed by the display means 32. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image playback device that plays back and displays a plurality of captured images in a slide show format, and an imaging device such as a digital camera including the image playback device.

  As a function for browsing a plurality of captured images, a digital camera equipped with a slide show function for sequentially displaying these images on an image display monitor at regular intervals has been developed. In such a slide show function, a plurality of captured images often have similar images, and the user may feel frustrated if they are played back and displayed at regular time intervals without being distinguished. is there.

  As a conventional technique for suppressing this, the display interval of continuously shot images is performed at a time interval shorter than the display interval of a general image (Patent Document 1 below), and the similarity between a plurality of images In which the display interval of the image with high similarity is shortened (Patent Document 2 below), and the image is displayed at different time intervals depending on the type of image (Patent Document 3 below) Has been proposed.

  However, even if the display interval of a similar image is shortened, the similar image is repeatedly reproduced and displayed, and a failed image (for example, an exposure that is considered unnecessary to be displayed). (Failure image, camera shake image) and the like are also displayed, and thus the fatigue felt by the user cannot be sufficiently prevented.

  The present invention has been made in view of such a point, and an image reproducing device capable of minimizing the fatigue felt by the user when sequentially reproducing and displaying a plurality of images in a slide show format, And an imaging apparatus including the image reproduction apparatus.

JP 2006-41586 A JP 2006-246127 A JP 2007-174278 A

  The image reproduction apparatus according to the present invention displays an image of a storage means (31) storing a plurality of images, a display means (32) for displaying images, and a plurality of images stored in the storage means. Discriminating means (33) for discriminating whether or not to skip, and of the plurality of images stored in the storage means, images determined to be skipped by the discriminating means are excluded from display on the display means. And a control means (34) for sequentially reproducing and displaying the plurality of images on the display means.

  An image pickup apparatus according to the present invention includes an image pickup element that picks up an image of a subject by an optical system, and the above-described image reproduction apparatus according to the present invention.

  In the description of this section, reference numerals indicating members and the like shown in the drawings showing embodiments to be described later are appended with parentheses, but this is merely for ease of understanding, and each component of the present invention Is not limited by these symbols.

  In the present invention, for a plurality of stored images, it is determined whether or not image display should be skipped, and a plurality of images are sequentially reproduced and displayed while excluding images determined to be skipped. For example, by excluding similar images, failed images, etc., and reproducing and displaying only images that are considered to be highly necessary for the user, it is possible to minimize the fatigue felt by the user. it can.

It is a block diagram which shows schematic structure of the digital camera in embodiment of this invention. It is a figure which shows schematic structure of the image file in embodiment of this invention. It is a block diagram which shows the function structure of the image reproduction apparatus in embodiment of this invention. It is a flowchart which shows the initial setting process of the slide show execution condition in embodiment of this invention. It is a figure which shows the slide show mode selection menu in embodiment of this invention. It is a figure which shows the reproduction time selection menu in embodiment of this invention. It is a flowchart which shows the operation | movement at the time of slide show execution in embodiment of this invention. It is a flowchart which shows the image extraction process (subroutine of step S35 of FIG. 7) in the embodiment of the present invention. FIG. 9 is a flowchart showing a first processing example of the first extraction processing (subroutine of step S100 in FIG. 8) based on the luminance value in the embodiment of the present invention. It is a flowchart which shows the 2nd process example of the 1st extraction process (subroutine of FIG.8 S100) based on the luminance value in embodiment of this invention. It is a flowchart which shows the 3rd process example of the 1st extraction process (subroutine of FIG.8 S100) based on the luminance value in embodiment of this invention.

It is a figure which shows the event for demonstrating the effect of.
It is a flowchart which shows the 4th process example of the 1st extraction process (subroutine of FIG.8 S100) based on the luminance value in embodiment of this invention. It is a flowchart which shows the 5th process example of the 1st extraction process (subroutine of FIG.8 S100) based on the luminance value in embodiment of this invention. It is a flowchart which shows the 1st process example of the 2nd extraction process (subroutine of step S200 of FIG. 8) based on the color characteristic value in the embodiment of the present invention. It is a flowchart which shows the 2nd process example of the 2nd extraction process (subroutine of step S200 of FIG. 8) based on the color characteristic value in the embodiment of the present invention. It is a flowchart which shows the 3rd process example of the 2nd extraction process (subroutine of step S200 of FIG. 8) based on the color characteristic value in the embodiment of the present invention. It is a flowchart which shows the 4th example of a 2nd extraction process (subroutine of step S200 of FIG. 8) based on the color characteristic value in embodiment of this invention. It is a flowchart which shows the 5th example of a 2nd extraction process (subroutine of step S200 of FIG. 8) based on the color characteristic value in embodiment of this invention. It is a flowchart which shows the example based on the imaging | photography time information of the 3rd extraction process (subroutine of FIG.8 S300 of FIG. 8) based on the accompanying information in embodiment of this invention. It is a flowchart which shows the example based on the imaging | photography place information of the 3rd extraction process (subroutine of FIG.8 S300 of FIG. 8) based on the accompanying information in embodiment of this invention. It is a flowchart which shows the example which extracts the image of the standard value of the 4th extraction process (subroutine of step S400 of FIG. 8) in the bracketing imaging | photography mode in embodiment of this invention. It is a flowchart which shows the example in the case of extracting an image using the histogram of the 4th extraction process (subroutine of FIG.8 S400 of FIG. 8) in the bracketing imaging | photography mode in embodiment of this invention. It is a flowchart which shows the 5th extraction process (subroutine of FIG.8 S500) in the case of the continuous shooting mode in embodiment of this invention. It is a flowchart which shows the 6th extraction process (subroutine of FIG.8 S600) which excludes the unnecessary image in embodiment of this invention.

  Hereinafter, a digital camera including an image reproduction apparatus according to an embodiment of the present invention will be described with reference to the drawings.

[Overall camera configuration]
FIG. 1 is a block diagram showing the overall configuration of a digital camera according to an embodiment of the present invention. As shown in FIG. 1, the camera 1 includes a camera body 2 and a photographing lens 3 as an optical system. Here, the photographing lens 3 may be fixed to the camera body 2 or may be interchangeable.

  The camera body 2 is provided with a CPU 10, and the CPU 10 is connected to a system bus 11. The CPU 10 receives a signal output from each block to be described later and receives a control program (including a slide show display processing program to be described later) and various control data stored in the flash memory 12 connected to the system bus 11. Based on the above, a predetermined calculation is performed, and a control signal based on the calculation result is output to each block.

  An image sensor 14 is connected to the system bus 11 via a sensor drive circuit 13. In addition, an A / D conversion circuit 15, a timing generator (TG) 16, an image processing unit 17, a buffer memory 18, an image recording medium 19, and an operation unit 20 are connected to the system bus 11, respectively. Furthermore, an image display monitor (liquid crystal panel) 21 is connected to the system bus 11 via a display driving unit (not shown).

  The image sensor 14 is configured by a CCD, a CMOS, or the like, receives and captures light from a subject via the photographing lens 3, and outputs an image signal (analog signal as accumulated charge). The imaging signal output from the imaging device 14 is converted into a digital signal by the A / D conversion circuit 15 and sent to the image processing unit 17 via the system bus 11. The timing generator 16 outputs a timing signal for driving the image sensor 14 and a timing signal for driving the A / D conversion circuit 15.

  The image processing unit 17 is configured by an ASIC (Application Specific Integrated Circuit) or the like, performs image processing such as white balance (WB) adjustment, contour compensation, and gamma correction on the original image data that is a digital signal, and also performs predetermined processing. A compression process for compressing in a compression format (for example, JPEG) or a decompression process for compressed image data is performed.

  The buffer memory 18 is a memory that temporarily stores original image data, image data after image processing, and the like as a work area for processing by the CPU 10.

  The image recording medium 19 is a portable memory card composed of a flash memory or the like, and records image data (still image, moving image) on which compression processing has been performed together with predetermined accompanying information. The image recording medium 19 is replaceably mounted in a predetermined slot (not shown) provided in the camera body 2.

  The operation unit 20 is a release button that can be switched between half-press and full-press, a main switch for turning on / off the main power, a command dial, a menu button, an item selection cross key, an OK button (decision button), and a slide show. It includes a start button, buttons for selecting various shooting modes, etc., and the photographer operates these switches and buttons according to a predetermined procedure to select and set various modes in addition to shooting instructions. Switching, parameter selection and input, and other instructions associated with shooting can be performed.

  The image sent from the image processing unit 17, the image read from the buffer memory 18 or the image recording medium 19, information related to shooting, and the like are displayed on the image display monitor 21 via a display driving unit (not shown).

  The image display monitor 21 is provided on the back surface of the camera body 2, and in the live view display mode, an image being captured by the image sensor 14 is displayed on the image display monitor 21 in real time as a through image. The through image is a frame rate at which a predetermined thinning process is performed on the original image due to the relationship between the resolution of the image sensor 14 and the resolution of the image display monitor 21 so that it can be visually recognized as a moving image. It is an image that is displayed.

  When the release button (shooting instruction button) of the operation unit 20 is pressed by the photographer, the image processing unit 17 performs image processing (correction, compression, etc.) on the image data related to the captured image from the image sensor 14. As shown in FIG. 2, the CPU 10 adds predetermined accompanying information AD to the image data ID after the image processing, and sequentially increments the serial number as an image file DF in a format such as exif. The predetermined file name is recorded on the image storage medium 19.

  The accompanying information AD is information relating to photographing stored along with the image data. The accompanying information AD includes photographing time information (year / month / day / hour / minute / second) from a clock unit (not shown) included in the CPU 10, a GPS unit. Shooting location information (GPS information such as longitude and latitude, altitude, etc.) from (not shown), continuous shooting information indicating whether or not shooting was performed in continuous shooting mode, bracketing information indicating whether or not shooting was performed in bracketing shooting mode , Exposure information, shooting mode information (information identifying sports mode, portrait mode, etc.), editing information indicating that the image is the basis of image editing (processing), and the like are included as necessary.

[Functional structure of image playback device]
FIG. 3 is a block diagram showing a functional configuration of a slide show processing program for realizing the image reproduction apparatus according to the embodiment of the present invention. This image reproduction device IPA is realized by executing a slide show display processing program on a computer system.

  This slide show processing program includes an image storage unit (storage unit) 31 that stores a plurality of images, a display unit (display unit) 32 that displays images, and a plurality of images stored in the image storage unit 31. A determination unit (determination means) 33 for determining whether or not to skip the display of the image, and among the plurality of images stored in the image storage unit 31, an image determined to be skipped by the determination unit 33 is displayed on the display unit 32. A control unit (control unit) 34 that sequentially reproduces and displays a plurality of images on the display unit 32, and a data storage unit (memory) 35 that stores various data are excluded. It is configured.

  Although not shown in the slide show display processing program, if necessary, a face recognition unit (face recognition means) that automatically recognizes an area where a person's face is present in an image or between a plurality of images. A subject tracking unit (subject tracking means) that automatically recognizes the movement of the predetermined subject may be provided. In addition to the processing described above, the control unit 34 also performs processing for managing the program as a whole.

  Here, the slide show display processing program is stored in advance in the flash memory 12 of the camera 1 described above, and the CPU 10 reads out and executes the program, thereby realizing a slide show function by the image reproducing apparatus. . Therefore, the image storage unit 31 corresponds to the image recording medium 19 described above, the display unit 32 corresponds to the image display monitor 21 described above, and a part of the flash memory 12 is used as the data storage unit 35.

[Initial setting of slide show execution conditions]
FIG. 4 is a flowchart showing the initial setting process of the slide show execution condition in the embodiment of the present invention.

  In the initial setting process, a slide show mode selection menu (slide show initial setting screen) as a sub menu is selected on the main menu screen displayed on the image display monitor 21 by pressing the menu button of the operation unit 20. Start with.

  When the slide show mode selection menu is displayed, it is first determined whether or not the automatic selection mode (automatic selection image display mode) has been selected (step S10). This determination is made according to a user setting operation in the slide show mode selection menu. The slide show mode selection menu includes, for example, as shown in FIG. 5, “all image display mode” and “selected image slide show mode”, and the “selected image slide show mode” further includes “manual selected image display mode”. , And a menu (screen) including “automatically selected image display mode”.

  Here, the “all image display mode” is a mode in which all images stored in the image storage unit 31 or all images in a specific holder are displayed as a slide show. “Manually selected image display mode” of “selected image slideshow mode” is a method for manually selecting (manually) a plurality of images used for a slideshow from a plurality of images stored in the image storage unit 31, and selecting the selected images. Is a mode for displaying a slide show. The “automatically selected image display mode” is a mode in which a plurality of images used for the slide show are automatically selected from a plurality of images stored in the image storage unit 31, and determined as unnecessary according to the determination result by the determination unit 33. In this mode, a slide show display is performed while skipping (excluding) the images as appropriate.

  In various menu screens, for example, a cursor for selecting an item (mode, etc.) is displayed as indicated by a downward black triangle mark in FIG. By operating the cross key of the operation unit 20 in the up / down direction (and in some cases, in the left / right direction), each item can be moved up and down (and in some cases, left / right) in the screen.

  The user can input and set item selection settings and various numerical values by pressing the OK button of the operation unit 20 in accordance with the position of the character string of the item to be selected. In FIG. 5, the cursor is set to “automatically selected image display mode”, and by pressing the OK button in this state, the automatically selected image display mode can be selected and set.

  In FIG. 5, the character string of the item for which the cursor is set is highlighted (may be displayed in reverse or in different colors) so that the cursor position can be determined more intuitively.

  If it is determined in step S10 that the automatic selection mode has been selected (in the case of Y), the automatic selection image display mode is set (step S13), and if it is determined that the automatic selection mode has not been selected (N In the case), according to the user's operation in the slide show mode selection menu, the full image display mode or the manually selected image display mode is set (step S15). This mode setting is specifically performed by writing a value corresponding to the mode in the corresponding flag.

  Next, it is determined whether or not the total playback time and the playback time per image have been selected (step S17). Here, the “total playback time” is a preset display time of the entire slide show, that is, the time from the start of the display of the first image to the end of the display of the last image. The “reproduction time per image” is a preset display time per image, that is, from the start of display of one image to the end of the display (display of the next image). Time to start).

  The determination in step S17 is made according to the user's operation on the playback time selection menu. For example, as shown in FIG. 6, the playback time selection menu includes “1 second”, “3 seconds”, “5 seconds”, “8 seconds”, “10 seconds” as the playback time per image. , And “custom”, and the total playback time of the slide show is “1 minute”, “3 minutes”, “5 minutes”, “8 minutes”, “10 minutes”, “15 minutes”, “20 minutes” ”,“ 30 minutes ”,“ custom ”, and“ no limit ”.

  The user operates the cross key of the operation unit 20 to select one for the reproduction time per image and one for the total reproduction time of the slide show, and select the corresponding item by pressing the OK button. Can be set. FIG. 6 shows an example in which “3 seconds” is selected as the playback time per image and “5 minutes” is selected as the total playback time of the slide show. In this setting, as a rule, 100 images are displayed as a slide show.

  In FIG. 6, items appended with “(AUTO)” (items of “3 seconds” and “no restriction”) indicate default values. That is, when the user skips (omits) the setting operation here, it indicates that the conditions are automatically set on the apparatus side. Further, “no restriction” means that the slide show display is continued until all the images extracted for the slide show are reproduced. Furthermore, when “custom” is selected, the user can set an arbitrary time. For example, “playback time per image” can be set in units of one second from 1 second to 59 seconds. The “total slide show playback time” can be set in increments of 1 minute from 1 minute to 59 minutes.

  If it is determined in step S17 that the total playback time and playback time per image have not been selected (in the case of N), the process waits until selection is made, and if it is determined that the selection has been made (Y In the case of (1), “total playback time” and “playback time per image” selected in each menu, and “slide show mode information” are stored in the memory 35. Here, if the initial setting screen is ended without any selection operation by the user, the “automatically selected image display mode” is automatically determined, and the condition of “AUTO” is added to the playback time. Items are automatically determined and stored in the memory 35.

[Operation during slide show execution]
FIG. 7 is a flowchart showing the operation at the time of executing the slide show in the embodiment of the present invention. This process starts when the user turns on (ON) the slide show start button of the operation unit 20.

  First, the slide show execution conditions (slide show mode, total playback time, playback time per image) set in the initial setting flow (FIG. 4) are read from the memory 35 (step S31). Next, it is determined whether or not the mode is the automatic selection image display mode (step S33). If it is determined that the mode is the automatic selection image display mode (in the case of Y), an extraction process for automatically extracting slide show images is performed ( Step S35). This step S35 is a step of automatically extracting a slide show image by any one of a plurality of subroutines to be described later, or some or all of them.

  Next, it is determined whether there is a total playback time setting (step S37). If it is determined that there is a total playback time setting (in the case of Y), the process proceeds to step S39.

  In step S39, whether or not the image (extracted image) extracted in step S35 is within the total playback time based on the playback time per image, that is, the number of extracted images is the total playback time and one image. It is determined whether or not the number of displayable images obtained from the per-playback time is exceeded.

  In step S39, when it is determined that the extracted images are within the total reproduction time, that is, the number of displayable images is not exceeded (in the case of Y), the extracted images are arranged in the order of photographing time with the set reproduction time per image. If all the images to be displayed are reproduced and displayed sequentially, the slide show is terminated (step S41).

  In step S41, the respective reproduction times for each image are set by the ratio of the photographing intervals based on the photographing time difference, that is, the total reproduction time is set according to the ratio of the photographing intervals based on the photographing times related to the respective images. Images may be displayed at the allocated display time intervals.

  If it is determined in step S39 that the extracted image does not fit within the total playback time, that is, the number of displayable images is exceeded (in the case of N), an extraction condition (threshold) described later used in step S35 is changed (step S35). S43), the process returns to step S35. The loop of steps S35, S37, S39, and S43 is repeated while changing the extraction conditions in step S43 until all the extracted images are displayed within the total playback time.

  In steps S39 and S41, when a plurality of subject images that move in the continuous shooting mode are extracted in step S35 (details will be described later), for these images, the continuous shooting interval (for example, 0.2 seconds) in the continuous shooting mode. ), It may be considered to switch and display continuous shot images at the same display interval.

  In steps S39 and S41, when a plurality of subject images moving in the continuous shooting mode are extracted in step S35 (details will be described later), images (thumbnail images) obtained by reducing a plurality of images related to the subject moving in the continuous shooting mode are extracted. The images may be arranged vertically and horizontally on one screen and displayed as one image. The thumbnail image may be displayed using the thumbnail image when the thumbnail image is set in the accompanying information AD of the image file DF.

  If it is determined in step S37 that the total playback time is not set, that is, if “no limit (AUTO)” is selected as the item of the total playback time (in the case of N), one set image is set. Each extracted image is sequentially reproduced and displayed in the order of the photographing time with the corresponding reproduction time, and when all the images are reproduced, the slide show is ended (step S45).

  If it is determined in step S33 that the mode is not the automatic selection image display mode, that is, if it is determined that the mode is the all-image slide show mode or the manual selection mode (in the case of N), it is determined whether there is a total playback time setting. If it is determined that there is a total playback time setting (in the case of Y), each extracted image should be sequentially played back and displayed in the order of the shooting time in the set playback time per image. If all the images have been reproduced, the slide show ends (step S51). In this case, when the set total playback time has elapsed, the slide show is terminated even if unplayed images remain.

  In step S51, the reproduction time for each image is set by the ratio of the photographing intervals based on the photographing time difference, that is, the total reproduction time is set according to the ratio of the photographing intervals based on the photographing times related to the respective images. Images may be displayed at the allocated display time intervals.

  If it is determined in step S47 that the total playback time has not been set (in the case of N), each image is sequentially played back in the order of shooting time with the set playback time per image, and all images to be displayed are displayed. If it has been reproduced, the slide show is terminated (step S53).

  The image file DF includes additional information AD, such as various shooting modes (for example, a sports mode used when shooting a sports scene with a sense of speed, a port used when taking a photo with a slightly blurred background and a person being highlighted) When shooting mode information related to (rate mode) is recorded, the display unit 32 follows the shooting mode information included in the accompanying information AD when a plurality of images are displayed as a slide show in steps S41, S45, S51, or S53. The display method displayed on the screen may be changed. As a display method, for example, a display method that provides an effect of turning a page of a book or an album in the sport mode, a display method that provides an effect of fading in / out for each image in the portrait mode, etc. can do.

[Image extraction processing]
FIG. 8 is a flowchart showing image extraction processing (subroutine of step S35 of FIG. 7) in the embodiment of the present invention.

  This image extraction process includes a first extraction process (step S100) based on luminance values of a current image that is an image scheduled to be reproduced and a previous image that is an image scheduled to be reproduced before the current image, Second extraction process (step S200) based on color characteristic values with the previous image, third extraction process (step S300) based on accompanying information (shooting time information, shooting location information), and fourth extraction in bracketing shooting mode The process (step S400), the fifth extraction process in the continuous shooting mode (step S500), and the sixth extraction process (step S600) for removing inappropriate images are configured.

  In FIG. 8, the first extraction process to the sixth extraction process (steps S100 to S600) are all executed in this order, but the order of execution is not limited to this order. Only one of them may be executed, or two or more may be executed in combination.

[First Extraction Processing Based on Luminance Value (Step S100)]
(First processing example of first extraction processing)
FIG. 9 is a flowchart showing a first processing example of the first extraction processing (subroutine of step S100 in FIG. 8) based on the luminance value in the embodiment of the present invention. Here, it is assumed that the YCbCr (YUV) color system is used as the color space (color system) of the image data ID in the image file DF. Here, Y is a luminance value, Cb (U) is a color characteristic value (blue color difference), and Cr (V) is a color characteristic value (red color difference). Here, the Y value is used as the luminance value. The feature amount is calculated.

  In the first processing example of the first extraction process, a feature amount related to similarity is calculated using a luminance value (Y value) based on the current image and the previous image, and the feature amount is calculated using a predetermined threshold value related to the luminance value. Compared with (first threshold value), if the feature amount is less than the threshold value, the current image is determined as a non-extracted image to be skipped from the slide show display, and if the feature amount is greater than or equal to the threshold value, a slide show is performed. This is a process for discriminating an extracted image to be displayed.

  Here, the reading of the image from the image storage unit 31 is sequentially performed in the order of the photographing time, and all or part of the accompanying information AD is also read as necessary. The context of the shooting time when reading an image is based on the shooting time information in the accompanying information AD, the creation time (year / month / day / hour / minute / second) of the image file DF, or the number included in the file name of the image file DF. Can be recognized. Here, the previous image is an image scheduled to be played back immediately before the current image, but is not limited to the image scheduled to be played back immediately before, and is an image scheduled to be played before the previous image. There may be.

  When this process is started, first, current image data (image data related to the current image) is read from the image storage unit 31 (step S110). That is, the position of the pixel in the X direction (horizontal direction) of the current image is x (x = 1, 2,..., M), and the position of the pixel in the Y direction (vertical direction) of the current image is y (y = 1, 2). ,..., N) are read into the two-dimensional array f (x, y), and the luminance values (Y values) for the corresponding pixels are read. Here, since the feature amount is calculated using only the luminance value (Y value), only the Y value is read. However, the Cb value as the color characteristic value and / or the Cr value as the color characteristic value are used. You may make it read simultaneously. When this process is started and step S110 is executed for the first time, the image data with the earliest shooting time in the image storage unit 31 is read.

  Next, similarly, the previous image data (image data related to the previous image) is read from the image storage unit 31 (step S120). That is, the position of the pixel in the X direction (horizontal direction) of the previous image is x (x = 1, 2,..., M), and the position of the pixel in the Y direction (vertical direction) of the previous image is y (y = 1, 2). ,..., N) are read into the two-dimensional array g (x, y) corresponding to the respective luminance values (Y values). Here, since the feature amount is calculated using only the luminance value (Y value), only the Y value is read. However, the Cb value as the color characteristic value and / or the Cr value as the color characteristic value are used. Similar to the case of the current image, it may be read at the same time. Note that when this process is started and step S120 is executed for the first time, there is no image whose shooting time is earlier than the image read in step S110, so that no data is read and the array g (x, It is assumed that all y) are default values (for example, the minimum luminance value or the maximum luminance value).

  Next, an integrated value of absolute values of differences in luminance values (Y values) is calculated as a feature amount (step S130). That is, the feature value is obtained by sequentially adding the absolute value of f (x, y) -g (x, y) for all pixels (all regions) to the work variable dsum related to the feature value.

  Next, it is determined whether or not the feature amount dsum is less than a threshold th1 preset as a predetermined threshold (step S140). If it is less than the threshold (in the case of Y), display of the current image is performed. A numerical value “0” indicating non-display (non-extraction) is set in the flag flg1 (step S150), and if it is equal to or greater than the threshold (in the case of N), display (extraction) is displayed in the display flag flg1 for the current image. A numerical value “1” is set (step S160).

  The threshold value defines the range of similarity between the current image and the previous image. If a relatively large value is used as the threshold value, the range of similarity can be increased, and the threshold value can be relatively large. If a small value is used, the similarity range can be reduced. As this threshold value, an appropriate value is used in relation to the content of the feature amount used for similarity determination (here, the luminance value), and a preset fixed value is used here.

  However, this threshold value may be changed stepwise or continuously by a predetermined setting operation using the operation unit 20 by the user. Further, this threshold value may be automatically and dynamically changed based on a value obtained by statistically processing past discrimination results. As an example, if a certain amount of past history of discrimination results (extracted or not extracted) is kept, and if the discrimination result with non-extraction (with similarity) continues for a long time, the threshold value will be smaller When the determination result of extraction (no similarity) continues for a long time, the threshold value can be changed to a larger value. In this embodiment, as described above, in step S43 in FIG. 7, the number of extracted images is dynamically changed so that the number of extracted images is within the displayable number determined by the relationship between the reproduction time per image and the total reproduction time. Like to do.

  Thereafter, it is determined whether or not the image is the final image (step S170). If it is determined that the image is not the final image (in the case of N), the process returns to step S110 to sequentially set the next image as the current image and the immediately preceding current image. The same process is repeated (steps S110 to S170), and when it is determined that the image is the final image (in the case of Y), this process ends and the process returns to FIG.

  In this process, only the luminance value (Y value) is used for the calculation of the feature amount used for the similarity determination. However, the Cb value and / or the Cr value as the color characteristic value are similarly described. The integrated value of the difference between the current image and the previous image may be calculated, and the similarity may be determined using the result of comparing these values with a preset threshold corresponding to the calculated value. In this case, if any one of these luminance values and color characteristic values is determined to be similar, it may be determined as similar as a whole, or all of these luminance values and color characteristic values may be determined. May be determined as similar as a whole. Similarity may be determined based on only the color characteristic value (Cb value and / or Cr value), not the combination of the luminance value (Y value) and the color characteristic value (Cb value and / or Cr value). good. The same applies to the second to fifth processing examples of the first extraction processing described later.

(Second processing example of first extraction processing)
FIG. 10 is a flowchart showing a second processing example of the first extraction processing (subroutine of step S100 in FIG. 8) based on the luminance value in the embodiment of the present invention. Note that steps substantially the same as those in FIG. 9 are denoted by the same reference numerals, and a part of the description is omitted.

  In the first processing example of the first extraction process described above, as the feature value related to the luminance value, a difference is obtained for each pixel corresponding to each other with respect to the entire current image (all regions) and the entire previous image (all regions), What integrated these was used. On the other hand, in the second processing example of the first extraction process, a difference is taken for each pixel corresponding to a specific area in the entire area of the current image and a specific area in the entire area of the previous image. Thus, the sum of these is used. The position of the specific area of the current image and the position of the specific area of the previous image may be positions corresponding to each other or different positions.

  A specific area in the entire area of the image may be set by the user using the operation unit 20, but here, a face recognition unit using a well-known face recognition technique is provided to provide the image. An area related to the face of a person existing inside is automatically extracted, and the area related to the face is set as a specific area.

  That is, in FIG. 10, after the current image is read (step S110) and the previous image is read (step S120), either the current image or the previous image (here, the current image) A face detection process for detecting the region is performed (step S121).

  Next, it is determined whether the pixel (x, y) to be processed exists inside or outside the face area (area) (step S122), and the pixels existing inside the face area are determined. (In the case of Y), the integration process is performed in step S130, and for pixels existing outside (in the case of N), the process proceeds to step S140 without executing step S130.

  Next, it is determined whether or not the feature amount dsum is less than a predetermined threshold th2 set as a predetermined threshold (first threshold) (step S140). If it is less than the threshold (in the case of Y), A numerical value “0” indicating non-display (non-extraction) is set to the display flag flg1 for the current image (step S150), and if it is equal to or greater than the threshold (in the case of N), the display flag flg1 for the current image is set. A numerical value “1” indicating display (extraction) is set (step S160).

  Here, the luminance value difference accumulation process (step S130) is performed for a specific area related to the human face detected by the face detection process for the current image and a specific area corresponding to this in the previous image. Contrary to this, on the contrary, the integration of the luminance value difference between the specific area related to the face of the person detected by the face detection process for the previous image and the specific area corresponding to this of the current image Processing (step S130) may be performed.

  Further, the specific area of the current image and the specific area of the previous image do not need to correspond to each other (match), and face detection processing (step S121) is performed between the current image and the previous image. ) Are separately performed, and a luminance value difference accumulation process (step S130) is performed for the specific area detected by the face detection process for the current image and the specific area detected by the face detection process for the previous image. You may do it.

  In this way, in this process, the area related to the human face in the image is set as a specific area, and the integrated value of the luminance value difference is calculated for the specific area. When the same or similar face exists, even if the background is different, the display of the current image is skipped in the slide show display.

  In contrast to this, an area other than the area related to the face of the person in the image may be set as the specific area, and an integrated value of the difference between the luminance values may be taken. In this case, if the background is the same or similar, the display of the current image is skipped even if the faces of persons in the image are different. The user uses the operation unit 20 to determine whether the area related to the human face in the image is the specific area or whether the area other than the area related to the human face (area related to the background) is the specific area. The selection may be made according to a selection operation performed in advance.

  Here, the current image should be skipped when the face is the same or similar regardless of the size of the area related to the face of the person in the image (ratio to the entire image) (non-extraction). If the current image is not similar, it is determined that the current image should not be skipped (extraction), but the size of the area related to the face is related to the size of the predetermined specific area (area related to the face). If the area related to the face is smaller than the threshold value compared to a predetermined threshold value (second threshold value), even if it is determined that the display of the current image should not be skipped, the current image May be skipped.

  Furthermore, here, the specific area is an area related to the face of the person in the image or an area other than the area related to the face of the person, but it is not an area of the person's face, but an area of animals, automobiles, buildings, other things, etc. May be detected, and this region or other regions may be set as the specific region.

(Third processing example of the first extraction processing)
FIG. 11 is a flowchart showing a third processing example of the first extraction processing (subroutine of step S100 in FIG. 8) based on the luminance value in the embodiment of the present invention. Note that steps substantially the same as those in FIG. 9 are denoted by the same reference numerals, and a part of the description is omitted.

  In the first processing example of the first extraction process described above, the feature values are calculated using the luminance values of the current image and the previous image as they are. On the other hand, in the second modified example, the luminance values (post-process luminance values) obtained by performing differential filter processing on the luminance values (pre-process luminance values) of the read current image and the previous image are different. The integrated value is calculated. In addition, as a differential filter, although a Laplacian filter (Laplace filter) can be illustrated, it is not limited to this.

  That is, after reading the current image f (x, y) in step S110, the current image is subjected to Laplacian filter processing to obtain an image f ′ (x, y) (step S111). In step S120, the previous image g ( After reading x, y), the previous image is subjected to Laplacian filter processing to obtain an image g ′ (x, y) (step S123). In step S131, dsum + = | f ′ (x, y) −g '(X, y) | is calculated and compared with a threshold th3 as a predetermined threshold (first threshold) regarding the luminance value after the Laplacian filter processing. The rest is the same as the first processing example of FIG.

  The differential filter process is applied to the above-described second processing example (FIG. 10), and after the differential filter process is performed on a specific region related to a human face or the like in the image, an integrated value of the difference is calculated. You may do it.

  Also, the size of the area related to the face of the person in the image (ratio to the entire image) is compared with a predetermined threshold (second threshold) relating to the size of the predetermined specific area (area related to the face). Thus, when the area related to the face is smaller than the threshold value, the display of the current image may be skipped even when it is determined that the display of the current image should not be skipped.

(Fourth processing example of the first extraction processing)
FIG. 12 is a flowchart showing a fourth processing example of the first extraction processing (subroutine of step S100 in FIG. 8) based on the luminance value in the embodiment of the present invention. In addition, about the step substantially the same as FIG. 9 or FIG. 11, the same code | symbol is attached | subjected and the one part description is abbreviate | omitted.

  In the first processing example of the first extraction process described above, the feature values are calculated using the luminance values of the current image and the previous image as they are. On the other hand, in the fourth processing example, the luminance values (post-process luminance values) obtained by frequency-converting the luminance values (pre-process luminance values) of the read current image and the previous image are different. The integrated value is calculated. In addition, as a frequency conversion process, although a DCT (discrete cosine transform) filter process can be illustrated, it is not limited to this.

  That is, after reading the current image f (x, y) in step S110, the current image is subjected to DCT filter processing to obtain an image f ′ (x, y) (step S112), and in step S120, the previous image g ( After reading x, y), the previous image is subjected to DCT filter processing to obtain an image g ′ (x, y) (step S124). In step S131, dsum + = | f ′ (x, y) −g '(X, y) | is calculated and compared with a threshold th4 as a predetermined threshold (first threshold) regarding the luminance value after the DCT filter processing. The rest is the same as the first processing example in FIG. 9 or the third processing example in FIG. 11.

  Note that the DCT filter process is applied to the above-described second process example (FIG. 10), the DCT filter process is performed on a specific region related to a human face or the like in the image, and an integrated value of the difference is calculated. You may do it.

  Also, the size of the area related to the face of the person in the image (ratio to the entire image) is compared with a predetermined threshold (second threshold) relating to the size of the predetermined specific area (area related to the face). Thus, when the area related to the face is smaller than the threshold value, the display of the current image may be skipped even when it is determined that the display of the current image should not be skipped.

(Fifth processing example of first extraction processing)
FIG. 13 is a flowchart showing a fifth processing example of the first extraction processing (subroutine of step S100 in FIG. 8) based on the luminance value in the embodiment of the present invention. Note that steps substantially the same as those in FIG. 9 are denoted by the same reference numerals, and a part of the description is omitted.

  In the first processing example of the first extraction process described above, an integrated value of differences in luminance values of pixels corresponding to each of the current image and the previous image is used as a feature amount, and this is compared with a predetermined threshold value for determination. ing. On the other hand, in the fifth processing example, the read current image and the previous image are equally divided into a plurality of corresponding divided areas (divided areas), and each divided area of the current image and the previous image is divided. The difference in the appearance frequency of the luminance value is used as a feature amount, and this is compared with a predetermined threshold value relating to the distribution state of the luminance value. In other words, the similarity (distribution shape) of the luminance distribution state for each divided region between the two images is determined by the template matching method.

  That is, after the current image f (x, y) is read in step S110 and the previous image g (x, y) is read in step S120, a division process for dividing the image into a predetermined size is performed (step S125). ). Here, the image division processing is to divide the number of pixels m in the horizontal direction (X direction) of the image (all areas) into a and the number of pixels n in the vertical direction (Y direction) into b, and m ′ = In this example, m / a and n ′ = n / b are used as a plurality (a × b) of divided regions each including pixels m ′ × n ′. As an example, the size m ′ × n ′ of the divided regions can be 8 × 8, 16 × 16, 32 × 32,.

  Next, matching is performed for each divided region corresponding to the position between both images (step S132). That is, the absolute values of the differences between the luminance values in one divided region f (x ′, y ′) in the current image and one divided region g (x ′, y ′) in the previous image are sequentially integrated. The integrated value dsum is obtained, and this is performed for all combinations of a plurality of divided areas in the current image and a plurality of divided areas in the previous image. Accordingly, (a × b) × (a × b) integrated values dsum are calculated.

  Next, the coordinates of the position where dsum is smallest and the coordinates of the original position of the template are integrated (dx + = Δx, dy + = Δy). Here, the position coordinates are coordinates on the XY coordinate system on the captured image. Thereafter, the coordinate integrated value dx is compared with the predetermined threshold th5 and the coordinate integrated value dy is compared with the predetermined threshold th6 (step S141), the coordinate integrated value dx is less than the threshold th5, and the coordinate integrated value is obtained. When the value dy is less than the threshold th6 (in the case of Y), a numerical value “1” indicating display (extraction) is set to the display flag flg1 for the current image (step S150), and the coordinate integrated value dx is the threshold value. If it is greater than or equal to th5, or if the coordinate integrated value dy is greater than or equal to the threshold th6 (in the case of N), a numerical value “0” indicating non-display (non-extraction) is set in the display flag flg1 for the current image ( In step S160, it is determined whether the image is the final image (step S170).

[Second Extraction Process Based on Color Characteristic Value (Step S200)]
The first to fifth processing examples of the second extraction process based on the color characteristic values described below correspond to the first to fifth processing examples of the first extraction process based on the luminance value described above, respectively. Part of it. That is, in the first extraction process described above, the luminance value (Y value) of the image data expressed in the YCbCr color system is used in principle for calculating the feature amount. In the second extraction process, the image file DF is used. The difference is that the RGB color system is used as the color space (color system) of the image data ID. Here, R is red (wavelength 700 nm) as a color characteristic value, G is green (wavelength 546.1 nm) as a color characteristic value, and B is blue (wavelength 435.8 nm) as a color characteristic value.

(First processing example of second extraction processing)
FIG. 14 is a flowchart showing a first processing example of the second extraction processing (subroutine of step S200 in FIG. 8) based on the color characteristic values in the embodiment of the present invention. In the first processing example of the second extraction process, a feature quantity related to similarity is calculated using color characteristic values (R value, G value, B value) based on the current image and the previous image, and the feature quantity is calculated. Is compared with a predetermined threshold value (first threshold value) for the color characteristic value, and when the feature amount is less than the threshold value, the current image is determined as a non-extracted image to be skipped from the slide show display, and the feature amount is This is a process for discriminating an extracted image to be displayed as a slide show when the threshold is exceeded.

  When this processing is started, first, current image data (image data relating to the current image) is read from the image storage unit 31 (step S210). That is, the position of the pixel in the X direction (horizontal direction) of the current image is x (x = 1, 2,..., M), and the position of the pixel in the Y direction (vertical direction) of the current image is y (y = 1, 2). ,..., N) are read into the two-dimensional array f (x, y), and the luminance values (Y values) for the corresponding pixels are read. Note that, here, all color characteristic values (R value, G value, B value) are read as the characteristic amount is calculated using all color characteristic values (R value, G value, B value). However, at least one of these may be read.

  The other steps are the same as in the first processing example of the first extraction processing for the luminance values shown in FIG. 9, and thus substantially the same steps are denoted by the same reference numerals and description thereof is omitted. .

  In this process, since the color characteristic values (R value, G value, B value) are used for calculating the feature quantity used for similarity determination, the feature quantity is calculated for each color characteristic value. The similarity is determined by comparing with a preset threshold value corresponding to each. In this case, if any one of these color characteristic values is determined to be similar, it may be determined to be similar as a whole, or if two of these are determined to be similar, It may be determined that they are similar, or when all of these are determined to be similar, they may be determined to be similar as a whole. Further, similarity may be determined using at least one of these three color characteristic values. The same applies to the second to fifth processing examples of the second extraction process described below.

(Second processing example of second extraction processing)
FIG. 15 is a flowchart showing a second processing example of the second extraction processing (subroutine of step S200 in FIG. 8) based on the color characteristic values in the embodiment of the present invention. In Steps S210 and S220, color characteristic values (R value, G value, B value) are read as the current image and the previous image, feature values are calculated based on these color characteristic values, and threshold values relating to the color characteristic values are calculated. Are the same as the second processing example of the first extraction processing described with reference to FIG. 10 described above, and thus substantially the same steps are denoted by the same reference numerals. The description is omitted.

(Third processing example of second extraction processing)
FIG. 16 is a flowchart showing a third processing example of the second extraction processing (subroutine of step S200 of FIG. 8) based on the color characteristic values in the embodiment of the present invention. In steps S210 and S220, color characteristic values (R value, G value, B value) are read as the current image and the previous image, and feature values are calculated based on the color characteristic values according to the differential filter processing. Since it is the same as the third processing example of the first extraction processing described with reference to FIG. 11 described above except that the comparison with the threshold value regarding the color characteristic value subjected to the differential filter processing is performed, it is substantially the same. These steps are denoted by the same reference numerals and description thereof is omitted.

(Fourth processing example of second extraction processing)
FIG. 17 is a flowchart showing a fourth processing example of the second extraction processing (subroutine of step S200 of FIG. 8) based on the color characteristic values in the embodiment of the present invention. In Steps S210 and S220, color characteristic values (R value, G value, B value) are read as the current image and the previous image, and feature amounts are calculated based on the color characteristic values related to those obtained by frequency conversion processing. Since it is the same as the fourth processing example of the first extraction process described above with reference to FIG. 12 except that a comparison with a threshold value regarding the color characteristic value subjected to the frequency conversion process is performed, it is substantially the same. These steps are denoted by the same reference numerals and description thereof is omitted.

(Fourth modification of the second extraction process)
FIG. 18 is a flowchart showing a fifth processing example of the second extraction processing (subroutine of step S200 in FIG. 8) based on the color characteristic values in the embodiment of the present invention. In steps S210 and S220, the first extraction process described with reference to FIG. 13 described above is performed except that color characteristic values (R value, G value, B value) are read as the current image and the previous image. Since it is the same as 5 processing examples, the same code | symbol is attached | subjected to the substantially same step, and the description is abbreviate | omitted.

[Third extraction process based on accompanying information (step S300)]
(Example based on shooting time information)
FIG. 19 is a flowchart showing an example based on the photographing time information of the third extraction process (subroutine of step S300 in FIG. 8) based on the accompanying information in the embodiment of the present invention.

  In the example based on the shooting time information of the third extraction process, the difference (shooting time difference) between the shooting time information of the accompanying information of the current image and the shooting time information of the accompanying information of the previous image is related to similarity. The feature amount is compared with a predetermined threshold value (first threshold value) related to the shooting time difference, and when the feature amount is equal to or less than the threshold value, the current image is determined as a non-extracted image to be skipped from the slide show display. Then, when the feature amount exceeds the threshold value, it is a process of discriminating the extracted image to be displayed as a slide show.

  Here, it is assumed that reading of images from the image storage unit 31 is sequentially performed in order of shooting time, and at least shooting time information is read from the accompanying information AD.

  When this processing is started, first, the current image data (image data related to the current image) is read from the image storage unit 31 as image 1 including its accompanying information (shooting time information) (step S311). When this processing is started and step S311 is executed for the first time, the image data with the earliest shooting time in the image storage unit 31 is read.

  Next, similarly, the previous image data (image data related to the previous image) is read from the image storage unit 31 as image2 including its accompanying information (shooting time information) (step S312). When this process is started and step S312 is executed for the first time, there is no image whose shooting time is earlier than that of the image read in step S311. Therefore, data is not read and image2 and its shooting time are not read. Information is assumed to be a default value.

  Next, a photographing time difference (diff) that is a difference between the photographing time information of the original image image1 and the photographing time information of the previous image image2 is obtained (step S313). It is determined whether or not the shooting time difference diff exceeds a threshold th7 set in advance as a predetermined threshold (first threshold) relating to the shooting time difference (step S314). Then, a numerical value “1” indicating display (extraction) is set in the display flag flg1 for the current image (step S315), and if it is equal to or less than the threshold value (in the case of N), the display flag flg1 for the current image is not set. A numerical value “0” indicating display (non-extraction) is set (step S316).

  It should be noted that if the difference in shooting time between the current image and the previous image is short, it is considered that there is a high probability that similar shooting has been performed. Conversely, if the difference in shooting time is long, different shooting is performed. The threshold is set to an appropriate value from this viewpoint. Here, a fixed value set in advance is used as the threshold value, but it may be changed stepwise or continuously by a predetermined setting operation using the operation unit 20 by the user. .

  Further, this threshold value may be automatically and dynamically changed based on a value obtained by statistically processing past discrimination results. As an example, keep a certain amount of past history of discrimination results (extracted, non-extracted), and if the discrimination result with non-extraction continues for a long time, change the threshold to a smaller value and extract When the determination result is continued for a long time, the threshold value can be changed to a larger value. In this embodiment, as described above, in step S43 in FIG. 7, the number of extracted images is dynamically changed so that the number of extracted images is within the displayable number determined by the relationship between the reproduction time per image and the total reproduction time. Like to do.

  Thereafter, it is determined whether or not the image is the final image (step S317). If it is determined that the image is not the final image (in the case of N), the process returns to step S311 to sequentially set the next image as the current image and the previous current image. Is repeated as a previous image (steps S311 to S317), and when it is determined that the image is the final image (in the case of Y), this process is terminated and the process returns to FIG.

(Example based on shooting location information)
FIG. 20 is a flowchart showing an example based on the shooting location information of the third extraction process (subroutine of step S300 of FIG. 8) based on the accompanying information in the embodiment of the present invention.

  An example based on the shooting location information of the third extraction process is a difference between shooting location information (eg, longitude and latitude as GPS information) in the accompanying information of the current image and shooting location information in the accompanying information of the previous image ( (Shooting location difference) is used as a feature amount related to similarity, and the feature amount is compared with a predetermined threshold value (first threshold value) relating to the shooting location difference. If the feature amount is equal to or less than the threshold value, the current image is displayed as a slideshow. This is a process for discriminating from the display a non-extracted image to be skipped and discriminating it as an extracted image to be displayed as a slide show when the feature amount exceeds the threshold.

  Here, it is assumed that reading of images from the image storage unit 31 is sequentially performed in order of shooting time, and at least shooting location information is read from the accompanying information AD. However, the reading of the image from the image storage unit 31 is not performed in the order of the photographing times, but based on a specific point (for example, based on the place of the one with the earliest photographing time) as the photographing place information of each image. You may make it carry out in an order from the thing with the shortest linear distance calculated | required based on.

  When this process is started, first, the current image data (image data relating to the current image) is read from the image storage unit 31 as image 1 and its accompanying information (shooting location information) is read (step S321). When this process is started and step S321 is executed for the first time, the image data with the earliest shooting time in the image storage unit 31 is read.

  Next, similarly, the previous image data (image data related to the previous image) is read from the image storage unit 31 as image2 including its accompanying information (shooting location information) (step S322). When this process is started and step S322 is executed for the first time, there is no image whose shooting time is earlier than that of the image read in step S321, so data is not read and image2 and its shooting location It is assumed that the information has a predetermined default value.

  Next, a shooting location difference (diff), which is the difference between the shooting location information of the original image image1 and the shooting location information of the previous image image2, is obtained (step S323). It is determined whether or not the shooting location difference diff exceeds a threshold th8 set in advance as a predetermined threshold relating to the shooting location difference (step S324). If this threshold is exceeded (in the case of Y), the current image is detected. A numerical value “1” indicating display (extraction) is set in the display flag flg1 (step S325), and if it is equal to or less than the threshold value (in the case of N), it is not displayed (not extracted) in the display flag flg1 for the current image. A numerical value “0” is set (step S326).

  It should be noted that if the difference in shooting location between the current image and the previous image is small, it is considered that there is a high probability that similar shooting has been performed. Conversely, if the difference in shooting location is large, different shooting is performed. The threshold is set to an appropriate value from this viewpoint. Here, a fixed value set in advance is used as the threshold value, but it may be changed stepwise or continuously by a predetermined setting operation using the operation unit 20 by the user. .

  Further, this threshold value may be automatically and dynamically changed based on a value obtained by statistically processing past discrimination results. As an example, keep a certain amount of past history of discrimination results (extracted, non-extracted), and if the discrimination result with non-extraction continues for a long time, change the threshold to a smaller value and extract When the determination result is continued for a long time, the threshold value can be changed to a larger value. In this embodiment, as described above, in step S43 in FIG. 7, the number of extracted images is dynamically changed so that the number of extracted images is within the displayable number determined by the relationship between the reproduction time per image and the total reproduction time. Like to do.

  Thereafter, it is determined whether or not the image is the final image (step S327). If it is determined that the image is not the final image (in the case of N), the process returns to step S321 to sequentially set the next image as the current image and the previous current image. Is repeated as a previous image (steps S321 to S327), and when it is determined that the image is the final image (in the case of Y), this process ends and the process returns to FIG.

[Fourth Extraction Processing in Auto Bracketing Shooting Mode (Step S400)]
The auto bracketing shooting mode is a shooting mode for continuously recording a plurality of images of the same subject while gradually changing various shooting parameters (shooting conditions). The shooting parameters are not particularly limited, but examples include exposure and white balance. For exposure bracketing shooting mode, the number of images recorded by bracketing shooting is, for example, one standard, one correction on the plus side, one correction, and one correction on the minus side, for a total of three images. Generally, 1 sheet is standard, 1 sheet is corrected to the plus side, 1 sheet is corrected, 2 sheets is corrected to the plus side, 1 sheet is corrected, 1 sheet is corrected to the minus side, 1 sheet is corrected, and 2 sheets are aligned to the minus side. It may be corrected to a total of 5 sheets.

  When recorded in the auto bracketing shooting mode, bracketing information is added to the image file as accompanying information of the image data. The bracketing information includes information indicating that the image was shot in the bracketing shooting mode, information indicating the type of shooting parameters used for bracketing (exposure, white balance, etc.), and correction values for shooting parameters used for bracketing ( Information indicating a numerical value or the number of steps), information for associating images of an image group captured by bracketing, and the like are set.

  When shooting in the bracketing shooting mode, the user operates the operation unit 20 to perform a predetermined setting operation, thereby performing bracketing shooting for a desired shooting parameter. The correction value of the shooting parameter, the number of images to be recorded in one bracketing shooting, and the like may be changed and set by the user operating the operation unit 20 and performing a predetermined setting operation. .

  In the bracketing shooting mode, recording is normally performed a predetermined number of times (for example, three times) while automatically changing shooting parameters in one release (shooting instruction). However, recording may be performed while automatically changing the shooting parameters for each release. Some of these are appropriately determined for each shooting parameter, or can be set in advance by a user setting operation.

  As an example, in exposure bracketing, a total of three images are taken and recorded continuously, one with standard exposure, one with exposure adjusted to the plus side, and one with exposure adjusted to the minus side. In white balance bracketing, after one image is taken, three images are recorded with different white balance. Considering the slide show display of a plurality of bracketed images, it may be considered sufficient that only one of the images (a plurality of images captured by one bracketing) is reproduced. is there. Therefore, in this embodiment, when an image is shot in the bracketing shooting mode, it is determined that one image selected according to a predetermined selection condition from images shot in the bracketing mode should not be skipped and displayed. It is determined as a power extraction image, and the remaining images (the other two images) are determined to be skipped and are set as non-extraction images that should not be displayed.

(Example of extraction using standard values)
FIG. 21 is a flowchart showing an example of extracting an image of a standard value in the fourth extraction process (subroutine of step S400 in FIG. 8) in the bracketing shooting mode according to the embodiment of the present invention.

  Here, in order to simplify the description, it is assumed that an image group composed of three images photographed in an auto exposure bracketing (AEB) photographing mode is a processing target. Further, as a predetermined selection condition, an image with optimum exposure is extracted, and an image with standard exposure (exposure correction value “0”) is regarded as an image with optimum exposure. In addition, it is assumed that reading of images from the image storage unit 31 is sequentially performed in order of shooting time, and at least bracketing information is read from the accompanying information AD.

  When this process is started, first, the current image data (image data related to the current image) is read from the image storage unit 31 as image 1 including its accompanying information (bracketing information) (step S411). When this process is started and step S411 is executed for the first time, the image data with the earliest shooting time in the image storage unit 31 is read.

  Next, it is determined whether or not the current image image1 is an image shot in the auto exposure bracketing shooting mode (step S412). This determination is made based on information indicating whether or not the image has been subjected to auto-exposure bracketing shooting, which is set in the bracketing information of the current image. If it is determined in step S412 that the current image is an image shot in the auto exposure bracketing shooting mode (in the case of Y), the process proceeds to step S413, and it is determined that the current image is not an image shot in the auto exposure bracketing shooting mode. If so (N), the process proceeds to step S17.

  Next, the current image image1 and other images forming the image group related to the bracketing shooting are read as image2 and image3 (step S413). In step S410, the pointer used for reading the image is incremented by the number of images read in step S413 (here, two).

  Next, it is determined whether or not the exposure correction value is “0” for each of the images image1, image2 and image3 constituting the image group (step S414). This determination is made based on the setting of information indicating the correction value (numerical value or number of steps, etc.) of the shooting parameter used for bracketing in the bracketing information for each image. For an image determined to be Y in step S414 (an image whose exposure correction value is determined to be “0”), a numerical value “1” indicating display (extraction) is set in the display flag flg1 for the image in step S415. For the image determined to be N in step S414 (the image for which the exposure correction value is determined not to be “0”), the numerical value “0” indicating non-display (non-extraction) in the display flag flg1 for the image in step S416. "Is set.

  Thereafter, in step S417, it is determined whether or not the image is the final image. If it is determined that the image is not the final image (in the case of N), the process returns to step S411 to sequentially read the original image (the image is read in step S413). In this case, the next image after the last read image) is set as the current image, and the same processing is repeated (steps S411 to S417). When it is determined that the image is the final image (in the case of Y), this processing is performed. When finished, return to FIG.

  It should be noted that here, an image photographed with the standard exposure (standard value) should be displayed as an optimum exposure image, an extracted image to be displayed, and an image photographed with the exposure value corrected to the plus side or the minus side should be displayed. The image corrected with the positive correction value is set as the extracted image to be displayed, or the image corrected with the negative correction value is set as the extracted image to be displayed. These images may be non-extracted images. Which of the images related to the standard exposure, the plus side correction, and the minus side correction is used as the extracted image may be arbitrarily set by the user performing a predetermined setting operation using the operation unit 20.

(Example of extraction using a histogram)
An example of extraction using the histogram of the fourth extraction process is an extracted image to be displayed by determining that one image selected according to a predetermined selection condition from images taken in the bracketing mode should not be skipped. This is a process of determining that the remaining image should be skipped and making it a non-extracted image that should not be displayed.

  FIG. 22 is a flowchart showing an example of extracting an image using the histogram of the fourth extraction process (subroutine of step S400 in FIG. 8) in the bracketing shooting mode according to the embodiment of the present invention.

  Here, in order to simplify the description, it is assumed that an image group composed of three images photographed in an auto exposure bracketing (AEB) photographing mode is a processing target. As a predetermined selection condition, an image with optimum exposure is extracted. In addition, it is assumed that reading of images from the image storage unit 31 is sequentially performed in order of shooting time, and at least bracketing information is read from the accompanying information AD. In the example (FIG. 21) in which the image is extracted using the standard value described above, the image with the standard exposure (exposure correction value “0”) is extracted as the optimal exposure image. The difference is that a histogram distribution is obtained for each of the images constituting the image, and the image having the largest distribution is extracted as an image with optimum exposure.

  When this process is started, first, the current image data (image data related to the current image) is read from the image storage unit 31 as image1 including the accompanying information (bracketing information) (step S421). When this process is started and step S421 is executed for the first time, the image data with the earliest shooting time in the image storage unit 31 is read.

  Next, it is determined whether or not the current image image1 is an image shot in the auto exposure bracketing shooting mode (step S422). This determination is made based on information indicating whether or not the image has been subjected to auto-exposure bracketing shooting, which is set in the bracketing information of the current image. If it is determined in step S422 that the current image is an image shot in the auto exposure bracketing shooting mode (in the case of Y), the process proceeds to step S423, and it is determined that the current image is not an image shot in the auto exposure bracketing shooting mode. If so (N), the process proceeds to step S428.

  Next, the current image image1 and other images forming the image group related to the bracketing shooting are read as image2 and image3 (step S423). In step S423, the pointer used for reading the image is incremented by the number of images read in step S423 (here, two).

  Next, for each of the images image1, image2, and image3 constituting the image group, a histogram distribution (diff) relating to the luminance value is obtained (step S424). Here, it is assumed that the YCbCr (YUV) color system is used as the color space (color system) of the image data ID in the image file DF relating to the image. The histogram relating to the luminance value is, for example, a frequency distribution diagram in which the Y value as the luminance value of the YCbCr color system is expressed on the horizontal axis and the frequency (appearance frequency) on the vertical axis. The distribution is its variance or standard deviation.

  Next, it is determined whether or not each image has the largest diff value (step S425). For an image determined to be Y in step S425 (an image determined to have the largest diff), a numerical value “1” indicating display (extraction) is set in the display flag flg1 for the image in step S426, and in step S425. For an image determined to be N (an image other than an image determined to have the largest diff), a numerical value “0” indicating non-display (non-extraction) is set in the display flag flg1 for the image in step S427. .

  Thereafter, in step S428, it is determined whether or not the image is the final image. If it is determined that the image is not the final image (in the case of N), the process returns to step S421 and sequentially the original image (the image is read in step S423). In this case, the next image after the last read image) is used as the current image, and the same processing is repeated (steps S421 to S428). If it is determined that the image is the final image (in the case of Y), this processing is performed. When finished, return to FIG.

  Although the case where the Y value as the luminance value is used as the histogram has been exemplified, a Cb value or a Cr value as a color characteristic value, or a combination thereof may be used.

  Further, although the histogram is obtained for the entire area of each image, it may be obtained for a specific area that is a part of the entire area. In this case, the above processing is performed with the area related to the face of the person recognized by the face recognition means automatically recognizing the face of the person in the image as the specific area, and one image related to the optimal exposure should not be skipped May be extracted.

  Furthermore, the size of the area related to the face of the person in the image (ratio to the entire image) is compared with a predetermined threshold (second threshold) relating to the size of the specific area (area related to the face) set in advance. Thus, when the area related to the face is smaller than the threshold value, the display of the current image may be skipped even when it is determined that the display of the current image should not be skipped.

[Fifth Extraction Processing in Continuous Shooting Mode (Step S500)]
The fifth extraction process (step S500 in FIG. 8) in the continuous shooting mode is a process when shooting is performed in the continuous shooting mode in which a plurality of images are continuously captured at a predetermined shooting interval. Here, in the case of shooting in the continuous shooting mode, continuous shooting information is added as the accompanying information of the image data in the image file. As the continuous shooting information, information indicating that the image is shot in the continuous shooting mode, information for associating the images of the group of images shot in the continuous shooting mode, and the like are set.

  For a plurality of images shot in continuous shooting mode, if the main subject in the image is stationary, one (or several) of the continuous shots is displayed as a slide show. On the contrary, if the main subject is moving, it is considered that there is a demand to display the entire movement.

  Therefore, in the fifth extraction process, it is recognized that the movement of a predetermined subject between the plurality of images is recognized by the subject tracking unit, and the subject tracking is performed between the plurality of images taken in the continuous shooting mode. When it is recognized by the means, it is determined that one of the plurality of images recognized as still should not be skipped, and an extracted image to be used for a slide show display, and the remaining images should be skipped And a non-extracted image that should not be used for the slide show display.

  Further, when the subject tracking means recognizes that the subject is moving between a plurality of images taken in the continuous shooting mode, it is determined that all images recognized as moving should not be skipped. Thus, an extracted image to be used for slide show display is used. By this process, even if it is determined that it is a non-extracted image that should not be used for the slide show display by executing any one or more of the first extraction process to the fourth extraction process described above, continuous shooting is performed and the subject moves. If so, all the images are determined as extracted images to be used for slide show display.

  As a technique for detecting the movement of the main subject, a known technique such as subject tracking can be used. For example, the template matching process using the template image is performed for the previous image and the current image, respectively, and the movement amount of the region matched with the template image is calculated.

  Here, the template image is image data that serves as a reference for template matching processing, and uses a single or a plurality of template images registered in advance by performing a predetermined registration operation. An arbitrary image can be registered as the template image. For example, a human face or the like can be used as the template image. However, the template image is not limited to one registered in advance, and for example, a template image that is dynamically set without performing a registration operation using a known technique such as face recognition for identifying a human face in the image. It may be used.

  When template matching processing is performed, for each of the previous image and the current image, it is detected whether or not there is a matching region that matches the template image in the image (target image). Is detected, and the difference between the positions is set as the movement amount. In addition, as template matching processing, well-known methods, such as a cross-correlation method and a residual sequential test method, can be used, for example.

  Specifically, in the template matching process, a rectangular frame for matching with the template image is set as a target area in the target image, and the position of the target area is moved by a predetermined amount within the target image, for example, by one pixel. Then, the similarity between the image in the target area and the template image at each position is calculated. As a result of performing the template matching process on the entire target image, the position of the region (matching region) having the highest similarity with the template image in the target region is set as the matching result. The difference between the position of the matching area for the previous image and the position of the matching area for the current image is taken as a movement amount, and the presence or absence of movement is determined by comparison with a predetermined threshold relating to the movement amount.

  The detection of the movement of the main subject is not limited to the template matching process, and for example, the movement detection process of the subject as described in JP-A-2000-59699 is applied. May be.

  FIG. 23 is a flowchart showing a fifth extraction process (subroutine of step S500 in FIG. 8) in the continuous shooting mode in the embodiment of the present invention. It is assumed that reading of images from the image storage unit 31 is sequentially performed in order of shooting time, and nine images are shot in the continuous shooting mode.

  When this process is started, first, the current image data (image data related to the current image) is read from the image storage unit 31 as image1 including the accompanying information (continuous shooting information) (step S510). When this process is started and step S510 is executed for the first time, the image data with the earliest shooting time in the image storage unit 31 is read.

  Next, it is determined whether or not the current image image1 is an image shot in the continuous shooting mode (step S520). This determination is made based on continuous shooting information indicating whether or not the current image was shot in the continuous shooting mode. If it is determined in step S520 that the current image is an image shot in the continuous shooting mode (in the case of Y), the process proceeds to step S530, and if it is determined that the current image is not an image shot in the continuous shooting mode (in the case of N) ), The process proceeds to step S580.

  Next, other images forming the group of images related to the current image image1 and continuous shooting are read as image2, image3,..., Image9 (step S530). In step S510, the pointer used for reading the image is incremented by the number of images read in step S530 (here, eight).

  Next, among the images image1 to image9 constituting the image group, for the two predetermined images (for example, the first image and the last image in continuous shooting), the main subject is stopped by the subject tracking unit described above. It is determined whether or not there is (step S540). Here, for the sake of simplicity, it is determined between the first and last two images whether or not the subject is stationary, but it is determined between three or more images that are appropriately selected. Anyway. It is also possible to determine all of two images that are adjacent to each other, and determine whether the image is totally stationary or moving from the overall determination result.

  When it is determined in step S540 that the subject is stationary (in the case of Y), only the first image (image1) of continuous shooting is a numerical value indicating display (extraction) in the display flag flg1 of the image. “1” is set, and a numerical value “0” indicating non-display (non-extraction) is set to the display flag flg1 for the remaining images (image2 to image9) (step S550). Here, only the first image is an extracted image that should be displayed as a slide show, and the remaining images are all non-extracted images that should not be displayed as a slide show. However, instead of the first image, the last image or One intermediate image may be used as the extracted image. Further, the number of images to be extracted images is not limited to one, and may be two or more. When two or more images are extracted images, for example, it is preferable to select the images intermittently so that the first image image1, the intermediate image image5, and the last image image9 are extracted images.

  If it is determined in step S540 that the subject is not stationary, that is, is moving (in the case of N), a numerical value “1” indicating display (extraction) is displayed on the display flag flg1 for all the images image1 to image9. It sets (step S570).

  Next, in step S570, it is determined whether or not the image is the final image. If it is determined that the image is not the final image (in the case of N), the process returns to step S510 to sequentially read the original image (the image is read in step S530). In this case, the next image after the last read image) is used as the current image, and the same processing is repeated (steps S510 to S580). If it is determined that the image is the final image (in the case of Y), this processing is performed. When finished, return to FIG.

[Sixth Extraction Processing for Eliminating Unnecessary Images (Step S600)]
FIG. 24 is a flowchart showing a sixth extraction process (subroutine of step S600 in FIG. 8) for eliminating unnecessary images in the embodiment of the present invention.

  In the sixth extraction process for eliminating the unnecessary image, when the image is edited (processed) and the original image and the edited image exist, the original image, the over-exposed (over-exposed), or the under-exposed ( Exclusion of images that are considered unnecessary for slide show display such as underexposure improperly exposed images and hand shake images is performed. It is assumed that reading of images from the image storage unit 31 is sequentially performed in order of shooting time.

  When this process is started, first, the current image data is read from the image storage unit 31 as image 1 including its accompanying information (editing information) (step S610). When this process is started and step S610 is executed for the first time, the image data with the earliest shooting time in the image storage unit 31 is read.

  Next, it is determined whether or not the current image image1 is an image (editing source image) that is the source of editing (processing) (step S620). This determination is made based on the editing information set in the accompanying information of the current image. If it is determined in step S620 that the current image is an editing source image (Y), the process proceeds to step S630. If it is determined that the current image is not an edited image (unedited image) (N), The process proceeds to step S660.

  Next, it is determined whether or not the current image image1 is a camera shake image (step S630). This determination is made by analyzing the current image. If it is determined in step S630 that the image is a camera shake image (in the case of Y), the process proceeds to step S640. If it is determined that the image is not a camera shake image (in the case of N), the process proceeds to step S660.

  Next, it is determined whether or not the current image image1 is an inappropriate exposure image (step S640). This determination is made by analyzing the current image. An improperly exposed image is an image that is overexposed (overexposed) or underexposed (underexposed), and is determined, for example, by comparing the ratio of the white-out or black-out portion in the image with a predetermined threshold. be able to. If it is determined in step S640 that the image is an inappropriate exposure image (in the case of Y), the process proceeds to step S650. If it is determined that the image is not an inappropriate exposure image (in the case of N), the process proceeds to step S660.

  Next, in step S650, a numerical value “0” indicating non-display (non-extraction) is set in the display flag flg1 for the current image, and in step S660, a numerical value “1” indicating display (extraction) in the display flag flg1 for the image. "Is set.

  Thereafter, in step S670, it is determined whether or not the image is the final image. If it is determined that the image is not the final image (in the case of N), the process returns to step S610 to sequentially set the next image of the original image as the current image. The same processing is repeated (steps S610 to S670), and when it is determined that the image is the final image (in the case of Y), this processing ends and the process returns to FIG.

  Here, whether or not the image is an inappropriate exposure image is assumed to be performed for the entire area of the current image. However, the above-described face recognition unit determines a specific area related to the human face in the current image. Also good.

  The digital camera to which the image reproducing apparatus according to the present invention can be applied may be a compact digital camera, a single-lens reflex digital camera, or other digital cameras. Further, the present invention is not limited to a device generally called a camera, and can be applied to any electronic device having a mobile phone, a PDA, and other imaging functions. Further, in addition to being applied to such a digital camera or the like, it can be configured as an image reproducing apparatus alone, and the above-described image file (including image data and accompanying information) stored in the storage unit is the target of processing. It can be realized by causing a dedicated or general-purpose personal computer or the like to execute a program similar to the slide show display processing program, and does not necessarily have an imaging function.

  The embodiment described above is described for facilitating understanding of the present invention, and is not described for limiting the present invention. Therefore, each element disclosed in the above embodiment includes all design changes and equivalents belonging to the technical scope of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Digital camera, 2 ... Camera body, 3 ... Shooting lens, 10 ... CPU, 11 ... System bus, 12 ... Flash memory, 13 ... Sensor drive circuit, 14 ... Image sensor, 15 ... A / D conversion circuit, 16 ... Timing generator, 17 ... image processing unit, 18 ... buffer memory, 19 ... image recording medium, 20 ... operation unit, 21 ... image display monitor, 31 ... image storage unit, 32 ... display unit, 33 ... discrimination unit, 34 ... control 35, data storage unit, DF, image file.

Claims (24)

Storage means for storing a plurality of images;
Display means for displaying an image;
A discriminating unit for discriminating whether or not to skip the display of the images for the plurality of images stored in the storage unit;
Out of the plurality of images stored in the storage unit, the image determined to be skipped by the determination unit is excluded from the display on the display unit, and the plurality of images are sequentially reproduced on the display unit. Control means to display;
An image reproducing apparatus comprising:   The determination means calculates a feature amount related to similarity based on a current image scheduled to be reproduced and a previous image scheduled to be reproduced before the current image, and compares the feature amount with a predetermined first threshold value. The image reproducing apparatus according to claim 1, wherein the determination is performed.   3. The image according to claim 2, wherein the feature amount is an integrated value of a difference in luminance value or color characteristic value for the entire region of the current image and the previous image or a specific region therein. Playback device.   The feature amount is an integrated value of a difference in luminance value or color characteristic value for the entire region of the image obtained by differential filtering each of the current image and the previous image, or a specific region therein. The image reproducing device according to claim 2, wherein The storage means stores the shooting time information of each image accompanying the plurality of stored images.
The image reproducing apparatus according to claim 2, wherein the feature amount is a difference in shooting time between the current image and the previous image.   The said control means displays an image by the display time interval which allocated the preset total reproduction time according to the ratio of the imaging interval based on the said imaging | photography time which concerns on each image, It is characterized by the above-mentioned. Image playback device.   The feature amount is a difference in the distribution state of the appearance frequency of the luminance value or the color characteristic value in the entire region of the current image and the previous image or a specific region in the region. The image reproducing device described in 1.   The feature amount is an integrated value of a difference in luminance value or color characteristic value for an entire area of the image obtained by converting the current image and the previous image into frequency components, respectively, or a specific area therein. The image reproducing apparatus according to claim 2, wherein: A face recognition means for automatically recognizing a person's face in the image;
The determination unit performs the determination using the region related to the face of the person recognized by the face recognition unit or a region other than the region related to the face as the specific region. The image reproducing device according to any one of the above.   The control unit determines that the determination unit should not skip the display of the image when the area related to the face of the person recognized by the face recognition unit is smaller than a predetermined second threshold value. The image reproduction apparatus according to claim 9, wherein even when the image is displayed, the display of the image is skipped. The plurality of images stored in the storage means include information indicating whether or not the images are shot in a bracketing mode in which a plurality of shootings are continuously performed while changing shooting conditions,
The determining means determines that one image selected according to a predetermined selection condition from the plurality of images taken in the bracketing mode should not be skipped, and determines that the remaining image should be skipped. The image reproducing apparatus according to claim 1, wherein   When the photographing condition is exposure, the determination unit selects one image related to optimum exposure as an image that should not be skipped from the plurality of images photographed in the bracketing mode. The image reproducing device according to claim 11. A face recognition means for automatically recognizing a person's face in the image;
13. The image reproduction according to claim 12, wherein the determination unit selects one image related to the optimal exposure as an image that should not be skipped for the region related to the face of the person recognized by the face recognition unit. apparatus. Subject tracking means for automatically recognizing movement of a predetermined subject between a plurality of images;
The plurality of images stored in the storage unit includes information indicating whether or not the images are captured in a continuous shooting mode in which a plurality of images are continuously captured at a predetermined shooting interval,
The discriminating means, when the subject tracking means recognizes that the subject is stationary between a plurality of images taken in the continuous shooting mode, the plurality of images recognized as stationary. The image reproducing apparatus according to claim 1, wherein it is determined that one of the images should not be skipped and the remaining image is determined to be skipped. Subject tracking means for automatically recognizing movement of a predetermined subject between a plurality of images;
The plurality of images stored in the storage unit includes information indicating whether or not the images are captured in a continuous shooting mode in which a plurality of images are continuously captured at a predetermined shooting interval,
The discriminating unit skips all images recognized as moving when the subject tracking unit recognizes that the subject is moving between a plurality of images taken in the continuous shooting mode. The image reproducing apparatus according to claim 1, wherein it is determined that it should not be performed.   16. The control unit according to claim 15, wherein the control unit displays a plurality of images recognized as the subject moving by the subject tracking unit at a display time interval substantially the same as the predetermined shooting interval. Image playback device.   The control means reduces a plurality of images recognized by the subject tracking means as moving the subject, and arranges them vertically and horizontally, and displays them as one image on the display means. 15. The image reproducing device according to 15. The storage means accompanies each of the plurality of stored images and stores the shooting location information thereof.
The image reproducing apparatus according to claim 2, wherein the feature amount is a distance between shooting locations of the current image and the previous image.   When the number of images stored in the storage means exceeds the number of displayable images obtained from the preset total reproduction time and reproduction time per image, the control means skips the excess number of images. The image reproducing apparatus according to claim 2, wherein the first threshold value is changed as described above. The plurality of images stored in the storage means include information on a shooting mode used at the time of shooting among a plurality of types of shooting modes,
The image reproduction device according to claim 1, wherein the control unit changes a display method when the image is displayed on the display unit according to the shooting mode.   Even if the control means is an image determined not to be skipped by the determination means, if the entire image or a specific area in the image is an overexposed, underexposed, or camera shake image, 21. The image reproducing apparatus according to claim 1, wherein the image is skipped. A face recognition means for automatically recognizing a person's face in the image;
The image reproduction apparatus according to claim 21, wherein the control unit sets a region related to the face of the person recognized by the face recognition unit as the specific region.   2. The determination unit according to claim 1, wherein the determination unit determines that the current image should be skipped when the current image scheduled to be reproduced is the image of the editing source that is the basis of the editing. Image playback device. An image sensor for capturing an image of a subject by an optical system;
An image reproduction device according to any one of claims 1 to 23;
An imaging apparatus comprising:

Images