JP2010263352A - Image processing program and camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing program which selects a suitable representative image even if there is no operation history information based on the user operation. <P>SOLUTION: The image processing program makes a computer perform: classification processing which classifies a plurality of images into groups for every predetermined period based on the photography day of each image; first extraction processing which extracts, for each period, a plurality of images representing each period from the groups classified by the classification processing based on the degree of user value of an image in the group; second extraction processing which extracts, for each period, one representative image representing each period from a plurality of images extracted by the first extraction processing based on the degree of image evaluation of the plurality of images; and photographing history information generation processing which generates the photographing history information by associating the information indicating each period, the representative image corresponding to the period, and the information about the representative image of the period. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing program and a camera equipped with the program.

  A technique for preferentially displaying images representing a plurality of images is known (see Patent Document 1).

JP 2006-157778 A

  In the prior art, images with a large number of browsing or printing operations are preferentially displayed based on operation history information such as browsing and printing, so if there is no operation history information by user operation, an appropriate representative image is selected. It was difficult.

  An image processing program according to the present invention includes a classification process for classifying a plurality of images into groups for each predetermined period based on the shooting date of each image, and a user value of an image in the group from the group classified by the classification process. A first extraction process for extracting a plurality of images representing periods based on the degree for each period, and a plurality of images extracted by the first extraction process based on the image evaluation degree of the plurality of images. A second extraction process for extracting one representative image for each period, information indicating the period for each period, a representative image corresponding to the period, and imaging related to the representative image for the period The imaging history information generation process for generating history information is executed by a computer.

  According to the present invention, an appropriate representative image can be selected without the operation history information based on the user operation.

It is a block diagram explaining the structural example of the electronic camera by one Embodiment of this invention. It is a flowchart explaining the flow of the production | generation process of imaging | photography history information. It is a flowchart explaining the detail of the extraction process of a representative image. It is a rear view of an electronic camera. It is a figure explaining registration photography. It is a figure which illustrates a digest display. It is a figure which illustrates a digest display. It is a figure which illustrates a digest display. It is a figure which illustrates a digest display. It is a figure which illustrates the operation menu screen. It is a flowchart explaining the flow of a digest display process. It is a figure explaining the modification 2. FIG. It is a figure which illustrates a computer apparatus.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration example of an electronic camera 1 according to an embodiment of the present invention. In FIG. 1, an electronic camera 1 includes a photographing optical system 11, an image sensor 12, an AFE (Analog front end) circuit 13, an image processing circuit 14, a speaker drive circuit 15, a speaker 16, and an LCD monitor 17. RAM 18, flash memory 19, CPU 20, memory card interface (I / F) 21, power supply control circuit 22, operation member 23, and GPS device 25.

  The CPU 20, RAM 18, flash memory 19, memory card interface 21, power supply control circuit 22, image processing circuit 14, speaker drive circuit 15, LCD monitor 17, and GPS device 25 are connected via a bus 24.

  The photographing optical system 11 includes a plurality of lens groups including a zoom lens and a focusing lens, and forms a subject image on the light receiving surface of the image sensor 12. In order to simplify FIG. 1, the photographing optical system 11 is shown as a single lens.

  The image sensor 12 is configured by a CCD image sensor, a CMOS image sensor, or the like in which light receiving elements are two-dimensionally arranged on the light receiving surface. The image sensor 12 photoelectrically converts a subject image by a light beam that has passed through the photographing optical system 11 to generate an analog image signal. The analog image signal is input to the AFE circuit 13.

  The AFE circuit 13 performs analog processing such as correlated double sampling and gain adjustment on the analog image signal, and converts the image signal after the analog processing into digital image data. The digital image data is input to the image processing circuit 14. The image processing circuit 14 performs various types of image processing (color interpolation processing, gradation conversion processing, contour enhancement processing, white balance adjustment processing, image compression processing, image expansion processing, etc.) on the digital image data.

  The speaker drive circuit 15 generates a sound reproduction signal such as an operation sound, music, a voice message, and the like based on the sound data sent from the CPU 20. The speaker 16 performs audio reproduction based on the audio reproduction signal.

  The LCD monitor 17 is composed of a liquid crystal panel, and displays an image, an operation menu screen, and the like according to an instruction from the CPU 20. The RAM 18 is used as a work memory for the CPU 20. The RAM 18 temporarily stores digital image data in the pre-process and post-process of image processing by the image processing circuit 14. The flash memory 19 stores a program to be executed by the CPU 20.

  The CPU 20 comprehensively controls operations performed by the electronic camera 1 by executing a program stored in the flash memory 19. The CPU 20 also performs AF (autofocus) operation control and automatic exposure (AE) calculation. The AF operation uses, for example, a contrast detection method for obtaining a focus position of a focusing lens (not shown) based on contrast information of a through image. The through image refers to a monitor image that is repeatedly acquired by the image sensor 12 at a predetermined time interval (for example, 30 frames / second) before a shooting instruction.

  The memory card interface 21 has a connector (not shown), and a storage medium 51 such as a memory card is connected to the connector. The memory card interface 21 writes data to the connected storage medium 51 and reads data from the storage medium 51. The storage medium 51 is configured by a memory card incorporating a semiconductor memory, a hard disk drive, or the like.

  The power supply control circuit 22 controls supply / cut-off of power to each block in the camera including the imaging device 12, the LCD monitor 17, and the backlight (not shown) of the LCD monitor 17 in accordance with an instruction from the CPU 20.

  The operation member 23 includes a release button 23a, a zoom switch 23b 23c, a cross switch 23g, a menu switch 23e, and the like which will be described later. The operation member 23 sends an operation signal corresponding to each operation, such as a mode switching operation or a menu selection operation, to the CPU 20.

  The GPS device 25 receives radio waves from GPS satellites in response to instructions from the CPU 20 and outputs received signals to the CPU 20. The CPU 20 performs a predetermined calculation based on a received signal from the GPS device 25 and detects positioning information (latitude, longitude, altitude) of the electronic camera 1.

  The electronic camera 1 performs predetermined image processing and compression processing on the image signal acquired by the image sensor 12 at the time of shooting, and adds additional information including positioning information and information about the shot image to the image data after the compression processing. It is configured to generate an added image file. Specifically, an image file in Exif format is generated in which image data in JPEG format is stored in the image data portion and additional information is stored in the additional information portion. The Exif format image file is obtained by embedding thumbnail images and additional information data in image data in the JPEG image format. The generated image file is recorded on the recording medium 51.

  Further, the electronic camera 1 is configured to be able to switch between a shooting mode and a playback mode. The shooting mode is an operation mode in which a subject image is shot and data of the shot image is stored in the recording medium 51 as an image file. The reproduction mode is a mode for displaying the reproduced image based on the image data on the LCD monitor 17 by reading the captured image data from the recording medium 51.

<Generation of shooting history information>
The electronic camera 1 according to the present embodiment has a function of generating shooting history information. The shooting history information is information for displaying a digest of images taken by the camera. The CPU 20 of the electronic camera 1 divides the captured images into image groups for each predetermined period based on the shooting date, extracts a representative image for each image group, associates shooting information regarding the representative image with the representative image, and the flash memory. Record to 19.

  The present embodiment is characterized in that the shooting history information is generated and a digest of the shot image is displayed on the LCD monitor 17 based on the generated shooting history information. The processing that is necessary for this is performed.

  FIG. 2 is a flowchart for explaining the flow of processing for generating shooting history information executed by the CPU 20. For example, after the electronic camera 1 is used for the first time when the calendar month changes, the CPU 20 performs a power-off process of the camera 1 (specifically, a predetermined amount according to an operation of turning off the power switch). After the power-off process is performed and before the power supply by the power control circuit 22 is stopped), the process shown in FIG. 2 is started.

  In step S <b> 11 of FIG. 2, the CPU 20 extracts information on the shooting date and time of each image from the captured image file recorded in the recording medium 51, and proceeds to step 12. In step S <b> 12, the CPU 20 determines whether shooting date / time information has been extracted for all image files. The extraction of the shooting date / time information may be performed for a new shot taken after the previous processing of FIG. If the CPU 20 has extracted the shooting date / time information for all the image files, the CPU 20 makes a positive determination in step S12 and proceeds to step S13. If there is an image file from which the shooting date / time information has not been extracted, the CPU 20 makes a negative determination in step S12 and returns to step S11.

  In steps S13 to S15, S21 and S22, a period is set. In step S13, the CPU 20 determines whether or not shooting has been performed once a month. For example, the CPU 20 makes a positive determination in step S13 when shooting is performed in the most recent month and proceeds to step S21. If not, the CPU 20 determines negative in step S13 and proceeds to step S14. In step S21, the CPU 20 sets the period to one month and proceeds to step S16.

  In step S14, the CPU 20 determines whether or not the image has been taken once every two months. For example, the CPU 20 makes a positive determination in step S14 when shooting has been performed in the last two months and proceeds to step S22. If not, the CPU 20 makes a negative determination in step S14 and proceeds to step S22. In step S22, the CPU 20 sets the period to two months and proceeds to step S16.

  In step S15, the CPU 20 sets the period to three months and proceeds to step S16. In this example, the period is set to one month to three months. However, it may be configured to set a wider half year or one year, or a narrower one week period. You may make it set.

  In step S16, the CPU 20 classifies the captured images for each of the set periods and proceeds to step S17. The classification creates a management table in the history recording area of the flash memory 19 without storing the image file in the folder provided for each period, and stores information for associating the image file with the period in the table. You can just store it.

  In step S17, the CPU 20 performs a representative image extraction process and proceeds to step S18. The extraction process is a process of selecting one frame of captured image that represents an image group classified for each period. Details of the extraction process will be described later.

  In step S18, the CPU 20 opens the captured image file extracted as the representative image, generates reduced image data (reduced representative image) obtained by reducing the data size of the main image of the file, and proceeds to step S19. The size of the reduced representative image is a size corresponding to the screen resolution of the LCD monitor 17. Note that generation of reduced image data may be omitted when there is a sufficient capacity in the history recording area.

  In step S19, the CPU 20 includes information indicating the period, reduced representative image, information related to the reduced representative image (for example, shooting date / time information (including time zone information), shooting point information, camera setting information at the time of shooting (focal length). (Including aperture value, subject distance, AF setting area information), shooting scene information, character information), and the shooting history information is recorded in the history recording area of the flash memory 19. The process proceeds to step S20.

  The shooting history information is recorded in the flash memory 19 separately from the image file in the recording medium 51, and has a very small data size compared to the image file in the recording medium 51. Therefore, the shooting history information generated based on the plurality of image files recorded on the separate recording medium 51 can be collectively recorded in the history recording area of the flash memory 19. Note that the shooting history information once recorded in the flash memory 19 is not normally deleted. In other words, even if the photographed image file in the recording medium 51 is deleted (including removal to another recording medium), the photographing history information generated based on the deleted image file is retained.

  In step S20, the CPU 20 determines whether shooting history information has been recorded for all the set periods. The CPU 20 makes an affirmative decision in step S20 when the respective shooting history information has been recorded for the entire set period, and ends the process of FIG. If there is a period during which no shooting history information is recorded, the CPU 20 makes a negative determination in step S20, returns to step S17, and repeats the above-described processing.

<Representative image extraction process>
Details of the representative image extraction processing will be described with reference to the flowchart illustrated in FIG. 3. In step S171 in FIG. 3, the CPU 20 reads each image from the captured image file recorded in the recording medium 51, and performs subject recognition processing on the read image. The CPU 20 uses, for example, a known technique such as template matching to capture shooting scenes such as “landscape”, “portrait”, “cooking”, “flower”, “dog”, “sunset”, “wedding”, etc. A recognition process necessary for determining the above is performed. Template data is recorded in the flash memory 19 in advance. Note that subject recognition processing for an image may be performed when the image is captured.

  When the determination scene is “landscape”, the subject in the image is estimated as “mountain”, “street corner”, “sea”, “Japanese subject”, and the like. The subject estimation is performed by template matching, for example. For example, template data of a building is used for estimating the “street corner”.

  In the present embodiment, when the determination scene is “portrait”, gender estimation and approximate age estimation are performed from the “face” in the image. These estimations use a known face attribute estimation technique. Further, personal authentication (identification) is also performed by comparing the “face” in the photograph with the “face” registered in the electronic camera 1 in advance. The face identification process uses, for example, a known identification technique.

  The reference data that the electronic camera 1 uses to identify the “face” can be recorded (registered) in the flash memory 19. The registration procedure will be described later.

  In step S172, the CPU 20 performs scene determination and proceeds to step S173. The CPU 20 determines one from “landscape”, “portrait”, “cooking”, “flower”, “dog”, “sunset”, “wedding” and the like using the subject recognition result.

  In step S173, the CPU 20 determines whether scene determination has been performed for all image files. If the CPU 20 determines each shooting scene for all image files, the CPU 20 makes a positive determination in step S173 and proceeds to step S174. If there is an image file that has not undergone scene determination, the CPU 20 makes a negative determination in step S173, returns to step S171, and repeats the above-described processing.

  In step S <b> 174, the CPU 20 determines whether there is an image with a particularly low frequency of the shooting location in the image group classified in the set period. The shooting location is specified based on shooting point information generated based on the positioning information included in the additional information data. The CPU 20 has a peculiar shooting location (for example, most of the images are shot in the area A, but only during a certain period compared to the average shooting location of all the images taken by the electronic camera 1 so far. If the captured image (including images captured in the B area) is classified in the period, an affirmative determination is made in step S174 and the process proceeds to step S175. If the shooting location of the image classified in the period matches the average shooting location of all the images, the CPU 20 makes a negative determination in step S174 and proceeds to step S176. The average shooting location may be configured to be manually set by the user (for example, the position of the house is set).

  In step S175, the CPU 20 sets a corresponding image group (that is, an image group shot at a specific shooting location) among the image groups classified in the period as a representative image extraction source (candidate) in step S176B. Proceed to In step S176, the CPU 20 extracts, from the image groups classified in the period, the image group photographed on the most frequently photographed day (that is, the image group photographed most frequently in one day) as a representative image extraction source. Proceed to step S176B as (candidate). In step S176B, the CPU 20 proceeds to step S177 with the captured image of the most frequently captured scene as the representative image extraction source (candidate) in the image group of step S175 or step S176.

  In step S177, the CPU 20 extracts a representative image from the candidate image group based on the extraction criteria determined in accordance with the shooting scene (S172) for the image group as the extraction source (candidate). Then, the process proceeds to step S178.

The extraction criteria are as follows.
1. When the judgment scene is “landscape”, an image having the highest spatial frequency in the image group is selected. When there are a plurality of images having the same spatial frequency, an image with a smaller aperture (small aperture) at the time of shooting is selected.

2. When the determination scene is “portrait” and an individual is identified, an image having the largest “face” area size of the identified person in the image group is selected. If there are images having the same size of the “face” area, an image with an appropriate brightness of the “face” area (the pixel signal value is within a predetermined range and is neither over nor under) is selected. If there are a plurality of images with appropriate brightness in the “face” area, an image having the highest spatial frequency in the “face” area is selected.

  When the determination scene is “portrait” and an individual is not identified, an image having the largest human “face” area size is selected from the image group. If there are images having the same size of the “face” area, an image with an appropriate brightness of the “face” area (the pixel signal value is within a predetermined range and is neither over nor under) is selected. If there are a plurality of images with appropriate brightness in the “face” area, an image having the highest spatial frequency in the “face” area is selected.

3. When the determination scene is “cooking”, an image having the highest spatial frequency in the image group is selected. If there are images with the same spatial frequency, select one that has a wide color distribution. Specifically, the color component ratio (for example, RGB component ratio) of the pixel signal corresponding to each different point (for example, 20 points) in the screen is obtained, and an image having the largest variation in the ratio in the screen is selected.

  Even when the determination scene is “flower”, “dog”, “sunset”, “wedding”, etc., the image having the highest spatial frequency in the image group is selected. If there are images with the same spatial frequency, an image with a smaller aperture (small aperture) at the time of shooting is selected.

  In step S177, the CPU 20 determines whether or not representative images have been extracted from all periods. When the CPU 20 extracts representative images from the set periods, the CPU 20 makes an affirmative decision in step S178 and ends the process of FIG. If there is a period during which no representative image is extracted, the CPU 20 makes a negative determination in step S178, returns to step S174, and repeats the above-described processing.

<Registered shooting process>
A procedure for registering reference data used for identifying the “face” described above will be described. FIG. 4 is a rear view of the electronic camera 1. On the back of the electronic camera 1, there are an LCD monitor 17, a zoom switch 23b (T), a zoom switch 23c (W), a mode switch 23d, a menu switch 23e, a deletion switch 23f, a cross switch 23g, and an OK. A switch 23h is provided.

  When the menu switch 23 e is pressed, the CPU 20 displays an “operation menu” screen illustrated in FIG. 4 on the LCD monitor 17. The “operation menu” includes a “digest display setting” item 41 and a “registered shooting” item 42. When the cross switch 23g is pressed down while the “operation menu” screen is displayed, the CPU 20 changes the selection item up or down according to the operation signal. When the cross switch 23g is pressed rightward with the “registered shooting” item 42 selected, the CPU 20 displays the assist frame G illustrated in FIG. 5 on the LCD monitor 17 and accepts the registered shooting operation.

  The CPU 20 displays an image (a so-called through image) captured by the image sensor 12 at a predetermined frame rate (for example, 30 fps) on the LCD monitor 17 and displays the assist frame G so as to overlap the displayed image. The photographer holds the electronic camera 1 so that the face of the subject person to be registered is within the assist frame G.

  The CPU 20 performs a photographing process when the release button 23a is fully pressed. The CPU 20 further performs face detection processing based on the data corresponding to the assist frame G in the acquired image data, and when a face is detected, the reference data is stored in the flash memory 19 as a “face” of a new person. Record (register).

  Specifically, thumbnail image data is generated based on image data corresponding to the assist frame G, and feature amount data is generated based on the image data. Then, reference data including thumbnail image data and feature amount data is recorded in the flash memory 19. This reference data is used as information indicating the “face” registered at the time of identifying the “face”, and is used for comparison with the captured “face”.

<Digest display>
A digest display using the shooting history information will be described. FIG. 6 is a diagram illustrating a digest display. In FIG. 6, representative images representing four periods are displayed in a list on the LCD monitor 17. In the example of FIG. 6, each period being displayed is one month, but the length may vary depending on the period. In the vicinity of the representative image, a display (shooting date) indicating a period corresponding to the representative image is displayed.

  When the cross switch 23g is pressed in the right direction during the list display of FIG. 6, the CPU 20 scrolls the representative image being displayed as illustrated in FIG. According to FIG. 7, the period (2008.12) not displayed in FIG. 6 is newly displayed at the right end. When the cross switch 23g is pressed in the left direction, the CPU 20 scrolls in the opposite direction. 6 and 7 exemplify the case where four representative images are displayed on one screen, the number of display images per screen is not limited to four, and may be nine or sixteen.

  FIG. 8 is a diagram illustrating another digest display (slide show display). In FIG. 8, a representative image representing one period (2008.11) is displayed on the LCD monitor 17. In the example of FIG. 8, the displayed period is one month. In the vicinity of the representative image, a display indicating the period corresponding to the representative image (shooting date) and corresponding character information (in this example, “Looks like * ^ _ ^ *”) are displayed.

  The character information is based on predetermined character information data recorded in the flash memory 19 in advance corresponding to the shooting scene. For example, the data for displaying “delicious * ^ _ ^ *” corresponding to the shooting scene of “cooking” is recorded. When displaying a representative image whose determination scene is “cooking”, the CPU 20 displays corresponding character information.

  When a predetermined time (referred to as interval time) elapses from the display of FIG. 8, the CPU 20 of the electronic camera 1 displays the display image of FIG. 9 on the LCD monitor 17 instead of the display image of FIG. In the example of FIG. 9, the representative image is displayed for the period (2008.12) next to the period (2008.11) displayed in FIG. In the vicinity of the representative image, a display indicating the period corresponding to the representative image (shooting date) and the corresponding character information (in this example, “◯ △ island (^ _ ^) v”) are displayed. In the case of the slide show display, predetermined music is reproduced from the speaker 16 as BGM during the display.

  Whether the digest display is performed in the list display or the slide show display is set in advance in the menu process. In addition, whether to display the interval time for updating the display image at the time of the slide show display, an interval between adjacent intervals after elapse of the interval time, or a period selected at random is set in the menu processing.

  When the “digest display setting” item 41 is selected while the “operation menu” screen illustrated in FIG. 4 is being displayed and the cross switch 23g is pressed rightward, the CPU 20 performs the “digest” illustrated in FIG. The “display setting” screen is displayed on the LCD monitor 17. The “digest display setting” screen includes a “display format” item 101, an “interval setting” item 102, and a “BGM setting” item 103.

  When the cross switch 23g is pressed rightward while the “display format” item 101 is selected, the CPU 20 selects whether to perform digest display as a list display or as a slide show display, and displays a digest display. Accept the operation to start.

  When the cross switch 23g is pressed down in the right direction with the “interval setting” item 102 selected, the CPU 20 accepts an interval time setting operation. Further, when the cross switch 23g is pressed rightward while the “BGM setting” item 103 is selected, the CPU 20 accepts a sound file selection operation to be reproduced from the speaker 16 as BGM during the digest display.

  FIG. 11 is a flowchart for explaining the flow of the digest display process executed by the CPU 20 set with the menu as described above. CPU20 will start the process by FIG. 11, if the instruction | indication of a digest display start is performed. In step S51 of FIG. 11, the CPU 20 determines the display format. The CPU 20 proceeds to step S52 when “list display” is set in the menu process, and proceeds to step S56 when “slide show display” is set in the menu process.

  In step S52, the CPU 20 performs the list display illustrated in FIGS. 6 and 7 based on the shooting history information, and proceeds to step S53. In step S53, the CPU 20 determines whether or not there is a scroll operation. When the cross switch 23g is pressed leftward or rightward, the CPU 20 makes a positive determination in step S53 and proceeds to step S54. If the cross switch 23g is not pressed in the left direction or the right direction, the CPU 20 makes a negative determination in step S53 and proceeds to step S55.

  In step S54, the CPU 20 scrolls the display image in accordance with the pressing operation direction of the cross switch 23g and proceeds to step S55. In step S55, the CPU 20 determines whether or not an end operation has been performed. When an operation for ending the digest display (for example, an operation of pressing the OK switch 23h) is performed, the CPU 20 makes a positive determination in step S55 and ends the process of FIG. If the operation for ending the digest display (for example, pressing the OK switch 23h) is not performed, the CPU 20 makes a negative determination in step S55, returns to step S52, and repeats the above-described processing.

  In step S56, the CPU 20 reads a reduced representative image for a predetermined period from the shooting history information, and proceeds to step S57. The initial value of “period” is, for example, the oldest, and when designated in menu processing (not shown), a reduced representative image for the designated “period” is read.

  In step S57, the CPU 20 performs the slide show display illustrated in FIGS. 8 and 9 based on the shooting history information, and proceeds to step S58. In step S58, the CPU 20 determines whether the time is up. When the set interval time has elapsed, the CPU 20 makes a positive determination in step S58 and proceeds to step S59. If the set interval time has not elapsed, the CPU 20 makes a negative determination in step S58 and proceeds to step S60.

  In step S59, the CPU 20 reads the reduced representative image of the next period from the shooting history information, and returns to step S57. When returning to step S57, the slide show display is repeated. The next “period” is a new “period” adjacent to the currently displayed “period”, and if it is specified to be selected randomly in the menu process (not shown), the “period” selected at random Read the reduced representative image.

  In step S60, the CPU 20 determines whether or not an end operation has been performed. When an operation for ending the digest display (for example, an operation of pressing the OK switch 23h) is performed, the CPU 20 makes an affirmative determination in step S60 and ends the process of FIG. If the operation for ending the digest display (for example, pressing the OK switch 23h) is not performed, the CPU 20 makes a negative determination in step S60, returns to step S58, and repeats the above-described processing.

According to the embodiment described above, the following operational effects are obtained.
(1) The CPU 20 of the electronic camera 1 classifies a plurality of images into groups for each predetermined period based on the shooting date of each image (step S16), and from the groups classified by the classification processing, From the plurality of images extracted by the first extraction processing (steps S174 to S176) and the plurality of images extracted by the first extraction processing, respectively, for each period, a plurality of images representing the period based on the user value of the image of A second extraction process (step S177) for extracting one representative image representing a period for each period based on the degree of image evaluation of a plurality of images, information indicating the period for each period, and corresponding to the period Shooting history information generation processing (step S19) for generating shooting history information in which the representative image and information related to the representative image of the period are associated with each other. Since as rows, even without operation history information based on a user operation such as image browsing operation and printing operation can be extracted appropriate representative image.

  In addition, since shooting history information is generated by associating information indicating a period for each period, a representative image corresponding to the period, and information regarding the representative image of the period, shooting is performed even when the original image is deleted. It becomes possible to keep history information.

(2) In the first extraction process of (1), when there is an image shot at a specific shooting position with respect to the average shooting position of all the images before classification, the specific shooting is performed. Since a plurality of images shot at a position are extracted and there are no images shot at a specific shooting position in the group, a plurality of images shot on the most frequently shot date in the group are extracted. When there is an image for a trip, a photographed image during the trip is extracted.

(3) The second extraction process of (1) includes a scene determination process (step S172) for determining a shooting scene of an image, and the first extraction process based on a predetermined determination criterion corresponding to the determined shooting scene. Since one image is extracted from the plurality of images extracted by the above, for example, the determination scene can be extracted based on different standards for “landscape” and “portrait”.

(4) Since the CPU 20 further performs display processing (FIG. 11) for displaying the reproduced images representing the periods for each period based on the shooting history information, the representative image extracted as described above. Can be reproduced and displayed for each period.

(5) The display process of (4) includes a period corresponding to the representative image, a shooting position of the representative image, a shooting scene determined for the representative image, and a display indicating predetermined character information corresponding to the shooting scene. Therefore, the viewer of the reproduced display image can look back on the memories from the content displayed and reproduced without newly reading out the image file of the representative image for each period.

(6) The representative reduced image generation process (step S18) for generating a reduced size image of the representative image extracted by the second extraction process is performed to reduce the representative image of the shooting history information to a reduced size image. Even when all the representative reduced images are included, the data size of the entire photographing history information can be suppressed. As a result, it is possible to reduce the time required for calculation and save the usage capacity of the history recording area.

<About user image user value determination>
In step S174 described above, the CPU 20 extracts a photographed image at a specific photographing location as compared with the average photographing location of all the images photographed by the electronic camera 1 so far. The photographed image at the unique photographing location is determined to be an image that is deeply considered by the user, that is, an image having a high user value. On the other hand, it is determined that the captured image at the average shooting location of all the images captured by the electronic camera 1 so far is an image having a lower user value than the captured image at the specific shooting location.

Further, in step S176 described above, the CPU 20 selects the image group captured on the most frequently-captured date among the image groups classified in the period (that is, the day on which the most images were captured in the period). Included image) as a representative image extraction source. It is determined that the images included in the image group photographed on the most frequent photographing date are images having a high user value. On the other hand, it is determined that an image shot on a date other than the most frequent shooting date is an image having a lower user value than an image shot on the highest shooting date.
Note that the shooting point information generated based on the positioning information included in the additional information data is used as a criterion for determining the user value of the image. However, the image user value is not limited to this. Any standard can be used.

<Determination of image evaluation degree of image>
In step S176B described above, the CPU 20 uses the captured image of the most frequently captured scene as the representative image extraction source. In step S177 described above, the representative image is extracted from the candidate image group based on the extraction criteria corresponding to the shooting scene determined for the image group as the extraction source (candidate). did. As a result, an image having a high image evaluation degree can be used as a representative image from the image group as the extraction source (candidate).

(Modification 1)
In the slide show display illustrated in FIGS. 8 and 9, a predetermined background pattern may be displayed in addition to the representative image. Then, the background pattern file that stores data used for background pattern display may be configured to be selectable for each period, as in the case of selecting a sound file to be played back by BGM.

(Modification 2)
The background pattern displayed in the slide show display and the sound file to be played back by BGM may be aligned during a period in which a common shooting scene is determined. FIG. 12 is a diagram for explaining the second modification. When the CPU 20 displays the representative image for the period in which the determined shooting scene is “cooking”, the CPU 20 sets the background pattern file F1 and the sound file for BGM playback as S1.

  Further, when displaying the representative image for the period in which the determined shooting scene is “flower”, the CPU 20 sets the background pattern file F2 and the sound file for BGM playback as S2. Similarly, when displaying the representative image for the period in which the determined shooting scene is “child A”, the CPU 20 sets the background pattern file F3 and the sound file for BGM playback as S3.

  For example, when a background pattern file selection operation or a sound file selection operation is performed in any one of four periods (2008. 8 to 2008. 11) in which the shooting scene is “flower”, A common background pattern file and sound file are selected for other periods in which the shooting scene is “flower”.

(Modification 3)
When displaying predetermined character information corresponding to the shooting scene, the character information may be changed according to the observer who observes the digest display. For example, the electronic camera 1 is configured to register age and sex as user information, and the user information is stored in the flash memory 19.

  When displaying the character information corresponding to the shooting scene, the CPU 20 of the third modification varies the display contents according to the user information. For example, “delicious!” And “delicious” are recorded in addition to the “delicious” * ^ _ ^ * as described above, corresponding to the shooting scene of “cooking”. If the user information indicates a woman, “Delicious” * ^ _ ^ * is displayed. If the user information indicates a male adult, “Delicious!” Is displayed. If the user information indicates a minor, “Delicious” is displayed. For example, the display differs depending on the user. By changing the expression according to the language difference between men and women and generations, or by changing the frequency of use of hiragana, katakana, and kanji for adults and children, it is possible to provide different character information by gender and age.

(Modification 4)
Depending on the user information, the background pattern and the sound file for BGM playback may be different.

(Modification 5)
Although the case of the electronic camera 1 has been described as an example, the present invention may be applied to an image reproduction device such as a photo viewer or a projector.

(Modification 6)
In the above description, the processing executed by the CPU 20 of the electronic camera 1 has been described as an example. However, the image processing program for performing the above-described shooting history information generation processing (FIGS. 2 and 3) is executed in the computer device 200 shown in FIG. By doing so, the photographing history information generating device may be configured. When the program is used by being loaded into the personal computer 200, the program is loaded into the data storage device of the personal computer 200, and then the program is executed to be used as a photographing history information generation device.

  The loading of the program to the personal computer 200 may be performed by setting a recording medium 204 such as a CD-ROM storing the program in the personal computer 200, or to the personal computer 200 by a method via the communication line 201 such as a network. You may load. When passing through the communication line 201, the program is stored in the hard disk device 203 of the server (computer) 202 connected to the communication line 201. The program can be supplied as various types of computer program products such as provision via the recording medium 204 or the communication line 201.

(Modification 7)
It is also possible to cause the computer 200 to display a digest using the shooting history information generated using the program of the sixth modification. In this case, the digest display device is configured by causing the computer device 200 to execute an image processing program for performing the digest display processing (FIG. 11). A configuration in which the electronic camera 1 and the computer apparatus 200 are connected (wired connection or wireless connection), and shooting history information generated by the electronic camera 1 is transmitted to the computer apparatus 200, and the computer apparatus 200 performs a digest display. It may be.

  The above description is merely an example, and is not limited to the configuration of the above embodiment.

DESCRIPTION OF SYMBOLS 1 ... Electronic camera 12 ... Image pick-up element 14 ... Image processing circuit 17 ... LCD monitor 18 ... RAM
19 ... Flash memory 20 ... CPU
21 ... Memory card interface 23 ... Operation member 25 ... GPS device 51 ... Storage medium

Claims (8)

A classification process for classifying a plurality of images into groups for each predetermined period based on the shooting date of each image;
A first extraction process for extracting, for each period, a plurality of images representing the period from the group classified by the classification process, based on the user value of the images in the group;
A second extraction process for extracting one representative image representing the period from each of the plurality of images extracted by the first extraction process based on an image evaluation degree of the plurality of images.
Shooting history information generation processing for generating shooting history information in which information indicating a period for each period, a representative image corresponding to the period, and information regarding the representative image of the period are associated;
An image processing program for causing a computer to execute. In the image processing program according to claim 1,
The first extraction process includes
If an image shot at a specific shooting position with respect to the average shooting position of all images before the classification exists in the group, extract a plurality of images shot at the specific shooting position,
An image processing program for extracting a plurality of images photographed on the most frequent photographing date in the group when an image photographed at the specific photographing position does not exist in the group. The image processing program according to claim 1 or 2,
The second extraction process includes
Including a scene determination process for determining a shooting scene of the image,
An image processing program that extracts one image from a plurality of images extracted by the first extraction processing based on a predetermined determination criterion corresponding to the determined shooting scene. In the image processing program as described in any one of Claims 1-3,
An image processing program causing a computer to further execute a display process for displaying a reproduction image representing the period for each period based on the shooting history information. The image processing program according to claim 4,
The display processing includes a display showing a period corresponding to the representative image, a shooting position of the representative image, a shooting scene determined for the representative image, and predetermined character information corresponding to the shooting scene. An image processing program. In the image processing program according to any one of claims 1 to 5,
Causing the computer to further execute a representative reduced image generation process for generating a reduced size image of the representative image extracted by the second extraction process;
The shooting history information generation process generates shooting history information in which information indicating a period for each period, a representative reduced image corresponding to the period, and information on the representative image of the period are associated with each other. An image processing program. The image processing program according to claim 5,
The image processing program characterized in that the display process varies the character information according to a shooting scene and user registration information.   A camera comprising the image processing program according to claim 1.

Images