JP2011128938A - Image display device and image display program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To select an image important for a user as an album image. <P>SOLUTION: A controller 104 calculates distribution of the number of captured images in each shooting time to classify the images by sub time zone, and groups the images whose shooting time interval in each shooting time zone are not higher than a predetermined threshold, for each sub-sub time zone. Then, the controller 104 selects one album image from a sub-sub time zone including the most images, for each sub time zone, and displays slide show of the selected album images on a monitor 106. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image display device and an image display program.

  The following electronic album devices are known. When the electronic album device divides images into groups and creates an album including all the images in the group for each group, the image having the highest resolution in each group is selected as the cover image of the album (for example, Patent Document 1).

JP 2003-58867 A

  However, since the conventional electronic album apparatus creates an album that includes all the images in the group, there is a possibility that images that the photographer does not consider important are also included in the album.

An image display device according to the present invention selects an image classification unit that classifies an image every predetermined shooting time, and an image whose shooting time interval is a predetermined threshold or less as a selection group for each classification classified by the image classification unit. Select the selection group selection means, and for each classification, select the selection group containing the most images from the selection group as the priority selection group, and select the album display image from the images included in the priority selection group The image display means for album display to be displayed, and the display means for displaying on the display device the image for album display selected by the image display means for album display are provided.
The present invention further includes a number designation means for designating the number of album display images selected by the album display image selection means, and the album display image selection means designates the selected album display image by the number designation means. The selection of the album display image may be repeated until the designated number of images is reached.
The album display image selecting means excludes the selected group in which the album display image is selected from the priority selection group, and the selected album display image remains even if the album display image is selected for all the priority selection groups. If the number is smaller than the designated number, the selection group excluded from the priority selection group may be selected again as the priority selection group to select the album display image.
The album display image selecting means selects a plurality of candidate images from the images included in the priority selection group, and the display means displays the plurality of candidate images selected by the album display image selecting means on the display device. While displaying, a user interface for the user to select an album display image from among a plurality of candidate images may be displayed on the display device.
An image display program according to the present invention selects an image classification procedure for classifying an image every predetermined shooting time and an image whose shooting time interval is equal to or smaller than a predetermined threshold for each classification classified by the image classification procedure as a selection group. Selection group selection procedure and for each classification, select the selection group that contains the most images from the selection group as the priority selection group, and select the album display image from the images included in the priority selection group The image display procedure for album display to be performed and the display procedure for displaying the album display image selected in the image display procedure for album display on the display device are executed by the computer.

  According to the present invention, it is possible to select an image that the photographer considers important as an album display image.

1 is a block diagram illustrating a configuration of an embodiment of a camera 100. FIG. It is a flowchart figure which shows the flow of an album creation process. It is a figure which shows the example of a division | segmentation of the imaging | photography time according to an album structure number. It is a 1st figure which shows the example of distribution of the imaging | photography number for every division | segmentation time slot | zone. It is a flowchart figure which shows the flow of the image selection process for album display. It is a 2nd figure which shows the example of distribution of the imaging | photography number for every division | segmentation time slot | zone. It is a 1st figure which shows the example of a re-division | segmentation of a division | segmentation time slot | zone. It is a figure which shows the example of calculation of the average imaging | photography time interval Ave01 used as a threshold value. It is a 2nd figure which shows the example of a re-division | segmentation of a division | segmentation time slot | zone. It is a figure which shows the specific example of the image number for every subdivision time slot | zone.

  FIG. 1 is a block diagram illustrating a configuration of an embodiment of a camera according to the present embodiment. The camera 100 includes an operation member 101, a lens 102, an image sensor 103, a control device 104, a memory card slot 105, and a monitor 106. The operation member 101 includes various input members operated by the user, such as a power button, a release button, a zoom button, a cross key, an enter button, a play button, and a delete button.

  The lens 102 is composed of a plurality of optical lenses, but is representatively represented by one lens in FIG. The lenses constituting the lens 102 include a zoom lens for changing the zoom magnification, a focus adjustment lens (AF lens) for performing focus adjustment, and the like. The image sensor 103 is an image sensor such as a CCD or a CMOS, for example, and captures a subject image formed by the lens 102. Then, an image signal obtained by imaging is output to the control device 104.

  The control device 104 generates image data in a predetermined image format, for example, JPEG format (hereinafter referred to as “main image data”) based on the image signal input from the image sensor 103. Further, the control device 104 generates display image data, for example, thumbnail image data, based on the generated image data. The control device 104 generates an image file that includes the generated main image data and thumbnail image data, and further includes header information, and outputs the image file to the memory card slot 105.

  The memory card slot 105 is a slot for inserting a memory card as a storage medium, and the image file output from the control device 104 is written and recorded on the memory card. The memory card slot 105 reads an image file stored in the memory card based on an instruction from the control device 104.

  The monitor 106 is a liquid crystal monitor (rear monitor) mounted on the back surface of the camera 100, and the monitor 106 displays an image stored in a memory card, a setting menu for setting the camera 100, and the like. . Further, when the user sets the mode of the camera 100 to the shooting mode, the control device 104 outputs image data for display of images acquired from the image sensor 103 in time series to the monitor 106. As a result, a through image is displayed on the monitor 106.

  The control device 104 includes a CPU, a memory, and other peripheral circuits, and controls the camera 100. Note that the memory constituting the control device 104 includes SDRAM and flash memory. The SDRAM is a volatile memory, and is used as a work memory for the CPU to develop a program when the program is executed or as a buffer memory for temporarily recording data. The flash memory is a non-volatile memory in which data of a program executed by the control device 104, various parameters read during program execution, and the like are recorded.

  The camera according to the present embodiment has an album creation function for creating an album for a captured image recorded on a memory card. The control device 104 creates an album based on an instruction from the user. Specifically, the control device 104 performs the process shown in FIG. 2 to create an album. The processing shown in FIG. 2 is executed by the control device 104 as a program that is activated when the user operates the operation member 101 and gives an instruction to start creating an album.

  In step S10, the control device 104 selects an album image based on an instruction from the user. For example, the control device 104 displays an image selection screen displaying a list of images recorded in the memory card on the monitor 106, and the image candidates included in the album are images specified on the image selection screen by the user. Is selected as the album image. Alternatively, the control device 104 displays a folder selection screen displaying a list of folders in the memory card on the monitor 106, and selects an image in the folder selected on the folder selection screen by the user as an album image. Then, it progresses to step S20.

  In step S20, the control device 104 designates the number of images to be included in the album (album constituting number) based on an instruction from the user. For example, the control device 104 displays a number selection screen for prompting the user to specify the number of album constituents on the monitor 106 and accepts specification of the number of album constituents from the user. At this time, 12 sheets, 24 sheets, 36 sheets, etc. are prepared as options for the number of constituents of the album, and the user can select an arbitrary number from these options. The number of sheets may be freely specified. Then, it progresses to step S30.

  In step S <b> 30, the control device 104 registers target subjects to be preferentially included in the album based on an instruction from the user. For example, the control device 104 prompts the user to photograph a subject to be registered, and registers the subject in the photographed image as a target subject accordingly. Alternatively, the control device 104 prompts the user to select an image including a subject to be registered from images recorded on the memory card, and registers the subject in the selected image as a target subject accordingly. To do. Examples of subjects to be registered here include a human face, a car, an airplane, a ball, and the like. Thereafter, the process proceeds to step S40.

  In step S40, the control device 104 reads the shooting date and time of the album image selected in step S10 from the header information of the image file, and calculates the distribution of the number of shots for each shooting date and time zone. In the present embodiment, the control device 104 calculates the entire shooting time between the earliest shooting date and the latest shooting date and time of the album image selected in step S10, and selects the entire shooting time in step S20. Divide into equal intervals by the number of albums. This makes it possible to classify the images for each shooting time zone. An example of dividing the shooting time in step S40 is shown in FIG.

  For example, consider the case where the total shooting time is 12 hours. In this case, when the number of albums is 12, 12 hours are divided into 12 and each divided time period is 1 hour. When the number of albums is 24, 12 hours are divided into 24, so that each divided time zone is 30 minutes. When the number of albums is 50, 12 hours are divided into 50, so that each divided time zone is 14 minutes.

  Also, consider the case where the total shooting time is 3 days (72 hours). In this case, when the number of albums is twelve, 72 hours are divided into twelve, so that each divided time zone is six hours. When the number of albums is 24, 72 hours are divided into 24, so that each divided time zone is 3 hours. When the number of albums is 50, 72 hours are divided into 50, so that each divided time zone is 1.5 hours.

  Also, consider the case where the total shooting time is 7 days (168 hours). In this case, when the number of albums is 12, the 168 hours are divided into 12 and each divided time zone is 14 hours. When the number of albums is 24, 168 hours are divided into 24, so that each divided time zone is 7 hours. When the number of albums is 50, 168 hours are divided into 50, so that each divided time slot is 3.4 hours.

  Then, the control device 104 calculates the distribution of the number of shots for each divided time period by calculating the sum of the number of shots for each divided time period, and displays the calculation result on the monitor 106. For example, the control device 104 displays a graph representing the number of captured images for each divided time zone as shown in FIG. 4 on the monitor 106 as the calculation result. Thereafter, the process proceeds to step S50.

  In step S50, the control device 104 performs album display image selection processing, which will be described later with reference to FIG. 5, and selects album display images that are actually included in the album from the album images selected in step S10. Thereafter, the process proceeds to step S60, and the control device 104 copies the album display image selected in step S50 to the album display folder in the memory card. If the album display folder does not exist in the memory card at this time, the control device 104 creates an album display folder in the memory card and then copies the album display image. Thereafter, the process proceeds to step S70.

  In step S70, the control device 104 reads the display image on the monitor 106 from the image file of the album display image copied to the album display folder, and displays the album display image on the monitor 106 based on the read display image. Is displayed as a slide show. Thus, the user can confirm the album display image selected in step S50. Thereafter, the process ends.

  Next, the album display image selection process executed in step S50 will be described with reference to the flowchart shown in FIG. The process in FIG. 5 will be described for the case where the number of album constituents specified in step S20 is twelve, and the number of captured images for each of the twelve divided time periods divided in step S40 described above is illustrated. An example of distribution as shown in FIG. In FIG. 6, numbers 1 to 12 are added to each divided time zone, and in this embodiment, each divided time zone is called with a number such as divided time zone 1 to divided time zone 12. I will do it.

  In step S51, the control device 104 redivides each divided time slot divided in step S40 described above according to the shooting time interval of the images shot in each divided time slot. The division | segmentation method of a division | segmentation time slot | zone is demonstrated using FIGS. First, as shown in FIG. 7, the control device 104 changes the boundary of each divided time zone divided in step S40 based on the image capturing time interval.

  Here, FIG. 7 is a diagram showing the photographing time interval (vertical axis / minute) for each image (horizontal axis / number of sheets) for the three time periods of the divided time zones 3 to 5. In FIG. 7A, an area indicating the shooting time interval of images (13 images) shot in the divided time zone 3 is represented as area 3, and images (5 shots) shot in the divided time zone 4 are displayed. A region indicating the photographing time interval is represented as region 4, and a region representing the photographing time interval of images (16 images) photographed within the divided time zone 5 is represented as region 5.

  The control device 104 calculates the average shooting time interval Ave01 by dividing the total shooting time described above by the number of album constituents, and sets this Ave01 to the threshold 7a. Note that Ave01 is calculated as shown in FIG. For example, when the total shooting time is 12 hours and the number of albums is 100, Ave01 = 7 minutes is calculated.

  Then, as shown in FIG. 7A, it is determined whether or not the image capturing time interval is equal to or less than the threshold 7a at the boundary between the region 3 and the region 4 and the boundary between the region 4 and the region 5. When the image capturing time interval is equal to or smaller than the threshold value 7a at the region boundary, the control device 104 changes the region boundary until the image capturing time interval becomes larger than the threshold value 7a.

  For example, at the boundary between the region 3 and the region 4, the shooting time interval 7b between the 13th image in the region 3 and the first image in the region 4 is equal to or less than the threshold 7a. ), The boundary between the region 3 and the region 4 is moved to between the third and fourth sheets of the region 4 where the image capturing time interval is equal to or less than the threshold 7a. In addition, at the boundary between the region 4 and the region 5, the shooting time interval 7c between the fifth image in the region 4 and the first image in the region 5 is equal to or less than the threshold 7a. ), The boundary between the region 4 and the region 5 is moved to between the sixth and seventh sheets of the region 5 where the image capturing time interval is equal to or less than the threshold 7a.

  After changing the boundary of each region based on the image capturing time interval in this way, the control device 104 searches for a portion in each region where two or more images with the image capturing time interval of Ave01 or less continue. Is divided for each part obtained by the search. For example, a method for dividing the region 3 shown in FIG. 7B will be described with reference to FIG. As shown in FIG. 9, the control device 104 determines that the region 9 a, the region 9 b, and the region 9 c from the region 3 are portions where two or more images having an image capturing time interval of Ave01 or less, that is, a threshold value 7a or less continue. And the area 3 is divided into the three partial areas 9a to 9c. Accordingly, each divided time zone can be subdivided according to the shooting time interval of the images shot within each divided time zone, and among the images included in each divided time zone, the shooting time interval is equal to or less than the threshold 7a. The images can be grouped for each partial region including the images.

  In the present embodiment, the subdivided partial area is called a subdivision time zone and expressed as Peak. In addition, each re-division time zone is called with a name using a division source region number and a partial region number in the division source region. For example, the subdivision time zone 9a is called Peak3-1, the subdivision time zone 9b is called Peak3-2, and the subdivision time zone 9c is called Peak3-3.

  Thereafter, the process proceeds to step S52, and the control device 104 calculates the number of images included in the subdivision time zone for each subdivision time zone (Peak) in which the subdivision has been performed in this way. Each time, one image is selected as an album display image from the images included in the subdivision time zone in which the calculated number of images is the largest. Thus, one album display image is selected from each of the divided time zones in which the re-divided time zone exists.

  FIG. 10 shows a specific example of the result of calculating the number of images for each subdivision time period for each of the regions 1 to 12 in the present embodiment. In FIG. 10, for example, one subdivision time period Peak1-1 exists in the region 1, and the Peak1-1 includes five images. Further, it is shown that there is no subdivision time zone in the area 2. In the example shown in FIG. 10, one album is selected from each of the areas 1, 3, 4, 5, 7, 8, 9, and 11 where the subdivision time zone exists, that is, a total of eight album display images are selected first. Will be.

  As a method of selecting one album display image from images included in each subdivision time zone, the control device 104 gives priority to, for example, an image including the subject registered in step S30 described above. Make a selection. At this time, if there are a plurality of images including the subject registered in step S30 in each subdivision time zone, an image having the largest subject size may be selected from them. In addition, when there is no image including the subject registered in step S30 in each subdivision time period, an image that satisfies a certain selection criterion such as an image that does not cause camera shake may be preferentially selected. The control device 104 may select one image at random. In this case, the image selection criterion may be set in advance, or may be arbitrarily set by the user.

  Thereafter, the process proceeds to step S53, and the control device 104 calculates the number N of unselected images obtained by subtracting the number of selected album display images from the number of album constituents (designated number) designated in step S20, and step S54. Proceed to In step S54, the control device 104 excludes the subdivision time zone in which the album display image was selected in step S52 from the selection targets of the album display image, and proceeds to step S55.

  In step S55, the control device 104 determines whether N is 0, that is, whether selection of album display images for the number of albums designated in step S20 has been completed. If an affirmative determination is made in step S55, the process returns to the process shown in FIG. On the other hand, if a negative determination is made in step S55, the process proceeds to step S56.

  In step S56, it is determined whether the number of subdivision time zones other than the subdivision time zones excluded in step S54 is not zero. If a negative determination is made in step S54, the process proceeds to step S59, and the control device 104 does not have a subdivision time zone for selecting an album display image as it is, so that the subdivision time zone excluded in step S54 does not exist. The exclusion is canceled and the process returns to step S52. On the other hand, if a positive determination is made in step S56, the process proceeds to step S57.

  In step S57, the control device 104 determines whether or not the number of subdivision time zones other than the subdivision time zones excluded in step S54 is greater than N. If a positive determination is made in step S57, the process proceeds to step S58. Then, from the subdivision time zones other than the subdivision time zones excluded in step S54, the top N subdivision time zones with the number of images included are identified, and each of the N subdivision time zones that have been identified is specified. One album display image is selected from each of them, and the process returns to the process shown in FIG. On the other hand, if a negative determination is made in step S57, the process returns to step S52 and the process is repeated.

  In step S58, if the re-division time zone divided from the same area as the sub-division time zone excluded in step S54 is included in the top N sub-division time zones, the control device 104 determines the re-division time. The top N subdivision time zones are specified by excluding the zones. In addition, when a plurality of subdivision time zones divided from the same region are included in the top N subdivision time zones, only one of them is left, and the other subdivision time zones are excluded from the top N To do. Accordingly, it is possible to prevent a plurality of album display images from being selected from the same region, and to select album display images uniformly from within the entire shooting time.

  In addition, when there are a plurality of subdivision time zones in which the number of images included is the same, the control device 104 gives priority to album display in a subdivision area with a small number of album display images selected from the same area. Select an image. Accordingly, it is possible to prevent a large number of album display images from being selected from a specific area, and it is possible to select album display images uniformly within the entire shooting time.

According to the present embodiment described above, the following operational effects can be obtained.
(1) The control device 104 calculates the distribution of the number of shots for each shooting time zone and classifies the images for each divided time zone, and the shooting time interval for each shooting time zone is an image having a predetermined threshold value or less. Are grouped by subdivision time zone, and for each subdivision time zone, one album display image is selected from the subdivision time zones that contain the most images, and the selected album display image is monitored. A slide show is displayed on 106. As a result, when the shooting time interval is equal to or less than the predetermined threshold, since many shots are taken in a short time, there is a high possibility that an image taken during that time is an image that the photographer considers important. Therefore, an image that the photographer considers important can be selected as an image for album display.

(2) The control device 104 repeats the selection of the album display image until the number of albums designated by the user is reached by the album display image selection process shown in FIG. Thus, an album including the number of images designated by the user can be created.

(3) In step S54 of FIG. 5, the control device 104 excludes the re-division time period in which the album display image was selected in step S52 from the selection targets of the album display image, and re-division excluded in step S56. When it is determined that the number of subdivision time zones other than the time zone is zero, the exclusion of the subdivision time zone is canceled. As a result, even if there is no subdivision time zone for selecting the album display image as a result of excluding the subdivision time zone, the exclusion can be canceled and the album display image can be continuously selected.

-Modification-
The camera of the above-described embodiment can be modified as follows.
(1) In the embodiment described above, the distribution of the number of shots is calculated for each divided time period in step S40 of FIG. 2, and the number of shot images for each divided time period as shown in FIG. The example in which the figure is displayed on the monitor 106 as the calculation result has been described. However, the bar graph indicating the number of shots shown in FIG. 4 may be represented by stacking and displaying thumbnail images of the respective images. Thus, the user can grasp the distribution of the number of shots for each divided time zone together with the content of the image.

(2) In the above-described embodiment, the control device 104 calculates the entire shooting time between the earliest shooting date and the latest shooting date and time of the album image selected in step S10 in step S40 of FIG. The example in which the entire shooting time is divided into equal intervals by the number of albums selected in step S20 has been described. However, regardless of the number of albums, the user may be allowed to arbitrarily set how many times the entire shooting time is divided, or the control device 104 may divide into a preset number. Good.

(3) In the above-described embodiment, the example has been described in which the control device 104 selects the album display image by performing the album display image selection processing shown in FIG. When the album display image is selected by the method shown in FIG. 5, it is impossible to know how many album display images are selected from each divided time period unless processing is performed. On the other hand, one album display image is always selected from each divided time zone so that the shooting time intervals of the album display image images are equalized within the entire shooting time. Also good.

  Further, as in the above modification (2), when the entire shooting time is divided regardless of the number of album constituents, the number of album constituents differs from the number of splitting time zones. Even if the album display images are selected one by one, the total number of selected images does not necessarily match the number of albums. In such a case, a plurality of album display images may be selected equally from the respective divided time zones. For example, when the number of albums is 12 and the number of division time zones is 3, four album display images may be selected from each division time zone.

  Alternatively, the user may be able to specify how many album display images are selected from each divided time zone. For example, when the number of albums is 12 and the number of division time zones is 3, the user selects five album display images from the division time zone 1 and the division time zone 2, and the division time zone It may be specified that three to two album display images are selected.

  Alternatively, the number of album display images selected from each divided time zone may be determined according to the ratio of the number of images included in each divided time zone. For example, when the number of albums is 12 and the number of division time zones is 3, 40 images are obtained in division time zone 1, 20 images in division time zone 2, and 60 images in division time zone 3. If it is included, the control device 104 selects a total of 12 album display images, that is, the divided time zones 1 to 4, the divided time zones 2 to 2, and the divided time zones 3 to 6. do it.

(4) In the above-described embodiment, in step S52 of FIG. 5, the control device 104 selects one image from among the images included in the re-division time zone having the largest number of images for each division time zone. An example of selecting an album display image has been described. However, the control device 104 selects a plurality of images as candidate images from among the images included in the subdivision time zone having the largest number of images for each division time zone, and selects one of the selected candidate images. A user interface for selecting one album display image may be displayed on the monitor 106 to prompt the user to select an album display image. Thus, the user can instruct the album to include a favorite image from among a plurality of candidate images.

(5) In the above-described embodiment, in step S70 of FIG. 2, the control device 104 reads the display image on the monitor 106 from the image file of the album display image copied to the album display folder, and displays the read display. The example in which the album display image is displayed as a slide show on the monitor 106 based on the image for use has been described. However, the control device 104 may read the display image on the monitor 106 from the image file of the album display image copied to the album display folder, and display the read display image as a list in the album format.

(6) In the above-described embodiment, the control device 104 makes one album based on the results of selection of the album image, designation of the number of albums, and registration of the target subject in steps S10 to S30 in FIG. An example of selecting an album display image to be included has been described. However, in order to create a plurality of albums, the control device 104 selects an album image for each of the plurality of albums, specifies the number of album constituents, and registers the target subject in advance, and then performs continuous processing. An album display image may be selected for each album.

(7) In the above-described embodiment, the case where the present invention is applied to the camera 100 has been described. However, the present invention can also be applied to other devices having an image display function, such as a personal computer, a portable information terminal, an electronic photo frame, and the like.

  Note that the present invention is not limited to the configurations in the above-described embodiments as long as the characteristic functions of the present invention are not impaired. Moreover, it is good also as a structure which combined the above-mentioned embodiment and a some modification.

100 Camera, 101 Operation member, 102 Lens, 103 Image sensor, 104 Control device, 105 Memory card slot, 106 Monitor

Claims (5)

Image classification means for classifying images at predetermined shooting times;
A selection group selection unit that selects an image whose shooting time interval is equal to or less than a predetermined threshold for each classification classified by the image classification unit;
For each of the classifications, a selection group including the most images from the selection group is selected as a priority selection group, and an album display image is selected from the images included in the priority selection group. Image selection means;
An image display device comprising: display means for displaying the album display image selected by the album display image selection means on a display device. The image display device according to claim 1,
A number designation means for designating the number of the album display images selected by the album display image selection means;
The album display image selecting means repeats selection of the album display image until the selected album display image reaches the designated number designated by the number designation means. The image display device according to claim 2,
The album display image selection means excludes the selected group that has selected the album display image from the priority selection group and selects the album display image for all the priority selection groups. When the number of album display images is smaller than the designated number, the selection group excluded from the priority selection group is selected again as a priority selection group, and the album display image is selected. Image display device. In the image display device according to any one of claims 1 to 3,
The album display image selecting means selects a plurality of candidate images from images included in the priority selection group,
The display means displays the plurality of candidate images selected by the album display image selection means on the display device, and a user selects the album display image from the plurality of candidate images. An image display device, characterized in that a user interface for displaying is displayed on the display device. An image classification procedure for classifying images for each predetermined shooting time;
A selection group selection procedure for selecting an image whose shooting time interval is equal to or less than a predetermined threshold as a selection group for each classification classified in the image classification procedure;
For each of the classifications, a selection group including the most images from the selection group is selected as a priority selection group, and an album display image is selected from the images included in the priority selection group. Image selection procedure,
An image display program for causing a computer to execute a display procedure for displaying the album display image selected in the album display image selection procedure on a display device.

Images