JP2009246890A - Image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor that outputs an easy-to-view list of images. <P>SOLUTION: The number of frame images extracted from a moving image is determined for one or each of a plurality of moving image information stored in a media card, and frame image information corresponding to the determined number of frame images are acquired from respective moving image files. The image list 20 is output wherein frame images corresponding to the frame image information or reduced or enlarged images of the frame images are arranged as index images 21 based upon the acquired frame image information. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus.

  In recent years, since a moving image and a still image can be shot using a digital camera, there are cases in which a moving image and a still image are shot separately according to a shooting scene. For example, a scene without motion such as a group photo can be shot as a still image, and a scene with motion such as a sports day scene can be shot as a moving image.

There has also been proposed an apparatus that prints out a moving image or a still image captured by such a digital camera or displays it on a display.
JP 2005-130254 A JP 9-322113 A

  However, the apparatus as described above merely provides a simple list of frame image index images and still image index images that constitute a moving image, and can provide an image list with sufficiently good browsing properties. There was a problem of not.

  For example, since a moving image is composed of a large number of frame images, it is preferable to output an image list that allows browsing of as many frame images as possible in order to grasp the contents of the moving image. However, in view of the time taken for browsing and the large amount of ink, toner, and recording paper consumed, it is not realistic.

  On the other hand, if a uniform number of index images are formed for each moving image, for example, only a small number of index images are formed for a video with a very long recording time, and the user can accurately determine the contents of the video. There is a problem that cannot be grasped. On the other hand, when a plurality of index images are formed for a video that has a very short recording time and can be grasped only by looking at one index image, there is almost no change in content. As a result, a large number of such index images are formed, and there is a possibility that the browseability of the image list is deteriorated.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide an image processing apparatus capable of outputting a list of images with good viewability.

  In order to achieve this object, an image processing apparatus according to claim 1 processes moving image information for reproducing a moving image, and stores the number of frame images extracted from the moving image in a storage medium. Extracted frame number determining means for determining each of one or a plurality of stored moving image information, and frame image information corresponding to the number of frame images determined by the extracted frame number determining means, for each of the moving image information Based on the frame image acquisition means acquired from the frame image information acquired by the frame image acquisition means, a frame image corresponding to the frame image information, or a reduced or enlarged image of the frame image is arranged as a moving image index image. Output means for outputting the list of images.

  The image processing apparatus according to claim 2 is the image processing apparatus according to claim 1, wherein the output means stores still image information for outputting a still image when the storage medium stores the still image information. An image list in which a still image index image composed of a still image corresponding to the above or a reduced or enlarged image of the still image is arranged together with the moving image index image is output.

  The image processing device according to claim 3 is the image processing device according to claim 2, wherein the index image group including the moving image index image and the still image index image is arranged in an order according to a predetermined condition. As described above, for each of the index images constituting the index image group, there is provided order determining means for determining an arrangement order, and the output means arranges the index image groups in the arrangement order determined by the order determining means. Output image list.

  According to a fourth aspect of the present invention, there is provided the image processing device according to the third aspect, wherein the time information for obtaining the time information specifying the time when the image information is generated is obtained for each of the still image information and the frame image information. The arrangement order determining means includes the index image group so that the time information acquired by the time information acquisition means is the predetermined condition and the time specified by the time information is in ascending order or descending order. The arrangement order is determined for each of the index images constituting the.

  The image processing device according to claim 5 is the image processing device according to any one of claims 1 to 4, wherein the extracted frame number determination means increases the moving image recording time length as the moving image recording time length increases. The number of frame images is determined for each piece of moving image information so that the number of frame images extracted from the image becomes large.

  The image processing device according to claim 6 is the image processing device according to any one of claims 1 to 4, further comprising switching detection means for detecting switching of a scene included in the moving image, wherein the number of extracted frames is determined. Determines the number of frame images for each of the moving image information so that the larger the number of scene switching detected by the switching detection means, the larger the number of frame images extracted from the moving image. To do.

  The image processing device according to claim 7 is the image processing device according to claim 6, wherein when the moving image includes a plurality of scenes, the frame image acquisition unit extracts at least one frame image from each scene. As described above, frame image information is acquired for each scene.

  The image processing device according to claim 8 is the image processing device according to any one of claims 1 to 4, wherein the extraction frame number determination means increases the total number of frame images included in the moving image. The number of frame images is determined for each piece of moving image information so that the number of frame images extracted from the moving image becomes large.

  The image processing device according to claim 9 is the image processing device according to claim 2, wherein the extracted frame number determination means is based on the number of the still image index images arranged in the image list output by the output means. Thus, the number of frame images to be extracted from the moving image is determined.

  According to the image processing apparatus of the first aspect, the number of frame images extracted from the moving image is determined for each piece of moving image information, and the moving image index image corresponding to the determined number of frame images is included in the image list. Arranged and output. Therefore, it is possible to output an image list with good browsing properties in which an appropriate number of moving image index images are arranged for each moving image.

  According to the image processing apparatus of the second aspect, in addition to the effect produced by the image processing apparatus of the first aspect, even if the storage medium includes a mixture of still image information and moving image information, It is possible to output an easy-to-view image list that allows you to visually recognize the contents of image information and moving image information.

  According to a third aspect of the present invention, in addition to the effects produced by the second aspect, the index image group including the moving image index image and the still image index image is arranged in an arrangement order according to a predetermined condition. It is possible to output a list of images that are arranged and have good readability.

  According to the image processing apparatus of the fourth aspect, in addition to the effect produced by the image processing apparatus of the third aspect, it is possible to output an image list that is easy to view for the user in which the index images are arranged in order of generation time.

  According to the image processing device according to claim 5, in addition to the effect produced by the image processing device according to any one of claims 1 to 4, for moving image information having a long recording time, a larger number of moving image index images It will be placed in the image list. For video information with a long recording time, it is expected that more scenes have been shot. Therefore, by placing a large number of video index images in the image list, the content of the video information is given to the user. It can be accurately grasped.

  Also, for slow motion video with a long playback time with respect to the time required from the start of recording to the end of recording (that is, the recording time), if the recording time is short, a smaller value is determined as the number of extracted frame images. An appropriate number of moving image index images can be arranged in the image list in order to grasp the contents.

  According to the image processing device of the sixth aspect, in addition to the effect produced by the image processing device according to any one of the first to fourth aspects, a larger number of moving image indexes are provided for moving image information having a large number of scene switching times. The image is arranged in the image list. For moving image information with a large number of scene switching times, by arranging a large number of moving image index images in the image list, the user can accurately grasp the contents of the moving image information.

  According to the image processing apparatus of the seventh aspect, in addition to the effect produced by the image processing apparatus of the sixth aspect, when the moving image includes a plurality of scenes, at least one moving image index image is included in the image list for each scene. Since they are arranged, each of a large number of scenes recorded in the moving image information can be grasped more accurately.

  According to the image processing device of the eighth aspect, in addition to the effect produced by the image processing device according to any one of the first to fourth aspects, a larger number of moving image information including a large number of frame images in the moving image. The moving image index images are arranged in the image list. Since a moving image composed of a large number of frame images is expected to contain more scenes, the content of the moving image information can be obtained by placing a larger number of video index images in the image list. Can be accurately grasped by the user.

  According to the image processing device of the ninth aspect, in addition to the effect produced by the image processing device of the second aspect, an appropriate number of moving image index images are obtained based on the number of still image index images arranged in the image list. The image list can be arranged in the image list, and an image list that is easy to view for the user can be output.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a perspective view showing an external configuration of a multifunction peripheral device (hereinafter referred to as “MFP (Multi Function Peripheral)”) 1 which is a first embodiment of an image processing apparatus of the present invention.

  The MFP 1 is a multifunction peripheral device having various functions such as a photo capture function, a copy function, a scanner function, and a media capture function. In the media capture function, a process for reading out an image file from a media card (an example of a storage medium in claims) loaded in a slot unit 6 to be described later and printing it out, an image corresponding to the image file read from the media card is displayed. A process of displaying and outputting on the LCD 5 and a process of storing image data read by the scanner function in a media card can be executed.

  In particular, the MFP 1 according to the present embodiment is configured to print a list of images with good readability in which index images are arranged so that the user can grasp the contents of the image file in the media card mounted in the slot unit 6. The details will be described later.

  A scanner 2 for reading a document is arranged on the top of the MFP 1. In addition, a printer 3 composed of a so-called inkjet printer is built in the housing as a device for printing an image on recording paper.

  A slot 6 is provided on the front surface of the MFP 1. The slot portion 6 is provided with a card slot into which various media cards such as a compact flash (registered trademark) and an SD memory card can be directly inserted.

  An operation panel is provided in front of the document cover body, and includes an operation unit 4 including a plurality of keys and a touch panel, and an LCD 5. The MFP 1 displays the operation procedure and the status of the process being executed on the LCD 5 and also displays information corresponding to the operation of the operation unit 4.

  The electrical configuration of the MFP 1 will be described with reference to FIG. FIG. 2 is a block diagram showing an electrical configuration of the MFP 1. The MFP 1 mainly includes a CPU 11, a ROM 12, a RAM 13, an EEPROM 14, a scanner 2, a printer 3, an operation unit 4, an LCD 5, and a slot unit 6.

  Among these, the CPU 11, ROM 12, RAM 13, and EEPROM 14 are connected to each other via a bus line 26. The scanner 2, the printer 3, the operation unit 4, the LCD 5, the slot unit 6, and the bus line 26 are connected to each other via an input / output port 27.

  The CPU 11 controls each function of the MFP 1 and controls each unit connected to the input / output port 27 according to fixed values and programs stored in the ROM 12, RAM 13, and EEPROM 14.

  The ROM 12 is a non-volatile memory that stores the control program 12a executed by the CPU 11 and can retain the contents even after the power is turned off. The control program 12a includes a program for executing processing shown in flowcharts in FIGS.

  The ROM 12 further includes a horizontal image arrangement number storage area 12b and a one-page image arrangement number storage area 12c.

  The horizontal image arrangement number storage area 12b is an area for storing “the number of horizontal arrangements”. “Number of sheets arranged in the horizontal direction” is a value indicating the number of index images that can be arranged in a horizontal row in the image list. Note that the MFP 1 according to the present embodiment includes a plurality of types of “horizontal arrangement number” according to the print paper size (L, A4, Letter, etc.) and the print mode (high definition, normal, high speed, etc.) in advance. In the arrangement printing process (see FIGS. 12 and 13), which will be described later, an appropriate value is read out and used.

  The one-page image arrangement number storage area 12c is an area for storing “the number of image arrangements in one page”. “Number of images per page” is a value indicating the maximum number of index images that can be arranged in an image list formed on one page of recording paper. In this embodiment, a plurality of types of “number of images per page” are stored in advance according to the print paper size and print mode, and in the layout printing process (see FIGS. 12 and 13) described later. In the following description, a suitable value is read out and used.

  The RAM 13 is a memory for temporarily storing various data when each operation of the MFP 1 is executed. The processed file number storage area 13b, the processed image total number storage area 13c, the generated page number storage area 13d, and the file information storage area 13h, arrangement information storage area 13i, frame image information storage area 13j, decoded data storage area 13k, counter storage area 13m, moving image file number storage area 13o, dynamic range information management area 13s, first survey frame storage area 13t, first Two survey frame storage areas 13u are provided.

  Here, the meaning of terms used in the present embodiment will be described. In the present embodiment, “moving image” means an image reproduced by switching and displaying a large number of frame images. A “moving image file (an example of moving image information described in claims)” is a file for reproducing a moving image, and includes, for example, an AVI moving image file, a quick time moving image file, and the like. However, any information file can be used as long as it can reproduce a moving image. In the present embodiment, “frame image information” means information corresponding to one frame image constituting a moving image.

  The processing file number storage area 13b is an area for storing the “total number of processing files”. The “total number of processed files” is a value indicating the total of still image files (an example of still image information described in claims) and moving image files stored in the media card.

  The processed image total number storage area 13c is an area for storing “total number of processed images”. The “total number of processed images” is a value indicating the total number of index images formed in the image list. The generated page number storage area 13d is an area for storing “number of generated pages”. The “number of generated pages” is a value indicating the total number of pages of the image list output by executing the layout printing process (FIGS. 12 and 13) described later.

  The file information storage area 13h and the arrangement information storage area 13i will be described later with reference to FIGS.

  The frame image information storage area 13j is an area for storing frame image information extracted from the moving image file. The decoded data storage area 13k is an area for storing a result of decoding the frame image information or a result of decoding the still image file.

  The counter storage area 13m is an area for storing various counters. The moving image file number storage area 13o is an area for storing the number of moving image files stored in the media card.

  The dynamic range information management area 13s, the first survey frame storage area 13t, and the second survey frame storage area 13u may not be used in the MFP 1 of the first embodiment, and will be described together with the second embodiment. Description of is omitted. The EEPROM 14 is a rewritable nonvolatile memory.

  FIG. 3 is a diagram showing an example of the image list 20 for one page printed by the MFP 1. As shown in FIG. 3, the image list 20 includes an image group including a moving image index image 21 indicating the contents of a moving image file and a still image index image 22 indicating the contents of a still image file.

  Although details will be described later with reference to FIG. 4, the MFP 1 individually determines the number of frame images to be extracted from the moving image for each moving image file stored in the media card.

  Then, frame image information corresponding to the determined number of frame images is extracted (acquired) from each of the moving image files, and an image obtained by reducing or enlarging the frame image corresponding to the extracted frame image information to a specified size is obtained. The moving image index image 21 is arranged in the image list 20.

  Therefore, it is possible to output an image list 20 with good browsing properties in which an appropriate number of moving image index images 21 are arranged for each moving image.

  Further, when a still image file for outputting a still image is stored in the media card, the MFP 1 converts the still image corresponding to the still image file into an image that has been reduced or enlarged to a specified size, and a still image index. The image 22 is arranged in the image list 20 together with the moving image index image 21.

  Therefore, even when a still image file and a moving image file are mixed on the media card, an image list 20 with good readability is provided so that the contents of the still image file and the moving image file can be visually recognized together. Can be output.

  Further, the MFP 1 determines the arrangement order for each of the index images constituting the index image group so that the image group including the index images 21 and 22 is in ascending order or descending order of the shooting date and time (an example of generation time). The image list 20 in which the index images 21 and 22 are arranged in the determined arrangement order is printed.

  The image list 20 shown in FIG. 3 is an example thereof. For example, the index images 21 and 22 for one horizontal row are arranged in the order in which the shooting date and time are updated from the left side to the right side of the image list 20. The arrangement order for each of the index images 21 and 22 is determined so that the index images 21 and 22 corresponding to the next horizontal row having the latest shooting date and time are arranged below the horizontal row. Therefore, it is possible to output an image list that is easy to view for the user, in which the index images 21 and 22 are arranged in order of photographing date and time.

  As shown in FIG. 3, when a plurality of index images 21 derived from the same moving image file are arranged adjacent to each other, the MFP 1 prints in a form linked with a pattern imitating a movie film, for example. It is going to output. In this way, the user can collectively grasp the index images 21 derived from the same moving image file, and at a glance, the index image 22 corresponding to the still image file and the index image 21 corresponding to the frame image information. Can be distinguished by, and is easy to read.

  FIG. 4 is a diagram schematically illustrating a relationship between the number of frame images extracted from a moving image and the recording time length, which is determined by the MFP 1 according to the first embodiment.

  As shown in FIG. 4, the MFP 1 has a larger number of frame images to be extracted from the moving image as the recording time length of the moving image (that is, the time from the recording start S to the recording end E) is larger. In this way, the number of frame images is determined for each moving image file. More specifically, the number of frame images extracted from each moving image is determined according to the ratio of the recording time length. That is, the number of frames is determined so that a moving image with a longer recording time extracts more frames than a moving image with a shorter recording time.

  In this way, a larger number of moving image index images 21 are arranged in the image list 20 for moving image information with a long recording time. Since a larger number of scenes are expected to be captured in a moving image file having a long recording time, by placing a large number of moving image index images 21 in the image list 20, the contents of the moving image file are The user can be accurately grasped.

  FIG. 5 is a diagram schematically showing the configuration of the file information storage area 13h. As shown in FIG. 5, the file information storage area 13h includes a file ID storage area 201 for storing the file ID, a file name storage area 202 for storing the file name, a file type storage area 203 for storing the file type, and an extraction frame. Extracted frame number storage area 204 for storing the number of frames, total frame number storage area 205 for storing the total number of frames, fps information storage area 206 for storing fps information, file date information storage area 207 for storing file date information, file time A file time information storage area 208 for storing information and a file additional information storage area 209 are provided, and file information 200 including a file name, a file type, the number of extracted frames, fps information, file date information, file time information, and file additional information. The file information 200 Storing information associated with the file ID to. As a preparatory process for determining the arrangement order of the index images 21 and 22 in the image list 20 (see FIG. 3), the MFP 1 stores file information 200 for each of the still image file or the moving image file stored in the media card. It is created and stored in the file information storage area 13h.

  The file ID storage area 201 is an area for storing a file ID. The file name storage area 202 is an area for storing a file name of a still image file or a moving image file. As shown in FIG. 5, an extension is added to each file name. For example, if the image file is a JPEG file, the extension “jpg” is added, if it is an AVI movie file, the extension “avi” is added, and if it is a quick time movie file, the extension “mov” is added. Added.

  The file type storage area 203 is an area for storing a value indicating the type (format) of each image file. The type of the image file can be determined based on, for example, an extension added to the file name. In this embodiment, when the format of the image file is a JPEG file (extension jpg), a value “0” indicating that it is a JPEG file is stored in the file type storage area 203, and the format of the image file is an AVI video file. If it is (extension avi), the value “1” is stored in the file type storage area 203, and if the image file format is a quick time video file (extension mov), the value “2” is stored in the file type storage area. 203.

  Note that the type of the image file can also be determined based on information stored in several bytes from the top of each image file. For example, if the first two bytes are “0xFFD8”, it can be determined that the file is a JPEG file. If the first two bytes are “0x424D”, it can be determined that the data is bitmap data. The type of image file may be determined based on such information.

  The extracted frame number storage area 204 is an area for storing a value indicating how many frame image information corresponding to the number of frame images is to be extracted from the image file. In the case of a still image file, “1” is stored in the extracted frame number storage area 204. In the case of a moving image file, the number of frame image extractions determined by an extraction frame number determination process (see FIG. 9) described later is stored.

  The total frame number storage area 205 is an area for storing the total number of frames of each image file. In the case of a moving image file, the total number of frames included in the moving image file is stored, and in the case of a still image, 1 is always stored.

  The fps information storage area 206 is an area for storing fps (Frame Per Second) information of each image file. If it is a still image file, “0” is stored. On the other hand, in the case of a moving image file, for example, “60” indicating that there are 60 frame images per second, and “30” indicating that there are 30 frame images per second include the fps information. Stored in the storage area 206.

  The file date information storage area 207 is an area for storing file date information indicating the shooting date of each image file. For example, the shooting date “January 15, 2008” is represented as file date information “20080115”.

  The file time information storage area 208 is an area for storing file time information indicating the shooting time of each image file. For example, the shooting time “12:50:45” is represented as file time information “125045”. When the image file is a moving image file, information indicating the shooting start time is stored as file time information.

  In the following description, the total number of frames, fps information, file date information, and file time information are acquired by reading the information described in the header of each image file. You may acquire the information.

  The file additional information storage area 209 is an area for storing other unique information of each image file. In the first embodiment, the file additional information storage area 209 stores recording length information indicating the length of the recording time of the moving image file. The unit of the value shown in the file additional information storage area 209 in FIG. 5 is “seconds”. In the case of a still image file, “1” is uniformly stored in the file additional information storage area 209.

  FIG. 6 is a diagram schematically showing the configuration of the arrangement information storage area 13i. As shown in FIG. 6, the arrangement information storage area 13 i corresponds to the arrangement information 300 including the file ID, the extracted frame position, the extracted frame number, the image date information, the image time information, and the image additional information, and the arrangement information 300. The arrangement order is stored.

  As shown in FIG. 6, the arrangement information storage area 13i includes an arrangement order storage area 301, a file ID storage area 302, an extracted frame position storage area 303, an extracted frame number storage area 304, an image date information storage area 305, an image time. An information storage area 306 is provided.

  The arrangement information storage area 301 is an area for storing the arrangement order. In an arrangement printing process (see FIGS. 12 and 13) described later, arrangement information 300 is read in the order according to the arrangement order, and frame images or still image index images 21 and 22 specified by each arrangement information 300 are displayed. Are arranged in the image list 20 in the order according to the arrangement order.

  The file ID storage area 302 is an area for storing a file ID. As described with reference to FIG. 5, since the file ID and the file name are stored in a one-to-one correspondence in the file information storage area 13h, one image file is specified from the file ID. be able to.

  The extracted frame position storage area 303 is an area for storing an “extracted frame position” indicating what number of frame image information is counted from the beginning in one moving image file. A method for calculating the extracted frame position will be described later.

  The extracted frame number storage area 304 stores an “extracted frame number” indicating the number of frame image information extracted from one moving image file, counting from the beginning.

  The image date information storage area 305 is an area in which image date information indicating the shooting date of the image file specified by the file ID stored in the file ID storage area 302 is stored. The image time information storage area 306 is an area in which image time information representing the shooting time is stored. For still image files, the file time information stored in the corresponding area of the file information storage area 13h is copied to the image time information storage area 306.

  On the other hand, for the moving image file, image time information representing the shooting time is acquired for each frame image information and stored in the image time information storage area 306. A specific calculation example for calculating the image time information for each frame image information will be described later with reference to the flowchart shown in FIG.

  FIG. 7 is a flowchart showing a layout image printing process executed by the MFP 1. This layout image printing process is executed when the user inputs a print output start instruction for the image list 20.

  As shown in FIG. 7, in the layout image printing process, first, file information 200 is created, and an image information acquisition process (S101) for storing in the file information storage area 13h (see FIG. 5) is executed. Details of the processing will be described later with reference to FIG.

  Next, an extraction frame number determination process for determining the number of frame images extracted from the moving image is executed (S101a). Details of the processing will be described later with reference to FIG.

  Next, arrangement information determination processing is executed (S102). In this process, the arrangement order of the index images 21 and 22 is determined. Details of this processing will be described later with reference to FIG. Next, the layout printing process is executed (S103). Details of the layout printing process (S103) will be described later with reference to FIGS.

  The MFP 1 outputs the image list 20 described with reference to FIG. 3 by executing the layout image printing process.

  FIG. 8 is a flowchart showing the image information acquisition process (S101). The image information acquisition process (S101) is a process for creating the file information 200 (see FIG. 5).

  First, the total number of processed files stored in the media card is calculated and stored in the processed file number storage area 13b (S299). Next, the number of moving image files stored in the media card is calculated and stored in the moving image file number storage area 13o (S300).

  Then, a file number counter for counting the number of files is initialized with 0 (S301). This file number counter is provided in the counter storage area 13m (see FIG. 2).

  Next, among the image files stored on the media card, one image file is selected as a processing target, and the file name, file date information, and file time information of the image file are acquired (S302). Then, the acquired file name, file date information, and file time information are stored in an area corresponding to the file ID of the file number counter value (S303). The file name is stored in the file name storage area 202, the file date information is stored in the file date information storage area 207, and the file time information is stored in the file time information storage area 208 (see FIG. 5).

  Next, the type of the selected image file is analyzed (S304). In this process, for example, the type of the image file is determined by analyzing the extension added to the file name. The determined image file type is stored in the file type storage area 203 (see FIG. 5) corresponding to the file ID of the file number counter value (S305).

  Then, based on the acquired type of the image file, it is determined whether the selected image file is a moving image file or a still image file (S306).

  If it is determined in S306 that the file is a moving image file (S306: moving image), recording length information indicating the recording time length of the moving image file is acquired (S307). In the present embodiment, description will be made assuming that recording length information included in header information of a moving image file is acquired. However, for example, the recording length information may be acquired by other means such as a value obtained by dividing the total number of frames by the fps information included in the header information of the moving image file as the recording length information.

  The acquired recording length information is stored in the file additional information storage area 209 (see FIG. 5) corresponding to the file ID of the file number counter value (S308).

  On the other hand, if it is determined in S306 that the file is a still image file (S306: still image), “1” is stored in the file additional information storage area 209 (S309).

  When one of the processes in S308 or S309 is executed in this way, next, 1 is added to the processed image number counter (S310), and the value of the file number counter exceeds the total number of processed files. It is determined whether or not (S311).

  If the determination in S311 is negative (S311: No), the process returns to S302 and is repeated. If the determination is affirmative (S311: Yes), the image information acquisition process (S101) is terminated. And it transfers to the process shown in FIG.

  FIG. 9 is a flowchart showing extraction frame number determination processing (S101a). In the extraction frame number determination process (101a), the number of frame images to be extracted from the moving image is determined for each moving image file stored in the media card.

  First, the file number counter is initialized with 0 (S400). Next, with reference to the file type storage area 203 corresponding to the file ID of the file number counter value, it is determined whether the type of the image file is a moving image or a still image (S402).

  When it is determined that the image is a still image (S402: still image), the frame image extraction number “1” is stored in the extracted frame number storage area 204 (see FIG. 5) corresponding to the file ID of the file counter value (S402a). ), 1 is added to the file number counter (S407). Then, it is determined whether or not the value of the file number counter is equal to or greater than the total number of processed files (S408). If the determination in S408 is negative (S408: No), the process returns to S402 and is repeated.

  On the other hand, when it is determined that the image is a moving image (S402: moving image), the recording length information of the moving image file to be processed is read from the file additional information storage area 209 (see FIG. 5) (S403), and the recording length information is obtained. Is divided by a predetermined unit time to determine the number of extracted frame images (number of extracted frame images) (S404). Note that an integer greater than or equal to 1 is calculated as the number of extracted frame images. The unit time may be configured so that the user can input from the operation unit 4.

  Furthermore, the specific method for calculating the number of frame image extractions is not limited to the above-described example, and another method may be employed. For example, the calculation may be performed by using the “average recording time” obtained by averaging the recording length information of all the moving image files and the prescribed reference extraction number, as shown in Equation 4 below.

(Formula 4)
Number of extracted frame images = (recording length information / average recording time) x reference number of extracted frames

  Next, the determined number of extracted frame images is stored in the extracted frame number storage area 204 (see FIG. 5) corresponding to the file ID of the file number counter value (S406).

  Then, 1 is added to the value of the file number counter (S407), and the process from S402 is repeated while the determination in S408 is negative (S408: No). If the value of the file number counter becomes equal to or greater than the total number of processed files while the process is repeated (S408: Yes), the extracted frame number determination process is terminated.

  In this way, an appropriate number of frame image extractions is determined for each moving image file.

  FIG. 10 is a flowchart showing the arrangement information determination process. First, a file number counter, a processed image number counter, and a frame image extraction number counter are each initialized to 0 (S1001). These counters are provided in the counter storage area 13m (see FIG. 2).

  Next, the type of the image file corresponding to the file ID of the file number counter value is determined (S1002). Initially, since the value of the file number counter is “0”, the type of the image file with the file ID “0” is determined.

  When it is determined that the type of the image file is a moving image (S1002: moving image), file date information indicating the shooting date of the moving image file, file time information indicating the shooting start time of the moving image file, and fps of the moving image file. And the total frame number information indicating the total number of frames of the moving image file are read out from the header of the moving image file (S1003).

  Then, the file date information is stored in the file date information storage area 207 corresponding to the arrangement order of the processed image counter value, the file time information is stored in the file time information storage area 208, and the fps information is stored in the fps information storage area 206. The total frame number information is stored in the total frame number storage area 205 (S1004).

  Next, a process of creating arrangement information for the processing target image file and storing it in the arrangement information storage area 13i (see FIG. 6) is performed. Specifically, first, the current file number counter value is stored as a file ID in the file ID storage area 302 corresponding to the arrangement order of the processed image number counter value. Further, the extracted frame number and the extracted frame position are calculated based on the current frame image extraction number counter value, and are stored in the extracted frame position storage area 303 and the extracted frame number storage area 304, respectively (S1004a).

Note that the extracted frame position can be calculated, for example, as in Equation 5 below.
(Formula 5)
Extraction frame position = (total frame number / extraction frame number) x extraction frame number

  Next, the image time information of the frame image information specified by the extracted frame position is calculated and acquired, and stored in the image time information storage area 306 corresponding to the arrangement order (S1005). In the present embodiment, as an example, image time information is calculated as follows.

  Here, the file time information indicating the shooting start time of the moving image file is VideoTime, the fps information is FPS, the image time information indicating the shooting time of the frame image information is FrameTime, and the extraction frame position of the frame image information to be processed is N. To do.

Then, the file time information VideoTime is decomposed into moving picture time information VT_Hour, moving picture minute information VT_Minute, and moving picture second information VT_Second as shown in Equation 6 below.
(Formula 6)
VT_Hour = [VideoTime / 10000]
VT_Minute = [(VideoTime-VT_Hour × 10000) / 100]
VT_Second = VideoTime-(VT_Hour × 10000 + VT_Minute × 100)
Next, frame time information Frame_Hour, frame portion information Frame_Minute, and frame second information Frame_Second are calculated as shown in Equation 7 below.
(Formula 7)
Here, Cal_Second, Cal_Minute, and Cal_Hour are temporary variables for obtaining the above information.
A mod B represents the remainder when A is divided by B
Cal_Second = VT_Second + [N / FPS]
Cal_Minute = VT_Minute + [Cal_Second / 60]
Cal_Hour = VT_Hour + [Cal_Minute / 60]
Frame_second = Cal_Second mod 60
Frame_Minute = Cal_Minute mod 60
Frame_Hour = Cal_Hour mod 24
The above is combined using, for example, Equation 8 below to calculate image time information FrameTime representing the shooting time of the frame image information.
(Formula 8)
FrameTime = Frame_Hour × 10000 + Frame_Minute × 100 + Frame_Second
Next, an image date calculation process is executed (S1006). The image date calculation process is a process for calculating and obtaining frame year information Frame_Year, frame month information Frame_Month, and frame date information Frame_Day.

  FIG. 11 is a flowchart showing image date calculation processing. Note that a variable M shown in the flowchart of FIG. 11 is a variable that means that M days are advanced from the current date.

  First, moving image year information VD_Year, moving image month information VD_Month, and moving image day information VD_Day are substituted into frame year information Frame_Year, frame month information Frame_Month, and frame date information Frame_Day, respectively (S1201). Next, [Cal_Hour / 24] is substituted into the variable M (S1202). Next, it is determined whether M is 0 (S1203). If the determination is affirmative (S1203: Yes), this process is terminated.

  On the other hand, if negative (S1203: No), the frame date information Frame_Day is judged (S1204). If it is determined that “1 to 27” (S1204: 1 to 27), “1” is added to Frame_Day (S1205).

  On the other hand, if “28 or 29” is determined in the determination in S1204 (S1204: 28 or 29), it is determined whether or not Frame_Month is “2” (S1206). When negative (S1206; No), it transfers to the process of S1205.

  On the other hand, if the determination is affirmative (S1206: Yes), it is next determined whether or not Frame_Day is “28” (S1208). If negative (S1208: No), “1” is substituted into Frame_Day, and “1” is added to Frame_Month (S1210).

  On the other hand, if the determination in S1208 is positive (S1208: Yes), it is determined whether or not the year indicated by Frame_Year is a leap year (S1209). If the determination is affirmative (S1209: Yes), the process proceeds to S1205. When negative (S1209: No), it progresses to the process of S1210.

  Next, if “30” is determined in the determination of S1204 (S1204: 30), it is next determined whether Frame_Month is 4, 6, 9, or 11 (S1211). If the determination is affirmative (S1211: Yes), the process proceeds to S1210.

  On the other hand, if negative (S1211: No), “1” is added to Frame_Day (S1216). Next, if “31” is determined in the determination in S1204 (S1204: 31), it is then determined whether Frame_Year is 12 (S1215). When negative (S1215: No), it progresses to the process of S1216.

  On the other hand, if affirmative (S1215: Yes), “1” is substituted into Frame_Day, “1” is substituted into Frame_Month, and “1” is added to Frame_Year (S1217).

  After the processing of S1205, S1210, S1216, and S1217, “1” is subtracted from the variable M (S1212), and the process returns to S1203. If the determination in S1203 is affirmed (S1203: Yes), this process ends.

Returning to FIG. The values calculated in the process shown in FIG. 11 are combined using, for example, the following formula 11 to calculate image date information FrameDate representing the shooting date of the frame image information. The calculated image date information is stored in the image date information storage area 305 (S1007).
(Formula 11)
FrameDate = Frame_Year × 10000 + Frame_Month × 100 + Frame_Day

  Note that the image time information and the image date information acquired in the processing of S1005 and S1006 correspond to an example of time information described in the claims. Further, the shooting date and time specified by the image time information and the image date information corresponds to an example of the time when the image information is generated, as described in the claims.

  In this way, when the arrangement information is created for one frame image information extracted from the moving image file and stored in the arrangement information storage area 13i, a processed image number counter for counting the number of processed images, Then, “1” is added to the frame image extraction number counter (S1008).

  Then, it is determined whether or not the value of the frame image extraction number counter is equal to or greater than the frame image extraction number determined for the moving image file (S1009). If the determination in S1009 is negative (S1009: No), the process returns to S1004a and the process is repeated.

  On the other hand, if the determination in S1009 is affirmative (S1009: Yes), then the frame image extraction number counter is initialized with 0 (S1010), and 1 is added to the file number counter (S1016). The frame image extraction number counter is provided in the counter storage area 13m (see FIG. 2). Then, it is determined whether or not the value of the file number counter is equal to or greater than the “total number of processed files” indicating the total of still image files and moving image files stored in the media card (S1017). If the determination in S1017 is negative (S1017: No), the process returns to S1002, and the next image file corresponding to the file ID of the file number counter value is selected as a processing target, and the process is repeated.

  Next, a case where it is determined that the image file to be processed is a still image file (S1002: still image) will be described. Similarly, in the case of a still image file, first, file information relating to the still image file is created and stored in the file information storage area 13h (see FIG. 4).

  Specifically, first, the current file number counter value is stored in the file ID storage area 302 (see FIG. 6) corresponding to the arrangement order of the processed image number counter value, and the extracted frame position storage area 303 and the extracted frame are stored. “1” is stored in the number storage area 304 (see FIG. 6) (S1011a). Then, file date information indicating the shooting date of the still image file to be processed and file time information indicating the shooting time are read (obtained) (S1011), and the file ID of the file number counter value in the file information storage area 13h is read. The acquired file date information and file time information are stored in the corresponding area (S1012). Note that “0” is stored in the fps information storage area 206. Here, the file date information and the file time information correspond to an example of the time information described in the claims. Further, the shooting date and time specified by the file date information and the file time information corresponds to an example of the time when the image information is generated as described in the claims.

  Next, the file date information of the still image file to be processed corresponding to the file ID of the file number counter value is set to the image date corresponding to the arrangement order of the processed image number counter value in the arrangement information storage area 13i (see FIG. 6). The information is stored in the information storage area 305, and the file time information of the still image file to be processed is stored in the image time information storage area 306 corresponding to the same arrangement order (S1013). Then, 1 is added to the processed image number counter (S1015), and the process proceeds to S1016.

  If the determination in S1017 is affirmed while the processing is repeated in this way (S1017: Yes), then the arrangement information is sorted in ascending order of the image time information (S1018), and the arrangement information determination process (S102) is performed. finish. Through the arrangement information determination process (S102), the corresponding arrangement order is determined for each of the index images 21 and 22 specified by the arrangement information.

  FIG. 12 is a flowchart showing the layout printing process. In the layout print process (S103) shown in FIG. 12, the image list 20 in which the index images 21 and 22 are arranged in the order determined by the layout information determination process (S102; see FIG. 10) is printed out on a recording sheet.

  First, the “horizontal arrangement number” indicating the number of index images 21 and 22 for one horizontal row arranged in the image list 20 is read from the horizontal image arrangement number storage area 12b (S1101). Next, the “number of images in one page” indicating the number of index images 21 and 22 that can be arranged in the image list 20 for one page is read from the image arrangement number storage area 12c in one page (S1102).

  Next, the page counter is initialized with 1 (S1103), and the “total number of processed images”, which is the sum of the total number of still image files and the total number of extracted frame images, is stored in the total processed image storage area 13c (FIG. 2) (S1104). The page counter is provided in the counter storage area 13m.

  Next, a “generated page number” indicating how many pages of the image list are to be printed out is calculated from the total number of processed images and the number of images arranged per page, and the generated page number storage area 13d (see FIG. 2). (S1105).

In the present embodiment, the number of generated pages page_no is calculated using the following formula 12. Here, the total number of processed images is TotalImageNo, and the number of images arranged in one page is LAYOUT_NUM.
(Formula 12)
page_no = [TotalImageNo / LAYOUT_NUM] + 1
Next, the layout image counter is initialized to 0 (S1106), and the number of layout images layout_no to be placed on one sheet of recording paper is calculated (S1107). In the present embodiment, layout_no is calculated using Equation 13 below. The layout image counter is provided in the counter storage area 13m.
(Formula 13)
(Page counter value) <Number of generated pages
layout_no = (Number of images on one page)
(Page counter value) ≥ Number of generated pages
layout_no = (number of group images)-{(number of images in one page) x (page counter value)}
Next, the file ID corresponding to the arrangement order and the extracted frame number are read from the arrangement information storage area 13i (S1108). Then, it is determined whether the image file corresponding to the read file ID is a moving image file or a still image file (S1109).

  If it is determined in S1109 that the file is a moving image file (S1109: moving image), then frame image information for one frame image corresponding to the extracted frame number is extracted from the moving image file (S1110).

  Next, the extracted frame image information is decoded (S1111). Then, the decoded frame image information is reduced or enlarged to the specified size of the index images 21 and 22, and is arranged at a predetermined position in the arrangement buffer (S1112).

  On the other hand, if it is determined in S1109 that the file is a still image file (S1109: still image), the still image file specified by the file ID corresponding to the arrangement order is extracted, decoded (S1113), and decoded. The obtained still image file is reduced or enlarged to the specified size of the index images 21 and 22, and is arranged at a predetermined position in the arrangement buffer (S1114).

  In this way, after executing the placement processing for decoding either the frame image information or the still image file and placing it in the placement buffer, the “horizontal direction” is the upper limit of the number of images that can be placed in the horizontal direction. It is determined whether or not the arrangement processing for “number of arrangements” has been performed (S1115). If the determination in S1115 is negative (S1115: No), the horizontal position indicating the arrangement position of the next data in the arrangement buffer is updated (S1119).

  Then, “1” is added to the layout image counter (S1120), and it is determined whether or not the value of the layout image counter is equal to or larger than the number “layout_no” of the index images 21 and 22 to be arranged on the current recording paper to be processed. Judgment is made (S1121). If the determination in S1121 is negative (S1121: No), the process returns to S1108, and arrangement information corresponding to the next arrangement order is processed.

  If the arrangement processing for “the number of arrangements in the horizontal direction” is executed while the processing is repeated in this way, the determination in S1115 is affirmed (S1115: Yes). Next, the data in the arrangement buffer is stored. The data is transferred to the printer 3 (see FIG. 2) (S1116). As a result, the data in the placement buffer is subjected to print processing in the printer 3. However, an area where no image is arranged in the arrangement buffer is not printed out.

  Next, the horizontal position indicating the horizontal arrangement position of the next data in the arrangement buffer is initialized (S1117), and the vertical position indicating the vertical arrangement position of the next data in the arrangement buffer is updated (S1117). S1118). The arrangement position of the next data in the arrangement buffer is determined by the horizontal position and the vertical position so that the next index images 21 and 22 are arranged from the left end of the next row in the image list 20. And the process of S1120 and S1121 mentioned above is performed.

  In this way, when the printing process is completed for all the index images 21 and 22 arranged on the recording paper for one page to be processed, the determination in S1121 is affirmed (S1121: Yes), so the next shown in FIG. Move on to processing.

  FIG. 13 is a flowchart showing the continuation of the layout printing process shown in FIG. 12, and is executed when the determination in S1121 is affirmed.

  First, it is determined whether there is data that has not yet undergone printing processing in the arrangement buffer (S1122). If the determination in S1122 is affirmative (S1122: Yes), the remaining data is transferred to the printer 3 (S1123), the printer 3 prints out, and the process proceeds to S1124. On the other hand, if the determination in S1122 is negative (S1122: No), the determination in S1123 is skipped and the process proceeds to S1124.

  Then, a print completion command indicating that data output for one page has been completed is passed to the printer 3 (S1124), and “1” is added to the page counter (S1125). Next, the horizontal position and the vertical position indicating the arrangement position of the next data in the arrangement buffer are initialized (S1126). Then, it is determined whether the value of the page counter is larger than “number of generated pages” (S1127). If the determination in S1127 is negative (S1127: No), the process returns to S1106 shown in FIG. 12, and the process for the next page is started.

  On the other hand, if the determination in S1127 is affirmative (S1127: Yes), the layout printing process ends.

  In the layout printing process (S103) shown in FIGS. 12 and 13, when index images 21 derived from the same moving image file are adjacent to each other in the image list 20, the index images 21 and 22 are connected. The pattern to be printed (see FIG. 3) may be formed and printed, but the details of the process will be omitted.

  As described above, according to the MFP 1 of the first embodiment, as described with reference to FIG. 3, it is possible to output the image list 20 with good viewability.

  Next, the MFP 1 according to the second embodiment will be described. Note that since the external configuration and electrical configuration of the MFP 1 of the second embodiment are the same as those of the MFP 1 of the first embodiment, only the extraction frame number determination process is illustrated for the MFP 1 of the second embodiment.

  14 and 15 are flowcharts showing the extracted frame number determination process (S101b) executed by the MFP 1 of the second embodiment. This extracted frame number determination process (S101b) is executed instead of the extracted frame number determination process (S101a) described in the first embodiment.

  In the extraction frame number determination process (S101b) of the second embodiment, the larger the number of scene switching included in a moving image, the larger the number of frame images extracted from the moving image (the number of frame image extractions). In addition, it is a process for determining the number of frame image extractions for each moving image file.

  First, a file number counter, an extracted frame number counter, and a processed image number counter are initialized with 0 (S501).

  Next, referring to the file type storage area 203 (see FIG. 5) corresponding to the file number counter value, it is determined whether the type of the image file is a moving image file or a still image file (S502). If it is determined that the file is a still image file (S502: still image), the process proceeds to S525 shown in FIG.

  On the other hand, when it is determined that the file is a moving image file (S502: moving image), the file ID is read from the file ID storage area 201 corresponding to the file number counter value (S503). Then, the total number of frames is read from the moving image file corresponding to the file ID, and stored in the total frame number storage area 205 corresponding to the file number counter value (S504).

Next, the fps information corresponding to the file number counter value is read from the fps information storage area 206, and the survey frame extraction interval is calculated based on the fps information (S507). The survey frame extraction interval can be calculated based on Equation 15 below, for example.
(Formula 15)
Survey frame extraction interval = (fps information / interval coefficient)
The interval coefficient may be a predetermined fixed value, or may be configured to be set by the user from the operation unit 4.

Next, the number of survey frames is calculated from the total number of frames and the survey frame extraction interval (S507). The number of survey frames can be calculated based on, for example, Equation 16 below.
(Formula 16)
Number of survey frames = [total number of frames / survey frame extraction interval]

  Next, the extracted frame number counter is initialized with “0” (S509). Then, using the value obtained by multiplying the extracted frame number counter value by the frame extraction interval as the frame extraction position, the frame image information specified at the frame extraction position is extracted (S510).

  Then, the frame image information is stored in the first survey frame storage area 13t (see FIG. 2) (S511). Then, “1” is added to the extracted frame number counter (S512), and the process proceeds to the process shown in FIG.

  FIG. 15 is a process showing the latter half of the extracted frame determination process (S101b) shown in FIG. First, frame image information specified by the frame extraction position is extracted using a value obtained by multiplying the extracted frame number counter value by the frame extraction interval as a frame extraction position (S513).

  Next, the frame image information is stored in the second survey frame storage area 13u (see FIG. 2) (S514). Then, the difference between the frame image information stored in the second survey frame storage area 13u and the frame image information stored in the first survey frame storage area 13t is calculated (S515).

  Specifically, a difference between pixel values is calculated for each pixel, and a value obtained by adding the differences for all pixels is calculated as a difference between two pieces of frame image information. However, from the viewpoint of processing speed, the difference between the pixel values may be calculated only for a predetermined number of points, and the sum of the differences may be used as the difference between the two frame image information.

  Next, it is determined whether or not the calculated difference is greater than or equal to a threshold value (S516). Here, the threshold value is assumed to be a predetermined fixed value in order to detect whether or not the scene has been switched between the previously extracted frame image information and the currently extracted frame image information. As will be described, the user may be configured to be able to set from the operation unit 4.

  When judgment of S516 is denied (S516: No), it transfers to S519. On the other hand, if the determination in S516 is affirmative (S516: Yes), that is, if switching of a scene included in the moving image is detected, “1” is added to the extracted frame number counter and the processed image number counter (S517). ).

  Then, the frame extraction position calculated in the process of S513 is stored in the extracted frame position storage area 303 (see FIG. 6) corresponding to the processed image number counter value, and the current extracted frame number counter value is stored in the extracted frame number storage. It memorize | stores in the area | region 304 (S518).

  Next, the data in the second survey frame storage area 13u is stored in the first survey frame storage area 13t (S519), and "1" is added to the extracted frame number counter (S520).

  Next, it is determined whether or not the extracted frame number counter value is greater than or equal to the number of survey frames (S521). While the determination in S521 is negative (S521: No), the process returns to S513 and is repeated.

  That is, the frame extraction position is the extracted frame position storage area so that the frame image information for which the difference from the previously extracted frame image information is determined to be greater than or equal to the threshold is extracted in the layout printing process to be executed later. 303 is stored.

  As a result, when a plurality of scenes are included in the moving image to be processed, at least one frame image is extracted from each scene, and the frame extraction position is set such that the moving image index image 21 is arranged in the image list 20. Can be determined.

  If the determination in S521 is affirmative (S521: Yes), then the number of scene switching is stored in the file additional storage area 209 (see FIG. 5) corresponding to the file number counter value (S522).

  Next, the current extracted frame number counter value is determined as the number of frame images to be extracted from the processing target moving image, and stored in the extracted frame number storage area 204 corresponding to the file number counter value (S524). Then, the extracted frame number counter value is initialized with “0” (S525), and the file number counter is incremented by “1” (S526).

  Next, it is determined whether or not the file number counter value is equal to or greater than the total number of processed files (S527). If the determination in S527 is negative (S527: No), the process returns to S502 and the process is repeated.

  If the determination in S527 is affirmed while the process is repeated in this manner (S527: Yes), the extracted frame number determination process (S101b) is terminated.

  Similarly to the MFP 1 of the first embodiment, the MFP 1 of the second embodiment also receives frame image information corresponding to the number of frame images determined by the extracted frame number determination process in the layout printing process (S103) executed later. Extracted and output as a moving image index image 22.

  Therefore, according to the MFP 1 of the second embodiment, a larger number of moving image index images 21 are arranged in the image list 20 for a moving image file having a large number of scene switching times. For a moving image file with a large number of scene switching times, by arranging a large number of moving image index images 21 in the image list 20, the contents of the moving image file can be accurately grasped by the user.

  In addition, even when a moving image includes a plurality of scenes, at least one moving image index image 21 is arranged in the image list 20 for each scene, and thus a large number of scenes recorded in the moving image file. Each can be grasped more accurately.

  Next, the MFP 1 according to the third embodiment will be described. Note that since the external configuration and electrical configuration of the MFP 1 of the third embodiment are the same as those of the MFP 1 of the first embodiment, only the extracted frame number determination process is illustrated for the MFP 1 of the third embodiment.

  FIG. 16 is a flowchart illustrating the extracted frame number determination process (S101c) executed by the MFP 1 of the third embodiment. This extracted frame number determination process (S101c) is executed instead of the extracted frame number determination process (S101a) described in the first embodiment. Note that the extracted frame number determination process (S101c) of the third embodiment includes processes of S601 to S603 instead of the processes of S403 and S404 in the extracted frame number determination process (S101a) of the first embodiment described above. In other respects, the other components are the same, and the same components are denoted by the same reference numerals and the description thereof is omitted.

As shown in FIG. 16, the extracted frame number determination process (S101c) of the third embodiment reads the total frame number of the moving image file to be processed (S601), and stores it in the total frame number storage area 205 (see FIG. 5). Store (S602). Then, the number of frame image extractions is calculated from the total number of frames, for example, by using either the following formula A or formula B.
(Formula A)
Number of extracted frame images = total number of frames / number of unit frames Here, the number of unit frames may be a predetermined value or may be configured so that the user can input from the operation unit 4.
(Formula B)
Number of extracted frame images = (total number of frames / average total number of frames) × reference number of extracted frames Here, the average total number of frames is a value obtained by averaging the total number of frames of all moving image files. It may be configured to be a value, or may be configured so that the user can input from the operation unit 4.

  According to the MFP 1 of the third embodiment, for a moving image file in which a large number of frame images are included in a moving image, a large value is determined as the number of extracted frame images. 20 will be arranged. Since a moving image composed of a large number of frame images is expected to include a larger number of scenes, a larger number of moving image index images 21 are arranged in the image list 20, thereby moving the moving image file. It is possible to allow the user to accurately grasp the contents of.

  The present invention has been described above based on the embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications and changes can be easily made without departing from the spirit of the present invention. Can be inferred.

  For example, in the present embodiment, the image list 20 is described as being printed out on recording paper. However, the present invention can also be applied to the case where the image list 20 is displayed on a display device such as the LCD 5.

  The present invention is also applied to, for example, a case where the present invention is applied to a personal computer and the image list 20 is displayed on a PC monitor, or the image list is printed out by controlling the printer from the personal computer. Can be applied.

  Further, the extraction frame number determination process (S101a, S101b, S101c) described in the above embodiment is modified, and the frame image extraction number is determined based on, for example, the number of still image index images 22 arranged in the image list 20. You may comprise so that it may do.

  For example, in the extracted frame number determination process (101a) of the first embodiment, first, the number of still image files stored in the media card is calculated. For example, when the number is 10 (that is, when the number of still image index images 22 to be arranged in the image list 20 is 10), the number of the still image index images 22 is increased. Based on this, the maximum number of moving images extracted with one longest recording time is set to a number such as 10 frames or 20 frames.

  Then, if there is a moving image file whose recording time is shorter than that of the moving image, each moving image file is multiplied by the ratio of the recording time of each moving image to the longest recording time by the previously calculated maximum number of extracted images. The number of frame image extractions is determined. In this way, the number of frame image extractions based on the number of still image index images 22 can be determined.

  The maximum number of moving images extracted with respect to the number of still image indexes 22 may be stored in a table in advance, or the same number as the number of still image indexes 22 may be set as the maximum number of extracted images. Further, it may be derived by a specific formula using the number of still image index images 22.

  Further, as a modification example in which the number of frame images extracted is determined based on the number of still image index images 22, the following example is also conceivable. For example, the number of frame image extractions is calculated by substituting the number of still image index images 22 into the “reference extraction number” of Equation 4 or Equation B above. Even in this case, the number of frame image extractions can be determined based on the number of still image index images 22 (that is, having a certain correlation with the number of still image index images 22).

  If the number of frame image extractions is determined based on the number of still image index images 22 as in this modification, it is possible to provide an image list 20 that is easy to view for the user. For example, when a still image file and a moving image file are stored in a recording medium one by one, if there are 100 frames extracted from a moving image file, one of 100 moving image index images 21 The still image index image 22 may be confused. In such a case, even if the image list 20 is printed, it is very troublesome for the user to check where the still image index image 21 is printed and what kind of still image it is. According to this modification, for example, if the number of still images and the “reference extraction number” of frames are set to the same value, the balance between the number of still images and the number of frame images can be maintained. Troublesomeness is reduced.

  In the above-described embodiment, the moving image file and the still image file are both assumed to be image files generated by shooting. However, the moving image file and the still image file are generated by a method other than shooting. Even if it is a thing, this invention is applicable. In this case, the arrangement order of the index images 21 and 22 is determined based on other conditions such as file generation date / time information indicating file creation date / time and file update date / time information instead of the shooting date / time. It may be configured.

  In the above-described embodiment, the case where a still image file and a moving image file are mixed in the media card has been described. Is applicable.

  In the above-described embodiment, the image information stored in the removable media card is the processing target. However, the present invention is also applicable to the case where the image information stored in the internal memory of the MFP 1 is the processing target. Applicable.

  Further, the number of frame image extractions may be determined based on conditions other than the above embodiment. For example, an analysis unit that analyzes voice information included in the moving image information, and a voice analysis unit that detects the number of times or time when the volume exceeds a threshold based on the analysis by the analysis unit, the voice analysis unit The number of frame images may be determined for each of the moving image information so that the larger the number of times or time detected by the above, the larger the number of frame images cut out from the moving image. Further, a position corresponding to a scene where a loud sound is recorded may be determined as the frame extraction position.

  Alternatively, only the sound of a specific frequency may be detected for the number of times or time when the sound is detected.

  Furthermore, in the above-described embodiment, the arrangement order is sorted based on the shooting date and time. However, the arrangement order is changed under other conditions such as a dynamic range, average luminance, and whether or not a face is included in an image. You may sort.

1 is a perspective view showing an external configuration of an MFP that is a first embodiment of an image processing apparatus according to the present invention; FIG. 2 is a block diagram illustrating an electrical configuration of the MFP. FIG. FIG. 3 is a diagram illustrating an example of an image list for one page output from an MFP. FIG. 6 is a diagram schematically showing a relationship between the number of frame images extracted from a moving image and the recording time length determined by the MFP. It is a figure which shows typically the structure of a file information storage area. It is a figure which shows typically the structure of an arrangement | positioning information storage area. 6 is a flowchart illustrating a layout image printing process executed by the MFP. It is a flowchart which shows an image information acquisition process. It is a flowchart which shows an extraction frame number determination process. It is a flowchart which shows arrangement | positioning information determination processing. It is a flowchart which shows an image date calculation process. It is a flowchart which shows arrangement | positioning printing processing. 13 is a flowchart showing a continuation of the layout printing process shown in FIG. 10 is a flowchart illustrating extraction frame number determination processing executed by the MFP according to the second embodiment. FIG. 15 is a flowchart showing a continuation of the extracted frame number determination process shown in FIG. 14. FIG. 12 is a flowchart illustrating extraction frame number determination processing executed by the MFP of the third embodiment.

Explanation of symbols

1 MFP (an example of an image processing apparatus)
20 Image List 21 Movie Index Image 22 Still Image Index Image S101a Extracted Frame Number Determination Process (Example of Extracted Frame Number Determination Unit)
S101b Extracted frame number determination processing (an example of extracted frame number determination means)
S101c Extracted frame number determination processing (an example of extracted frame number determination means)
S1110 Example of frame image acquisition means S102 Arrangement information determination processing (example of order determination means)
S103 Arrangement printing process (an example of output means)
S516 An example of switching detection means S1005 An example of time information acquisition means S1006 An example of time information acquisition means S1011 An example of time information acquisition means

Claims (9)

An image processing apparatus for processing moving image information for reproducing a moving image,
Extraction frame number determining means for determining the number of frame images extracted from a moving image for each of one or more pieces of moving image information stored in a storage medium;
Frame image acquisition means for acquiring frame image information corresponding to the number of frame images determined by the extracted frame number determination means from each of the moving image information;
Based on the frame image information acquired by the frame image acquisition means, an output means for outputting an image list in which frame images corresponding to the frame image information or reduced or enlarged images of the frame images are arranged as moving image index images An image processing apparatus comprising: The output means includes
When still image information for outputting a still image is stored in the storage medium, a still image index image composed of a still image corresponding to the still image information or a reduced or enlarged image of the still image is The image processing apparatus according to claim 1, wherein a list of images arranged together with the moving image index image is output. An arrangement order is determined for each of the index images constituting the index image group so that the index image group including the moving image index image and the still image index image is arranged in an order according to a predetermined condition. Order determination means for
The image processing apparatus according to claim 2, wherein the output unit outputs an image list in which the index image group is arranged in the arrangement order determined by the order determination unit. For each of the still image information and the frame image information, a time information acquisition unit that acquires time information for specifying a time when the image information is generated is provided.
The arrangement order determining means includes
With the time information acquired by the time information acquisition means as the predetermined condition, the arrangement order is set for each of the index images constituting the index image group so that the time specified by the time information is in ascending or descending order. The image processing apparatus according to claim 3, wherein the determination is performed.   The extracted frame number determining means determines the frame image of each of the moving image information so that the larger the recording time length of the moving image, the larger the number of frame images extracted from the moving image. The image processing apparatus according to claim 1, wherein the number of sheets is determined. Comprising switching detection means for detecting switching of a scene included in the moving image;
For each of the moving image information, the extracted frame number determining unit increases the number of frame images extracted from the moving image as the number of scene switching detected by the switching detection unit increases. 5. The image processing apparatus according to claim 1, wherein the number of frame images is determined. The frame image acquisition means includes
The image processing apparatus according to claim 6, wherein when a moving image includes a plurality of scenes, frame image information is acquired for each scene so that at least one frame image is extracted from each scene.   The extracted frame number determining means determines the frame image for each of the moving image information so that the larger the total number of frame images included in the moving image, the larger the number of frame images extracted from the moving image. The image processing apparatus according to claim 1, wherein the number of images is determined. The extracted frame number determining means includes:
3. The image processing apparatus according to claim 2, wherein the number of frame images extracted from the moving image is determined based on the number of the still image index images arranged in the image list output by the output unit. .

Images