JP2009241551A - Image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor able to output a highly user-friendly image list. <P>SOLUTION: Management information is assigned to each extracted frame image information. A moving image index is formed for each extracted frame image information and output as an image list, the moving image index including a frame image corresponding to the frame image information or a reduced or enlarged image of the frame image and control information assigned to the frame image information. That makes it possible to provide a highly user-friendly image list. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus.

  In recent years, since a moving image and a still image can be shot using a digital camera, there are cases in which a moving image and a still image are shot separately according to a shooting scene. For example, a scene without motion such as a group photo can be shot as a still image, and a scene with motion such as a sports day scene can be shot as a moving image.

There has also been proposed an apparatus that prints out a moving image or a still image captured by such a digital camera or displays it on a display.
JP 2005-130254 A JP 9-322113 A

  However, in the image list output by the apparatus as described above, the moving image and the still image are simply arranged, and a sufficiently convenient image list cannot be output.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide an image processing apparatus capable of outputting a highly convenient image list.

  In order to achieve this object, the image processing apparatus according to claim 1 corresponds to a frame image extracted from the moving image when the moving image information for reproducing the moving image is stored in the storage medium. Extracting means for extracting the frame image information from each of the moving image information stored in the storage medium, management information assigning means for assigning management information to each of the frame image information extracted by the extracting means, A moving image index including a frame image corresponding to the frame image information or a reduced or enlarged image of the frame image and management information allocated to the frame image information by the management information allocation unit is extracted by the extraction unit. Output means for generating each frame image information and outputting it as an image list.

  The image processing apparatus according to claim 2 is the image processing apparatus according to claim 1, wherein the management information assigning unit stores still image information for outputting a still image in the storage medium together with the moving image information. Management information is assigned to each of the frame image information and the still image information, and the output means includes a still image corresponding to the still image information or a reduced or enlarged image of the still image, and The image list in which the still image index including the management information assigned to the still image information by the management information assigning unit is arranged together with the moving image index is output.

  According to a third aspect of the present invention, in the image processing apparatus according to the second aspect, the management information designating means for designating one of the management information and the management information designated by the management information designating means are assigned. There is provided designated image output means for outputting an image corresponding to the received frame image information or still image information.

  The image processing apparatus according to claim 4, further comprising: classification means for classifying an image information group including the frame image information and the still image information into a plurality of groups in the image processing apparatus according to claim 3. The means outputs the image list for each group classified by the classification means.

  The image processing device according to claim 5 is the image processing device according to claim 4, wherein the management information assigning unit is configured to provide each of the frame image information or the still image information classified into the same group by the classification unit. Assign the only management information in the group.

  The image processing device according to claim 6 is classified into a group designating unit for designating one of the groups and a group designated by the group designating unit in the image processing device according to claim 4 or 5. For each of the frame image information or the still image information, designated group output means for outputting an image corresponding to the image information is provided.

  The image processing device according to claim 7 is the image processing device according to any one of claims 1 to 6, wherein the extraction unit includes frame image information corresponding to a plurality of frame images from each of the moving image information. To extract.

  According to the image processing device of claim 1, each of the moving image indexes arranged in the image list is assigned to a frame image corresponding to the frame image information or a reduced or enlarged image of the frame image, and the frame image information. Management information. Therefore, there is an effect that it is possible to output a convenient image list that allows the user to specify a desired frame image using the management information. Therefore, for example, even when viewing a list of images with a large number of similar-image video indexes arranged by multiple people, by specifying the management information, each person can easily identify the specified frame image. can do.

  According to the image processing device according to claim 2, in addition to the effect produced by the image processing device according to claim 1, a highly convenient image list capable of browsing the moving image index and the still image index all at once. Can be output. In addition, since the moving image index and the still image index each include management information, even if a frame image and a still image are mixed in the image list, the user can easily select a desired image using the management information. Can be specified.

  According to the image processing device according to claim 3, in addition to the effect produced by the image processing device according to claim 2, the user grasps management information assigned to desired frame image information or still image information from the image list. The management information can be used to output a desired image.

  According to the image processing apparatus of the fourth aspect, in addition to the effect produced by the image processing apparatus of the third aspect, an image list is output for each group, so that the user can easily find a desired image. A convenient image list can be output.

  According to the image processing device of claim 5, in addition to the effect produced by the image processing device of claim 4, each frame image information or still image information classified into the same group is unique in the group. Since the management information is allocated, it is possible to output a convenient image list that can uniquely identify the images in the group based on the management information.

  According to the image processing device of the sixth aspect, in addition to the effect produced by the image processing device according to the fourth or fifth aspect, the user determines a desired group from the image list, and is classified into the desired group. Images can be output.

  According to the image processing device of claim 7, in addition to the effect produced by the image processing device according to any one of claims 1 to 6, frame image information corresponding to a plurality of frame images from each of the moving image information Therefore, it is possible to make the user grasp the temporal change of the image recorded in each moving image information.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a perspective view showing an external configuration of a multifunction peripheral device (hereinafter referred to as “MFP (Multi Function Peripheral)”) 1 which is an embodiment of an image processing apparatus of the present invention.

  The MFP 1 is a multifunction peripheral device having various functions such as a photo capture function, a copy function, a scanner function, and a media capture function. In the media capture function, a process for reading out an image file from a media card (an example of a storage medium in claims) loaded in a slot unit 6 to be described later and printing it out, an image corresponding to the image file read from the media card is displayed. A process of displaying and outputting on the LCD 5 and a process of storing image data read by the scanner function in a media card can be executed.

  In particular, the MFP 1 according to the present embodiment has a configuration for outputting a highly convenient image list so that the user can grasp the contents of the image file in the media card mounted in the slot unit 6. To do.

  A scanner 2 for reading a document is arranged on the top of the MFP 1. In addition, a printer 3 composed of a so-called inkjet printer is built in the housing as a device for printing an image on recording paper.

  A slot 6 is provided on the front surface of the MFP 1. The slot portion 6 is provided with a card slot into which various media cards such as a compact flash (registered trademark) and an SD memory card can be directly inserted.

  In addition, an operation panel is provided in front of the document cover body, and includes an operation unit 4 including a plurality of keys and a touch panel, and an LCD 5. The MFP 1 displays the operation procedure and the status of the process being executed on the LCD 5 and also displays information corresponding to the operation of the operation unit 4.

  The electrical configuration of the MFP 1 will be described with reference to FIG. FIG. 2 is a block diagram showing an electrical configuration of the MFP 1. The MFP 1 mainly includes a CPU 11, a ROM 12, a RAM 13, an EEPROM 14, a scanner 2, a printer 3, an operation unit 4, an LCD 5, and a slot unit 6.

  Among these, the CPU 11, ROM 12, RAM 13, and EEPROM 14 are connected to each other via a bus line 26. The scanner 2, the printer 3, the operation unit 4, the LCD 5, the slot unit 6, and the bus line 26 are connected to each other via an input / output port 27.

  The CPU 11 controls each function of the MFP 1 and controls each unit connected to the input / output port 27 according to fixed values and programs stored in the ROM 12, RAM 13, and EEPROM 14.

  The ROM 12 is a non-volatile memory that stores the control program 12a executed by the CPU 11 and can retain the contents even after the power is turned off. The control program 12a includes a program for executing processing shown in flowcharts in FIGS.

  The ROM 12 further includes a horizontal image arrangement number storage area 12b and a one-page image arrangement number storage area 12c.

  The horizontal image arrangement number storage area 12b is an area for storing “the number of horizontal arrangements”. The “number of horizontal arrangements” is a value indicating the number of indexes that can be arranged in a horizontal row in the image list. Note that the MFP 1 according to the present embodiment includes a plurality of types of “horizontal arrangement number” according to the print paper size (L, A4, Letter, etc.) and the print mode (high definition, normal, high speed, etc.) in advance. Is stored, and an appropriate value is read out and used in the layout printing process (see FIG. 13) described later.

  The one-page image arrangement number storage area 12c is an area for storing “the number of image arrangements in one page”. “Number of images arranged in one page” is a value indicating the maximum number of indexes that can be arranged in an image list formed on one page of recording paper. In the present embodiment, a plurality of types of “number of images per page” are stored in advance according to the print paper size and print mode, and in the layout printing process (see FIG. 13) described later, A suitable value is read from and used.

  The RAM 13 is a memory for temporarily storing various data when each operation of the MFP 1 is executed. The extracted frame number storage area 13a, the processed file number storage area 13b, the processed image total number storage area 13c, and the generated page number storage. An area 13d, a group information storage area 13g, a file information storage area 13h, an arrangement information storage area 13i, a frame image information storage area 13j, a decoded data storage area 13k, a counter storage area 13m, and an image management information storage area 13n are provided. .

  Here, the meaning of terms used in the present embodiment will be described. In the present embodiment, “moving image” means an image reproduced by switching and displaying a large number of frame images. A “moving image file (an example of moving image information described in claims)” is a file for reproducing a moving image, and includes, for example, an AVI moving image file, a quick time moving image file, and the like. However, any information file can be used as long as it can reproduce a moving image. In the present embodiment, “frame image information” means information corresponding to one frame image constituting a moving image.

  The extracted frame number storage area 13a is an area for storing “the number of frame images extracted”. The “number of frame image extractions” is a value indicating how many frame images corresponding to one moving image file are to be extracted. For example, when “5” is stored as the “number of extracted frame images”, the MFP 1 corresponds to five frame images per moving image file for each moving image file stored in the media card. Frame image information is extracted, and five indexes per moving image file are arranged in the image list based on the extracted frame image information.

  The MFP 1 according to the present embodiment will be described assuming that an arbitrary value input by the user from the operation unit 4 is stored as the “frame image extraction number” in the extracted frame number storage area 13a. It may be stored in the ROM 12 or the like.

  The processing file number storage area 13b is an area for storing the “total number of processing files”. The “total number of processed files” is a value indicating the total of still image files (an example of still image information described in claims) and moving image files stored in the media card.

  The processed image total number storage area 13c is an area for storing “total number of processed images”. The “total number of processed images” is a value indicating the total number of indexes formed in the image list. The generated page number storage area 13d is an area for storing “number of generated pages” indicating the number of pages of the image list to be output by executing the layout printing process (see FIG. 13) described later.

  The group information storage area 13g, the file information storage area 13h, and the arrangement information storage area 13i will be described later with reference to FIGS.

  The frame image information storage area 13j is an area for storing frame image information extracted from the moving image file. The decoded data storage area 13k is an area for storing a result of decoding the frame image information or a result of decoding the still image file.

  The counter storage area 13m is an area for storing various counters. The EEPROM 14 is a rewritable nonvolatile memory. The image management information storage area 13n will be described later with reference to FIG.

  FIG. 3 is a diagram illustrating an example of the image list 20 output by the MFP 1. As shown in FIG. 3, a moving image index 21 or a still image index 22 is arranged in the image list 20.

  First, the moving image index 21 will be described. When a moving image file for reproducing a moving image is stored in the media card, the MFP 1 displays frame image information corresponding to the frame image extracted from the moving image for each moving image file stored in the media card. Extract from

  A management number (an example of management information) is assigned to each piece of extracted frame image information. Then, a moving image index 21 including a thumbnail 211 in which a frame image corresponding to the extracted frame image information is enlarged or reduced to a predetermined size and a management number 212 assigned to the frame image information is extracted from the extracted frame image information. Each is generated, arranged in the image list 20, and output.

  Therefore, since the user can designate a desired frame image from the image list 20 using the management number 212, the convenience of the image list 20 is high.

  Next, the still image index 22 will be described. When a still image file for outputting a still image is stored in the media card together with the moving image file, the MFP 1 assigns a management number to each still image file. Then, a still image index 22 including a thumbnail 221 obtained by enlarging or reducing a still image corresponding to the still image file to a specified size and a management number 222 assigned to the still image file is stored in the media card. Each of the still image files is generated, arranged in the image list 20 together with the moving image index 21, and output.

  Therefore, the user can browse the moving image index 21 and the still image index 22 together, and the convenience of the image list 20 is high. Furthermore, since the moving image index 21 and the still image index 22 each include a management number, even if a frame image and a still image are mixed in the image list, the user can easily select a desired number according to the management information. An image can be specified.

  In FIG. 3, only one moving image index 21 and one still image index 22 are denoted by reference numerals for easy viewing of the drawing.

  Further, the MFP 1 is configured to output an image list 20 for each group classified based on the shooting date. For example, as illustrated in FIG. 3, the groups “January 15, 2008” and “January 20, 2008” having different shooting dates each have an image list 20 as a separate page.

  Further, the MFP 1 prints the shooting date 23 of the group and a group number (hereinafter referred to as a group number) 24 for specifying each group on the header portion of the image list 20 or the like.

  Therefore, as long as the shooting date of the target image is known, it is only necessary to browse the image list 20 of the shooting date, and a desired image can be easily found.

  Although the image list 20 shown in FIG. 3 is an example, the MFP 1 arranges the indexes 21 and 22 for one horizontal row in the order in which the shooting date and time are updated from the left side to the right side of the image list 20. The arrangement order is determined for each of the indexes 21 and 22 such that the next horizontal row of indexes 21 and 22 is arranged below the horizontal row. Therefore, it is possible to quickly find a target image from among a large number of indexes 21 and 22.

  Note that the MFP 1 according to the present embodiment is configured to extract frame image information corresponding to one or more frame images and output a moving image index 21 for each moving image file. It may be configured to extract frame image information corresponding to a plurality of frame images per file and output the moving image index 21. In this way, since a plurality of frame images per moving image file can be visually recognized by the user by the image list 20, the user can grasp temporal changes in the images recorded in the moving image file. Can be made.

  Further, as shown in FIG. 3, the moving image index 21 may be printed out in a form bordered by a pattern imitating a movie film, for example. In this way, the user can distinguish the moving image index 21 and the still image index 22 at a glance.

  FIG. 4 is a diagram schematically showing the configuration of the file information storage area 13h. As shown in FIG. 4, the file information storage area 13h includes a file ID storage area 201 for storing the file ID, a file name storage area 202 for storing the file name, a file type storage area 203 for storing the file type, and an extraction frame. Extracted frame number storage area 204 for storing the number of frames, total frame number storage area 205 for storing the total number of frames, fps information storage area 206 for storing fps information, file date information storage area 207 for storing file date information, file time A file time information storage area 208 for storing information is provided, and file information 200 including a file name, a file type, the number of extracted frames, fps information, file date information, and file time information, and a file ID for managing the file information 200 Is stored in association with. The MFP 1 creates file information 200 for each of the still image file or the moving image file stored in the media card as a preparation process for determining the arrangement order of the indexes 21 and 22 in the image list 20 (see FIG. 3). And stored in the file information storage area 13h.

  The file ID storage area 201 is an area for storing a file ID. The file name storage area 202 is an area for storing a file name of a still image file or a moving image file. As shown in FIG. 4, an extension is added to each file name. For example, if the image file is a JPEG file, the extension “jpg” is added, if it is an AVI movie file, the extension “avi” is added, and if it is a quick time movie file, the extension “mov” is added. Added.

  The file type storage area 203 is an area for storing a value indicating the type (format) of each image file. The type of the image file can be determined based on, for example, an extension added to the file name. In this embodiment, when the format of the image file is a JPEG file (extension jpg), a value “0” indicating that it is a JPEG file is stored in the file type storage area 203, and the format of the image file is an AVI video file. If it is (extension avi), the value “1” is stored in the file type storage area 203, and if the image file format is a quick time video file (extension mov), the value “2” is stored in the file type storage area. 203.

  Note that the type of the image file can also be determined based on information stored in several bytes from the top of each image file. For example, if the first two bytes are “0xFFD8”, it can be determined that the file is a JPEG file. If the first two bytes are “0x424D”, it can be determined that the data is bitmap data. The type of image file may be determined based on such information.

  The extracted frame number storage area 204 is an area for storing a value indicating how many frame image information corresponding to the number of frame images is to be extracted from the image file. In the case of a still image file, “1” is stored in the extracted frame number storage area 204.

  The total frame number storage area 205 is an area for storing the total number of frames of each image file. In the case of a moving image file, the total number of frames included in the moving image file is stored, and in the case of a still image, 1 is always stored.

  The fps information storage area 206 is an area for storing fps (Frame Per Second) information of each image file. If it is a still image file, “0” is stored. On the other hand, in the case of a moving image file, for example, “60” indicating that there are 60 frame images per second, and “30” indicating that there are 30 frame images per second include the fps information. Stored in the storage area 206.

  The file date information storage area 207 is an area for storing file date information indicating the shooting date of each image file. For example, the shooting date “January 15, 2008” is represented as file date information “20080115”.

  The file time information storage area 208 is an area for storing file time information indicating the shooting time of each image file. For example, the shooting time “12:50:45” is represented as file time information “125045”. When the image file is a moving image file, information indicating the shooting start time is stored as file time information.

  In the following description, the total number of frames, fps information, file date information, and file time information are acquired by reading the information described in the header of each image file. You may acquire the information.

  The MFP 1 of this embodiment arranges the indexes 21 and 22 so that the indexes 21 and 22 are arranged in the order according to the shooting date and time based on the unique information of each image file stored in the file information storage area 13h. Determine the order. Information indicating the determined arrangement order is stored in the arrangement information storage area 13i shown in FIG.

  FIG. 5 is a diagram schematically showing the configuration of the arrangement information storage area 13i. As illustrated in FIG. 5, the arrangement information storage area 13 i stores arrangement information 300 including a file ID, a group number, an extracted frame number, image date information, and image time information, and an arrangement order corresponding to the arrangement information 300. To do.

  As shown in FIG. 5, the arrangement information storage area 13i includes an arrangement order storage area 301, a file ID storage area 302, a group number storage area 303, an extracted frame number storage area 304, an image date information storage area 305, and image time information. A storage area 306 is provided.

  The arrangement information storage area 301 is an area for storing the arrangement order. In the layout printing process (see FIG. 13) described later, the layout information 300 is read in the order according to the layout order, and the frame images or still image indexes 21 and 22 specified by the layout information 300 are displayed in the layout order. Are arranged in the image list 20 in the order according to the above.

  The file ID storage area 302 is an area for storing a file ID. As described with reference to FIG. 4, since the file ID and the file name are stored in a one-to-one correspondence in the file information storage area 13h, one image file is specified from the file ID. be able to.

  The group number storage area 303 is an area for storing the group number. The group number will be described later with reference to FIG.

  The extracted frame number storage area 304 is an area for storing an “extracted frame number” indicating what number of frame image information is counted from the beginning in one moving image file.

Here, the “extracted frame number” includes the total number of frames of the moving image file stored in the “total frame number storage area 205”, the number of extracted frames stored in the “extracted frame number storage area 204”, It can be calculated as follows by using a frame image number counter value representing the number of frame images in the frame image extracted from the moving image.
(Extracted frame number) = [(frame image number counter value−1) × (total number of frames) ÷ (number of extracted frames)]
Here, [] represents a Gaussian symbol, and [a] represents the largest integer not exceeding a.

  The image date information storage area 305 is an area in which image date information indicating the shooting date of the image file specified by the file ID stored in the file ID storage area 302 is stored. The image time information storage area 306 is an area in which image time information representing the shooting time is stored. For still image files, the file time information stored in the corresponding area of the file information storage area 13h is copied to the image time information storage area 306.

  On the other hand, for a moving image file, since a plurality of pieces of frame image information are extracted from the moving image file, image time information representing the shooting time is acquired and stored in the image time information storage area 306 for each frame image information. . A specific calculation example for calculating the image time information for each frame image information will be described later with reference to FIG.

  In an arrangement printing process (see FIG. 13), which will be described later, based on the arrangement information 300 stored in the arrangement information storage area 13i, the image list 20 in which the indexes 21 and 22 are arranged in the order according to the shooting date and time (see FIG. 3). ) Is printed out.

  FIG. 6 is a diagram showing an example of the configuration of the group information storage area 13g. As shown in FIG. 6, the group information storage area 13g is provided with a group number storage area 401, a group unit information storage area 402, and a group No storage area 403.

  The group number storage area 401 is an area for storing the number of groups generated for classifying the indexes 21 and 22. In the example illustrated in FIG. 6, the group “10” is generated to classify the indexes 21 and 22.

  The group unit information storage area 402 is an area for storing information for each group. The group unit information storage area 402 stores a storage area 403 that stores a group number (group number) and a group image number storage area 404 that stores the number of indexes 21 and 22 classified into the group specified by the group number. And are provided. In the example illustrated in FIG. 6, “10” indexes 21 and 22 are classified into the group having the group number “1”.

  The MFP 1 according to the present embodiment outputs an image list 20 for each group in accordance with the information stored in the group information storage area 13g.

  FIG. 7 is a diagram schematically showing the configuration of the image management information storage area 13n. The image management information storage area 13n is an area for storing a management number assigned to each of the frame image information and the still image file. As shown in FIG. 7, a group number storage area 501 for storing a group No. , An image management number storage area 502 for storing a management number (see FIG. 3) assigned to frame image information or a still image file, a file ID storage area 503 for storing a file ID, and a frame extracted from one moving image file A frame number storage area 504 for storing a frame number indicating the number of extracted frames is provided.

  As shown in FIG. 7, the MFP 1 according to the present embodiment assigns a unique management number within each group to each of the frame image information or the still image file classified into the same group. As described with reference to FIG. 3, the indexes 21 and 22 of the same group are output together in the same image list 20, but each index 21 and 22 includes a unique management number within the group. The user can uniquely specify the indexes 21 and 22 (that is, the indexes 21 and 22 in the same group) arranged in the same image list 20 by the management number.

  FIG. 8 is a flowchart showing the layout image printing process. When an image list output process is input from the user, the MFP 1 starts this layout image printing process.

  First, an arrangement order determination process for determining the arrangement order of the indexes 21 and 22 is executed (S100). Next, a management number determination process (S150) for determining a management number to be included in the indexes 21 and 22 is executed. Then, according to the determined arrangement order and management number, the arrangement printing process (S200) for outputting the image list 20 described with reference to FIG. 3 is executed. Hereinafter, each process will be described in detail.

  FIG. 9 is a flowchart showing the arrangement order determination process (S100). First, the value input from the operation unit 4 by the user is stored in the extracted frame number storage area 13a as “frame image extraction number” (S101). Next, the “total number of processed files” indicating the total of still image files and moving image files stored in the media card is calculated and stored in the processed file number storage area 13b (S102).

  Next, the processing file number counter, the processing image number counter, and the frame image extraction number counter are each initialized to 0 (S103). These counters are provided in the counter storage area 13m (see FIG. 2).

  Next, of the image files stored on the media card, one image file is selected as a processing target, and the file name of the image file and the type of the image file are acquired. Then, the acquired file name and value indicating the type of image file are stored in the file name storage area 202 and the file type storage area 203 (see FIG. 4) corresponding to the file ID of the processing file number counter value, respectively (S104). ).

  Then, it is determined whether the selected image file is a moving image file or a still image file (S105). If it is determined that the file is a moving image file (S105: moving image), file date information, file time information, and fps information representing fps are acquired from the header of the moving image file (S106).

  Then, the file date information is stored in the file date information storage area 207 corresponding to the arrangement order of the processed image counter value, the file time information is stored in the file time information storage area 208, and the fps information is stored in the fps information storage area 206. Store (S107).

  Next, the current processing file number counter value is stored in the file ID storage area 302 of the arrangement information storage area 13i (see FIG. 5) corresponding to the arrangement order of the processed image number counter value. Further, the extracted frame number is calculated from the value of the frame image extraction number counter at the present time, and stored in the extracted frame number storage area 304 corresponding to the arrangement order of the processed image number counter value (S108).

  Next, time information of the frame image information is calculated, and the calculated time information is stored as image time information in the image time information storage area 306 corresponding to the arrangement order (S109). Specifically, first, the file time information indicating the shooting start time of the moving image file is VideoTime, the fps information is FPS, the image time information indicating the shooting time of the frame image information is FrameTime, and the frame image information to be processed is specified. Let N be the extracted frame number.

  Then, the file time information VideoTime is decomposed into moving picture time information VT_Hour, moving picture minute information VT_Minute, and moving picture second information VT_Second as follows.

VT_Hour = [VideoTime / 10000]
VT_Minute = [(VideoTime-VT_Hour × 10000) / 100]
VT_Second = VideoTime-(VT_Hour × 10000 + VT_Minute × 100)
Next, frame time information Frame_Hour, frame portion information Frame_Minute, and frame second information Frame_Second are calculated as, for example, Equation 1 below.
(Formula 1)
Here, Cal_Second, Cal_Minute, and Cal_Hour are temporary variables for obtaining the above information.
A mod B represents the remainder when A is divided by B
Cal_Second = VT_Second + [N / FPS]
Cal_Minute = VT_Minute + [Cal_Second / 60]
Cal_Hour = VT_Hour + [Cal_Minute / 60]
Frame_second = Cal_Second mod 60
Frame_Minute = Cal_Minute mod 60
Frame_Hour = Cal_Hour mod 24
The above is combined using, for example, Equation 2 below to calculate image time information FrameTime representing the shooting time of the frame image information.
(Formula 2)
FrameTime = Frame_Hour × 10000 + Frame_Minute × 100 + Frame_Second
Similarly, when the file date information of the moving image file is VideoDate, and the image date information of the frame image information to be extracted is FrameDate, first, VideoDate is set to moving image year information VD_Year, moving image month information VD_Month, moving image date information VD_Day, For example, it decomposes | disassembles using the following Numerical formula 3.
(Formula 3)
VD_Year = [VideoDate / 10000]
VD_Month = [(VideoDate-VD_Year × 10000) / 100]
VD_Day = VideoDate-(VD_Year × 10000 + VD_Month × 100)
Next, an image date calculation process is executed (S110). The image date calculation process is a process for calculating frame year information Frame_Year, frame month information Frame_Month, and frame date information Frame_Day.

  FIG. 10 is a flowchart showing image date calculation processing. Note that the variable M shown in the flowchart of FIG. 10 is a variable that means that M days are advanced from the current date.

  First, moving image year information VD_Year, moving image month information VD_Month, and moving image day information VD_Day are substituted into frame year information Frame_Year, frame month information Frame_Month, and frame date information Frame_Day, respectively (S1201). Next, [Cal_Hour / 24] is substituted into the variable M (S1202). Next, it is determined whether M is 0 (S1203). If the determination is affirmative (S1203: Yes), this process is terminated.

  On the other hand, if negative (S1203: No), the frame date information Frame_Day is judged (S1204). If it is determined that “1 to 27” (S1204: 1 to 27), “1” is added to Frame_Day (S1205).

  On the other hand, if “28 or 29” is determined in the determination in S1204 (S1204: 28 or 29), it is determined whether or not Frame_Month is “2” (S1206). When negative (S1206; No), it transfers to the process of S1205.

  On the other hand, if the determination is affirmative (S1206: Yes), it is next determined whether or not Frame_Day is “28” (S1208). If negative (S1208: No), “1” is substituted into Frame_Day, and “1” is added to Frame_Month (S1210).

  On the other hand, if the determination in S1208 is positive (S1208: Yes), it is determined whether or not the year indicated by Frame_Year is a leap year (S1209). If the determination is affirmative (S1209: Yes), the process proceeds to S1205. When negative (S1209: No), it progresses to the process of S1210.

  Next, if “30” is determined in the determination of S1204 (S1204: 30), it is next determined whether Frame_Month is 4, 6, 9, or 11 (S1211). If the determination is affirmative (S1211: Yes), the process proceeds to S1210.

  On the other hand, if negative (S1211: No), “1” is added to Frame_Day (S1216). Next, if “31” is determined in the determination in S1204 (S1204: 31), it is then determined whether Frame_Year is 12 (S1215). When negative (S1215: No), it progresses to the process of S1216.

  On the other hand, if affirmative (S1215: Yes), “1” is substituted into Frame_Day, “1” is substituted into Frame_Month, and “1” is added to Frame_Year (S1217).

  After the processing of S1205, S1210, S1216, and S1217, “1” is subtracted from the variable M (S1212), and the process returns to S1203. If the determination in S1203 is affirmed (S1203: Yes), this process ends.

Returning to FIG. The values calculated in the process shown in FIG. 10 are combined using, for example, the following Equation 5 to calculate image date information FrameDate representing the shooting date of the frame image information. The calculated image date information is stored in the image date information storage area 305 (S111).
(Formula 5)
FrameDate = Frame_Year × 10000 + Frame_Month × 100 + Frame_Day
Next, “1” is added to the processed image number counter and the frame image extraction number counter, respectively (S113).

  Next, it is determined whether or not the value of the frame image extraction number counter is equal to or greater than the number of frame image extractions, that is, the number of frame image information extracted from the moving image file (S114). If the determination in S114 is negative (S114: No), the process returns to S108 and is repeated.

  On the other hand, if the determination in S114 is affirmative (S114: Yes), then the frame image extraction number counter is initialized to 0 (S115), and 1 is added to the processing file number counter (S122). Then, it is determined whether or not the value of the processing file number counter is equal to or greater than the “total number of processing files” indicating the total of still image files and moving image files stored in the media card (S123). If the determination in S123 is negative (S123: No), the processing returns to S104, the next image file is selected as a processing target, and the processing is repeated.

  Next, a case where it is determined that the image file to be processed is a still image file (S105: still image) will be described. In the case of a still image file, the current processing file number counter value is stored in the file ID storage area 302 corresponding to the arrangement order of the processing image number counter value. Further, “0” is stored in the extracted frame number storage area 304 corresponding to the arrangement order of the processed image counter value (S115a).

  Next, file date information and file time information of the still image file to be processed are acquired. In the file information storage area 13h, the file date information is stored in the file date information storage area 207 (see FIG. 4) corresponding to the file ID of the processing file counter value, and the file time information corresponding to the file ID is stored. The file time information is stored in the storage area 208 (S117). Note that “0” is stored in the fps information storage area 206.

  Then, the file date information of the still image file to be processed is stored in the image date information storage area 305 corresponding to the arrangement order of the processed image number counter values in the arrangement information storage area 13i (see FIG. 5). Further, the file time information of the still image file to be processed is stored in the image time information storage area 306 corresponding to the same arrangement order (S119). Then, 1 is added to the processed image number counter (S121), and the process proceeds to S122.

  Thus, according to the processing from S101 to S123, the file ID, the extracted frame number, the image date information, and the image time information are stored in the arrangement information storage area 13i.

  FIG. 11 is a flowchart showing a continuation of the arrangement order determination process (S100) shown in FIG. 9, and shows a part of the process of classifying the indexes 21 and 22 and sorting them in the arrangement order according to the shooting date and time. .

  As shown in FIG. 11, first, the value of the processed image number counter at the present time is stored as the “total number of processed images” in the processed image total number storage area 13c (see FIG. 2) (S124). Then, the processing image counter is initialized with “0” (S125). Here, the processed image number counter is provided in the counter storage area 13m (see FIG. 2).

  Next, a group number is determined according to the image date information stored in the image date information storage area 305 of the arrangement information storage area 13i (see FIG. 5) (S126). Specifically, when the value of the image date information storage area 305 corresponding to the arrangement order of the value of the processed image counter is the same as the value of the already existing group, the corresponding group number is set as the image information. If not, a new group number is determined as the group number of this image information. However, the initial value of No is 1, and the new group No is the largest group No + 1 so far.

  In this way, the indexes 21 and 22 corresponding to the frame image information or still image file whose shooting date is the same day are classified into the same group, while corresponding to the frame image information or still image file whose shooting date is different. The indexes 21 and 22 are classified into different groups.

  Then, the determined group number is stored in the group number storage area 303 (see FIG. 5) corresponding to the arrangement order of the values of the processed image number counter (S127). Next, “1” is added to the processed image number counter (S128), and it is determined whether the value of the processed image number counter is equal to or greater than the value stored in the total number of processed images (S129). If the determination in S129 is negative (S129: No), the process is repeated from S126.

  On the other hand, if the determination in S129 is affirmative (S129: Yes), the maximum group number is stored in the group number storage area 401 (see FIG. 6) (S130). Then, the arrangement information is sorted in ascending order of group number (S131). In the process of S131, it is sufficient if the arrangement information can be sorted in ascending order of the group numbers. Therefore, the sorting algorithm is not particularly limited, and for example, a quick sort method or a bubble sort method can be used. .

  Note that the arrangement information storage area 13i illustrated in FIG. 5 schematically illustrates a state in which arrangement information stored in the arrangement information storage area 13i is sorted in ascending order of group numbers.

  Returning to FIG. Next, the number of images included in the same group number is calculated (S132), and stored in the group image number storage area 404 in association with the group number (S133). Next, the group counter is initialized with 1 (S134). This group counter is a counter provided in the counter storage area 13m (see FIG. 2).

  Next, the arrangement information is sorted in ascending order of image time information (S135). This sorting is done in groups. Thereby, the corresponding arrangement order is determined for each of the indexes 21 and 22 specified by the arrangement information. That is, the arrangement order according to the image time information (photographing time information) is determined within the indexes classified into the same group.

  Next, 1 is added to the group counter (S136), and it is determined whether the value of the group counter has become larger than the value of the group number storage area 401 (see FIG. 6) (S137). If the determination in S137 is negative (S137: No), the process returns to S135 and is repeated. On the other hand, when the processing for all the groups is finished and the determination in S137 is affirmed (S137: Yes), the arrangement order determination processing (S100) is finished.

  Next, a management number determination process for assigning a management number to each of the frame image information and the still image file will be described.

  FIG. 12 is a flowchart showing the management number determination process (S150). First, the group management number counter is initialized with “1”, and the arrangement order counter is initialized with “0” (S151). Then, the number of generated groups is read from the group number storage area 401 (see FIG. 6) (S152), and the image management number counter is initialized with “1”.

  Next, the number of group images corresponding to the value of the group management number counter is read from the group image number storage area 404 (see FIG. 6) (S154), and then the file ID corresponding to the value of the arrangement order counter and the extracted frame The number is read from the arrangement information storage area 13i (see FIG. 5) (S155).

  Then, the group management number counter value is stored in the group number storage area 501 in the image management information storage area 13n (see FIG. 7), and the image management number counter value is stored in the image management number storage area 502. Further, the read file ID is stored in the file ID storage area 503 in the image management information storage area 13n, and the frame number is stored in the frame number storage area 504 (S156). By this processing, an image management number counter value can be assigned as a management number to each of the frame image information specified by the file ID and the frame number or each still image file.

  Next, “1” is added to each of the image management number counter and the arrangement order counter (S157), and it is determined whether or not the image management number counter value is larger than the number of group images (S158). If the determination in S158 is negative (S158: No), the process is repeated from S153.

  On the other hand, if the determination in S158 is affirmative (S158: Yes), the image management number counter is initialized with “1” (S159), and “1” is added to the group management number counter (S160). Next, it is determined whether or not the group management number counter value has become larger than the number of groups (S161). If the result is negative (S161: No), the processing is repeated from S153.

  If the determination in S161 is affirmed while the process is repeated (S161: Yes), the management number determination process (S150) is terminated.

  FIG. 13 is a flowchart showing the layout printing process (S200). The layout printing process (S200) shown in FIG. 13 is a process that is executed following the management number determination process (S150) described with reference to FIG. 12, and prints out the image list 20 on a recording sheet.

  First, the “horizontal arrangement number” indicating the number of indexes 21 and 22 for one horizontal row arranged in the image list 20 is read from the horizontal image arrangement number storage area 12b (S201). Next, the “number of images in one page” indicating the number of indexes 21 and 22 that can be arranged in the image list 20 for one page is read from the one-page image arrangement number storage area 12c (S202).

  Next, the group counter is initialized with 1 (S203), and the page counter is initialized with 1 (S204). The page counter is a counter provided in the counter storage area 13m (see FIG. 2).

Next, the number of group images corresponding to the group number of the group counter value is read from the group image number storage area 404 (S205). Then, from the read “number of group images” and “number of images arranged in one page”, a “number of generated pages” indicating how many pages the image list 20 is printed out for the group to be processed is calculated. Stored in the generated page number storage area 13d (see FIG. 2) (S206). In the present embodiment, the “number of generated pages” is calculated using, for example, Equation 6 below.
(Formula 6)
(Number of generated pages) = [(Number of group images) / (Number of images in one page)] + 1
Next, the layout image counter is initialized to 0 (S207), and the number of images layout_no to be arranged on one page of recording paper is calculated (S208). In the present embodiment, layout_no is calculated using, for example, Equation 7 below.
(Formula 7)
(Page counter value) <Number of generated pages
layout_no = (Number of images on one page)
(Page counter value) ≥ Number of generated pages
layout_no = (number of group images)-{(number of images in one page) x (page counter value)}
Next, the file ID corresponding to the arrangement order and the extracted frame number are read from the arrangement information storage area 13i (S209). Then, it is determined whether the image file corresponding to the read file ID is a moving image file or a still image file (S210).

  If it is determined in S210 that the file is a moving image file (S210: moving image), then frame image information for one frame image specified by the extracted frame number is extracted from the moving image file (S211).

  Next, the extracted frame image information is decoded and stored in the decoded data storage area 13k (S212). Then, the decoded frame image information is reduced or enlarged to a specified size, and the assigned management number (that is, the management number corresponding to the file ID and frame number of the processing target frame image information shown in FIG. 7) is added. Thus, the moving image index information for outputting the moving image index 21 described with reference to FIG. 3 is generated (S212a). Then, the generated moving image index information is arranged at a predetermined position of an arrangement buffer provided in the RAM 13 (see FIG. 2) (S213).

  On the other hand, if it is determined in S210 that the file is a still image file (S210: still image), the still image file specified by the file ID corresponding to the arrangement order is decoded and stored in the decoded data storage area 13k. (S214) Then, the decoded still image file is reduced or enlarged to a prescribed size, and the assigned management number is added to output the still image index 22 described with reference to FIG. Still image index information is generated (S214a). Then, the generated moving image index information is arranged at a predetermined position in the arrangement buffer (S215).

  In this way, after executing the process of decoding either the frame image information or the still image file and placing it in the placement buffer, next, the “horizontal direction” which is the upper limit of the number of images that can be placed horizontally It is determined whether or not the processing has been performed for the “number of arranged sheets” (S216). If the determination in S216 is negative (S216: No), the horizontal position indicating the arrangement position of the next data is updated (S220).

  Then, “1” is added to the layout image counter (S221), and it is determined whether or not the value of the layout image counter is equal to or greater than the number “layout_no” of the indexes 21 and 22 to be arranged on the current recording paper to be processed. (S222). If the determination in S222 is negative (S222: No), the process returns to S209, and the arrangement information corresponding to the next arrangement order is processed.

  In this way, by repeating the process, frame image information corresponding to the frame image of the number of extracted frames is extracted from each of the moving image files stored in the media card and placed in the placement buffer. Also, a still image file stored in the media card is extracted and placed in the placement buffer.

  If the arrangement processing for “horizontal arrangement number” times is executed while the processing is repeated in this way, the determination in S216 is affirmed (S216: Yes). The data is transferred to the printer 3 (see FIG. 2) (S217). As a result, the data corresponding to the indexes 21 and 22 for one horizontal row arranged in the arrangement buffer is subjected to the printing process by the printer 3, and the image list 20 can be output.

  Then, the horizontal position indicating the horizontal position of the next index 21 or 22 to be processed is initialized (S218), and the vertical position indicating the vertical position is updated (S219). That is, the next arrangement position is determined so that the next indexes 21 and 22 are arranged from the left end of the next column in the image list 20. And the process of S221 and S222 mentioned above is performed.

  When the number of indexes 21 and 22 processed in this way reaches the number of indexes layout_no to be arranged on the recording paper to be processed, the determination in S222 is affirmed (S222: Yes), so the next shown in FIG. Transition to processing.

  FIG. 14 is a flowchart showing the continuation of the layout printing process (S200) shown in FIG. 13, and is executed when the determination in S222 is affirmed.

  First, it is determined whether there is data that has not yet undergone printing processing in the arrangement buffer (S223). If the determination in S223 is affirmative (S223: Yes), the remaining data is transferred to the printer 3 (S224), the printer 3 prints it out, and the process proceeds to S225. However, the printing process is not performed for an area where no image is arranged in the arrangement buffer. On the other hand, if the determination in S223 is negative (S223: No), the determination in S224 is skipped and the process proceeds to S225.

  Then, a print completion command indicating completion of data output for one page is passed to the printer 3 (S225). Then, “1” is added to the page counter (S226). Next, the horizontal position and the vertical position indicating the arrangement position of the next data in the arrangement buffer are initialized (S227). Then, it is determined whether the value of the page counter has become larger than the “number of generated pages” indicating how many pages of the image list 20 are to be printed out for the current group to be processed (S228). If the determination in S228 is negative (S228: No), the processing returns to S207 shown in FIG.

  On the other hand, if the determination in S228 is affirmative (S228: Yes), 1 is added to the group counter (S229). Then, it is determined whether or not the value of the group counter has become larger than the value stored in the group number storage area 401 (S230). When determination of S230 is denied (S230: No), it returns to S204 and repeats a process. That is, the process is repeated with the group specified by the next group number as the process target.

  On the other hand, if the determination in S228 is affirmative (S228: Yes), the layout printing process (S200) is terminated. By executing the layout printing process (S200), the image list 20 described with reference to FIG. 3 can be output.

  Next, a usage example of the management number printed in the image list 20 in this way will be described.

  FIG. 15 is a flowchart showing the designated output process (S300). This designated output process is a process for printing out only the image designated by the user.

  First, it is determined whether or not a group number is input from the operation unit 4 by the user (S302). If the determination in S302 is negative (S302: No), the process waits. If the determination is affirmative (S302: Yes), the input group number is stored (S303).

  Next, it is determined whether or not a management number has been input (S304). For example, when a predetermined time elapses in the management number input waiting state or when a print execution command is input by the user without inputting the management number, the determination in S304 is denied (S304: No), The group No. stored in the group is designated, all frame image information or still image files classified in the group are read, and the corresponding frame image and still image are printed out at the same magnification (S305).

  On the other hand, if the determination in S304 is affirmative (S304: Yes), the input management number is stored (S306). Then, the designated frame image information or still image file to which the group No. stored earlier is designated and the previously stored management number is assigned among the frame image information or still image files classified into the group is stored. Are read out, the corresponding frame image or still image is printed out at the same magnification (S308), and the process is terminated.

  As described with reference to FIG. 3, since the user can grasp the group number and the management number from the image list 20, by starting the designated output process (S 300), the frame image information included in the desired group or An image can be printed out only for the still image file, or only a desired image can be printed using the management number.

  The present invention has been described above based on the embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications and changes can be easily made without departing from the spirit of the present invention. Can be inferred.

  For example, in the present embodiment, the image list 20 is described as being printed out on recording paper. However, the present invention can also be applied to the case where the image list 20 is displayed on a display device such as the LCD 5.

  The present invention is also applied to, for example, a case where the present invention is applied to a personal computer and the image list 20 is displayed on a PC monitor, or the image list is printed out by controlling the printer from the personal computer. Can be applied.

  In the above-described embodiment, the moving image file and the still image file are both assumed to be image files generated by shooting. However, the moving image file and the still image file are generated by a method other than shooting. Even so, the present invention is applicable. In this case, the arrangement order of the indexes 21 and 22 is determined based on other conditions such as file generation date / time information indicating file creation date / time and file update date / time information instead of the shooting date / time. May be.

  In the above-described embodiment, the case where a still image file and a moving image file are mixed in the media card has been described. Is applicable.

  In the above-described embodiment, the image information stored in the removable media card is the processing target. However, the present invention is also applicable to the case where the image information stored in the internal memory of the MFP 1 is the processing target. Applicable.

  In the embodiment described above, “shooting date” is adopted as a condition for classifying the group. However, there are various conditions such as “shooting month”, “shooting year”, and “handling shooting time close to the same group”. Conditions can be considered. This condition may be set in advance by the user from the operation unit 4 or may be set in advance with one condition fixed.

  Further, the arrangement order may be determined and the indexes 21 and 22 may be classified based on other conditions instead of the conditions described in the above embodiment. For example, the image information may be classified under other conditions such as a dynamic range, average luminance, and whether or not a face is included in the image.

1 is a perspective view showing an external configuration of an MFP which is an embodiment of an image processing apparatus of the present invention. 2 is a block diagram illustrating an electrical configuration of the MFP. FIG. 6 is a diagram illustrating an example of an image list output by an MFP. FIG. It is a figure which shows typically the structure of a file information storage area. It is a figure which shows typically the structure of an arrangement | positioning information storage area. It is a figure which shows the structure of a group information storage area typically. It is a figure which shows typically the structure of an image management information storage area. It is a flowchart which shows a layout image printing process. It is a flowchart which shows an arrangement | positioning order determination process. It is a flowchart which shows an image date calculation process. 10 is a flowchart showing a continuation of the arrangement order determination process shown in FIG. 9. It is a flowchart which shows a management number determination process. It is a flowchart which shows arrangement | positioning printing processing. 14 is a flowchart showing a continuation of the layout printing process shown in FIG. 13. It is a flowchart which shows a designated output process.

Explanation of symbols

1 MFP (an example of an image processing apparatus)
20 Image list 21 Movie index 22 Still image S126 Example of classification unit S156 Example of management information allocation unit S200 Layout printing process (example of output unit)
S211 An example of extraction means S305 An example of group designation means, an example of designated group output means S308 An example of management information designation means, an example of designated image output means

Claims (7)

When moving image information for reproducing a moving image is stored in the storage medium, frame image information corresponding to the frame image extracted from the moving image is stored in each of the moving image information stored in the storage medium. Extraction means for extracting from,
Management information assigning means for assigning management information to each of the frame image information extracted by the extracting means;
A moving image index including a frame image corresponding to the frame image information or a reduced or enlarged image of the frame image and management information allocated to the frame image information by the management information allocation unit is extracted by the extraction unit. An image processing apparatus comprising: output means for generating each frame image information to be output and outputting it as an image list. The management information allocating means manages information for each of the frame image information and the still image information when still image information for outputting a still image is stored in the storage medium together with the moving image information. Is assigned,
The output means includes a still image index including a still image corresponding to the still image information or a reduced or enlarged image of the still image, and management information assigned to the still image information by the management information assigning means. The image processing apparatus according to claim 1, wherein a list of images arranged together with the moving image index is output. Management information specifying means for specifying any of the management information;
3. The image processing apparatus according to claim 2, further comprising designated image output means for outputting an image corresponding to frame image information or still image information to which management information designated by the management information designation means is assigned. Classifying means for classifying the image information group consisting of the frame image information and the still image information into a plurality of groups,
The image processing apparatus according to claim 3, wherein the output unit outputs the image list for each group classified by the classification unit.   5. The image according to claim 4, wherein the management information assigning means assigns only management information in the group to each of the frame image information or the still image information classified into the same group by the classification means. Processing equipment. A group designating means for designating one of the groups;
5. A designated group output means for outputting an image corresponding to the image information for each of the frame image information or the still image information classified into the group designated by the group designation means. 5. The image processing apparatus according to 5.   The image processing apparatus according to claim 1, wherein the extraction unit extracts frame image information corresponding to a plurality of frame images from each of the moving image information.

Images