JP2015195524A - Moving image processing program, moving image processing method, and moving image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily select a frame appropriate to printing from among moving image files.SOLUTION: Moving image files and meta data attached to the moving image files are acquired. Specific frames 41, 42, 43, and 44 for output appropriate to printing are extracted from among the moving image files on the basis of the acquired meta data.

Description

  The present invention relates to a moving image processing program, a moving image processing method, and a moving image processing apparatus for processing a moving image file.

  Hardware and software that can import video files for viewing and editing have become widespread. For example, a moving image file can be enjoyed in various forms by loading the moving image file into various information processing terminals such as a personal computer, a smartphone, and a multi-function device and executing various processes.

  As one of processing functions for a moving image file, a moving image printing function is known and has already been put into practical use (for example, see Patent Document 1). Movie printing is a function of extracting a frame at a desired timing from a movie and printing an image of the frame.

JP 2011-71591 A

  In order to print a specific frame in a moving image using the moving image printing function, it is necessary to determine a desired frame to be printed from the moving image. The frame to be printed is usually determined by a procedure in which a user who wants to print a movie searches for a desired frame while playing back a movie file and using functions such as fast-forward and frame advance as necessary. Done.

  For this reason, it is troublesome to search for a frame suitable for printing from a moving image file. In particular, in the case of a moving image file with a long reproduction time or a moving image file with few impressive scenes, it takes a lot of time to search for a frame suitable for printing.

  The present invention has been made in view of the above problems, and an object thereof is to easily select a frame suitable for printing from a moving image file.

  The present invention made to solve the above problems is a moving image processing program executable by a computer, and includes a file acquisition process, a data acquisition process, and a frame extraction process as processes to be executed by the computer.

  The file acquisition process is a process for acquiring a moving image file. The data acquisition process is a process of acquiring metadata added to the moving image file acquired by the file acquisition process. The frame extraction process is a process of extracting a candidate frame that is a specific output frame suitable for printing from a moving image file based on the metadata acquired by the data acquisition process.

  By causing the computer to execute the moving image processing program of the present invention, candidate frames for output are extracted from the moving image file based on the metadata added to the moving image file. Since candidate frames are extracted based on the metadata, it is possible to easily select a frame suitable for printing from the moving image file.

  In addition to the above-described program, the present invention is realized in various forms such as a recording medium on which the program is recorded, an apparatus on which the program is executed, various systems including the apparatus, and a method for processing a moving image. Can do.

It is a block diagram which shows schematic structure of the moving image printing system of embodiment. It is explanatory drawing which shows the example image during reproduction | regeneration of the moving image file to which text metadata was added. It is explanatory drawing which shows the example of an image during reproduction | regeneration of the moving image file to which link metadata was added, and the moving image file to which area | region metadata was added. It is a flowchart which shows a moving image printing process. It is explanatory drawing which shows the specific example of the determination method of a scene, and the extraction method of a flame | frame. It is explanatory drawing which shows the other example of the determination method of a scene. It is explanatory drawing which shows the other example of the determination method of a scene, and the extraction method of a flame | frame. It is a flowchart which shows the detail of the thumbnail selection process for the moving image file selection of S180 in the moving image printing process of FIG. It is explanatory drawing which shows the example of a moving image list display screen. It is explanatory drawing which shows the example of a printing frame selection screen.

Preferred embodiments of the present invention will be described below with reference to the drawings.
(1) Description of Movie Printing System As shown in FIG. 1, the movie printing system according to the present embodiment includes a terminal 10, an MFP (abbreviation of multifunction peripheral device) 100, an AP (abbreviation of access point) 150, A server 160.

  The terminal 10 is an information processing terminal such as a personal computer, a smartphone, or a tablet. The terminal 10 includes a CPU 11, a flash memory 12, a RAM 13, an operation key 15, an LCD 16, a touch panel 17, a memory card interface (hereinafter referred to as "memory card I / F") 18, a voice input / output unit 19, a telephone network communication unit 20, A short-range communication unit 22 and a wireless communication unit 23 are provided. These units are connected to each other via a bus line 24.

  The CPU 11 controls each unit connected via the bus line 24 in accordance with programs and data stored in the flash memory 12. The flash memory 12 is a nonvolatile memory capable of electrically rewriting stored contents. The flash memory 12 stores an operating system (hereinafter abbreviated as “OS”) 12 a and an application (hereinafter abbreviated as “application”) 12 b. The OS 12 a is basic software for realizing standard functions of the terminal 10.

  Note that other applications other than the application 12b are also stored in the flash memory 12, but the illustration and description of these other applications are omitted here. In the following description, the CPU 11 that executes programs such as the OS 12a and the application 12b may be simply described by a program name. For example, the description “application is” may mean “the CPU 11 that executes the application”.

  The application 12b is software for using various functions of the MFP 100 from the terminal 10, is provided by the vendor of the MFP 100, and is installed on the terminal 10 by the user. By installing the application 12b in the terminal 10, various functions of the MFP 100 can be used from the terminal 10. For example, the application 12b can directly use the print function, scan function, and the like of the MFP 100 from the terminal 10.

  One of the functions provided in the application 12b is a moving image printing function that allows the MFP 100 to select a frame from a moving image file and cause the MFP 100 to print an image of the frame (that is, a still image).

  The flash memory 12 is provided with an application storage area 12c. The application storage area 12c is a storage area used by the application 12b and allocated to the application 12b. In the application storage area 12c, for example, reduced images that are various thumbnails generated when the moving image printing function is executed are stored. The moving image file and metadata (details will be described later) added to the moving image file may be stored in the application storage area 12c, or may be an area different from the application storage area 12c in the flash memory 12. May be stored.

  The RAM 13 is a volatile memory for temporarily storing various data when the CPU 11 executes the OS 12a, the application 12b, and the like. The operation keys 15 are mechanical keys for the user of the terminal 10 to input various information and instructions to the terminal 10. The LCD 16 is a liquid crystal display device capable of displaying various screens. The touch panel 17 is a well-known input device that can accept an input operation on the terminal 10 by touching or approaching an indicator such as a finger or a stick, and is provided over the LCD 16. When the terminal 10 is a terminal (for example, a personal computer) to which a mouse can be connected as an input device, a mouse can also be included as a constituent member of the terminal 10. In the following description, an input operation with an indicator on the touch panel 17 is referred to as a “touch operation”, and an operation of moving the mouse pointer on the screen to overlap a specific area or image is referred to as “mouse over”. The input operation by clicking is called “mouse operation”.

  The memory card I / F 18 is an interface to which a rewritable nonvolatile memory card 25 is mounted, and controls writing and reading of data with respect to the memory card 25. The voice input / output unit 19 is a voice input / output device including a microphone, a speaker, and the like. The telephone network communication unit 20 is a circuit for performing a voice call via a mobile phone network (not shown).

  The short-range communication unit 22 is an interface for performing communication by short-range wireless communication in which a short distance of about 10 cm, for example, is used as a communicable distance. The short-range wireless communication performed by the short-range communication unit 22 of the present embodiment is non-contact communication (hereinafter referred to as “NFC communication”) according to the NFC standard.

  The wireless communication unit 23 is an interface for performing communication according to the wireless LAN standard (hereinafter referred to as “wireless LAN communication”). In the present embodiment, the wireless LAN communication performed by the wireless communication unit 23 is wireless LAN communication compliant with the IEEE802.11b / g / n standard. The terminal 10 can perform wireless communication based on the Wi-Fi (registered trademark) standard (hereinafter referred to as “Wi-Fi communication”) with the AP 150 via the wireless communication unit 23.

  The AP 150 is a relay device that relays Wi-Fi communication. The AP 150 has a broadband router function and is connected to the Internet. Accordingly, the terminal 10 can connect to the Internet via the AP 150 and can communicate with the server 160 connected to the Internet.

  The MFP 100 has various functions such as a print function, a scan function, a copy function, and a facsimile function. The MFP 100 includes various components for realizing the various functions. The printer unit 131 illustrated in FIG. 1 is a constituent member for realizing a printing function. In MFP 100, when print data is received from outside by wireless communication unit 123 or short-range communication unit 122, printer unit 131 can perform print output based on the print data.

  The MFP 100 includes a short-range communication unit 122 having the same configuration as the short-range communication unit 22 of the terminal 10. In addition, the MFP 100 includes a wireless communication unit 123 having the same configuration as the wireless communication unit 23 of the terminal 10. Therefore, the terminal 10 and the MFP 100 can perform NFC communication between them. Further, the terminal 10 and the MFP 100 can perform Wi-Fi communication with each other via the AP 150. In addition, the terminal 10 and the MFP 100 can also perform direct communication based on the Wi-Fi Direct (registered trademark) standard, that is, wireless communication not via the AP 150.

  Note that the terminal 10 and the MFP 100 may be configured to be able to perform data communication using other data communication methods. For example, data communication via a wired LAN may be possible. In that case, the terminal 10 may be connected to the Internet via a wired LAN.

  The server 160 stores various types of data. As data stored in the server 160, there is a moving image file. The server 160 also functions as a server for a moving image posting service, and can upload a moving image file to the server 160 via the Internet or download a moving image file from the server 160 via the Internet. Various metadata (details will be described later) can be added to the uploaded video file. In addition, when downloading a moving image file, metadata added to the moving image file can also be downloaded. The download of metadata is usually performed separately from the download of the video file. For example, first, a moving image file is downloaded, and then metadata attached to the moving image file (that is, associated and stored in the server 160) is downloaded.

  The terminal 10 can also download and view a moving image file and metadata from the server 160. The moving image file and metadata downloaded from the server 160 can be stored in the flash memory 12 or the memory card 25. Further, when the terminal 10 has a moving image shooting function, the shot moving image file can be uploaded to the server 160. A moving image file stored in the memory card 25 can also be uploaded to the server 160. Note that metadata can be arbitrarily added to the moving image file. For this reason, when a moving image file is acquired from the server 160, the memory card 25, or the like, metadata is not necessarily added to the moving image, but in the present embodiment, metadata is added to the moving image file. Assuming that.

(2) Description of Metadata Next, the moving image file and metadata added to the moving image file will be described in more detail. As is well known, a moving image file is composed of a plurality of frames (still images) taken continuously at a predetermined time interval. The higher the frame rate, the more frames per unit time, and the smoother the motion can be reproduced. The moving image file includes various data related to the moving image in addition to the plurality of frames. For example, moving image shooting date and time, file format, and the like.

  Furthermore, as described above, metadata that is information related to the moving image file can be added to the moving image file. The metadata is data indicating the content of a moving image, and can be added to any timing or time zone in the entire reproduction time of the moving image file. By adding metadata to a video file, the added value of the video file can be increased.

  There are various types of metadata such as annotations, sticky notes, tags, and comments. For example, if metadata for displaying text in a video (hereinafter referred to as “text metadata”) is added to a specific time zone of a video file, the text indicated by that metadata during playback of that time zone Is displayed.

  For example, metadata for embedding a hyperlink in a moving image (hereinafter referred to as “link metadata”) can be added to a specific time zone of the moving image file. As is well known, a hyperlink (hereinafter abbreviated as “link”) is location information of other files and data, and a URL (Uniform Resource Locator) is mainly used. The link metadata can be added to the designated area by designating an arbitrary area in the entire screen on which the moving image is displayed. The link information included in the link metadata is not directly displayed even during playback in the time zone to which the link metadata is added. However, since the frame image indicating the outer frame of the designated area in which the link information is embedded is displayed, the user can recognize that the link metadata is added.

  During playback of the time zone to which link metadata is added, if you touch within the specified area on the screen or mouse over the specified area, a frame image showing the outer frame of the specified area is highlighted, The added link information (for example, URL) is displayed. When a specific operation (for example, long press, also referred to as long tap) is performed on the touch panel 17 or a mouse is operated in the designated area where the link is embedded within the time when the link metadata is added. , It is possible to jump to the link destination indicated by the link information.

  Further, as metadata for embedding a link in a moving image, there is region metadata in addition to the link metadata. The area metadata is not directly displayed even during reproduction of the time zone to which the area metadata is added. Moreover, unlike the link metadata, a frame image indicating the outer frame of the designated area in which the link information is embedded is not displayed. Therefore, the user cannot directly recognize that metadata is added from the content of the moving image being reproduced.

  During the reproduction of the time zone to which the area metadata is added, when a touch operation is performed in the designated area on the screen or the mouse is moved over the designated area, a frame image indicating the outer frame of the designated area is displayed. At that time, in addition to displaying the frame image, link information (for example, URL) is also displayed. Thus, the user can recognize that the link is embedded and the designated area in which the link is embedded. When a specific operation (for example, long press) is performed on the touch panel 17 or the mouse is operated in the designated area where the link is embedded within the time when the area metadata is added, the link indicated by the link information You can jump ahead.

  Various information is included in the metadata. Information included in the metadata includes, for example, time zone information for adding metadata in the entire moving image, display position information indicating at which position in the screen the image is displayed, and additional date and time information indicating the date and time added to the moving image. If there is an image to be displayed (for example, text or frame image), display image information indicating the contents of the image, if there is an image to be displayed, whether to display it directly, or touch operation or mouse over Until it is done, there is display method information that indicates whether or not to make it non-display state. In the case of text metadata, the display image information includes information such as text font, font size, and color. In the case of link metadata and area metadata, information indicating the position / range of the designated area and link information are also included.

  FIG. 2 and FIG. 3 show examples of images during reproduction of a moving image file to which various kinds of metadata are added. 2 and 3 show moving images displayed on the LCD 16 when a moving image file stored in the flash memory 12 is played back, and in particular, display examples of a time zone in which metadata is added. .

  FIG. 2A shows one frame (that is, one frame) during the reproduction of the pet dog recorded moving image 31, and one frame in a time zone to which the text metadata of the text image 31a is added. As shown in FIG. 2A, text metadata for displaying a text image 31a expressing the feeling of the dog is added to the pet dog recording video 31 as shown in FIG. .

  FIG. 2B is a frame during the reproduction of the fireworks display video 32, and is a frame in the time zone to which the text metadata of the text image 32a is added. As shown in FIG. 2B, the fireworks display video 32 is added with text metadata for displaying a text image 32a of the title of the firework being fired for the scene where the firework is being fired. Yes.

  FIG. 2C shows one frame during the reproduction of the Western-style program moving image 33, and one frame in the time zone to which the text metadata of the text image 33a is added. As shown in FIG. 2 (c), the Western-style program video 33 includes an English scene for a scene in which a certain character is talking and an English subtitle of the story is shown. Text metadata for displaying a Japanese-translated text image 33a of subtitles is added.

  FIG. 3 (a) is a frame during playback of the nature introduction video 34, and is a frame in the time zone to which the link metadata of the two frame images 34a and 34b is added. In the link metadata added to the nature introduction video 34, information for displaying the frame images 34a and 34b and the area surrounded by the frame images 34a and 34b are touch-operated or the mouse is moved over. Information for highlighting the frame image when it is touched, and link information corresponding to the frame image is displayed when the area surrounded by the frame images 34a and 34b is touched or the mouse is moved over And information for. For example, when the mouse is moved over the area surrounded by the left frame image 34a in the figure, the frame image 34a is highlighted, and the link information associated with the frame image 34a is displayed. When the mouse is left-clicked in this state, the terminal 10 accesses the link destination indicated by the link information, acquires information from the link destination, and displays the information. When the link destination is an external video file, the video file is downloaded and can be played back.

  FIG. 3B is a frame during playback of the landscape-recorded moving image 35, and is a frame in the time zone to which the region metadata of the four frame images 35a to 35d is added. However, each of the frame images 35a to 35d is normally not displayed. Each of the frame images 35a to 35d is displayed so as to surround specific object images 351 to 354 displayed on the screen. For example, the frame image 35d at the upper left in the figure is displayed so as to surround the cloud object image 354 on the mountain.

  The link metadata added to the landscape recording moving image 35 includes a frame image corresponding to the area surrounded by the non-displayed frame images 35a to 35d when the area is touched or the mouse is moved over. And the link information corresponding to the frame image is displayed when any of the frame images 35a to 35d is in a display state and the area is touched or the mouse is moved over. And information for. For example, when the mouse is moved over an area surrounded by the center frame image 35a (not displayed) in the figure, the frame image 35a is displayed, and link information associated with the frame image 35a is further displayed. When the mouse is left-clicked in this state, the terminal 10 accesses the link destination indicated by the link information, acquires information from the link destination, and displays the information. When the link destination is an external video file, the video file is downloaded and can be played back.

(3) Description of Movie Printing Function Next, an outline of the movie printing function, which is one of the functions of the application 12b, will be described. A moving image printing function for printing out a specific frame in a moving image is already known. However, as described above, the conventional moving image printing function is very time-consuming and inefficient because the user needs to search for a frame to be printed while reproducing the moving image. It cannot be easily determined which part of the entire moving image is a notable scene suitable for printing.

  On the other hand, when metadata is added to the moving image file, the time zone in which the metadata is added is highly likely to be a characteristic scene or a noteworthy scene in the entire moving image. That is, there is a high possibility that the time zone in which metadata is added is a scene suitable for printing. Therefore, in the present embodiment, the moving image printing function of the application 12b is configured to automatically extract a frame suitable for printing using metadata and provide it to the user.

  Here, first, the overall image of the moving image printing process, which is the process of the application 12b for realizing the moving image printing function, will be described with reference to the flowchart of FIG. Subsequently, a particularly characteristic process in the moving image printing process will be described in detail.

(3-1) Description of Moving Image Printing Process After the activation, the CPU 11 of the terminal 10 reads and executes the application 12b when a specific input operation for activating the application 12b is performed. When a specific input operation for starting the moving image printing function is performed after the application 12b is activated, the moving image printing process shown in FIG. 4 is started. The moving image printing start process is one of the program modules included in the application 12b.

  When starting the moving image printing process shown in FIG. 4, the CPU 11 of the terminal 10 acquires a moving image file in S110. Where to obtain the video file can be set in advance. For example, a moving image file stored in the flash memory 12 of the terminal 10 may be an acquisition target. When the memory card 25 is attached, the memory card 25 may be included in the acquisition target. Further, for example, a moving image file stored in a specific storage area in an external server may be an acquisition target. Here, the description will be continued assuming that N moving image files from moving image file 1 to moving image file N have been acquired in S110.

  In S120, the metadata added to the moving image file is acquired for each of the N moving image files acquired in S110. In S130, the file variable n is set to 1. In S140, the moving image file to be processed is set as the moving image file n.

  In S150, a scene determination process is executed. The scene determination process is a process of determining at least one scene that is likely to contain a frame suitable for printing from the moving image file n to be processed. The specific contents of the scene determination process in S150 will be described in detail later with reference to FIGS.

  In S160, a frame extraction process is executed. The frame extraction process is a process for extracting a frame most likely to be most suitable for printing from the scenes for each scene determined in S150. In this embodiment, one frame is extracted from one scene. The specific contents of the frame extraction process in S160 will be described in detail later with reference to FIGS.

  In S170, a print frame selection thumbnail generation process is executed. Specifically, a thumbnail is generated for each frame extracted in S160. The thumbnail generated here is a thumbnail to be displayed when the user selects a frame to be printed later. Therefore, the thumbnail generated here is referred to as “print frame selection thumbnail”.

  In S180, moving image file selection thumbnail selection processing is executed. Specifically, one or more thumbnails suitable for representing the moving image file n are selected from the print frame selection thumbnails generated for each frame according to the selection criteria described later. The thumbnail to be selected here is a thumbnail to be displayed when the user selects which video file is to be printed first from the plurality of video files 1 to N later. Therefore, the thumbnails selected here are referred to as “moving image frame selection thumbnails”. The moving picture frame selection thumbnail selection process in S180 will be described in more detail later with reference to FIG.

  In S190, it is determined whether or not the file variable n is greater than or equal to N, that is, whether or not the processing of S140 to S180 has been performed for all of the obtained N moving image files. If the file variable n is not yet greater than N (S190: NO), the file variable n is incremented by 1 in S200, and the process returns to S140. If the file variable n is N or more (S190: YES), the process proceeds to S210.

  In S210, the moving image file selection thumbnail for each moving image file selected in S180 is displayed on the LCD 16. Specifically, as illustrated in FIG. 9A, a moving image list display screen in which the moving image file selection thumbnails 51, 52, 53,... For each moving image file are displayed as a list is displayed on the LCD 16. In S220, the selection of the moving image file by the user is accepted. Specifically, the user accepts an operation (for example, a tap operation, a mouse operation, etc.) for selecting a specific moving image file selection thumbnail on the moving image list display screen displayed in S210.

  In S230, the print frame selection thumbnail generated in S170 for the moving image file selected in S220 is displayed on the LCD 16. Specifically, as illustrated in FIG. 10A, a print frame selection screen on which a list of print frame selection thumbnails 71, 72, 73... Of the selected moving image file is displayed is displayed on the LCD 16. . In S240, the user selects a print frame. Specifically, the user accepts an operation (for example, a tap operation, a mouse operation, etc.) for selecting a specific print frame selection thumbnail on the print frame selection screen displayed in S230. The frame to be printed is determined by the process of S240.

  In S250, some print layouts for printing out the frame determined in S240 are displayed, and the user selects a print layout desired by the user. As layouts to be displayed here, for example, layouts with different frame image sizes, layouts with different display methods of images indicating metadata for frames, layouts that do not include metadata images, and the like can be considered.

  In S260, print data according to the print layout selected in S250 is generated and output to a device having a print function (for example, MFP 100). As a result, the selected frame can be printed. In S270, it is determined whether an operation for ending the moving image printing function has been performed. When the operation for ending the moving image printing function is not performed (S270: NO), the process returns to S210. When the operation for ending the moving image printing function is performed (S270: YES), the moving image printing process is ended.

(3-2) Description of Scene Determination Method and Frame Extraction Method Of the moving image printing process shown in FIG. 4, the scene determination process in S150 and the frame extraction process in S160 will be described in more detail with reference to FIGS. .

  First, the scene determination process in S150 will be described. The scene determination process according to the present embodiment is a process for determining a scene that has a high possibility of including a frame suitable for printing, using metadata added to a moving image file. In the basic processing method, as shown in FIG. 5, a time zone in which the same single metadata is continuously added is determined as one scene. That is, the time zone in which the metadata M1 is added is determined as the scene A in the entire moving image time, the time zone in which the metadata M2 is added is determined as the scene B, and the metadata M3 is added. The time zone in which the metadata M4 is added is determined as the scene D.

FIG. 5 exemplifies a specific time zone in which metadata is discretely added in a moving image file of a travel recording moving image 36 taken during a trip by a certain user.
While the processing method illustrated in FIG. 5 is used as a base, in the present embodiment, the state in which metadata is added and the length thereof, the type of metadata, the presence / absence of duplicate metadata in the same time zone, and the like Accordingly, the processing method is switched as appropriate.

  For example, as illustrated in FIG. 6A, when a plurality of metadata is densely added and there is a section where the metadata is not added in a short period (hereinafter referred to as “gap”). Determines a certain time zone immediately before the short gap to which the metadata is not added as the scene A, and decides a certain time zone immediately after the gap as the scene B. Only one of scenes A and B may be determined. In other words, when there is a time period in which a plurality of metadata are continuously added and the metadata is continuously added as a whole for a long time period, a certain time period immediately after the start of the entire time period And at least one of the fixed time zone immediately before the end is determined as a scene.

  A criterion for determining whether or not the time period during which metadata is continuously added is long can be determined as appropriate. For example, a threshold value for time may be set, and it may be determined that the time zone is long when the threshold is equal to or greater than the threshold value. Further, for example, a threshold may be set for the number of metadata that are continuously added, and it may be determined that the time zone is long when metadata equal to or greater than the threshold is continuously added. In addition, it is not necessarily an essential requirement that a plurality of metadata is continuously added. Even when one piece of metadata is added continuously over a long period of time, the fixed time zone immediately after the start or the fixed time zone immediately before the end of the time zone in which the metadata is added is determined as a scene. May be. Also, instead of judging based on the length of the time zone in which metadata is continuously added, if the gap is short by simply judging whether or not the gap is short, a certain time immediately before the gap A certain time zone immediately after the belt or the gap may be determined as the scene.

  Further, when a scene is determined by a basic processing method as illustrated in FIG. 5, for example, when one metadata is continuously added over a long time as illustrated in FIG. 6B. Does not adopt the time zone to which the metadata is added as a scene. In FIG. 6B, since the length of the metadata Mx is longer than a predetermined time threshold (for example, 60 seconds), the time zone to which the metadata Mx is added is not determined as a scene.

  In addition, as shown in FIG. 7A, a plurality of metadata may be added with time overlap. In this case, as shown in FIG. 7A, the entire time zone in which metadata is continuously added, including overlapping periods, is determined as one scene. In the example of FIG. 7A, three metadata are sequentially added in the time period from the time t1 to the time t2, and there are overlapping time periods. If the type of metadata is not considered, it can be said that the time period from time t1 to t2 is an independent time period to which metadata is continuously added as a whole. Therefore, the time zone is determined as scene A. In the time zone from time t3 to t4, two metadata are added so as to overlap in some time zones, but as a whole, one independent time in which metadata is continuously added. It is a belt. Therefore, the time zone is determined as scene B.

  Also, as illustrated in FIG. 7B, when a plurality of metadata are continuously added and overlapping sections occur irregularly, the scene is determined based on specific metadata. decide. FIG. 7B shows an example in which text metadata is adopted as specific metadata, and a time zone in which one text metadata is added is determined as a scene. Which metadata is to be the specific metadata can be determined as appropriate. For example, priority may be set for each type of metadata, and metadata having the highest priority may be set as specific metadata. The text metadata is metadata in which text information is directly displayed, and is suitable as specific metadata because it easily serves as an index for a moving image file.

  Next, the frame extraction process of S160 will be described. The frame extraction process of the present embodiment is a process for extracting one frame suitable for printing from the scene for each scene determined in the scene determination process of S150.

  It is possible to appropriately determine how to extract one frame from the scene. For example, an extraction criterion may be determined in advance, and extraction may be performed according to the extraction criterion. For example, as a first extraction criterion, a frame at a time when a specific elapsed time has elapsed from the start of the scene may be extracted. The specific elapsed time may be zero. That is, the first frame in the scene may be extracted. Also, for example, as the second extraction criterion, image blurring is the most in each frame included in one entire scene or in each frame included in a time zone from the start in one scene until a certain time elapses. A small number of frames may be extracted. However, a frame in which the entire screen is filled with the same color (for example, a frame when the screen is darkened) may be excluded from the extraction target.

  FIG. 5 shows an example in which one frame is extracted from each scene by the extraction method as described above. That is, the first frame 41 is extracted from the scene A. The metadata M1 (here, text metadata) added to the first frame 41 is metadata for displaying a text image 41a related to the contents of the first frame 41. From the scene B, the second frame 42 is extracted. Metadata M2 (here, text metadata) added to the second frame 42 is metadata for displaying a text image 42a related to the contents of the second frame 42. A third frame 43 is extracted from the scene C. Metadata M3 (here, text metadata) added to the third frame 43 is metadata for displaying the text image 43a related to the contents of the third frame 43. A fourth frame 44 is extracted from the scene D. Metadata M4 (here, text metadata) added to the fourth frame 44 is metadata for displaying a text image 44a related to the contents of the fourth frame 44.

  As illustrated in FIG. 7, even when there is a time zone in which a plurality of metadata is redundantly added to one scene, a frame may be extracted from the entire scene for each scene. Good. However, a period in which metadata overlaps in one scene may have a higher degree of attention than another period (for example, a period in which only one metadata is added).

  Therefore, when there is a time zone in which a plurality of metadata is added in duplicate in one scene, the amount of metadata information is the largest among the one scene as illustrated in FIG. A frame may be extracted from the time zone To by narrowing down to the time zone (for example, the time zone having the largest number of overlapping metadata) To.

(3-3) Explanation of Movie File Selection Thumbnail Selection Process Details of the movie file selection thumbnail selection process in S180 of the movie print process shown in FIG. 4 will be described with reference to FIG. Note that the moving image file selection thumbnail selection processing in FIG. 8 is processing for processing the print frame selection thumbnail generated in S170. Therefore, “metadata” in the moving image file selection thumbnail selection process of FIG. 8 indicates metadata added to each thumbnail generated in S170. That is, the metadata to be processed in the moving image file selection thumbnail selection process of FIG. 8 is metadata added to each thumbnail generated in S170.

  When the CPU 11 proceeds to the moving image file selection thumbnail selection process of S180, the CPU 11 executes the process shown in FIG. That is, in S310, the CPU 11 determines whether or not there is order information indicating the addition order when the provider of the moving image file n adds metadata in the metadata of each thumbnail.

  If there is order information (S310: YES), in S320, it is determined whether or not the metadata added first among the metadata of each thumbnail is text metadata. If the first added metadata is not text metadata (S320: NO), the process proceeds to S340. When the first added metadata is text metadata (S320: YES), the process proceeds to S330.

  In S330, the print frame selection thumbnail generated from the scene including the text metadata added at the beginning (that is, the scene to which the text metadata is added) is used to select the video file indicating the video file n. Set to thumbnail. There is a high possibility that the scene to which the text metadata is added at the beginning is the scene that the video provider wants to claim most (that is, the scene with many highlights). Therefore, it can be said that a thumbnail generated from such a scene is a thumbnail suitable for representing the moving image file n. After the processing of S330, the process proceeds to S190 (FIG. 4).

  If it is determined in S310 that there is no order information (S310: NO), the process proceeds to S340. In S340, it is determined whether there is text metadata in the metadata of each thumbnail. If there is text metadata (S340: YES), it is determined in S350 whether there is only one text metadata having the maximum font size. For example, when there is only one text metadata with the largest font size, such as when all the text metadata have the same font size or there are multiple text metadata with the largest font size (S350: NO) The process proceeds to S370. If there is only one text metadata with the largest font size (S350: YES), the process proceeds to S360.

  In S360, the print frame selection thumbnail generated from the scene including the text metadata having the largest font size is set as the video file selection thumbnail indicating the video file n. The scene to which the text metadata having the largest font size is added among the text metadata is highly likely to be the most emphasized scene in the moving image and the most desired by the moving image provider. Therefore, it can be said that a thumbnail generated from such a scene is a thumbnail suitable for representing the moving image file n. After the process of S360, the process proceeds to S190 (FIG. 4).

  If it is determined in S340 that there is no text metadata (S340: NO), the process proceeds to S370. In S370, it is determined whether or not there is link metadata in the metadata of each thumbnail. If there is link metadata (S370: YES), it is determined in S380 whether there is non-special link metadata. Non-special link metadata is other link metadata excluding link metadata having special link information. As the special link information, for example, there is link information that leads to registration in a video channel site for video browsing. Note that how to set the non-special link metadata can be determined as appropriate.

  For example, if there is no non-special link metadata (eg, all link metadata is link metadata having special link information) (S380: NO), the process proceeds to S400. If there is non-special link metadata (S380: YES), the process proceeds to S390.

  In S390, for the non-special link metadata added at the earliest time within the video playback time among the non-special link metadata, the print frame selection thumbnail generated from the scene including the non-special link metadata is It is set as a moving image file selection thumbnail indicating the moving image file n. After the process of S390, the process proceeds to S190 (FIG. 4).

  If it is determined in S370 that there is no link metadata (S370: NO), the process proceeds to S400. In S400, for the metadata added at the earliest time within the moving image playback time among the metadata of each thumbnail, the print frame selection thumbnail generated from the scene including the metadata is indicated for the moving image file n. Set to thumbnail for video file selection. After the process of S390, the process proceeds to S190 (FIG. 4).

(3-4) Description of Moving Image List Display Screen An example of the moving image list display screen displayed in S210 in the moving image printing process illustrated in FIG. 4 is illustrated in FIG. The moving image list display screen 50 shown in FIG. 9A is a screen in which one moving image file selection thumbnail selected for each moving image file is displayed in a list in the vertical direction. By performing a specific screen transition operation (for example, flicking up and down, swiping, etc.), the display content can be scrolled up and down.

  The moving image file can be selected by performing a selection operation by touch operation or mouse operation on the moving image file selection thumbnail corresponding to the moving image file to be printed.

  On the moving image list display screen 50 in FIG. 9A, one moving image file selection thumbnail 51 (corresponding to the third frame 43 in FIG. 5) is displayed as a thumbnail indicating the moving image file of the travel recording moving image 36 (see FIG. 5). One moving image file selection thumbnail 52 is displayed as a thumbnail indicating the moving image file of the fireworks display moving image 32 (see FIG. 2B), and the moving image file of the landscape recording moving image 35 (see FIG. 3B) is displayed. One moving image file selection thumbnail 53 is displayed as a thumbnail to be shown.

  In addition, in the moving image list display screen 50 in FIG. 9A, each moving image file selection thumbnail 51, 52, 53 includes an image indicating metadata. The area metadata added to the landscape recording moving image 35 is displayed as a frame image indicating the area in the moving image file selection thumbnail 53.

  Note that whether or not to display an image indicating metadata on each thumbnail in the moving image list display screen, and where and how to display the image when displaying it, can be appropriately determined.

(3-5) Description of Print Frame Selection Screen An example of the print frame selection screen displayed in S230 in the moving image printing process shown in FIG. 4 is shown in FIG. The print frame selection screen shown in FIG. 10A is a list of print frame selection thumbnails generated for the video files selected on the video list display screen (see FIG. 9A) arranged vertically. It is the displayed screen. By performing the screen transition operation, the display content can be scrolled up and down.

  A frame to be printed can be selected by performing a selection operation by a touch operation or a mouse operation on a print frame selection thumbnail corresponding to the frame to be printed.

  In the print frame selection screen 70 of FIG. 10A, a plurality of print frame selection thumbnails 71, 72, 73... Generated for the movie file of the travel record movie 36 (see FIG. 5) are displayed. ing. The print frame selection thumbnail 71 at the top of the screen is the first frame 41 in FIG. 5, and the print frame selection thumbnail 72 at the middle of the screen is the second frame 42 in FIG. 5. The frame selection thumbnail 73 is the third frame 43 of FIG.

  The order in which the plurality of print frame selection thumbnails are displayed can be determined as appropriate. For example, it may be arranged from the top with reference to the time in the video (for example, in order from the start of the video). Further, for example, a unique priority order may be set and arranged from the top according to the priority order.

  In addition, in the print frame selection screen 70 of FIG. 10A, images (in this case, text images) indicating metadata for the respective print frame selection thumbnails 71, 72, 73 are displayed in an overlay in the thumbnails. .

  However, it is not essential to overlay display an image indicating metadata on a print frame selection thumbnail, and an image indicating metadata may not be overlay displayed. Further, even if no overlay display is performed in the print frame selection thumbnail, an image indicating metadata may be displayed outside each thumbnail, for example, as a print frame image 80 shown in FIG. 10B. .

  If a plurality of metadata is added to the frame from which the print frame selection thumbnail is generated, all images indicating the plurality of metadata may be displayed, or only one or a plurality of images may be displayed. You may make it select and display. A selection method in the case of selecting any one or a plurality of metadata from among a plurality of metadata can be determined as appropriate. For example, priority may be given to metadata so that the metadata is preferentially selected from metadata having a high priority. It is possible to appropriately determine whether or not to display an image indicating metadata on each thumbnail, and where and how to display the image when displaying the thumbnail.

(4) Effects of Embodiment As described above, in the terminal 10 of the present embodiment, the application 12b includes the moving image printing function and executes the moving image printing process illustrated in FIG. In the moving image printing function of the present embodiment, a print output frame is extracted based on the metadata added to the moving image file. Therefore, the user of the terminal 10 can easily select a frame suitable for printing in the moving image file.

  In the moving image printing function of this embodiment, first, a scene is determined based on metadata, and a frame is extracted from the determined scene for each determined scene according to a specific extraction criterion. In this way, by first narrowing the extraction target scene prior to frame extraction, the processing load for frame extraction can be reduced. In addition, since the frame is extracted according to a specific extraction criterion, the frame can be appropriately extracted by appropriately setting the extraction criterion.

  In the present embodiment, a plurality of types of methods for determining a scene from a moving image file are prepared as illustrated in FIGS. By appropriately using such a plurality of types of scene determination methods, a scene can be appropriately determined from a moving image file, and thus candidate frames suitable for printing can be appropriately extracted.

  In the present embodiment, the above-described first extraction criterion or second extraction criterion is employed as an extraction criterion when extracting one frame from one scene. For example, a frame at a specific timing in the scene, such as at the start of the scene or around the middle of the scene, may be suitable for printing. Further, a frame with a large image blur is not suitable for printing regardless of the contents of the frame, so it can be said that the smaller the blur, the more suitable for printing. Therefore, by extracting the frames based on the elapsed time from the start of the scene and the blurring of the images, it is possible to appropriately and efficiently extract the frames suitable for printing.

  Further, in the above embodiment, when a plurality of metadata is duplicated and added in one scene, the frame is extracted from the narrowed-down time zone where the plurality of metadata overlaps the most. By narrowing the frame extraction target to a specific time zone from within the scene instead of the entire scene, the processing load required for frame extraction can be reduced. In addition, since a time zone in which a plurality of metadata is loaded is highly likely to be one of the most characteristic time zones in the scene, frames are extracted by narrowing down to such a time zone. Thus, a frame suitable for printing can be extracted appropriately and efficiently.

  In the above embodiment, a print frame selection thumbnail is generated for each frame extracted in the frame extraction process, and the thumbnail list screen (print frame selection screen in FIG. 10) is displayed on the LCD 16, from which the print target is selected. Let the user select a frame. Therefore, the user can easily and efficiently select a frame to be printed.

  Further, as shown in FIG. 10A, information indicated by corresponding metadata may be added to the print frame selection thumbnail displayed on the print frame selection screen. In that case, the user can know the contents of each frame more specifically, and can thereby appropriately select the frame to be printed.

  In addition, when there are a plurality of moving image files, it is necessary to first select a moving image file to be printed before selecting which frame in the moving image file is to be printed. On the other hand, in the present embodiment, for each video file, a thumbnail suitable for representing the video file is selected as a video file selection thumbnail from the print frame selection thumbnails, and the selected video file selection thumbnails are selected. Therefore, a desired moving image file to be printed can be efficiently selected.

  In the present embodiment, the terminal 10 corresponds to an example of a moving image processing apparatus of the present invention. The application 12b corresponds to an example of a moving image processing program of the present invention. The CPU 11 corresponds to an example of a computer and a control unit of the present invention. The LCD 16 corresponds to an example of a display unit of the present invention. The frame extracted in the frame extraction process of S160 corresponds to an example of the candidate frame of the present invention, and the extraction standard used in the frame extraction process corresponds to an example of the candidate frame extraction standard of the present invention. The time zone To shown in FIG. 7 corresponds to an example of the narrowed-down scene of the present invention. The print frame selection thumbnail corresponds to an example of a thumbnail image of the present invention. The moving image file selection thumbnail corresponds to an example of the moving image selection image of the present invention. The process of S110 corresponds to an example of a file acquisition process of the present invention. The process of S120 corresponds to an example of the data acquisition process of the present invention. The process of S150 corresponds to an example of the scene extraction process of the present invention. The process of S170 corresponds to an example of the image generation process of the present invention. The process of S230 corresponds to an example of the image display process of the present invention. The process of S240 corresponds to an example of an image selection process and a determination process of the present invention. The process of S180 corresponds to an example of the selection image setting process of the present invention. The process of S210 corresponds to an example of the selection image display process of the present invention. The process of S220 corresponds to an example of the selection image selection process of the present invention.

[Other Embodiments]
(1) The moving image printing process of FIG. 4 is configured to proceed to S210 after finishing the processing of S140 to S180 for all of the obtained N moving image files, but in this way, up to S180 for all moving image files. It is not essential to proceed to S210 after finishing the process. For example, every time the processing up to S180 is completed for one moving image file, the processing after S210 may be sequentially performed to display an image so that selection can be accepted. In that case, when a moving image file in the middle is selected, the processing up to S180 may be stopped at that time, and the processing may proceed to S230 and subsequent processing for the selected moving image file.

  (2) The specific contents of the moving image file selection thumbnail selection process in S180 of FIG. 4, that is, the method of selecting the moving image file selection thumbnail from the print frame selection thumbnails generated in S170 will be described in detail in FIG. The method is not limited. The selection method shown in FIG. 8 is merely an example, and other selection criteria may be set for selection. For example, a print frame selection thumbnail generated from a scene including text metadata having the smallest number of text characters in the text metadata may be selected as a moving image file selection thumbnail. Further, for example, a priority may be set for each type of metadata, and a print frame selection thumbnail generated from a scene including metadata with the highest priority may be selected as a moving image file selection thumbnail.

  A plurality of moving image file selection thumbnails may be selected for one moving image file. A specific selection method for selecting a plurality can be determined as appropriate. For example, in the moving image file selection thumbnail selection process of FIG. 8, the process proceeds to S340 after the process of S330, proceeds to S370 after the process of S360, and proceeds to S400 after the process of S390. A plurality of movie file selection thumbnails can be selected for one movie file.

  Then, when a plurality of moving image file selection thumbnails are selected for one moving image file, it is possible to appropriately determine how to display each moving image file selection thumbnail on the moving image list display screen. For example, the images may be displayed while sequentially switching one by one in a slide show format. Further, for example, as illustrated in FIG. 9B, all the selected moving image file selection thumbnails may be displayed in a list for each moving image file. The moving image list display screen 60 shown in FIG. 9B shows an example in which five moving image file selection thumbnails 61 to 65 are selected from the moving image files of the travel recording moving image 36 and are displayed in a list. Yes. Also in the example of FIG. 9B, it is possible to appropriately determine whether or not to display an image indicating metadata on each thumbnail, and where and how to display the image when displaying the thumbnail.

  (3) When displaying one moving image file selection thumbnail for one moving image file as in the moving image list display screen 50 illustrated in FIG. 9A, not only displaying the thumbnail, Frames within a certain time period including frames corresponding to thumbnails may be reduced and continuously displayed for switching. That is, you may make it display the moving image within the said fixed time by the size of a thumbnail.

  (4) In the print frame selection screen illustrated in FIG. 10, all the print frame selection thumbnails generated for the moving image file selected on the moving image list display screen can be displayed. It is not necessary to be able to display all the print frame selection thumbnails. For example, the more frames extracted by the frame extraction process, the more print frame selection thumbnails that are generated. In this case, some of the generated print frame selection thumbnails may be thinned and displayed. The criteria for thinning out thumbnails can be determined as appropriate.

  (5) The terminal 10 is merely an example as a platform for executing the application 12b. For example, the application 12b may be executed by the MFP 100. Further, for example, the application 12b may be executed by the server 160 or other information processing apparatus (specifically, an information processing apparatus that is separate from the terminal 10 and capable of data communication with the terminal 10). Specifically, for example, when a desired moving image file to be printed is uploaded from the terminal 10 or the MFP 100 to the information processing apparatus, scene determination and frame extraction are performed on the information processing apparatus side. Each generated and selected thumbnail is displayed on the terminal 10 or MFP 100 by causing the data processing apparatus to transmit the thumbnail data to the terminal 10 or MFP 100. The result of the thumbnail selection process in terminal 10 or MFP 100 is transmitted to the information processing apparatus. Based on the result, the information processing apparatus generates print data, and the print data is transmitted to MFP 100.

  (6) In the above embodiment, an example in which the present invention is applied to moving image printing has been described, but application of the present invention is not limited to moving image printing. That is, the present invention can be applied to other purposes other than the purpose of extracting frames from a moving image file for the purpose of moving image printing.

  (7) The provision form of the application 12b is not limited to provision by downloading via the Internet, and various provision forms can be adopted. For example, in a state recorded on a computer-readable (tangible) non-transitory recording medium (A non-transitory computer-readable recording medium) such as a memory card, flexible disk, DVD, CD-ROM, or hard disk It may be possible to provide it.

  (8) In addition, the present invention is not limited to the specific means and structure shown in the above embodiment, and can take various forms without departing from the gist of the present invention. For example, the functions of one component in the above embodiment may be distributed as a plurality of components, or the functions of a plurality of components may be integrated into one component. Further, at least a part of the configuration of the above embodiment may be replaced with a known configuration having the same function. Moreover, you may abbreviate | omit a part of structure of the said embodiment as long as a subject can be solved. In addition, at least a part of the configuration of the above embodiment may be added to or replaced with the configuration of the other embodiment. In addition, all the aspects included in the technical idea specified from the wording described in the claims are embodiments of the present invention.

DESCRIPTION OF SYMBOLS 10 ... Terminal, 11 ... CPU, 12 ... Flash memory, 12a ... OS, 12b ... Application, 12c ... Storage area for application, 13 ... RAM, 15 ... Operation key, 16 ... LCD, 17 ... Touch panel, 18 ... Memory card I / F, 19 ... voice input / output unit, 20 ... telephone network communication unit, 22 ... short-range communication unit, 23 ... wireless communication unit, 24 ... bus line, 25 ... memory card, 31 ... pet dog recording video, 31a, 32a, 33a, 41a, 42a, 43a, 44a ... text image, 32 ... fireworks display video, 33 ... Western program video, 34 ... nature introduction video, 34a, 34b, 35a-35d ... frame image, 35 ... landscape recording video, 36 ... Travel record moving image, 41... 1st frame, 42... 2nd frame, 43... 3rd frame, 44. ˜65: Thumbnail for selecting moving image file, 70, 80: Print frame selection screen, 71-73: Thumbnail for selecting print frame, 100: MFP, 122: Short-range communication unit, 123: Wireless communication unit, 131: Printer unit, 160: Server.

Claims (15)

On the computer,
File acquisition processing to acquire video files,
A data acquisition process for acquiring metadata attached to the video file acquired by the file acquisition process;
A frame extraction process for extracting candidate frames, which are specific frames for output suitable for printing, from the moving image file based on the metadata acquired by the data acquisition process;
A video processing program for running A moving image processing program according to claim 1,
A scene extraction process for extracting a specific time zone as a scene from the video file based on the metadata acquired by the data acquisition process;
In the frame extraction process, the candidate frame is extracted according to a specific candidate frame extraction criterion from the scene extracted by the scene extraction process. The moving image processing program according to claim 2,
In the scene extraction process, at least one of the scenes is extracted with the time zone in which metadata is continuously added as one scene in the entire movie file. A moving image processing program according to claim 2 or claim 3,
The moving image processing program, wherein the scene is a time zone in which predetermined predetermined metadata is continuously added. The moving image processing program according to claim 2,
In the scene extraction process, at least one scene is extracted from the entire moving image file, with a certain time zone immediately before or immediately after a time zone in which no metadata is continuously added as one scene. A moving picture processing program characterized by the above. A moving image processing program according to any one of claims 2 to 5,
Any one of the following (a) and (b) is set as the candidate frame extraction criterion:
(A) A frame at a time when a specific elapsed time has elapsed from the start of the scene is set as the candidate frame.
(B) Among the frames included in the entire scene or the frames included in the time zone from the start of the scene until a predetermined time elapses, a frame with the least image blur is set as the candidate frame. . A moving image processing program according to any one of claims 2 to 6,
In the frame extraction process, when there is a time zone in which a plurality of metadata is added in duplicate in the scene, a time zone with the largest number of metadata duplications in the scene is selected as a narrowed-down scene. A moving image processing program that extracts the candidate frame from the narrowed-down scene according to the candidate frame extraction criterion. A moving image processing program according to any one of claims 1 to 7,
The plurality of metadata includes text metadata for displaying text in the video, link metadata for displaying an image indicating a region where the hyperlink is embedded in the video, and the video. When the hyperlink is embedded in the embedded area and a specific input operation is performed on the embedded area, the area metadata for displaying at least one of the image indicating the embedded area and the image indicating the hyperlink is displayed. Including at least two pieces of metadata,
A moving picture processing program characterized by the above. A moving image processing program according to any one of claims 1 to 8,
An image generation process for generating a thumbnail image representing the candidate frame for each candidate frame extracted in the frame extraction process;
An image display process for displaying at least one of the thumbnail images generated by the image generation process on a display unit;
An image selection process for receiving a selection input of a specific thumbnail image from among the thumbnail images displayed on the display unit by the image display process;
A determination process for determining the candidate frame corresponding to the thumbnail image selected by the image selection process as an output target frame;
A moving image processing program characterized by comprising: The moving image processing program according to claim 9,
In the image display processing, for each thumbnail image, information indicating metadata added to the candidate frame corresponding to the thumbnail image is also displayed together. The moving image processing program according to claim 10,
The metadata includes at least one of an image indicating the embedded area and an image indicating the hyperlink when a hyperlink is embedded in a moving image and a specific input operation is performed on the embedded area. Contains region metadata for display,
In the image display process, when the region metadata is added to the candidate frame corresponding to the thumbnail image, the information indicating the hyperlink of the region metadata and the hyperlink as the information indicating the metadata A moving image processing program that displays at least one of information indicating an area in which is embedded. A moving image processing program according to any one of claims 9 to 11,
A selection image setting process for setting a thumbnail image selected according to a specific selection criterion from the thumbnail images generated in the image generation process as a moving image selection image indicating the moving image file;
For each of the different video files, a selection image display process for displaying the video selection image corresponding to the video file on the display unit;
A selection image selection process for receiving a selection input of a specific video file from the video selection images displayed on the display unit by the selection image display process;
Run
In the image display process, the thumbnail image corresponding to the moving image file selected by the selection image selection process is displayed. A moving image processing program according to claim 12,
In the selection image display processing, for each moving image selection image, information indicating metadata added to the candidate frame corresponding to the moving image selection image is also displayed. . A file acquisition step for acquiring a video file;
A data acquisition step of acquiring metadata attached to the video file acquired in the file acquisition step;
Based on the metadata acquired in the data acquisition step, a frame extraction step of extracting candidate frames that are specific frames for output from the moving image file;
A moving image processing method comprising: With a control unit,
The controller is
File acquisition processing to acquire video files,
A data acquisition process for acquiring metadata attached to the video file acquired by the file acquisition process;
A frame extraction process for extracting candidate frames that are specific frames for output from the moving image file based on the metadata acquired by the data acquisition process;
The moving picture processing apparatus characterized by performing.