JP2015198387A - Moving image processing program, moving image processing method, and moving image processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To print a metadata-added frame in a moving image file with a content corresponding to the taste of a user, when moving image printing is to be performed.SOLUTION: When a frame to be subjected to moving image printing is determined, one or more preview images each indicating a printing result to be obtained in the case of printing the frame is generated and displayed on a display unit. As the preview images to generate, one or more preview images 61 of specific types each including an image 62 of a frame and an information image 63 indicating metadata added to the frame are included. When the preview images are selected, printing data of the selected preview images is generated.

Description

  The present invention relates to a moving image processing program, a moving image processing method, and a moving image processing apparatus for processing a moving image file.

  Hardware and software that can import video files for viewing and editing have become widespread. For example, a moving image file can be enjoyed in various forms by loading the moving image file into various information processing terminals such as a personal computer, a smartphone, and a multi-function device and executing various processes.

  As one of processing functions for a moving image file, a moving image printing function is known and has already been put into practical use (for example, see Patent Document 1). Movie printing is a function of extracting a frame at a desired timing from a movie and printing an image of the frame.

JP 2011-71591 A

  Metadata that is information related to the moving image file can be added to the moving image file. With the spread of software for editing moving image files and the diversification of moving image posting services via the Internet, adding value to moving image files to increase added value is becoming increasingly popular. In the case where a video file is downloaded from a video site on the Internet and viewed, metadata information is being displayed in the video.

  Moving image printing can also be performed on a moving image file to which metadata is added. However, if the user wants to print a specific frame in the scene to which the metadata is added, the user will print whether the metadata information will be printed, and what image will be printed. There is a possibility of getting lost.

  The present invention has been made in view of the above problems, and an object of the present invention is to enable printing of a frame to which metadata in a moving image file is added according to user's preference when performing moving image printing. And

  The present invention made to solve the above-described problems is a moving image processing program that can be executed by a control unit in a moving image processing apparatus including a display unit and a control unit. The moving image processing program of the present invention includes a file acquisition process, a data acquisition process, a frame determination process, an image generation process, an image display process, an image selection process, and a print data generation process as processes to be executed by the control unit. And having.

  The file acquisition process is a process for acquiring a moving image file. The data acquisition process is a process of acquiring metadata added to the moving image file acquired by the file acquisition process. The frame determination process is a process of determining a specific frame to which metadata is added as a print target frame from the moving image file. The image generation process is a process of generating at least one preview image of a print result when printing the print target frame determined by the frame determination process. The image display process is a process for displaying the preview image generated by the image generation process on the display unit. The image selection process is a process of accepting a selection input of a specific preview image among the preview images displayed by the image display process. The print data generation process is a process for generating print data of the preview image selected by the image selection process.

  By causing the computer to execute the moving image processing program of the present invention, at least one preview image of the print target frame to which the metadata is added is displayed, and the print data of the specific preview image selected from the preview image is displayed. Can be generated.

  Therefore, according to the moving image processing program of the present invention, it is possible to confirm in advance how the frame to which the metadata is added is actually printed out, thereby printing according to the user's preference. Can be output.

  In addition to the above-described program, the present invention is realized in various forms such as a recording medium on which the program is recorded, an apparatus on which the program is executed, various systems including the apparatus, and a method for processing a moving image. Can do.

It is a block diagram which shows schematic structure of the moving image printing system of embodiment. It is explanatory drawing which shows the example image during reproduction | regeneration of the moving image file to which text metadata was added. It is explanatory drawing which shows the example of an image during reproduction | regeneration of the moving image file to which link metadata was added, and the moving image file to which area | region metadata was added. It is explanatory drawing which shows the example of the printing result in an overlay layout and an external arrangement layout. It is explanatory drawing which shows the example of the printing result in a character recognition layout and a face recognition layout. It is explanatory drawing which shows an example of a preview screen. It is explanatory drawing which shows an example of a layout selection screen. It is a flowchart which shows a moving image printing process. It is a flowchart which shows the detail of the printing layout selection process of S180 in the moving image printing process of FIG. FIG. 10 is a flowchart showing details of text metadata layout processing in S380 in the print layout selection processing of FIG. 9. FIG.

Preferred embodiments of the present invention will be described below with reference to the drawings.
(1) Description of Movie Printing System As shown in FIG. 1, the movie printing system according to the present embodiment includes a terminal 10, an MFP (abbreviation of multifunction peripheral device) 100, an AP (abbreviation of access point) 150, A server 160.

  The terminal 10 is an information processing terminal such as a personal computer, a smartphone, or a tablet. The terminal 10 includes a CPU 11, a flash memory 12, a RAM 13, an operation key 15, an LCD 16, a touch panel 17, a memory card interface (hereinafter referred to as "memory card I / F") 18, a voice input / output unit 19, a telephone network communication unit 20, A short-range communication unit 22 and a wireless communication unit 23 are provided. These units are connected to each other via a bus line 24.

  The CPU 11 controls each unit connected via the bus line 24 in accordance with programs and data stored in the flash memory 12. The flash memory 12 is a nonvolatile memory capable of electrically rewriting stored contents. The flash memory 12 stores an operating system (hereinafter abbreviated as “OS”) 12 a and an application (hereinafter abbreviated as “application”) 12 b. The OS 12 a is basic software for realizing standard functions of the terminal 10.

  Note that other applications other than the application 12b are also stored in the flash memory 12, but the illustration and description of these other applications are omitted here. In the following description, the CPU 11 that executes programs such as the OS 12a and the application 12b may be simply described by a program name. For example, the description “application is” may mean “the CPU 11 that executes the application”.

  The application 12b is software for using various functions of the MFP 100 from the terminal 10, is provided by the vendor of the MFP 100, and is installed on the terminal 10 by the user. By installing the application 12b in the terminal 10, various functions of the MFP 100 can be used from the terminal 10. For example, the application 12b can directly use the print function, scan function, and the like of the MFP 100 from the terminal 10.

  One of the functions provided in the application 12b is a moving image printing function that allows the MFP 100 to select a frame from a moving image file and cause the MFP 100 to print an image of the frame (that is, a still image).

  The flash memory 12 is provided with an application storage area 12c. The application storage area 12c is a storage area used by the application 12b and allocated to the application 12b. The application storage area 12c stores, for example, various preview images generated when the moving image printing function is executed, moving image printing history, and the like. The moving image file and metadata (details will be described later) added to the moving image file may be stored in the application storage area 12c, or may be an area different from the application storage area 12c in the flash memory 12. May be stored.

  The RAM 13 is a volatile memory for temporarily storing various data when the CPU 11 executes the OS 12a, the application 12b, and the like. The operation keys 15 are mechanical keys for the user of the terminal 10 to input various information and instructions to the terminal 10. The LCD 16 is a liquid crystal display device capable of displaying various screens. The touch panel 17 is a well-known input device that can accept an input operation on the terminal 10 by touching or approaching an indicator such as a finger or a stick, and is provided over the LCD 16. When the terminal 10 is a terminal (for example, a personal computer) to which a mouse can be connected as an input device, a mouse can also be included as a constituent member of the terminal 10. In the following description, an input operation with an indicator on the touch panel 17 is referred to as a “touch operation”, and an operation of moving the mouse pointer on the screen to overlap a specific area or image is referred to as “mouse over”. The input operation by clicking is called “mouse operation”.

  The memory card I / F 18 is an interface to which a rewritable nonvolatile memory card 25 is mounted, and controls writing and reading of data with respect to the memory card 25. The voice input / output unit 19 is a voice input / output device including a microphone, a speaker, and the like. The telephone network communication unit 20 is a circuit for performing a voice call via a mobile phone network (not shown).

  The short-range communication unit 22 is an interface for performing communication by short-range wireless communication in which a short distance of about 10 cm, for example, is used as a communicable distance. The short-range wireless communication performed by the short-range communication unit 22 of the present embodiment is non-contact communication (hereinafter referred to as “NFC communication”) according to the NFC standard.

  The wireless communication unit 23 is an interface for performing communication according to the wireless LAN standard (hereinafter referred to as “wireless LAN communication”). In the present embodiment, the wireless LAN communication performed by the wireless communication unit 23 is wireless LAN communication compliant with the IEEE802.11b / g / n standard. The terminal 10 can perform wireless communication (hereinafter referred to as “Wi-Fi communication”) based on the Wi-Fi (registered trademark, the same applies hereinafter) standard with the AP 150 via the wireless communication unit 23. .

  The AP 150 is a relay device that relays Wi-Fi communication. The AP 150 has a broadband router function and is connected to the Internet. Accordingly, the terminal 10 can connect to the Internet via the AP 150 and can communicate with the server 160 connected to the Internet.

  The MFP 100 has various functions such as a print function, a scan function, a copy function, and a facsimile function. The MFP 100 includes various components for realizing the various functions. The printer unit 131 illustrated in FIG. 1 is a constituent member for realizing a printing function. In MFP 100, when print data is received from outside by wireless communication unit 123 or short-range communication unit 122, printer unit 131 can perform print output based on the print data.

  The MFP 100 includes a short-range communication unit 122 having the same configuration as the short-range communication unit 22 of the terminal 10. In addition, the MFP 100 includes a wireless communication unit 123 having the same configuration as the wireless communication unit 23 of the terminal 10. Therefore, the terminal 10 and the MFP 100 can perform NFC communication between them. Further, the terminal 10 and the MFP 100 can perform Wi-Fi communication with each other via the AP 150. In addition, the terminal 10 and the MFP 100 can perform direct communication based on the Wi-Fi Direct (registered trademark, the same applies hereinafter) standard, that is, wireless communication not via the AP 150.

  Note that the terminal 10 and the MFP 100 may be configured to be able to perform data communication using other data communication methods. For example, data communication via a wired LAN may be possible. In that case, the terminal 10 may be connected to the Internet via a wired LAN.

  The server 160 stores various types of data. As data stored in the server 160, there is a moving image file. The server 160 also functions as a server for a moving image posting service, and can upload a moving image file to the server 160 via the Internet or download a moving image file from the server 160 via the Internet. Various metadata (details will be described later) can be added to the uploaded video file. In addition, when downloading a moving image file, metadata added to the moving image file can also be downloaded. The download of metadata is usually performed separately from the download of the video file. For example, first, a moving image file is downloaded, and then metadata attached to the moving image file (that is, associated and stored in the server 160) is downloaded.

  The terminal 10 can also download and view a moving image file and metadata from the server 160. The moving image file and metadata downloaded from the server 160 can be stored in the flash memory 12 or the memory card 25. Further, when the terminal 10 has a moving image shooting function, the shot moving image file can be uploaded to the server 160. A moving image file stored in the memory card 25 can also be uploaded to the server 160. Note that metadata can be arbitrarily added to the moving image file. For this reason, when a moving image file is acquired from the server 160, the memory card 25, or the like, metadata is not necessarily added to the moving image, but in the present embodiment, metadata is added to the moving image file. Assuming that.

(2) Description of Metadata Next, the moving image file and metadata added to the moving image file will be described in more detail. As is well known, a moving image file is composed of a plurality of frames (still images) taken continuously at a predetermined time interval. The higher the frame rate, the more frames per unit time, and the smoother the motion can be reproduced. The moving image file includes various data related to the moving image in addition to the plurality of frames. For example, moving image shooting date and time, file format, and the like.

  Furthermore, as described above, metadata that is information related to the moving image file can be added to the moving image file. The metadata is data indicating the content of a moving image, and can be added to any timing or time zone in the entire reproduction time of the moving image file. By adding metadata to a video file, the added value of the video file can be increased.

  There are various types of metadata such as annotations, sticky notes, tags, and comments. For example, if metadata for displaying text in a video (hereinafter referred to as “text metadata”) is added to a specific time zone of a video file, the text indicated by that metadata during playback of that time zone Is displayed.

  For example, metadata for embedding a hyperlink in a moving image (hereinafter referred to as “link metadata”) can be added to a specific time zone of the moving image file. As is well known, a hyperlink (hereinafter abbreviated as “link”) is location information of other files and data, and a URL (Uniform Resource Locator) is mainly used. The link metadata can be added to the designated area by designating an arbitrary area in the entire screen on which the moving image is displayed. The link information included in the link metadata is not directly displayed even during playback in the time zone to which the link metadata is added. However, since the frame image indicating the outer frame of the designated area in which the link information is embedded is displayed, the user can recognize that the link metadata is added.

  During playback of the time zone to which link metadata is added, if you touch within the specified area on the screen or mouse over the specified area, a frame image showing the outer frame of the specified area is highlighted, The added link information (for example, URL) is displayed. When a specific operation (for example, long press, also referred to as long tap) is performed on the touch panel 17 or a mouse is operated in the designated area where the link is embedded within the time when the link metadata is added. , It is possible to jump to the link destination indicated by the link information.

  Further, as metadata for embedding a link in a moving image, there is region metadata in addition to the link metadata. The area metadata is not directly displayed even during reproduction of the time zone to which the area metadata is added. Moreover, unlike the link metadata, a frame image indicating the outer frame of the designated area in which the link information is embedded is not displayed. Therefore, the user cannot directly recognize that metadata is added from the content of the moving image being reproduced.

  During the reproduction of the time zone to which the area metadata is added, when a touch operation is performed in the designated area on the screen or the mouse is moved over the designated area, a frame image indicating the outer frame of the designated area is displayed. At that time, in addition to displaying the frame image, link information (for example, URL) is also displayed. Thus, the user can recognize that the link is embedded and the designated area in which the link is embedded. When a specific operation (for example, long press) is performed on the touch panel 17 or the mouse is operated in the designated area where the link is embedded within the time when the area metadata is added, the link indicated by the link information You can jump ahead.

  Various information is included in the metadata. Information included in the metadata includes, for example, time zone information for adding metadata in the entire moving image, display position information indicating at which position in the screen the image is displayed, and additional date and time information indicating the date and time added to the moving image. If there is an image to be displayed (for example, text or frame image), display image information indicating the contents of the image, if there is an image to be displayed, whether to display it directly, or touch operation or mouse over Until it is done, there is display method information that indicates whether or not to make it non-display state. In the case of text metadata, the display image information includes information such as text font, font size, and color. In the case of link metadata and area metadata, information indicating the position / range of the designated area and link information are also included.

  FIG. 2 and FIG. 3 show examples of images during reproduction of a moving image file to which various kinds of metadata are added. 2 and 3 show moving images displayed on the LCD 16 when a moving image file stored in the flash memory 12 is played back, and in particular, display examples of a time zone in which metadata is added. .

  FIG. 2A shows one frame (that is, one frame) during the reproduction of the pet dog recorded moving image 31, and one frame in a time zone to which the text metadata of the text image 31a is added. As shown in FIG. 2A, text metadata for displaying a text image 31a expressing the feeling of the dog is added to the pet dog recording video 31 as shown in FIG. .

  FIG. 2B is a frame during the reproduction of the fireworks display video 32, and is a frame in the time zone to which the text metadata of the text image 32a is added. As shown in FIG. 2B, the fireworks display video 32 is added with text metadata for displaying a text image 32a of the title of the firework being fired for the scene where the firework is being fired. Yes.

  FIG. 2C shows one frame during the reproduction of the Western-style program moving image 33, and one frame in the time zone to which the text metadata of the text image 33a is added. As shown in FIG. 2 (c), the Western-style program video 33 includes an English scene for a scene in which a certain character is talking and an English subtitle of the story is shown. Text metadata for displaying a Japanese-translated text image 33a of subtitles is added.

  FIG. 3 (a) is a frame during playback of the nature introduction video 34, and is a frame in the time zone to which the link metadata of the three frame images 34a, 34b, and 34c is added. In the link metadata added to the nature introduction video 34, information for displaying each frame image 34a, 34b, 34c and whether the area surrounded by each frame image 34a, 34b, 34c is touch-operated. Or, information for highlighting the frame image when the mouse is over, and the frame image corresponding to the frame image when the area surrounded by the frame images 34a, 34b, 34c is touched or the mouse is over Information for displaying the linked information. For example, when the mouse is moved over the area surrounded by the left frame image 34a in the figure, the frame image 34a is highlighted, and the link information associated with the frame image 34a is displayed. When the mouse is left-clicked in this state, the terminal 10 accesses the link destination indicated by the link information, acquires information from the link destination, and displays the information. When the link destination is an external video file, the video file is downloaded and can be played back.

  FIG. 3B is a frame during playback of the landscape-recorded moving image 35, and is a frame in the time zone to which the region metadata of the four frame images 35a to 35d is added. However, each of the frame images 35a to 35d is normally not displayed. Each of the frame images 35a to 35d is displayed so as to surround specific object images 351 to 354 displayed on the screen. For example, the frame image 35d at the upper left in the figure is displayed so as to surround the cloud object image 354 on the mountain.

  The link metadata added to the landscape recording moving image 35 includes a frame image corresponding to the area surrounded by the non-displayed frame images 35a to 35d when the area is touched or the mouse is moved over. And the link information corresponding to the frame image is displayed when any of the frame images 35a to 35d is in a display state and the area is touched or the mouse is moved over. And information for. For example, when the mouse is moved over an area surrounded by the center frame image 35a (not displayed) in the figure, the frame image 35a is displayed, and link information associated with the frame image 35a is further displayed. When the mouse is left-clicked in this state, the terminal 10 accesses the link destination indicated by the link information, acquires information from the link destination, and displays the information. When the link destination is an external video file, the video file is downloaded and can be played back.

(3) Overview of Movie Printing Function Next, an overview of the movie printing function that is one of the functions of the application 12b will be described. When the moving image printing function of the application 12b is used, a desired frame in the moving image file can be selected on the terminal 10, and the print data of the frame can be transmitted to the MFP 100 and printed out by the MFP 100.

  When a desired frame is selected from the moving image file at the terminal 10, a preview image showing a print result when the frame is printed out is displayed on the LCD 16. In this embodiment, when metadata is added to a frame selected as a print target, an image in which an information image that is an image indicated by the metadata is added to an image of the frame can be printed out. A plurality of print layouts having different frame images and information image layouts are prepared as print layouts for printout.

  Specifically, in this embodiment, at least an overlay layout, an external layout, a character recognition layout, a face recognition layout, and a layout without metadata are prepared as print layouts.

  The overlay layout is a layout in which an information image is overlay-displayed (ie, superimposed) on a frame image. FIG. 4A shows an example of a printing result when a frame to which text metadata is added is printed in an overlay layout. A print result 41 in FIG. 4A illustrates a result of moving a movie printed by selecting one frame during playback of the pet dog recorded movie 31 shown in FIG. 2A as a frame to be printed. In the print result 41 when the frame illustrated in FIG. 2A is printed in the overlay layout, the frame image 51 is printed on most of the printing paper, and the text image 51a is overlaid on the frame image 51. Will be printed. The content of the text image 51a is the same as that of the text image 31a (see FIG. 2A) displayed during moving image reproduction. In the print result 41, the relative positional relationship, size, and color of the text image 51a with respect to the frame image 51 are substantially the same as the relative positional relationship, size, and color of the text image 31a with respect to the entire frame image that is being played back. It is. That is, the overlay layout for the frame to which the text metadata is added is a layout in which the playback screen during playback of the moving image is almost reproduced.

  FIG. 4B shows an example of a print result when a frame to which region metadata is added is printed with an overlay layout. The print result 42 in FIG. 4B illustrates the result of selecting a frame to be printed as the frame to be printed and printing the movie, while the landscape-recorded movie 35 shown in FIG. In the print result 42 when the frame illustrated in FIG. 3B is printed in the overlay layout, the frame image 52 is printed on the upper side of the rectangular print paper arranged in the vertical direction, and Four frame images 52a to 52d are printed in the frame image 52 by overlay. In the print result 42, the relative positional relationship and size of the frame images 52a to 52d with respect to the frame image 52 are substantially the same as the relative positional relationship and size of the frame images 35a to 35da with respect to the entire frame image being played back. is there. That is, this is a layout in which a virtual image is reproduced such that if all the frame images 35a to 35d are displayed during moving image reproduction, such an image is obtained. In other words, it can be said that the print result 42 in FIG. 4B is an image in which an area associated with link information in a frame image is visualized.

  As described above, the overlay layout is a print layout in which the metadata information image is displayed in an overlaid manner in the frame image. The content of the information image displayed as an overlay varies depending on the type of metadata. When a frame with link metadata added is printed out with an overlay layout, an image in which a frame image in the frame image is highlighted is printed.

  The outer layout is a layout in which an information image is displayed separately from a frame image. FIG. 4C shows an example of a printing result when a frame to which text metadata is added is printed in an external layout. The print result 43 in FIG. 4C exemplifies a result of selecting a frame to be printed as a frame to be printed and reproducing the moving image as shown in FIG. 2B. In the print result 43 when the frame illustrated in FIG. 2B is printed in the outer layout, the frame image 53 is printed on the upper side of the rectangular print paper arranged in the vertical direction, and In addition to the frame image 53, a text image 53a is printed below the frame image 53. The content of the text image 53a is the same as the text image 32a (see FIG. 2B) displayed during the reproduction of the moving image.

  FIG. 4D shows an example of a print result when a frame to which link metadata is added is printed in an external layout. The print result 44 in FIG. 4D illustrates the result of selecting a frame to be printed as a frame to be printed and reproducing the moving image 34 shown in FIG. In the print result 44 when the frame illustrated in FIG. 3A is printed in the external layout, the frame image 54 is printed on the upper side of the rectangular print paper arranged in the vertical direction. In the left area under the frame image 54, the images in the areas surrounded by the frame images 34a, 34b, and 34c shown in FIG. 3A are displayed as area images 541, 542, and 543, respectively. Is done. Further, on the right side of each area image 541, 542, 543, link information 54a, 54b, 54c and text for supplementary explanation respectively associated with each frame image 34a, 34b, 34c of FIG. Is displayed.

  As described above, the external layout is a print layout in which an information image of metadata is displayed separately from the frame image. The content of the information image displayed outside the frame image differs depending on the type of metadata. In addition, when printing out the frame to which the region metadata is added in the external layout, for example, in addition to the contents of the overlay layout illustrated in FIG. 4B, each frame image 52a is provided below the frame image 52. While displaying the image in the area | region enclosed by -52d, you may make it display the link information matched with each frame image 52a-52d.

  In the character recognition layout, if a frame image to which text metadata is added contains characters that are separate from the text metadata text image, the characters are extracted from the frame image and the text metadata text image is extracted. And displayed outside the frame image.

  FIG. 5A shows an example of a printing result when a frame to which text metadata is added and a frame including characters as an image is printed by the character recognition layout. The print result 45 in FIG. 5A exemplifies the result of selecting a frame to be printed as a frame to be printed and playing the movie, while playing the movie program movie 33 shown in FIG. 2C. In the print result 45 when the frame illustrated in FIG. 2C is printed with the character recognition layout, a frame image 55 is printed on the upper side of the rectangular print paper arranged in the vertical direction.

  Further, in the frame of FIG. 2C, English subtitles are included as characters included in the image of the frame. Therefore, an attempt is made to recognize a character in the frame, and if the character is recognized normally, the recognized character (that is, English subtitle) 551 and the text image 55a of the text metadata added to the frame, Is displayed below the frame image 55.

  The face recognition layout displays a balloon next to a person's face in a frame image to which text metadata is added, and also displays text metadata in the balloon. This is a layout for displaying a text image. FIG. 5B shows an example of a printing result when a frame to which text metadata is added and a frame including a human face as an image is printed by the face recognition layout. The print result 46 in FIG. 5B illustrates a result of moving a movie by selecting one frame being reproduced as the frame of the movie program movie 33 shown in FIG. 2C as a print target frame. In the print result 45 when the frame illustrated in FIG. 2C is printed in the face recognition layout, the frame image 56 is printed on the upper side of the rectangular print paper arranged in the vertical direction.

  In the frame of FIG. 2C, a human face is displayed on the left side of the entire image. Therefore, when the face in the frame is recognized and the face and its position are recognized normally, a balloon 561 is displayed on the outer side of the frame in the direction where the human face exists as seen from the center of the frame. Further, a text image 56 a of text metadata is displayed in the balloon 561.

  The layout without metadata is a layout in which only a frame image is displayed as a print result and metadata information is not displayed. As a specific example, for example, when the pet dog recording moving image 31 shown in FIG. 2A is printed with a layout without metadata, the text image 51a is removed from the print result 41 shown in FIG. 4A. Results are obtained.

  Thus, in the present embodiment, at least the five types of print layouts are prepared as print layouts. A preview image displayed on the LCD 16 when a desired frame is selected from the moving image file in the terminal 10 is a preview image indicating a print result according to one specific print layout among the prepared print layouts.

  FIG. 6 shows an example of the preview screen 60 displayed on the LCD 16. On the preview screen 60 in FIG. 6, a preview image 61 is displayed that shows a print result when the frame of the Western-style program moving image 33 illustrated in FIG. 2C is printed in an overlay layout. In the preview image 61, a frame image 62 is displayed, and a text image 63 indicated by text metadata is displayed in an overlay display in the frame image 62.

  A preview image that is displayed first when a desired frame to be printed is selected from the moving image file is a default preview image. What content (that is, what kind of print layout) the preview image is displayed as the default preview image can be appropriately determined.

  In the present embodiment, the default preview image is determined based on the past moving image printing history each time a frame to be printed is determined. Specifically, when moving image printing for the same scene of the same moving image has been performed in the past, a preview image having the same print layout as that employed at that time is displayed as a default preview image.

  In addition, even if a movie has not been printed for the same scene of the same movie in the past, if the frame of the same metadata combination has been printed in the past, the print used at that time A preview image having the same print layout as the layout is displayed as a default preview image.

  For example, when a frame to which one text metadata is added is selected and its default preview image is generated, the past metadata is referred to and the same metadata combination (in this example, one text metadata) If the frame is printed with a moving image and is then printed with an overlay layout, for example, the default preview image of the same overlay layout is displayed. For example, when a frame to which two text metadata are added is selected and the default preview image is generated, the same metadata combination (in this example, two text metadata) is referred to with reference to the past history. If the frame is printed with a moving image and then printed in the outer layout, for example, the default preview image of the same outer layout is displayed.

  In addition to the preview image, a print operation window 71 is also displayed on the preview screen 60. In the print operation window 71, an NFC print mark 72 indicating that print data can be transmitted using NFC communication, a setting button 73, and a Wi-Fi print button 74 are displayed.

  Below the NFC print mark 72, a message is displayed that the currently displayed preview image can be printed by holding the terminal 10 over a printer with an NFC communication function and tapping the preview screen. As shown in this message, print data can be transmitted from the terminal 10 to the MFP 100 using NFC communication. When the preview image 61 is displayed and the terminal 10 is held over the MFP 100 to enable NFC communication between the two and the tap operation is performed on the preview image 61, the print layout of the preview image 61 displayed at the time of the operation is displayed. Print data is generated. When the terminal 10 is a terminal that can use a mouse, a mouse operation on the preview image 61 may be performed. The generated print data is transmitted to MFP 100 by NFC communication. As a result, printing is performed by the MFP 100. Note that the method of transmitting print data from the terminal 10 to the MFP 100 is not limited to the method of transmitting directly by NFC communication, and other methods may be used. For example, first, Wi-Fi connection information may be transmitted by NFC communication to prepare for both the terminal 10 and the MFP 100 for Wi-Fi communication, and then print data may be transmitted by Wi-Fi communication. In that case, you may transmit by Wi-Fi communication via AP150, and you may transmit directly by Wi-Fi Direct. When the terminal 10 and the MFP 100 can perform data communication using a communication method other than NFC communication and Wi-Fi communication, print data may be transmitted using the communication method.

  The print data can also be transmitted to the MFP 100 by tapping or operating the Wi-Fi print button 74 displayed on the print operation window 71. When the Wi-Fi print button 74 is tapped or operated with the mouse while the preview screen 60 is displayed, print data in the print layout of the preview image 61 displayed at the time of operation is generated, and Wi-Fi communication is performed. Is transmitted to MFP 100. As a result, printing is performed by the MFP 100.

  On the other hand, if the user wants to see other preview images by looking at the default preview image displayed on the preview screen 60, a list of preview images by other print layouts can be viewed. Specifically, when a setting button 73 in the printing operation window 71 is tapped or operated with a mouse, a setting menu screen (not shown) is displayed. When the “layout” button in the setting items displayed on the setting menu screen is tapped or operated with the mouse, preview images in all print layouts that can be generated for the selected frame are generated. A list of generated preview images is displayed on the LCD 16 as a layout selection screen.

  FIG. 7 shows an example of the layout selection screen 80. As shown in FIG. 7, the layout selection screen 80 is a screen in which the generated preview images are arranged and displayed as a list. More specifically, a list of preview thumbnails which are reduced images obtained by reducing the size of the generated preview image is displayed. FIG. 7 shows an example in which all the four preview thumbnails 81 to 84 are displayed and only a part of the two preview thumbnails 85 and 86 are displayed. In the layout selection screen 80, the display content on the screen can be slid in the vertical direction by the user performing, for example, a flick operation or a swipe operation in the vertical direction of the screen. The display content can also be slid up and down by a mouse operation.

  The type of preview image generated when a layout button (not shown) is tapped or operated with a mouse is determined based on all metadata added to a frame selected as a print target. For example, when only one text metadata is added to the frame to be printed, at least preview images of an overlay layout and an external layout are generated. When a character is included in the frame and the character can be recognized, a preview image of the character recognition layout is also generated. In addition, when a face image of a person is included in the frame and the face can be recognized, a preview image of the face recognition layout is also generated. In this way, print preview images are generated in all print layouts that can be generated for all metadata added to the frame to be printed. All the generated print preview images can be confirmed on the layout selection screen 80.

  When the user searches for a preview image of a desired print layout to be printed from the layout selection screen 80 and taps or operates the preview image, the selected preview image is displayed as the display content on the LCD 16. The preview screen (see FIG. 6) is displayed. Therefore, the user can reconfirm the preview image selected on the layout selection screen as a preview image of a larger size on the preview screen. If the print layout of the selected preview image is acceptable, the terminal 10 is held over the MFP 100 or the Wi-Fi print button 74 is tapped or operated with the mouse to cause the MFP 100 to execute printing with the selected print layout. be able to.

  It should be noted that a part or all of the preview images displayed on the layout selection screen 80 may be displayed in a list on a single print sheet. For example, when an operation button for index printing is provided in the print operation window 71 in the preview screen, and the operation button is operated, preview images in all print layouts that can be generated for the selected frame are displayed in a list. The print data may be transmitted to MFP 100.

(4) Movie Printing Process The movie printing process that is the process of the application 12b for realizing the above-described movie printing function will be described with reference to the flowchart of FIG. After the activation, the CPU 11 of the terminal 10 reads and executes the application 12b when a specific input operation for activating the application 12b is performed. When a specific input operation for starting the moving image printing function is performed after the application 12b is activated, the moving image printing process shown in FIG. 8 is started. The moving image printing start process is one of the program modules included in the application 12b.

  When starting the moving image printing process shown in FIG. 8, the CPU 11 of the terminal 10 acquires a moving image file in S110. Where to obtain the video file can be set in advance. For example, a moving image file stored in the flash memory 12 of the terminal 10 may be an acquisition target. When the memory card 25 is attached, the memory card 25 may be included in the acquisition target. Further, for example, a moving image file stored in a specific storage area in an external server may be an acquisition target.

  In S120, the metadata added to the moving image file acquired in S110 is acquired. In S130, it is determined whether to automatically extract a frame to be printed (hereinafter also referred to as “print frame”). In the present embodiment, the user manually selects either a manual extraction in which the user himself selects a desired print frame while reproducing a moving image file, or an automatic extraction in which a frame suitable for moving image printing is automatically extracted from the moving image frame. Can be selected. Automatic extraction is a part of the moving image printing function of the application 12b.

  When manual extraction is selected by the user (S130: NO), a print frame selection process is executed in S140. Specifically, the user is prompted to reproduce a moving image file and select a desired print frame from the reproduced moving image file. Then, when a specific frame selection operation is performed on the moving image being reproduced, the selected frame is determined as a print frame. When the print frame is determined, the process proceeds to S170.

  If automatic extraction is selected by the user (S130: YES), print frame automatic extraction processing is performed in S150. A detailed description of the print frame automatic extraction process is omitted, but a brief description will be given as follows. First, based on the metadata added to the moving image file, characteristic scenes that are expected to have frames suitable for moving image printing are narrowed down. For example, it is possible to narrow down to a scene to which metadata is added, a scene to which specific metadata is added, a scene to which a plurality of metadata is added in duplicate, and the like. When the scene is narrowed down, one or more frames are extracted from the scene as print frames. For example, a frame at a specific time in the scene and a frame with the least image blur in the scene are extracted as print frames. One or a plurality of print frames are extracted from the moving image file by extracting the print frames in the print frame automatic extraction process of S150.

  In S160, the selection of a print frame is accepted. Specifically, the print frames extracted in S150 are displayed in a list on the LCD 16 and any one of them is selected. Then, the selected one print frame is determined as a print frame to be actually printed.

  In S170, the moving image print history is acquired from the print execution information (details will be described later) stored in the application storage area 12c. In S180, a print layout selection process is executed. The moving image print history acquired in S170 is used in the print layout selection process in S180. The print layout selection process in S180 is a process for allowing the user to select a print layout for printing the print frame determined in S140 or S160. Details of the print layout selection processing in S180 will be described later. In S190, print data according to the print layout selected in S180 is generated and output to MFP 100 via NFC communication or Wi-Fi communication.

  After transmitting the print data, in S200, the print execution information is stored in the application storage area 12c as the moving image printing history of the current moving image printing. The print execution information to be saved includes the file name of the moving image file on which the moving image was printed, information indicating the print frame in which the print data was actually generated, metadata information added to the print frame, and added to the print frame. Among the metadata, the information of the metadata actually expressed as the print result (that is, the image printed on the printing paper as an image), the adopted print layout, and the like are included.

  The print layout selection process in S180 will be described in detail. Details of the print layout selection process of S180 are shown in FIG. When the CPU 11 of the terminal 10 shifts to the print layout selection process, in S310, the CPU 11 refers to the moving image print history stored in the application storage area 12c to determine whether the same scene of the same moving image file has been printed in the past. to decide. If the same scene of the same moving image file has been printed in the past (S310: YES), the process proceeds to S340.

  In S340, a preview image is generated with the same print layout as the past print layout, and is displayed on the LCD 16 as a default preview image. After the default preview image is displayed, the process proceeds to S350.

  In S310, when the same scene of the same moving image file has not been printed in the past (S310: NO), the process proceeds to S320. In S320, with reference to the moving image printing history stored in the application storage area 12c, it is determined whether or not a frame having the same metadata combination has been printed in the past. That is, it is determined whether or not a frame having the same combination as the combination of metadata added to the print frame to be printed has been printed in the past.

  If a frame with the same metadata combination has been printed in the past (S320: YES), in S340, a preview image is generated with the same print layout as that used in the past moving image printing, It is displayed on the LCD 16 as a default preview image. After the default preview image is displayed, the process proceeds to S350. Note that the preview image data generated in S340 is temporarily stored in the application storage area 12c at least until the print layout is finally determined. The same applies to preview images generated by the processes of S330, S400, S420, S430, S520, S560 to S570, and S580 described later.

  If no frames of the same metadata combination have been printed in the past (S320: NO), the process proceeds to S330. In S330, an overlay layout preview image is generated and displayed on the LCD 16 as a default preview image. After the default preview image is displayed, the process proceeds to S350. Note that the print layout employed in S330 is not limited to the overlay layout, and can be determined as appropriate.

  In S350, it is determined whether or not the layout button has been pressed. Specifically, the setting button 73 displayed on the preview screen (see FIG. 6) is tapped or operated by the mouse, and the layout button is tapped or operated by the mouse on the setting menu screen (not shown) displayed by the operation. It is judged whether it was done. If the layout button has not been pressed (S350: NO), it is determined in S360 whether or not a print execution instruction has been issued. Specifically, as described with reference to FIG. 6, the terminal 10 has an NFC communication function. It is determined whether the preview screen is tapped or operated with the mouse while the Wi-Fi print button 74 is tapped or operated with the mouse. If any operation is performed (S360: YES), the print layout is determined as the print layout of the preview image currently displayed on the preview screen, assuming that a print execution instruction has been issued, and S190 (FIG. 8). ) If no operation is performed (S360: NO), the process returns to S350.

  If the layout button is pressed in S350 (S350: YES), it is determined in S370 whether text metadata is included in the metadata added to the print frame. If text metadata is included, the process proceeds to S380. In S380, the text metadata layout process is executed. Details of the text metadata layout processing in S380 are shown in FIG. When the CPU 11 of the terminal 10 proceeds to the text metadata layout process, in S510, the CPU 11 executes a character recognition process for the print frame and determines whether or not a character is recognized. If a character is recognized from the image of the print frame (S510: YES), the process proceeds to S520.

  In S520, a preview image of a character recognition layout (see FIG. 5A) is generated as a preview image, and the process proceeds to S530. Also, when characters cannot be recognized from the print frame image (S510: NO), the process proceeds to S530.

  In step S530, face recognition processing for the print frame is executed to determine whether a person's face has been recognized. If a person's face is recognized from the print frame image (S530: YES), the process proceeds to S540. In S540, it is determined whether or not there is one recognized face. If the number of recognized faces is not one (S540: NO), the face of the person who is scolding is identified among the plurality of recognized faces in S550.

  There are various methods for identifying a person who is speaking, but in the present embodiment, compared to at least one frame before and after the frame to be printed, the method is performed using a specific algorithm based on a change in the content of the image. Identify people. If the face of the person who is speaking is specified, it will progress to S560. If it is determined in S540 that there is one recognized face (S540: YES), the face is identified as the face of a person who is scolding, and the process proceeds to S560.

  The processes of S560 to S570 are processes for generating a preview image of the face recognition layout (see FIG. 5B). In S560, the position of the face of the person in the print frame is compared with the center coordinates of the print frame, and a balloon is generated outside the frame in the direction in which the person's face exists as viewed from the center coordinates. In S570, the text metadata is synthesized in the balloon generated in S560. That is, the text image indicated by the text metadata is embedded in the balloon.

  After the processing of S570, the process proceeds to S580. If the face of the person cannot be recognized from the image of the print frame in S530 (S530: NO), the process proceeds to S580. In S580, preview images of three types of print layouts, ie, an overlay layout, an external layout, and a layout without metadata are generated for text metadata. As described above, in the text metadata layout process shown in FIG. 10, at least an overlay layout (see FIG. 4A), an external layout (see FIG. 4C), and a layout without metadata are used as preview images. , Three types of print layout preview images are generated. If a character can be recognized from the print frame, a preview image of the character recognition layout is also generated. If the face of the person can be recognized from the print frame, a preview image of the face recognition layout is also generated.

  Returning to FIG. 9, the description will be continued. If it is determined in S370 that text metadata is not included (S370: NO), it is determined in S390 whether or not link metadata is included in the metadata added to the print frame. If link metadata is included (S390: YES), the process proceeds to S400.

  In S400, preview images of three types of print layouts for the link metadata, an overlay layout (similar to FIG. 2B), an external layout (see FIG. 2D), and a layout without metadata. Are respectively generated, and the process proceeds to S410. If it is determined in S390 that link metadata is not included (S390: NO), the process proceeds to S410.

  In S410, it is determined whether or not area metadata is included in the metadata added to the print frame. If area metadata is included (S410: YES), the process proceeds to S420. In S420, preview images of two types of print layouts for the area metadata, namely, an overlay layout (see FIG. 2B) and a layout without metadata are generated, and the process proceeds to S430. If it is determined in S410 that the area metadata is not included (S410: NO), the process proceeds to S430.

  In S430, when preview images of a plurality of types of print layouts are generated by the processing so far, at least one preview image obtained by combining the plurality of types of print layouts is generated. For example, when text metadata is added and a preview image of an overlay layout and a preview image of an external layout are generated for the text metadata, a preview image obtained by combining both of them, that is, a text image is a frame image. A preview image displayed both inside and outside the frame image is generated. Preview images may be generated for all combinations that can be combined, or preview images may be generated by limiting to a specific type or number of all combinations that can be combined.

  In S440, a layout selection screen (see FIG. 7) for each preview image generated up to S430 is displayed on the LCD 16, and a print layout is selected from the screen.

  In S450, the preview image of the print layout selected in S440 is displayed on the preview screen (see FIG. 6). That is, the screen is switched from the layout selection screen to the preview screen. After switching the screen to the preview screen in S450, the process returns to S350.

(5) Effects of Embodiment As described above, in the terminal 10 of the present embodiment, the application 12b includes the moving image printing function, and executes the moving image printing process illustrated in FIGS. In the moving image printing function of this embodiment, a preview image of a print frame to which metadata is added is displayed on the preview screen, a preview image of a print layout to be printed is selected, and printing of the selected print layout is performed. Generate data.

  Therefore, when the user wants to print a frame to which metadata is added, the user can confirm in advance how to actually print out before printing. Can be printed out.

  In this embodiment, when a print frame is selected, first, one default preview image is displayed on the preview screen. If the default preview image is selected, print data of the print layout of the default preview image is generated. That is, if the default preview image displayed first has the contents desired by the user and is selected for printing, preview images of other layouts are not generated. Therefore, it is possible to reduce the processing load for generating the preview image.

  On the other hand, when an operation for displaying another preview image (in this embodiment, an operation of a layout button) is performed on the preview screen, each preview image different from the default preview image is generated and the layout is displayed. Display a list on the selection screen. At this time, a default preview image may also be displayed on the layout selection screen. Then, when any one preview image is selected from the layout selection screen, the selected preview image is displayed again on the preview screen. The user can finally reconfirm the preview screen selected from the layout selection screen in a large size in the preview screen. For this reason, it is possible to suppress printing out with unintended contents.

  In this embodiment, a preview image including a print frame image and an information image indicated by metadata can be generated as a preview image. Therefore, the added value of the print output result can be increased.

  Further, in this embodiment, a plurality of print layouts that can be printed are prepared, and a plurality of print layout preview images corresponding to the types of metadata added to the print frame can be generated. Therefore, the options of the preview image including the information image are widened, and the user can obtain a print result with a print layout closer to his / her preference.

  In the present embodiment, the terminal 10 corresponds to an example of a moving image processing apparatus of the present invention. The application 12b corresponds to an example of a moving image processing program of the present invention. The CPU 11 corresponds to an example of a control unit of the present invention. The LCD 16 corresponds to an example of a display unit of the present invention. The print frame selected in S140 or S160 corresponds to an example of a print target frame of the present invention. The five types of print layouts illustrated in FIGS. 4 to 5 correspond to examples of the layout pattern of the present invention. Characters and human faces included in the frame image correspond to an example of a specific type of image of the present invention. The relationship between the English subtitles and the Japanese translation text image 33a in one frame of the Western-style program video 33 in FIG. 2C corresponds to an example of the specific relationship of the present invention. The relationship between the person's face and the Japanese-translated text image 33a in FIG. 8C corresponds to an example of the specific relationship of the present invention. The character recognition layout and the face recognition layout correspond to an example of a specific layout of the present invention. The default preview image corresponds to an example of the initial preview image of the present invention. The maximum number of preview images that can be simultaneously displayed in the layout selection screen in FIG. 7 corresponds to an example of the maximum displayable number of the present invention. The process of S110 corresponds to an example of a file acquisition process of the present invention. The process of S120 corresponds to an example of the data acquisition process of the present invention. The processes of S140 and S160 correspond to an example of the frame determination process of the present invention. The process of S180 corresponds to an example of the image generation process of the present invention. The process of S360 corresponds to an example of the image selection process of the present invention. The process of S190 corresponds to an example of the print data generation process of the present invention. The processes of S340, S330, S400, S420, S430, S520, S560 to S570, and S580 correspond to an example of the layout determination process of the present invention. The processes of S510 and S530 correspond to an example of the image recognition process of the present invention. The processes of S330 and S340 correspond to an example of the first generation process and the first display process of the present invention. The processes of S400, S420, S430, S520, S560 to S570, and S580 correspond to the second generation process and an example of the present invention. The process of S440 corresponds to an example of the second display process of the present invention. The process of S350 corresponds to an example of the operation reception process of the present invention. The process of S360 corresponds to an example of the first selection process, the second selection process, and the third selection process of the present invention. The process of S200 corresponds to an example of the storage process of the present invention. The process of S450 corresponds to an example of a third display process of the present invention.

[Other Embodiments]
(1) There are various types of print layouts other than the print layouts exemplified in the above embodiment. For example, as an overlay layout for the frame to which the region metadata is added, in addition to the overlay layout illustrated in FIG. 4B, a layout in which, for example, link information is displayed as an overlay instead of a frame image may be set. Or you may set the layout in which both a frame image and link information are displayed.

  For example, in the overlay layout illustrated in FIG. 4A, the position where the text image 51a is arranged, the size and color of the text image 51a, and the like can be determined as appropriate. As for the text image 53a in the external layout illustrated in FIG. 4C, where and in what size and color the outer side of the frame image 53 can be determined appropriately.

  Also, for example, in the external layout illustrated in FIG. 4D, the size, position, relative positional relationship, etc. of the frame image and text image displayed outside the frame image 54 can be determined as appropriate. Only one of the frame image and the text image may be printed out.

  In addition, although five types of layouts such as an overlay layout, an external layout, a character recognition layout, a face recognition layout, and a layout without metadata are illustrated as print layouts, print layouts other than these five types may be prepared. It is possible to appropriately determine how many types of print layouts are prepared and which metadata can be applied to each print layout.

  (2) The terminal 10 is merely an example as a platform for executing the application 12b. For example, the application 12b may be executed by the MFP 100. Further, for example, the application 12b may be executed by the server 160 or other information processing apparatus (specifically, an information processing apparatus that is separate from the terminal 10 and capable of data communication with the terminal 10). Specifically, for example, when a desired moving image file to be printed is uploaded from the terminal 10 or the MFP 100 to the information processing apparatus, scene determination and frame extraction are performed on the information processing apparatus side. Each generated and selected thumbnail is displayed on the terminal 10 or MFP 100 by causing the data processing apparatus to transmit the thumbnail data to the terminal 10 or MFP 100. The result of the thumbnail selection process in terminal 10 or MFP 100 is transmitted to the information processing apparatus. Based on the result, the information processing apparatus generates print data, and the print data is transmitted to MFP 100.

  (3) The provision form of the application 12b is not limited to provision by downloading via the Internet, and various provision forms can be adopted. For example, in a state recorded on a computer-readable (tangible) non-transitory recording medium (A non-transitory computer-readable recording medium) such as a memory card, flexible disk, DVD, CD-ROM, or hard disk It may be possible to provide it.

  (4) In addition, the present invention is not limited to the specific means and structure shown in the above embodiment, and can take various forms without departing from the gist of the present invention. For example, the functions of one component in the above embodiment may be distributed as a plurality of components, or the functions of a plurality of components may be integrated into one component. Further, at least a part of the configuration of the above embodiment may be replaced with a known configuration having the same function. Moreover, you may abbreviate | omit a part of structure of the said embodiment as long as a subject can be solved. In addition, at least a part of the configuration of the above embodiment may be added to or replaced with the configuration of the other embodiment. In addition, all the aspects included in the technical idea specified from the wording described in the claims are embodiments of the present invention.

DESCRIPTION OF SYMBOLS 10 ... Terminal, 11 ... CPU, 12 ... Flash memory, 12a ... OS, 12b ... Application, 12c ... Storage area for application, 13 ... RAM, 15 ... Operation key, 16 ... LCD, 17 ... Touch panel, 18 ... Memory card I / F, 19 ... voice input / output unit, 20 ... telephone network communication unit, 22 ... short-range communication unit, 23 ... wireless communication unit, 24 ... bus line, 25 ... memory card, 31 ... pet dog recording video, 31a, 32a, 33a, 41a, 42a, 43a, 44a ... text image, 32 ... fireworks display video, 33 ... Western-style program video, 34 ... nature introduction video, 34a-34c, 35a-35d ... frame image, 35 ... landscape recording video, 36 ... Travel record movie, 41-46 ... printing result, 51-56,62 ... frame image, 51a, 53a, 55a, 56a, 63 ... text image, 52a ... frame image, 5 a ... link information, 60 ... preview screen, 61 ... preview image, 71 ... print operation window, 72 ... NFC print mark, 73 ... setting button, 74 ... print button, 80 ... layout selection screen, 81-86 ... preview thumbnail , 100 ... MFP, 122 ... near field communication part, 123 ... wireless communication part, 131 ... printer part, 150 ... AP, 160 ... server, 351 to 354 ... object image, 541 to 543 ... area image, 551 ... English subtitles 561 ... Speech balloon.

Claims (11)

A display unit;
A moving image processing program that can be executed by the control unit.
In the control unit,
File acquisition processing to acquire video files,
A data acquisition process for acquiring metadata attached to the video file acquired by the file acquisition process;
A frame determination process for determining, from the moving image file, a specific frame to which the metadata is added as a print target frame;
An image generation process for generating at least one preview image of a print result when printing the print target frame determined by the frame determination process;
Image display processing for displaying the preview image generated by the image generation processing on the display unit;
An image selection process for receiving a selection input of a specific preview image among the preview images displayed by the image display process;
Print data generation processing for generating print data of the preview image selected by the image selection processing;
A video processing program for running A moving image processing program according to claim 1,
The image generation process includes at least one preview image of a specific type that is a preview image including a frame image indicating the print target frame and an information image indicating metadata added to the print target frame. A moving image processing program characterized by generating a preview image. The moving image processing program according to claim 2,
In the image generation process, a plurality of preview images having different layouts of the frame image and the information image are generated as the specific type of preview image. The moving image processing program according to claim 3,
At least one of at least one layout pattern prepared in advance is determined based on at least one of the content of the frame image of the print target frame and the content of the metadata added to the print target frame. Layout determination process to
In the image generation process, for each at least one layout pattern determined by the layout determination process, the specific type of preview image of the layout according to the layout pattern is generated. A moving image processing program according to claim 4,
At least one of the following (a) to (c) is prepared as the layout pattern.
(A) A layout pattern for superimposing and displaying the information image in the frame image.
(B) A layout pattern in which the information image is arranged outside the frame image.
(C) A layout pattern for displaying the information image and an image of an area associated with the information image in the frame image. A moving image processing program according to claim 4 or 5,
As the layout pattern, a specific type of image and the information image indicating specific metadata that is metadata having a specific relationship with the specific type of image are in a positional relationship corresponding to the specific relationship. Have a specific layout to place,
An image recognition process for recognizing the specific type of image from the frame image of the print target frame;
In the layout determination processing, when the specific type of image is recognized by the image recognition processing, at least the specific layout is determined as the layout pattern. A moving image processing program according to any one of claims 1 to 6,
The image generation process includes:
A first generation process for generating one preview image;
A second image that generates at least one preview image different from the initial preview image when a request operation for a preview image different from the initial preview image that is the preview image generated by the first generation processing is received; Generation process,
Have
The image display process includes
A first display process for displaying the initial preview image on the display unit when the initial preview image is generated by the first generation process;
A second display process for causing the display unit to display the preview image including the initial preview image or excluding the initial preview image when the preview image is generated by the second generation process; ,
Have
And an operation reception process for receiving the requested operation after the execution of the first display process.
The second generation process is a process executed when the request operation is received by the operation reception process,
The image selection process includes:
A first selection process for receiving the selection input for the initial preview image displayed by the first display process;
A second selection process for receiving a selection input of a specific preview image among the displayed preview images when the second display process is executed;
Have
In the print data generation process, print data of the preview image selected in the first selection process or the second selection process is generated. The moving image processing program according to claim 7,
The moving image processing apparatus has a storage unit,
When the print data is generated by the print data generation process, the number and type of metadata added to the print target frame corresponding to the print data and the generated print data are added. A storage process for storing, in the storage unit, information indicating which metadata information among the metadata is actually displayed in the print result,
In the first generation process, the same number and types of metadata as the number and types of the metadata added to the print target frame are added based on the printing history stored in the storage unit. If the print data of the previous frame has been generated in the past, the initial information including the same metadata information as the metadata whose information was represented in the print result in the print data generated in the past A moving image processing program characterized by generating one preview image. A moving image processing program according to claim 7 or claim 8,
In the second display process, the preview image to be displayed can be displayed in a predetermined maximum size in the display area of the display unit with a size smaller than the display size of the initial preview image in the first display process. List up to a maximum number of numbers simultaneously,
Furthermore,
After the execution of the second display process, when the preview image is selected by the second selection process, the selected preview image has a size larger than the display size in the second display process. A third display process to be displayed on the display unit;
A third selection process for receiving a selection input for the preview image displayed by the third display process;
Have
In the print data generation process, when the preview image is selected by the third selection process, print data of the preview image is generated. A frame determination step for determining a specific frame to which the metadata is added as a print target frame from the video file to which the metadata is added;
A step of generating a preview image of a printing result when printing the frame to be printed determined in the frame determining step, and a frame image indicating the frame to be printed and metadata added to the frame to be printed An image generating step for generating at least one preview image including at least one specific type of preview image that is a preview image including an information image to be displayed;
An image display step of causing the display unit to display the preview image generated in the image generation step;
An image selection step for receiving selection input of a specific preview image among the preview images displayed in the image display step;
A print data generation step for generating print data of the preview image selected in the image selection step;
A moving image processing method comprising: A display unit;
A control unit,
The controller is
File acquisition processing to acquire video files,
A data acquisition process for acquiring metadata attached to the video file acquired by the file acquisition process;
A frame determination process for determining a print target frame that is a frame to be printed from the moving image file based on the metadata acquired by the data acquisition process;
A process of generating a preview image of a printing result when printing the printing target frame determined by the frame determination process, and a frame image indicating the printing target frame and metadata added to the printing target frame An image generation process for generating at least one preview image, including at least one specific type of preview image that is a preview image including an information image indicating
Image display processing for displaying the preview image generated by the image generation processing on the display unit;
An image selection process for receiving a selection input of a specific preview image among the preview images displayed by the image display process;
Print data generation processing for generating print data of the preview image selected by the image selection processing;
The moving picture processing apparatus characterized by performing.