JP2008187267A - Moving picture printer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture printer which edits a mobile easily, when the mobile body in a moving image is edited to create a static image. <P>SOLUTION: The moving image printer has a capture means for capturing image data of a frame, designated by a user and image data for a plurality of frames in front of and behind it; a mobile detecting means for detecting a mobile body image in the moving image from the image data of the plurality of frames captured by the capture means; an image separating means for separating a frame image, designated by the user into the mobile body image detected by the mobile body detecting means and a background image; a mobile image editing means for editing the mobile body image, in response to the user's operation; a static image generating means for compositing the mobile body image edited by the mobile body image editing means and the background image to generate the static image; and a printing means for printing the static image generated by the static image generating means. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

The present invention relates to a moving image printing apparatus that captures a moving image taken by a digital video camera or the like and prints it as a still image, and more particularly, a moving image printing apparatus that can edit a moving body image in a moving image by a user instruction. About.

  When a moving object such as a passing person or a car is present when shooting a landscape or a stationary object with a video camera such as a video camera, the moving object is an obstacle when capturing the moving image and generating a still image. In some cases, the user cannot obtain a desired still image.

  An image generating apparatus that determines that pixel data having a high appearance frequency is background data based on histograms of the same images in a plurality of frames constituting a moving image and generates a still image that does not include a moving object has been proposed. (For example, see Patent Document 1). As a result, a still image that does not include a moving object can be generated.

  In addition, based on the difference information between the reference frame image and the adjacent frame image, a moving body region including the moving body in the reference frame is detected, and the area corresponding to the moving body region includes other moving bodies not included. Search for frame images. Then, an image generation apparatus that synthesizes a still image that does not include a moving object by replacing the moving object region with an image that does not include the moving object has been proposed (see, for example, Patent Document 2).

  FIG. 7 is a conceptual diagram showing the processing contents of a conventional image generating apparatus.

  FIG. 7 shows that the person 702 moves rightward and the car 703 moves leftward on the same background. The frame image 704 is an image in which the frame images of the moving image 701 are arranged in time series order (frame n−1 → frame n → frame n + 1).

  Consider a case where such a moving image is captured and only a background image excluding the person 702 and the car 703 is generated.

  First, in a plurality of consecutive frames, a histogram of pixel data in the same image is calculated, and pixel data having the highest appearance frequency is selected from the image data in the same pixel. When attention is paid to the same pixel, the pixel data changes in each frame in the period in which the moving object exists in the pixel, but changes in the image data in the period in which the background portion exists. Does not occur. Therefore, an image of only the background portion can be generated by selecting pixel data having the highest appearance frequency.

For example, in each frame of the frame image 704, the pixel data of the points A and B (pixel data in which the pixels A, B, and X are described) has a background portion appearing twice, and the moving body portion Appears once. When pixel data having a high appearance frequency is selected at points A and B, pixel data of the background portion is selected instead of pixel data of the moving person 702 or car 703. By applying this method to all pixels, a still image 705 in which a moving body in a moving image is replaced with a background can be generated.
JP-A-9-149364 JP-A-2005-202706

  However, the conventional image generation apparatus can detect a moving object in a moving image and replace it with a background. However, in a moving image having a plurality of moving objects, the moving object can be selected and replaced with the background. There is a problem that you can not.

  For example, in a moving image in which a person and a car are moving on the same background, it is not possible to generate a still image in which only the car is replaced with the background while the person remains. Further, it is also impossible to move the detected moving body to a different position and to perform editing processing such as changing the magnification.

  In a conventional image generation device, a moving object can be selectively deleted by limiting to a specific area in a moving image, but the user must set an area for moving object detection while watching a moving image. Don't be. Therefore, in the above conventional example, there is a problem that the user is forced to perform a complicated operation in which the user sets an area for detecting a moving object while watching a moving image.

  In addition, in the conventional image generation apparatus, when the detected moving object generates a still image arranged at a preferred position on the background, or when generating a still image in which the size of the moving object is enlarged / reduced Inconvenience arises. In other words, the extracted moving body image needs to be imported into another processing device such as a personal computer and edited using image processing application software, and the user can view the still image obtained by editing the moving body image. It cannot be generated easily.

An object of the present invention is to provide a moving image printing apparatus that can easily edit a moving image in a moving image to generate a still image.

The present invention is a moving image printing apparatus that inputs a moving image and prints a frame specified by a user as a still image, and captures the image data of a frame specified by the user and image data of a plurality of frames before and after the frame. Have means. The present invention includes moving body detection means for detecting a moving body image in a moving image from a plurality of frames of image data captured by the capture means. The present invention edits the moving body image according to a user operation, an image separating means for separating a frame image designated by the user into a moving body image detected by the moving body detecting means and a background image. Mobile image editing means. The present invention combines the moving body image edited by the moving body image editing unit and the background image to generate a still image, and prints the still image generated by the still image generation unit. Printing means.

According to the present invention, when a moving object in a moving image is edited to generate a still image, there is an effect that the editing is easy.

  The best mode for carrying out the invention is the following embodiment.

  FIG. 1 is a configuration diagram illustrating a moving image printing apparatus 100 that is Embodiment 1 of the present invention.

  The moving image printing apparatus 100 includes a control unit 101, a moving image input unit 102, a frame memory 103, a moving object detection / separation unit 104, a moving object image memory 105, a background image memory 106, an editing memory 107, An operation unit 108 and a display unit 109 are provided. In addition, the moving image printing apparatus 100 includes an image composition unit 110 and a printing unit 111.

  The control unit 101 controls the operation of the entire apparatus, and each block operates according to the control of the control unit 101.

  The moving image input unit 102 is an interface unit that inputs moving image data. The moving image input unit 102 is connected to a moving image capturing apparatus such as a video camera and inputs moving image data to the moving image printing apparatus. The moving image input unit 102 includes an interface unit that reads a memory device such as a memory card, and sends moving image data to the moving image printing apparatus by reading a memory card that stores moving image data.

  The frame memory 103 is an image memory that accumulates moving image data input by the moving image input unit 102 in units of frames and accumulates moving image data for a plurality of frames necessary for detecting a moving body in a moving image. Further, when a moving image is captured and printed according to an operator's instruction, moving image data read from a video camera or a memory card is temporarily stored in the frame memory 103. The accumulated moving image data is displayed on the display unit 109, and the operator searches the scene to be captured while checking the display unit 109.

  The moving object detection separation unit 104 detects a moving object in the moving image, and generates a moving object image including only the moving object and a background image in which the moving object part is replaced with the background. When an operator designates a scene to be captured, moving image data stored in the frame memory 103 is read out, and a moving body image and a background image are obtained from the frame data of the scene designated by the operator and a plurality of frame data before and after the scene data. Generate.

  The moving body image memory 105 and the background image memory 106 are image memories that store the moving body image and the background image generated by the moving body detection separation unit 104, respectively.

  The edit memory 107 is an image memory for storing a moving body image edited by an operator's operation, and the image data is rewritten sequentially according to the operator's editing process.

  The operation unit 108 is an operation unit for an operator to operate the moving image printing apparatus 100, and includes various operation keys and a display unit 109 such as an LCD. It is also possible to operate the moving image printing apparatus 100 by installing a touch panel on the display unit 109 and detecting the pressed state of the touch panel.

  The display unit 109 reproduces a moving image by displaying the frame data stored in the frame memory 103. Further, the image data in the editing memory 107 is displayed on the display unit 109, and the operator edits the moving body image while checking the editing status on the display unit 109.

  The image synthesis unit 110 synthesizes the moving body image edited by the operator and the background image generated by the moving body detection separation unit 104 to generate a still image. A still image is generated by overwriting the edited image data on the background image data.

  The printing unit 111 is configured by a color printer such as an inkjet method, and prints the still image generated by the image composition unit 110 on a recording sheet as a color image.

  The frame memory 103, the mobile image memory 105, the background image memory 106, and the editing memory 107 are composed of general-purpose memories such as DRAM. In the first embodiment, the image memories 103, 105, 106, and 107 are separate memories, but the same memory may be divided into areas.

  Next, the operation of the moving image printing apparatus 100 will be described.

  FIG. 2 is a flowchart showing the operation in the first embodiment.

  If an instruction to capture a moving image is given by an operation by the operator via the operation unit 108, the process is started (S201). The moving image data input by the moving image input unit 102 is displayed on the display unit 109 via the frame memory 103, and the reproduction is continued until the scene to be captured is designated by the operator (S202 to S203). In the reproduction of a moving image, when an operator instructs fast forward / rewind or the like, image data is read from a video camera or a memory card and reproduced in accordance with this instruction. The image data in the frame memory 103 is constantly updated as the moving image is reproduced, and is controlled so as to store the frame data being reproduced and a plurality of frame data before and after the frame data.

  Subsequently, when a scene to be captured is designated by an operator's instruction (S203), the frame to be captured and data of a plurality of frames before and after the frame are read from the frame memory 103, and the moving body detection / separation unit 104 moves the moving body. Is detected (S204). Further, the moving image of the designated scene is separated into a moving body image and a background image, and the separated moving body image and background image are stored in the moving body image memory 105 and the background image memory 106, respectively (S205). Then, the separated moving body image is transferred to the editing memory 107, and editing processing by the operator is started (S206). The image data in the editing memory 107 is displayed on the display unit 109, and the operator performs editing processing while checking the display unit 109.

  When a plurality of moving objects are detected, first, the moving object to be edited is specified (S207). When specifying the moving body, the operator presses the selection key of the operation unit to specify the moving body. In the case of a device having a touch panel, a moving body is specified by pressing a moving body portion to be edited.

  Subsequently, editing processing of the moving body image designated by the operation of the operator is performed. When the delete key or the like is pressed after designating the moving object (S208), the selected moving object data is deleted from the edit memory 107 (S209). When the arrow key is pressed or dragged on the touch panel (S210), the selected moving body data is moved on the editing memory 107 (S211). Further, when the scaling process is instructed by a key operation (S212), the moving body data being selected is enlarged / reduced, and the moving body data in the editing memory 107 is updated (S213).

  Next, when the print key is pressed by the operator's operation (S215), the image data in the editing memory 107 and the image data in the background image memory 106 are combined to generate a still image (S216). Then, the generated still image data is transferred to the printing unit 111, and a print image is output (S217).

  In the first embodiment, control is performed so that the printing unit 111 prints the still image generated by the image composition unit 110. However, when an operator operates to save the generated still image, the still image synthesized by the image synthesis unit 110 may be stored in a memory card provided in the moving image input unit 102.

  FIG. 3 is a diagram illustrating a specific example of the moving image editing process according to the first embodiment.

  The moving image 301 is a moving image in which the person 302 moves in the right direction and the car 303 moves in the left direction. A case will be described in which the moving image 301 is captured, a person 302 as a moving object is moved to a position designated by the operator, and a still image in which the car 303 is deleted is generated and printed.

  As shown in the frame image 304, the moving image 301 includes a plurality of continuous frame images (..., Frame n−1, frame n, frame n + 1,...). In this frame image 304, a moving body in the moving image is detected based on the histogram information of the pixel data in the same pixel, and the moving image 301 is separated into the background image 305 and the moving body image 306. The separated moving body image 306 is transferred to the editing memory 107 and subjected to editing processing by an operator's operation while displaying the moving body image on the display unit.

The operator selects the person 302 by operating the selection key on the operation unit or pressing the touch panel, and moves the person 302 to a desired position using the arrow key operation or the drag operation on the touch panel. Further, the vehicle 303 is selected by pressing the selection key operation or the touch panel, and the vehicle 303 is deleted by pressing the delete key. The editing process is performed by a memory operation on the editing memory 107, and an edited image 307 is generated. Subsequently, when the operator performs a key operation and issues a print instruction, a composite image 308 is generated by combining the background image 305 and the edit image 307, and the printing unit 111 prints the composite image 308.

  FIG. 4 is a configuration diagram illustrating the moving image printing apparatus 200 according to the second embodiment of the present invention.

  The moving image printing apparatus 200 is an embodiment in which a scanner 412 and an editing instruction detection unit 413 are added to the moving image printing apparatus 100.

  Further, the printing unit 111 can print the image data in the mobile image memory 105. Further, in the first embodiment, the operation unit 108 is provided with a display unit 109 such as an LCD. However, in the second example, the moving image printing apparatus does not have a display unit capable of displaying image data.

  The scanner 412 is a reading device composed of photoelectric conversion elements such as a CCD and a CIS, and reads a document to obtain digital image data.

  The editing instruction detection unit 413 compares the image data read by the scanner 412 with the data in the mobile image memory, and detects the editing processing content designated by the operator.

  Operations in other blocks are the same as those in the first embodiment.

  Next, the operation of the moving image printing apparatus according to the second embodiment will be described.

  FIG. 5 is a flowchart illustrating the operation in the second embodiment.

  When the operator instructs to capture a moving image by operating the operation unit 108, the process is started (S501). If the moving image printing apparatus does not have a means for displaying moving image data, the time of the scene to be captured (the time from the start of data) is confirmed in advance with a video camera or the like, and the operator specifies the time to be captured (S502). Then, the scene to be captured is determined.

  The moving image input unit 102 inputs moving image data, and the scene designated by the operator and the image data of several frames before and after the scene are stored in the frame memory 103 (S503).

  The moving object detection / separation unit 104 detects a moving object from the image data of a plurality of frames stored in the frame memory 103 (S504). Further, the moving image is separated into a moving body image and a background image, and the separated moving body image and background image are stored in the moving body image memory 105 and the background image memory 106, respectively (S505). . The moving body image data stored in the moving body image memory 105 is transferred to the printing unit 111 and printed as a moving body image (S506).

  The operator marks an edited content desired to be applied to the moving body on the printed moving body image (S507). The mark written by the operator has a predetermined shape. For example, if the editing content to be applied to the moving object is to delete the moving object, the mark (X) is marked, and if it is desired to lay out (move) the moving object at a different position, an arrow (→ Mark).

  Subsequently, the moving body image marked by the operator is read by the scanner 412 (S508). The editing instruction detection unit 413 detects the mark entered by the operator by calculating the difference between the image data read by the scanner 412 and the image data stored in the moving object image memory 105. Pattern matching is performed between the detected mark shape and a mark indicating predetermined editing contents, and the editing contents designated by the operator are detected (S509).

  Then, according to the editing content detected by the editing instruction detection unit 413, the mobile body image data editing process is performed. The data in the mobile image memory 105 is transferred to the editing memory 107, and editing processing is executed by a memory operation on the editing memory 107 (S510). If the detected editing content is to be erased, the data of the designated moving body is erased from the editing memory 107. If the detected editing content is a layout change (movement), the data of the designated moving body is moved on the editing memory 107.

  After completion of editing, the image data in the editing memory 107 and the image data in the background image memory 106 are combined by the image combining unit 110 (S511), and the combined still image is printed by the printing unit 111 (S512). Exit.

  In the second embodiment, a predetermined mark is entered on the printed moving body image, and the content of editing is instructed by reading the mark with a scanner. However, in S506, when printing the moving body image, numbers are added to the detected plurality of moving bodies, printed, and the number of the moving body and the input of the editing content are operated based on the operation of the operator. It may be executed via the unit 108. In this way, the editing content to be applied to each moving body is instructed.

  FIG. 6 is a diagram illustrating a specific example of the moving image editing process according to the second embodiment.

  The moving image 601 is a moving image in which the person 602 moves in the right direction and the car 603 moves in the left direction. A case will be described in which the moving image 601 is captured, a person 602 as a moving object is moved to a position designated by the operator, and a still image in which the car 603 is deleted is generated and printed.

  Similar to the description of FIG. 3 in the first embodiment, in a plurality of frame images constituting the moving image 601, a moving object in the moving image is detected based on histogram information of pixel data at the same pixel, and the moving image 601 is displayed. The background image 605 and the moving body image 606 are separated.

  The separated moving body image 606 is printed by the printing unit 111, and the operator performs marking indicating the editing content on the printed moving image. On the printed moving body image 607, the operator enters an arrow (→) having a length corresponding to the moving direction and the moving amount in the vicinity of the person who moves the layout.

  Further, an x mark indicating an erasing process is entered in the car 603 to be erased. Subsequently, the moving body image 607 marked by the operator is read by the scanner 412, and the editing instruction detection unit 413 detects the editing content entered by the operator. Further, according to the detected editing content, a memory operation is performed on the moving object image data in the editing memory 107 (editing is performed on the memory). The data of the person 602 in which the arrow is entered moves to a position corresponding to the direction and length of the arrow, and the car 603 in which the x mark is entered is deleted from the editing memory 107, and an edited image 608 is generated. Further, a composite image 609 obtained by combining the background image 605 and the edited image 608 is generated, and the printing unit 111 prints the composite image 609.

  According to the first aspect of the present invention, when a moving image is captured and printed as a still image, a moving body in the moving image can be automatically detected, so that the user does not make full use of complicated moving body detection processing. In addition, the mobile part can be easily edited. Also, in the editing process of the moving object, the editing process is performed only on the moving object image obtained by extracting the moving object in the moving image. Even so, the editing process can be performed.

  According to the second and third aspects of the present invention, the user can select a plurality of detected moving objects and execute editing processing such as erasure, layout movement, and magnification change on each moving object. Thus, a still image according to the user's preference can be generated.

  According to the fourth aspect of the present invention, the contents of the editing process to be performed on the moving body can be instructed by marking the printed recording paper, so that the moving image printing apparatus does not have a large display device capable of displaying image data. Even if it exists, the editing process can be easily instructed.

  In the above embodiment, the frame memory 103 is an example of a capture unit that captures image data of a frame designated by the user and image data of a plurality of frames before and after the frame. The moving body detection separation unit 104 is an example of a moving body detection unit that detects a moving body image in a moving image from a plurality of frames of image data captured by the capture unit. The moving object detection / separation unit 104 is an example of an image separation unit that separates a frame image designated by the user into a moving object image detected by the moving object detection unit and a background image.

  The control unit 101 is an example of a moving body image editing unit that edits the moving body image in accordance with a user operation. The image synthesizing unit 110 is an example of a still image generating unit that generates a still image by combining the moving body image edited by the moving body image editing unit and the background image. The printing unit 111 is an example of a printing unit that prints the still image generated by the still image generation unit.

  In this case, the moving body image editing means is means for performing different editing processes for each detected moving body when the moving body detecting / separating means detects a plurality of moving bodies. The moving body image editing means is means for executing at least one of erasing the moving body image, moving the layout, and changing the magnification.

  In the above embodiment, the scanner 412 is an example of a scanner that reads an image. The printing unit 111 is an example of a second printing unit that prints the moving body image separated by the moving body detection and separation unit. The scanner 412 is an example of a means for reading a printed image relating to a mark entered by the user in the printed moving body image. . The editing instruction detection unit 413 is an example of means for detecting and specifying a mark entered by the user from the read image data.

Further, the above embodiment can be grasped as a method invention. That is, the above embodiment is an example of a control method of the moving image printing apparatus that inputs a moving image and prints a frame designated by the user as a still image. Further, the above embodiment is an example of realizing a capture step of capturing image data of a frame designated by a user and image data of a plurality of frames before and after the frame and storing them in a storage device. The above embodiment is an example of realizing a moving body detection step of detecting a moving body image in a moving image from a plurality of frames of image data captured in the capturing step and storing it in a storage device. In the above-described embodiment, the frame image specified by the user is separated into the moving body image detected in the moving body detection process and the background image, and the image separation process of storing in the storage device is realized. The said Example is an example which implement | achieves the mobile body image edit process which edits the said mobile body image according to a user's operation, and memorize | stores it in a memory | storage device. In the embodiment, the moving body image edited in the moving body image editing step and the background image are synthesized, a still image is generated, and stored in a storage device, and the still image generation step This is an example of realizing a printing process for printing a still image generated in (1).

1 is a configuration diagram illustrating a moving image printing apparatus 100 that is Embodiment 1 of the present invention. FIG. 3 is a flowchart illustrating an operation in the first embodiment. 6 is a diagram illustrating a specific example of a moving image editing process in Embodiment 1. FIG. It is a block diagram which shows the moving image printing apparatus 200 of Example 2 of this invention. 10 is a flowchart illustrating an operation in the second embodiment. FIG. 10 is a diagram illustrating a specific example of a moving image editing process according to the second embodiment. It is a conceptual diagram which shows the processing content of the conventional image generation apparatus.

Explanation of symbols

100: moving image printing apparatus,
101 ... control unit,
102 ... moving image input unit,
103 ... frame memory,
104 ... moving object detection separation part,
105: Mobile image memory,
106: Background image memory,
107 ... editing memory,
108 ... operation unit,
109 ... display unit touch panel,
110: Image composition unit,
111 ... printing section,
200: moving image printing apparatus,
412 ... Scanner,
413 ... Editing instruction detection unit.

Claims (5)

In a moving image printing apparatus for inputting a moving image and printing a frame specified by the user as a still image,
Capture means for capturing image data of a frame designated by a user and image data of a plurality of frames before and after the frame;
Moving body detection means for detecting a moving body image in a moving image from a plurality of frames of image data captured by the capture means;
Image separation means for separating the frame image designated by the user into a moving body image detected by the moving body detection means and a background image;
Mobile body image editing means for editing the mobile body image in response to a user operation;
A still image generating means for generating a still image by synthesizing the moving body image edited by the moving body image editing means and the background image;
Printing means for printing the still image generated by the still image generating means;
A moving image printing apparatus comprising: In claim 1,
The moving object image editing means is a means for performing different editing processes for each detected moving object when the moving object detecting / separating means detects a plurality of moving objects. . In claim 1,
The moving image printing apparatus according to claim 1, wherein the moving body image editing means is means for executing at least one of erasing of the moving body image, layout movement, and magnification change. In claim 1,
A scanner for reading images;
Second printing means for printing a moving body image separated by the moving body detection and separation means;
In the printed moving body image, a mark to be entered in the moving body image for editing processing that the user wants to perform. The print image related to the mark entered by the user is read by the scanner. A means of detecting and specifying the marks entered;
A moving image printing apparatus comprising: In a control method of a moving image printing apparatus for inputting a moving image and printing a frame specified by a user as a still image,
A capture step of capturing image data of a frame designated by a user and image data of a plurality of frames before and after the frame, and storing them in a storage device;
A moving body detecting step of detecting a moving body image in a moving image from a plurality of frames of image data captured in the capturing step and storing the moving body image in a storage device;
An image separation step of separating the frame image designated by the user into a moving body image detected in the moving body detection step and a background image and storing them in a storage device;
A moving body image editing step of editing the moving body image and storing it in a storage device in accordance with a user operation;
A still image generation step of combining the moving body image edited in the moving body image editing step and the background image, generating a still image, and storing the still image in a storage device;
A printing step of printing the still image generated in the still image generation step;
A method for controlling a moving image printing apparatus, comprising:

Images