JP2009118291A - Image forming apparatus, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image forming apparatus and program for creating an effective digest print. <P>SOLUTION: The invention relates to an image forming apparatus (4) for creating, from a moving image, digest print as many as a designated number of frames, including: a frame extraction unit (12) for extracting a plurality of frame images from moving image data; a cut point detection unit (14) for comparing image information items of the extracted frame images to detect a cut point at which image information rapidly changes; a representative frame selection unit (16) for selecting a frame image that has been detected as the cut point, as a representative frame image; and a print engine (20) for time-sequentially printing the selected representative frame image. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image forming apparatus and a program for creating a digest print of a moving image.

  This type of image forming apparatus, such as an MFP, has a plurality of functions. Specifically, the MFP includes a printing function, a transmission function, and a storage function. The storage function stores an image from a client PC or an image read by a scanner in a storage device (for example, HDD), and the transmission function is The stored image is transmitted, and the print function prints the stored image.

  Here, a digest print may be created using a moving image transmitted from a client PC (see, for example, Patent Document 1). Specifically, a plurality of cut points (frame images) are detected from the received moving image data, and then the detected plurality of frame images are printed in time series and provided to a user operating the client PC. .

JP 2006-211283 A

  However, in the above conventional technique, since cut points are detected from moving image data at regular intervals, there arises a problem that an effective digest print cannot be created. This is because a moving frame image cannot be printed if the moving image data occupies a lot of time in a scene with little motion, in other words, a scene with little image change.

In this digest print, the detected frame image is printed in the specified frame (frame). However, if the number of frame images is smaller than the number of frames, the frame may be left over. You have to be careful. In this case, in the above conventional technique, the user needs to manually adjust, forcing a complicated operation.
SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide an image forming apparatus and a program for solving the above-described problems and creating an effective digest print.

  A first invention for achieving the above object is an image forming apparatus that creates a digest print of a specified number of frames from a moving image, the frame extracting unit extracting a plurality of frame images from the moving image data, The image information of each frame image, a cut point detection unit that detects a cut point at which the image information changes rapidly, a representative frame selection unit that selects a frame image detected as the cut point as a representative frame image, A print engine that prints the selected representative frame images in time series.

  According to the first aspect of the present invention, the image forming apparatus has a frame extraction unit when creating a digest print of a moving image, and the frame extraction unit extracts a plurality of frame images from the moving image data. Output to the cut point detector. The cut point detection unit compares the image information of each extracted frame image. Then, a cut point at which the image information changes rapidly is detected and output to the representative frame selection unit. Next, the representative frame selection unit selects the frame image detected as the cut point as the representative frame image, and the print engine prints the selected representative frame image in time series.

  Therefore, the selected representative frame image is a cut point where the image information changes abruptly, that is, a frame image in which the image information changes suddenly. A simple digest print can be created.

According to a second aspect, in the configuration of the first aspect, the cut point detection unit obtains a difference value between the image information of the frame image extracted this time and the image information of the frame image extracted last time, and the difference value is predetermined. The frame image extracted this time is detected as a cut point when the threshold is exceeded.
According to the second invention, in addition to the operation of the first invention, the cut point detection unit analyzes the moving image data in real time. Specifically, the cut point detection unit obtains a difference value between the image information of the frame image extracted this time and the image information of the frame image extracted last time. When the difference value exceeds a predetermined threshold value, the frame image extracted this time is detected as a cut point, so that a frame image with a sudden change in image information can be obtained with certainty.

According to a third aspect, in the configuration of the second aspect, when the number of designated frames is different from the number of selected representative frame images, the cut point detection unit matches the number of selected representative frame images with the number of designated frames. Therefore, the threshold value is changed.
If the number of designated frames is different from the number of selected representative frame images, the number of frames is excessive or insufficient, and the user is forced to adjust the number of designated frames and the number of selected representative frame images. .

  However, according to the third invention, in addition to the operation of the second invention, in this case, the cut point detection unit changes the threshold value so that the number of representative frame images selected matches the number of designated frames. This makes it possible to create a digest printer completely automatically without bothering the user and contributes to improving the reliability of the image forming apparatus.

  A fourth invention is a program for an image forming apparatus that creates a digest print of a moving image, the program extracting a plurality of frame images from moving image data to a computer of the image forming apparatus, and the extracted program Compare the image information of each frame image, detect the cut point where the image information changes abruptly, select the frame image detected as the cut point as the representative frame image, and select the selected representative frame image And a procedure for printing in time series.

  According to the fourth invention, first, a plurality of frame images are extracted from the moving image data, and the image information of the extracted frame images is compared. Next, a cut point where the image information changes rapidly is detected, and a frame image detected as the cut point is selected as a representative frame image. Then, when the selected representative frame image is printed in time series, a digest print of a moving image is created. Therefore, the selected representative frame image is a cut point where the image information changes abruptly, that is, a frame image in which the image information changes suddenly. Digest prints can be created.

  According to the present invention, it is possible to provide an image forming apparatus and a program that prints a moving image and does not bother the user.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a configuration diagram of a digest print creation system according to the present embodiment. The system 1 is configured using a network 2 such as a LAN, for example, and the network 2 includes an image forming apparatus 4 and a plurality of clients. PC6 is connected respectively.

  FIG. 2 is a schematic configuration diagram of the image forming apparatus. The apparatus 4 is connected to the network 2 via the network interface 26 and further connected to a public line. The apparatus 4 is a digital multi-function peripheral, which is a so-called multi-function peripheral device (hereinafter referred to as MFP). The MFP 4 executes various operations in accordance with program instructions.

The MFP 4 includes, for example, a printing function (Copy function), a transmission function (Send function), and a storage function (Box function).
More specifically, the HDD 32 sequentially stores various data such as data read by the scanner unit 22, data transmitted from the client PC 6, data received by the FAX communication unit 24, and the Box function. have.

On the other hand, the FAX communication unit 24 also has a Send function, and transmits data stored in the HDD 32 to the other party. The print engine 20 prints data stored in the HDD 32 and has a copy function.
The print engine 20 includes an automatic document feeder (ADF) that transports a document to an image reading position of the scanner unit 22, a sheet supply unit that supplies a sheet, an image forming unit that transfers an image to a sheet, and a sheet that has been transferred Are connected to a post-processing device that performs sorting, punching, stapling, and the like.

  In addition, the MFP 4 includes an operation panel 28. In addition to buttons for touch operation, the panel 28 displays character information, a guidance image, and the like, and is configured to accept user operations. In this embodiment, the designated frame number for digest printing, that is, the designated frame number for printing a plurality of cut points detected from moving image data arranged in time series can be set. The user's operation content on the panel 28 is notified to the controller 10.

Further, the MFP 4 includes a memory 30, and the memory 30 includes a ROM, a RAM, and the like. Setting data associated with printing, in this embodiment, a correspondence table between the paper size and the designated number of frames, The program is stored.
Various operations of the MFP 4 are controlled by the controller 10. The controller 10 is an element that functions as a computer and has hardware resources such as a CPU. The controller 10 uses the hardware resources to execute a predetermined program and operates the print engine 20, the scanner unit 22, and the FAX communication unit 24 described above.

Here, as shown in FIG. 2, the HDD 32 has a box area 34. In the box area 34 of this embodiment, in addition to the various data described above, moving image data transmitted from the client PC 6 is also stored in this embodiment.
By the way, the controller 10 of this embodiment includes a frame extraction unit 12, a cut point detection unit 14, and a representative frame selection unit 16.

The frame extraction unit 12 extracts a plurality of frame images from the moving image data stored in the HDD 32, and outputs the extracted frame images to the cut point detection unit 14.
The cut point detection unit 14 compares the image information of the extracted frame images, detects a cut point at which the image information changes rapidly, and outputs the cut point to the representative frame selection unit 16.

Specifically, the cut point detection unit 14 firstly, among a plurality of extracted frame images, first, a difference value between the image information of the frame image extracted this time and the image information of the frame image extracted last time, In other words, a value obtained by quantifying the difference is obtained.
When the difference value exceeds a predetermined threshold value, the cut point detection unit 14 detects the frame image extracted this time as a cut point. This is because this cut point corresponds to a frame image whose image information has changed suddenly with respect to the previously extracted frame image.

Subsequently, the representative frame selection unit 16 divides the cut points into frame image shot groups arranged at the head. The representative frame selection unit 16 selects a frame image detected as the cut point as a representative frame image and outputs the selected frame image to the print engine 20.
The engine 20 prints the selected representative frame images in time series and provides the user with a digest print.

Here, in the present embodiment, the initial value of the threshold value described above is set to a large value, but the cut point detection unit 14 changes the threshold value to be small according to the number of representative frame images selected. As will be described later, if the number of selected representative frame images is smaller than the designated frame number, the selected number matches the designated frame number.
More specifically, FIGS. 3 and 4 show processing that the program causes the controller 10 to execute. Hereinafter, the operation of the MFP 4 configured as described above according to the present invention will be described.

In step S301 of FIG. 3, the client PC 6 transmits moving image data to the MFP 4, and the process proceeds to step S302. In the MFP 4 that has received this data, the controller 10 selects all representative frame images.
Specifically, as shown in FIG. 4, in step S401, the frame extraction unit 12 reads moving image data from the HDD 32 (FIG. 5A), and extracts a plurality of frame images from the moving image data. As shown in FIG. 5B, a total of 29 frame images are extracted in this embodiment. Then, the cut point detection unit 14 calculates a difference value between the extracted frame images, and the process proceeds to step S402.

  In step S402, the cut point detection unit 14 compares the extracted image information of each frame image, and determines whether or not the current image information is a cut point that changes rapidly. If the difference value exceeds the predetermined threshold value, that is, if it is determined YES, the process proceeds to step S403, where the frame image extracted this time has a sudden change in image information compared to the previously extracted frame image. If it is an image, the frame image is detected as a cut point, and the process proceeds to step S404.

This cut point is a portion painted in black in FIGS. 5A and 5B described above, and according to the current threshold value, the first, the 14th, and the 21st, counting from the left side. These three cut points are detected.
Subsequently, in step S404, the representative frame selection unit 16 divides these cut points into shot groups of frame images arranged at the head.

Then, the representative frame selection unit 16 selects a frame image detected as the cut point as a representative frame image, and the process proceeds to step S405.
More specifically, as shown in FIG. 5C, the moving image data according to the present embodiment is divided into three shot groups in which each cut point is arranged at the head. The th and 21st three cut points are selected as representative frame images, respectively.

  Next, in step S405, the cut point detection unit 14 determines whether the analysis of all the extracted frame images has been completed. If the analysis of the frame image remains, the process proceeds to step S406, the frame image extracted next time is analyzed, and the process returns to step S401. If so, the process exits the routine of FIG. 4 and proceeds to step S303.

If it is determined in step S402 that the frame image extracted this time is not a cut point, the process also proceeds to step S405, and whether or not the analysis of all the extracted frame images has been completed as described above. To determine.
Then, after the analysis of all the frame images is completed, the representative frame selection unit 16 determines whether or not a margin is generated on the paper (step S303).

  Specifically, the representative frame selection unit 16 compares the selected number of representative frame images with the designated frame number set on the operation panel 28, and when the selected number and the designated frame number match, That is, when it determines with YES, it progresses to step S304. This is because there is no margin in the paper in this case. The print engine 20 prints the selected representative frame images in time series, creates a digest print, and exits a series of routines.

On the other hand, if the number of selected representative frame images is smaller than the designated number of frames in step S303, the process proceeds to step S305, where the cut point detection unit 14 changes the threshold value to a small value and returns to step S302 for extraction. Redo all frame image analysis.
Specifically, in the example of FIG. 5C, each of the three cut points is selected as a representative frame image. However, if six designated frames are set on the operation panel 28, As a result, three margins are generated on the paper.

  Therefore, in the present embodiment, the cut point detection unit 14 changes the threshold value to a small value, and then compares the difference value of the image information of each frame image with the changed threshold value to detect the cut point again. . More specifically, as shown in FIG. 6, detection of cut points is repeated until the moving image data of the present embodiment is divided into six shot groups with each cut point at the head.

  That is, for example, the 11th, 18th, and 27th cut points (for example, the 11th, 18th, and 27th cut points) according to the new threshold values changed to be smaller than the first, 14th, and 21st cut points described above based on the previous threshold values. If a total of six cut points (all of which are blacked out) are selected as representative frame images, the process proceeds to step S304. As a result, an effective digest print with no margin on one sheet is created.

As described above, according to the present embodiment, the MFP 4 has the frame extraction unit 12 when creating a digest print of a moving image. This frame extraction unit 12 is transmitted from the client PC 6 and is sent to the HDD 32. A plurality of frame images are extracted from the held moving image data and output to the cut point detection unit 14.
The cut point detection unit 14 compares the image information of the extracted frame images. Then, a cut point at which the image information changes rapidly is detected and output to the representative frame selection unit 16.

Next, the representative frame selecting unit 16 divides the cut point into shot groups of the frame image arranged at the head, and selects the frame image detected as the cut point as the representative frame image, so that the print engine 20 is selected. The representative frame images are printed in time series.
Therefore, since the selected representative frame image is a cut point where the image information changes abruptly, that is, a frame image where the image information changes suddenly, the cut points are detected at regular intervals from the moving image data. In comparison, a moving frame image is printed, and an effective digest print can be created.

  Further, the cut point detection unit 14 analyzes the moving image data in real time. Specifically, the cut point detection unit 14 obtains a difference value between the image information of the frame image extracted this time and the image information of the frame image extracted last time. When the difference value exceeds a predetermined threshold value, the frame image extracted this time is detected as a cut point, so that a frame image with a sudden change in image information can be obtained with certainty.

Further, when the number of representative frame images selected is smaller than the designated number of frames, the number of frames is excessive, and the user is forced to adjust the number of selected representative frame images and the number of designated frames.
However, according to the present embodiment, in this case, the cut point detection unit 14 decreases the threshold value so that the number of representative frame images selected matches the number of designated frames. As a result, a digest printer that fills all the designated number of frames can be created completely automatically without bothering the user and contributes to improving the reliability of the MFP 4.

The present invention is not limited to the above embodiments, and various modifications can be made without departing from the scope of the claims.
For example, the cut point detection unit 14 of the present embodiment is changed so that the threshold value becomes small, but is not necessarily limited to this form. That is, when the number of selected representative frame images is larger than the designated number of frames, the threshold value may be changed so that the selected number matches the designated number of frames.

Finally, the above-described MFP 4 is an example of an image forming apparatus, and the present invention can naturally be applied to a copying machine, a printer, a facsimile, and the like that can create a digest print. The program of the present invention can also be applied to a client PC in which this program is installed.
In any of these cases, the effect of creating an effective digest print is obtained as described above.

It is a block diagram of the digest print production system which concerns on a present Example. It is a schematic block diagram of MFP of FIG. It is a flowchart which produces the digest print by the controller of FIG. It is a flowchart which selects the representative frame image of FIG. It is explanatory drawing which produces the digest print by FIG. It is explanatory drawing which produces the digest print by FIG.

Explanation of symbols

4 MFP (image forming device)
6 Client PC
10 Controller (computer)
12 frame extraction unit 14 cut point detection unit 16 representative frame selection unit 20 print engine 28 operation panel 30 memory 32 HDD

Claims (4)

An image forming apparatus that creates a digest print of a specified number of frames from a moving image,
A frame extraction unit for extracting a plurality of frame images from moving image data;
A cut point detector that compares the image information of the extracted frame images and detects a cut point at which the image information changes abruptly;
A representative frame selection unit that selects a frame image detected as the cut point as a representative frame image;
An image forming apparatus comprising: a print engine that prints the selected representative frame images in time series. The image forming apparatus according to claim 1,
The cut point detection unit obtains a difference value between the image information of the frame image extracted this time and the image information of the frame image extracted last time, and when the difference value exceeds a predetermined threshold, the cut point detection unit An image forming apparatus that detects a frame image to be cut as the cut point. The image forming apparatus according to claim 2,
When the designated frame number and the representative frame image selection number are different,
The image forming apparatus, wherein the cut point detection unit changes the threshold value so that the number of selected representative frame images matches the number of designated frames. A program for an image forming apparatus for creating a digest print of a moving image,
The program is stored in the computer of the image forming apparatus.
A procedure for extracting a plurality of frame images from moving image data;
A procedure for comparing the image information of each extracted frame image and detecting a cut point at which the image information changes abruptly;
A procedure for selecting a frame image detected as the cut point as a representative frame image;
A program for executing a procedure for printing the selected representative frame image in time series.

Images