JP2005328446A - Image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus which is capable of clearly and time-sequentially recognizing a moving object when outputting a motion picture and consecutive still pictures to an output device as one still picture. <P>SOLUTION: An image processing apparatus comprises an image input means 1; an image average synthesizing means 2 for generating a synthetic image averaging pixels of consecutive images in a predetermined block; a motion region detecting means 3 for detecting a motion region of a pixel moving between images; a differential region synthesizing means 4 for generating a synthetic image by extracting a specific region from an image; a image processing data temporary storage means 5; and an image output means 6 for outputting the synthetic image generated by the differential region synthesizing means 4. Thus, a moving region between images is extracted and a synthetic image is outputted to clearly and time-sequentially recognize a moving object. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing and output mode for outputting one synthesized image from a captured moving image, continuous still images, a moving image file recorded on a recording medium, and a continuous still image file in an image processing apparatus.

  Conventionally, as a method of outputting a moving image captured by a camera, a continuous still image, a moving image recorded on a recording medium, or a playback image obtained by reproducing a continuous still image to an output device as a single still image, an easy synthesis method is used. An image processing apparatus having means for generating and printing a single composite image is known.

As a means for generating and printing a single synthesized image by an easy synthesis method, an image to be synthesized is specified from a moving image to be printed, a pixel value of each pixel is averaged, and a synthesized image is generated and printed (for example, Patent Document 1). Assume that the moving images of images 1 to 6 shown in FIG. This is a moving image in which an object like a round ball is moving from right to left while accelerating from the background. FIG. 13 shows the result of averaging and synthesizing and printing out the moving images of images 1 to 6.
JP 2001-274970 A

  However, in the conventional apparatus, a moving image and continuous still images can be output as a single still image on a print sheet. However, since the pixel values of each pixel are averaged and combined, there are the following problems.

  When a user outputs a moving image and continuous still images as a single still image, it is common for the user to output the moving object in the image. If there is an object, the area where the object moved becomes an average of the background and the object, so it becomes a translucent object, and the area where the object did not pass is the same even if averaged and synthesized. Is printed as it is, and the background is printed more clearly than the moving object.

  Also, the user wants to recognize the temporal correlation of moving objects in the image from the printing paper, but cannot recognize it without looking at the original moving image and continuous still images.

  In order to solve the above-described problem, the image processing apparatus according to claim 1 is an image processing apparatus that outputs a single composite image from a moving image and continuous still images. The image input means for input, the image average composition means for generating a composite image obtained by averaging each pixel of the continuous image in a predetermined section in the moving image and the continuous still image, and the moving between the image of the moving image and the continuous still image A motion area detecting means for detecting a motion area of a pixel; and a difference area synthesizing means for extracting a specific area from a moving image and continuous still image images to generate a synthesized image, and is generated by the image average synthesizing means. Image processing data temporary storage means for storing the synthesized image, the motion area detected by the motion area detection means, and the composite image generated by the difference area synthesis means; Characterized by comprising an image output means for outputting the synthesized image generated by the differential area combining unit.

  The image processing apparatus according to claim 2 is the image processing apparatus according to claim 1, wherein the motion region detecting unit is configured to detect a continuous image from a head image of a moving image to be synthesized and a continuous still image to a specific time point. A motion region is detected, and a motion region is detected when an image after the specific time point is compared with a moving image to be synthesized and output and a head image of continuous still images.

  The image processing device according to claim 3 is the image processing device according to claim 1 or 2, wherein the difference area synthesis means is a sequence from the head image of the moving image to be synthesized and the continuous still image to a specific time point. The difference area of the motion area when the moving area of the image and the image after the specific time point are compared with the moving image to be synthesized and output and the head image of the continuous still image are detected, and the difference area is detected from the image after the specific time point. One composite image is generated from each image data obtained by extracting.

  An image processing apparatus according to a fourth aspect is the image processing apparatus according to the first, second, and third aspects, wherein the difference area synthesizing unit extracts each image data obtained by extracting the difference area from images after the specific time point. When synthesizing, the image data extracted from the previous image in the time series is replaced with the image data extracted from the subsequent image and synthesized.

  The image processing device according to claim 5 is the image processing device according to any one of claims 1, 2, 3 and 4, wherein the difference region synthesis means is a moving image and a continuous still image synthesized and output by the image average synthesis means. The image data obtained by extracting the difference area from the image after the specific time point is combined with the composite image obtained by averaging the pixels of the continuous images from the first image to the specific time point.

  The image processing device according to claim 6 is the image processing device according to claim 5, further comprising an output image designating unit, wherein the output image designating unit includes the moving image input by the moving image input unit and continuous still images. The first image and the last image for generating one composite image are designated from the image, and the moving area of the continuous image from the first image of the moving image and the continuous still image to the specific time point is specified. A specific time point for detection is designated.

  The image processing device according to claim 7 is the image processing device according to claim 5 or 6, wherein the moving image input means has means for reproducing a recorded moving image file and a continuous still image file, It is characterized by inputting continuous still images.

  An image processing apparatus according to an eighth aspect of the present invention is the image processing apparatus according to any one of the fifth, sixth, and seventh aspects, wherein the image output means includes a printing means, and the composite image generated by the difference area synthesis means is one sheet. It prints on the printing paper of this.

  The present invention solves the above-described conventional problems. When a moving image and continuous still images are output as a single still image to an output device, image processing that allows a moving object to be clearly and time-recognized. An object is to provide an apparatus.

  Hereinafter, an embodiment of an image processing apparatus of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a basic configuration of an image processing apparatus according to a first embodiment of the present invention. An image input unit 1, an image average synthesizing unit 2, a motion region detecting unit 3, a difference region synthesizing unit 4, a temporary image processing data. The storage unit 5, the image output unit 6, and the print image designation unit 7 are configured.

  The moving image input means 1 captures a video signal obtained by the camera as a moving image or a continuous still image and transmits the image to the image average combining means 2.

  In this embodiment, the captured video signal is treated as a moving image, and a part of the captured moving image is output as a single still image. Here, a part of the moving image to be output is a moving image from image 1 to image 6 in FIG. The range of the moving image to be printed can be arbitrarily specified by the user using the print image specifying means 7. The user can specify the printing start point and end point while photographing with the camera, and outputs the moving image as one still image while photographing. It is also possible to specify the range of video to be output automatically, such as using the scene change detection method to output the video range from the beginning of the scene change to the next scene. .

  The image input means 1 can also input a video signal reproduced from a moving image file recorded on a recording medium or a continuous still image file.

  Next, the image average synthesizing unit 2 generates a synthesized image α obtained by averaging the images from the first image of the moving image to be output to a specific time point. In the present embodiment, this specific time point is set as an image 4. An averaged composite image α from image 1 to image 4 is shown in FIG. Further, the user can arbitrarily designate the images up to this specific time using the print image designation means 7. In addition, the number of images from the beginning of the moving image to be output, or the number of seconds later may be designated in advance. Then, a composite image α obtained by averaging the images from the first image of the moving image to be output to a specific time is stored in the image processing data temporary storage unit 5.

  Next, the motion region detection means 3 detects a motion region A from the head image of the output moving image to the image immediately before the certain specific time point. The motion area A from the image 1 to the image 3 becomes the motion area 8 from the image 1 to the image 3 shown in FIG. Then, the motion area A from the output top image to the image immediately before a certain specific time is stored in the image processing data temporary storage means 5.

  In addition, the motion region detection means 3 detects a motion region B in which the head image of the moving image to be output is compared with the image at the specific time point. The motion region B when the image 1 and the image 4 are compared becomes the motion region 9 when the image 1 and the image 4 shown in FIG. 5 are compared. The head image of the moving image to be output is stored in the temporary storage means 5.

  Next, the difference area synthesizing unit 4 compares the moving image B obtained by comparing the head image of the moving image to be output with the image at the certain point in time, and a certain point in time from the head image of the moving image to be output stored in the temporary storage unit 5 The difference area C of the motion area A up to the previous image is detected. The difference area C deletes the motion area A from the motion area B that compares the head image of the output moving image with the image at a specific time point to the image immediately before the specific time point from the head image of the output moving image. This is the area. The difference region C between the motion region B when comparing the image 1 and the image 4 and the motion region A from the image 1 to the image 3 is obtained from the motion region B and the image 1 when comparing the image 1 and the image 4 in FIG. It becomes the difference area 10 of the motion area A up to the image 3. A region that exists in the region A but does not exist in the region B is not included in the region C.

  Then, the difference area synthesizing unit 4 extracts the image data of the area corresponding to the area C from the image at the certain specific time point, and from the head image of the moving image to be printed stored in the temporary storage unit 5 to the specific time point. A composite image β is generated by replacing the image data of the region corresponding to the region C of the composite image α obtained by averaging the images. Image data corresponding to the difference area 10 between the motion area B and the motion area A from the image 1 to the image 3 when the image 1 and the image 4 are compared from the image 4 are averaged composite images from the image 1 to the image 4 FIG. 8 shows a composite image β synthesized with α. Then, the composite image α is deleted from the temporary storage means 5 and the composite image β is stored in the temporary storage means 5.

  Next, the image after a certain specific time is demonstrated. The motion region detection means 3 detects a motion region B ′ obtained by comparing the head image of the moving image to be output with images after a certain point. The difference area synthesizing unit 4 compares the motion image B ′ obtained by comparing the first image of the moving image to be output with an image after a certain specific time point and one of the specific time points from the first image of the moving image stored in the temporary storage unit 5. The difference area C ′ of the motion area A up to the previous image is detected.

  Then, the image data of the area corresponding to the difference area C ′ is extracted from the images after the certain specific time point, and the image data of the area corresponding to the area C ′ of the composite image β stored in the temporary storage unit 5 is extracted. A replacement composite image β ′ is generated. At this time, the composite image β is deleted from the temporary storage means 5 and the composite image β ′ is stored in the temporary storage means 5. Image data corresponding to the difference region C ′ of the motion region B ′ and the motion region A from the image 1 to the image 3 when the image 1 and the image 5 are compared is extracted from the image 5 and combined with the composite image β. 'Is shown in FIG.

  The above procedure is repeated for images after a certain point in time. As a result, the composite image finally generated by the difference region combining unit 4 is output by the image output unit 6. Thus, when the moving image of the image 1 to the image 6 of FIG. 2 is output, it will become FIG.

  As described above, according to the present invention, it is possible to output an image obtained by extracting and synthesizing a region moving between images. In addition, the moving area of the image output to be combined with the image data extracted from the previous image in time series is replaced with the image data extracted from the subsequent image in time series. Can be recognized.

  The image output means 6 has a printing means, and the synthesized image finally generated by the difference area synthesizing means 4 is not only displayed on a display such as a monitor but also printed on a single printing sheet. May be.

  In the embodiment of the present invention, the input of the video, the image processing, and the image output are described as an integrated device. However, the video camera and the printer are connected by an interface such as a USB, and the video input and the image are performed by the video camera. Devices having respective functions such as performing processing and outputting an image with a printer may be connected and used.

  The temporary storage means 5 is used as a composition source in the head image of the moving picture to be output, the motion area from the head image of the moving picture to be detected detected by the motion area detection means 3 to a specific point in time, and the difference area composition means 4 Since only the image needs to be stored, the amount of memory used can be significantly reduced compared to the technique of extracting the background from a moving image or the like.

  Also, if you simply compare the first image with an image at a certain point in time and try to extract a moving area from the image at a certain point in time and combine it with the first image, it will move if there is already a moving object in the first image When the areas are combined, the moving object in the top image is replaced with the background. For example, if a moving object other than the background already exists in the top image as in the moving image of FIG. 2, the motion region when compared is the motion region 11 when comparing image 1 and image 2 of FIG. When the image data of the region corresponding to the motion region 11 when comparing the image 1 and the image 2 from the image 2 is extracted and synthesized with the image 1, the result is as shown in FIG. become.

  However, according to the present invention, even when a moving object already exists in the head image, the moving object of the head image can be left in the composite image and output.

  The image processing apparatus according to the present invention has an effect that a moving object can be clearly and time-recognized when a moving image and continuous still images are output as a single still image. This is effective for image processing, printing form, and the like in a printing apparatus having a function of printing the image.

Basic configuration diagram of image processing apparatus of the present invention The figure which showed the example of the image sequence of the image to output The figure which showed the synthesized image (alpha) averaged from the image 1 to the image 4 The figure which showed the motion area A from the image 1 to the image 3 The figure which showed the motion area B when comparing the image 1 and the image 4 The figure which showed the difference area | region C of the motion area when comparing the image 1 and the image 4, and the motion area from the image 1 to the image 3 The figure which showed synthetic | combination image (beta) which extracted the difference area | region C from the image 4 and was synthesize | combined with the synthetic | combination image (alpha). The figure which showed synthetic | combination image (beta) which extracted the difference area | region C 'from the image 5, and was synthesize | combined with synthetic | combination image (beta). A diagram in which images 1 to 6 are output The figure which showed the motion area when image 1 and image 2 are simply compared 11 is a diagram showing a composite image obtained by extracting the motion region of FIG. The figure which showed the example of the image sequence of the image output with the conventional printing method The figure which printed the animation of image 1 to image 6 with the conventional printing method

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image input means 2 Image average composition means 3 Motion area detection means 4 Difference area composition means 5 Image processing data temporary storage means 6 Image output means 7 Output image designation means 8 Motion area from image 1 to image 3 9 Image 1 and image 4 motion region when comparing 4 10 motion region when comparing image 1 and image 4 and difference region between motion regions from image 1 to image 11 11 motion region when comparing image 1 and image 2 12 image 1 The area where the moving object is combined with the background of image 2

Claims (8)

An image processing apparatus that outputs a single composite image from a moving image and continuous still images, and an image input unit that inputs a captured moving image and continuous still images; Image average combining means for generating a composite image obtained by averaging each pixel of an image, motion area detection means for detecting a moving area of a pixel moved between a moving image and continuous still image images, and a moving image and continuous still images Difference region synthesizing means for extracting a specific area from the image and generating a synthesized image, a synthesized image generated by the image average synthesizing means, a motion area detected by the motion area detecting means, An image processing data temporary storage means for storing the composite image generated by the difference area composition means, and a composite image generated by the difference area composition means are output. The image processing apparatus characterized by comprising an image output unit. The image processing apparatus according to claim 1, wherein the motion area detection unit detects a motion area of a continuous image from a head image of a moving image to be synthesized and a continuous still image to a specific time point, and after the specific time point. An image processing apparatus for detecting a motion region when an image is compared with a moving image to be synthesized and output and a head image of continuous still images. 3. The image processing apparatus according to claim 1, wherein the difference area synthesizing unit includes a moving area of a continuous image from a head image of the moving image to be synthesized and a continuous still image to a specific time point, and after the specific time point. The difference area of the motion area when comparing the first image of the moving image and the continuous still image that are synthesized and output with the first image is detected, and one synthesized image is obtained from each image data obtained by extracting the difference area from the images after the specific time point Generating an image processing apparatus. 4. The image processing device according to claim 1, wherein the difference area synthesis unit is configured to combine the image data obtained by extracting the difference area from the images after the specific time point from the previous image in time series. An image processing apparatus, wherein the extracted image data is replaced and synthesized with image data extracted from a subsequent image. 5. The image processing apparatus according to claim 1, wherein the difference region synthesizing unit is a continuous image from a moving image synthesized by the image average synthesizing unit and a head image of continuous still images to a specific time point. An image processing apparatus characterized in that each image data obtained by extracting the difference area from the image after the specific time point is synthesized with a synthesized image obtained by averaging the pixels. 6. The image processing apparatus according to claim 5, further comprising an output image designating unit, wherein the output image designating unit generates a single composite image from a moving image and a continuous still image input by the image input unit. For specifying the start time and the end image, and for specifying a specific time point for detecting a motion region of a continuous image from the start image of the moving image and the continuous still image to a specific time point. A featured image processing apparatus. 7. The image processing apparatus according to claim 5, wherein the image input means includes means for reproducing a recorded moving image file and a continuous still image file, and inputs the moving image and the continuous still image. Image processing device. 8. The image processing apparatus according to claim 5, wherein the image output means includes a printing means, and prints the synthesized image generated by the difference area synthesizing means on a single printing sheet. Image processing device.

Images