JP5602818B2 - Camera, image reproduction apparatus, image composition method, and program - Google Patents

Description

  The present invention relates to a camera, an image reproduction device, an image composition method, and a program, and more particularly, to a camera, an image composition method, and a program that can synthesize a panoramic image from a moving image.

  In recent years, with the widespread use of digital images, various image processing techniques have been provided, and it has become possible to enjoy images with expressions that were previously unthinkable. Since the camera has also been converted into a digital image, it has become possible to easily shoot movies. In addition, with the digitization of images, it becomes easy to enlarge and display a part of an image by electronic zoom, which is used for a subject at a long distance. Electronic zoom is used in the direction of narrowing the field of view, but conversely, techniques for expanding the shooting range are also being incorporated in cameras.

For example, Patent Document 1 discloses an imaging device that obtains a panoramic image that reproduces a wide field of view by joining divided images and synthesizing the images.
Japanese Patent No. 3804313

  The imaging device disclosed in Patent Document 1 described above can widen the imaging range. However, this imaging device is based on the premise that the subject is stationary, and can only be applied to still images such as landscapes. That is, the imaging device disclosed in Patent Document 1 is not suitable for shooting a moving subject.

  The present invention has been made in view of such circumstances, and expresses a panoramic feeling without preparing a special wide-angle lens and the like, and moves the subject in a magnificent background image. An object of the present invention is to provide a camera, an image composition method, and a program that can express the image.

  In order to achieve the above object, the camera according to the first aspect of the present invention includes a motion determination unit that detects to which direction the field of view has moved during continuous shooting, an image frame that was previously captured, and an image that was captured later. Compare the frames, do not extract dissimilar portions, and determine a common portion image determination unit that determines a common portion image behind the moving direction of the dissimilar portion, and the backward direction of the previously captured image frame And a background composition unit for obtaining an image obtained by synthesizing the common part image.

  A camera according to a second aspect of the invention is characterized in that, in the first aspect of the invention, the adjacent part is used as a glue margin part for overlapping with the previously obtained common part image.

A camera according to a third invention is the camera according to the first invention, wherein the camera records an image synthesized by the continuous image recording unit that records the continuously shot image frames and the background synthesis unit. Display control that compares the background image recording unit , the image recorded in the background image recording unit , and the image frames recorded in the continuous image recording unit , and sequentially displays the synthesized image by replacing similar image portions And a section.

According to a fourth aspect of the present invention, there is provided a camera for obtaining a background composite image obtained by synthesizing a continuous image recording unit that records image frames continuously acquired at the time of continuous shooting and a common portion image obtained at the time of continuous shooting. The background composition unit, the background image recording unit that records the background composite image, the background composite image recorded in the background image recording unit, and the image frames recorded in the continuous image recording unit are compared sequentially. A display control unit that sequentially displays the synthesized images by replacing the similar image portion with the moving image frame image that the moving body moves.

  The image reproducing apparatus according to the fifth aspect of the present invention compares an image frame taken at the front of an image frame continuously shot while moving the field of view, and an image frame shot later, and finds a portion that is not similar. A common image determining unit for determining a common image in the backward direction of the visual field movement of the dissimilar portion without extracting, the adjacent portion in the backward direction of the previously acquired image frame, and the common image. And a background composition unit for obtaining a synthesized image.

According to a sixth aspect of the present invention, there is provided an image reproduction apparatus for obtaining a background composite image obtained by synthesizing a continuous image recording unit for recording image frames continuously acquired at the time of continuous shooting and a common image obtained at the time of continuous shooting. A background composition unit for comparing a background image recording unit for recording the background composite image, a background composite image recorded in the background image recording unit, and an image frame recorded in the continuous image recording unit, And a display control unit that sequentially displays the synthesized images by replacing the successive similar image portions with the frame images of the moving image as the moving body moves.

  In the image composition method according to the seventh aspect of the present invention, during continuous shooting, the direction in which the shooting field of view is moved is determined, and the image frame shot first is compared with the image frame shot later, The non-similar part is not extracted, the common part image in the backward direction of the moving direction of the non-similar part is determined, and the adjacent part in the backward direction of the previously captured image frame is combined with the common part image. It is characterized in that the synthesized image is background synthesized.

According to an eighth aspect of the present invention, there is provided an image composition method for recording image frames continuously acquired at the time of continuous shooting, combining and recording the common part images obtained at the time of continuous shooting, The image frames recorded at the time of the continuous shooting are compared, and similar images are sequentially replaced with moving image frames that the moving body moves to sequentially display synthesized images.

  The program according to the ninth aspect of the present invention compares the step of determining the direction in which the field of view is moved during continuous shooting, the image frame shot first, and the image frame shot later, The step of determining a common part image in the backward direction of the moving direction of the dissimilar part without extracting the dissimilar part, the adjacent part in the backward direction of the previously captured image frame, and the common part image And background synthesizing the synthesized image.

According to a tenth aspect of the invention, there is provided a program for recording image frames continuously acquired at the time of continuous shooting, a step of combining and recording the common part image obtained at the time of continuous shooting, and the recorded combination A display step of comparing the image and the image frame recorded during the continuous shooting and sequentially displaying the synthesized image by sequentially replacing the similar image portion with the moving image frame image that the moving body moves. It is characterized by that.

  According to the present invention, a camera, an image composition method, and a program that can express a panoramic feeling without preparing a special wide-angle lens or the like, and can express the movement of a subject in a majestic background image. Can be provided.

  Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied according to the drawings. FIG. 1 is a block diagram showing a configuration of a camera 10 according to the first embodiment of the present invention. The camera 10 is a digital camera and can capture still images and moving images. Inside the camera 10, there are a control unit 1, an operation unit 1a, a lens 2, an imaging unit 3, a motion determination unit 4, a first buffer 5a, a second buffer 5b, a similarity extraction unit 5c, a third buffer 5d, and a margin portion 5e. , An image processing unit 6, a combining unit 7a, a moving image combining unit 7b, a display unit 8, a moving image recording unit 9a, and a background recording unit 9b are provided.

  The control unit 1 includes a CPU (Central Processing Unit) and the like, is connected to each unit of the camera 10, and performs overall control according to a built-in program. The operation unit 1a includes operation members such as a release button, a menu button, and a playback button. When the user operates the operation unit 1a, the control unit 1 outputs a control signal to each unit according to the operation.

  The lens 2 is an optical lens for forming a subject image. The image pickup unit 3 includes an image pickup element and its readout circuit, and converts the subject image formed by the lens 2 into image data. The motion determination unit 4 receives the image data from the imaging unit 3 and detects the motion direction of the camera 10. That is, images obtained continuously are compared to determine in which direction the shooting screen of the camera 10 is moving.

  The first buffer 5 a is a storage unit for temporarily storing image data from the imaging unit 3. The second buffer 5b is a storage unit for temporarily storing image data temporarily transferred to the first buffer 5a immediately before the image data is temporarily stored in the first buffer 5a.

  The similarity extraction unit 5c compares the end portions of the image data temporarily stored in the first buffer 5a and the second buffer 5b, respectively, and extracts only similar portions (hereinafter, similar portions are extracted). This is referred to as a partial background image (see 25a and 25b in FIG. 4 described later). Here, the end side is a rear end side with respect to the movement direction of the camera 10 detected by the motion determination unit 4.

  The margin portion 5e extracts only the end portion of the image data temporarily stored in the first buffer 5a as a margin portion (also referred to as a margin portion). Note that the position of the margin is generated on the side opposite to the movement direction of the camera 10 detected by the movement determination unit 4. The third buffer 5d is a storage unit that temporarily stores the partial background image extracted by the similarity extraction unit 5c and the margin part extracted by the margin part 5e.

  The synthesizing unit 7a sequentially synthesizes the partial background images temporarily stored in the third buffer 5d. That is, every time image data of each frame constituting a moving image is output from the imaging unit 3 to the first buffer 5a, the partial background image and the blank portion are temporarily stored in the third buffer 5d and output to the combining unit 7a. Is done. Each time the partial background image is output, the synthesizing unit 7a combines the partial background images so that a part of the partial background image overlaps the blank portion, thereby generating a background image. That is, the partial background image gradually extends in the direction opposite to the margin portion every time image data of each frame is output, and becomes a background image like a panoramic image.

  The image processing unit 6 performs image processing such as image compression for reducing the storage capacity. The image data of the background image generated by the synthesizing unit 7a and the image data of each frame constituting the moving image output from the imaging unit 3 are subjected to image processing such as compression by the image processing unit 6 in the JPEG format or the motion JPEG format. Is made.

  The background recording unit 9b records the image data of the background image generated by the synthesizing unit 7a and compressed by the image processing unit 6. The moving image recording unit 9 a records the moving image before the background separation process output from the imaging unit 3. The moving image recording unit 9a and the background recording unit 9b may be provided separately, but different areas may be allocated on the same recording medium.

  The moving image combining unit 7b combines the moving image recorded in the moving image recording unit 9a with the background image recorded in the background recording unit 9b. That is, the moving image synthesizing unit 7b detects a portion that matches the background image for each frame constituting the moving image, replaces the detected portion with a moving image, and combines the images. This makes it possible to synthesize images that run in a vast landscape.

  The display unit 8 includes a display device such as a liquid crystal monitor, and reproduces and displays the moving image combined by the moving image combining unit 7b or the moving image recorded in the moving image recording unit 9a. The image data synthesized by the moving image synthesizing unit 7b is not only displayed on the display unit 8, but the image data may be recorded on the moving image recording unit 9a or the like.

  Next, the synthesized moving image in the present embodiment will be described with reference to FIGS. FIG. 2 shows the respective frames 21a to 21d constituting the moving image when the moving person 24 is photographed as a moving image against the background of the mountain range 22 and the tree 23. Each frame 21a to 21d can be enjoyed as a moving image by sequentially reproducing the frames.

  As shown in Fig. 2, when you chase and follow the scenes of a person running in a wide landscape, a bird flying, or a vehicle running, the background spreads in one frame. You can't copy everything. It is possible to depict the spread for the first time by shooting multiple frames.

  Therefore, in the present embodiment, as shown in FIG. 3, a wide background image 27 is generated from a plurality of frames constituting a moving image, and a person 24 as a subject moves in the background image 27. I try to express it. That is, FIG. 3A shows a situation where the person 24 is running from the right side to the left side, and FIG. 3B is a time point after the time point of FIG. Shows running.

  As described above, in this embodiment, although the subject moves in the screen, the spread of the background can be reproduced together with the movement. With conventional cameras, a still panorama and each frame shown in FIG. 2 could be reproduced sequentially at the same position, but neither movement nor spread could be expressed. On the other hand, the camera 10 of the present embodiment can also express movement and spread.

  Next, a method for generating the background image 27 will be described with reference to FIGS. 4 (a) and 4 (b) show continuously obtained photographing frames. A common area exists as a background on the back side of the person 24 who is the subject of each shooting frame. That is, since the photographer is following the movement of the person 24, the background is the same, although it slightly deviates from the movement direction of the person 24. The common portion (partial background image) 25a in FIGS.

  Since the portion 24a (foot portion in the figure) of the person 24 changes from the center of the common portion (partial background image) 25a, the background and the person 24 are both images (FIG. 4A and FIG. 4). Unlike in (b)), the similarity extraction unit 5c does not detect this portion 24a. Therefore, it is the portion of the common portion (partial background image) 25a that is shaded that is extracted as being similar, and the similarity extraction unit 5c uses this strip-shaped common portion (partial background image). Extract only 25a. In the present embodiment, when extracting similar parts, a strip-shaped range obtained by dividing the screen into eight equal parts in the horizontal direction is used. You may change suitably about this division | segmentation number and its shape.

  FIG. 4C is a diagram in which the common part (partial background image) 25a is taken out, and the margin part (glue part) 26a is taken out from FIG. The margin part 26a is a part adjacent to the partial background image 25a, and this part is used as a margin part (glue allowance) when combining with the next partial background image 25b.

  When the partial background image 25a is extracted by comparing the frames of FIG. 4A and FIG. 4B, the partial images of FIG. 4D and FIG. The background image 25b is extracted. That is, FIG. 4D is the same image as FIG. 4B, but since it is compared with the next frame, the position of the extracted common part (partial background image) is shown in FIG. ) Is different. The partial background image 25b is extracted in the same manner as the partial background image 25a, and a margin part (glue part) 26b is also extracted.

  In this way, when the partial background images 25a and 25b with the strip-shaped margins 26a and 26b are extracted, next, the composition unit 7a performs image synthesis so that the margin 26b overlaps the partial background image 25a. As a result, a background image as shown in FIG. Thereafter, each time image data of a shooting frame constituting a moving image is output from the shooting unit 3, the shooting frames are sequentially compared, and a partial background image or the like is generated and synthesized, as shown in FIG. Such a background image 27 is synthesized. The procedure for synthesizing the background image will be described later with reference to the flowchart shown in FIG.

  Next, a method for generating a moving image by inserting a moving image frame into the background image 27 will be described with reference to FIGS. 5 and 6. When the background image 27 is generated as described above, next, a portion similar to each frame of the moving image in the background image 27 is sequentially detected, and the image of the similar portion is set as the background image 27. By sequentially replacing, a moving image in which the person 24 runs in the panoramic view as shown in FIG. 3 is obtained.

  First, from the background image 27 shown in FIG. 6, a partial background image 25 e ′ that matches the partial background image 25 e of each frame 21 e constituting the moving image is detected. When a matching portion is detected, a corresponding portion (width Y of the partial background image 21e) 27e of the inserted image is deleted from the background image 27, and the frame 21e is inserted into this portion. As shown in FIGS. 5B and 5C, moving frames are sequentially shifted as shown in FIGS. 5B and 5C so that a moving image in which the person 24 runs can be obtained. This moving image synthesis is performed by the moving image combining unit 7b. The procedure for synthesizing the moving image will be described later with reference to the flowchart shown in FIG.

  Next, the background image composition described with reference to FIGS. 4 and 5 will be described with reference to the flowchart shown in FIG. This background image composition flow is executed by the control unit 1 controlling each unit.

  In the background image composition flow, first, motion determination is performed (S1). In this step, based on the image data of the peripheral part of the image acquired by the imaging unit 3, the motion determination unit detects a motion vector and detects to which direction the field of view is moved. As described above, in the present embodiment, the background image is synthesized in the backward direction of the moving direction of the camera 10, and the direction in which the background image is synthesized is determined based on this movement direction.

  Next, an image is acquired in the first buffer (S2). In this step, the image data from the imaging unit 3 is temporarily stored in the first buffer 5a. Subsequently, it is determined whether the next image has been acquired (S3). The imaging unit 3 acquires image data at a predetermined time interval, and in this step, it is determined whether the image has been acquired by reading the image data of the next shooting frame constituting the moving image after the predetermined time has elapsed. I do.

  If the result of determination in step S3 is that the next image has been acquired, transfer is made to the second buffer (S4). In this step, the image data temporarily stored in the first buffer 5a is transferred to the second buffer 5b, and the newly acquired image data is temporarily stored in the first buffer 5a. On the other hand, if the result of determination in step S3 is that the next image has not been acquired, it is determined whether or not two images temporarily stored in the first buffer 5a and the second buffer 5b can be compared ( S11). In this step, it is determined whether image data is temporarily stored in both buffers and comparison has not been performed yet.

  If the result of determination in step S11 is that comparison is not possible, processing proceeds to step S18. On the other hand, if the result of determination is that comparison is possible, the part behind the first buffer and the common part of the second buffer are extracted and recorded (S12). In this step, as described with reference to FIG. 4, the rear side of the movement direction of the image acquired later (corresponding to the image shown in FIG. 4A and temporarily stored in the first buffer 5 a). From the portion (the rightmost strip portion divided into eight in the horizontal direction in FIG. 4), the image acquired earlier (corresponding to the image shown in FIG. 4B and transferred to the second buffer 5b) Comparison is made and a matching partial background image 25a is extracted and temporarily stored in the third buffer 5d.

  Subsequently, the back of the common part is stored as a margin from the second buffer (S13). As described in FIGS. 4C and 4F, the margin portions 26a and 26b as the margin portions are copied from the image data acquired first and temporarily stored in the second buffer 5b. Temporarily stored together with the images 25a and 25b.

  Next, it is determined whether or not composition is possible (S14). That is, in steps S12 and S13, the partial background images 25a and 25b and the glue margin portions 26a and 26b for background image synthesis are temporarily stored, so it is determined whether image synthesis is possible using these data. If the result of this determination is that synthesis is not possible, processing proceeds to step S18.

  On the other hand, if the result of determination in step S14 is that compositing is possible, next, image compositing is performed by superimposing the previous common part (partial background image) and the margin part (S15). That is, as shown in FIG. 4G, the background image 27 is synthesized from the strip-shaped partial background images 25a and 25b by using the margin portions 26a and 26b. This synthesis is performed by the synthesis unit 7a.

  Next, each frame combined in step S15 and a common part (partial background image) are recorded (S16). Each frame is image data constituting a moving image, which is recorded in the moving image recording unit 9a, and the background image 27 in which the common part (partial background image) is synthesized is recorded in the background recording unit 9b.

  Subsequently, it is determined whether or not the background image composition is finished (S18). When background image composition is performed while shooting a moving image, it is determined that the background image composition is finished when the moving image shooting is completed. In addition, it is also possible to record a moving image in advance and record it, and then perform background image composition for the recorded moving image. In this case, the background is used by using all of the pre-recorded moving image frames. It is determined to end when image composition is performed.

  If the result of determination in step S18 is not end, processing returns to step S3, the next image is acquired, and the above-described operation is executed. On the other hand, if the result of determination is that the processing has ended, the flow returns to the original flow in which the overall control of the camera 10 is performed.

  Next, a moving image display flow for generating a moving image as shown in FIG. 3 by superimposing a moving image on the background image described above will be described with reference to the flowchart shown in FIG.

  In the moving image display flow, first, the synthesized background image 27 is displayed (S21). In this step, a background image 27 as shown in FIG. 5A synthesized by the synthesis unit 7a is displayed on the display unit 8. Then, it is determined whether it is a predetermined timing (S22). In this step, it is determined whether or not it is the timing for each frame of the moving image read from the moving image recording unit 9a, and if it is not the predetermined timing, it waits for the predetermined timing.

  If the result of determination in step S22 is a predetermined timing, it is next determined whether or not there is uncombined (S23). In this step, it is determined whether or not all shooting frames constituting the moving image have been read from the moving image recording unit 9a. If there is no unsynthesized image as a result of this determination, the process returns and returns to the flow for performing overall control of the camera 10.

  On the other hand, if the result of determination in step S23 is that there is an unsynthesized image, the common part of the two images is detected (S24). In this step, as described with reference to FIG. 6, the portion 25e 'of the background image 27 corresponding to the partial background image 25e of the frame image 21e corresponding to one frame of the moving image is detected.

  Subsequently, as described with reference to FIG. 6, the width Y to the opposite end of the partial background image (common part) 25e is determined (S25), and the image corresponding to this width Y is erased from the background image 27 (S26). Then, the frame image 21e of the moving image is inserted into the erased portion, and the image is synthesized (S27). That is, in these steps, the portion of the width Y corresponding to the width of the inserted image is deleted from the background image 27 from the partial background image (common portion), and the image (frame image 21e) as it is captured is inserted into that portion. Is displayed. The synthesized image is displayed for a predetermined time.

  Next, the background is returned from the image synthesized in step S27 to the background image 27 (S28). When the background is returned, the process returns to step S22 to execute the above-described operation. In this way, by repeatedly executing Steps S22 to S28, the background image 27 and the frame image of the moving image are sequentially compared, and the background image 27 having the width Y including the common portion is replaced with an image. The video is synthesized by obtaining.

  As described above, in the present embodiment, it is possible to reproduce a moving image of a moving body in a panoramic background that cannot be captured by a single still image (see FIG. 3).

  In particular, since a large screen TV is suitable for displaying a vast landscape, an image taken by the camera according to the present embodiment is recorded, and is connected to the large screen TV for playback display. Anyway. In addition, an image captured by a general video camera may be subjected to image analysis by a playback device, and playback display similar to the present embodiment may be performed.

  Next, a second embodiment of the present invention will be described using FIG. 9 and FIG. In the first embodiment, as illustrated in FIG. 3, a panoramic background image 27 is generated in advance, and a state in which the moving object moves therein is displayed. In the second embodiment, the background image extends in accordance with the movement of the moving body as shown in FIG.

  That is, according to the movement of the person 24, the background images 27a to 27c are sequentially extended as shown in FIGS. Such a display method is effective when displaying the travel distance of the moving body, and can provide a thrilling effect of not knowing what the destination is at the beginning.

  The configuration of the second embodiment is the same as that shown in FIG. 1, and instead of the flowchart shown in FIG. 7, the background image composition flowchart shown in FIG. 10 is executed.

  The background image composition flow is almost the same as the flow shown in FIG. 7, and the first buffer image composition in step S17 is performed in place of each frame and common area recording in step S16. In the first embodiment, after all the partial background images 25a and 25b are generated, these are combined to generate the background image 27. However, in the second embodiment, every time a partial background image is generated, the partial background image generated up to that time is combined.

  In step S18, it is determined whether the background image 27 is generated by all partial background images in the first embodiment. However, in the second embodiment, the partial background image is determined. Is generated once, and a moving image is displayed. When the moving image display for one frame is performed, the process returns to the background image composition, and thereafter, the moving image display and the background image composition are repeated.

  As described above, according to each embodiment of the present invention, a background image is generated based on continuously shot image frames, a portion where the image frame and the background image are common is detected, and this common portion is detected. The video frames that were taken continuously are replaced sequentially to compose a moving image. Therefore, it is possible to express a panoramic feeling without preparing a special wide-angle lens or the like and to express the movement of the subject in a magnificent background image. That is, it is possible to display an image that simultaneously expresses the spread of the landscape and the state of movement of the moving body.

  In this embodiment, the image is taken with a camera, and the taken image is reproduced and displayed. However, the present invention is not limited to this, and the camera may be used only for shooting and moving image recording, and may be reproduced and displayed on the playback device so that the moving body moves in the paranorama-like background image as in this embodiment. . In this case, the image data of the recorded moving image is sequentially read out, temporarily stored and transferred to the first buffer 5a and the second buffer 5b, and the temporarily stored image data is used as in the embodiment of the present invention. What is necessary is just to process.

  In addition, as a moving image, the present invention can be applied not only to images with natural movement such as television and movies, but also to images that are continuously shot such as time-lapse shooting and continuous shooting.

  In the present embodiment, the digital camera is used as the device for shooting. However, the camera may be a digital single-lens reflex camera or a compact digital camera having a continuous shooting function such as a moving image, a video camera, A camera dedicated to moving images such as a movie camera may be used, and a camera built in a mobile phone, a personal digital assistant (PDA), or the like may be used. In any case, the present invention can be applied to any imaging device capable of continuously acquiring images.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

It is a block diagram which shows the structure of the camera concerning 1st Embodiment of this invention. It is a figure which shows the image of each flame | frame of the image image | photographed with the camera which concerns on 1st Embodiment of this invention. In the camera concerning 1st Embodiment of this invention, it is a moving image which shows a mode that a to-be-photographed object moves in a background image, (a) is an image in an initial stage, (b) is from (a). It is a later image. In the camera according to the first embodiment of the present invention, it is a diagram for explaining the generation of the background image, (a) is the image of the first frame, (b) is the image of the next frame, (c) Is a diagram in which a common part (partial background image) of both images is extracted, (d) is an image of the same next frame as (b), (e) is a further next image, (f) Is a diagram obtained by extracting a common part (partial background image) of two images of the next frame and the next frame, and (g) is a diagram obtained by synthesizing the common part (partial background image). In the camera according to the first embodiment of the present invention, FIG. 4 is a diagram illustrating a method of generating a moving image, (a) is a diagram of a background image, and (b) and (c) are a part of the background image and a moving image. It is a figure explaining replacing with the frame image to perform and producing | generating a moving image. It is a figure explaining the production | generation method of a moving image in the camera in 1st Embodiment of this invention. It is a flowchart of the background image synthesis | combination in the camera concerning 1st Embodiment of this invention. It is a flowchart of the moving image display in the camera concerning 1st Embodiment of this invention. In the camera in 2nd Embodiment of this invention, it is a figure which shows a background image, (a)-(c) shows a mode that a background image is extended sequentially. It is a flowchart of the background image synthesis | combination in the camera concerning 2nd Embodiment of this invention.

DESCRIPTION OF SYMBOLS 1 ... Control part, 2 ... Lens, 3 ... Imaging part, 4 ... Motion determination part, 5a ... 1st buffer, 5b ... 2nd buffer, 5c ... Similarity extraction , 5d ... third buffer, 5e ... margin, 6 ... image processing unit, 7a ... combining unit, 7b ... moving image combining unit, 8 ... display unit, 9a ... Movie recording unit, 9b ... background recording unit, 10 ... camera, 21a to 21e ... frame image, 22 ... mountain range, 23 ... tree, 24 ... person, 24a ... Part of person, 25a-25b ... partial background image (common part), 26a-26b ... margin (part of glue), 27 ... background image, 27a-27c ... background image, 27e ..Part of background image

Claims (10)

A motion determination unit that detects which shooting field of view has moved during continuous shooting;
Compare the first shot image frame with the later shot image frame, do not extract the dissimilar part, and determine the common part image behind the moving direction of the dissimilar part And
A background synthesizing unit for obtaining an image obtained by synthesizing the adjacent part in the rear direction of the image frame photographed first and the common part image;
A camera comprising:   2. The camera according to claim 1, wherein the camera is used as a margin part for combining the adjacent part with the previously obtained common part image. The above camera
A continuous image recording unit for recording the continuously shot image frames;
A background image recording unit for recording the image synthesized by the background synthesis unit;
A display control unit that sequentially compares the images recorded in the background image recording unit and the image frames recorded in the continuous image recording unit, sequentially replaces similar image portions and combines them;
The camera according to claim 1, further comprising: A continuous image recording unit for recording image frames continuously acquired during continuous shooting;
A background synthesis unit for obtaining a background synthesized image obtained by synthesizing the common part image obtained at the time of continuous shooting;
A background image recording unit for recording the background composite image;
The background composite image recorded in the background image recording unit is compared with the image frames recorded in the continuous image recording unit, and the similar image portion is sequentially replaced with a moving frame image of a moving body. A display control unit for sequentially displaying the synthesized images;
A camera comprising: Compare the image frames taken ahead of the image frames taken continuously while moving the field of view with the image frames taken later, and do not extract dissimilar parts, but do not extract the dissimilar parts of the field of view A common part image determination unit for determining a common part image in the backward direction of movement;
A background synthesizing unit for obtaining an image obtained by synthesizing the adjacent portion in the rear direction of the previously acquired image frame and the common part image;
An image reproducing apparatus comprising: A continuous image recording unit for recording image frames continuously acquired during continuous shooting;
A background synthesis unit for obtaining a background synthesized image obtained by synthesizing the common part image obtained at the time of continuous shooting;
A background image recording unit for recording the background composite image;
And recorded background composite image on the background image recording unit, by comparing the image frames recorded on the continuous image recording unit, synthesized by replacing successive similar image portion frame image of moving the moving object moves A display control unit for sequentially displaying the captured images;
An image reproducing apparatus comprising: During continuous shooting, determine the direction of the shooting field of view,
Compare the image frame captured earlier with the image frame captured later, do not extract the dissimilar part, determine the common part image behind the moving direction of the dissimilar part,
An image synthesizing method comprising: synthesizing a background of an image obtained by synthesizing the above-described adjacent portion in the rear direction of the previously captured image frame and the common portion image. Records image frames that are acquired continuously during continuous shooting,
Combine and record the common part image obtained during the continuous shooting,
The recorded composite image is compared with the image frames recorded during the continuous shooting, and similar images are sequentially replaced with moving image frames that the moving body moves to sequentially display the combined images. A characteristic image composition method. Determining the direction in which the field of view is moving during continuous shooting;
Comparing the previously captured image frame and the later captured image frame, not extracting a dissimilar part, and determining a common part image behind the moving direction of the dissimilar part;
A background synthesis of an image obtained by synthesizing the adjacent portion in the rear direction of the image frame photographed first and the common portion image;
An image composition program characterized by comprising: A step of recording image frames acquired continuously during continuous shooting;
Synthesizing and recording the common part image obtained during the continuous shooting;
A display step of comparing the recorded composite image with the image frame recorded at the time of the continuous shooting, and sequentially replacing the similar image portion with a moving frame image of the moving body and sequentially displaying the combined image. When,
An image composition program characterized by comprising: