JP2014168147A - Image processing program and digital camera - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately express the movement of an object that moves in a panoramic still image.SOLUTION: An image processing program allows a computer to perform: input processing for inputting a plurality of images obtained by photographing a target moving body in time series by changing a photographing direction; moving body identification processing for identifying the moving body in the inputted image; panoramic background image generation processing for synthesizing the plurality of images different in photographing time so that positions of feature points in a background region except for the moving body are adjusted based on the inputted image and generating a panoramic background image in a range wider than the photographing range of the individual images; and image data generation processing for generating image data which is to be reproduced and displayed on a display device so that a region of the moving body moves on the panoramic background image.

Description

  The present invention relates to an image processing program and a digital camera.

  A technique for expressing only a part of motion in a still image is known (see Patent Document 1). This technology expresses a heterogeneous world where time is progressing only in some areas in a still-timed world of still images in which noise does not change over time or things that should move originally do not move It has attracted attention recently.

JP 2010-212781 A

  The prior art is applied to an object that moves periodically in a part of the screen, and there is a problem that it is difficult to apply the object when the object moves in the screen.

  An image processing program according to the present invention inputs an input process for inputting a plurality of images obtained by photographing a moving object of interest in time series while changing a shooting direction, a moving object identification process for identifying a moving object in the input image, and an input process A panoramic background image generation process for generating a panoramic background image in a wider range than the shooting range of each image by combining a plurality of images with different shooting times so as to align the position of the background area other than the moving body based on the image, An image data generation process for generating image data to be reproduced and displayed on a display device so that a region of a moving object moves on a panoramic background image is executed by a computer.

  ADVANTAGE OF THE INVENTION According to this invention, the motion of the target object which moves in a panoramic image can be expressed appropriately.

It is a block diagram which illustrates the composition of the digital camera by one embodiment of the invention. It is a figure explaining the acquisition timing of the image in "pre-shooting photography mode". It is a figure explaining the production | generation of a panoramic image. It is a figure explaining the moving body area | region in nine frame images. It is a figure explaining the synthesis | combination of the moving body area | region to the panorama background image. It is a flowchart explaining the flow of the process which CPU performs. It is a figure which illustrates a computer.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating the configuration of a digital camera 1 according to an embodiment of the invention. For example, the digital camera 1 generates a panoramic still image having a wider range than individual still images based on a plurality of frames of still images acquired while moving the shooting range, such as panning shooting, and For example, “motion expression” is performed in which an object moving in the longitudinal direction is dynamically moved and expressed. In the following description, as an example, a panoramic still image is generated based on a plurality of frames of still images acquired while changing the shooting direction in the horizontal direction, and the panoramic still image is moved in the longitudinal direction. An example of performing “motion expression” in which an object to be moved is dynamically expressed will be described.

  Details of the digital camera 1 will be described below. In FIG. 1, the photographic lens 11 forms a subject image on the imaging surface of the imaging element 12. 1 illustrates the digital camera 1 in which the photographing lens 11 is formed integrally with the camera (the photographing lens cannot be attached / detached), but the camera includes a camera body and an interchangeable lens that can be attached to and detached from the camera body. You may comprise by a system. In that case, the configuration consisting of reference numerals 11 and 21 in FIG. 1 is included on the interchangeable lens side, and the configuration consisting of other reference numerals is included on the camera body side.

  When the half-press switch 20a is turned on in conjunction with a half-press operation of a shutter button (not shown), the CPU 16 performs an AE (automatic exposure) calculation and an autofocus (AF) process to form a focusing lens (a focusing lens constituting the photographing lens 11). (Not shown) is moved forward and backward in the optical axis direction (arrow direction in FIG. 1). Thereby, the focal position of the photographic lens 11 is automatically adjusted. The driving of the focusing lens (not shown) is performed by the lens driving unit 21 that receives an instruction from the CPU 16.

  The image sensor 12 is configured by a CMOS image sensor or the like. The image sensor 12 captures a subject image formed on the imaging surface. The image signal output from the image sensor 12 is converted from an analog signal to a digital signal by the A / D converter 13. The image processing unit 14 performs predetermined image processing on the digital image signal.

  The liquid crystal monitor 15 displays an image captured by the image sensor 12 and an image stored in a buffer memory 18 or a memory card 50 described later, and displays an image, an icon, an operation menu, and the like according to an instruction from the CPU 16. indicate. A touch operation member 15 a is laminated on the display surface of the liquid crystal monitor 15. The touch operation member 15a sends a signal indicating the touch position on the display screen to the CPU 16.

  The flash memory 17 stores programs executed by the CPU 16 and data necessary for execution processing. The contents of the program and data stored in the flash memory 17 can be added and changed by an instruction from the CPU 16.

  The CPU 16 executes a control program using the buffer memory 18 as a work area, for example, and performs various controls on each part of the camera. The buffer memory 18 is also used when image data is temporarily stored. In the present embodiment, images of a plurality of frames (referred to as pre-taken images) acquired at a predetermined frame rate by the image sensor 12 before a shooting instruction (full pressing of the shutter button), or predetermined by the image sensor 12 after a shooting instruction. It is also used for temporarily storing images of a plurality of frames (called “post-taken images”) acquired at the frame rate.

  In addition to the image processing on the digital image signal, the image processing unit 14 generates an image file (for example, an Exif file) in a predetermined format storing the image signal. The recording / reproducing unit 19 records (saves) the image file on the memory card 50 based on an instruction from the CPU 16 and reads out the image file recorded (saved) on the memory card 50.

  The memory card 50 is a recording medium that is detachably attached to a card slot (not shown). The CPU 16 reproduces and displays the captured image on the liquid crystal monitor 15 based on the image file read from the memory card 50 by the recording / reproducing unit 19 or the image data stored in the post-capture buffer memory 18.

  The operation member 20 includes the half-press switch 20a, a full-press switch 20b that is turned on in response to a full-press operation of the shutter button, a mode switching switch, and the like, and sends an operation signal associated with the operation of each member to the CPU 16.

  The ON signal (half-press operation signal) from the half-press switch 20a is output when the shutter button is pressed down to about half of the normal stroke, and the output is canceled when the half-stroke press operation is canceled. The ON signal (full push operation signal) from the full push switch 20b is output when the shutter button is pushed down to the normal stroke, and the output is released when the push operation of the normal stroke is released.

<Shooting mode>
The digital camera 1 has a “normal shooting mode” and a “first shooting mode”. The “normal shooting mode” is a shooting mode in which a shot image is acquired frame by frame in response to the full-press operation signal and recorded in the memory card 50. In “pre-shooting shooting mode”, a still image is acquired at a predetermined frame rate (for example, 120 frames per second), and when the full-press operation signal is received, a plurality of frames acquired before and after the full-press operation signal is received. This is a shooting mode in which a predetermined image among images (the above-mentioned pre-taken image and post-taken image) is recorded on the memory card 50. Each photographing mode is configured to be switchable according to an operation signal from the operation member 20 or the touch operation member 15a.

<Playback mode>
The digital camera 1 in the reproduction mode reproduces and displays the image recorded in the “normal photographing mode” or the “pre-shooting photographing mode” on the liquid crystal monitor 15 for each frame or every predetermined number of frames. In the case of “motion expression”, the liquid crystal is expressed so as to express the movement of the object moving in the longitudinal direction in the panoramic still image based on the images of the plurality of frames acquired in the “pre-shooting shooting mode”. Reproduction display is performed on the monitor 15.

<Motion expression>
Since the present embodiment has a feature in the “motion expression” process, the following description will be focused on this point. ON / OFF of the “motion expression” process is configured to be switchable according to an operation signal from the operation member 20 or the touch operation member 15a.

-Acquisition of multiple frame images-
The user follows a subject (aircraft in this example) moving in the horizontal direction while panning the digital camera 1, for example, and acquires a plurality of frames of images by panning shooting in accordance with movement of the subject. FIG. 2 is a diagram for explaining image acquisition timing in the “pre-shooting shooting mode”. In FIG. 2, when the “pre-shooting shooting mode” is activated at time t0, the CPU 16 starts a release standby process. In the release standby process, the subject image is captured at the predetermined frame rate, exposure calculation and focus adjustment are performed, and the acquired image data is sequentially stored in the buffer memory 18.

  In the “pre-shooting shooting mode”, a sufficient memory capacity of the buffer memory 18 used for storing the pre-shooting image and the post-shooting image is secured in advance. When the number of frame images stored in the buffer memory 18 after time t0 reaches a predetermined number (for example, A), the CPU 16 overwrites and erases the oldest frame images in order. Thereby, the memory capacity of the buffer memory 18 used for storing the pre-taken image and the post-taken image in the “pre-photographing shooting mode” can be limited.

  When a full press operation signal is input at time t1, the CPU 16 starts the release process. In the release process, (A + B) frame images obtained by combining A frame images pre-taken before time t1 and B frame images taken after time t1 are recorded on the memory card 50. An image. A black band in FIG. 2 represents a section in which (A + B) frame images that are recording candidate images are acquired. The hatched band represents a section in which a frame image that has been temporarily stored in the buffer memory 18 but has been overwritten and erased is acquired.

-Generate a wide range of background images-
The CPU 16 generates a panoramic background still image having a wider range than the imaging range of one frame, based on a plurality of frames of images stored in the buffer memory 18. Specifically, among the (A + B) frame images, a predetermined image (for example, the first frame f1 out of the A frames taken in advance, the frame f (A + 1) acquired in response to the full press operation (time t1)) Thereafter, the last frame f (A + B)) is selected from the B frames taken later, and a background still image is generated based on these three frames. Note that the frame f1 and the frame f (A + 1), and the frame f (A + 1) and the frame f (A + B) are selected so as to have overlapping regions.

  The CPU 16 aligns the frame images arranged in time series in the background area excluding the moving object of each frame, and then obtains a difference between adjacent frames, thereby moving the moving object (the book in the frame image). In the example, aircraft) is extracted. Specifically, the region of the moving object can be extracted by taking a logical product between the difference images binarized with a predetermined threshold that are temporally adjacent. If the area of the moving object can be specified in the predetermined frame in this way, the area of the moving object can be specified in each frame where the above difference calculation is performed. Here, a region where a difference greater than or equal to a predetermined value between frames corresponds to an object, and a region where the difference between frames is less than a predetermined value corresponds to a non-object (background in this example).

  FIG. 3 is a diagram for explaining generation of a panoramic background still image. The CPU 16 extracts each moving body region from the frame f1, the frame f (A + 1), and the frame f (A + B) by, for example, a pattern matching method. In each frame image of FIG. 3, areas m1, m (A + 1), and m (A + B) surrounded by broken lines represent the respective moving object areas. The moving body area is preferably an area configured only by a moving object not including a background, but may be configured as a rectangular area including a moving object and a part of the background. The CPU 16 further extracts two or more feature points in the non-moving object region (background region) obtained by excluding the moving object regions from the frame f1, the frame f (A + 1), and the frame f (A + B). In FIG. 3, a plurality of black dots represent feature points. Extraction of feature points suitable for alignment between images is disclosed in, for example, Lowe, David G. (1999). 1362011142865_0.790410. Proceedings of the International Conference on Computer Vision. Any known technique can be used.

  The CPU 16 associates feature points between the frame f1 and the frame f (A + 1) and between the frame f (A + 1) and the frame f (A + B), and the frame f1 so as to match the positions of the associated feature points. Then, the frame f (A + 1) and the frame f (A + B) are combined to generate an image (panoramic background still image) P wider than the shooting range of one frame. Here, the data of the area of the moving object in the synthesized still image generated by the synthesis process of the frame f1, the frame f (A + 1), and the frame f (A + B) is a background image from other frames whose background is the background. Extract and replace data. For example, the image data of the area m1 that is the area of the moving object in FIG. 3 is the moving object of the frame f1 in the frame f (A + 1), the frame f (A + B), or other frames other than the frame f1. This is replaced with the image data of the background area corresponding to the area m1. Similarly, m (A + 1) which is the area of the moving object in frame f (A + 1) and m (A + B) which is the area of the moving object in frame f (A + B) in FIG. It can be replaced with image data of a background area corresponding to m (A + 1) and m (A + B) in a frame other than f (A + 1) and frame f (A + B). In the above configuration, the image data of the region of the moving object in the predetermined frame is replaced with the image data of the background region of another frame. Such processing includes, for example, providing a plurality of feature points in the background region of the frame f1, obtaining the positional relationship between each feature point and the moving object region m1, and then positioning the feature points with the plurality of feature points in the background region. A background region whose relationship is the same as the positional relationship between the feature point of the background region in the frame f1 and the moving object region m1 is obtained in another frame, and the image data of the background region in the other frame is obtained from the frame f1. This can be realized by replacing the image data of the moving object area.

  The panorama background image P may be synthesized by superimposing (A + B) all frame images arranged in time series, but as in this example, the minimum overlap allowance for matching two or more feature points ( By ensuring the overlapping area) and reducing the number of frames used for the synthesis, the panoramic background still image can be generated more quickly than when all the frame images are synthesized into one.

―Combine moving object area with background image―
The CPU 16 selects a predetermined image (for example, the frame f1, the 10th frame f10, the 20th frame f20,..., The 80th frame f80 from the (A + B) frame images, and these 9 frames. Based on the above, nine images for expressing motion are synthesized, and the frame f80 is the last frame, and corresponds to the above f (A + B).

  Specifically, moving object regions (moving object regions) are extracted from the nine frame images arranged in time series by the pattern matching method. Among these, since the frames f1 and f80 (= f (A + B)) have already been extracted, the existing information is used. As described above, the moving object region in each frame may be extracted by a logical operation of the frame difference image.

  FIG. 4 is a diagram for explaining moving object regions in nine frame images. In each frame image of FIG. 4, areas m1, m10, m20,..., M80 surrounded by broken lines represent moving object areas. The CPU 16 further calculates moving object (moving object) position information indicating the relative positional relationship between the moving object area and the non-moving object area (background area) in each frame image. Thereby, the temporal change of the moving object position information is obtained.

  Specifically, in each frame image, feature points are extracted in the moving object region and the non-moving object region, respectively. A plurality of black dots in each frame image in FIG. 4 represents a feature point. Since extraction of feature points suitable for calculating relative position information between distant regions is well known, description thereof will be omitted.

  FIG. 5 is a diagram for explaining the synthesis of the moving object region to the panoramic background image P. The CPU 16 sequentially synthesizes the moving object areas m1, m10, m20,..., M80 of each frame image into corresponding positions in the panorama background image P. Specifically, first, feature points respectively corresponding to the feature points extracted in each frame image of FIG.

  The CPU 16 associates feature points between the moving object area m1 and the panorama background image P, and aligns the moving object area m1 with respect to the panorama background image P based on the moving object position information obtained from the frame f1 in FIG. To synthesize the moving object region m1.

  Next, the CPU 16 associates feature points between the moving object region m2 and the panoramic background image P, and based on the moving object position information obtained from the frame f10 in FIG. To align the moving object region m10.

  Thereafter, similarly, up to the moving object region m80 of the frame f80 in FIG. As a result, nine panoramic images are obtained by combining the moving object regions m1, m10,..., M80 at different positions based on temporal changes in the moving object position information.

  The CPU 16 records the nine panoramic images on the memory card 50. Note that the first recording method for recording nine panoramic images as they are, the first panoramic image, and difference information representing an area (moving object region) different from the first panoramic image are used as the second and subsequent image information. The second recording method for recording as the second recording method can be switched in accordance with an operation signal from the operation member 20 or the touch operation member 15a. In the present embodiment, it is assumed that the first recording method is selected.

  FIG. 6 is a flowchart for explaining the flow of processing executed by the CPU 16 during the above-described “motion expression”. The CPU 16 activates the process shown in FIG. 6 when the “pre-shooting shooting mode” is set and the “motion expression” process is turned on. In step S1 of FIG. 6, the CPU 16 starts acquiring a pre-taken image (that is, a release standby process), and proceeds to step S2. As a result, the pre-taken frame image is accumulated in the buffer memory 18 and is sequentially displayed on the liquid crystal monitor 15.

  In step S2, the CPU 16 performs AE (automatic exposure) calculation and AF (automatic focus adjustment) processing based on the pre-captured image data, and proceeds to step S3. In step S3, the CPU 16 determines whether or not the release button has been fully pressed. The CPU 16 makes an affirmative decision in step S3 when an on signal from the full push switch 20b is input, and proceeds to step S4. If an on signal from the full push switch 20b is not inputted, the CPU 16 makes a negative decision in step S3. To return to step S2. When returning to step S2, the above-described processing is repeated.

  In step S4, the CPU 16 starts acquisition of a later shot image and proceeds to step S5. The post-taken images are one sheet acquired in response to the full press operation and (B-1) sheets acquired thereafter. In step S5, the CPU 16 extracts the object (aircraft in this example) in the frame image as described above, and proceeds to step S6.

  In step S6, the CPU 16 generates a panoramic background image having a wider range than the shooting range of one frame based on the plurality of frames of images stored in the buffer memory 18, and proceeds to step S7. In step S7, the CPU 16 extracts moving object regions (rectangular regions including a part of the object and the background) from the nine frame images arranged in time series, and proceeds to step S8.

  In step S8, the CPU 16 calculates moving body position information indicating the relative positional relationship between the moving body area and the non-moving body area in each of the nine frame images, and proceeds to step S9. In step S9, the CPU 16 aligns each moving object region with the panorama background image P based on the respective moving object position information obtained from each frame image, and synthesizes it. As a result, nine panoramic images obtained by synthesizing the moving object regions m1, m10,..., M80 at different positions are obtained.

  In step S10, the CPU 16 records nine panoramic images on the memory card 50 and proceeds to step S11. In step S11, the CPU 16 determines whether or not a reproduction instruction has been performed. When an operation signal instructing reproduction is input from the operation member 20 or the touch operation member 15a, the CPU 16 makes a positive determination in step S11 and proceeds to step S13. When the operation signal instructing reproduction is not input from the operation member 20 or the touch operation member 15a, the CPU 16 makes a negative determination in step S11 and proceeds to step S12.

  In step S12, the CPU 16 determines whether or not an end instruction has been issued. When an operation signal for turning off the “motion expression” process is input from the operation member 20 or the touch operation member 15a, the CPU 16 makes a positive determination in step S12 and ends the process of FIG. When the operation signal for turning off the “motion expression” process is not input from the operation member 20 or the touch operation member 15a, the CPU 16 makes a negative determination in step S12 and returns to step S1. When returning to step S1, the above-described processing is repeated.

  In step S <b> 13, the CPU 16 repeatedly performs moving image reproduction display based on the combined nine panoramic images. Specifically, the nine panoramic images are reproduced and displayed on the liquid crystal monitor 15 in order at a predetermined frame rate. In general, since the aspect ratio of the panoramic image is larger than the aspect ratio of the display area of the liquid crystal monitor 15, the top and bottom of the screen to be reproduced and displayed are displayed in black or blue, for example.

  Since the non-moving object area (background) of the nine panoramic images synthesized is common, the image of the area that does not change from the previous frame that has been reproduced and displayed is left as it is, and the image that is changed from the previous frame is newly reproduced and displayed. By doing so, reproduction and display can be performed so as to express the movement of the object (aircraft) moving in the longitudinal direction in the panoramic still image.

According to the embodiment described above, the following operational effects can be obtained.
(1) The CPU 16 inputs an input process for inputting a plurality of frame images obtained by shooting a moving body (aircraft) of interest while changing the shooting direction in time series, and an identification process for identifying the moving body (aircraft) in the input frame images. Based on (S5) and the input frame image, a plurality of frame images having different shooting times are synthesized so as to align the positions of the background regions other than the moving body (aircraft), and a wider range than the shooting range of the individual frame images. Panorama background image generation processing (S6) for generating the panorama background image P, and image data to be reproduced and displayed on the liquid crystal monitor 15 so that the moving object area (moving object area) moves on the panorama background image P is generated. Image data generation processing (S7-S9) is executed. Thereby, the movement of the moving body moving in the panoramic still image can be appropriately expressed.

(2) The panorama background image generation process (S6) of (1) above has a plurality of overlapping areas where the shooting ranges overlap each other, and each of the plurality of background areas included in the overlapping area has at least two feature points. Since the frame images are combined, the process of generating the panorama background image P can be performed more quickly than when combining a frame image having more feature points and the frame image. Further, the panorama background image P can be generated with a smaller number of frames than the number of frames used when generating the moving body region image that moves in the panorama background image P.

(3) The image data generation process described in (1) or (2) described above is based on temporal changes in the relative positional relationship between a moving body region (moving body region) obtained from an input frame image and a background region. Since the position of the area of the moving object on the panorama background image P is obtained based on (S7-S8), the movement of the moving object in the panorama still image can be appropriately expressed.

(4) The image data generation process of (3) above is based on a moving object area (moving object area) based on more images (9 frames) than the number of images (3 frames) used in the panoramic background image generation process (S6). ) And the temporal change in the relative positional relationship between the background region and the movement of the moving object can be expressed smoothly.

(5) In the image data generation processing described in the above (1) to (4), since the area including the moving body and a part of the background is the area of the moving body, for example, the moving body has a complicated outer shape. However, the burden of the generation process can be reduced by making the outer shape including a part of the background a simple rectangle.

(6) Since the processing described in the above (1) to (5) is executed by the CPU 16 of the digital camera 1, the CPU 16 of the digital camera 1 can smoothly express the movement of the moving moving body.

(7) Since the digital camera 1 described in (6) above includes a playback device that plays back and displays the image data generated by the image data generation processing, the liquid crystal monitor 15 of the digital camera 1 The movement of a moving object can be expressed appropriately.

(Modification 1)
In the above description, an example in which a panoramic image is obtained based on an image group of a plurality of frames arranged in time series acquired in the “pre-shooting shooting mode” has been described. However, a plurality of image groups are not necessarily in the “pre-shooting shooting mode”. It does not have to be a captured image group. For example, a panoramic image may be obtained based on a group of images of a plurality of frames arranged in time series obtained by continuous shooting while panning the camera.

(Modification 2)
The frame rate for acquiring a group of images of a plurality of frames may not be 120 frames per second as described above, but may be 30 frames per second or 5 frames per second. This frame rate may be appropriately set according to the moving speed of the moving subject (target object). It should be noted that so-called slow playback can be performed by lowering the frame rate at the time of playback display than the frame rate at the time of acquisition.

(Modification 3)
In the above-described embodiment, an example in which the panorama background image P is generated using three frames (frame f1, frame f (A + 1), frame f (A + B)) has been described. May be generated using a larger number of frame images. In order to generate a panoramic background image P that is wider than the shooting range of each frame image, at least two frames or more are required.

(Modification 4)
In the above-described embodiment, an example in which the number of images used for expressing motion is nine frames has been described. However, the number of images is not limited to the nine frames described above, and the number of images depends on the moving speed of the moving subject (target object). May be set as appropriate. If more images are used, the movement of the moving subject (object) can be expressed more smoothly.

(Modification 5)
In the above description, an example has been described in which an image group of a plurality of frames is acquired at a frame rate of 120 frames per second, and nine images used for expressing motion are obtained by thinning out the images. If the frame rate when acquiring an image group is lower than the moving speed of the moving object (object), the moving object (object) is used even if all the acquired image groups are used without being thinned out. ) Is not possible to express smoothly. In this case, interpolation is generated between the frames of the actually acquired image group (the moving object position is estimated based on the moving object position in the preceding and following frame images, and a frame image in which the moving object region is inserted into the estimated position is generated. ) Frame image may be inserted. Thereby, the movement of the moving subject (object) can be expressed smoothly.

(Modification 6)
In the above description, an example in which the digital camera 1 is used as an electronic device has been described. However, a multi-function mobile phone or a tablet computer may be used.

(Modification 7)
In the above-described embodiment, the example in which the “motion expression” process is performed by the digital camera 1 based on the image group of a plurality of frames arranged in time series has been described. However, the posterior can be performed using a personal computer, a tablet computer, or the like. An image processing apparatus that performs “motion expression” processing may be configured. In this case, an image group of a plurality of frames arranged in time series is stored as image data acquired by the digital camera 1.

  Then, by causing the computer device 200 shown in FIG. 7 to execute a program for performing the processing of the flowchart illustrated in FIG. 6 (steps S5 to S13), a subject (target object) that moves in the panoramic still image, for example, in the longitudinal direction. The image processing apparatus that expresses the movement of When the program is loaded into the personal computer 200 and used, the program is loaded into the data storage device of the personal computer 200 and then used as an image processing apparatus by executing the program.

  The loading of the program to the personal computer 200 may be performed by setting a storage medium 204 such as a CD-ROM storing the program in the personal computer 200, or to the personal computer 200 by a method via the communication line 201 such as a network. You may load. When passing through the communication line 201, the program is stored in the hard disk device 203 of the server (computer) 202 connected to the communication line 201. The program can be supplied as various forms of computer program products such as provision via the storage medium 204 or the communication line 201.

  The above description is merely an example, and is not limited to the configuration of the above embodiment.

DESCRIPTION OF SYMBOLS 1 ... Digital camera 12 ... Image pick-up element 14 ... Image processing part 15 ... Liquid crystal monitor 15a ... Touch operation member 16 ... CPU
17 ... Flash memory 18 ... Buffer memory 19 ... Recording / reproducing unit 20 ... Operation member 50 ... Memory card 200 ... Computer 204 ... Storage medium

Claims (7)

Input processing to input multiple images taken in time series of moving objects of interest while changing the shooting direction;
A moving body identifying process for identifying the moving body in the input image;
Based on the input image, a panoramic background image is generated by combining a plurality of images with different shooting times so as to align the positions of background regions other than the moving body and generating a panoramic background image having a wider range than the shooting range of each image. Generation process,
Image data generation processing for generating image data to be reproduced and displayed on a display device so that the region of the moving object moves on the panoramic background image;
An image processing program for causing a computer to execute. In the image processing program according to claim 1,
The panoramic background image generation processing includes overlapping regions in which shooting ranges overlap each other, and a plurality of images each having at least two feature points are synthesized in the background region included in the overlapping region. Image processing program. The image processing program according to claim 1 or 2,
The image data generation processing is based on temporal changes in the relative positional relationship between the area of the moving object and the background area, which are obtained from the plurality of input images, and the moving object on the panoramic background image. An image processing program for obtaining a position of an area. The image processing program according to claim 3.
The image data generation process determines a temporal change in the relative positional relationship between the area of the moving object and the background area based on more images than the number of images used in the panoramic background image generation process. An image processing program. In the image processing program according to any one of claims 1 to 4,
In the image data generation processing, an area including a part of the moving object and a background is set as an area of the moving object.   A digital camera comprising the image processing program according to any one of claims 1 to 5. The digital camera according to claim 6, wherein
A digital camera comprising a playback device that plays back and displays the image data generated by the image data generation processing.

Images