JP4701791B2 - Image processing apparatus and program - Google Patents

Description

The present invention relates to an image processing apparatus, an 及 Beauty program, an image processing apparatus which can easily create a moving image zoomed by extracting a portion of the moving image relates及 beauty program.

In recent years, digital cameras that can shoot not only still images but also moving images have become mainstream. As an example of such a digital camera, a space portion (a part of a frame) centered on the subject of interest is cut out from the temporal frame of interest of continuously captured moving image data, and the subject of interest of the extracted still image is made larger. A digital camera provided with an image processing device for obtaining an easy-to-view image is disclosed (see, for example, Patent Document 1).
JP 2004-178368 A

  However, the technique disclosed in Patent Document 1 acquires still images of the subject of interest from the captured moving images and combines them as divided photographs, and acquires and combines the moving images of the subject of interest. I can't.

The present invention has been made in consideration of the above, an image processing apparatus which can easily create a moving image zoomed by extracting a part of a moving image, aims to provide a 及 beauty program And

In order to achieve the above object, an image processing apparatus according to a first aspect of the present invention includes a specifying unit that specifies a moving direction and a moving amount for moving a frame surrounding a subject image specified in advance in a moving image; according to the movement direction and the movement amount designated by said designating means setting, to each of a plurality of frame images forming the moving image, a frame body setting means successively sets the frame body by the frame setting means An image enlarging unit that cuts out an image included in the frame and enlarges the image to the size of the frame image, and an image enlarged by the image enlarging unit are connected according to the order of the frame image from which the image is cut out. And a moving image creating means for creating a moving image centered on the subject image.

The image processing apparatus according to a second aspect of the present invention provides the moving image based on a distance between a measuring unit that measures a distance from a predetermined subject in a moving image and the subject measured by the measuring unit. Subject image detection means for detecting the subject image at substantially the same distance from each of a plurality of frame images constituting the image, and subject images detected by the subject image detection means for each of the plurality of frame images. A frame setting means for setting a frame surrounding the subject image, an image enlargement means for cutting out an image included in the frame set by the frame setting means and expanding the image to the size of the frame image, and the image A moving image that creates a moving image centered on the subject image by joining the images magnified by the magnifying means in accordance with the order of the frame images from which the images are cut out It includes a creating means, a.

  Furthermore, in the image processing apparatus, when the subject image detection unit detects a plurality of target object images that are candidates for the subject image, the target object is located closest to the frame set as the immediately preceding frame image. May be acquired as the subject image.

An image processing apparatus according to a third aspect of the present invention includes: a change part detection unit that detects a part that has changed from the immediately preceding frame image in each of a plurality of frame images constituting a moving image;
When a change is detected in each of the plurality of frame images by the change part detection unit, the detected part is temporarily set as a frame surrounding the subject image, and no change is detected. Is a frame temporary setting means for temporarily setting the immediately preceding frame as it is,
An average value calculating means for calculating an average value of center positions and sizes of the frame bodies of the plurality of frame images set by the frame temporary setting means; an average value calculated by the average value calculating means; and the frame body An intermediate value calculating means for calculating an intermediate value between the center position and size of the frame set by the temporary setting means, and an average value obtained by calculating the intermediate value calculated by the intermediate value calculating means by the average value calculating means A discriminating unit that discriminates whether or not the disc is more than a predetermined value, and if the discriminating unit discriminates that the disc is separated by a predetermined value or more, the frame body of the immediately previous or next frame is set to the frame body. If it is determined that the distance is not more than a predetermined value, the frame setting means for setting the frame temporarily set by the frame temporary setting means, and the frame set by the frame setting means Included images An image enlarging means for projecting and enlarging the frame image to the size of the frame image and an image enlarged by the image enlarging means are connected in accordance with the order of the frame images from which the image has been cut out, thereby centering the subject image. Moving image creation means for creating the moving image.

A program according to a fourth aspect of the present invention is designated by a designation procedure for designating a movement direction and a movement amount for moving a frame surrounding a predetermined subject image in a moving image to the computer, and the designation procedure. In accordance with the moving direction and moving amount, a frame setting procedure for setting the frame for each of a plurality of frame images constituting the moving image, and an image included in the frame set by the frame setting procedure An image enlargement procedure that cuts out and enlarges to the size of the frame image and an image enlarged by the image enlargement procedure are joined together according to the order of the frame images from which the image has been cut out, thereby focusing on the subject image. And a moving image creation procedure for creating a moving image.
According to a fifth aspect of the present invention, there is provided a program based on a measurement procedure for measuring a distance from a predetermined subject in a moving image and a distance from the subject measured by the measurement procedure. A subject image detection procedure for detecting the subject image at substantially the same distance from each of a plurality of frame images constituting the moving image; and a subject image detected by the subject image detection procedure for each of the plurality of frame images. A frame setting procedure for setting a frame surrounding the subject image, an image enlargement procedure for cutting out an image included in the frame set by the frame setting procedure and expanding the image to the size of the frame image, A moving image centered on the subject image by joining the images enlarged by the image enlargement procedure according to the order of the frame images from which the images were cut out To execute a moving image creation procedure of creating.
According to a sixth aspect of the present invention, there is provided a program for causing a computer to detect a changed portion detection procedure for detecting a portion changed from a previous frame image in each of a plurality of frame images constituting a moving image, and the plurality of frame images. If a change is detected by the change part detection procedure, the detected part is temporarily set as a frame surrounding the subject image, and if no change is detected, the immediately preceding frame is set. A temporary frame setting procedure for temporarily setting a body as a frame as it is, and an average value calculating procedure for calculating an average value of center positions and sizes of the frames of the plurality of frame images set by the temporary frame setting procedure; An intermediate value calculating procedure for calculating an intermediate value between the average value calculated by the average value calculating procedure and the center position and size of the frame set by the frame temporary setting procedure; and the intermediate value A determination procedure for determining whether or not the intermediate value calculated by the output procedure is more than a predetermined value away from the average value calculated by the average calculation procedure, and a determination that the intermediate value is more than a predetermined value by the determination procedure If it is determined that the frame of the immediately preceding or subsequent frame is set as the frame, and it is determined that the frame is not separated by a predetermined value or more, the frame temporarily set by the frame temporary setting procedure is set. A frame setting procedure to be set, an image enlargement procedure for cutting out an image included in the frame set by the frame setting procedure and enlarging it to the size of the frame image, and an image enlarged by the image enlargement procedure And a moving image creation procedure for creating a moving image centered on the subject image by connecting the images according to the order of the cut-out frame images.

According to the present invention, an image processing apparatus which can easily create a moving image zoomed by extracting a portion of the moving image, it is possible to provide a 及 beauty program.

Hereinafter, the best mode for carrying out the present invention will be described in detail.
[Embodiment 1]

  First, a specific configuration of the digital camera according to Embodiment 1 of the present invention will be described.

  FIG. 1 is a block diagram illustrating a configuration example of a digital camera according to the present embodiment. As shown in FIG. 1, the digital camera 1 includes a lens optical system 2, an image sensor 3, an A / D (Analog / Digital) converter 4, an image processing unit 5, and a DRAM (Dynamic Random Access Memory) 6. A CODEC (Coder Decoder) 7, a display unit 8, a VRAM (Video Random Access Memory) 9, a control unit 10, a lens driving motor unit 11, an operation unit 12, and a flash memory 13. ing.

  The lens optical system 2 includes an imaging lens, a focus lens that performs focusing (focusing), a diaphragm mechanism that adjusts the amount of light of a subject image incident on the imaging element 3, and the like. An optical image (subject image) of the subject condensed through the lens optical system 2 is formed on the image sensor 3.

  The imaging device 3 is composed of, for example, a CCD (Charge Coupled Device) or the like, and converts a subject image formed through the lens optical system 2 into a charge having a magnitude corresponding to the brightness (photoelectric conversion). And accumulate. The image pickup device 3 is scanned and driven by a timing generator (not shown) or a V (Vertical) driver, and outputs the accumulated charges as an image pickup signal (analog signal).

  The image pickup signal output from the image pickup device 3 is subjected to A / D conversion after noise is removed by a double correlation sampling (CDS) circuit (not shown), amplified by an AGC (Automatic Gain Control) amplifier (not shown). The digital image pickup signal is converted by the device 4.

  The image processing unit 5 includes a color process circuit, a DMA (Direct Memory Access) controller, and the like. The image processing unit 5 is a color process circuit, and performs color process processing on the digital imaging signal supplied from the A / D converter 4 to generate YUV data. Then, the image processing unit 5 DMA-transfers the YUV data generated by the color process circuit to the DRAM 6 as a YUV signal using the DMA controller.

  The DRAM 6 is used as a work memory when the CODEC 7 compresses and decompresses YUV data.

  The CODEC 7 compresses the YUV data DMA-transferred to the DRAM 6 to generate compressed data of still images and moving images, or decompresses the compressed still image and moving image data read out from the flash memory 13 and stores them on the DRAM 6. Or YUV data is reproduced.

  In this embodiment, still image compression and decompression are performed by the JPEG (Joint Photographic Experts Group) method, and moving image compression and decompression are performed by the MPEG (Moving Picture Experts Group) method.

  The display unit 8 is configured by, for example, a liquid crystal display (LCD) or the like, and displays a through image, a captured image, a reproduced image, and the like based on a video signal supplied from the control unit 10. It is.

  The VRAM 9 is used as a work memory when displaying an image on the display unit 8.

  The control unit 10 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and the CPU appropriately executes various programs stored in the ROM or the like. Thus, the operation of each part of the digital camera 1 is controlled. The RAM is used as a work memory when the CPU executes a program.

  In the present embodiment, the control unit 10 writes the YUV data held in the DRAM 6 to the VRAM 9, periodically reads the YUV data from the VRAM 9, generates a video signal, and supplies this to the display unit 8. Thereby, a through image, a captured image, a reproduced image, and the like are displayed on the display unit 8.

  Further, the control unit 10 creates an image file by adding header information to the compressed data generated by the CODEC 7 and stores the image file in the flash memory 13.

  Further, the control unit 10 adjusts the position of the focus lens in a predetermined step unit by step driving the lens drive motor unit 11 based on the contrast value obtained from the YUV data, thereby focusing (focusing). I do.

  The lens drive motor unit 11 is composed of, for example, a stepping motor or the like, and moves the focus lens to the in-focus position by step driving in accordance with a step drive command or a motor forward / reverse rotation command supplied from the control unit 10. It is.

  The operation unit 12 includes various operation keys such as a power key, a release button, a mode switching key for switching between the through mode, the shooting mode, and the playback mode, and supplies a detection signal corresponding to the key operation to the control unit 10. To do.

  The flash memory 13 is composed of an SD (Secure Digital) memory card, for example, and stores an image file created by the control unit 10.

  Next, a moving image reconstruction process according to the first embodiment of the digital camera having the above configuration will be described.

FIG. 2 is a flowchart showing the contents of a moving image reconstruction process in which a part of a moving image is cut out from the flash memory 13 in which the captured moving image is stored to reconstruct a new moving image.
First, the control unit 10 causes the display unit 8 to display a screen in which a reference rectangular frame is added to the first image frame image among a plurality of frames constituting the moving image.

  Subsequently, as shown in FIG. 3A, a rectangular shape so that the subject image of interest fits within a reference rectangular frame that is added and displayed on the first displayed frame image displayed on the display unit 8. When the position and size of the frame are specified by the user (step S101), the control unit 10 is in a mode for fixing the size (size) of the reference rectangular frame, or a mode for scaling up or down. A rectangular frame scaling mode selection screen for selecting any of the rectangular frame scaling modes is displayed on the display unit 8.

  In response to this, when the user designates a mode for scaling the rectangular frame size, the control unit 10 sets a rectangular frame scaling mode flag provided in the RAM or the like (step S102). Then, the next image frame is acquired (step S103), the difference between the previous frame image and the next frame image is extracted as the target subject image, and the image portion corresponding to the difference is detected (step S104). .

  The control unit 10 temporarily sets and displays a rectangular frame in which the rectangular frame size has been enlarged or reduced so as to surround the image portion of the change detected in the detection process of step S104 described above (step S105). Then, whether or not to further change the rectangular frame size temporarily set in step S105 described above is determined based on whether or not the rectangular frame size scaling flag is set in the processing in step S102 described above (step S106). .

  When the user selects the rectangular frame size fixed mode in the processing of step S102 described above and the scaling mode flag is not set (step S106; No), the center is set at the same position as the temporarily set rectangular frame. And a rectangular frame having the same size as the previous rectangular frame is reset (step S107).

  On the other hand, when the rectangular frame size scaling mode for changing the rectangular frame size so that it fits in the target subject image is selected in the processing of step S102 described above (step S106; Yes), FIG. As shown in FIG. 2C, a rectangular frame having a size obtained by enlarging or reducing the size of the previous rectangular frame so as to fit the subject image of interest is reset (step S108 in FIG. 2).

  When the rectangular frame size scaling process in either step S107 or S108 is completed, an image in the rectangular frame region that has been reset so as to fit the subject image is acquired, and the acquired image is stored in an internal memory (not shown). (Step S109). When the image acquisition process in step S109 described above is performed, the control unit 10 confirms whether or not there is an image frame for which a rectangular frame has not been set (step S110). If there is still a frame for which the rectangular frame has not been set (step S110; Yes), the process returns to step S103, and the processes from step S103 to S109 are repeated until the determination process in step S109 becomes Yes.

On the other hand, when the rectangular frame is set for all image frames (step S110; No), the images in the rectangular frame cut out and stored by the image acquisition process of S109 are read out in the order of storage. A moving image is reconstructed by enlarging the image to a size and sequentially joining them along the time axis. Then, it is stored in the flash memory 13 as a new moving image file (step S111). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the first embodiment.

As described above, according to the moving image reconstruction process in the first embodiment, the image of the subject of interest moving in the rectangular frame size set in the moving image after shooting is gradually enlarged or reduced in one direction. You can perform sequential extraction of partial images within a rectangular frame and zoom up each extracted target subject image, so you can easily create new continuous video images that focus on the target subject image from continuously captured moving images Can be created.
[Embodiment 2]

  Next, Embodiment 2 of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

FIG. 5 is a flowchart showing the processing contents of the moving image reconstruction processing in the present embodiment.
First, the control unit 10 causes the display unit 8 to display an image of the first frame among a plurality of frames constituting the moving image.

  Subsequently, as shown in FIG. 6A, the position of the reference rectangular frame and the position of the reference rectangular frame so that the target object image fits within the reference rectangle added and displayed in the first frame image displayed on the display unit 8. When the size is designated by the user (step S201), the control unit 10 causes the display unit 8 to display a designation screen that allows the user to designate the moving direction and the moving amount of the rectangular frame for tracking the target subject image. .

  In response to this, when the user specifies the moving direction and moving amount of the rectangular frame (step S202), the control unit 10 displays the next image frame (step S203), and FIG. As shown in (c), the movement destination position of the rectangular frame is set according to the movement direction and the movement amount designated by the processing in step S202 described above (step S204). Then, an image portion corresponding to the rectangular frame at the set position is cut out, and is temporarily stored in an internal memory (not shown) following the image portion cut out immediately before (step S205).

  After the process of step S205, the control unit 10 checks whether there is still a frame for which a rectangular frame has not been set (step S206). If there is still a frame part for which the rectangular frame has not been set (step S206; Yes), the process returns to step S203, and the rectangular frame setting is continuously executed.

On the other hand, when the rectangular frame is set for all the frames (step S206; No), the image portion in the rectangular frame set to the movement position is cut out and enlarged to the normal size, and this is displayed on the time axis. To reconstruct a new moving image (step S20 7 ). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the second embodiment.

As described above, according to the moving image reconstruction process in the second embodiment, a rectangular frame for storing a subject image to be noticed that moves within a plurality of frames of a moving image after shooting is designated, and the subject image After specifying the movement direction, you can move the rectangular frame in the specified direction at regular time intervals, extract partial images continuously, and zoom up each extracted object image of interest, so you can shoot continuously captured moving images Therefore, it is possible to easily create a new continuous moving image with the focused subject image in focus.
[Embodiment 3]

  Next, a third embodiment of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

FIG. 8 is a flowchart showing the contents of a moving image reconstruction process for extracting a capture target designated at the start of shooting from a moving image and reconstructing a new moving image.
First, the control unit 10 displays an image captured by the image sensor 3 on the display unit 8 as a through image.

  Then, as shown in FIG. 9A, when the user designates the position of the subject image of interest to be captured before the start of shooting and recording (step S301), the control unit 10 The distance A is measured using a TTL metering method or the like, and is temporarily stored in a work memory provided in the RAM (step S302). A rectangular frame centered on the position of the subject image of interest designated in the processing of step S301 described above is provisionally set (step S303).

  Subsequently, the control unit 10 determines whether the rectangular frame provisionally set in the process of step S303 is within the image frame displayed on the display unit 8 (step S304). If it is determined that the rectangular frame is not within the frame (step S304; No), the rectangular frame is shifted to a position that fits within the frame (step S305). On the other hand, if it is determined that the rectangular frame is within the frame (step S304; Yes), the process proceeds to step S306.

  In step 306, the control unit 10 acquires the YUV data of the next frame of the moving image from the DRAM 6 temporarily stored, and the digital camera 1 and the subject are separated in the acquired frame. A position where the distance is equal to the distance A measured in the process of step S302 described above is detected (step S307).

  Here, if a plurality of positions where the distance between the digital camera 1 and the subject is equal to the distance A are detected in the process of step S307, the position within the current frame closest to the position of the immediately preceding rectangular frame is captured. Is extracted as the position of the subject (step S308). Then, as shown in FIGS. 9B and 9C, the control unit 10 provisionally sets a rectangular frame centered on the position of the subject acquired in the process of step S307 or S308 in FIG. Step S309).

  Subsequently, the control unit 10 determines whether or not all parts of the rectangular frame provisionally set in the process of step S309 are within the frame displayed on the display unit 8 (step S310). If all the parts of the rectangular frame do not fit within the frame according to the determination result (step S310; No), the rectangular frame is sequentially moved to a position that fits within the frame (step S311). On the other hand, when all the parts of the rectangular frame are within the frame (step S310; Yes), the process proceeds to step S312.

  When either of the processes in step S310 or S311 described above is completed, the control unit 10 cuts out the partial image in the rectangular frame and stores it in the work memory (not shown) following the partial image cut out immediately before. (Step S312). Each time a partial image is stored in the work memory, it is checked whether there is a next frame of the moving image (step S313). If the next frame of the moving image still exists (step S313; Yes), the process returns to step S306, and the processes of steps S306 to S312 are repeated until the final frame of the moving image.

On the other hand, when there is no next frame of the moving image, that is, when the partial image of the rectangular frame has been cut out until the final frame (step S313; No), the cut partial image within the set rectangular frame is stored. The moving image is reconstructed by sequentially reading from the work memory, expanding to the normal size, and connecting them along the time axis (step S314). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the third embodiment.

As described above, according to the moving image reconstruction process in the third embodiment, when the subject specified on the moving image before the start of shooting is at the same distance from the digital camera 1, the subject image is obtained from a plurality of subjects. Since a partial image within a predetermined rectangular frame can be sequentially cut out from a moving image and stored, and each stored partial image can be zoomed up, a new moving image focused on a specified subject can be easily created. be able to.
[Embodiment 4]

  Next, a fourth embodiment of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

11 and 12 are flowcharts showing the contents of the moving image reconstruction process in the present embodiment.
First, the control unit 10 displays an image captured by the image sensor 3 on the display unit 8 as a through image.

  Then, as shown in FIG. 13 (a), when the user designates the in-focus point and the size of the rectangular frame surrounding it before the start of shooting (step S401), the control unit 10 determines the next moving image. The YUV data of the frame is acquired from the DRAM 6 temporarily stored (step S402), and the acquired YUV data is compared with the YUV data of the immediately preceding frame, whereby the current frame and the immediately preceding frame are compared. A changed portion is detected (step S403).

  Then, it is determined whether or not a changed portion is detected at a location close to the rectangular frame set in the immediately preceding frame in the process of step S403 (step S404). If a changed portion is not detected at a location close to the rectangular frame set in the immediately preceding moving image frame (step S404; No), the position and focus of the rectangular frame are left as they are (step S405).

  On the other hand, when a changed portion is detected at a location close to the rectangular frame set in the immediately preceding moving image frame (step S404; Yes), as shown in FIGS. 13B and 13C, this changed portion is displayed. A rectangular frame is temporarily set so as to surround (step S406 in FIG. 11) and focused at the center or the closest location in the rectangular frame (step S407).

  After the process of step S405 or S407, the control unit 10 checks whether there is a next frame of the moving image (step S408). If there is still a next frame of the moving image (step S408; Yes), the process returns to step S402, and the rectangle setting is continued.

  On the other hand, if there is no next frame of the moving image (step S408; No), after shooting is finished (step S409), all rectangular frames from the initially set rectangular frame to a certain range are extracted (step S410). .

  Subsequently, the control unit 10 calculates an average value of the center position and size of the rectangular frame extracted in the process of step S410 (step S411), and provisionally determines the calculated average value and the process of step S406. An intermediate value between the position and size of the rectangular frame set in (2) is calculated (step S412).

  And the control part 10 discriminate | determines whether the intermediate value calculated by the process of step S412 has left | separated from the average value calculated by the process of step S411 more than fixed value (step S413), and fixed value When the distance is more than the above (step S413; Yes), the position and size of the rectangular frame immediately before or immediately after is adopted (step S414).

  On the other hand, if the intermediate value calculated in step S412 is within a certain range from the average value calculated in step S411 (step S413; No), the process proceeds to step S415.

  Then, as illustrated in FIGS. 14A to 14C, the control unit 10 determines the position and size of the rectangular frame formed based on the intermediate value calculated in the process of step S412 (step S415). Thereafter, the control unit 10 checks whether there is a next frame of the moving image (step S416). If there is still a next frame of the moving image based on the determination result (step S416; Yes), it is determined whether or not the next unprocessed rectangular frame group can be acquired (step S417).

  If these unprocessed rectangular frame groups can be acquired (step S417; Yes), the rectangular frame group is taken out from the DRAM 6 (step S418), and the process returns to step S411 to set the rectangular frame in step S416. Or it repeats until the process of S417 becomes No.

On the other hand, when there is no next frame (step S416; No), or when it is impossible to acquire an unprocessed rectangular frame group (step S417; No), a partial image within the set rectangular frame is cut out, and normal A moving image is reconstructed by enlarging the image to a size and connecting them along the time axis (step S419). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the fourth embodiment.

As described above, according to the moving image reconstruction process in the fourth embodiment, the moving subject is automatically focused on the moving subject, the subject image is extracted from the moving image, and a moving image obtained by zooming up the subject image can be easily obtained. Can be created.
[Embodiment 5]

  Next, a fifth embodiment of the present invention will be described. Note that the configuration of the digital camera of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

  FIG. 16 is a flowchart showing the contents of the moving image reconstruction process in the present embodiment. First, the control unit 10 acquires YUV data of the first frame from the DRAM 6 (step S501), and focuses the closest point in the frame (step S502). Subsequently, as shown in FIGS. 17A to 17C, the control unit 10 sets a rectangular frame having a predetermined size so that the in-focus position is as centered as possible (step S503).

  Thereafter, the control unit 10 checks whether or not there is a next frame of the moving image (step S504). If the next frame of the moving image still remains (step S504; Yes), after obtaining the YUV data of the next frame of the moving image from the DRAM 6 (step S505), the process returns to step S502, and step S504 is performed. Each process of S502 to S505, which is a rectangular frame setting process, is repeated until the determination process of “Yes” is Yes.

On the other hand, if there is no next frame of the moving image, that is, the last frame (step S504; No), the partial image within the set rectangular frame is cut out and enlarged to the normal size, and this is connected along the time axis. By matching, the moving image is reconstructed (step S506). As a result, the control unit 10 can create a moving image as shown in FIGS.
The above processing is the moving image reconstruction processing in the fifth embodiment.

  As described above, according to the moving image reconstruction process according to the fifth embodiment, a moving image obtained by automatically focusing on an adjacent subject, extracting the subject image from the moving image, and zooming up the subject image can be easily obtained. Can be created.

  In addition, this invention is not limited to the said embodiment, A various deformation | transformation and application are possible. Hereinafter, modifications of the above-described embodiment applicable to the present invention will be described.

  In the above embodiment, the image processing apparatus of the present invention is applied to a digital camera. However, the present invention is not limited to this, and may be applied to, for example, a mobile communication terminal having a camera function. .

  Moreover, in the said embodiment, the program which CPU of the control part 10 performs was previously memorize | stored in ROM etc. However, the present invention is not limited to this, and the program for executing the above-described processing may be applied to an existing mobile communication terminal so as to function as the digital camera 1 according to the above embodiment. Good.

  The method for providing such a program is arbitrary. For example, the program may be provided via a communication medium such as the Internet, or may be stored and distributed in a recording medium such as a memory card.

It is a block diagram which shows the structural example of a digital camera. 4 is a flowchart showing the contents of a moving image reconstruction process according to the first embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 1. FIG. It is a figure which illustrates the moving image produced in Embodiment 1. FIG. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the second embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 2. FIG. It is a figure which illustrates the moving image created in Embodiment 2. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the third embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 3. It is a figure which illustrates the moving image created in Embodiment 3. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the fourth embodiment. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the fourth embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 4. FIG. 10 is a diagram for explaining setting of a rectangular frame in a fourth embodiment. It is a figure which illustrates the moving image created in Embodiment 4. 10 is a flowchart illustrating the contents of a moving image reconstruction process according to the fifth embodiment. It is a figure which illustrates the rectangular frame set in Embodiment 5. It is a figure which illustrates the moving image created in Embodiment 5.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Digital camera, 2 ... Lens optical system, 3 ... Image sensor, 4 ... A / D converter, 5 ... Image processing part, 6 ... DRAM, 7 ... CODEC, 8 ... Display part, 9 ... VRAM, 10 ... Control 11, lens driving motor unit 12, operation unit 13, flash memory

Claims (7)

A designation means for designating a movement direction and a movement amount for moving a frame surrounding a subject image designated in advance in a moving image;
Frame body setting means for sequentially setting the frame body in each of a plurality of frame images constituting the moving image according to the movement direction and movement amount designated by the designation means;
Image enlarging means for cutting out an image included in the frame set by the frame setting means and enlarging it to the size of the frame image;
A moving image creating means for creating a moving image centered on the subject image by joining the images magnified by the image enlarging means in accordance with the order of frame images from which the images were cut out;
An image processing apparatus comprising: A measuring means for measuring a distance from a predetermined subject in the moving image;
Subject image detection means for detecting the subject image at substantially the same distance from each of a plurality of frame images constituting the moving image based on the distance to the subject measured by the measurement means;
Frame setting means for setting a frame surrounding the subject image in the subject image detected by the subject image detection means for each of the plurality of frame images;
Image enlarging means for cutting out an image included in the frame set by the frame setting means and enlarging it to the size of the frame image;
A moving image creating means for creating a moving image centered on the subject image by joining the images magnified by the image enlarging means in accordance with the order of frame images from which the images were cut out;
An image processing apparatus comprising: The subject image detection means includes
When a plurality of target object images that are candidates for the subject image are detected, an image of the target object that is closest to the frame set in the immediately preceding frame image is acquired as the subject image.
The image processing apparatus according to claim 2. In each of the plurality of frame images constituting the moving image, a changed part detecting means for detecting a changed part from the immediately preceding frame image;
When a change is detected in each of the plurality of frame images by the change part detection unit, the detected part is temporarily set as a frame surrounding the subject image, and no change is detected. Is a frame temporary setting means for temporarily setting the immediately preceding frame as it is,
Average value calculating means for calculating an average value of center positions and sizes of the frame bodies of the plurality of frame images set by the frame temporary setting means;
Intermediate value calculating means for calculating an intermediate value between the average value calculated by the average value calculating means and the center position and size of the frame set by the frame temporary setting means;
Determining means for determining whether or not the intermediate value calculated by the intermediate value calculating means is a predetermined value or more away from the average value calculated by the average value calculating means;
If it is determined by the determining means that the frame is separated by a predetermined value or more, the frame of the immediately preceding or immediately following frame is set to the frame, and if it is determined that the frame is not separated by a predetermined value or more, Frame body setting means for setting the frame temporarily set by the frame temporary setting means;
Image enlarging means for cutting out an image included in the frame set by the frame setting means and enlarging it to the size of the frame image;
A moving image creating means for creating a moving image centered on the subject image by joining the images magnified by the image enlarging means in accordance with the order of frame images from which the images were cut out;
An image processing apparatus comprising: On the computer,
A designation procedure for designating a moving direction and a moving amount for moving a frame surrounding a pre-designated subject image in a moving image;
A frame setting procedure for setting the frame to each of a plurality of frame images constituting the moving image according to the moving direction and moving amount specified by the specifying procedure;
An image enlargement procedure for cutting out an image included in the frame set by the frame setting procedure and enlarging it to the size of the frame image;
A moving image creating procedure for creating a moving image centered on the subject image by joining the images enlarged by the image enlarging procedure in accordance with the order of the frame images from which the images were cut;
A program for running On the computer,
A measurement procedure for measuring a distance from a predetermined subject in a moving image;
A subject image detection procedure for detecting the subject image at substantially the same distance from each of a plurality of frame images constituting the moving image based on a distance from the subject measured by the measurement procedure;
A frame setting procedure for setting a frame surrounding the subject image in the subject image detected by the subject image detection procedure for each of the plurality of frame images;
An image enlargement procedure for cutting out an image included in the frame set by the frame setting procedure and enlarging it to the size of the frame image;
A moving image creating procedure for creating a moving image centered on the subject image by joining the images enlarged by the image enlarging procedure in accordance with the order of the frame images from which the images were cut;
A program for running On the computer,
In each of a plurality of frame images constituting a moving image, a changed part detection procedure for detecting a changed part from the immediately preceding frame image;
When a change is detected in each of the plurality of frame images by the change part detection procedure, the detected part is provisionally set as a frame surrounding the subject image, and no change is detected. Is a temporary frame setting procedure for temporarily setting the previous frame as it is,
An average value calculating procedure for calculating an average value of center positions and sizes of the frame bodies of the plurality of frame images set by the frame temporary setting procedure;
An intermediate value calculating procedure for calculating an intermediate value between the average value calculated by the average value calculating procedure and the center position and size of the frame set by the frame temporary setting procedure;
A determination procedure for determining whether or not the intermediate value calculated by the intermediate value calculation procedure is a predetermined value or more away from the average value calculated by the average value calculation procedure;
If it is determined by the determination procedure that the frame is separated by a predetermined value or more, the frame of the immediately preceding or immediately following frame is set to the frame, and if it is determined that the frame is not separated by a predetermined value or more, A frame setting procedure for setting a frame temporarily set by the frame temporary setting procedure;
An image enlargement procedure for cutting out an image included in the frame set by the frame setting procedure and enlarging it to the size of the frame image;
A moving image creating procedure for creating a moving image centered on the subject image by joining the images enlarged by the image enlarging procedure in accordance with the order of the frame images from which the images were cut;
A program for running

Images