JP3678160B2 - Image processing apparatus, display apparatus, program, and storage medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing technique for generating a moving image having a video effect from a plurality of still images.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, moving image files having various video effects are created from still images taken with a digital camera or the like. Such an image file of a moving image is configured by connecting a plurality of still images each corresponding to one frame. Each of these still images has a relatively small difference in image data (symbols), and various video effects are expressed by being continuously displayed at predetermined time intervals. Become.
[0003]
[Problems to be solved by the invention]
By the way, as a video effect expressed by an image file of such a moving image, there is a demand for an in-focus position that gradually changes from a distant view to a close view or from a close view to a distant view. In order to generate a moving image file having such a video effect, a plurality of still images that have been photographed with respect to the same subject and whose focus position has changed relatively slightly are converted into a moving image file. It is necessary to prepare as many as the number of frames composing That is, still images at all the in-focus positions to be displayed are necessary.
[0004]
However, conventionally, in order to acquire the above-described plurality of still images, it has been necessary to perform imaging by changing the focal position of the imaging lens as many times as the number of frames required in a digital camera or the like that performs imaging.
[0005]
The present invention has been made in view of the above problems, and provides an image processing apparatus capable of creating an image file of a moving image having a video effect in which the focus position gradually changes from a small number of still images. For the purpose.
[0006]
[Means for Solving the Problems]
  In order to solve the above-mentioned problem, the invention according to claim 1 is the image processing apparatus, the first still image captured at the first focus position and the second focus position for the same subject. The second still image andAnd using a blur function that indicates the degree of blur caused by deviation from focus, In a third focusing position different from the first focusing position and the second focusing position.Should be obtained when shooting the subjectThe third still imageBy calculationFirst image generating means for generating;By activating the first image generation means while sequentially setting a plurality of in-focus positions as the third in-focus position, a plurality of third in which the degree of blur of the subject varies stepwise in order of frame numbers. A still image is generated, and a moving image is generated using the plurality of third still images.And second image generation means for generating.
[0007]
According to a second aspect of the present invention, in the image processing device according to the first aspect of the present invention, the image processing apparatus further includes an imaging unit that captures a still image, and the imaging unit responds to an operation of an operation button. An image and the second still image are taken continuously in time.
[0008]
  According to a third aspect of the present invention, in the image processing apparatus according to the first or second aspect of the present invention, the first image generation means is configured to store the third still image.Specify the degree of blur in the blur functionBlur parameter setting means for variably setting the parameters.
[0009]
  According to a fourth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects, the second image generating means includesVideoConfigurePaintingImage number setting means for variably setting the number of images is provided.
[0010]
  The invention according to claim 5 is the image processing apparatus according to any one of claims 1 to 4, wherein the second image generating means isVideoDisplay speed setting means for variably setting the display speed.
[0011]
  According to a sixth aspect of the present invention, in the display device, a first still image captured at the first focus position with respect to the same subject, and a second still image captured at the second focus position,And using a blur function that indicates the degree of blur caused by deviation from focus, In a third focusing position different from the first focusing position and the second focusing position.Should be obtained when shooting the subjectThe third still imageBy calculationImage generating means for generating;By activating the image generation means while sequentially setting a plurality of in-focus positions as the third in-focus position, a plurality of third still images in which the degree of blur of the subject varies stepwise in order of frame numbers. And generating a moving image using the plurality of third still images.Output means for outputting and displaying.
[0012]
The invention according to claim 7 is the display device according to claim 6, further comprising an imaging unit that captures a still image, wherein the imaging unit responds to an operation of an operation button. And the second still image is taken continuously in time.
[0013]
  The invention according to claim 8 is executed by a computer included in the image processing apparatus in the program,The computer uses a first still image taken at the first in-focus position for the same subject and a second still image taken at the second in-focus position, and is out of focus. Should be obtained when the subject is photographed at a third in-focus position different from the first in-focus position and the second in-focus position. A step of generating a third still image by calculation, and activating the first image generation means while sequentially setting a plurality of in-focus positions as the third in-focus position; Generating a plurality of third still images that differ stepwise in order of frame numbers, and generating a moving image using the plurality of third still images..
[0014]
The invention according to claim 9 is characterized in that the program according to claim 8 is recorded in a recording medium.
[0015]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0016]
<1. Still image shooting>
First, a digital camera that is an image processing apparatus including an imaging unit that captures a still image used for generating a moving image will be described.
[0017]
1-3 is a figure which shows the principal part structure of the digital camera 1, FIG. 1 is a top view, FIG. 2 is sectional drawing seen from the II-II position of FIG. 1, FIG. 3 is equivalent to a rear view. . These figures are not necessarily in accordance with the triangulation method, and are mainly intended to conceptually illustrate the main configuration of the digital camera 1.
[0018]
As shown in these drawings, the digital camera 1 has a structure roughly divided into a substantially rectangular parallelepiped camera body 2 and an imaging unit 3. A memory card 8 for recording a photographed image is detachably stored in the camera body 2. The digital camera 1 uses a power source battery E formed by connecting four AA batteries E1 to E4 in series as a drive source.
[0019]
The imaging unit 3 is provided with an imaging circuit 302 having a CCD color area sensor 303 at an appropriate position behind the lens group 30 with a macro function as a photographing lens. The lens group 30 includes a zoom lens 300 and a focusing lens 301.
[0020]
On the other hand, in the camera main body 2, the zoom position of the zoom lens 300 is changed and the focus position is changed by driving the zoom motor M <b> 1 for moving the lens between the accommodation position and the photographing position and the focusing lens 301. A focus motor M2 for performing the above is provided.
[0021]
A grip portion G is provided on the front surface of the camera body 2, and a pop-up built-in flash 5 is provided at an appropriate position on the upper end of the camera body 2. The flash 5 can be manually popped up and stored. A shutter button 9 is provided on the upper surface of the camera body 2.
[0022]
On the other hand, as shown in FIG. 3, a liquid crystal display (LCD) 10 capable of electronically displaying a live view display of a captured image and a recorded image, and an electronic viewfinder (EVF) 20 are provided on the back of the camera body 2. Is provided. The EVF 20 can display a captured image electronically via an eyepiece lens, and the LCD 10 can display the captured image electronically on a display screen larger than the EVF 20.
[0023]
A recording / playback mode setting button 14 for switching between “recording mode” and “playback mode” is provided on the back of the camera body 2. The recording mode is a mode in which a photograph is taken and a photographed image is recorded on the memory card 8, and the reproduction mode is a mode in which the photographed image recorded on the memory card 8 is reproduced and displayed on the LCD 10.
[0024]
A quadruple button 35 is provided on the right side of the back side of the digital camera 1. When the buttons L and R are pressed, the zoom motor M1 is driven to perform zooming, and in addition, the buttons U, D, L, and R are used. Perform various operations.
[0025]
Further, a cancel button 33, a confirmation button 32, a menu button 34 and an LCD button 31 are provided on the back of the camera body 2. The menu button 34 is for displaying a menu screen on the LCD 10. On this menu screen, a menu related to the functions of the digital camera 1 can be set by a user's operation input using the quad button 35 or the like. The cancel button 33 is a button for canceling the content selected on the menu screen, and the confirmation button 32 is a button for confirming the content selected on the menu screen. The LCD button 31 is a button for switching the LCD 10 display off and off.
[0026]
The user can select a shooting mode in the recording mode on the menu screen. The shooting mode of the digital camera 1 includes a normal shooting mode in which normal shooting is performed for each image, and a blur adjustment mode. In the blur adjustment mode, the focus position of the photographing lens is changed by one shutter operation, and the photographing operation is performed twice in succession, so that the photographed image focused on the foreground and the distant view are focused. In this mode, a captured image is acquired. A captured image captured in the blur adjustment mode is used to obtain a still image at an arbitrary in-focus position in an image processing apparatus described later.
[0027]
Next, the internal configuration of the digital camera 1 will be described. FIG. 5 is a schematic block diagram showing the internal configuration of the digital camera 1. In the figure, a CCD 303 converts an optical image of a subject formed by the lens group 30 into image signals of R (red), G (green), and B (blue) color components (pixel signals received by each pixel). Of the signal sequence) and output the result. The timing generator 314 generates various timing pulses for controlling the driving of the CCD 303.
[0028]
Exposure control in the imaging unit 3 is performed by adjusting the aperture of the lens group 30 by the aperture control driver 306 and the exposure amount of the CCD 303, that is, the charge accumulation time of the CCD 303 corresponding to the shutter speed. If the appropriate shutter speed cannot be set when the subject brightness is low, the inappropriate exposure due to insufficient exposure is corrected by adjusting the level of the image signal output from the CCD 303. That is, when the luminance is low, exposure control is performed by combining the shutter speed and gain adjustment. The level adjustment of the image signal is performed in the gain adjustment of the AGC circuit in the signal processing circuit 313.
[0029]
The timing generator 314 generates a drive control signal for the CCD 303 based on the reference clock transmitted from the timing control circuit 202. The timing generator 314 generates, for example, a clock signal such as a timing signal for integration start / end (exposure start / end), a read control signal (horizontal synchronization signal, vertical synchronization signal, transfer signal, etc.) of the light reception signal of each pixel, Output to the CCD 303.
[0030]
The signal processing circuit 313 performs predetermined analog signal processing on the image signal (analog signal) output from the CCD 303. The signal processing circuit 313 includes a CDS (correlated double sampling) circuit and an AGC (auto gain control) circuit. The CDS circuit reduces the noise of the image signal and adjusts the gain of the AGC circuit to thereby generate the image signal. Adjust the level.
[0031]
The light control circuit 304 controls the light emission amount of the built-in flash 5 in flash photography to a predetermined light emission amount set by the overall control unit 250. In flash photography, the reflected light of the flash light from the subject is received by the light control sensor at the same time as the exposure starts, and when the amount of received light reaches a predetermined light emission amount, a light emission stop signal is output from the light adjustment circuit 304. In response to the light emission stop signal, the light emission of the built-in flash 5 is forcibly stopped, whereby the light emission amount of the built-in flash 5 is controlled to a predetermined light emission amount.
[0032]
The A / D conversion circuit 205 converts each pixel signal of the image signal into a 10-bit digital signal. The A / D conversion circuit 205 converts each pixel signal (analog signal) into a 10-bit digital signal based on the A / D conversion clock input from the timing generation circuit.
[0033]
The timing generator 314 is provided with a timing control circuit 202 that generates a clock for the A / D conversion circuit 205. The timing control circuit 202 is controlled by a reference clock in the overall control unit 250.
[0034]
The black level correction circuit 206 corrects the black level of the A / D converted pixel signal to a reference black level. A WB (white balance) circuit 207 performs level conversion of pixel data of R, G, and B color components. The WB circuit 207 converts the level of the pixel data of each of the R, G, and B color components using the level conversion table input from the overall control unit 250. The parameters (characteristic gradients) of each color component in the level conversion table are set for each captured image by the overall control unit 250, either automatically or manually. The γ correction circuit 208 corrects the gradation of pixel data.
[0035]
The image memory 209 is a memory that temporarily stores image data for which signal processing has been completed. The image memory 209 has a capacity capable of storing image data for at least two frames. This is because in the blur adjustment mode, image data for two frames is captured by one shutter operation, and these are stored respectively. The storage capacity for one frame is a capacity capable of storing pixel data for 1600 × 1200 pixels corresponding to the number of pixels of the CCD 303.
[0036]
In the blur adjustment mode, the A / D converted image data is not subjected to predetermined processing by the black level correction circuit 206, WB circuit 207, and γ correction circuit 208 under the control of the overall control unit 250. Stored in the memory 209. That is, the image memory 209 stores two frames of image data in the CCD-RAW format that has only undergone A / D conversion. This is for the purpose of avoiding as much as possible processing that may cause a reduction in image quality because it is used for subsequent image processing (blur adjustment processing).
[0037]
The LCD VRAM 210 is a buffer memory for image data displayed on the LCD 10. The LCD VRAM 210 has a storage capacity for image data corresponding to the number of pixels 400 × 300 of the LCD 10. The EVFVRAM 220 is a buffer memory for image data displayed on the EVF 20. The EVFVRAM 220 has a storage capacity of image data corresponding to the number of pixels 640 × 480 of the EVF 20.
[0038]
Further, in the shooting standby state, after each pixel data of the image captured by the imaging unit 3 every 1/30 (seconds) is subjected to predetermined signal processing by the A / D conversion circuit 205 to the γ correction circuit 208. Are temporarily stored in the image memory 209, transferred to the LCD VRAM 210 and the EVF VRAM 220 via the overall control unit 250, and displayed on the LCD 10 and the EVF 20 (live view display).
[0039]
As a result, the user can visually recognize the subject image. In the reproduction mode, the image read from the memory card 8 is subjected to predetermined signal processing by the overall control unit 250, then transferred to the LCD VRAM 210, and reproduced and displayed on the LCD 10. A similar display is performed also in the EVF 20.
[0040]
The card I / F 212 is an interface for writing image data to the memory card 8 and reading image data. In addition, the communication I / F 224 is an interface compliant with, for example, the USB standard for externally connecting the personal computer 225 so as to allow communication. The control program recorded in the recording medium 226 such as the memory card 8 or the CD-ROM can be taken into the ROM 251 of the overall control unit 250 via the card I / F 212 and the communication I / F 224.
[0041]
The RTC 219 is a clock circuit for managing the shooting date and time. It is driven by another power source (not shown).
[0042]
The operation unit 211 includes various buttons and buttons such as the shutter button 9, the LCD button 31, and the confirmation button 32 described above.
[0043]
The shutter button 9 is a two-stage button capable of detecting a half-pressed state (S1) and a pressed-in state (S2) as used in a silver halide camera. When the shutter button 9 is set to the S1 state in the standby state, the lens driving for AF is started, and the overall control unit 250 evaluates the contrast of the image in the image memory 209, and the motor M1, The lens is driven and stopped by M2. By determining the level of the image data in the image memory in the S1 state, the shutter speed (SS) and aperture value are determined. Further, a white balance correction value is determined.
[0044]
The zoom control circuit 307 controls the driving of the zoom motor M1. The zoom motor M1 is driven based on the zoom control signal input from the overall control unit 250, and the zoom lens 300 is moved in the direction specified by the user. A focus control circuit 308 controls driving of the focus motor M2. The driving amount of the focus motor M2 is controlled based on the AF control signal input from the overall control unit 250, and the focusing lens 301 is set to the focal position.
[0045]
The overall control unit 250 is composed of a microcomputer and centrally controls the photographing function and the reproduction function. The overall control unit 250 includes a ROM 251 storing a control program for controlling driving of the above-described members of the digital camera 1 and processing acquired image data, and a work area for performing various arithmetic operations according to the control program. The RAM 252 is provided.
[0046]
In FIG. 4, an exposure setting unit 253, a display control unit 254, a recording control unit 255, a reproduction control unit 256, and a special photographing control unit 257 are arithmetically processed by the CPU of the overall control unit 250 according to a control program stored in the ROM 251. The function realized by this is expressed as a function block.
[0047]
The exposure setting unit 253 performs exposure control processing, determines the luminance of the subject using the image data of the G color component of the live view image, and determines the exposure control value (shutter speed (SS)) based on the determination result. And aperture value).
[0048]
The display control unit 254 performs image display processing, reads the image data temporarily stored in the image memory 209, adjusts the image size to the display destination image size as necessary, and transfers the image data to the VRAMs 210 and 220. To perform the operation.
[0049]
The recording control unit 255 performs a recording process. In the normal shooting mode, the recording control unit 255 reads the image data temporarily stored in the image memory 209 after the shooting instruction, reads the image data to the RAM 252, performs a predetermined compression process using the JPEG method such as two-dimensional DTC conversion and Huffman encoding, and records the data. Created as photographic image data for use. Also, a thumbnail image is created by reading out pixel data from the image memory 209 every 8 pixels in both the vertical and horizontal directions to the RAM 252. Further, tag information related to the photographed image data recorded accompanying these recording data is created. Then, the recording control unit 255 creates a still image file in which tag information is attached to the compressed high-resolution captured image data and thumbnail image, and records them in the memory card 8.
[0050]
On the other hand, in the blur adjustment mode, the recording control unit 255 does not perform compression processing on the image data temporarily stored in the image memory 209 (CCD-RAW format data that has only been A / D converted). The captured image data for recording is used as it is. This is because the compression processing by the JPEG method loses the information of the original image due to lossy compression, and the image quality after processing deteriorates. Thumbnail images and tag information are created in the same manner as in the normal shooting mode. Further, uncompressed CCD-RAW format shot image data and still image files with tag information attached to thumbnail images are created and recorded in the memory card 8. The In the blur adjustment mode, two pieces of photographed image data are generated, so that a still image file is created for each photographed image data and recorded in the memory card 8.
[0051]
FIG. 5 shows an example of the structure of a still image file stored in the memory card 8. In FIG. 5, “P000001.JPG”, “P000002.JPG”, and the like indicate still image file names. In the example of the figure, the still image file name is represented by “PL.M”, and “L” in “PL.M” is a 6-digit number indicating the order in which the still image files were created. “M” is an extension indicating the data format of the photographed image data. In “M”, “JPG” is photographed image data compressed and recorded in the JPEG format, and “RAW” is photographed image data recorded in the CCD-RAW format. The photographed image data photographed in the normal photographing mode has the extension “JPG”, and the photographed image data photographed in the blur adjustment mode has the extension “RAW”.
[0052]
“1b” and “2b” indicate the folder names of still image files shot in the blur adjustment mode. In the blur adjustment mode, since two still image files are created by one shutter operation, both still image files are collected in one folder and recorded on the memory card 8. In the example of FIG. 5, the folder name is represented by “Nb”, and “N” indicates a number indicating the shooting order in the blur adjustment mode. Therefore, “1b” indicates that the folder stores a combination of still image files first captured in the blur adjustment mode.
[0053]
FIG. 6 is a diagram illustrating a method of recording a still image file on the memory card 8. The top storage area of the memory card 8 is provided with an index area for storing folder information and information of still image files belonging to each folder, and each still image file is stored in the subsequent area in the order of shooting. . The storage area of each still image file in the memory card 8 is composed of three areas, and tag information, captured image data, and thumbnail images are stored in order from the top. As shown in the figure, the tag information includes information such as camera name, lens name, focal length at the time of photographing, F value at the time of photographing, photographing mode, focal position, file name, subject brightness, white balance adjustment value, and the like. It is. Here, the shooting mode indicates information indicating whether the shooting was performed in the normal shooting mode or the shooting was performed in the blur adjustment mode.
[0054]
The reproduction control unit 256 performs reproduction processing of the captured image recorded on the memory card 8 on the LCD 10. When the playback mode is set by the recording / playback mode setting button 14, the playback control unit 256 reads thumbnail images from each still image file recorded on the memory card 8 and sequentially stores them in the LCD VRAM 210 according to a predetermined index format. As a result, the thumbnail images are displayed as indexes on the LCD 10.
[0055]
When a thumbnail image of a frame to be reproduced is designated by the operation of the quadruple button 35 or the like with respect to the indexed thumbnail image, the reproduction control unit 256 reads captured image data from a still image file corresponding to the frame. . When the read frame is taken in the normal shooting mode, a predetermined expansion process is performed on the compressed shot image data, and the image memory 209 is stored. On the other hand, if the image was taken in the blur adjustment mode, the image data is stored in the image memory 209 as it is because the image is not compressed. The captured image data stored in the image memory 209 is transferred to the LCD VRAM 210 and displayed on the LCD 10 after the image size is adjusted by the display control unit 254.
[0056]
The special photographing control unit 257 controls driving of each member of the digital camera 1 when the photographing mode is set to the blur adjustment mode. When the shutter button 9 enters the S2 state, the special imaging control unit 257 captures two pieces of image data for blur adjustment so that the focus motor is driven to change the focal position, and the CCD 303 is exposed at predetermined intervals. Control is performed so that the operation is repeated twice. Further, the black level correction circuit 206, the WB circuit 207, and the γ correction circuit 208 are controlled not to perform predetermined processing.
[0057]
Next, the photographing operation in the blur adjustment mode of the digital camera 1 configured as described above will be described. FIG. 7 is a flowchart illustrating a procedure for capturing a still image in the blur adjustment mode.
[0058]
In step S11, when the shutter button 9 is half-pressed (S1 state), the digital camera 1 prepares for taking a still image. First, the aperture value of the aperture is set to an open aperture value (for example, F = 2.8) (step S12). Here, the reason why the aperture value is set to the full aperture value is to blur the subject other than the target distance to be focused by reducing the depth of field.
[0059]
Subsequently, the focus of the taking lens is controlled to be infinite. Further, the exposure time of the CCD 303 corresponding to the shutter speed is set, and a white balance adjustment value is set (step S13).
[0060]
In this state, when the shutter button 9 is fully pressed (state S2) in step S14, exposure is performed for the exposure time set by the CCD 303, and a still image of the subject is captured. After exposure, the image signal output from the CCD 303 is subjected to predetermined analog signal processing in the signal processing circuit 313, converted into 10-bit pixel data in the A / D conversion circuit 205, and is directly converted into an image in the CCD-RAW format. It is stored in the memory 209 (step S15). Since this still image was taken with the focus of the taking lens being infinite, the distant view such as the background is in focus and the close view is out of focus.
[0061]
Subsequently, the recording control unit 255 of the overall control unit 250 creates tag information and thumbnail images, and creates a still image file from these and image data in the CCD-RAW format stored in the image memory 209. Then, a folder for storing the captured image in the blur adjustment mode is created in the memory card 8, and the generated still image file is recorded in the folder (step S16). Information that is taken for the first time in the blur adjustment mode is added to the shooting mode of the tag information of the still image file, such as “blur adjustment mode 1/2”. Further, information of “infinity” is given to the focal position of the tag information.
[0062]
Next, the focus of the photographic lens is controlled so that a subject at a predetermined distance in the foreground, for example, 1 m away is in focus (step S17). Note that the exposure time and white balance adjustment value of the CCD 303 are not changed from when the first image was taken, but the settings are used as they are.
[0063]
Then, exposure is performed for the exposure time set by the CCD 303 to capture a still image of the subject. After exposure, as in the case of shooting the first image, predetermined processing is performed by the signal processing circuit 313 and the A / D conversion circuit 205 and stored in the image memory 209 (step S18). In this still image, since the focus of the taking lens is controlled 1 m ahead, the near view of a person or the like is almost in focus, and the distant view is out of focus.
[0064]
Subsequently, the recording control unit 255 of the overall control unit 250 creates tag information and thumbnail images, and creates a still image file from these and image data in the CCD-RAW format stored in the image memory 209. The generated still image file is recorded in the same folder in which the first still image file is stored (step S19). In the tag information shooting mode of the still image file, information that is taken for the second time in the blur adjustment mode is added, such as “bokeh adjustment mode 2/2”. Further, information “1 m” is given to the focus position of the tag information.
[0065]
In the present embodiment, a still image (distant view focused image) focused on the far view side is first photographed, and a still image (near view focused image) focused on the near view side is captured the second time. Although shooting is performed, the order of shooting may be reversed.
[0066]
<2. Defocus adjustment process>
Here, a still image (hereinafter referred to as “bokeh adjustment image”) at an arbitrary in-focus position is acquired using two still images captured by changing the focal position of the photographing lens as described above. The adjustment process will be briefly described. In this case, it is assumed that the technique shown in the Journal of the Institute of Image Information and Television Engineers Vol. 51, No. 12, pp. 2072 to 2081 “Generation of Arbitrarily Focused Image from Multiple Images Based on Iterative Method” is applied.
[0067]
FIG. 8 is a model diagram showing two still images used for the blur adjustment process. In this description, it is assumed that the blur adjustment image I is created using the two images Ir and If shown in FIG. FIG. 8A shows a foreground focused image Ir focused on a foreground, and FIG. 8B shows a distant focused image If focused on a far view. A circular shape represents a near-field subject, a hexagonal shape represents a distant subject, and a solid line represents a focused state and a wavy line represents a blurred state.
[0068]
The blur adjustment process is basically
(1) Positioning process between two still images Ir and If
(2) Creation of a blur adjustment image by image composition processing, which is predetermined calculation processing
It is performed in two steps. Each will be described below.
[0069]
  The alignment process aligns the positions of both still images in order to accurately synthesize the same pattern of the two still images to be used. This is the difference in shooting timing between the two still imagesInThis is because a slight positional difference occurs. This alignment process is performed in two stages, that is, an alignment process for the entire image and a local alignment process.
[0070]
In the alignment processing of the entire image, for example, the images Ir and If are compared while changing parameters such as an enlargement ratio, a parallel movement amount, and a rotation angle in the distant focused image If with reference to the foreground focused image Ir. Then, a combination of parameters in which both the images Ir and If are the best match is calculated. More specifically, the mean square value ΔU of the respective pixel level differences corresponding to both images is calculated, and using these sums ΣΔU as an index, an optimal enlargement ratio and parallel movement amount are set so that the sum ΣΔU is minimized. And a combination of parameters such as a rotation angle. Note that since the focus position at the time of shooting differs between the foreground in-focus image Ir and the foreground in-focus image If, an error may occur when the images Ir and If are directly compared. For this reason, in order to obtain the optimum combination of parameters, the calculation is performed using a hierarchical matching method. When the distant view focused image If is converted with the calculated parameters, the distant view focused image If obtained by aligning the entire image with the close view focused image Ir is obtained.
[0071]
In the local alignment process, a positional deviation is corrected for each pixel between the foreground focused image Ir and the distant view focused image If subjected to the alignment process for the entire image. This correction is performed within the r × r pixel centered on the pixel position (x, y) of the foreground in-focus image Ir and the pixel position (x + m, y + n) of the distant-focus image If for which the entire image has been aligned. The calculation is performed by calculating the mean square value of the corresponding pixel level differences between the two images, and further calculating the parameter (m, n) that minimizes the sum total of r × r. When the parameter (m, n) is calculated for all the pixels and the distant view focused image If is corrected using the parameter (m, n), the alignment row is finally aligned with the near view focused image Ir. A distant view focused image If is obtained.
[0072]
Various methods are known as image composition processing. Since the iterative method is adopted in the present embodiment, the following description will be made on the iterative method.
[0073]
As shown in FIG. 8, the function representing the in-focus area in the foreground focused image Ir is f1 (x, y), and the function representing the in-focus area in the distant in-focus image If is f2 ( x, y), h1 (x, y) is a function representing the degree of blurring of the unfocused foreground area of the distant focused image If, and the degree of blurring of the unfocused distant view area of the foreground focused image Ir is If the function to represent is h2 (x, y), the function g1 (x, y) representing the foreground focused image Ir is
g1 (x, y) = f1 (x, y) + h2 (x, y) * f2 (x, y) (1)
And the function g2 (x, y) representing the distant view focused image If is
g2 (x, y) = h1 (x, y) * f1 (x, y) + f2 (x, y) (2)
It is represented by In these formulas, * is a convolution, and the same applies to the following formulas.
[0074]
On the other hand, in the blur adjustment image I, an image obtained by blurring the foreground area of the foreground in-focus image Ir with the blur function ha (x, y) and a distant view area of the distant-focus image If if with the blur function hb (x, y). The function f (x, y) representing the blur adjustment image I is
f (x, y) = ha (x, y) * f1 (x, y) + hb (x, y) * f2 (x, y)… (3)
It is represented by
[0075]
  Here, the blur functions h1 and h2 of the original images Ir and If and the blur functions ha and hb of the blur adjustment image I are expressed as follows:
    h (x, y) = (1 / πR²) ・ Exp (-(x²+ Y²) / R²) …(Four)
      R: amount of blur (blur radius)
Is obtained by substituting R for the blur amounts R1 and R2 for the blur functions h1 and h2..In the case of a photographed image, the blur amounts R1 and R2 are values defined by the focal position of the photographing lens at the time of photographing. For this reason, in this embodiment, blurring is obtained by obtaining information about the type of the photographing lens and the focal position of the photographing lens from the tag information of the still image file indicating information at the time of photographing, and referring to a preset table. The functions h1 and h2 are acquired. Also, assuming that the blur amounts for the blur functions ha and hb are Ra and Rb, respectively, the set values of the blur amounts Ra and Rb determine the degree of blur of the blur adjustment image I generated after processing, that is, the in-focus position. It will be a thing.
[0076]
When f1 (x, y) and f2 (x, y) are deleted from the equations (1) to (3), the function g1 (x, y) of the foreground focused image Ir and the function g2 (x of the far view focused image If , y), a relational expression of the function f (x, y) of the blur adjustment image I
(ha-hb * h1) * g1 + (hb-ha * h2) * g2 = (δ-h1 * h2) * f… (5)
Is obtained. In Equation (5), δ is a Dirac delta function. Further, in the expression (5), the variable (x, y) portion in the function notation is omitted for convenience.
[0077]
Therefore, the function f indicating the blur adjustment image I can be obtained by solving the equation (5). In the iterative method, the left side in (5)
g = (ha-hb * h1) * g1 + (hb-ha * h2) * g2… (6)
And f repeated k times^(k)age,
f^{(k + 1)}= g + (h1 * h2) * f^(k)  … (7)
When iterative calculation is performed as shown in, f → k → ∞^{( ∞ )}Converges to f satisfying the expression (5), so that the blur adjustment image I at an arbitrary in-focus position is calculated by repeating this iterative calculation. Here, the initial value f⁽⁰⁾May be g1, g2, (g1 + g2) / 2 or the like.
[0078]
9 to 15 are diagrams illustrating examples of the blur adjustment image I acquired by changing the blur amounts Ra and Rb in the blur adjustment process. 9 is infinite, FIG. 10 is 20 m, FIG. 11 is 10 m, FIG. 12 is 5 m, FIG. 13 is 2 m, and FIG. 14 is in focus. FIG. 15 shows a blur adjustment image I corresponding to a focus position of 1 m and FIG. 15 corresponding to a focus position of 0.5 m. Note that, in the blur adjustment image I of these figures, the home A1, which is a distant subject, has a shooting distance of 20 m, and the automobile A2, which is a mid-range subject, has a shooting distance of 5 m, and is a person who is a close-up subject. A3 has a shooting distance of 1 m.
[0079]
For example, in FIG. 10 (in-focus position 20 m), the house A1 which is a subject with a shooting distance of 20 m is in focus, but the other subjects are out of focus. In FIG. 12 (in-focus position 5 m), the vehicle A2 which is a subject with a shooting distance of 5 m is in focus, but other subjects are out of focus. Further, in FIG. 14 (in-focus position 1 m), the person A3 who is a subject with a shooting distance of 1 m is in focus, but the other subjects are out of focus.
[0080]
Further, when the blur adjustment images I of FIGS. 9 to 15 are compared in this order, the object in the background, the object in the middle background, and the object in the foreground are gradually focused. That is, an image file of a moving image whose focus position gradually changes from a distant view to a close view (hereinafter referred to as “focus change moving image”) is obtained by converting the blur adjustment image I as shown in the examples of FIGS. It becomes possible to create by connecting. Here, for the sake of explanation, seven blur adjustment images I have been illustrated, but it is needless to say that blur adjustment images I at in-focus positions that are not illustrated can also be acquired.
[0081]
<3. Movie creation>
Next, blur adjustment processing is performed using the two still images (the foreground in-focus image and the distant background in-focus image) taken in the above-described blur adjustment mode of the digital camera 1 to create a focus change moving image. An image processing apparatus will be described.
[0082]
FIG. 16 is an external view showing a configuration of an image processing apparatus that creates a focus change moving image. As shown in FIG. 16, the image processing apparatus 50 includes a personal computer 60 and a printer 70 that is an output device thereof.
[0083]
The personal computer 60 includes a computer main body 61, a display 62 for displaying various information, a keyboard 63 and a mouse 64 for receiving input from the user. The computer main body 61 also includes readers 61a and 61c that read various data from a recording medium 90 such as a CD-ROM, and a memory card reader 61b that reads a memory card such as a digital camera.
[0084]
In addition, the personal computer 60 is a processing program (hereinafter referred to as “focusing program”) that can create a focus change movie from two still images shot in the blur adjustment mode in a predetermined storage device in the computer main body 61. A focal change movie creation program ") is stored. The personal computer 60 functions as an image processing device by reading out and executing this in-focus change moving image creating program from a predetermined storage device. This moving image creation program is installed in advance in the computer main body 61 via a reader 61a or 61b from a recording medium 90 such as a CD-ROM in which the program is recorded. The in-focus change movie creating program may be installed after being downloaded from a predetermined server storage device via a communication line such as the Internet.
[0085]
FIG. 17 is a diagram illustrating an example of a work window displayed on the display 62 when the in-focus change moving image creating program is executed in the personal computer 60. In the work window 100, three display areas 101 to 103 for displaying image data and the like related to the process of creating the in-focus moving image, and command buttons 104 to 108 for instructing processing contents and processing conditions are displayed. .
[0086]
The display area 101 and the display area 102 are arranged at the upper part of the screen. The display area 101 displays a thumbnail image of a foreground in-focus image, and the display area 102 displays a thumbnail image of a distant-focus image. The display area 103 is arranged below the display area 101, and displays a processing result in a blur adjustment process described later. The command buttons 104 to 107 are displayed vertically arranged below the display area 102, and the command buttons 108 are displayed below the display area 101.
[0087]
  A command button (hereinafter referred to as “file button”) 104 labeled “file” is for designating two still image files from which a focus-change moving image is created. This file button1By clicking 04, a folder designation window is opened, and a folder storing still image files shot in the blur adjustment mode such as a memory card attached to the memory card reader 61b is displayed. Since the foreground in-focus image and the far-in-focus image taken in the blur adjustment mode are included in the same folder “Nb”, both still image files can be specified only by specifying the folder.
[0088]
When a folder to be opened is designated by the user in this folder designation window, the tag information of both still image files included in the designated folder is referred to and whether or not the image is taken in the blur adjustment mode. It is to be determined. In the still image file shot in the blur adjustment mode, the information of “bokeh adjustment mode 1/2” or “bokeh adjustment mode 2/2” is included in the tag information shooting mode. , It is determined that the image was taken in the blur adjustment mode. If the image was not shot in the blur adjustment mode, the subsequent processing cannot be performed, so that a predetermined error message is displayed to allow the user to specify a folder to be opened again.
[0089]
A command button (hereinafter referred to as “setting button”) 105 described as “setting” is used to set various parameters of a focus change moving image to be created. When the setting button 105 is clicked, a setting window 110 as shown in FIG. As shown in FIG. 18, the setting window 110 displays setting forms 111 to 114 that can set parameters such as the degree of blur of the in-focus moving image to be created, the number of frames, the playback time, and the display speed.
[0090]
Here, the focus change moving image created in the present embodiment will be briefly described. FIG. 23 is a diagram illustrating a configuration of a focus change moving image to be created. As shown in the figure, the in-focus change video has a configuration in which n frames (n> 1) are connected, and each frame corresponds to one still image data (blur adjustment image). When the in-focus moving image is reproduced, these still image data are displayed from the first frame F1 to the nth frame Fn in order.
[0091]
In this embodiment, since a moving image in which the focus position gradually changes from a distant view to a foreground is created, the first frame F1 is in a state in which the distant view is in focus, and the foreground is the most blurred among all frames. It becomes a state. On the other hand, the nth frame Fn is in a state in which the near view is in focus, and the distant view is in the most blurred state in all frames.
[0092]
In addition, the focus-change moving image created in the present embodiment displays each frame at a certain time T1 seconds during reproduction. Accordingly, the reproduction time T2 seconds of the focus-changing moving image has a relationship of T2 = T1 × n, and the number of frames displayed per second (fps), that is, the display speed V has a relationship of V = n / T2. The display time T1 of each frame is the reciprocal of the display speed V.
[0093]
Returning to FIG. 18, the setting form 111 is used to set the near-field maximum blur amount ra and the far-field maximum blur amount rb that are parameters for determining the blur details of the in-focus moving image. This is based on the amount of blur in the foreground area of the first frame F1 to be created (corresponding to Ra described above) as the maximum foreground blur amount ra and the amount of blur in the distant region of the nth frame Fn (corresponding to Rb described above). This is set as the far-field maximum blur amount rb.
[0094]
As shown in FIG. 18, the setting form 111 includes two option buttons 115 and 116 and two numerical value input boxes 116a and 116b. When the option button 115 described as “automatic” is selected, the near-field maximum blur amount ra and the far-field maximum blur amount rb are set to preset default values, for example, “5” pixels. On the other hand, when the option button 116 described as “manual” is selected, the value input in the numerical value input box 116a is the foreground maximum blur amount ra, and the value input in the numerical value input box 116b is the maximum far view blur amount. Set as rb.
[0095]
The setting form 112 is for setting the number of frames n of the focus-changing moving image, the setting form 113 is for setting the playback time T2 of the focusing-change moving image, and the setting form 114 is for setting the display speed V of the focusing-change moving image. . These parameters are variably set by inputting values into numerical value input boxes provided in the setting forms 112 to 114, respectively. As described above, since there is a relationship of V = n / T2, if a value is input to two numerical value input boxes among the setting forms 112 to 114, the remaining one is calculated and automatically numerical values. It is displayed in the input box.
[0096]
The setting window 110 further includes an OK button 117 and a cancel button 118. When the OK button 117 is clicked, each parameter input in the setting forms 111 to 117 is updated and stored in a predetermined storage device inside the computer main body 61. On the other hand, when the cancel button 118 is clicked, each parameter is not updated.
[0097]
Returning to FIG. 17, the command button (hereinafter referred to as “execution button”) 106 displayed as “execution” actually performs the process of creating the in-focus moving image using the two images shot in the blur adjustment mode. It is for execution. The details of the process for creating the in-focus moving image will be described later.
[0098]
A command button (hereinafter referred to as “end button”) 107 displayed as “end” is for ending the execution of the focus change moving image creating program. When the end button 107 is clicked, the work window 100 is closed and all processing is completed.
[0099]
A command button (hereinafter referred to as “cancel button”) 108 displayed as “Cancel” is used to cancel the process of creating a focus-change moving image halfway. Since the processing time of the process for creating the in-focus moving image is long, if the user wants to forcibly stop the process for some reason, it can be stopped by clicking this stop button.
[0100]
Next, in-focus moving image creation processing will be described with reference to the flowchart shown in FIG.
[0101]
First, the user clicks the file button 104, and designates a folder in which two still image files used for creating a focus change moving image are stored. When the folder to be opened is specified, thumbnail images are read from the two still image files stored in the specified folder and displayed in the display areas 101 and 102 of the work window 100 (steps S21 and S22). ).
[0102]
Next, the setting button 105 is clicked by the user, and various parameters are set for the focus-changing moving image to be created. That is, the parameters of the near view maximum blur amount ra, the far view maximum blur amount rb, the number of frames n, the playback time T2, and the playback speed V are set (step S23).
[0103]
Subsequently, it is determined whether or not the execution button 106 has been operated (step S24). Here, if there is no operation of the execution button 106, it will be in a standby state in the state where two thumbnail images were displayed. In this state, it is possible to return to step S23 and perform various parameter settings for the in-focus moving image again.
[0104]
When the execution button 106 is operated, captured image data (a foreground in-focus image and a foreground in-focus image) are read from the two designated still image files (step S25).
[0105]
Further, tag information is read from the two still image files, and information on the type of the photographing lens of the photographing lens and the focal position of the photographing lens included in the tag information is acquired. Based on the acquired information, a table stored in advance in a predetermined storage device is referred to, and the read out distance in-focus image R1 in the distant view in-focus image and the distant view region in the distant-focus image R2 It is set (step S26).
[0106]
Subsequently, in order to create the first frame F1, the count value i (i = 1, 2, 3,..., N) indicating the currently created frame number is set to “1”. It is set (step S27).
[0107]
Subsequently, blur adjustment processing is performed using the foreground in-focus image and the distant view in-focus image, and a defocus adjustment image to be a frame of the in-focus change moving image is created (step S28). This frame creation process is repeated as many times as the number of frames to be created n. In the following description, it is assumed that the i-th frame Fi is created.
[0108]
  FIG.0These are flowcharts showing the flow of this frame creation processing. First, the above-described registration processing of the foreground in-focus image and the foreground in-focus image is performed, and finally a distant-in-focus image that is aligned with the foreground in-focus image is obtained (step S41). In addition, in this alignment process, in order to improve the processing speed, it may be performed only by the parallel movement of the distant view focused image with reference to the close view focused image. Further, when the second and subsequent frames are created (i> 1), this processing is omitted because the alignment process is performed when the first frame is created (i = 1). May be.
[0109]
Subsequently, the blur amount Ra of the foreground region and the blur amount Rb of the far view region in the i-th frame to be created are set (step S42). Specifically, the blur amounts Ra and Rb are arithmetic expressions that define stepwise changes based on the maximum blur amounts ra and rb, which are set parameters, respectively.
Ra = ra · (n−i) / (n−1)
Rb = rb · (i−1) / (n−1)
It is calculated and set by.
[0110]
For example, when i = 1 (first frame F1), Ra = ra and Rb = 0. That is, since the blur amount Ra of the foreground area is the maximum near-field blur amount ra and the blur amount Rb of the far-field area is “0”, it is set so that the distant view is focused and the foreground is in the most blurred state. On the other hand, when i = n (the nth frame Fn), Ra = 0 and Rb = rb. That is, the blur amount Ra of the foreground area is “0”, and the blur amount Rb of the distant view area is the maximum distant view blur rb, so that the near view is in focus and the far view is in the most blurred state. Further, when 1 <i <n, the setting is performed so that the blur state is intermediate between the frames F1 and Fn.
[0111]
Subsequently, the count value j of the counter that counts the number of iterations when calculating the blur adjustment image by the iterative method is set to “0” (step S43). Subsequently, the first calculation is performed in the above-described iterative method of the blur adjustment process (step S44), and the blur adjustment image of the calculation result is displayed in the display area 103 (step S45).
[0112]
Subsequently, it is determined whether or not an instruction to stop processing is instructed by the stop button 108 (step S46). If an instruction to stop processing is instructed, the processing is forcibly stopped and the process returns to step S21 in FIG. .
[0113]
If the stop of the process is not instructed in step S46, whether the iterative calculation result has converged (step S47), and whether the count value j of the number of repetitive calculations has reached a predetermined number set in advance. (Step S48) is sequentially determined. If the iterative calculation result has not converged and the count value j of the number of iterations has not reached the predetermined number, the count value j is incremented by 1 (step S49), and the process returns to step S44 to adjust the next blur. An operation is performed.
[0114]
On the other hand, when the result of the iterative calculation converges or when the count value j of the number of times of the repeated calculation reaches a predetermined number, the frame creation process is terminated with the blur adjustment image as the result of the calculation as the frame Fi.
[0115]
When the creation process of the frame Fi is completed, the frame Fi is connected to the moving image data being created in step S29 of FIG. That is, every time a frame is created, it is linked to the moving image data, and a focus-changing moving image is created sequentially. At the same time, the reciprocal of the reproduction speed V is added as timing information to be reproduced for the frame Fi. If i = 1, there is no moving image data to be connected, so this process is not performed.
[0116]
Subsequently, it is determined whether or not the count value i of the currently created frame number has reached the frame number n (step S30). If the frame number n has not been reached, the count value i is incremented by one. (Step S31), the process returns to step S28, and the next frame is created.
[0117]
FIG. 21 is a diagram illustrating a state of the work window 100 in which a focus change moving image is being created. During the creation of the in-focus change movie, a progress bar 109a indicating the progress of the creation process is displayed at the bottom of the work window 100, and a status display 109b indicating that the in-focus change movie is being created. From this display, the user can recognize the progress of the creation process. Note that if the cancel button 108 displayed on the work window 100 is clicked, this process is forcibly stopped.
[0118]
Thereafter, frames are sequentially created by the same processing, and the created frames are connected to the moving image data being created. If the stop button 108 is not instructed to stop the process, the creation of the in-focus change movie ends when the frame number count value i reaches the frame number n in step S30.
[0119]
When the focus-changing moving image is created, a moving-image playback window 120 is displayed on the display 62 as shown in FIG. 22, and the created focus-changing moving image is played back and displayed in the display area 121 (step S32 in FIG. 19). . At the bottom of the moving image playback window 120, a progress bar 122a indicating the progress of playback and a status display 122b indicating that playback is in progress are made. The user can confirm the in-focus moving image created by the moving image playback window 120. That is, the image processing device 50 also functions as a display device that displays a focus change moving image.
[0120]
Subsequently, when the reproduction of the focus change video is finished, a confirmation dialog for inquiring whether or not to save the focus change video is displayed. When the user selects to save, the focus change video It is stored in the storage means (steps S33 and S34 in FIG. 19).
[0121]
<4. Modification>
As mentioned above, although embodiment of this invention was described, this invention is not limited to the said embodiment.
[0122]
In the above-described embodiment, the focus change moving image is generated using the image processing device 50 in which the personal computer 60 executes the focus change moving image generation program. However, the image processing device including the above-described imaging unit is used. A focusing change moving image creation program may be stored in the ROM 251 of a certain digital camera 1, and the digital camera 1 may execute the program to create a focusing change moving image. In such a case, the created in-focus moving image is displayed on the LCD 10, so that the digital camera 1 also functions as a display device.
[0123]
In addition, the in-focus moving image in the above-described embodiment is such that the in-focus position gradually changes from the distant view to the foreground, but conversely, the in-focus position gradually changes from the foreground to the distant view. It may be a thing. In such a case, it can be easily realized by reversing the arithmetic expression for calculating the blur amounts Ra and Rb in step S42 in FIG. Further, the user may be able to set the in-focus direction “from distant view to near view” or “from close view to distant view”.
[0124]
Further, in the above embodiment, each frame of the in-focus moving image is configured by the blur adjustment image that is the calculation result of the blur adjustment process. However, the original captured image data may be included. For example, a distant-focus image that is captured image data is used for the first frame F1, and a near-focus image that is captured image data is used for the n-th frame Fn, and only the intermediate frame is blurred. You may make it produce by a taste adjustment process. Although the processing time for creating the in-focus moving image is long, in this way, the processing time can be relatively shortened.
[0125]
【The invention's effect】
As described above, according to the inventions of claims 1 to 5, 8 and 9, the in-focus position is gradually determined from two still images taken at different in-focus positions. An image file of a moving image having a changing video effect can be created.
[0126]
In particular, according to the invention of claim 2, since it is possible to shoot continuously in time by changing the focus position in response to the operation of the operation button, it is possible to capture two still images at different focus positions. It can be obtained easily.
[0127]
In particular, according to the invention of claim 3, since the blur parameter of the still image included in the moving image file can be set variably, the blur in the video effect of the moving image file can be changed. Can be set to
[0128]
Further, according to the invention of claim 4, since the number of still images constituting the moving image file can be set variably, the stage of the video effect of the moving image file can be set variably. can do.
[0129]
In particular, according to the invention of claim 5, since the display speed of the still image group constituting the moving image file can be set variably, the display speed of the video effect of the moving image file can be changed. Can be set.
[0130]
According to the sixth and seventh aspects of the present invention, it is possible to display a video effect in which the in-focus position gradually changes from two still images taken at different in-focus positions.
[0131]
In particular, according to the seventh aspect of the present invention, since the in-focus position can be changed in response to the operation of the operation button and images can be continuously captured in time, two still images at different in-focus positions can be captured. It can be obtained easily.
[Brief description of the drawings]
FIG. 1 is a plan view of a digital camera that captures a still image.
FIG. 2 is a cross-sectional view of a digital camera that captures a still image.
FIG. 3 is a rear view of a digital camera that captures a still image.
FIG. 4 is a block diagram illustrating a functional configuration of the digital camera.
FIG. 5 is a diagram illustrating a method of recording a still image file on a memory card.
FIG. 6 is a diagram illustrating a configuration example of a still image file stored in a memory card.
FIG. 7 is a diagram illustrating a shooting procedure in a blur adjustment mode of the digital camera.
FIG. 8 is a model diagram showing two images used for blurring adjustment processing.
FIG. 9 is a diagram illustrating an example of a blur adjustment image corresponding to an in-focus position of infinity.
FIG. 10 is a diagram illustrating an example of a blur adjustment image corresponding to a focus position of 20 m.
FIG. 11 is a diagram illustrating an example of a blur adjustment image corresponding to a focus position of 10 m.
FIG. 12 is a diagram illustrating an example of a blur adjustment image corresponding to a focus position of 5 m.
FIG. 13 is a diagram illustrating an example of a blur adjustment image corresponding to a focus position of 2 m.
FIG. 14 is a diagram illustrating an example of a blur adjustment image corresponding to a focus position of 1 m.
FIG. 15 is a diagram illustrating an example of an acquired blur adjustment image corresponding to a focus position of 0.5 m.
FIG. 16 is an external view showing a configuration of an image processing apparatus according to an embodiment of the present invention.
FIG. 17 is a diagram illustrating an example of a work window displayed on the display of the image processing apparatus.
FIG. 18 is a diagram illustrating an example of a setting window displayed on the display of the image processing apparatus.
FIG. 19 is a diagram illustrating a processing procedure for creating an image file of a moving image.
FIG. 20 is a diagram illustrating a procedure of processing for creating each frame constituting a moving image.
FIG. 21 is a diagram illustrating a state of a work window during creation of a moving image file.
FIG. 22 is a diagram illustrating an example of a moving image playback window displayed on the display of the image processing apparatus.
FIG. 23 is a diagram illustrating a configuration of an image file of a moving image.
[Explanation of symbols]
1 Digital camera
8 Memory card
9 Shutter button
50 Image processing device
60 Personal computer
61 Computer body
62 display
70 Printer
90 recording media
100 working window
110 Settings window
120 Movie playback window

Claims (9)

An image processing apparatus,
The first still image captured at the first in-focus position for the same subject and the second still image captured at the second in-focus position are used, and blur caused by deviation from the in- focus position is used. By using a blur function that indicates the degree ,
First image generation for generating a third still image to be obtained when the subject is photographed at a third in-focus position different from the first in-focus position and the second in-focus position by calculation. Means,
By activating the first image generation means while sequentially setting a plurality of in-focus positions as the third in-focus position, a plurality of third in which the degree of blur of the subject varies stepwise in order of frame numbers. Second image generating means for generating a still image and generating a moving image using the plurality of third still images ;
An image processing apparatus comprising: The image processing apparatus according to claim 1.
Imaging means for capturing still images;
Further comprising
The image processing device is characterized in that the imaging means captures the first still image and the second still image sequentially in response to an operation of an operation button. The image processing apparatus according to claim 1 or 2,
The image processing apparatus according to claim 1, wherein the first image generation unit includes a blur parameter setting unit that variably sets a parameter that specifies a degree of blur in the blur function of the third still image. The image processing apparatus according to any one of claims 1 to 3,
The second image generating means, an image processing apparatus characterized by comprising an image number setting unit that variably sets the picture number image that make up the moving picture. The image processing apparatus according to any one of claims 1 to 4,
The image processing apparatus, wherein the second image generating means includes display speed setting means for variably setting the display speed of the moving image . A display device,
The first still image captured at the first in-focus position for the same subject and the second still image captured at the second in-focus position are used, and blur caused by deviation from the in- focus position is used. By using a blur function that indicates the degree ,
Image generating means for generating, by calculation, a third still image to be obtained when the subject is photographed at a third in-focus position different from the first in-focus position and the second in-focus position;
By activating the image generating means while sequentially setting a plurality of in-focus positions as the third in-focus position, a plurality of third still images in which the degree of blur of the subject varies stepwise in order of frame numbers Output means for generating and outputting a moving image using the plurality of third still images ;
A display device comprising: The display device according to claim 6,
Imaging means for capturing still images;
Further comprising
The display device is characterized in that the first still image and the second still image are taken continuously in time in response to an operation of an operation button. By being executed by a computer included in the image processing apparatus ,
The first still image captured at the first in-focus position for the same subject and the second still image captured at the second in-focus position are used, and blur caused by deviation from the in-focus position is used. By using a blur function that indicates the degree,
Generating a third still image by calculation to be obtained when the subject is photographed at a third in-focus position different from the first in-focus position and the second in-focus position ;
By activating the first image generation means while sequentially setting a plurality of in-focus positions as the third in-focus position, a plurality of third in which the degree of blur of the subject varies stepwise in order of frame numbers. Generating a still image and generating a moving image using the plurality of third still images; and
A program characterized by having executed .   A computer-readable recording medium on which the program according to claim 8 is recorded.

Images