JP2012209775A - Image capture device, image capture control method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image capture device capable of capturing images at an image capture speed corresponding to the movement speed tendency of the image capture device by a user.SOLUTION: A CPU 7 determines, when a shutter SW is fully depressed in capturing panoramic images, a shutter speed for capturing panoramic images based on an average value of the latest five camera movement speeds read out from a movement speed storage part 24. An image capture part 2 sequentially captures images with a predetermined time interval at the above shutter speed while a user operates a digital camera 1, takes in the captured images as composition images every time an image capture device reaches to a predetermined position (a composition image acquisition position), and combines the images by overlapping parts of the images with each other to generate one panoramic image. At this time, the CPU 7 calculates a camera movement speed using the captured images or the like, and renews the average value of the latest five camera movement speeds acquired when capturing panoramic images.

Description

  The present invention relates to an imaging apparatus, an imaging control method, and a program suitable for taking a panoramic image.

  As a conventional technique, while maintaining the state in which the user presses down the shutter switch, the digital camera is moved in the horizontal direction while being substantially fixed in the vertical direction around the user's own body. A technique for generating a panoramic image by executing a plurality of imaging processes and synthesizing these captured images is known (for example, see Patent Document 1).

JP-A-6-303562

  The technique disclosed in Patent Document 1 is based on the assumption that the user rotates the digital camera at a constant speed. However, in reality, it is rare that such an ideal shooting is performed. For example, it is generated when the speed at which the user moves the camera in the horizontal direction is too high with respect to the shutter speed set in the camera. There is a risk that subject blur or the like will occur in the panoramic image.

  SUMMARY An advantage of some aspects of the invention is that it provides an imaging apparatus, an imaging control method, and a program that can reduce the occurrence of subject blur or the like in a generated panoramic image.

  In order to solve the above-described problem, the present invention includes an imaging unit and a generation unit that sequentially acquires a plurality of images captured by the imaging unit and generates a panoramic image from the acquired plurality of images. In the imaging apparatus, the imaging control means for sequentially capturing a plurality of images while the imaging apparatus is moved, and the imaging means performs imaging based on the moving speed while the imaging apparatus is moved. The image pickup apparatus includes a changing unit that changes the shutter speed.

  According to the present invention, since a panorama image is generated from a plurality of images captured according to the tendency of the moving speed of the imaging device, it is possible to reduce the occurrence of subject blur or the like in the generated panorama image.

It is a block diagram which shows the structure of the digital camera by 1st Embodiment of this invention. It is a conceptual diagram for demonstrating normal imaging mode. It is a conceptual diagram for demonstrating the panorama imaging mode with the digital camera 1 by this 1st Embodiment. 4 is a flowchart for explaining an operation of the digital camera 1 according to the first embodiment. 6 is a flowchart for explaining the operation of continuous shooting processing and combining processing in the digital camera 1 according to the first embodiment. In this 1st Embodiment, it is a conceptual diagram for demonstrating the calculation method of a camera moving speed. It is a flowchart for demonstrating the operation | movement of this 2nd Embodiment. It is a flowchart for demonstrating the operation | movement of practice mode process by this 2nd Embodiment. It is a flowchart for demonstrating operation | movement of the continuous shooting process & synthetic | combination process in the digital camera 1 by this 2nd Embodiment. It is a flowchart for demonstrating the operation | movement of this 3rd Embodiment. It is a flowchart for demonstrating operation | movement of the continuous shooting process & synthetic | combination process in the digital camera 1 by this 3rd Embodiment. In this 3rd Embodiment, it is a conceptual diagram for demonstrating the calculation method of a camera moving speed. It is a figure which shows the conditions for determining shutter speed according to a user's camera moving speed and the brightness (exposure) at that time.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

A. First Embodiment FIG. 1 is a block diagram showing a configuration of a digital camera according to a first embodiment of the present invention. In the figure, a digital camera 1 includes an imaging unit 2, an imaging control unit 3, an image processing unit 4, a moving distance measuring unit 5, a moving speed calculating unit 6, a CPU 7, a RAM 8, a ROM 9, a recording unit 10, a display unit 11, and keys. An input unit 12 is provided.

  The imaging unit 2 includes a lens group such as a focus lens and a zoom lens, and an imaging device (CCD or the like), and adjusts autofocusing, aperture, zooming, and the like according to a control signal from the imaging control unit 3, and the lens group by the imaging device. The light of the subject projected via is converted into an electrical signal and output as an imaging signal. The imaging control unit 3 controls the imaging operation of the imaging unit 2 under the control of the CPU 7.

  The image processing unit 4 performs image processing (pixel interpolation processing, γ correction, generation of luminance and color difference signals, white balance processing, exposure correction processing, etc.) of image data captured by the imaging unit 2, and compression / decompression of image data (for example, , JPEG format, Motion-JPEG format or MPEG format compression / decompression) processing, and processing for combining a plurality of captured images.

  In particular, in the first embodiment of the present invention, the image processing unit 4 includes an overlapping area determination unit 20, an image position adjustment unit 21, and an image composition unit 22 that are used during panoramic shooting. The overlapping area determination unit 20 determines the size of the overlapping area of images (not all captured as a composite image) sequentially captured at a predetermined time interval (for example, 7 fps or 10 fps) during panoramic shooting. In addition, an overlapping area between the compositing images captured at a predetermined position (composition image capturing position) during horizontal movement is determined.

  The image position adjustment unit 21 adjusts the positions of adjacent images based on the feature points of the overlapping area. The image combining unit 22 combines adjacent images whose positions are adjusted. The overlapping area determination unit 20, the image position adjustment unit 21, and the image composition unit 22 perform the above processing on each of a plurality of captured images sequentially captured at the time of panorama shooting, thereby combining one connected composition. An image (panoramic image) is obtained.

  The moving distance measuring unit 5 measures the moving distance of the digital camera when the digital camera is moved to rotate in the horizontal direction while being substantially fixed in the vertical direction during panoramic photography. The moving speed calculation unit 6 calculates the camera moving speed of the digital camera during panoramic shooting.

  The camera moving speed is calculated by dividing the moving distance measured by the moving distance measuring unit 5 by the time required to move the distance. At the time of panoramic shooting, the digital camera 1 sequentially captures images at a predetermined time interval (for example, 7 fps or 10 fps), and captures the captured image as a composite image every time it reaches a predetermined position (composite image acquisition position). Is working. Therefore, if the number of frames required for the digital camera 1 to move to the compositing image acquisition position is acquired, the time required to move the distance can be obtained.

  The CPU 7 is a one-chip microcomputer that controls each part of the digital camera 1. In particular, in the first embodiment, the CPU 7 sequentially captures images at a predetermined time interval (for example, 7 fps or 10 fps) while the user moves the digital camera 1 during panorama shooting, and reaches the end. Or, until panoramic shooting is completed, every time the camera reaches a predetermined position (composite image acquisition position), the image capturing control unit 3, the image processing unit 4, the moving distance measuring unit 5, The speed calculation unit 6 and the like are controlled. In addition, the CPU 7 synthesizes the plurality of captured images so as to partially overlap (for example, using an α blend), and generates a single composite image (panoramic image) that is captured at a wide angle. Control each part as much as possible. Details of the image composition will be described later.

  Further, the CPU 7 sets the shutter speed at the time of panoramic shooting based on the average value of the camera moving speeds obtained at the last five panoramic shootings. In other words, during panoramic shooting, the shutter speed for the captured image to be shot is changed according to the tendency of the camera moving speed (whether it is slow or fast) when the user moves the digital camera 1 to rotate in the horizontal direction. decide. As a result, an image can be taken at an imaging speed corresponding to the tendency of the moving speed of the digital camera 1 by the user without causing a subject blur or the like.

  The RAM 8 is used as a buffer memory for temporarily storing image data picked up by the image pickup unit 2 and is used as a working memory for the CPU 7. The ROM 9 stores a program necessary for controlling each part of the digital camera 1 by the CPU 7 and data necessary for controlling each part. The CPU 7 performs processing according to this program.

  The recording unit 10 records a composite image (panoramic image) or a composite image synthesized from a plurality of images. Further, the recording unit 10 has a moving speed storage unit 24, and records the camera moving speed (swing speed) at the time of panoramic photographing calculated by the moving speed calculation unit 6. In the first embodiment of the present invention, the average value of the camera movement speeds obtained during the last five panoramic shootings is recorded. As described above, the CPU 7 sets the shutter speed at the time of panoramic shooting based on the average value of the camera moving speeds obtained at the last five panoramic shootings.

  The display unit 11 includes a color LCD and its driving circuit, and displays the subject imaged by the imaging unit 2 as a through image when in the imaging standby state, and is read out from the recording unit 10 when reproducing the recorded image. Display the expanded recorded image. The key input unit 12 includes a plurality of operation keys such as a shutter SW (switch), a zoom SW, a mode key, a SET key, and a cross key, and outputs an operation signal according to a user's key operation to the CPU 7.

  FIG. 2 is a conceptual diagram for explaining a normal imaging mode. When the digital camera 1 shoots in the normal imaging mode, as shown in FIG. 2, the digital camera 1 can only shoot an image 30 that is within the field angle range of the imaging system of the digital camera 1.

  FIG. 3 is a conceptual diagram for explaining a panoramic imaging mode in the digital camera 1 according to the first embodiment. The user holds the digital camera 1 with respect to the desired scenery, for example, presses the shutter SW at the left end (half press → full press), and, as shown by the arrow in FIG. Move in the direction. The digital camera 1 sequentially captures images at predetermined time intervals (for example, 7 fps, 10 fps, etc.), and picks up images (synthetic images) every time it reaches a predetermined position until it reaches the end or panoramic shooting ends. Image) and sequentially synthesizing the captured images for synthesis to generate one synthesized image (panoramic image) 31.

A-2. Operation of First Embodiment Next, the operation of the first embodiment described above will be described.
FIG. 4 is a flowchart for explaining the operation of the digital camera 1 according to the first embodiment. First, when the shutter SW is half-pressed (step S10), the CPU 7 executes an AF (autofocus) process (step S12). After fully pressing the shutter SW, the user moves the digital camera 1 so as to rotate in the horizontal direction (see FIG. 3).

  When the shutter SW is fully pressed (step S14), the CPU 7 reads the average value of the camera movement speeds obtained during the last five panoramic shootings from the movement speed storage unit 24 of the recording unit 10, and the camera movement speed. Based on the average value, the shutter speed at the time of panoramic shooting is determined (step S16). For example, when the camera movement speed is “slow” from the average value of the camera movement speeds, the shutter speed is set to “1/250 (s)”, and when the camera movement speed is “fast”, the shutter speed is set to “1/1”. 500 (s) ". Note that how to determine whether the camera moving speed is “slow” or “fast” will be described later.

  Next, the CPU 7 controls the imaging control unit 3 to sequentially capture images at a predetermined time interval (for example, 7 fps, 10 fps, etc.), capture the captured image every time it reaches a predetermined position, and move the camera speed. And a combined image (panoramic image) 31 is generated by sequentially combining the captured images (step S18). The details of the continuous shooting process & composition process will be described later.

  Next, the CPU 7 determines whether or not continuous shooting ends (step S20). The end of continuous shooting is, for example, when an end signal is generated by the user (user operation), or when an error occurs in image acquisition due to a large movement of the camera or when the image acquisition direction exceeds the maximum size of the panoramic image. When the movement distance to exceeds the threshold, etc. If the continuous shooting has not ended (NO in step S20), the process returns to step S18 to continue the continuous shooting process and the composition process.

  On the other hand, when the continuous shooting is completed (YES in step S20), an overall camera moving speed (for example, an average value, a median value, (Change value of speed, etc.) is calculated (step S22), the comprehensive camera moving speed is stored in the moving speed storage unit 24 of the recording unit 10 (step S24), and the process is terminated. As a result of the above processing, when setting the shutter speed for generating the next and subsequent panoramic images, the moving speed storing unit 24 stores the moving speed storage unit 24 as an element of the average value of the camera moving speeds obtained during the last five panoramic shootings. The stored overall camera speed can be included. Thereby, the shutter speed according to the tendency of the moving speed of the digital camera 1 by the user can be updated.

  FIG. 5 is a flowchart for explaining the operation of the continuous shooting process and the combining process in the digital camera 1 according to the first embodiment. During execution of the continuous shooting process and the composition process, the CPU 7 controls the imaging control unit 3 and sequentially captures images at a predetermined time interval (for example, 7 fps or 10 fps) by the imaging unit 2. The captured images are not all captured as composite images, and are discarded unless they are captured at the capture position.

  First, the CPU 7 determines whether or not the digital camera 1 has moved a certain distance (step S30). Further, the overlapping area determination unit 20 of the image processing unit 4 is an image to be taken into the recording unit 10 as an image for synthesis by determining the size of the overlapping area of images sequentially captured at a predetermined time interval. Determine whether or not. The image to be captured as the composition image is an image that overlaps the composition image captured one time earlier by a predetermined size (for example, 1/3). That is, if it is an image to be captured as a composition image, it has reached a predetermined position, and the digital camera 1 has moved a certain distance. In other words, if the overlapping area is large, the predetermined position has not yet been reached, and if the overlapping area is small, the predetermined position has been passed.

  If the digital camera 1 has not moved a certain distance (NO in step S30), the CPU 7 has repeatedly reached step S30 because the predetermined position has not yet been reached. On the other hand, when the digital camera 1 has moved a certain distance (YES in step S30), the captured image at that time is captured and stored in the recording unit 10 (step S32). Next, the moving distance measuring unit 5 calculates the camera moving speed in each frame at the time of image acquisition (step S34). Here, calculation of the camera moving speed will be described.

  FIGS. 6A and 6B are conceptual diagrams for explaining a method of calculating the camera moving speed in the first embodiment. In FIGS. 6A and 6B, reference numerals 40-1 to 40-3 and 41-1 to 41-3 denote synthesis images captured as synthesis images. The scales shown below the compositing images 40-1 to 40-3 and 41-1 to 41-3 indicate the timing at which images are sequentially captured at a predetermined time interval (for example, a fixed value such as 7 fps or 10 fps). The horizontal axis is the movement distance.

  As shown in FIG. 6A, when the moving speed of the digital camera 1 is (relatively) slow, first, the first image sequentially picked up at a predetermined time interval, first, the composition image 40 Taken as -1. Next, since the seventh image of the images sequentially captured at a predetermined time interval has reached a predetermined position (because it has moved a certain distance), the seventh captured image is captured as the composition image 40-2. It is. Furthermore, since the predetermined position has been reached on the next seventh sheet (because it has moved a certain distance), the seventh captured image is captured as the composition image 40-3. If the predetermined time interval is 10 fps, it means that the predetermined distance has been moved in 7/10 fps = 0.7 seconds.

  As shown in FIG. 6B, when the moving speed of the digital camera 1 is (relatively) fast, first, the first image sequentially captured at a predetermined time interval, and first, the composition image 41. Taken as -1. Next, since the fourth image of the images sequentially captured at a predetermined time interval has reached a predetermined position (because it has moved a certain distance), the fourth captured image is captured as the composition image 41-2. It is. Furthermore, since the predetermined position has been reached on the next fourth sheet (because it has moved a certain distance), the fourth captured image is captured as the composition image 41-3. If the predetermined time interval is 10 fps, it means that a predetermined distance has been moved in 4/10 fps = 0.4 seconds.

  Thus, in the first embodiment of the present invention, since the predetermined position is fixed (fixed), if the moving distance is set to “1”, the time required for capturing the composition image is set as the camera moving speed. It can be used as a corresponding value. For example, when the predetermined time interval is 10 fps, the time may be “fast” when it is smaller than 0.5 seconds and “slow” when it is 0.5 seconds or more.

  Next, returning to FIG. 5, after calculating the camera moving speed, the image processing unit 4 synthesizes the previous synthesis image and the synthesis image captured this time (step S36). More specifically, the overlapping area determination unit 20 determines an overlapping area between the previous combining image (or a combined image synthesized so far) and the combining image captured this time. The image position adjustment unit 21 adjusts the positions of adjacent images based on the overlap region, and the image composition unit 22 synthesizes the adjacent images whose positions are adjusted. Thereafter, the process returns to the main routine shown in FIG.

  Then, until the continuous shooting by the panoramic shooting is completed, one connected composite image (panoramic image) is obtained by performing the above processing on each of the plurality of composite images that are sequentially captured.

  According to the first embodiment described above, since the shutter speed at the time of imaging is determined according to the moving speed of the digital camera 1 acquired at the time of panoramic photography performed by the user in the past, subject blurring or the like occurs. Without making it, an image can be taken at an imaging speed corresponding to the tendency of the moving speed of the digital camera 1 by the user.

B. Second Embodiment Next, a second embodiment of the present invention will be described.
In the second embodiment, prior to actual panorama shooting, the user is referred to as a practice mode and the digital camera 1 is moved in the horizontal direction in the same manner as during panorama shooting, and the camera moving speed at that time is measured. In actual panoramic photography, the shutter speed is determined according to the camera movement speed measured in the practice mode.

  FIG. 7 is a flowchart for explaining the operation of the second embodiment. First, the CPU 7 displays that it is in the practice mode (step S40), and upon receiving an instruction such as OK from the user via the key input unit 12, shifts to the practice mode continuous shooting process (step S42). In the practice mode continuous shooting process, although a composite image (panoramic image) is not actually created, a process of obtaining the camera moving speed from the number of frames between the images for synthesis by actually moving the digital camera 1 in the horizontal direction by the user. It is. The practice mode continuous shooting process will be described later.

  When the shutter switch SW is half-pressed (step S44), the CPU 7 executes an AF (autofocus) process (step S46). After fully pressing the shutter SW, the user moves the digital camera 1 so as to rotate in the horizontal direction (see FIG. 3).

  When the shutter switch SW is fully pressed (step S48), the CPU 7 reads the average value of the camera moving speed calculated during the practice mode continuous shooting process from the moving speed storage unit 24 of the recording unit 10, and the average value of the camera moving speed. Based on the above, the shutter speed at the time of panoramic shooting is determined (step S50). Next, the CPU 7 controls the imaging control unit 3 to sequentially capture images at a predetermined time interval (for example, 7 fps or 10 fps), capture the captured image every time it reaches a predetermined position, and capture the captured image. By sequentially synthesizing, one synthesized image (panoramic image) 31 is generated (step S52). The details of the continuous shooting process & composition process will be described later.

  Next, the CPU 7 determines whether or not continuous shooting is finished (step S54). The end of continuous shooting is, for example, when an end signal is generated by the user (user operation), or when an error occurs in image acquisition due to a large movement of the camera or when the image acquisition direction exceeds the maximum size of the panoramic image. When the movement distance to exceeds the threshold, etc. If the continuous shooting has not ended (NO in step S54), the process returns to step S52, and the continuous shooting process and the composition process are continued. On the other hand, when the continuous shooting is finished (YES in step S54), the process is finished.

  FIG. 8 is a flowchart for explaining the operation of the practice mode processing according to the second embodiment. During execution of the practice mode process, the CPU 7 controls the imaging control unit 3 and sequentially captures images at predetermined time intervals (for example, 7 fps or 10 fps). The captured images are not all captured as a composite image, and are discarded if they are not captured images at the capture position.

  First, when the shutter SW is half-pressed (step S60), the CPU 7 executes an AF (autofocus) process (step S62). After fully pressing the shutter SW, the user moves the digital camera 1 so as to rotate in the horizontal direction (see FIG. 3).

  When the shutter SW is fully pressed (step S64), the CPU 7 determines whether or not the digital camera 1 has moved a certain distance (step S66). Here, it is determined whether or not the overlapping region determination unit 20 of the image processing unit 4 is an image to be captured as a composition image by determining the size of the overlapping region of images sequentially captured at a predetermined time interval. Judging. If it is not determined that the digital camera 1 has moved a fixed distance (NO in step S66), the predetermined position has not been reached yet, and step S66 is repeatedly executed.

  On the other hand, if it is determined that the digital camera 1 has moved a certain distance (YES in step S66), the captured image at that time is captured and stored in the recording unit 10 (step S68). Next, the moving speed calculation unit 6 calculates the camera moving speed in each frame at the time of image acquisition (step S70). Since the calculation of the camera moving speed is the same as that in the first embodiment described above, a description thereof will be omitted.

  After calculating the camera moving speed, the CPU 7 determines whether or not the continuous shooting is finished (step S72). The end of continuous shooting is, for example, when an end signal is generated by the user (user operation), or when an error occurs in image acquisition due to a large movement of the camera or when the image acquisition direction exceeds the maximum size of the panoramic image. When the movement distance to exceeds the threshold, etc. If the continuous shooting has not ended (NO in step S72), the process returns to step S66 and the practice mode process is continued.

  On the other hand, when the continuous shooting is completed (YES in step S72), the overall camera moving speed (for example, an average value, a median value, (Change value of speed, etc.) is calculated (step S74), the comprehensive camera moving speed is stored in the moving speed storage unit 24 of the recording unit 10 (step S76), and the process is terminated.

  FIG. 9 is a flowchart for explaining the operation of the continuous shooting process & composition process in the digital camera 1 according to the second embodiment. Note that during execution of the continuous shooting process and the composition process, the CPU 7 controls the imaging control unit 3 to cause the imaging unit 2 to sequentially capture images at a predetermined time interval (for example, 7 fps or 10 fps). The captured images are not all captured as a composite image, and are discarded if they are not captured images at the capture position.

  First, the CPU 11 determines whether or not the digital camera 1 has moved a certain distance (step S80). The overlapping region determination unit 20 of the image processing unit 4 determines whether or not the image is to be captured as a composition image by determining the size of the overlapping region of images that are sequentially captured at predetermined time intervals. . The image to be captured as the composition image is an image that overlaps the composition image captured one time earlier by a predetermined size (for example, 1/3). That is, if it is an image to be captured as a composition image, it has reached a predetermined position, and the digital camera 1 has moved a certain distance.

  If the digital camera 1 has not moved a certain distance (NO in step S80), the predetermined position has not been reached yet, and step S80 is repeatedly executed. On the other hand, if the digital camera 1 has moved a certain distance (YES in step S80), the captured image at that time is captured and stored (step S82). Next, after calculating the camera moving speed, the image processing unit 4 synthesizes the previous synthesis image and the synthesis image captured this time (step S86).

  More specifically, the overlapping area determination unit 20 determines an overlapping area between the previous combining image (or a combined image synthesized so far) and the combining image captured this time. The image position adjustment unit 21 adjusts the positions of adjacent images based on the feature points of the overlap region, and the image composition unit 22 synthesizes the adjacent images whose positions are adjusted. Thereafter, the process returns to the main routine shown in FIG.

  Then, until the continuous shooting by the panoramic shooting is completed, one connected composite image (panoramic image) is obtained by performing the above processing on each of the plurality of composite images that are sequentially captured.

  According to the second embodiment described above, prior to actual panorama shooting, the user moves the digital camera 1 in the horizontal direction in the same manner as during panorama shooting and measures the camera moving speed at that time. After that, in actual panoramic photography, the shutter speed is determined according to the camera movement speed measured in the practice mode, so that the movement speed of the digital camera 1 by the user tends not to occur without subject blurring. An image can be captured at a corresponding imaging speed.

C. Third Embodiment Next, a third embodiment of the present invention will be described.
By the way, at the time of panorama shooting, for example, a certain user is fast at the beginning and slows down at the end, or a certain user is the fastest during shooting, or the user does not always move the camera at a constant speed. The change in the camera moving speed is different for each. Therefore, the third embodiment is characterized in that the camera moving speed is measured during actual panorama shooting, and the shutter speed is changed momentarily in real time according to the measured camera moving speed.

  FIG. 10 is a flowchart for explaining the operation of the third embodiment. First, when the shutter SW is half-pressed (step S90), the CPU 7 executes an AF (autofocus) process (step S92). After fully pressing the shutter SW, the user moves the digital camera 1 so as to rotate in the horizontal direction (see FIG. 3).

  When the shutter switch SW is fully pressed (step S94), the CPU 7 reads the average value of the camera movement speeds obtained during the last five panoramic shootings from the movement speed storage unit 24 of the recording unit 10, and the camera movement speed. The shutter speed at the time of panoramic shooting is determined based on the average value (step S96). Note that this shutter speed is an initial shutter speed, and is changed in real time according to a change in camera movement speed during continuous shooting described later.

  Next, the CPU 7 controls the imaging control unit 3 to sequentially capture images at a predetermined time interval (for example, 7 fps, 10 fps, etc.), capture the captured image every time it reaches a predetermined position, and move the camera speed. And a combined image (panoramic image) 31 is generated by sequentially combining the captured images (step S98). The details of the continuous shooting process & composition process will be described later.

  Next, the CPU 7 determines whether or not continuous shooting ends (step S100). The end of continuous shooting is, for example, when an end signal is generated by the user (user operation), or when an error occurs in image acquisition due to a large movement of the camera or when the image acquisition direction exceeds the maximum size of the panoramic image. When the movement distance to exceeds the threshold, etc. If the continuous shooting is not completed (NO in step S100), the process returns to step S98, and the continuous shooting process and the composition process are continued.

  On the other hand, when the continuous shooting is completed (YES in step S100), the overall camera moving speed (for example, an average value, a median value, (Change value of speed, etc.) is calculated (step S102), the comprehensive camera moving speed is stored in the moving speed storage unit 24 of the recording unit 10 (step S104), and the process ends.

  FIG. 11 is a flowchart for explaining the operation of the continuous shooting process & composition process in the digital camera 1 according to the third embodiment. During execution of the continuous shooting process and the composition process, the CPU 7 controls the imaging control unit 3 and sequentially captures images at a predetermined time interval (for example, 7 fps or 10 fps) by the imaging unit 2. The captured images are not all captured as composite images, and are discarded unless they are captured at the capture position.

  First, the CPU 7 determines whether or not the digital camera 1 has moved a certain distance (step S110). The overlap region determination unit 20 of the image processing unit 4 determines whether or not the image is to be captured as a composition image by determining the size of the overlap region of images sequentially captured at a predetermined time interval. ing. If the digital camera 1 has not moved a fixed distance (NO in step S110), the predetermined position has not been reached yet, and step S110 is repeatedly executed.

  On the other hand, if the digital camera 1 has moved a certain distance (YES in step S110), the captured image at that time is captured and stored (step S112). Next, the camera movement speed in each frame at the time of image acquisition is calculated (step S114). Since the calculation of the camera moving speed is the same as in the first and second embodiments described above, the description thereof is omitted.

  After calculating the camera moving speed, the CPU 7 determines the shutter speed according to the camera moving speed (step S116). For example, the faster the camera movement speed, the faster the shutter speed. Next, the image processing unit 4 synthesizes the previous synthesis image and the synthesis image captured this time (step S118). More specifically, the overlapping area determination unit 20 determines an overlapping area between the previous combining image (or a combined image synthesized so far) and the combining image captured this time. The image position adjustment unit 21 adjusts the positions of adjacent images based on the overlap region, and the image composition unit 22 synthesizes the adjacent images whose positions are adjusted. Thereafter, the process returns to the main routine shown in FIG.

  Then, by performing the above-described processing on each of a plurality of combined images that are sequentially captured while changing the shutter speed in real time according to the change in the camera moving speed by the user until the continuous shooting by panoramic shooting is completed. One connected composite image (panoramic image) is obtained.

  FIG. 12 is a conceptual diagram for explaining a camera moving speed calculation method in the third embodiment. In FIG. 12, reference numerals 40-1 to 40-3 and 41-1 to 41-3 denote synthesis images captured as synthesis images. The scales shown below the compositing images 40-1 to 40-3 and 41-1 to 41-3 indicate the timing at which images are sequentially captured at a predetermined time interval (for example, a fixed value such as 7 fps or 10 fps). The horizontal axis is the movement distance.

  As shown in FIG. 12, when the moving speed of the digital camera 1 changes, first, the first image sequentially captured at a predetermined time interval is first captured as the composition image 42-1. Next, since the fourth image of the images sequentially captured at a predetermined time interval has reached a predetermined position (because it has moved a certain distance), the fifth captured image is captured as the composition image 42-2. It is. In this case, if the predetermined time interval is 10 fps between the compositing image 42-1 and the compositing image 42-2, the predetermined distance is moved by 4/10 fps = 0.4 seconds (fast). Become.

  Next, since the seventh image of the images sequentially captured at a predetermined time interval has reached a predetermined position (because it has moved a certain distance), the seventh captured image is captured as a compositing image 42-3. It is. In this case, if the predetermined time interval is 10 fps between the compositing image 42-2 and the compositing image 42-3, the predetermined distance is moved in 7/10 fps = 0.7 seconds (slow). Become.

  Thus, in the third embodiment, since the predetermined position is fixed (fixed), if the moving distance is set to “1”, the time required for capturing the image for synthesis corresponds to the camera moving speed. Can be used as a value. For example, when the predetermined time interval is 10 fps, the time may be “fast” when it is smaller than 0.5 seconds and “slow” when it is 0.5 seconds or more.

  Therefore, even when the camera movement speed changes by the user during actual panorama shooting, the shutter speed is changed every moment in real time according to the change in the camera movement speed, so that no subject blurring occurs. The composition image for the panorama image can be taken.

  According to the third embodiment described above, the camera moving speed is measured during actual panorama shooting, and the shutter speed is changed momentarily in real time according to the change in the measured camera moving speed. Even if the camera moving speed changes during shooting, or even when a different user takes a panoramic image, the imaging speed according to the tendency of the moving speed of the digital camera 1 by the user does not occur. An image can be taken.

  In the first embodiment described above, when a plurality of users use the digital camera 1, the average value of the last five camera movement speeds is held for each user and used from the menu screen or the like. The user to be selected may be selectable. In addition, the user may select any method such as a gesture on the touch panel, password input, or determination using a fingerprint.

  In the above-described third embodiment, the camera moving speed is measured during continuous shooting in actual panorama shooting, and the shutter speed is changed in real time according to the measured camera moving speed. However, the shutter speed may be increased when the change in the camera movement speed during a continuous shooting in actual panoramic shooting exceeds a predetermined threshold (when it rapidly increases). As described above, even when the shutter speed is increased when the change in the camera moving speed during a continuous shooting in actual panoramic shooting exceeds a predetermined threshold (when it rapidly increases), the subject can be increased. The occurrence of shaking can be effectively prevented.

  In the first to third embodiments described above, the moving speed calculation unit 6 measures the camera moving speed by acquiring the number of frames required for the digital camera 1 to move to the compositing image acquisition position. However, the present invention is not limited to this, and the camera moving speed may be measured as an angular speed per unit time by a gyro sensor or the like. In this case, for example, if the camera moving speed is smaller (faster) than 40 [deg / s] on average, the shutter speed is 1/250 [s], and if it is 40 [deg / s] or higher (slow) on average. The shutter speed may be 1/500 [s]. In this way, the camera moving speed can be measured as an angular speed per unit time by a gyro sensor or the like, and an image can be captured at an imaging speed according to the tendency of the moving speed of the digital camera 1 by the user without causing a subject blur or the like. Can be imaged.

  In the first to third embodiments described above, the digital camera is provided with a time measuring means such as a CPU 7 or a timer, and the digital camera detects changes in the angle of view of captured images sequentially captured at predetermined time intervals (for example, 7 fps, 10 fps). It is also possible to measure one moving distance, measure the time required for moving the moving distance with a timer, and calculate the camera moving speed from the moving distance and time. In this way, the camera moving speed can be calculated from the moving distance based on the change in the angle of view of the captured images that are sequentially captured and the time required to move the moving distance without causing blurring of the subject. An image can be captured at an imaging speed corresponding to the tendency of the moving speed of the digital camera 1 by the user.

  In the first to third embodiments described above, the shutter speed is determined according to whether the user's camera moving speed is “slow” or “fast”. However, the brightness (exposure) as the shooting environment is further set. It may be added to one of the determination conditions. For the brightness of the shooting environment, an existing exposure meter or the like may be used.

  FIG. 13 is a diagram showing conditions for determining the shutter speed according to the camera moving speed of the user and the brightness (exposure) at that time. As shown in the figure, when the camera moving speed of the user is “slow”, the shutter speed is 1/500 (s) if shooting is outdoors (daytime), 1/250 (s) if indoors, and outdoor If it is (nighttime), 1/100 (s), if the user's camera moving speed is “fast”, the shutter speed should be 1/1000 (s) if shooting is outdoors (daytime), indoors. For example, 1/500 (s), and outdoors (nighttime), 1/100 (s) may be used. In this way, by determining the shutter speed according to the brightness as the shooting environment in addition to the camera moving speed, it is possible to select a more appropriate shutter speed, without causing subject blurring, etc. An image can be taken at an imaging speed corresponding to the tendency of the moving speed of the digital camera 1 by the user.

  Note that the threshold for determining whether the camera movement speed is “slow” or “fast” is, for example, a threshold of 0.5 seconds when the time interval for capturing an image for synthesis is used as the camera movement speed. Is less than 0.5 seconds and is “fast”, 0.5 seconds or more is “slow”, and when the angular velocity is used as the camera movement speed, for example, the threshold is set to 40 [deg / s] and 40 [deg / s]. It may be smaller than “deg / s] and“ fast ”, and 40 [deg / s] or more may be“ slow ”.

  In addition, as described above, the shutter speed is not changed according to the user's camera moving speed and the shooting environment (indoor, outdoor (day, night)), but instead of the shutter speed, the shooting environment ( You may make it change an ISO value according to indoor and outdoor (daytime, night).

As mentioned above, although several embodiment of this invention was described, this invention is not limited to these, The invention described in the claim, and its equal range are included.
Below, the invention described in the claims of the present application is appended.

(Appendix 1)
The invention according to attachment 1 is an imaging apparatus comprising: an imaging unit; and a generation unit that sequentially acquires a plurality of images captured by the imaging unit and generates a panoramic image from the acquired plurality of images. An imaging control unit that causes the imaging unit to sequentially capture a plurality of images while the imaging device is moved, and a shutter speed at the time of imaging of the imaging unit based on a moving speed while the imaging device is moved. An image pickup apparatus comprising: a changing unit that changes

(Appendix 2)
The invention according to attachment 2 further includes a movement speed storage unit that stores a past movement speed of the imaging apparatus, and the changing unit is based on the past movement speed stored in the movement speed storage unit. The imaging apparatus according to appendix 1, wherein a shutter speed at the time of imaging by the imaging unit is changed.

(Appendix 3)
The invention according to appendix 3 includes a moving speed measuring unit that measures the moving speed during imaging by the imaging unit, and a moving speed storage unit that includes the moving speed of the imaging apparatus measured by the moving speed measuring unit. The imaging apparatus according to appendix 2, further comprising: a movement speed update unit that updates the past movement speed stored in the storage area.

(Appendix 4)
In the invention according to appendix 4, the moving speed measuring unit measures the moving speed of the imaging device in provisional shooting prior to the main shooting, and the changing unit sets the moving speed measured by the moving speed measuring unit. The imaging apparatus according to appendix 1, wherein a shutter speed at the time of imaging of the imaging unit is changed based on the imaging unit.

(Appendix 5)
According to the fifth aspect of the invention, the moving speed measuring unit sequentially measures the moving speed of the imaging device during imaging by the imaging unit, and the changing unit is configured to measure the moving speed during imaging by the imaging unit. The imaging apparatus according to appendix 1, wherein a shutter speed at the time of imaging by the imaging unit is sequentially changed based on a moving speed sequentially measured by the measuring unit.

(Appendix 6)
The invention according to appendix 6 includes a moving speed change amount calculating means for sequentially calculating the moving speed change amount during imaging by the imaging means, and a moving speed change amount calculated by the moving speed change amount calculating means. Determining means for determining whether or not the moving speed is greater than or equal to a predetermined threshold value, and the changing means determines that the change amount of the moving speed is greater than or equal to a predetermined threshold value when the determining means determines that the imaging The imaging apparatus according to appendix 5, wherein the shutter speed at the time of imaging of the means is changed.

(Appendix 7)
The invention according to appendix 7 further includes a time measuring unit that measures a time required for the imaging apparatus to reach a predetermined position, and a distance measuring unit that measures a distance until the predetermined position is reached. The moving speed measuring means calculates the moving speed of the imaging apparatus based on the time measured by the time measuring means and the distance measured by the distance measuring means. An imaging device.

(Appendix 8)
In the invention according to attachment 8, the moving speed measuring unit is a gyro sensor that detects an angular velocity of the imaging device, and the changing unit is based on the angular velocity of the device apparatus detected by the gyro sensor. The imaging apparatus according to any one of appendices 2 to 6, wherein a shutter speed at the time of imaging by the imaging unit is changed.

(Appendix 9)
The invention according to attachment 9 further includes detection means for detecting ambient brightness, wherein the changing means is a moving speed while the imaging apparatus is being moved, and ambient brightness detected by the detection means. The image pickup apparatus according to any one of appendices 1 to 8, wherein a shutter speed at the time of image pickup by the image pickup unit is changed based on the above.

(Appendix 10)
In the invention according to attachment 10, the imaging control unit sequentially captures images at a predetermined time interval by the imaging unit, and each time the imaging apparatus reaches a predetermined position during the movement process, the imaging is performed at that position. Any one of appendices 1 to 9, wherein an image is captured, and the generation unit generates a panoramic image by synthesizing a plurality of captured images that are captured each time the predetermined position is reached. It is an imaging device described in the above.

(Appendix 11)
The invention according to attachment 11 is an imaging apparatus including an imaging unit, and a generation unit that sequentially acquires a plurality of images captured by the imaging unit and generates a panoramic image from the acquired plurality of images. In the imaging control method, the imaging control step of sequentially imaging a plurality of images by the imaging means while moving the imaging device, and the imaging speed based on the moving speed while moving the imaging device And a changing step of changing an imaging speed at the time of imaging of the means.

(Appendix 12)
The invention according to attachment 12 includes an imaging unit that captures an image, and a generation unit that sequentially acquires a plurality of images captured by the imaging unit and generates a panoramic image from the acquired plurality of images. An imaging control unit that sequentially captures a plurality of images by the imaging unit while moving the imaging device, and a moving speed of the imaging unit while the imaging device is moving. A program that functions as a changing unit that changes an imaging speed at the time of imaging.

DESCRIPTION OF SYMBOLS 1 Digital camera 2 Imaging part 3 Imaging control part 4 Image processing part 5 Movement distance measurement part 6 Movement speed calculation part 7 CPU
8 RAM
9 ROM
DESCRIPTION OF SYMBOLS 10 Recording part 11 Display part 12 Key input part 20 Overlapping area determination part 21 Image position adjustment part 22 Image composition part 24 Movement speed storage part

Claims (12)

In an imaging apparatus comprising: an imaging unit; and a generation unit that sequentially acquires a plurality of images captured by the imaging unit and generates a panoramic image from the acquired plurality of images.
Imaging control means for causing the imaging means to sequentially capture a plurality of images while the imaging apparatus is moved;
An imaging apparatus comprising: a changing unit that changes a shutter speed at the time of imaging of the imaging unit based on a moving speed while the imaging apparatus is moved. A moving speed storage means for storing the past moving speed of the imaging apparatus;
The imaging apparatus according to claim 1, wherein the changing unit changes a shutter speed at the time of imaging of the imaging unit based on the past moving speed stored in the moving speed storage unit. A moving speed measuring means for measuring the moving speed during imaging by the imaging means;
The moving speed update means for updating the past moving speed stored in the moving speed storage means with the moving speed of the imaging apparatus measured by the moving speed measuring means. 2. The imaging device according to 2. The moving speed measuring means measures the moving speed of the imaging device in provisional shooting prior to actual shooting,
The imaging apparatus according to claim 1, wherein the changing unit changes a shutter speed at the time of imaging of the imaging unit based on a moving speed measured by the moving speed measuring unit. The moving speed measuring means sequentially measures the moving speed of the imaging device during imaging by the imaging means,
The change means sequentially changes a shutter speed at the time of imaging of the imaging means based on a moving speed sequentially measured by the moving speed measuring means during imaging by the imaging means. The imaging device described in 1. A moving speed change amount calculating means for sequentially calculating an amount of change in the moving speed during imaging by the imaging means;
Discrimination means for discriminating whether or not the movement speed change amount calculated by the movement speed change amount calculation means is equal to or greater than a predetermined threshold;
The said changing means changes the shutter speed at the time of imaging of the said imaging means, when it determines with the variation | change_quantity of the said moving speed being more than a predetermined threshold value by the said determination means. Imaging device. Clocking means for timing the time required for the imaging device to reach a predetermined position;
Distance measuring means for measuring the distance to reach the predetermined position,
The moving speed measuring means includes
The imaging apparatus according to claim 2, wherein the moving speed of the imaging apparatus is calculated based on the time measured by the time measuring means and the distance measured by the distance measuring means. The moving speed measuring means is a gyro sensor that detects an angular speed of the imaging device,
The imaging unit according to any one of claims 2 to 6, wherein the changing unit changes a shutter speed at the time of imaging of the imaging unit based on an angular velocity of the apparatus apparatus detected by the gyro sensor. apparatus. It further comprises detection means for detecting ambient brightness,
The changing unit is configured to change a shutter speed at the time of imaging of the imaging unit based on a moving speed while moving the imaging apparatus and an ambient brightness detected by the detecting unit. The imaging device according to any one of claims 1 to 8. The imaging control unit sequentially captures images at a predetermined time interval by the imaging unit, and captures a captured image captured at that position every time the imaging device reaches a predetermined position during the movement process,
The said production | generation means produces | generates a panoramic image by synthesize | combining the some captured image picked-up every time it arrives at the said predetermined | prescribed position. Imaging device. In an imaging control method in an imaging apparatus comprising: an imaging unit; and a generation unit that sequentially acquires a plurality of images captured by the imaging unit and generates a panoramic image from the acquired plurality of images.
An imaging control step of sequentially capturing a plurality of images by the imaging means while moving the imaging device;
An imaging control method comprising: a changing step of changing an imaging speed at the time of imaging of the imaging unit based on a moving speed while moving the imaging apparatus. An imaging apparatus comprising: an imaging unit that captures images; and a generation unit that sequentially acquires a plurality of images captured by the imaging unit and generates a panoramic image from the plurality of acquired images.
An imaging control unit that sequentially captures a plurality of images by the imaging unit while moving the imaging device;
A program that functions as a changing unit that changes an imaging speed at the time of imaging of the imaging unit based on a moving speed while the imaging apparatus is moved.

Images