JP6525692B2 - Image processing apparatus, control method therefor, control program, and imaging apparatus - Google Patents

Description

  The present invention relates to an image processing apparatus, a control method thereof, a control program, and an imaging apparatus, and in particular, an image processing apparatus that performs image composition processing on a plurality of images obtained as a result of photographing an astronomical object moving by periodical movement. About.

  In general, when photographing an astronomical object, it is necessary to perform long-time exposure such as 30 seconds or 1 minute because the amount of light of an astronomical object such as a star is very small. And, because the celestial body is performing a diurnal movement in accordance with the rotation of the earth, if it is exposed for a long time, the celestial body will not be a point image but a light trace. Therefore, when photographing celestial bodies, photography is generally performed using an equatorial telescope or the like dedicated to celestial bodies that can track celestial bodies in accordance with the movement of celestial bodies moving by circling motion.

  However, the equatorial mount is expensive and heavy, and not only does it need to be set when it is used, but its operation is also difficult. Therefore, without using the equatorial mount, multiple shots are taken with an exposure time that does not cause the light object to become a light trace, and the deviation of the light object due to the circumstantial motion occurring between the images is corrected and combined into one image The thing is done. As a result, imaging can be performed with the same exposure as when exposure is performed for a long second, without using the celestial body as a light trace.

  In the above-described image synthesis method, the image is first divided into a plurality of blocks, and the motion vector of the celestial body is calculated for each of the blocks. Then, the motion of the celestial body is calculated based on the motion vector to perform image shift correction.

  As such an image synthesizing method, for example, there is a method in which the total exposure time is determined according to the brightness of the subject, and the divided exposure is performed N times in such an exposure time that the celestial body does not become a light trace. Reference 1). Then, in this case, image shift correction is performed according to the motion vector between images, and one image is synthesized. Furthermore, when calculating a motion vector, there is one in which the search range is switched according to the focal length (see Patent Document 2).

JP 2003-259184 A Japanese Patent Application Laid-Open No. 4-180487

  However, in both of the patent documents 1 and 2, when the number of pixels is large, not only the time required for the image shift correction increases, but also the processing load increases, and the time required for photographing also increases. As a result, when photographing an astronomical object such as a nebula, the astronomical object as a subject may come out of the photographing range and a desired image may not be obtained.

  In order to cope with such a situation, for example, a cropping area for detecting a motion vector may be set at a predetermined position of an image. However, in the case of astronomical radiography, since the direction of the diurnal motion is different depending on the direction, it is difficult to calculate the motion vector with high accuracy unless the cropping area is set at an appropriate part of the image.

  Therefore, it is an object of the present invention to provide an image processing capable of calculating a motion vector necessary for image shift correction at high speed and efficiently by setting a crop area at a position where processing can be performed with high accuracy and at high speed. Abstract: An apparatus, a control method thereof, a control program, and an imaging apparatus.

In order to achieve the above object, an image processing apparatus according to the present invention is an image processing apparatus that combines a plurality of images obtained by photographing a moving subject into a composite image, the image processing apparatus comprising: First calculation means for obtaining a reference axis indicating a reference point when the subject moves according to an image, and setting a detection area for detecting a motion vector in each of the images according to the reference axis possess means, second calculating means for determining a motion vector of the object in the detection region, and an image synthesizing means for said synthesized image by synthesizing processing the image of the plurality on the basis of the motion vector The setting means sets the detection area on a straight line connecting the reference axis and the center point of the image .

  An image pickup apparatus according to the present invention is characterized by comprising: an image pickup means for picking up the plurality of images; an image processing apparatus as described above; and a recording means for recording a composite image obtained by the image processing apparatus. .

A control method according to the present invention is a control method of an image processing apparatus which combines a plurality of images obtained by photographing moving objects into a combined image, and the objects according to the plurality of images. A first calculation step of obtaining a reference axis indicating a reference point at the time of movement, a setting step of setting a detection area for detecting a motion vector in each of the images according to the reference axis, and a second calculation step of obtaining a motion vector of the object in the synthesized processed image of said plurality based on the motion vector have a, an image combining step to the composite image, in the setting step, The detection area is set on a straight line connecting the reference axis and the center point of the image .

A control program according to the present invention is a computer readable control program for causing a computer to execute each means of the image processing apparatus described above .

According to the present invention, it is possible to calculate the motion vectors required to shift correction during images synthesized quickly and efficiently.

It is a block diagram showing the composition about an example of an imaging device provided with an image processing device by an embodiment of the invention. It is a figure for demonstrating the function of the system control part at the time of calculating a motion vector in the camera shown in FIG. It is a flowchart for demonstrating the crop area | region setting process performed at the time of an image synthetic | combination process in the camera shown in FIG. It is a figure for demonstrating the 1st example of the setting of the crop area | region performed in the camera shown in FIG. It is a figure for demonstrating the 2nd example of a setting of the crop area | region performed in the camera shown in FIG. It is a figure for demonstrating the 3rd example of a setting of the crop area | region performed in the camera shown in FIG.

  Hereinafter, an example of an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an example of an imaging apparatus provided with an image processing apparatus according to an embodiment of the present invention.

  The illustrated imaging apparatus 100 is, for example, a digital camera (hereinafter simply referred to as a camera), and includes a photographing lens unit (hereinafter simply referred to as a photographing lens) 103. A mechanical shutter 101 having an aperture function is disposed downstream of the photographing lens 103, and an optical image (object image) is incident on the imaging unit 22 through the photographing lens 103. In addition, on the front side of the photographing lens 103, a barrier 102 for protecting the photographing lens 103, the shutter 101, and the imaging unit 22 is disposed.

  The imaging unit 22 includes an imaging device such as a CCD or a CMOS sensor, and the imaging device outputs an electrical signal (analog signal) corresponding to the optical image. Then, the analog signal is converted by the A / D converter 23 into a digital signal (image data).

  The imaging element provided in the imaging unit 22 has, for example, a Bayer array in which R (red), G (green), and B (blue) pixels are regularly arranged. The pixel arrangement of the imaging device is not limited to the Bayer arrangement. Further, the system control unit 50 controls the imaging unit 22, the photographing lens 103, and the shutter 101 by a timing generation circuit (not shown).

  Furthermore, in the illustrated camera, by controlling the reset timing of the imaging device, the accumulation time in the imaging device can be controlled (so-called electronic shutter). This electronic shutter is used, for example, for moving image shooting.

  The image processing unit 24 performs various correction processing such as predetermined pixel interpolation processing and shading correction on the image data from the A / D converter 23 or the image data from the memory control unit 15, and performs white balance processing, γ Perform correction processing and color conversion processing. Further, the image processing unit 24 performs image clipping and scaling processing to perform electronic zoom.

  At the time of shading correction, the image processing unit 24 corrects the luminance level in the image in order to correct the shading that occurs due to the characteristics of the photographing lens 103 and the characteristics such as the aberration of the imaging unit 22 for the image data. After the shading correction processing, the image processing unit 24 performs white balance (WB) processing for matching white reference in the image with white for the image data.

  Here, when performing the shading correction, the image processing unit 24 performs the correction of multiplying the gain for each pixel according to the two-dimensional coordinates (position) of the imaging element. In addition, in the case of the WB process, the image processing unit 24 performs a process of multiplying different gains for each of R, G (G 1 and G 2), and B in the Bayer arrangement.

  The image combining unit 54 performs an image combining process on a plurality of image data to generate one image data. In the illustrated example, the image combining unit 54 selects not only the simple addition combination or the addition average combination but also the brightest or darkest region in each of the regions of the image data to be combined, and combines these regions 1 It is possible to perform comparative bright combining processing or comparative dark combining processing for generating image data of a sheet. The image combining unit 54 may be integrated with the image processing unit 24.

  In addition, the image processing unit 24 performs predetermined arithmetic processing on image data. The system control unit 50 controls the exposure control unit and the distance measurement control unit (both not shown) based on the calculation result obtained by the image processing unit 24 to execute TTL AF processing, AE processing, and EF processing. Do.

  The memory control unit 15 controls the A / D converter 23, the image processing unit 24, and the memory 32 under the control of the system control unit 50. Then, the image data that is the output of the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15 or directly via the memory control unit 15. The display unit 28 is, for example, a TFT LCD, and the memory control unit 15 displays the image data written in the memory 32 on the display unit 28 as an image.

  If image data obtained by repeatedly performing exposure and readout in a predetermined cycle in the imaging unit 22 is displayed on the display unit 28 via the image processing unit 24 and the memory control unit 15, live view display and an electronic finder Can be realized. The display unit 28 can turn on or off the display under the control of the system control unit 50. When the display is turned off, the power consumption of the camera 100 can be significantly reduced.

  As described above, the memory 32 stores image data (still image and moving image) obtained as a result of imaging. The memory 32 has a sufficient storage capacity for storing a predetermined number of still images and a moving image for a predetermined time. As a result, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, writing of a large amount of image data can be performed to the memory 32 at high speed. The memory 32 can be used as a work area of the system control unit 50.

  The system control unit 50 controls the entire camera 100. The non-volatile memory 56 is, for example, a flash ROM, and a control program or the like is stored in the non-volatile memory 56. The system control unit 50 executes the control program to perform various processes described later. The non-volatile memory 56 is provided with an area for storing system information and an area for storing user setting information, and when the camera is activated, various information and settings are read from these areas and restored. .

  For example, a RAM is used as the system memory 52. In the system memory 52, constants and variables for the operation of the system control unit 50, and a control program read from the non-volatile memory 56 are expanded. Further, the system control unit controls the memory 32 and the display unit 28 to perform display control. A system timer 53 is a clock unit that measures time used for various controls and time of a built-in clock.

  The operation unit 70 is provided with various buttons and a touch panel. For example, as various buttons, there are a shutter switch (SW1 and SW2), a menu button, a set button, a macro button, a flash setting button, a single shot / continuous shooting / self timer switching button, and the like. Furthermore, as various buttons, there are a menu movement + (plus) button, a menu movement-(minus) button, a shooting image quality selection button, an exposure correction button, a date / time setting button, and the like.

  During operation of the shutter button, the shutter switch SW1 is turned on, and the system control unit 50 starts AF (auto focus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and the like. When the operation of the shutter button is completed, the shutter switch SW2 is turned on, and the system control unit 50 starts a series of processes such as an exposure process, a development process, a compression / decompression process, and a recording process.

  As the power supply unit 30, for example, a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery is used, and the power supply unit 30 further includes an AC adapter and the like. . The power supply unit 30 is controlled by the power supply control unit 80.

  The recording medium 200 is removable from the camera 100, and for example, a memory card or a hard disk is used. The recording medium 200 is connected to the camera 100 by an interface (I / F) 18.

  When the system control unit 50 calculates a rotation axis and a motion vector, which will be described later, the operation unit 51 executes a predetermined operation.

  FIG. 2 is a diagram for explaining the function of the system control unit 50 when calculating the motion vector in the camera shown in FIG.

  As illustrated, the system control unit 50 includes a motion vector detection unit 201, a motion vector calculation unit 202, a motion vector correction operation unit 203, and a rotation axis calculation unit 204 as functional blocks. The motion vector detection unit 201 receives image data and detects a motion vector of a subject (celestial body) between images. The motion vector calculation unit 202 cooperates with the motion vector correction operation unit 203 to correct the motion vector after correction according to the vector correction amount obtained by the motion vector correction operation unit 203 and the motion vector detected by the motion vector detection unit. Ask for

  The motion vector correction operation unit 203 obtains a vector correction amount according to the corrected motion vector obtained by the motion vector calculation unit 202, the focal length, and the aperture value. The rotation axis calculation unit 204 corrects the motion vector based on the vector correction amount obtained by the motion vector correction operation unit 203. Then, the rotation axis calculation unit 204 obtains a point at which the direction of the motion vector and the scalar amount become zero according to the direction and the scalar amount of the motion vector obtained for each of a plurality of search areas extracted from the image. Then, the rotation axis calculation unit 204 integrates the zero points for each search area to calculate the rotation axis of the image (a reference axis indicating a reference point). The motion vector data and the rotation axis data thus calculated are temporarily stored in the memory 32, for example.

  Here, a combining process for combining a plurality of image data performed by the camera 100 shown in FIG. 1 will be described.

  The image combining unit 54 can perform the four combining processes described above as the combining process, the weighted addition combining process, the comparative bright combining process, and the comparative dark combining process as the combining process.

  Now, assuming that the pixel value of the image data before composition is I_i (x, y) (i = 1 to N, x and y indicate coordinates in the image), N sheets (N is an integer of 2 or more) are combined Let the pixel value of the composite image after processing be I (x, y). As pixel values, signal values of R, G1, G2, and B in Bayer arrangement may be used, and luminance signal values (luminance values) obtained from groups of R, G1, G2, and B signals. May be used.

  Furthermore, after the interpolation processing is performed on the signals in the Bayer arrangement so that the R, G, and B signals exist for each pixel, the luminance value may be determined for each pixel. When obtaining the luminance value, for example, assuming that the luminance value is Y, a method of calculating by weighted addition of R, G, and B signals such as Y = 0.3 × R + 0.59 × G + 0.11 × B. Is used.

  The image combining unit 54 performs an addition combining process according to the following equation (1) with respect to pixel values associated with each other by performing processing such as alignment among a plurality of pieces of image data as necessary.

I (x, y) = I_1 (x, y) + I_2 (x, y) +... + I_N (x, y) (1)
The image combining unit 54 combines the pixel values of the N images for each pixel and combines them into composite image data.

  In the weighted addition and combining process, the image combining unit 54 performs weighted addition and sum process according to the following equation (2), using ak as a weighting coefficient.

I (x, y) = (a1 x I_1 (x, y) + a2 x I_2 (x, y) + ... + aN x I_N (x, y)) / N (2)
The image combining unit 54 uses weighted addition combining processing of pixel values of N sheets of images for each pixel as combined image data.

  In the comparative bright combining process, the image combining unit 54 performs the comparative bright combining process according to the following equation (3).

I (x, y) = max (I_1 (x, y), I_2 (x, y), ..., I_N (x, y)) (3)
The image combining unit 54 selects the maximum value of the pixel values of N images for each pixel, and sets the maximum value as combined image data.

  In the comparison dark synthesis process, the image synthesis unit 54 performs the comparison dark synthesis process according to the following equation (4).

I (x, y) = min (I_1 (x, y), I_2 (x, y), ..., I_N (x, y)) (4)
The image combining unit 54 selects the minimum value of the pixel values of N images for each pixel, and sets the minimum value as combined image data.

  Here, when performing the comparative bright combining processing, the comparative bright combining processing is performed in the following procedure. First, the system control unit 50 starts interval shooting according to the user's operation. Then, the system control unit 50 sets the first image of the plurality of images in the composition memory area set in the memory 32 as an initial value.

  Next, under the control of the system control unit 50, the image combining unit 54 compares the luminance at the same pixel in the second image and the first image set in the combining memory area. Then, the image combining unit 54 stores the pixel value having the higher luminance in the combining memory area.

  The above process is performed on all pixels of the first image and the second image, and the image combining unit 54 stores a combined image of the first image and the second image in the combining memory area. Do.

  Subsequently, for the third and subsequent images, the image combining unit 54 performs luminance on the same pixel as the combined image stored in the combining memory area and the image to be processed (that is, the third image here). Compare Then, the pixel value having the higher luminance is stored in the synthesis memory area. Furthermore, the image combining unit 54 performs the process on all pixels of the combined image and the image to be processed.

  Thus, the image combining unit 54 performs the above-described processing on all the images to be processed. That is, the image combining unit 54 performs the process represented by the following equation (5).

I2 (x, y) = max (I_1 (x, y), I_2 (x, y))
I3 (x, y) = max (I2 (x, y), I_3 (x, y))
....
I (x, y) = IN (x, y) = max (IN-1 (x, y), I_N (x, y)) (5)
FIG. 3 is a flowchart for explaining crop region setting processing performed in the image combining processing in the camera 100 shown in FIG. The process according to the illustrated flowchart is performed under the control of the system control unit 50.

  When starting the crop area setting process, the system control unit 50 starts photographing of an image (vector extraction image) according to the user's operation (step S301). When photographing of a plurality of sheets is completed, the image processing unit 24 reduces the plurality of images under control of the system control unit 50 (step S302).

  Subsequently, the system control unit 50 performs motion vector detection and rotation axis calculation on the image obtained by the reduction process as described with reference to FIG. 2 (step S303). After obtaining the rotation axis (reference axis) of the image, the system control unit 50 sets a crop area (detection area) according to the rotation axis in order to obtain an accurate motion vector (step S304). The setting of the cropping area will be described later.

  A plurality of cropping areas are set, and after setting cropping areas, the system control unit 50 calculates motion vectors in the cropping area by the motion vector calculating unit 202 and the rotation axis calculating unit 204 described in FIG. 2 (step S305). In this process, it is not necessary to calculate up to the rotation axis.

  Next, the system control unit 50 determines whether a predetermined number of cropping areas have been set (step S306). If a predetermined number of crop areas are not set (NO in step S306), the system control unit 50 returns to the process of step S304 to set crop areas.

  On the other hand, when a predetermined number of crop areas are set (YES in step S306), that is, when the crop area setting of step S304 and the motion vector calculation of step S305 are performed for a predetermined number of crop areas, the system control unit 50 performs cropping. End the area setting process. Then, the system control unit 50 integrates the motion vectors obtained for each cropping area, and the image combining unit 54 performs an image combining process according to the integrated motion vectors.

  Here, the setting of the cropping area described in FIG. 3 will be described.

  FIG. 4 is a diagram for explaining a first example of setting of cropping regions performed in the camera shown in FIG.

  First, as described above, the rotation axis 43 of the image is obtained. The rotation shaft 43 may be outside the area of the image. The celestial body 46 is performing periodical movement about an axis called polar axis. In order to extract motion vectors with high accuracy, it is advantageous that the moving amount of the celestial body 46 moving in a unit time in the image is large, and setting the crop area in the area where the celestial body 46 does not move correctly obtains the motion vector I can not do it.

  In general, when photographing the celestial body 46, for example, there are a so-called nebula photograph for photographing so-called nebula and so on and a star scene photograph and so on for photographing together a landscape and the like. In the case of a star landscape photograph, it is not preferable to set a cropping area in the area, since a landscape or the like usually enters at the bottom of the image.

  Therefore, as shown in FIG. 4, when setting the cropping area 45, the rotation axis 43 is used as a starting point, on the straight line 42 connecting the rotation axis 43 and the upper end of the image far from the rotation axis 43 or The cropping region is on the image on the upper side of the image center point 44 above the image center point 44 on the straight line 41 connecting the image center 43 and the center point 44 of the image and on the opposite side to the side where the rotation axis 43 is located It is desirable to set 45. By setting the cropping area 45 in this manner, the area of the celestial body 46 away from the rotation axis 43 can be set as the cropping area 45. As a result, a highly accurate motion vector can be obtained.

  Crop regions may be set on a straight line 42 connecting the rotation shaft 43 and the upper end of the image far from the rotation shaft 43 and on a straight line 41 connecting the rotation shaft 43 and the image center axis, A plurality of cropping areas may be set on a straight line.

  FIG. 5 is a diagram for explaining a second example of setting of cropping regions performed in the camera shown in FIG.

  As described above, after the rotation axis 43 is determined (again, the rotation axis 43 may be outside the area of the image), the cropping area 45 is set in an area equidistant from the rotation axis 43. That is, a plurality of cropping areas 45 are set on an arc centered on the rotation axis 43. As described above, since it is possible to detect the motion vector more accurately if it is separated from the rotation axis 43, it is advantageous that the distance from the crop area 45 to the rotation axis 43 is longer.

  On the other hand, when the distance from the rotation axis 43 is maximized, the image does not exist and the crop area 45 can not be set. Therefore, it is desirable to set the distance between the crop area 45 and the rotation axis 43 in consideration of the size of the image. Further, since there is a possibility that a landscape or the like may enter the lower part of the image, it is desirable to set the cropping area 45 on the upper side of the image on a curve equidistant from the rotation axis 43.

  Here, as described above, the method of setting the cropping area 45 on the straight lines 41 and 42 extending from the rotation axis 43 and the method of setting the cropping area 43 so as to be equidistant from the rotation axis 43 have been described. Furthermore, when it is desired to calculate a motion vector with high accuracy, a motion vector can be obtained even for a search area in which the entire image is divided into small blocks by combining these two methods. As a result, a preferable result is obtained when shooting while tracking an astronomical object.

  In addition, when photographing a nebula photograph, the angle of view is often narrowed using a telephoto lens or the like. In this case, it may be difficult to determine the rotation axis in the periodic movement of the celestial body from the image. In this case, the rotation axis can be correctly determined by combining information such as the turning angle and the orientation (attitude) detected by a gyro sensor (detection means) or the like separately mounted on the camera.

  FIG. 6 is a diagram for describing a third example of crop region setting performed in the camera shown in FIG.

  In FIG. 6, the rotation axis 43 is located in an area near the center of the image. When the rotation axis 43 is obtained from an image obtained by photographing the daily movement of the celestial body 46, if the rotation axis 43 is in the area of the image, a polar axis is present in the image. In this case, in the image, the celestial body 46 moves so as to rotate around the polar axis, so there is almost no movement of the celestial body 46 around the polar axis, and it is difficult to obtain a correct motion vector.

  Therefore, when the rotation axis 43 exists in a predetermined area in the center of the image, the crop area 45 is set on the straight lines 61 and 62 extending from the rotation axis 43 in the horizontal direction and the vertical direction. The cropping area may be set on a straight line extending from the rotating shaft 43 to the upper end of the image. In order to further improve the accuracy, it is desirable to set a cropping area by combining a straight line extending horizontally and vertically from the rotation axis 43 with a straight line extending from the rotation axis 43 to the image end.

  As described above, according to the present invention, when combining a plurality of images obtained by photographing a moving object such as an astronomical object, a cropping region is set in the image based on the rotation axis of the circling motion of the celestial object, and the cropping region Find the motion vector of the celestial body at. By this, it is possible to calculate the motion vector necessary for the shift correction at the time of image composition at high speed and efficiently.

  As apparent from the above description, in the example shown in FIG. 1, the image processing unit 24 and the system control unit 50 function as a first calculating unit, a setting unit, and a second calculating unit. Further, the system control unit 50 and the image combining unit 54 function as an image combining unit. The imaging lens 103, the shutter 102, the imaging unit 22, and the A / D conversion unit 23 constitute an imaging unit.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, The various form of the range which does not deviate from the summary of this invention is also included in this invention .

  For example, the control method may be executed by the image processing apparatus as the control method of the above-described embodiment. Further, a program having the functions of the above-described embodiments may be used as a control program to cause a computer provided with the image processing apparatus to execute the control program. The control program is recorded, for example, on a computer readable recording medium.

Other Embodiments
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

Reference Signs List 15 memory control unit 22 imaging unit 24 image processing unit 28 display unit 32 memory 50 system control unit 51 calculation unit 54 image combining unit 70 operation unit 103 photographing lens

Claims (14)

An image processing apparatus that combines a plurality of images obtained by photographing a moving subject into a combined image,
First calculation means for obtaining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting means for setting a detection area for detecting a motion vector in each of the images according to the reference axis;
Second calculating means for determining a motion vector of the subject in the detection area;
Image combining means for combining the plurality of images based on the motion vector to obtain the combined image;
I have a,
The image processing apparatus , wherein the setting unit sets the detection area on a straight line connecting the reference axis and a center point of the image. An image processing apparatus that combines a plurality of images obtained by photographing a moving subject into a combined image,
First calculation means for obtaining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting means for setting a detection area for detecting a motion vector in each of the images according to the reference axis;
Second calculating means for determining a motion vector of the subject in the detection area;
Image combining means for combining the plurality of images based on the motion vector to obtain the combined image;
Have
The setting means images processor you and sets the detection area on the straight line connecting the corner of the image and the reference axis. An image processing apparatus that combines a plurality of images obtained by photographing a moving subject into a combined image,
First calculation means for obtaining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting means for setting a detection area for detecting a motion vector in each of the images according to the reference axis;
Second calculating means for determining a motion vector of the subject in the detection area;
Image combining means for combining the plurality of images based on the motion vector to obtain the combined image;
Have
The setting means, the side opposite to the side where the reference axis is located the center point of the image as a reference, the detection area images processor you and sets a. An image processing apparatus that combines a plurality of images obtained by photographing a moving subject into a combined image,
First calculation means for obtaining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting means for setting a detection area for detecting a motion vector in each of the images according to the reference axis;
Second calculating means for determining a motion vector of the subject in the detection area;
Image combining means for combining the plurality of images based on the motion vector to obtain the combined image;
Have
The setting means, the reference axis images processor you and sets the detection area on an arc around the. An image processing apparatus that combines a plurality of images obtained by photographing a moving subject into a combined image,
First calculation means for obtaining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting means for setting a detection area for detecting a motion vector in each of the images according to the reference axis;
Second calculating means for determining a motion vector of the subject in the detection area;
Image combining means for combining the plurality of images based on the motion vector to obtain the combined image;
Have
The setting means, the reference axis images processor you characterized in that the horizontal direction towards or to set the detection area on a straight line extending in the vertical direction in the image as a starting point. The image processing apparatus according to any one of claims 1 to 5 , wherein the subject is a celestial body, and the reference axis is a rotation axis in a periodic motion of the celestial body. An imaging unit configured to capture the plurality of images;
An image processing apparatus according to any one of claims 1 to 6 .
Recording means for recording a composite image obtained by the image processing apparatus;
An imaging apparatus characterized by having: A detection unit configured to detect an attitude of the imaging device;
8. The image pickup apparatus according to claim 7 , wherein the setting unit sets the detection area in accordance with the posture detected by the detection unit. A control method of an image processing apparatus which combines a plurality of images obtained by photographing a moving subject and combines them into a composite image.
A first calculation step of determining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting a detection area for detecting a motion vector in each of the images according to the reference axis;
A second calculation step of determining a motion vector of the subject in the detection area;
An image combining step of combining the plurality of images based on the motion vector to obtain the combined image;
I have a,
In the setting step, the detection area is set on a straight line connecting the reference axis and the center point of the image . A control method of an image processing apparatus which combines a plurality of images obtained by photographing a moving subject and combines them into a composite image.
A first calculation step of determining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting a detection area for detecting a motion vector in each of the images according to the reference axis;
A second calculation step of determining a motion vector of the subject in the detection area;
  An image combining step of combining the plurality of images based on the motion vector to obtain the combined image;
Have
In the setting step, the detection area is set on a straight line connecting the reference axis and a corner of the image. A control method of an image processing apparatus which combines a plurality of images obtained by photographing a moving subject and combines them into a composite image.
A first calculation step of determining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting a detection area for detecting a motion vector in each of the images according to the reference axis;
A second calculation step of determining a motion vector of the subject in the detection area;
  An image combining step of combining the plurality of images based on the motion vector to obtain the combined image;
Have
In the setting step, the detection area is set on the opposite side to the side where the reference axis is located with reference to the center point of the image. A control method of an image processing apparatus which combines a plurality of images obtained by photographing a moving subject and combines them into a composite image.
A first calculation step of determining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting a detection area for detecting a motion vector in each of the images according to the reference axis;
A second calculation step of determining a motion vector of the subject in the detection area;
  An image combining step of combining the plurality of images based on the motion vector to obtain the combined image;
Have
In the setting step, the detection area is set on an arc centered on the reference axis. A control method of an image processing apparatus which combines a plurality of images obtained by photographing a moving subject and combines them into a composite image.
A first calculation step of determining a reference axis indicating a reference point when the subject moves according to the plurality of images;
Setting a detection area for detecting a motion vector in each of the images according to the reference axis;
A second calculation step of determining a motion vector of the subject in the detection area;
  An image combining step of combining the plurality of images based on the motion vector to obtain the combined image;
Have
In the setting step, the detection area is set on a straight line extending in a horizontal direction or a vertical direction in the image with the reference axis as a starting point. A computer readable control program for causing a computer to execute each means of the image processing apparatus according to any one of claims 1 to 6 .