JP6700937B2 - Image processing apparatus, control method thereof, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, a control method therefor, and a program, and more particularly, to an image processing apparatus for displaying auxiliary information used when capturing a trajectory of a diurnal motion of an celestial body, a control method therefor, and a program.

  In a camera as an image processing device, shooting is performed by long-time exposure, which is longer than usual. With long exposure, it is possible to capture the motion of a weakly luminescent object or the trajectory of light that cannot be captured in the normal exposure time. With long exposure, for example, the trajectory of the diurnal motion of the celestial body can be captured. Used for. When the trajectory of the diurnal motion of the celestial body is photographed, the display unit provided in the camera displays auxiliary information for assisting the user in determining the composition to be photographed. In order to display the auxiliary information, the camera acquires position information of the camera by a GPS or an elevation angle sensor provided in the camera, and the camera arbitrarily determines based on the acquired position information of the camera and pre-stored position information of the celestial body. Predict the position of the celestial body after the passage of time. After that, the camera superimposes the predicted result as auxiliary information on the live view image displayed on the display unit (see, for example, Patent Document 1). The user can easily grasp the position of the celestial body after an arbitrary time has elapsed by the live view image displayed on the display unit.

JP 2012-4763 A

  However, in the above-mentioned camera, it is necessary to provide a special device such as a GPS or an elevation angle sensor in order to display the auxiliary information. That is, the conventional camera cannot display the auxiliary information for assisting the shooting of the locus of the diurnal motion of the celestial body unless the above-mentioned special device is provided.

  An object of the present invention is to provide an image processing device, a control method thereof, and a program capable of displaying auxiliary information for assisting in capturing the trajectory of the diurnal motion of the celestial body without providing a special device. .

In order to achieve the above object, an image processing device of the present invention is an image processing device capable of generating a trajectory image showing a trajectory of a celestial body based on a plurality of images obtained by photographing, Image capturing means for capturing at least a first captured image and a second captured image captured at different times based on exposure conditions for capturing the plurality of images before capturing the image; the celestial from the difference of the position of the celestial bodies in the captured image and the second detecting means for detecting the celestial in each captured image, the first position of the celestial in the captured image and the second captured image Calculating means for calculating a motion vector of the celestial body , a synthetic image generating means for generating a synthetic image including predicted trajectory information of the celestial body generated based on the calculated motion vector, and at least the sky of the first captured image. Trajectory simulation image generating means for synthesizing the predicted trajectory information of the celestial body included in the synthesized image in a region and generating a trajectory simulation image simulating the trajectory image; and display means for displaying the generated trajectory simulation image. , Are provided.

  According to the present invention, it is possible to display auxiliary information for assisting in capturing the trajectory of the diurnal motion of the celestial body without providing a special device.

It is a block diagram which shows roughly the structure of the camera as an image processing apparatus which concerns on embodiment of this invention. 7 is a flowchart showing a procedure of display processing executed by the camera of FIG. 1. 3A and 3B are diagrams for explaining generation of predicted trajectory information by the camera of FIG. 1, FIG. 3A shows an example of a captured image used for generation of predicted trajectory information, and FIG. 3C shows the calculated predicted position of the star, and FIG. 3D shows an example of the generated predicted trajectory information. It is a figure for demonstrating the locus|trajectory simulation image produced|generated by the camera of FIG. 6 is a flowchart showing a procedure of a trajectory image capturing process executed by the camera of FIG. 1.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram schematically showing a configuration of a camera 100 as an image processing device according to an embodiment of the present invention.

  In FIG. 1, a camera 100 includes a shutter 101, a barrier 102, a taking lens 103, an imaging unit 104, an A/D conversion unit 105, an image processing unit 106, a memory control unit 107, a memory 108, a D/A conversion unit 109, and The display unit 110 is provided. The camera 100 also includes a system control unit 111, a non-volatile memory 112, a system memory 113, a system timer 114, an operation unit 115, a power supply control unit 116, a power supply unit 117, a recording medium I/F 118, and a communication unit 119. The system control unit 111 includes a shutter 101, a taking lens 103, an imaging unit 104, an image processing unit 106, a non-volatile memory 112, a system memory 113, a system timer 114, an operation unit 115, a power supply control unit 116, and a communication unit 119, respectively. It is connected. The system control unit 111, the memory control unit 107, the memory 108, and the recording medium I/F 118 are connected to each other via a system bus 120. The imaging unit 104 is connected to the A/D conversion unit 105, and the A/D conversion unit 105 is connected to the image processing unit 106 and the memory control unit 107, respectively. The D/A conversion unit 109 is connected to the memory control unit 107 and the display unit 110, respectively, and the power supply unit 117 is connected to the power supply control unit 116.

  The camera 100 is capable of capturing a still image and a moving image, and has a starry sky trajectory synthesis mode capable of generating a trajectory image of the diurnal motion of the celestial body using the still image captured by long-time exposure. In the starry sky trajectory combination mode, a trajectory image is generated by comparing a plurality of still images photographed by exposure for a long time and performing comparative bright combining for combining only bright portions. In the present embodiment, when the starry sky trajectory combination mode is set by the operation of the operation unit 115 by the user, the camera 100 causes the trajectory of FIG. 4, which will be described later, as auxiliary information for assisting in determining the composition of the trajectory image taken by the user. The simulation image 400 is displayed on the display unit 110. Thereby, the user can grasp the state of the trajectory of the diurnal motion of the celestial body before taking the trajectory image, and can determine the desired composition of the imaging.

  The shutter 101 has a diaphragm function. The barrier 102 protects an imaging system including the shutter 101, the taking lens 103, and the imaging unit 104. The taking lens 103 is a lens group including a zoom lens and a focus lens. The image pickup unit 104 is an image pickup device including a CCD, a CMOS device, or the like that converts an optical image based on the light flux transmitted through the taking lens 103 into an electrical analog signal. The A/D conversion unit 105 converts the analog signal converted by the imaging unit 104 into a digital signal, and sends the digital signal to the image processing unit 106 and the memory control unit 107. The image processing unit 106 performs various kinds of image processing including pixel interpolation and reduction on the digital signal transmitted from the A/D conversion unit 105, the image data acquired from the memory control unit 107, and the like. In the present embodiment, the image processing unit 106 respectively acquires, from the memory control unit 107, image data of a plurality of, for example, two captured images in which the same star is captured as a subject at different times. The image processing unit 106 detects a star in each captured image based on the acquired image data, and calculates the area occupied by the star in the captured image and the center coordinates of the star in the captured image. Further, the image processing unit 106 detects a motion vector indicating the shift of the position of the star in the two captured images based on the acquired image data. The memory control unit 107 transmits image data based on the digital signal transmitted from the A/D conversion unit 105 to the memory 108. The memory 108 stores image data transmitted from the memory control unit 107 and display data for displaying various information on the display unit 110. The D/A conversion unit 109 converts the image data, the display data, and the like stored in the memory 108 into an analog signal and sends the analog signal to the display unit 110. The display unit 110 includes a display such as an LCD and displays various images based on the analog signal transmitted from the D/A conversion unit 109. The display unit 110 has a function of an electronic viewfinder, and can display an image corresponding to an optical image obtained by a light flux transmitted through the taking lens 103 (live view image display).

  The system control unit 111 totally controls the camera 100, and the system control unit 111 executes various programs stored in the non-volatile memory 112 to perform various controls. The non-volatile memory 112 includes an EEPROM or the like and stores various programs used by the system control unit 111. The system memory 113 includes a RAM and the like and is used as a work area of the system control unit 111. The system memory 113 is used as a temporary storage area for various data. The system timer 114 measures the time used for various controls. The operation unit 115 includes buttons for performing various settings of the camera 100 and various shooting operations. In the present embodiment, for example, the starry sky trajectory combination mode is set by the user operating the operation unit 115, and the exposure conditions used in the starry sky trajectory combination mode and the continuous exposure time in long-time exposure are set. The power supply control unit 116 controls the supply of electric power from the power supply unit 117 to each component provided in the camera 100. The power supply unit 117 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery or a NiMH battery, and an AC adapter, and supplies electric power to each component provided in the camera 100. The recording medium I/F 118 performs data communication with the recording medium 121 such as a connected memory card or hard disk. The communication unit 119 performs data communication such as video signals and audio signals with various devices connected by a cable and various devices capable of wireless communication.

  FIG. 2 is a flowchart showing the procedure of the composite image display process executed by the camera 100 of FIG.

  The process of FIG. 2 is performed by the system control unit 111 executing various programs stored in the nonvolatile memory 112. The processing of FIG. 2 is premised on that the starry sky trajectory combination mode is preset by the operation of the operation unit 115 by the user and is performed before the user captures the trajectory image.

  In FIG. 2, first, the system control unit 111 determines an exposure condition for shooting for generating a trajectory simulation image 400, which will be described later, based on the exposure condition in the starry sky trajectory combination mode (step S201). That is, in the present embodiment, the trajectory simulation image 400 is generated under the same exposure condition as when the trajectory image was captured. Next, the system control unit 111 shoots the same subject including a desired star a plurality of times at different times, for example, twice based on the determined exposure condition. The system control unit 111 respectively generates a first captured image 300 of FIG. 3A which is a captured image of the first capturing and a second captured image which is a captured image of the second capturing (step S202). .. After that, the system control unit 111 stores the generated captured images and information indicating the exposure start time of each captured image in the memory 108. Next, the system control unit 111 acquires each stored captured image (image acquisition unit) and detects a star in each acquired captured image (step S203). Specifically, the system control unit 111 extracts, from each captured image, an isolated point having a pixel value different from that of surrounding pixels among a plurality of pixels forming each captured image, and detects a star from the extracted isolated point. To do. The system control unit 111 acquires subject-related information, which is information related to each star in each captured image, for all the detected stars. The subject-related information includes the center coordinates of each star, the area occupied by each star in each captured image, and the subject-related information includes at least one of the average luminance value of each star and the color information of each star.

  Next, the system control unit 111 calculates the motion vector of each star from the difference between the position of each star in the first captured image and the position of each star in the second captured image (step S204). As shown in FIG. 3B, the system control unit 111 divides each captured image into a plurality of divided areas, and among the plurality of divided areas, for example, a division in which a predetermined number or more of stars are present. A motion vector is calculated for the area. When there are a plurality of divided areas in which a predetermined number of stars or more exist, the system control unit 111 calculates a motion vector for each corresponding divided area. Next, the system control unit 111 determines whether the affine coefficient calculated based on the motion vector is available (step S205). The affine coefficient is used when performing various image processing such as enlargement/reduction and parallel movement on each captured image. In the present embodiment, the system control unit 111 calculates the affine coefficient based on the motion vector, and uses the calculated affine coefficient to calculate, for example, the predicted position of each star when the continuous exposure time has elapsed. To do. If the coordinates (x′, y′) of the subject in the image after image processing are the coordinates (x, y) of the subject in the image before image processing and the affine coefficients (a, b, c, d), the following equation 1 It is calculated by.

  When a plurality of motion vectors are calculated, the system control unit 111 selects at least three or more motion vectors from the calculated plurality of motion vectors in an arbitrary combination. After that, the system control unit 111 calculates the affine coefficient based on each selected motion vector, and calculates the error E of the affine coefficient shown in the following Expression 2 based on each calculated affine coefficient.

  The system control unit 111 measures the number of motion vectors in which the error E of the affine coefficient is equal to or smaller than a preset threshold value. In step S205, the system control unit 111 determines that the affine coefficient calculated based on the motion vector is available when the number of the motion vector is equal to or more than the preset number. On the other hand, when the number of the motion vectors is smaller than the preset number, the system control unit 111 determines that the affine coefficient calculated based on the motion vectors cannot be used.

  As a result of the determination in step S205, when the affine coefficient calculated based on the motion vector is not available, the system control unit 111 ends this processing. On the other hand, as a result of the determination in step S205, when the affine coefficient calculated based on the motion vector is available, the system control unit 111 causes the preset continuous exposure time to elapse based on the calculated affine coefficient. The predicted position of each star at that time is calculated (step S206). In the calculation process of the predicted position, the system control unit 111 calculates the affine coefficient per unit time based on the difference between the exposure start times of the stored captured images. The system control unit 111 also sets a time interval for dividing the continuous exposure time into a plurality of predicted times, and calculates a plurality of predicted positions on each star when the plurality of divided predicted times have passed. For example, when the continuous exposure time is set to 30 minutes, as shown in FIG. 3C, the predicted position of each star after 15 minutes has passed from the starting point, and each predicted position after 30 minutes has passed from the starting point. The predicted position of the star is calculated.

  Next, the system control unit 111 generates the predicted trajectory information 301 of FIG. 3D based on the calculated predicted position of each star. The predicted trajectory information 301 includes a line indicating the trajectory of each star, and the line indicating the trajectory of each star is formed by connecting the predicted positions of each star with a line. In the present embodiment, the line thickness and color of the predicted trajectory information 301 is determined based on the subject related information of each star. For example, when the subject-related information includes the average luminance value of each star, the line thickness of the predicted trajectory information 301 is determined based on the average luminance value of each star, and the subject-related information includes the color information of each star. In this case, the line color of the predicted trajectory information 301 is determined based on the color information of each star. Next, the system control unit 111 generates a synthesis image 302 including the generated predicted trajectory information 301 (step S207) (predicted trajectory information generating means).

  Next, the system control unit 111 is located in front of each star in the first captured image 300, which is the reference of the trajectory simulation image 400, which will be described later, among the acquired first captured image 300 and second captured image. The foreground area including the mountain 303 and the like is detected. In the present embodiment, when detecting the foreground area, the system control unit 111 generates a reduced image in which the first captured image 300 is reduced to a size such that each star in the first captured image 300 cannot be detected. .. The system control unit 111 groups pixels having similar brightness values and color information among a plurality of pixels forming the reduced image, and divides the pixels into a plurality of areas with a pixel having a brightness value and color information abruptly different from an adjacent pixel as a boundary. To divide. As a result, the reduced image is divided into, for example, a mountain region corresponding to the mountain 303 and a sky region corresponding to the sky 304 of the first captured image 300. In addition, the system control unit 111 calculates an average brightness value of each divided area, compares the average brightness value of the sky area and the average brightness value of each area excluding the sky area, and the comparison result is a preset predetermined value. An area having a value equal to or greater than is detected as a foreground area. Next, the system control unit 111 uses the acquired first captured image 300 and the acquired image for composition 302 to perform comparative bright composition. The system control unit 111 synthesizes the predicted trajectory information 301 included in the image for synthesis 302 in an area other than the foreground area in the first captured image 300 to generate the trajectory simulation image 400 (step S208) (composite image generation means). ). That is, in the present embodiment, in the trajectory simulation image 400, the predicted trajectory information 401 is not superimposed on the mountain 403 located in front of the star 402. Next, the system control unit 111 displays the trajectory simulation image 400 on the display unit 110 (step S209) and determines whether the continuous exposure time has been changed (step S210).

  As a result of the determination in step S210, when the continuous exposure time is changed, the system control unit 111 returns to the process of step S206. As a result, the system control unit 111 generates new star prediction trajectory information from the predicted position of the star when the changed continuous exposure time has elapsed. On the other hand, if the result of determination in step S210 is that the continuous exposure time has not changed, the system control unit 111 ends this processing.

  According to the processing of FIG. 2 described above, the predicted star trajectory information 301 is generated based on the motion vector calculated from the difference between the position of the star in the first captured image 300 and the position of the star in the second captured image. It Furthermore, the trajectory simulation image 400 including the predicted trajectory information 301 is generated, and the generated trajectory simulation image 400 is displayed. In order to calculate the motion vector, only the positions of the stars in each of the first captured image 300 and the second captured image need to be acquired, and in order to obtain these positions, the first captured image 300 and the second captured image are acquired. It is only necessary to be able to acquire the captured image of. Therefore, the predicted trajectory information 301 of a star can be displayed without providing a special device.

  In the processing of FIG. 2 described above, the predicted trajectory information 301 of a star includes a line indicating the trajectory of the star, and the thickness and color of the line indicating the trajectory of the star are determined based on the subject-related information. Thus, for example, even if a plurality of stars exist in the first captured image 300 and the second captured image, the thickness and color of the line indicating the trajectory of each star are individually determined based on the subject-related information of each star. This can be set, so that the user can easily specify a desired star from the plurality of stars in the displayed trajectory simulation image 400.

  Further, in the processing of FIG. 2 described above, stars are detected based on the isolated points in each of the first captured image 300 and the second captured image, so special image processing for star detection and star detection is performed. A star can be detected from the first captured image 300 and the second captured image without using the usage information or the like.

  In the above-described process of FIG. 2, when the continuous exposure time is changed, new star predicted trajectory information is generated from the predicted position of the star when the changed continuous exposure time has elapsed. This makes it possible to easily display the predicted trajectory information of the star when the continuous exposure time desired by the user has elapsed.

  Further, in the above-described processing of FIG. 2, the predicted star trajectory information 301 is generated based on the predicted positions of a plurality of stars when a plurality of divided prediction times have passed. As a result, the accuracy of the predicted trajectory information 301 can be improved, and the predicted trajectory information 301 of a star that approximates the trajectory of a star that is actually photographed can be generated.

  In the processing of FIG. 2 described above, the exposure conditions of the first captured image 300 and the second captured image at the time of capturing are determined based on the exposure conditions set when capturing the star trail image. .. Accordingly, the trajectory simulation image 400 including the predicted trajectory information 301 of the star using the first captured image 300 and the second captured image captured based on the exposure condition set when capturing the star trajectory image. Can be generated. That is, it is possible to generate the trajectory simulation image 400 including the predicted trajectory information 301 of the star under the same exposure condition as when the star trajectory image was captured, and thus, the prediction of the star that is approximate to the actually captured star trajectory image can be performed. The trajectory information 301 can be generated.

  Further, in the above-described processing of FIG. 2, the predicted trajectory information 401 is not superimposed on the mountain 403 located in front of the star 402 in the trajectory simulation image 400. As a result, it is possible to prevent the generation of the unnatural trajectory simulation image 400 in which the predicted trajectory information 401 of the star is combined with the mountain 403 located in front of the star 402.

  In the present embodiment, the case where the present invention is applied to the camera 100 as an image processing device that captures the trajectory of the diurnal motion of the celestial body has been described, but the application destination of the present invention is not limited to the camera 100. For example, the present invention can be applied to any image processing apparatus including a client PC or the like that can generate the above-described predicted trajectory information 301. Specifically, the client PC acquires the above-described first captured image 300 and second captured image from the camera 100 or the like. After that, the client PC calculates a motion vector of the star from the difference between the acquired position of the star in the first captured image 300 and the position of the star in the second captured image, and each star is calculated based on the calculated motion vector. The predicted locus information 301 of is generated. Further, the client PC generates a trajectory simulation image 400 including the generated predicted trajectory information 301 and displays the generated trajectory simulation image 400 on a display unit or the like provided in the client PC. As a result, the same effect as that of the above-described present embodiment can be obtained.

  Further, in the present embodiment, each setting value set when the trajectory simulation image 400 is generated may be set as the setting value for capturing the trajectory image.

  FIG. 5 is a flowchart showing a procedure of a trajectory image capturing process executed by the camera 100 of FIG.

  The process of FIG. 5 is performed by the system control unit 111 executing various programs stored in the nonvolatile memory 112. Further, the processing of FIG. 5 is premised on that the trajectory composite photographing mode in which the trajectory image is photographed after the trajectory simulation image 400 is generated is set in advance.

  In FIG. 5, first, the system control unit 111 performs the processing of steps S201 to S210 of FIG. Next, the system control unit 111 determines whether or not the number adjustment setting for adjusting the number of stars included in the trajectory simulation image 400 has been performed by the user's operation of the operation unit 115 (step S501). In the present embodiment, the quantity adjustment setting can be set to increase or decrease the number of stars included in the trajectory simulation image 400 displayed on the display unit 110.

  When the quantity adjustment setting is performed as a result of the determination in step S501, the system control unit 111 determines the pixel value of each pixel forming each of the first captured image 300 and the second captured image based on the quantity adjustment setting. The gain value to be adjusted is set (step S502). As a result, the pixel value of each pixel forming each captured image is changed, and the detection result of the isolated point in each captured image changes. For example, when the gain value is set, a pixel whose difference from the pixel values of the surrounding pixels is large is detected as an isolated point, that is, a star, and the difference from the pixel values of the surrounding pixels is reduced. The pixel is no longer detected as a star. The gain value set in step S502 is held in the memory 108. Next, the system control unit 111 performs the processing from step S206.

  As a result of the determination in step S501, when the quantity adjustment setting is not performed, the system control unit 111 determines whether or not the user has operated the operation unit 115 to instruct the end of the display of the trajectory simulation image 400 (step S503). ).

  As a result of the determination in step S503, when it is not instructed to end the display of the trajectory simulation image 400, the system control unit 111 continues the display of the trajectory simulation image 400 and ends the present process. On the other hand, when the end of display of the trajectory simulation image 400 is instructed as a result of the determination in step S503, the system control unit 111 sets the continuous exposure time for capturing the trajectory image (step S504). Specifically, the system control unit 111 sets the continuous exposure time used in the process of FIG. 2 as the continuous exposure time for capturing the trajectory image. Next, the system control unit 111 sets a gain value for capturing the trajectory image (step S505). Specifically, the system control unit 111 sets the gain value set in step S502 as the gain value for capturing the trajectory image. The continuous exposure time and the gain value set in steps S504 and S505 are displayed on the display unit 110. In the present embodiment, the case where the continuous exposure time and the gain value are set has been described as an example of the setting of the shooting of the locus image, but setting values other than the continuous exposure time and the gain value may be set. For example, each of the setting values such as the white balance, the shutter speed, and the aperture value set when generating the trajectory simulation image 400 may be set as the setting values for capturing the trajectory image. Next, the system control unit 111 determines whether or not the start of shooting the trajectory image is instructed (step S506).

  As a result of the determination in step S506, when the start of shooting the trajectory image is not instructed, the system control unit 111 ends this processing. On the other hand, as a result of the determination in step S506, when the start of shooting the trajectory image is instructed, the system control unit 111 starts shooting the trajectory image based on the setting values set in steps S504 and S505 (step S507). .. In capturing the trajectory image, the system control unit 111 continuously captures images until the set continuous exposure time elapses, and performs comparative bright composition on all the images captured until the continuous exposure time elapses. Generate a trajectory image of the starry sky. The locus image is updated each time a shooting is performed from when the start of shooting is instructed until the continuous exposure time elapses. After that, when the set continuous exposure time elapses, the system control unit 111 ends shooting, saves the trajectory image generated last in the recording medium 121 (step S508), and ends this processing.

  In the process of FIG. 5 described above, each of the setting values set when generating the trajectory simulation image 400 is set as the setting value for capturing the trajectory image. Accordingly, the trajectory image can be captured under the same setting conditions as the trajectory simulation image 400, and thus, the trajectory image approximate to the trajectory simulation image 400 can be captured.

  The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or a device via a network or a storage medium, and one or more processors in a computer of the system or the device read the program. It can also be realized by a process that is executed. The present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100 camera 106 image processing unit 111 system control unit 115 operation unit 300 first captured image 301, 401 predicted trajectory information 402 star 403 mountain 400 trajectory simulation image

Claims (8)

An image processing apparatus capable of generating a trajectory image showing a trajectory of a celestial body based on a plurality of images obtained by shooting,
An image acquisition unit that acquires at least a first captured image and a second captured image captured at different times based on exposure conditions for capturing the plurality of images before capturing the plurality of images ;
Detection means for detecting the celestial body in each of the first captured image and the second captured image;
Calculating means for calculating a motion vector of the celestial body from the difference between the position of the celestial body in the first photographed image and the position of the celestial body in the second photographed image;
Synthetic image generation means for generating a synthetic image including predicted trajectory information of the celestial body generated based on the calculated motion vector,
Trajectory simulation image generation means for synthesizing predicted trajectory information of the celestial body included in the synthesized image in at least the sky region of the first captured image, and generating a trajectory simulation image simulating the trajectory image,
An image processing apparatus comprising: a display unit that displays the generated trajectory simulation image. Detection means for detecting subject-related information including at least one of the color of the celestial body and the luminance of the celestial body in each of the first photographed image and the second photographed image;
Further comprising a prediction trajectory information generating means for generating the prediction trajectory information of the celestial body ,
Estimated track information of the celestial body comprises a line indicating the trajectory of the celestial,
The image processing apparatus according to claim 1, wherein the predicted trajectory information generation unit determines at least one of thickness and color of a line indicating the trajectory of the celestial body based on the subject related information. Further comprising setting means for setting the continuous exposure time,
The estimated track information generating means generates the estimated track information of the celestial body from predicted position of the celestial body when the continuous exposure time has elapsed,
If the continuous exposure time is changed after generating the predicted trajectory information of the celestial body , the predicted trajectory information generation means newly generates a predicted position of the celestial body based on the predicted position of the celestial body when the changed continuous exposure time has elapsed. The image processing apparatus according to claim 2, wherein the predicted trajectory information of the celestial body is generated. The predicted trajectory information generation means sets a time interval for dividing the continuous exposure time into a plurality of predicted times, and based on predicted positions of the plurality of celestial bodies when the plurality of divided predicted times have passed. The image processing apparatus according to claim 3, wherein the predicted trajectory information of the celestial body is generated. The image according to claim 1, wherein the detecting unit detects the celestial object based on an isolated point in each of the first captured image and the second captured image. Processing equipment. The astronomical image processing apparatus according to any one of claims 1 to 5, characterized in that a star. Further comprising a foreground region detecting means for detecting a foreground region that is located in front of the celestial bodies definitive in the first shooting picture image,
The trajectory simulation image generating means, the image processing apparatus according to any one of claims 1 to 6, characterized in that does not synthesize estimated track information of the celestial body contained in the composite image to the foreground area. A control method for an image processing device capable of generating a trajectory image showing a trajectory of a celestial body based on a plurality of images obtained by shooting ,
An image acquisition step of acquiring at least a first captured image and a second captured image captured at different times based on exposure conditions for capturing the plurality of images before capturing the plurality of images ;
A detection step of detecting the celestial body in each of the first captured image and the second captured image;
A calculation step of calculating a motion vector of the celestial body from the difference between the position of the celestial body in the first photographed image and the position of the celestial body in the second photographed image;
A synthetic image generation step of generating a synthetic image including predicted trajectory information of the celestial body generated based on the calculated motion vector;
A trajectory simulation image generating step of synthesizing predicted trajectory information of the celestial body included in the synthesized image in at least the sky region of the first captured image, and generating a trajectory simulation image simulating the trajectory image;
A step of displaying the generated trajectory simulation image, and a control method of the image processing device.