JP6039471B2 - Imaging apparatus and control method thereof - Google Patents

Description

The present invention relates to an imaging apparatus and its control how, in particular, relates to an image processing Hoshikei photos.

  In general, astronomical photography includes photographing called a starry photograph in which a starry sky and a building or mountain other than the star (landscape) are photographed on a single screen, and a hoshino photograph in which a star is stopped.

  In a starry photograph, an image capturing device such as a digital camera is fixed, and a landscape and a starry sky are photographed with a predetermined exposure time. When shooting a starry photograph, since shooting is performed in a dark place, the ISO sensitivity is set to be low enough not to cause noise so as not to deteriorate the image quality, and the exposure time is set longer.

  Although related to the focal length of the lens mounted on the imaging apparatus, the longer the exposure time, the longer the star trajectory is exposed. This star trajectory arises because the stars appear to move relatively due to the rotation of the earth. When taking Hoshino photographs, it is performed while tracking the stars using equipment called an equatorial mount that rotates the imaging device in accordance with the orbit of the stars.

  On the other hand, as a technique for taking a Hoshino photograph, for example, an exposure apparatus is known in which exposure is performed while driving an imaging surface of an imaging device in accordance with a star orbit (see Patent Document 1).

  Furthermore, as a method for taking a Hoshino photo, a reference image is set from a plurality of images taken with the imaging device fixed, and the same star as the reference image is detected from other images and detected. There is one in which the brightness value of each star is added to the star of the reference image to generate a hoshino photograph (see Patent Document 2).

JP 2010-122672 A JP 2006-279135 A

  However, in the method described in Patent Document 1, not only a mechanism for tracking a star is required, but if the landscape is reflected on the screen, the landscape is blurred and photographed by tracking the star.

An object of the present invention, when taking the Hoshikei photos, and sharpen the scenery and stars, yet to provide an imaging apparatus and its control how capable of producing an image trajectory of stars not reflected There is.

To achieve the above object, an imaging apparatus according to the present invention includes an imaging means for imaging the second object to move the first object that are sealed static image data obtained by the photographing of the imaging means wherein a first object and said second detecting means for outputting a detection data by detecting the object, in accordance with the prior danger out data in the first exposure condition according to the first object with obtaining the first photographic image data performs shooting by controlling the imaging means, before Symbol second imaging performed second shooting by controlling the imaging means with the exposure conditions according to the second object and obtained Ru control unit image data, and the second photographic image data of the luminance value is changed to a predetermined luminance value before Symbol second object, synthesis by synthesizing the first captured image data a synthetic unit that generates the image data, that has the features.

The control method according to the present invention is a control method for an image pickup apparatus having an image pickup means for picking up a stationary first subject and a moving second subject, and image data obtained by the image pickup means. the first subject and the detection step of outputting the detection data by detecting said second object, in accordance with the prior danger out data in the first exposure condition according to the first object with obtaining the first photographic image data performs shooting by controlling the imaging means, before Symbol second imaging performed second shooting by controlling the imaging means with the exposure conditions according to the second object and obtained Ru control step the image data, and the second photographic image data of the luminance value is changed to a predetermined luminance value before Symbol second object, synthesis by synthesizing the first captured image data to have a synthetic step that generates image data And features.

  According to the present invention, it is possible to generate an image in which a landscape that is a first subject and a star that is a second subject are clear and the locus of the star is not captured.

1 is a block diagram illustrating a configuration of an example of an imaging apparatus according to a first embodiment of the present invention. It is a flowchart for demonstrating an example of the synthesis | combination of the star-view photograph by the camera shown in FIG. 3 is a flowchart for explaining test imaging and detection of a first subject shown in FIG. 2. It is a figure which shows an example of the 1st test picked-up image obtained with the imaging part shown in FIG. It is a figure which shows the edge detection result of the 1st test picked-up image shown in FIG. It is a figure which shows an example of the edge detection result of the 2nd test picked-up image obtained by the imaging part shown in FIG. FIG. 4 is a diagram illustrating a part of an image on which the edge detection described in FIG. 3 is performed. It is a figure for demonstrating the setting of the block performed by the 1st detection part shown in FIG. It is a figure for demonstrating sticking of the label performed by the 1st detection part shown in FIG. It is a figure which shows typically the north star and the star which rotates centering on the north star. 3 is a flowchart for explaining second subject detection and exposure time calculation shown in FIG. 2. It is a figure which shows the image which match | combined the 2nd to-be-photographed object at the 2nd imaging | photography time with the 2nd to-be-photographed object at the 1st imaging | photography time. It is a figure which shows the search direction of the star according to direction. It is a figure which shows an example of the information management table hold | maintained at the information management part shown in FIG. It is a figure for demonstrating the moving direction of a 2nd to-be-photographed object. It is a figure for demonstrating the example which calculates | requires the moving speed of a star using the pitch of a sensor. It is a figure for demonstrating creation and update of the information management table preserve | saved at the information management part shown in FIG. 1, (a) is the state which reflected the detection result detected at the 1st time on the information management table (B) is a diagram showing a state in which the first star record is updated at the second shooting time, and (c) is a state in which the second star record is updated at the second shooting time. FIG. 6D is a diagram showing a state in which the third star record is updated at the second photographing time. It is a figure for demonstrating the area | region of the 1st to-be-photographed object detected by the 1st detection part shown in FIG. It is a figure for demonstrating how a star enters the back of a building. It is a flowchart for demonstrating the update process of the information management table | surface at the time of performing an exception process in the 2nd detection part shown in FIG. It is a block diagram which shows the structure about an example of the imaging device by the 2nd Embodiment of this invention. It is a flowchart for demonstrating the image composition performed with the camera shown in FIG.

  Hereinafter, an example of an imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing the configuration of an example of an imaging apparatus according to the first embodiment of the present invention.

  The illustrated imaging apparatus 100 is, for example, a digital camera (hereinafter simply referred to as a camera) and includes an imaging unit 101. The imaging unit 101 includes a lens optical system, an imaging device, an AFE (analog front end), a video processing unit, and a time acquisition unit, and an optical image is formed on the imaging device via the lens optical system. The image sensor outputs an electrical signal (analog signal) corresponding to the optical image, and the analog signal is converted into a digital signal by AFE.

  The video processing unit performs predetermined image processing on the digital signal and outputs it as image data. The image data is selectively output to the recording unit 102, the first detection unit 103, and the second detection unit 104 together with the photographing time output from the time acquisition unit.

  The recording unit 102 is detachable from the camera 100, and is, for example, a portable recording medium or an HDD. When the recording unit 102 is selected as the output destination, the image data output from the imaging unit 101 is recorded in the recording unit 102. Further, the recording unit 102 outputs the recorded image data to a first combining unit 108 and a second combining unit 109 described later.

  In the following description, a stationary subject other than the star and the sky is referred to as a first subject, and a star is referred to as a second subject.

  The first detection unit 103 receives the image data and the shooting time, detects the first subject from two pieces of image data having different shooting times, and determines the area of the first subject from the previously input image data. The indicated area coordinates (first area coordinates) are output as first detection data.

  The illustrated camera 100 includes a shooting direction acquisition unit (shooting direction detection means) 106 and an information management unit 107, and the shooting direction acquisition unit 106 is a GPS device or an electronic compass. The imaging direction acquisition unit 106 acquires the optical axis direction that is the imaging direction of the imaging apparatus 100 as optical axis data, and outputs the optical axis data to the second detection unit 104.

  Information management data (also referred to as an information management table), which will be described later, is stored in the information management unit 107, and the second detection unit 104 receives the image data and the shooting time, and outputs the data from the first detection unit 103. The first area coordinates, the optical axis data that is the output of the imaging direction acquisition unit 106, and the information management data that is the output of the information management unit 107 are received. The second detection unit 104 detects a second subject (that is, a star) from the two pieces of image data based on the first region coordinates, the optical axis data, and the information management data. The coordinates indicating the area of the subject (second area coordinates), the luminance value, and the photographing time are output as second detection data.

  In accordance with the second detection data, the information management unit 107 assigns an ID to each star on the screen, which is the second subject, and saves / updates the coordinates and luminance values of each second subject as information management data To do. As described above, this information management data is given to the second detection unit 104 and also to an exposure condition setting unit 105 and a first synthesis unit 108 described later.

  The exposure condition setting unit 105 sets / changes the exposure time, the number of exposures, the area for performing photometry, the ISO sensitivity, and the like in the imaging unit 101. Further, the exposure condition setting unit 105 determines a setting condition based on the first detection data and the information management data.

  The first synthesizing unit 108 reads the image data recorded in the recording unit 102, changes the luminance value of the second subject based on the information management data, and generates a synthesized image (first synthesized image). The composite image is generated and given to the second composite unit 109. The second synthesizing unit 109 generates a second synthesized image as described later according to the first detection data, the image data read from the recording unit 102, and the first synthesized image.

  Here, a description will be given of the composition of a starry photograph in which the starry sky and the landscape are clear and the locus of the star is not captured using the camera 100 shown in FIG.

  FIG. 2 is a flowchart for explaining an example of the synthesis of a starscape photograph by the camera 100 shown in FIG.

  When synthesizing a starry photograph in which the starry sky and scenery are clear and the locus of the star is not captured, test imaging is performed by the imaging unit 101 to obtain test image data. Then, the first detection unit 103 detects the first subject from the test image data as described above (step S2001). Subsequently, the second detection unit 104 uses the first detection data that is the output of the first detection unit 103 to detect the second subject and output the second detection data as described above. To do. Then, the exposure condition setting unit 105 determines an exposure time (that is, an exposure condition) for the first subject and the second subject (step S2002).

  Subsequently, the imaging unit 101 captures an image with the exposure condition (first exposure condition) relating to the first subject set by the exposure condition setting unit 105 to obtain image data (first image data) (step). S2003). Thereafter, the imaging unit 101 captures an image with the exposure condition (second exposure condition) relating to the second subject set by the exposure condition setting unit 105 to obtain image data (second image data) (step S2004). .

  Next, in order to make the second subject clear, the first composition unit 108 performs image composition as described later to obtain a first composition image (first composition image data) (step S2005). Next, the second synthesizing unit 109 synthesizes an image (first image data) obtained as a result of shooting under the exposure condition (first exposure condition) relating to the first subject and the first synthesized image. In this way, a second synthesized image (second image data) is obtained (step S2006), and the synthesis process is terminated.

  FIG. 3 is a flowchart for explaining the test photographing and the detection of the first subject shown in FIG.

  When the test shooting is started, the imaging unit 101 adjusts the ISO sensitivity and performs shooting at a shutter speed (shooting conditions) at which proper exposure is obtained (step S2101). The image obtained by the test shooting in step S201 is called the first test shooting image (first test image data). Then, the imaging unit 101 outputs the first test captured image to the first detection unit 104.

  The imaging unit 101 waits until a predetermined time elapses (step S2102). Here, the predetermined time is, for example, the time until the same star does not overlap on the screen between images obtained when continuous shooting is performed.

  Subsequently, the imaging unit 101 performs shooting under the same shooting conditions as in step S2101 (step S2103). Then, the imaging unit 101 outputs an image obtained as a result of shooting to the first detection unit 104. The image obtained by the test shooting in step S2103 is referred to as a second test shot image (second test image data). The first detection unit 104 detects edges from the first test photographed image and the second test photographed image (step S2104).

  FIG. 4 is a diagram illustrating an example of a first test captured image obtained by the imaging unit 101 illustrated in FIG.

  The first test photograph image shown in FIG. 4 is an image in which the landscape and the starry sky are photographed. In the image 200, a building 201, a star A (202), and a star B (203) are captured. Assume that the shooting time of the first test shot image is time t1.

  FIG. 5 is a diagram showing the edge detection result of the first test photographed image shown in FIG.

  In FIG. 5, in the image 500 at the photographing time t1, an edge 502 of the building 201 indicated by a broken line, an edge 502 of a star A indicated by a broken line, and an edge 503 of a star B indicated by a broken line are obtained as edge detection results. As will be described later, label A (504) is attached to the area surrounded by the edge 501, label B (505) is attached to the area surrounded by the edge 502, and label C (506) is attached to the area surrounded by the edge 503. It is done.

  FIG. 6 is a diagram illustrating an example of the edge detection result of the second test photographed image obtained by the imaging unit 101 illustrated in FIG.

  Since the second test photographed image is photographed after the first test photographed image, the star moves. In FIG. 6, in the image 600 at the photographing time t2, an edge 601 of the building 201 indicated by a broken line, an edge 602 of a star A indicated by a broken line, and a star 603 indicated by a broken line are obtained as edge detection results. As will be described later, label D (604) is attached to the area surrounded by the edge 601, label E (605) is attached to the area surrounded by the edge 602, and label F (606) is attached to the area surrounded by the edge 603. It is done.

  Referring to FIG. 3 again, the first detection unit 103 sets blocks surrounding the edges extracted from the first test photographed image and the second test photographed image (step S2105).

  FIG. 7 is a diagram illustrating a part of the image on which the edge detection described in FIG. 3 has been performed.

  In FIG. 7, one square represents one pixel. In the image 1600, when a detection edge 1601 exists in a pixel, the pixel is assigned a numerical value “1”. The pixels in which the detection edge 1601 does not exist are, for example, edge detection omission pixels 1603 and 1604. The first detection unit 103 scans the image 1600 from the upper left along the scanning direction 1604 to search for a pixel in which an edge is detected. When the right end of the image 1600 is reached, the line is lowered by one line, and the first detection unit 103 scans again from the left end along the scanning direction 1604 to search for a pixel whose edge is detected.

  In this way, the first detection unit 103 performs scanning for each line to search for pixels whose edges are detected. However, if a pixel has already been labeled, the first detection unit 103 ignores the pixel and performs scanning. Do. Here, a pixel with a label refers to a pixel that has already been extracted.

  The first detection unit 103 confirms a region surrounded by an edge to be grasped with the edge 1601 first discovered during scanning as an axis. In order to confirm the area surrounded by the edges to be grasped, the first detection unit 103 sets a block so as to cover the area where the corresponding edge exists, and based on the statistics of the number of edges in the block Specify the block size.

  FIG. 8 is a diagram for describing block setting performed by the first detection unit 103 illustrated in FIG. 1.

  In the example shown in FIG. 8, a 5 × 3 pixel block region 1700, a 9 × 5 pixel block region 1701, a 13 × 7 pixel block region 1702, a 17 × 9 pixel block region 1703, and a 21 × 11 pixel block region. 1704 is shown. Here, since the edge 1601 is detected by the above-described scanning, the edge 1601 is used as an axis. Here, this detection edge 1601 is called an axis edge.

  In the illustrated example, the first detection unit 103 sets a 5 × 3 pixel block area 1700 for two pixels on the left and right and two pixels on the lower side with the axis edge 1601 as the center. Then, the first detection unit 103 obtains the number of edges present in the 5 × 3 pixel block region 1700 as the first number of edges.

  Next, the first detection unit 103 increases the block size (that is, the block area 1701 of 9 × 5 pixels), and obtains the number of edges in the block 1701 as the second edge number. Then, the first detection unit 103 compares the first edge number with the second edge number. If the first edge number is equal to the second edge number, the first detection unit 103 determines that the area surrounded by the edges to be grasped is included in the area of the block 1700.

  On the other hand, if the number of first edges is different from the number of second edges, that is, if the number of second edges> the number of first edges, the first detector 103 further increases the block size. The number of edges in the block 1702 is obtained as the third edge number. Then, the first detection unit 103 compares the third edge number with the second edge number. Similarly, the first detection unit 103 determines a block for confirming a region surrounded by edges to be grasped.

  In the example illustrated in FIG. 8, the number of edges is 5 in the block 1700, 10 in the block 1701, and 14 in the block 1702. Further, the block 1703 has 20 edges, and the block 1704 has 20 edges. As a result, the first detection unit 103 determines the size of the block for confirming the area surrounded by the edge to be grasped as 17 × 9 pixels. That is, the first detection unit 103 sets the block 1703 as a block for confirming an area surrounded by an edge to be grasped.

  Note that FIG. 8 is an example, and when the block size is expanded, it may be changed with another size.

  Subsequently, the first detection unit 103 attaches a label to an area surrounded by edges in each block set as described above (step S2106).

  FIG. 9 is a diagram for explaining label sticking performed by the first detection unit 103 illustrated in FIG. 1.

  In FIG. 9, labels 1800 are assigned to the edges of the axes. Further, labels 1801 and 1802 are assigned to the edge detection omission pixels, respectively.

  The first detection unit 103 performs allocation if there is a label that is scanned for each line from the upper left end of the set block 1703 along the scanning direction 1803 and allocated to the pixels. In the illustrated example, when an edge exists in a pixel, the first detection unit 103 attaches a unique label for each block to the pixel (here, “A”). And the 1st detection part 103 sticks the same label also about the pixel pinched | interposed into the label for every line.

  In order to deal with the edge detection omission pixels 1602 and 1603 and the like, the first detection unit 103 checks the edges of the upper and lower pixels for each pixel when scanning, and the edges exist in the upper and lower pixels. In this case, the same label is attached to the pixel. Further, the first detection unit 103 applies the same label to pixels surrounded by the label for each line. Here, labels A (1801) and 1802 are allocated to the edge detection omission pixels 1602 and 1603, respectively.

  Here, as shown in FIG. 5, in the image 500, the label A (504) is labeled in the area surrounded by the edge 501, the label B (505) is labeled in the area surrounded by the edge 502, and the label is labeled in the area surrounded by the edge 503. Assume that C (506) is allocated. As shown in FIG. 6, in the image 600, the label D (604) is the area surrounded by the edge 601, the label B (605) is the area surrounded by the edge 602, and the label C is the area surrounded by the edge 603. Assume that (606) is allocated.

  In the image 500 and the image 600, a unique label is assigned to each region surrounded by edges in units of pixels.

  Referring to FIG. 3 again, the first detection unit 103 compares the positions of the labeled regions for the first test photographed image and the second test image (step S2107). Here, the first detection unit 103 compares the positions of the labels of the image 500 and the image 600, and if the label exists in the image 600 at the same position as the position where the label exists in the image 500, the first label is defined by the label. The subject in the area to be processed is set as the first subject.

  5 and 6, since the label A (504) of the building 201 at the photographing time t1 and the label D (604) of the building 201 at the photographing time t2 exist at the same position, the first detection unit 103 Outputs the coordinate information indicating the coordinates of the region in the image to the exposure condition setting unit 105 and the second detection unit 104, with the building 201 as the first subject.

  On the other hand, since the label B (505) of the star A (202) at the photographing time t1 and the label E (605) of the star A (202) at the photographing time t2 are not at the same position, the first detection unit 103 Assume that A (202) is not the first subject. Similarly, since the label C (506) of the star B (203) at the photographing time t1 and the label F (606) of the star B (203) at the photographing time t2 are not at the same position, the first detection unit 103 It is assumed that the star B (203) is not the first subject.

  Subsequently, the first detection unit 103 determines whether there is a label that is not the first subject (step S2108). If there is no label that is not the first subject (NO in step S2108), the first detection unit 103 extends the imaging standby time in the imaging unit 101 via the exposure condition setting unit 105 (step S2110). Then, the process proceeds to step S2102, and the imaging unit 2102 waits until the extended time elapses.

  In other words, if there is no label that is not the first subject, the waiting time until the second test shot image is shot after the first test shot image is shot is shorter than the time until the star moves. It will be. Accordingly, in step S2110, the standby time is extended, and the second test photographed image is captured again after the extended time has elapsed.

  If there is a label that is not the first subject (YES in step S2108), the first detection unit 103 uses the second detection unit 104 and the exposure condition as a region from the first test photographed image as the first subject. The setting is outputted to the setting unit 105 (step S2109), and the test photographing and the first subject detection are finished.

  Here, the second subject detection and exposure time calculation shown in FIG. 2 will be further described.

  First, it is assumed that the exposure time for the second subject is obtained by subtracting the preparation time between shootings that occur during continuous shooting from the time taken for a star called the second subject to move one pixel of the image sensor. When calculating the exposure time for the second subject, the star with the largest amount of movement on the screen is used.

  FIG. 10 is a diagram schematically showing a north star and a star rotating around the north star.

  As shown in the figure, it is assumed that the star C (702) and the star D (703) are rotating around the north star P (701). The north star P (701) and the star C (702) are separated by a distance dc (704), and the north star P (701) and the star D (703) are separated by a distance dd (705). The star C (702) and the star D (703) rotate counterclockwise about the north star P (701).

  The movement distance per unit time can be obtained by the distance from the north polar star P (701) × the rotation angle of unit time. Now, it is assumed that the relationship between the distance dc and the distance dd is the relationship of Expression (1).

dc <dd (1)
The star D (703) is separated from the north star P (701) by the distance d1 shown by the equation (2) as compared to the star C (702). Therefore, the moving distance between the star D (703) and the star C (702) is not the same.

d1 = dd-dc (2)
Observing celestial bodies from a certain point on the earth, the closer to the North Star, the smaller the amount of movement per unit time, and the closer to the equator, the larger the amount of movement. Since each star present on the screen has a different amount of movement, it is necessary to detect the star with the largest amount of movement and determine the exposure time according to the star.

  FIG. 11 is a flowchart for explaining the second subject detection and exposure time calculation shown in FIG.

  When the second subject detection and the exposure time calculation are started, the second detection unit 104 outputs the first detection unit 103 that outputs the first test photographed image and the second test photographed image. A second subject is detected based on the luminance value in the region excluding the subject region (step S2201). Subsequently, the second detection unit 104 detects the movement destination of the second subject in the first test photographed image and the second test photographed image (step S2202).

  Here, the search of the moving direction of the second subject (that is, the star) performed by the second detection unit 104 will be described.

  FIG. 12 is a diagram illustrating an image in which the second subject at the photographing time t1 and the second subject at the photographing time t2 are combined. Moreover, FIG. 13 is a figure which shows the search direction of the star according to direction.

  In FIG. 12, an image 900 shows a second subject 901 detected in the image taken at the photographing time t1 and a second subject 902 detected in the image taken at the photographing time t2. Here, a search area 903 is shown.

  In FIG. 13, it is assumed that the second detection unit 104 has detected the second subject 1000. Subsequently, shooting is performed with the imaging apparatus 100 as an eastward shooting direction (search direction) 1001. Note that imaging may be performed with the imaging apparatus 100 as the imaging direction (search direction) 1002 facing south. Further, the imaging apparatus 100 may be photographed with the westward photographing direction (search direction) 1003. Then, the movement destination of the second second subject 1000 is detected from the images photographed in these photographing directions 1001, 1002, or 1003.

  First, the second detection unit 104 acquires the shooting direction from the shooting direction acquisition unit 106. Here, it is assumed that the shooting direction is west. Since the shooting direction is west, the second detection unit 104 employs the search direction 1003 from the second subject 1000 in FIG.

  Referring to FIG. 12, the second detection unit 104 sets a block of 5 × 5 pixels centered on a coordinate of several pixels from the second subject 901 toward the lower left diagonal side, and the second block The coordinates having the closest brightness value to the subject 901 are set as the coordinates to which the second subject 901 has moved from the photographing time t1 to the photographing time t2.

  Assuming that the image is taken in the locus of a star that is the second subject, the second detection unit 104 outputs the coordinates of the pixel indicating the start of the locus. The start pixel of the locus may be the left side of the screen in the east, south, and west, the locus that appears above the north star in the north is the right side of the screen, and the locus that appears below the north star is the left side of the screen.

  The second detection unit 104 sets a plurality of stars in the image at the shooting time t1 as second subjects, and outputs each coordinate and luminance value to the information management unit 107. Then, the second detection unit 104 detects a movement destination indicating where the second subject detected at the shooting time t1 has moved at the shooting time t2, and outputs the coordinates to the information management unit 107. Subsequently, the second detection unit 104 detects the second subject (that is, the star) having the maximum movement amount (step S2203).

  FIG. 14 is a diagram showing an example of an information management table (information management data) held by the information management unit 107 shown in FIG.

  The information management table 800 includes a star ID column 801, a shooting time column 802, a luminance value column 803, a coordinate column 804, a pre-movement coordinate column 805, a movement direction column 806, a total luminance value column 807, a pre-movement shooting time column 810, and A record creation coordinate field 811 is provided. In the illustrated example, a star ID field 801 stores a star IDA 808 and a star IDB 809 for identifying a plurality of stars.

  When the star ID is recorded in the star ID column 801, the information management unit 107 associates the star ID with the shooting time column 802, the luminance value column 803, the coordinate column 804, the pre-movement coordinate column 805, the movement direction column 806, and the total. In the luminance value column 807, the photographing time, luminance value, coordinates, coordinates before movement, moving direction, and total luminance value are recorded. Then, the information management unit 107 manages in units of records for each row.

  The star ID is an ID for identifying the second subject (that is, a star) detected by the second detection unit 104. The photographing time is the time when an image in which the second subject exists is photographed. The luminance value is a luminance value of a star identified by the star ID. The coordinates indicate the position of the star identified by the star ID 801 on the screen. When the record is updated (every time it is updated), the coordinates recorded in the coordinate field 804 of the record are copied to the pre-movement coordinate field 805 as the pre-movement coordinates.

  The movement direction indicates a straight line formed by connecting the coordinates and the coordinates before movement, and a clockwise angle when a vertical line is drawn upward from the coordinates before movement. When the record is updated in the total luminance value column 807, the luminance values of the record are added together and recorded as a total luminance value.

  FIG. 15 is a diagram for explaining the moving direction of the second subject (that is, a star).

  The image (pixel map) 1100 shows the coordinates 1101 before and after the movement of the star and the movement direction θ (1103). Note that the coordinates 1101 before movement and the coordinates 1102 after movement indicate positions at different times for the same star.

  The moving direction θ (1103) is a clockwise angle formed by a line segment connecting the coordinates 1101 before the movement and the coordinates 1102 after the movement and a perpendicular line from the top of the screen to the coordinates 1101 before the movement.

  The second detection unit 104 outputs the coordinates of the stars detected as the second subject from the first test photographed image, the luminance value, and the photographing time to the information management unit 107. The information management unit 107 records the coordinates of the stars, the luminance value, and the shooting time in the information management table. That is, the information management unit 107 records the star coordinates, the luminance value, and the shooting time for each star ID in the coordinate column 804, the luminance value column 803, and the shooting time column 802, respectively.

  When creating the record, the information management unit 107 records the coordinates recorded in the coordinate column 804 in the coordinate 811 at the time of record creation together with the recording in the coordinate column 804.

  Next, the second detection unit 104 outputs the coordinates of the stars detected as the second subject from the second test photographed image, the luminance value, and the photographing time to the information management unit 107. As described above, since the positional relationship of the same star appearing in the second test photographed image is searched, the information management unit 107 determines the information management table for each star ID 801 according to the detection result of the second test photographed image. Update.

  When the information management unit 107 newly receives the coordinates of the star, the luminance value, and the shooting time, the coordinates recorded in the coordinate field 804 are overwritten and saved in the coordinate field 805 for each star ID, and the new coordinates are stored in the coordinate field 804. Save the star coordinates. Further, the information management unit 107 adds the luminance value recorded in the luminance value column 802 with the total luminance value recorded in the total luminance value column 807 and overwrites and saves the total value in the total luminance value column 807. Then, the information management unit 107 overwrites and saves the newly input luminance value in the luminance value column 802.

  Further, the information management unit 107 overwrites and saves the shooting time recorded in the shooting time column 802 in the shooting time column 810 before movement, and overwrites the newly input shooting time in the shooting time column 802. Based on the updated coordinates and the pre-movement coordinates, the information management unit 107 calculates the movement direction θ as described with reference to FIG. 15 and overwrites and saves the movement direction θ in the movement direction column 806.

  In this way, when the update of the information management table is completed according to the two test photographed images, the second detection unit 104 detects the star having the largest movement amount among the stars identified by the star ID. Here, the movement amount is obtained using the coordinates recorded in the coordinate field 804 (that is, the coordinates after movement) and the coordinates before movement recorded in the coordinates field 805 before movement. Here, the amount of movement is the square root of the result of subtracting the coordinates before movement from the coordinates after movement and adding the square of the result (X coordinate and Y coordinate).

  After detecting the star ID having the largest moving amount, the second detection unit 104 calculates the moving speed on the screen from the moving amount of the star related to the star ID (step S2204). In addition, when calculating | requiring a moving speed, you may make it calculate using only a pixel map, However, Here, the case where a moving speed is calculated | required also using the pitch of a sensor is demonstrated.

  FIG. 16 is a diagram for explaining an example in which the moving speed of the star is obtained using the pitch of the sensor.

  The illustrated optical sensor 1200 includes a plurality of pixels. Here, the vertical length 1201 of one pixel of the optical sensor 1200 is Lpv, and the horizontal length 1202 of one pixel of the optical sensor 1200 is Lph. To do. Further, the length 1203 of the diagonal line of one pixel of the optical sensor 1200 is Lpd.

  Now, let the pixel 1204 be a pixel that was exposed with a star before movement, and let the pixel 1205 be a pixel that was exposed with a star after movement. These pixels correspond to the coordinates of the pixel map.

  First, the moving speed vtc on the pixel map is obtained by the following equation (3).

Here, tn represents the shooting time after the movement of the star, and tn-1 represents the movement time before the movement of the star. Xn is the X coordinate after the star is moved, Xn-1 is the X coordinate before the star is moved, Yn is the Y coordinate after the star is moved, and Yn-1 is the Y coordinate before the star is moved.

For converting the moving velocity v _t on the optical sensor from the movement speed vtc on the pixel map. This conversion equation is shown by the following (4).

The second detection unit 104 calculates the exposure time for the second subject (step S2205). After obtaining the moving speed on the optical sensor, the second detection unit 104 confirms the moving direction of the star with the largest moving amount by referring to the information management table. Then, the second detection unit 104 determines a value by which the moving speed vt is divided by the moving direction θ (angle).

  For example, when the moving direction (angle) θ is 0 ° ≦ θ <30 °, 150 ° ≦ θ <210 °, 330 ° ≦ θ <360 °, the second detection unit 104 sets the moving speed vt to one pixel. Is divided by the vertical length Lpv. When the angle θ is 30 ° ≦ θ <60 °, 120 ° ≦ θ <150 °, 210 ° ≦ θ <240 °, and 300 ° ≦ θ <330 °, the second detection unit 104 sets the moving speed vt. The diagonal length 1203 of one pixel is divided by Lpd. When the angle θ is 60 ° ≦ θ <120 ° and 240 ° ≦ θ <300 °, the second detection unit 104 divides the moving speed vt by the horizontal length 1202 of one pixel by Lph.

  In this way, when the value that divides the moving speed Vt is changed in accordance with the moving direction θ, the quotient is substantially the time taken to move one pixel of the optical sensor. Further, the second detection unit 104 calculates the second exposure time according to the following equation (5) in consideration of the time lag that occurs during continuous shooting.

In Equation (5), * is a value determined by the moving direction θ.
Here, tss is the second exposure time, Lp * is the dimension of the sensor, and tl is the time lag.

  In this manner, after calculating the second subject detection and the exposure time using the first subject detection result, the second detection unit 104 performs the processes related to the second subject detection and the exposure time calculation. finish.

  Here, creation and update of the information management table stored in the information management unit 107 illustrated in FIG. 1 will be described with a specific example.

  FIG. 17 is a diagram for explaining the creation and update of the information management table stored in the information management unit 107 shown in FIG. FIG. 17A is a diagram illustrating a state in which the detection result detected at the first time t0 is reflected in the information management table, and FIG. 17B is a diagram illustrating the first imaging time t1 at the first imaging time t1. It is a figure which shows the state which updated the record of the star X. FIG. 17C is a diagram showing a state in which the record of the second star Y is updated at the second shooting time t1, and FIG. 17D is a diagram showing the third star Z at the second shooting time t1. It is a figure which shows the state which updated this record.

  In FIG. 17, the same elements as those in the example shown in FIG. Here, it is assumed that star X, star Y, and star Z are registered in the star ID column 801 as star IDs. The star X has a record 1900, and the star Y has a record 1901. The star Z has a record 1902.

  Now, it is assumed that three stars are detected by the second detection unit 104 from an image obtained as a result of shooting at the first shooting time t0. Then, the second detection unit 104 outputs the shooting time, the luminance value, and the star coordinates to the information management unit 107. The information management unit 107 creates a record 1900 by assigning a star ID of star X to the first star. Here, as illustrated in FIG. 17A, the information management unit 107 records “t0” in the shooting time column 802 and “10” in the luminance value column 803. Further, the information management unit 107 records the coordinates (100, 200) in the coordinate column 804 and records the coordinates (100, 200) in the record creation coordinate column 811.

  Subsequently, the information management unit 107 creates a record 1901 by assigning a star ID of star Y to the second star. Here, as shown in FIG. 17A, the information management unit 107 records “t0” in the photographing time column 802 and “20” in the luminance value column 803. Further, the information management unit 107 records the coordinates (300, 400) in the coordinate column 804 and records the coordinates (300, 400) in the record creation coordinate column 811.

  Further, the information management unit 107 creates a record 1902 by assigning a star ID of star Z to the third star. Here, as illustrated in FIG. 17A, the information management unit 107 records “t0” in the shooting time column 802 and “50” in the luminance value column 803. Furthermore, the information management unit 107 records the coordinates (250, 100) in the coordinate field 804 and records the coordinates (250, 100) in the coordinate field 811 when creating the record. Then, the information management unit 107 outputs the coordinates and luminance values recorded in the records 1900 to 1902 to the second detection unit 104.

  Next, it is assumed that the second detection unit 104 detects three stars from an image obtained as a result of shooting at the second shooting time t1. Then, the second detection unit 104 outputs the shooting time, the luminance value, and the star coordinates to the information management unit 107. Here, it is assumed that the same star as the first photographing time t0 is detected.

  First, the information management unit 107 updates the record 1900 for the star X that is the first star. As shown in FIG. 17B, the information management unit 107 overwrites and saves “t1” in the photographing time column 802 and “11” in the luminance value column 803. Further, the information management unit 107 overwrites and saves the coordinates (105, 205) in the coordinate column 804 and records the coordinates (100, 200) before the movement in the coordinates column 805 before the movement. Then, the movement direction θ is 45 ° from the coordinates after movement and the coordinates before movement, and the total luminance value is 21, so that the information management unit 107 records “45 °” in the movement direction column 805 to obtain the total luminance value. Record “21” in the field 807.

  Subsequently, the information management unit 107 updates the record 1901 for the second star, the star Y. As shown in FIG. 17C, the information management unit 107 overwrites and saves “t1” in the photographing time column 802 and “22” in the luminance value column 803. Further, the information management unit 107 overwrites and saves the coordinates (310, 415) in the coordinate field 804, and records the coordinates (300, 400) before the movement in the coordinates field 805 before the movement. Then, the movement direction θ is 56.5 ° from the coordinates after movement and the coordinates before movement, and the total luminance value is 42. Therefore, the information management unit 107 records “56.5 °” in the movement direction column 805. “42” is recorded in the total luminance value column 807.

  Next, the information management unit 107 updates the record 1902 for the star Z that is the third star. As shown in FIG. 17D, the information management unit 107 overwrites and saves “t1” in the photographing time column 802 and “53” in the luminance value column 803. Furthermore, the information management unit 107 overwrites and saves the coordinates (258, 110) in the coordinate field 804 and records the coordinates (250, 100) before the movement in the coordinates field 805 before the movement. The movement direction θ is 85.5 ° from the coordinates after movement and the coordinates before movement, and the total luminance value is 103. Therefore, the information management unit 107 records “85.5 °” in the movement direction column 805. Then, “103” is recorded in the total luminance value column 807.

  In this way, when the update of the records 1900 to 1901 is completed for the stars X to Z, the information management unit 107 outputs the coordinates, the luminance value, and the moving direction of each record to the second detection unit 104. If the total luminance value exceeds the set value after all the records have been updated, the information management unit 107 sends an instruction to stop shooting to the exposure condition setting unit 105.

  Until the information management unit 107 sends an instruction to stop shooting to the exposure condition setting unit 105, the detection result at the next shooting time detected by the second detection unit 104 is given to the information management unit 107. Then, the information management unit 107 updates the record according to the detection result, and after updating the record, the information management unit 107 sets the second coordinates of the stars, the luminance value, and the moving direction recorded in the updated record. To the detection unit 104.

  As described with reference to FIG. 2, in step S2003, the imaging unit 101 captures an image with exposure conditions suitable for the first subject. The region of the first subject in the image has been determined by the processing in step S2001, and the detection result is transmitted from the first detection unit to the exposure condition setting unit 105.

  FIG. 18 is a diagram for explaining a region of the first subject detected by the first detection unit 103 shown in FIG. FIG. 18 is the same image as the first test photographed image shown in FIG.

  In the image 200 shown in FIG. 18, the region 400 of the first subject is detected separately from the region 401 other than the first subject. The exposure condition setting unit 105 sets the exposure condition by lowering the ISO sensitivity so that the same area as the area 400 of the first subject is measured by the imaging unit 101 to obtain an appropriate exposure.

  The imaging unit 101 shoots and generates image data according to exposure conditions suitable for the first subject obtained by photometry of the first subject area 400. As described above, the image data is sent from the imaging unit 101 to the recording unit 102 and stored.

  In the process of step S2004 described with reference to FIG. 3, shooting is performed under an exposure condition suitable for the second subject. At this time, the exposure time for the second subject calculated by the information management unit 107 is sent from the information management unit 107 to the exposure condition setting unit 105. The exposure condition setting unit 105 controls the imaging unit 101 with the exposure time for the second subject. Image data obtained by the imaging unit 101 is output to the recording unit 102 and the second detection unit 104.

  Immediately after the image data is output, the imaging unit 101 captures again with the same exposure time. The second and subsequent image data obtained as a result of shooting with the exposure time for the second subject is output only to the second detection unit 104. The second detection unit 104 detects the second subject from the image data, and outputs the shooting time, the coordinates of the second subject, and the luminance value thereof to the information management unit 107.

  When the information management unit 107 calculates the exposure time for the second subject from the test photographed image and outputs it to the exposure condition setting unit 105, the information management table record is once deleted. Then, the information management unit 107 creates a record in the information management table again according to the detection result of the second detection unit 104.

  Specifically, the information management unit 107 creates a record as described above according to the detection result relating to the second subject output from the second detection unit 104. The second detection unit 104 is the same in the first image data obtained as a result of shooting under the same shooting conditions from the second image data shot by the imaging unit 101 with the exposure time for the second subject. The coordinates and brightness value of the star are detected and output to the information management unit 107 together with the photographing time.

  The information management unit 107 updates each record of the information management table as described above using these coordinates, luminance value, and photographing time. Then, the information management unit 107 sends the brightness value, moving direction, and coordinates of each record, which is the result of updating the information management table, to the second detection unit 104.

  The second detection unit 104 uses the coordinates of the same star in the second image data shot under the same shooting conditions from the third image data shot by the imaging unit 101 with the exposure time for the second subject. The brightness value is detected and output to the information management unit 107 together with the shooting time.

  Here, the method for detecting the coordinates of the same star from the second image data obtained as a result of photographing under the same photographing conditions from the third image data photographed with the exposure time for the second subject is described above. It is different from the method.

  Here, the same star is obtained from the second image data obtained as a result of photographing from the third image data obtained as a result of photographing with the exposure time for the second subject under the same photographing conditions except for the photographing time. The coordinate detection method will be described. The third and subsequent image data are detected from the previous image data.

  The second detection unit 104 detects the same star based on the luminance value, coordinates, and movement direction output from the information management unit 107. First, the second detection unit 104 determines a search direction from a position indicated by coordinates according to the movement direction.

  When the search direction is determined, the second detection unit 104 determines a coordinate having the closest luminance value from a block composed of 5 × 5 pixels around the pixel moved by one pixel along the movement direction from the position indicated by the coordinate. Explore. Note that the amount of movement and the size of the block during the search can be arbitrarily determined.

  Here, exception processing when the search destination is in the area of the first subject will be described.

  FIG. 19 is a diagram for explaining how a star enters the back of a building.

  In FIG. 19, an image 1300 is an image obtained by combining images taken at a predetermined shooting interval. A star position 1301 is a star position at the photographing time ti, and a star position 1302 is a star position at the photographing time tj. A star position 1303 is a star position at the photographing time tk.

  A route 1304 is a route along which the star moves from the photographing time ti to the photographing time tj, and a route 1305 is a route along which the star moves from the photographing time tj to the photographing time tk. A route 1306 is a route along which the star moves from the photographing time tk to the photographing time tl. Here, it is assumed that the time is earlier in the order of photographing times ti, tj, tk, and tl.

  The star observed at the photographing time ti is observed through the path 1304 from the photographing time ti to the photographing time tj at the photographing time tj. Furthermore, the star is observed through the path 1305 at the photographing time tk. At the photographing time tl, the star moves to the back of the building 201 through the route 1306. Here, the state where the star has moved to the back of the building 201 is referred to as an exception.

  The second detection unit 104 performs a search using images with different shooting times in order to detect a star that is the second subject. When the star moves behind the first subject such as the building 201, the second detection unit 104 performs the search. The second detection unit 104 cannot detect coordinates and luminance values. For this reason, here, the second detection unit 104 needs to perform exception processing.

  FIG. 20 is a flowchart for explaining the update process of the information management table when the second detection unit 104 shown in FIG. 1 performs exception processing.

  When the update process of the information management table is started, the information management unit 107 determines whether there is a record whose total luminance value exceeds the set value (step S1401). If there is a record in which the total luminance value exceeds the set value (YES in step S1401), the information management unit 107 ends the update process.

  On the other hand, if there is no record in which the total luminance value exceeds the set value (NO in step S1401), the exposure condition setting unit 105 controls the imaging unit 101 according to an instruction from the information management unit 107 to control the second subject. Photographing is performed with the exposure time for use (step S1402). Subsequently, the information management unit 107 confirms whether or not the update of each record in the information management table according to the detection result output from the second detection unit 104 has been completed (step S1403).

  When the update is completed (YES in step S1403), the information management unit 107 returns to the process of step S1401. On the other hand, if the update has not ended (NO in step S1403), the second detection unit 104 checks whether or not the search destination is included in the region of the first subject (step S1404).

  If the search destination is not included in the area of the first subject (NO in step S1404), the second detection unit 104 is identical according to the coordinates, the luminance value, and the movement direction stored in the information management table. The destination of the star is searched (step S1405). Then, the second detection unit 104 checks whether or not the star movement destination has been detected as the search destination (step S1406).

  When the second detection unit 104 can detect the moving destination of the star (YES in step S1406), the information management unit 107 corresponds to the information management table based on the detection result output from the second detection unit 104. The record is updated (step S1407). Then, the information management unit 107 returns to the process of step S1403.

  If the second detection unit 104 cannot detect the moving destination of the star (NO in step S1406), the information management unit 107 updates the corresponding record in the information management table using the pseudo information as an exception process (step S1408). . Then, the information management unit 107 returns to the process of step S1403. In step S1404, when the second detection unit 104 confirms that the search destination is included in the first subject area (YES in step S1404), the information management unit 107 performs the process of step S1408. Do.

  Here, as the pseudo information, the center coordinates of the block used when searching for the coordinates are used, and the brightness value stored in the brightness value column 803 is used.

  Shooting with an exposure time suitable for the second subject, detection of the second subject, and updating of the information management table are repeated until the setting condition is satisfied. Here, when any of the total luminance values reaches a predetermined set value in the star identified by the star ID in the information management table, it is determined that the set condition is satisfied. It should be noted that when setting the setting conditions, a value at which a pixel is blown out, a whiteout with respect to a specific star, and the like are taken into consideration.

  In the process of step S2005 described with reference to FIG. 2, the composition for sharpening the second subject is performed. First, the first synthesizing unit 108 acquires first image data taken from the recording unit 102 with an exposure time (exposure condition) suitable for the second subject. Further, the first synthesis unit 108 acquires the record creation coordinates and the total luminance value from the information management unit 107.

  The first synthesis unit 108 replaces the luminance value of the pixel indicated by the coordinates at the time of record creation with the total luminance value for the first image data (that is, corrects the luminance value to the total luminance value), and the first synthetic image data Is generated. Then, the first combining unit 108 outputs the first combined image data to the second combining unit 109.

  In the process of step S2006 described with reference to FIG. 2, the image data obtained by photographing the first subject and the first synthesized image data obtained by clarifying the second subject are synthesized. The second synthesizing unit 109 reads the image data captured with the exposure time (exposure condition) suitable for the first subject from the recording unit 102 and detects the first subject output by the first detecting unit 103. The first synthesized image data output from the region and the first synthesis unit 108 is read.

  Based on the first synthesized image data, the second synthesizing unit 109 has the same area of the image data photographed under the exposure condition suitable for the first subject in the area of the first subject in the first synthesized image data. Is attached to generate second composite image data.

  As described above, in the first embodiment of the present invention, the composite image data generated from a plurality of images photographed under the exposure condition suitable for the second subject and the exposure condition suitable for the first subject are photographed. Therefore, image data in which the first subject such as a landscape and the second subject such as a star are clear and the trajectory of the second subject is not captured can be generated.

[Second Embodiment]
Subsequently, an example of an imaging apparatus according to the second embodiment of the present invention will be described.

  FIG. 21 is a block diagram showing the configuration of an example of an imaging apparatus according to the second embodiment of the present invention. In FIG. 21, the same components as those of the image pickup apparatus shown in FIG.

  The illustrated camera 1500 includes an exposure condition setting unit 1503 having a function different from that of the exposure condition setting unit 105 described in FIG. 1, and further includes a user designated area acquisition unit (hereinafter simply referred to as a designated area acquisition unit) 1501 and a display unit. 1502.

  The designated area acquisition unit 1501 has a touch panel, buttons, and the like, and the user of the camera 1500 can select or designate a user designated area using the designated area acquisition unit 1501. The region selected or designated by the user is output to the exposure condition setting unit 1503, the second detection unit 104, and the second combining unit 109 as a detection result (also referred to as detection data) related to the first subject. The

  The display unit 1502 is, for example, a liquid crystal display device or an organic EL display device, and an image obtained as a result of photographing by the imaging unit 101 is displayed on the display unit 1502, and the user visually recognizes the image displayed on the display unit 1502. be able to.

  An exposure condition setting unit 1503 controls the imaging unit 101 to set an exposure time, the number of exposures, a photometric region, ISO sensitivity, and the like. The exposure condition setting unit 1503 determines a shooting condition (setting condition) based on the detection result of the first subject output from the designated area acquisition unit 1501 and the output of the information management unit 107.

  The second synthesizing unit 109 reads the image data from the recording unit 102, and the first synthesized image data output from the first synthesizing unit 108 indicates the detection result of the first subject output from the designated area acquiring unit 1501. Copy to the area and output the second composite image data.

  FIG. 22 is a flowchart for explaining image composition performed by the camera 1500 shown in FIG.

  When the image composition process is started, the imaging unit 101 captures two test photographed images (step S301). In the photographing process in step S301, the processes from steps S2101 to S2103 described in FIG. 3 are performed. Then, the imaging unit 101 outputs the first test captured image to the display unit 1502. The display unit 1502 displays the first test captured image sent from the imaging unit 101 (step S302).

  The user designates the area of the first subject from the first test photographed image displayed on the display unit 1502 using the designated area acquisition unit 1501 (step S303).

  Referring to FIG. 4, for example, a first test photographed image is displayed as an image 200 on the display unit 1502, and a building 201, a star A (202), and a star B (203) are displayed on the image 200. Yes. The user designates a subject to be set as the first subject by the designated area acquisition unit 1501 while viewing the first test photographed image displayed on the display unit 1502.

  When the first subject is designated, for example, when the user traces the first subject region 400 shown in FIG. 18 with a pointer or a finger, the first subject region 400 is designated as the detection result of the first subject. Output from the area acquisition unit 1501.

  Subsequently, as described in the first embodiment, the second detection unit 104 detects the second subject and calculates the exposure time using the detection result of the first subject (step S304). Note that the format of the first subject detection result (first detection data) output from the designated area acquisition unit 1501 is the same as the output of the first detection unit 103 described in the first embodiment.

  Subsequently, the imaging unit 101 performs shooting under exposure conditions suitable for the first subject (step S305). As described above, the designated area acquisition unit 1501 outputs detection data of the first subject to the exposure condition setting unit 1503. The exposure condition setting unit 1503 controls the imaging unit 101 so that the imaging unit 101 measures the area of the first subject and sets the shutter speed so that the first subject is photographed with appropriate exposure based on the photometric result. To do. Then, the imaging unit 101 stores image data obtained by capturing the first subject with appropriate exposure in the recording unit 102.

  Subsequently, the imaging unit 101 performs shooting under an exposure condition suitable for the second subject (step S306). Here, based on the exposure time calculated in step S304, the exposure condition setting unit 1503 controls the imaging unit 101 to perform imaging. Shooting conditions other than the exposure time are the same as those in step S2004 described in FIG.

  Next, image synthesis is performed to sharpen the second subject of the first synthesis unit 108 (step S307). The process in step S307 is the same as the process in step S2005 described with reference to FIG.

  Subsequently, the second synthesizing unit 109 synthesizes the image data obtained by photographing the first subject and the first synthesized image data obtained by clarifying the second subject (step S308). Here, based on the first composite image data, the second composite unit 109 captures an image of the first subject area designated by the user in the first composite image data under exposure conditions suitable for the first subject. The same area of the image data is pasted to generate second synthesized image data, and the synthesis process is terminated.

  As described above, in the second embodiment of the present invention, the composite image data generated according to a plurality of images photographed under the exposure condition suitable for the second subject and the first subject-specified region specified by the user. Since the image data shot under the exposure conditions suitable for one subject are synthesized, the first subject such as a landscape and the second subject such as a star become clear and the locus of the second subject is reflected. Image data can be generated.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  For example, the function of the above embodiment may be used as a control method, and this control method may be executed by the imaging apparatus. Further, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the imaging apparatus. The control program is recorded on a computer-readable recording medium, for example.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and the computer (or CPU, MPU, etc.) of the system or apparatus reads the program. To be executed.

DESCRIPTION OF SYMBOLS 100 Imaging device 101 Imaging part 102 Recording part 103 1st detection part 104 2nd detection part 105 Exposure condition setting part 106 Shooting direction acquisition part 107 Information management part 108 1st synthetic | combination part 109 2nd synthetic | combination part

Claims (11)

Imaging means for photographing a stationary first subject and a moving second subject ;
Detecting means for detecting the first subject and the second subject in the image data obtained by photographing by the imaging means and outputting detection data ;
Depending before dangerous out data, the first first with obtaining the first photographic image data performs shooting by controlling the imaging means with the exposure conditions of the subject, before Symbol second object a second second captured image data obtained Ru control means performs shooting by controlling the imaging means with the exposure conditions according to,
Before Symbol second the second photographic image data of the luminance value is changed to a predetermined luminance value of the subject, the synthetic unit that generates a synthetic image data by synthesizing the first captured image data ,
An imaging device comprising: Before SL control means obtains the first image data by imaging the first object and the second object by controlling the imaging means at a predetermined exposure condition, after a predetermined time, the Controlling the imaging means under a predetermined exposure condition to photograph the first subject and the second subject to obtain second image data;
Before dangerous out means, the image pickup apparatus according to claim 1, characterized in that to detect the second object and the first object from the first image data and the second image data. Before dangerous detecting means includes a display means for displaying the image data as an image,
Designating means for designating the first subject in the image;
The imaging apparatus according to claim 1 , wherein the first subject is detected when the first subject is designated by the designation unit. Before SL control means, claims, characterized in that for determining the first exposure condition in accordance with the prior dangerous exits the first region photometry been photometric results of the subject indicated by the data The imaging device according to any one of 1 to 3 . Before dangerous out means, on the basis of the first image data and the second image data, the second according to the moving speed of the second second object the movement amount, the largest of the subject The imaging apparatus according to claim 2 , wherein an exposure condition is determined. A photographing direction detecting means for detecting a photographing direction at the time of photographing by the imaging means;
Before dangerous detecting means, said imaging to determine the search direction in response to the detected photographing direction in the direction detection unit, before dangerous exits SL before detecting the moving destination of the second object based on the data the imaging apparatus according to claim 2, characterized in that outputs the detection data. For each of the second object in accordance with image data output from the imaging unit, according to claim 1-6, characterized in that it comprises an information management unit for recording at least the position and the luminance value as the information management data The imaging device according to any one of the above. The information management unit updates the information management data every time image data is output from the imaging unit, and the information management data further includes the moving direction of each of the second subjects, and The imaging apparatus according to claim 7 , further comprising a total luminance value obtained by summing the luminance values. The imaging apparatus according to claim 8 , wherein the information management unit updates the information management data until the total luminance value reaches a predetermined setting value. Before Kigo formation means, the imaging apparatus according to claim 8 or 9, characterized in that as adapted to use the total luminance value as the predetermined luminance value. A method for controlling an imaging apparatus having an imaging means for imaging a stationary first subject and a moving second subject,
A detection step of detecting the first subject and the second subject in the image data obtained by photographing by the imaging means and outputting detection data ;
Depending before dangerous out data, the first first with obtaining the first photographic image data performs shooting by controlling the imaging means with the exposure conditions of the subject, before Symbol second object a second second captured image data obtained Ru control steps performed shooting by controlling the imaging means with the exposure conditions according to,
Before Symbol second the second photographic image data of the luminance value is changed to a predetermined luminance value of the subject, the synthetic steps that generates the synthetic image data by synthesizing the first captured image data ,
A control method characterized by comprising: