JP4983624B2 - Imaging device, photographing method, photographing program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and an imaging program that can acquire a captured image in an enlarged imaging range that is wider than a range corresponding to an angle of view.

Conventionally, in an imaging device such as a digital camera, a plurality of images shot while changing the shooting position are mutually exceeded in order to enable shooting in an enlarged shooting range wider than the range corresponding to the angle of view. There is a method of wrapping and compositing into one image. Further, for example, in Patent Document 1 below, a frame corresponding to a predetermined shooting range at the time of each shooting is displayed on an LCD monitor or the like, and the next shooting range is displayed in the frame. The technique to teach a person is described. According to such a technique, it is possible to easily obtain a photographed image (composite image) having no missing part with an enlarged photographing range.
JP 2003-163823 A

  However, in the above-described technique, it is possible to prevent an image missing portion from occurring in a photographed image, but on the other hand, since the photographing range that can be enlarged at the time of photographing is fixed, the photographing range is originally necessary. If it is wider than the shooting range, useless shooting work is required. Further, even if the photographic range that can be enlarged is changed, in that case, it is necessary to select an appropriate range as the photographic range required before photographing. Therefore, there was a problem in convenience.

  The present invention has been made in view of such a conventional problem, and is an image pickup apparatus, a shooting method, and a shooting program capable of easily obtaining a shot image in an enlarged shooting range wider than the range corresponding to the angle of view. The purpose is to provide.

  In order to solve the above-described problem, in the imaging apparatus according to the first aspect of the present invention, the imaging range is expanded by aligning and synthesizing a plurality of first captured images acquired by a plurality of imaging operations. An imaging device that acquires the second captured image, an imaging unit that images a subject, a shooting control unit that causes the imaging unit to perform a continuous shooting operation of repeatedly shooting the subject, and a continuous shooting operation of the imaging unit And combining means for aligning and synthesizing the plurality of first photographed images acquired by step (2) and indicating light indicating the photographing position while the continuous photographing operation is being performed by the imaging means. An irradiation unit that irradiates the image and a predetermined region determined in correspondence with the irradiation position of the instruction light by the irradiation unit in the combined image that is aligned and combined by the combining unit and the second captured image Characterized by comprising an acquisition unit configured to acquire, the Te.

  In the image pickup apparatus according to the second aspect of the present invention, trajectory information indicating the trajectory of the light spot of the instruction light in the subject while the continuous photographing operation is performed by the image pickup means is used as the image pickup means. The light indicated by the trajectory information acquired by the trajectory information acquisition means on the trajectory information acquisition means acquired based on the first photographed image acquired by the above-mentioned processing, and the synthesized image that is aligned and synthesized by the synthesizing means. Area setting means for setting a predetermined area corresponding to the locus of the points, and the acquisition means acquires the predetermined area of the composite image set by the area setting means as the second photographed image. To do.

  In the image pickup apparatus according to the third aspect of the invention, the region setting unit includes a predetermined aspect ratio including a range surrounded by the locus of the light spot in the synthesized image synthesized by the synthesizing unit. Is set as the predetermined area.

  In the imaging device according to claim 4, the area setting means sets, as the predetermined area, a minimum rectangular area circumscribing a range surrounded by the locus of the light spot or a maximum rectangular area inscribed therein. It is characterized by doing.

  In the image pickup apparatus according to the fifth aspect of the invention, the synthesizing unit synthesizes a synthesized image from which the light spot imaged in the first photographed image is removed. .

  In the image pickup apparatus according to the sixth aspect of the present invention, when the synthesizing unit acquires the region including the locus portion of the light spot as the second photographed image, the locus of the light spot is The removed second captured image is acquired.

  In the image pickup apparatus according to the seventh aspect of the present invention, the trajectory information acquisition unit uses the trajectory information in an image space used when the plurality of first captured images are combined by the combining unit. The position of the light spot, which is a coordinate position and changes as the plurality of first captured images are aligned, is acquired.

  In the image pickup apparatus according to the eighth aspect of the present invention, whether or not acquisition of all the first photographed images required for obtaining the second photographed image has been completed is performed by the continuous photographing of the image pickup means. A determination unit configured to determine based on a plurality of first captured images acquired by the operation, wherein the region setting unit is acquired until the determination unit determines that acquisition of all the captured images has been completed; The predetermined area is set in a composite image composed of a plurality of first photographed images.

  In the imaging device according to the ninth aspect of the present invention, it is determined whether or not the locus shape of the light spot indicated by the locus information acquired by the locus information acquisition means is a predetermined locus shape. Whether or not the acquisition of all the first captured images has been completed on the condition that the determination unit determines that the locus shape of the light spot is a predetermined locus shape. It is characterized by determining whether or not.

  In the imaging device according to the invention described in claim 10, the predetermined locus shape is annular.

  In the image pickup apparatus according to the invention of claim 11, a plurality of range specifying methods are prepared as a method of specifying the photographing range to be enlarged, and the determination means has a locus shape of the light spot as a user. It is characterized by determining whether it is the predetermined | prescribed locus | trajectory shape corresponding to the range designation | designated method previously selected by (1).

  In the image pickup apparatus according to the twelfth aspect of the present invention, in response to a shooting start instruction from the user, the shooting control unit causes the shooting unit to start a continuous shooting operation, and a user ends a shooting end instruction. In response to the above, the photographing control unit terminates the continuous photographing operation in the imaging unit, and the determination unit determines whether or not the acquisition of all the captured images has been completed, and the determination unit determines whether all the captured images have been acquired. When it is determined that the acquisition is not completed, the photographing control means further includes a control means for resuming a continuous photographing operation in the imaging means.

  In the photographing method according to the thirteenth aspect of the present invention, the second photographing range is expanded by aligning and synthesizing a plurality of first photographed images acquired by a plurality of photographing operations. A method for acquiring a captured image of the image capturing method, wherein the image capturing means repeatedly performs a continuous image capturing operation while irradiating an instruction light indicating a capturing position toward a specific position within an angle of view; A step of acquiring, as the second photographic image, a predetermined area determined in correspondence with the irradiation position of the instruction light in the composite image obtained by aligning and synthesizing the plurality of first photographic images acquired by the photographing operation. It is characterized by including.

  In the imaging program according to the fourteenth aspect of the present invention, the second imaging range is expanded by aligning and synthesizing a plurality of first captured images acquired by a plurality of imaging operations. A procedure for causing a computer included in an imaging device that acquires the captured image of the imaging device to perform a continuous imaging operation of repeatedly imaging the subject while irradiating the instruction light indicating the imaging position toward a specific position within the angle of view; A predetermined area determined corresponding to the irradiation position of the instruction light in the composite image obtained by aligning and synthesizing the plurality of first captured images acquired by the continuous capturing operation is acquired as the second captured image. And a procedure is executed.

  According to the present invention, it is possible to easily obtain a photographed image having no missing portion in the enlarged photographing range even if the display means for notifying the photographer of the range to be photographed is provided. Therefore, it is possible to provide an imaging apparatus, a shooting method, and a shooting program that are excellent in convenience.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
(Embodiment 1)
1A and 1B are views showing an external appearance of an imaging apparatus 1 according to the present invention. FIG. 1A is a plan view, FIG. 1B is a front view, and FIG. 1C is a right side view. The imaging device 1 has functions as a digital camera and a laser pointer, and can acquire a captured image in an enlarged shooting range wider than the range corresponding to the angle of view, and is configured as follows. ing.

  As shown in FIG. 1, the imaging apparatus 1 includes a flat main body 2 having a rectangular cross section, and a power button 3, a shutter button 4, and first and second mode changeover switches (slide switches) on the upper surface of the main body 2. 5, 6 are provided. A semiconductor laser 7 that emits low-power laser light (irradiation means of the present invention) and a photographing lens 8 are provided side by side at one end in the longitudinal direction of the main body 2, and a memory card slot is provided in front of the main body 2. 9 and a data output terminal 10 are provided. The photographic lens 8 has a relatively long focal length, and is, for example, a 35 mm film equivalent of 250 mm (diagonal angle of view 10 °). Unlike the present embodiment, the photographic lens 8 may have a zoom function that allows the focal length to be switched and adjusted.

  The first mode changeover switch 5 is a switch for setting a mode related to a method for specifying a shooting range at the time of shooting an arbitrary subject (hereinafter referred to as a range specifying mode). Two types of modes are prepared in advance. The second mode changeover switch 6 is a switch for setting an operation mode (hereinafter referred to as “cutout mode”) related to a cutout method for cutting out an image to be actually recorded from a composite image to be described later. In, two types of modes, a maximum mode and a trajectory mode, are prepared in advance.

  The imaging device 1 can emit the semiconductor laser 7 by pressing the power button 3 and can stop the emission of the semiconductor laser 7 by pressing the power button 3 again. Can shoot an arbitrary subject by pressing the shutter button 4. In addition, the use assumed regarding the photographing function is (recording) description contents such as an arbitrary sentence or a figure handwritten on a whiteboard or projected using a data projector or the like.

  On the other hand, FIG. 2 is a block diagram showing an electrical configuration of the imaging apparatus 1. As shown in the figure, the imaging device 1 includes a camera module 21, a control unit 22 that controls each unit of the imaging device 1, a ROM 23, a built-in memory 24, an external memory interface 25, a data output interface 26, a laser light emitting unit 27, and a switch. Unit 28 and a power source unit 29, and an image captured by the camera module 21 is recorded on the memory card 11 mounted in the memory card slot 9 of the main body 2 via the external memory interface 25. .

  The camera module 21 is an image pickup means of the present invention, and is mainly a CCD or MOS type solid-state image pickup device that converts an optical image of a subject formed by the photographing lens 8 into an electric signal by photoelectric conversion and outputs it as an image pickup signal. An image pickup unit 31 including an AGC circuit for amplifying the image pickup signal, an AGC circuit for amplifying the image pickup signal, an A / D converter for converting the amplified image pickup signal into a digital image signal, and luminance signal processing for the digital image pickup unit signal And a signal processing unit 32 that performs color signal processing, interpolation processing, and the like, generates RGB data for each pixel, that is, image data, and outputs the data to the control unit 22.

  The built-in memory 24 is a memory (for example, SDRAM) capable of writing image data at a high speed, and stores image data output from the camera module 21 to the control unit 22, that is, image data of a subject imaged by the camera module 21. Remember from time to time. Further, the built-in memory 24 can secure an area for simultaneously storing a plurality of pieces of image data and a work area used by the control unit 22 to synthesize a plurality of pieces of image data during a photographing operation described later. It has a predetermined storage capacity.

  The data output interface 26 is an interface circuit for outputting the image data recorded on the memory card 11 to an external device connected by a cable via the data output terminal 10, and is, for example, a USB (Universal Serial). Bus) interface. The data output interface 26 can be replaced with a communication circuit for outputting image data to an external device by a communication method having a relatively narrow communication range such as an infrared method or a Bluetooth (registered trademark) method.

  The laser emission unit 27 includes the semiconductor laser 7 and its drive circuit. The switch unit 28 includes the power button 3, the shutter button 4, and the first and second mode changeover switches 5 and 6 described above. The power supply unit 29 includes a predetermined built-in battery and a power supply circuit for converting the battery voltage into a required voltage and supplying the converted voltage to each unit.

  The control unit 22 includes a CPU and its peripheral circuits, and controls the above-described units of the imaging apparatus 1 based on a shooting control program stored in the ROM 23. Further, at the time of shooting, the exposure time of the solid-state imaging device in the imaging unit 31 described above and automatic exposure control by adjusting the gain of the AGC circuit are also performed, and the shooting control unit, the combining unit, and the determination of the present invention are performed by performing the processing described later. Functions as a means, an area setting means, an acquisition means, a determination means, a trajectory information acquisition means, and a control means.

  Next, the operation of the imaging apparatus 1 having the above configuration will be described with reference to the flowcharts of FIGS. As shown in FIG. 3, when the power is turned on by pressing the power button 3 (YES in step SA1), the imaging device 1 immediately drives the semiconductor laser 7 to start emitting laser light (step SA2). . Here, the relationship between the light spot of the laser beam and the range that can be imaged by the imaging apparatus 1 (hereinafter referred to as the field angle range) is shown in FIG. This figure is a diagram showing an example in which the description content of an arbitrary range of the whiteboard B is taken from a distant place (for example, at a distance of 5 m), and as shown, the laser beam L (thick broken line) The light spot O is always located substantially at the center of the field angle range A.

  On the other hand, in the imaging apparatus 1, after the control unit 22 starts emitting the laser light L, whether or not there is an imaging start instruction by pressing the shutter button 4 and whether or not the power is turned off by re-pressing the power button 3 are sequentially determined. If it is confirmed that there is no instruction to start shooting and there is no power-off operation (NO in steps SA3 and SA13), only the emission of the laser beam L is continued.

  On the other hand, if an instruction to start shooting is given at any time (YES in step SA3), first, the image composition memory is initialized, that is, a process of securing a predetermined size image composition work area in the built-in memory 24. (Step SA4). Further, the photographing position information is initialized (step SA5). The shooting position information is a coordinate position (x, y) of a virtual coordinate space (hereinafter referred to as a “composition coordinate space”) used for the composition operation of a captured image, which will be described later. Here, the origin ( x = 0, y = 0) is set.

  Thereafter, until the camera module 21 starts an imaging operation at a predetermined time interval (e.g., 0.1 second interval) until a shooting end instruction is issued by pressing the shutter button 4 again (NO in step SA9), the following operations are performed. Repeat the process.

  First, every time the photographing timing of a predetermined time interval arrives, the photographing operation is performed to obtain photographed image data (step SA6), and the current photographing position update processing in FIG. Is updated (step SA7), and the acquired captured image data is overwritten and combined with the shooting position in the image composition memory (step SA8). Although not shown in the figure, at the first shooting timing at the beginning of the operation, there is no image data in the image composition memory and the shooting position is the origin, so the processing of steps SA7 and SA8 is skipped. Further, when the captured image data is acquired in step SA6, the drive of the semiconductor laser 7 is temporarily stopped (laser light is turned off) to avoid the reflection of the light spot on the captured image.

  FIG. 4 is a flowchart showing the contents of the above-described photographing position update processing executed in step SA7 at the second and subsequent photographing timings. In this process, feature points in the image (feature portions where the outline, color, etc. are remarkable) are extracted from the previous (immediately) captured image data stored in the image composition memory (step SA101). The same feature point is detected from the current captured image data using a technique such as pattern matching (step SA102).

  Next, the shift amount and the shift direction of the same feature point in the previous captured image data and the current captured image data are calculated, and based on the calculation result, the center of the current image data in the synthesis coordinate space A position is acquired (step SA103). Thereafter, the acquired center position is stored as trajectory data indicating the trajectory of the light spot O (see FIG. 11) of the laser light L as well as the current photographing position information (step SA104).

  FIG. 7 is a conceptual diagram showing the relationship between the photographed image G1 acquired at the beginning of photographing and the photographed image G2 obtained at the second photographing timing in the above-described composition coordinate space. In the shooting position update process at the second shooting timing, the center position (x1, y1) of the shot image G2 shown in the figure is acquired, and the data is stored as current shooting position information and trajectory data.

  Until the shutter button 4 is pressed again, the above-described steps SA6 to SA8 are repeatedly performed, so that newly acquired image data is the same subject (image) in the image composition memory. The components are sequentially synthesized so that the portions overlap, and the coordinate position of each point of the light spot O is accumulated as trajectory data. Thus, in the case of the example shown in FIG. 11, the user makes one stroke of the angle of view range A in the range where the user wishes to shoot on the whiteboard B using the light spot O of the laser light L as a guide (hereinafter, the desired shooting range). By moving without writing a gap in the manner of writing, image data in a region including the desired shooting range, that is, a region wider than the angle of view range A is combined in the image combining memory.

  Thereafter, when the shutter button 4 is pressed again by the user (YES in step SA9), the photographing unevenness determination process of FIG. 5 is performed. In such processing, first, it is determined whether or not the setting of the range designation mode by the first mode changeover switch 5 is the region mode. In the area mode, as shown in FIG. 12 (a), a desired photographing desired range C is obtained by moving the light spot O (view angle range A) of the laser light L so that the user draws an annular locus. This is the mode to specify.

  If the region mode is set (YES in step SA201), it is determined based on the locus data described above whether or not the locus of the light spot O intersects at any part (step SA202). FIG. 8 is a diagram exemplifying the shape of the locus K. The positions indicated by white circles in the drawing are stored as locus data, that is, the coordinate position of the light spot O at each photographing, that is, at the time of photographing start. The coordinate positions for the number of shootings from the origin (x0, y0) to the coordinate position (xn, yn) immediately before the end of shooting, and FIG. b) and (c) in the figure are examples when the trajectories K do not intersect.

  The determination method in step SA202 is arbitrary, but in the present embodiment, it is performed by the following method. That is, with respect to a plurality of line segments of the locus K, each of which is divided by two points whose storage order is adjacent to each other, first, a line segment having an end point as one end is set as a target line segment, and each other line segment is sequentially targeted. The coordinate position where both line segments intersect is calculated by a predetermined arithmetic expression using the coordinate positions at both ends of both line segments as parameters, and it is confirmed whether or not the intersecting coordinate position can be obtained. If the coordinate position cannot be obtained, the line segment of interest is then changed to a line segment on the start point side with respect to the line segment having the end point as one end, and then each of the other points on the start point side of the line of interest The coordinate positions where the two line segments intersect each other are calculated again, and it is confirmed whether or not the intersecting coordinate positions are obtained. Thereafter, if the coordinate position cannot be obtained, the attention line segment is sequentially changed to the line segment on the start point side, and the same processing is repeated.

  And, even if the attention line segment is changed from the start point side to a line segment that has a predetermined number of points as one end, the coordinate position where the attention line segment and the other line segment intersect cannot be obtained Determines that the trajectory K does not intersect in any part, and conversely, if a coordinate position where any noticeable line segment intersects with any other line segment is obtained, which trajectory K is It is determined that they intersect at that part.

  Here, in the case where the shape of the trajectory K is as shown in FIG. 8A and it is determined that the trajectory intersects (YES in step SA202), and even if it does not intersect, the shape of FIG. As described above, when the current photographing position (end point) is within a predetermined range from the initial position (start point) (within the range indicated by a broken line in the drawing), that is, acquired immediately before the shutter button 4 is pressed again. When the center coordinate position of the photographed image is not more than a predetermined distance from the origin of the composition coordinate space and the current photographing position is close to the initial position to some extent (NO in step SA202, YES in step SA203). Then, it is determined whether or not there is a hollow portion in the synthesized image portion (image region after the synthesis) in the image synthesis memory (step SA204). Such a hollow portion is a portion where no photographed image exists in the image after the composition processing at Step SA8 described above. For example, if the background color at the start of composition is white, it is a white-colored region. If the background color at the time is black, it is a black area.

  FIG. 9 is a diagram exemplifying a composite image portion 101 in an image in the image composition memory. FIG. 9A shows an example where the above-described hollow portion does not exist, and FIG. 9B shows a hollow portion. This is an example in the case where exists. In FIG. 9, each of the captured images G1, G2, G3,..., And the black circle in which the portions indicated by the thin solid lines are combined with each other are their center positions, and the position of the light spot of the laser beam The portion indicated by the thick solid line is the composite image portion 101, and the region indicated by the oblique line in FIG.

  If the determination result in step SA204 is YES and it is determined that the composite image portion 101 at that time does not have a hollow portion as shown in FIG. “No unevenness” is stored (step SA205), and the completion of shooting is notified (step SA206). Then, the shooting unevenness determination process is terminated and the process returns to the main flow of FIG. The notification of the completion of photographing is performed by blinking the laser beam a predetermined number of times. About the process which concerns here, it adds by the notification sound generation means which emits arbitrary notification sounds to the imaging device 1, and performs by generation | occurrence | production of a notification sound, or the element which can change the color of a laser beam as the semiconductor laser 7 It may be performed by changing the color of laser light.

  Further, when both the determination results of steps SA202 and SA203 are NO, for example, as shown in FIG. 8C, there is no intersection in the locus K, and the current shooting position is within a predetermined range from the initial position. If not, after “uneven shooting” is stored as the determination result of uneven shooting (step SA207), the uneven shooting determination process is terminated and the process returns to the main flow of FIG.

  On the other hand, if the determination result in step SA201 described above is NO and the scan mode is set instead of the area mode as the range designation mode, the following processing is performed. As shown in FIG. 12B, the scanning mode is desired by moving the light spot O (angle of view range A) of the laser light L so that the user scans the entire range of an arbitrary imaging range without any gaps. Is a mode for designating a desired photographing range C.

  When the scanning mode is set, first, the maximum rectangular area inscribed in the composite image portion 101 is specified (step SA208), and further, the minimum rectangular area inscribed in the composite image portion 101 is specified (step SA209). . Thereafter, the difference between the areas of the two rectangular areas is obtained, and the ratio of the area difference to the area of the minimum rectangular area is calculated (step SA210).

  FIG. 10 is a diagram showing an example of the maximum rectangular area and the minimum rectangular area in the composite image portion 101. In FIG. In the figure, the portion indicated by the solid line is a captured image that is combined with each other, the portion indicated by the broken line is the maximum rectangular region 103, and the portion indicated by the alternate long and short dash line is the minimum rectangular region 104.

  Here, the composite image portion 101 has a shape as shown in FIG. 10A, and the ratio of the area difference in the minimum rectangular area 104 calculated in step SA210 is equal to or less than a predetermined ratio ( For example, in the case of 30% or less (YES in step SA211), as described above, “no shooting unevenness” is stored as the determination result of shooting unevenness (step SA205), and the completion of shooting is notified (step SA206). ), The shooting unevenness determination process is terminated, and the process returns to the main flow of FIG.

  If the composite image portion 101 has a shape as shown in FIG. 10B and the ratio of the area difference in the minimum rectangular area 104 exceeds a certain ratio (NO in step SA211), “Uneven shooting” is stored as a shooting unevenness determination result (step SA212), the shooting unevenness determination process is terminated, and the process returns to the main flow of FIG.

  After that, in the main flow, when the result of the shooting unevenness determination is “with shooting unevenness” (NO in step SA11), the process returns to step SA6 described above to automatically resume continuous shooting at the above-described fixed intervals. Then, the processing after step SA6 is repeated until there is again an instruction to end photographing by pressing the shutter button 4. Then, when there is an instruction to end shooting (YES in step SA9), the presence / absence of shooting unevenness is determined again by the shooting unevenness determination process described above (step SA10). Thereafter, the steps are taken until the shooting unevenness determination result is “no shooting unevenness”.

  For example, when the range designation mode is the area mode and it is determined that “the photographing unevenness is present” due to the presence of the hollow portion in the composite image portion, the user can select a desired one as shown in FIG. Steps SA6 to SA10 are repeated until the field angle range A is moved (set) near the center of the desired shooting range C. However, in the shooting unevenness determination process in the meantime, although omitted in FIG. 5, when the range designation mode is the area mode, the above-described determinations in steps SA202 and SA203 are skipped, and only the presence or absence of a hollow portion is determined. to decide.

  Then, when the determination result of shooting unevenness is “no shooting unevenness” from the beginning, and when “shooting unevenness” is changed to “no shooting unevenness” (YES in step SA11), FIG. 6 continues. The indicated cut-out / recording process is performed (step SA12).

  In the cutout / recording process, the setting of the above-described range designation mode is confirmed, and if it is the area mode (YES in step SA301), the cutout mode set by the second mode changeover switch 6 is the locus mode. Further check whether or not. Here, when the cut-out mode is not the trajectory mode but the maximum mode (NO in step SA302), the minimum rectangular area 104 circumscribing the above-described composite image portion in the image stored in the image composition memory (see FIG. 10) and a rectangular area having a predetermined aspect ratio (for example, 4: 3) determined in advance is specified (step SA303). Even when the range designation mode is not the area mode (NO in step SA301), the minimum rectangular area 104 (see FIG. 10) is specified (step SA303). Thereafter, the minimum rectangular area is cut out from the image stored in the image composition memory, and the image data is recorded on the memory card 11 as photographed image data (step SA305), and then the main flow of FIG. Return.

  As a result, a photographed image of the subject portion in a region wider than a predetermined field angle range A (see FIG. 11) determined by the photographing lens 8 and the photographing distance is recorded. Note that the photographed image recorded in this case is usually an image in which there is a blank portion (a background color only portion) where no subject portion exists in the outer peripheral portion.

  Thus, by cutting out the smallest rectangular area circumscribing the composite image part, it is possible to cut out the largest range of images, but the maximum rectangular area inscribed in the composite image part may be cut out. Can cut out a larger range of images without margins. Alternatively, an area having a size intermediate between the minimum rectangular area circumscribing the composite image portion and the maximum rectangular area inscribed may be cut out.

  On the other hand, if the confirmation result in step SA302 is YES and the cut-out mode is the trajectory mode, a predetermined aspect ratio (for example, 4: 3) determined in advance in the image stored in the image composition memory. ) And a minimum rectangular area circumscribing the range surrounded by the locus K of the light spot of the laser light (step SA304). Thereafter, the minimum rectangular area is cut out from the composite image portion, and the image data is recorded on the memory card 11 as photographed image data (step SA305), and the process returns to the main flow of FIG.

  As a result, a photographed image of the subject portion in a region wider than a predetermined field angle range A (see FIG. 11) determined by the photographing lens 8 and the photographing distance is recorded. Note that the captured image recorded in this case is an image in which the above-mentioned margin portion does not exist at the outer peripheral portion or the margin portion is very small.

  The maximum rectangular area inscribed in the range surrounded by the locus K of the laser light spot is cut out, or the minimum rectangular area circumscribed in the area surrounded by the locus K of the laser light spot and the maximum rectangular area inscribed An area having an intermediate size may be cut out.

  In addition, an area having an intermediate size between the maximum (small) rectangular area that is inscribed (externally) in contact with the range surrounded by the locus K of the laser light spot and the maximum (small) rectangular area that is inscribed (externally) in contact with the composite image portion. May be cut out.

  The cutout mode may be set according to the setting state of the range designation mode. For example, when the range designation mode is set to the area mode, the cutout mode is set to the trajectory mode, and the range designation mode is set to If the cut-out mode is set to the maximum mode when the scan mode is set, it is possible to capture and record a more accurate area in the area mode and a larger area in the scan mode.

  After the captured image is recorded as described above, if the power is not turned off by the user (NO in step SA13), the process returns to step SA3, and the presence / absence of a shooting start instruction by pressing the shutter button 4 is sequentially confirmed. If there is an instruction to start photographing (YES in step SA3), the above-described processing after step SA4 is repeated, and when the power is turned off (YES in step SA13), laser light emission is stopped at that point (step S13). SA14) All processes are terminated.

  Although omitted in FIG. 3, during the operation described above, the control unit 22 appropriately confirms whether or not the user has turned off the power. For example, after a shooting start instruction is given, the shooting to be enlarged is performed. Even before the acquisition of all the images required to acquire the captured image corresponding to the range is completed, for example, there is an operation to turn off the power at an arbitrary time point while repeatedly performing the processes of steps SA6 to SA11 described above. If this is the case, all the processes are stopped at that time, and the emission of the laser beam is stopped to end all the processes.

  As described above, in the imaging apparatus 1 according to the present embodiment, when shooting an enlarged shooting range wider than the range corresponding to the angle of view, the shooting range to be enlarged is irradiated to the subject during shooting. It is automatically set according to the locus of the light spot. At the same time, during shooting, it is sequentially determined whether or not acquisition of all images required for acquisition of a captured image corresponding to the shooting range to be enlarged is completed, and when it is determined that acquisition of all images is completed Thus, an image of an area corresponding to the shooting range to be enlarged is cut out from the composite image constituted by the images shot so far, and is recorded as a shot image.

  Therefore, the user can specify the shooting range easily and freely by performing the operation of specifying the shooting range to be enlarged while confirming the irradiation position of the laser beam. In addition, it is possible to easily obtain a photographed image with a wide enlarged photographing range.

  Furthermore, even in the configuration as shown in FIGS. 1 and 2 that does not have a display means such as an LCD monitor for notifying the photographer of the range to be photographed, a photographed image having no missing portion in the enlarged photographing range can be obtained. It can be easily obtained.

  In addition, as shown in FIG. 12A, as a method for specifying the photographing range to be enlarged, the user moves the light spot O (view angle range A) of the laser light L so as to draw an annular locus. A method for designating a desired imaging desired range C (range designation method using an area mode) and a laser beam so that the user scans the entire arbitrary imaging range without any gaps as shown in FIG. Two types of methods are prepared: a method of designating a desired imaging desired range C by moving an L light spot O (angle of view range A) (range designating method by scanning mode).

  Therefore, the user can efficiently designate the photographing range to be enlarged by properly using the method for designating the photographing range to be enlarged as necessary. For example, if the desired shooting range C is not so wide as compared to the angle of view according to the angle of view, a range designation method using the area mode may be used, and if the range of angle of view according to the angle of view is considerably wide. For this, a range designation method using a scanning mode may be used.

  In addition, when there is an instruction to end shooting, continuous acquisition is automatically performed if acquisition of all images required to acquire a shooting image corresponding to the shooting range to be enlarged has not been completed (if there is unevenness). Since the resumption is performed, that is, the continuous photographing is continued while invalidating the photographing end instruction, it is possible to reliably obtain a photographed image having no missing portion in the enlarged photographing range.

  In addition, when the range designation mode is the area mode, the composite image portion illustrated in FIG. 10 is used as a cut-out mode for defining a cut-out area when a captured image in the enlarged shooting range is cut out from the composite image combined during continuous shooting. 101 is a minimum rectangular area circumscribing 101 and has a maximum mode for cutting out a rectangular area having a predetermined aspect ratio (for example, 4: 3) and a predetermined aspect ratio (for example, 4: 3) and laser light. And a locus mode for cutting out the smallest rectangular area circumscribing the range surrounded by the locus K of the light spot.

  Therefore, the user selects the maximum mode as the clipping mode in advance when, for example, an image with a wider shooting range is required even if the image has a marginal portion in the outer peripheral portion, When a general image with no margin in the outer peripheral portion is required even if the shooting range is somewhat narrow, or when an image with a more accurate range is required, the trajectory mode is set in advance as the cut-out mode. By selecting it, the required image can be easily obtained.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In this embodiment, in the imaging apparatus 1 having the configuration shown in FIGS. 1 and 2, the power-off operation is performed before the acquisition of all the images necessary for acquiring the captured image corresponding to the imaging range to be enlarged is completed. Yes, when all the processes are completed, the image data in the above-mentioned image composition memory in the built-in memory 24 and the shooting position information are stored by the battery backup even after the power is turned off, and the following is shown in FIG. The control unit 22 is caused to perform the above process.

  FIG. 13 is a flowchart corresponding to FIG. That is, in the present embodiment, after starting the emission of laser light in response to the power-on operation (YES in step SB1, step SB2), when an instruction to start shooting is given (YES in step SB3), first, the built-in memory 24 Whether or not the previous shooting / recording operation was incomplete is determined based on whether or not the previous image data or shooting position information is stored in (step SB4). At this time, if the previous shooting / recording operation is not completed (NO in step SB4), the same processing as in steps SA4 to SA14 in FIG. 3 described in the first embodiment is performed (steps SB5 to SB8, step SB4). SB13-SB19).

  On the other hand, when the previous shooting / recording operation has not been completed (YES in step SB4), the camera module 21 performs the first shooting operation to acquire the shot image data (step SB9). Subsequently, feature points in the image are extracted from the composite image data already stored in the image composition memory (step SB10), and the same feature points as the feature points are detected from the current captured image data (step SB11). The current shooting position information and the trajectory data are updated based on the shift amount and shift direction of the same feature point in the composite image data and the current shot image data (step SB12).

  Thereafter, the photographic image data acquired by the first photographing operation is overwritten and combined with the photographing position in the image composition memory (step SB13), and the first embodiment is performed in the second and subsequent photographing operations thereafter. The same processing is performed.

  By performing the above processing, in the present embodiment, when the power is turned off before the acquisition of all the images necessary for acquiring the captured image corresponding to the imaging range to be enlarged is completed at the previous imaging. By using the image data or the like at the time when the previous shooting is finished as it is, it is possible to efficiently perform the shooting operation when the shooting operation once interrupted for some reason is resumed.

  However, even if the previous shooting / recording operation has not been completed, the current shooting may not be a continuation of the previous shooting. Therefore, for example, after the power is turned on, the previous image data and the shooting position information in the built-in memory 24 are automatically deleted if there is no shooting start instruction within a certain time, or the user performs a predetermined key operation (shooting When the start instruction is issued, the shutter button 4 is used for a predetermined time or more), so that a new shooting is performed in response to the shooting start instruction even if the previous shooting recording operation is not completed as necessary. It is desirable to have a configuration that can start.

(Other embodiments)
Here, in the first and second embodiments described above, the position in the synthesis coordinate space of the center of the captured image sequentially acquired by continuous shooting is the current shooting position information and the light of the laser beam. It is stored as trajectory data indicating the trajectory of the point, and the movement state of the angle of view range A (see FIG. 11) with respect to the subject is determined based on the trajectory data. It is also possible to store the position in the coordinate space as shooting position information (trajectory data), and determine the movement state of the field angle range A (see FIG. 11) relative to the subject based on the position information.

  Further, the first unevenness determination process (FIG. 5) in response to a user's instruction to end shooting, that is, the locus of the light spot of the laser beam is a predetermined shape, in other words, the movement state of the field angle range A is a predetermined movement state. Whether or not the specification of the shooting range to be enlarged has been completed, and if it has been completed, acquisition of all the images required to acquire the shot image corresponding to the shooting range to be enlarged has been completed. Whether or not it is determined may be as follows.

  For example, when the area mode is set as the range designation mode, in the above unevenness determination process, it is determined whether or not the designation of the photographing range to be enlarged is completed sequentially during the continuous photographing and should be enlarged. When it is determined that the specification of the shooting range has been completed, continuous shooting is automatically terminated, and at that point, all images required to acquire the shot image corresponding to the shooting range to be enlarged have been acquired. Only determination of whether or not is made, and if all images have not been acquired, only such determination may be repeated thereafter. In such a case, it is not necessary to give a shooting end instruction after the user specifies a desired shooting range, and the usability is improved. In that case, the user may be notified of the completion of photographing (successful photographing) by any method such as blinking of laser light.

  Further, a designation method different from the above-described embodiment may be prepared in advance as a method for designating an imaging range to be enlarged. In this case, a range designation method other than the method for designating the photographing range to be enlarged in the manner of one-stroke writing as in the area mode or the scanning mode may be prepared in advance. For example, as described above, in the area mode, as shown in FIG. 12C, a hollow portion often occurs in the central portion of the desired photographing desired range C. For this reason, after specifying the outer portion of the desired shooting range C once, a range specifying method for specifying the central portion of the desired shooting range C is prepared in advance, and a range specifying mode (temporarily adding a center) using such a range specifying method is prepared. May be provided).

  In that case, when the processing in the center addition mode is performed, for example, after determining that the locus shape of the light spot of the laser beam is annular or substantially annular from the locus data described above, the range surrounded by the locus of the light spot It is sequentially determined whether or not the current shooting position has moved to the center of the image, and when it is determined that the current shooting position has moved to the center, acquisition of a shot image corresponding to the shooting range to be immediately expanded What is necessary is just to judge that acquisition of all the images required to complete is completed.

  In the first and second embodiments described above, when the area mode is set as the range specifying mode and the trajectory mode is set as the cutout mode, the combined image is set for continuous shooting. The cutout area to be performed is a minimum rectangular area having a predetermined aspect ratio and circumscribing a range surrounded by the locus of the light spot of the laser beam. However, the following area may be used.

  For example, after correcting the locus shape of the light spot of the laser light to a smooth curved shape by the least square method based on the locus data, or based on the locus data, the locus shape that approximates the locus shape is approximated in advance. After correcting (normalizing) one or more types of figures such as a square or a rectangle, a cutout region may be set based on the corrected trajectory. In addition, the specific cutout area in that case may be the maximum rectangular area inscribed in the range surrounded by the corrected locus, in addition to the minimum rectangular area circumscribed in the area surrounded by the corrected locus.

  Further, the shape of the cutout region set based on the locus of the laser light spot does not necessarily have to be a rectangular region. For example, the region corresponding to the locus shape of the laser light spot or the corrected locus shape is cut out as it is. May be set as

  In addition, a description has been given of sequentially synthesizing newly acquired captured images during continuous shooting, but actual combining processing is not performed during continuous shooting, and shooting position information (trajectory data) is used. ) Only, and it is determined whether or not acquisition of all images necessary for acquisition of the captured image corresponding to the imaging range to be enlarged is completed, and when it is determined that acquisition of all the images is completed. All the images acquired so far may be combined at once.

  In implementing the present invention, among the functions of the imaging device 1 described above, all or a part of the functions realized by the control unit 22 can be connected to the imaging device 1 wirelessly or by wire. Other devices such as a personal computer, a PDA (Personal Digital Assistants: personal digital assistant), and a mobile phone terminal may be used.

FIGS. 1A and 1B are diagrams illustrating an external appearance of an imaging apparatus common to the embodiments of the present invention, in which FIG. 1A is a plan view, FIG. 1B is a front view, and FIG. It is a block diagram which shows the electric constitution of an imaging device. 3 is a flowchart illustrating an operation of the imaging apparatus according to the first embodiment. It is a flowchart which shows the update process of imaging | photography position information. It is a flowchart which shows imaging | photography nonuniformity determination processing. It is a flowchart which shows a cutting-out / recording process. It is a conceptual diagram which shows the coordinate space for a synthesis | combination and imaging | photography position information. It is a figure which shows the example of the locus | trajectory of the light spot of a laser beam. It is a figure which shows the example of the composite image part in the memory for image composition. It is the figure which showed the example of the largest rectangular area in a synthetic | combination image part, and the smallest rectangular area. It is a schematic diagram which shows the positional relationship of the field angle range which can be image | photographed, and the light spot of a laser beam. It is a schematic diagram which shows the designation | designated method of imaging | photography desired range. 10 is a flowchart illustrating an operation of the imaging apparatus according to the second embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Main body 3 Power button 4 Shutter button 5 1st mode switch 6 Second mode switch 7 Semiconductor laser 8 Shooting lens 9 Memory card slot 10 Data output terminal 11 Memory card 21 Camera module 22 Control part 23 ROM
24 Built-in memory 25 External memory interface 26 Data output interface 27 Laser emission unit 28 Switch unit 29 Power supply unit 31 Imaging unit 32 Signal processing unit A Field angle range B Whiteboard C Desired shooting range K Trajectory L Laser beam O Light spot

Claims (14)

An imaging apparatus that acquires a second captured image with an expanded imaging range by aligning and synthesizing a plurality of first captured images acquired by a plurality of imaging operations,
Imaging means for imaging a subject;
Photographing control means for causing the imaging means to perform a continuous photographing operation for repeatedly photographing a subject;
Combining means for aligning and synthesizing a plurality of first captured images acquired by the continuous imaging operation of the imaging means;
Irradiation means for irradiating an instruction light indicating a photographing position toward a specific position within an angle of view while a continuous photographing operation is performed by the imaging means;
An acquisition means for acquiring a predetermined area determined in correspondence with the irradiation position of the instruction light by the irradiation means in the combined image synthesized by the alignment by the combining means;
An imaging apparatus comprising: Trajectory information acquisition means for acquiring trajectory information indicating the trajectory of the light spot of the instruction light in the subject while the continuous photographing operation is performed by the imaging means based on the first photographed image acquired by the imaging means. When,
An area setting unit that sets a predetermined area corresponding to the locus of the light spot indicated by the locus information acquired by the locus information acquisition unit in the combined image that is aligned and combined by the combining unit;
The imaging apparatus according to claim 1, wherein the acquisition unit acquires a predetermined region of the composite image set by the region setting unit as the second captured image.   The area setting means sets, as the predetermined area, a minimum rectangular area having a predetermined aspect ratio including a range surrounded by the locus of the light spot in the synthesized image synthesized by the synthesizing means. The imaging device according to claim 2.   The imaging apparatus according to claim 2, wherein the area setting unit sets, as the predetermined area, a minimum rectangular area circumscribing a range surrounded by the locus of the light spot or a maximum rectangular area inscribed.   The imaging apparatus according to claim 3, wherein the synthesizing unit synthesizes a synthesized image in which the light spot imaged in the first photographed image is removed.   The synthesizing unit acquires a second photographed image from which the locus of the light spot is removed when obtaining a region including the locus of the light spot as the second photographed image. Item 4. The imaging device according to Item 3.   The trajectory information acquisition means is a coordinate position in an image space used when the plurality of first photographed images are synthesized by the synthesizing means as the trajectory information, and is used for alignment of the plurality of first photographed images. The imaging apparatus according to claim 1, wherein the position of the light spot that changes with the acquisition is acquired. Judgment to determine whether or not acquisition of all the first photographed images required for obtaining the second photographed image has been completed based on the plurality of first photographed images obtained by the continuous photographing operation of the imaging means. With means,
The area setting means sets the predetermined area to a composite image composed of a plurality of first photographed images acquired until the judgment means judges that acquisition of all the photographed images has been completed. The imaging apparatus according to claim 1, wherein: Determination means for determining whether or not the locus shape of the light spot indicated by the locus information acquired by the locus information acquisition means is a predetermined locus shape;
The determination unit determines whether or not acquisition of all the first captured images has been completed on the condition that the determination unit determines that the locus shape of the light spot is a predetermined locus shape. The imaging apparatus according to claim 8.   The imaging apparatus according to claim 9, wherein the predetermined locus shape is annular. There are multiple methods for specifying the shooting range to be enlarged.
The imaging device according to claim 9, wherein the determination unit determines whether or not the trajectory shape of the light spot is a predetermined trajectory shape corresponding to a range designating method selected in advance by a user.   In response to a shooting start instruction from a user, the shooting control unit starts a continuous shooting operation in the imaging unit, and in response to a shooting end instruction from a user, the shooting control unit performs a continuous shooting operation in the imaging unit. And when the determination unit determines that the acquisition of all the captured images is not completed, the determination unit determines whether the acquisition of all the captured images has been completed. The imaging apparatus according to claim 1, further comprising a control unit that causes the control unit to resume a continuous shooting operation in the imaging unit. An imaging method for acquiring a second captured image with an expanded imaging range by aligning and synthesizing a plurality of first captured images acquired by a plurality of imaging operations,
A step of causing the imaging means to perform a continuous shooting operation of repeatedly imaging a subject while irradiating an instruction light indicating a shooting position toward a specific position within an angle of view;
A predetermined area determined corresponding to the irradiation position of the instruction light in the composite image obtained by aligning and synthesizing the plurality of first captured images acquired by the continuous capturing operation is acquired as the second captured image. A photographing method comprising the steps of: A computer having an imaging device that acquires a second captured image with an expanded imaging range by aligning and synthesizing a plurality of first captured images acquired by a plurality of imaging operations,
A procedure for causing the imaging means to perform a continuous shooting operation of repeatedly imaging a subject while irradiating an instruction light indicating a shooting position toward a specific position within an angle of view
A predetermined area determined corresponding to the irradiation position of the instruction light in the composite image obtained by aligning and synthesizing the plurality of first captured images acquired by the continuous capturing operation is acquired as the second captured image. A shooting program characterized by causing a procedure and to be executed.

Images